2024-03-12T17:03:42.704 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-12T17:03:42.704 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2024-03-12_14:59:27-fs-wip-yuri11-testing-2024-03-11-0838-reef-distro-default-smithi/7593742 --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/asok_dump_tree} --name yuriw-2024-03-12_14:59:27-fs-wip-yuri11-testing-2024-03-11-0838-reef-distro-default-smithi --verbose -- /home/teuthworker/archive/yuriw-2024-03-12_14:59:27-fs-wip-yuri11-testing-2024-03-11-0838-reef-distro-default-smithi/7593742/orig.config.yaml 2024-03-12T17:03:42.749 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-12T17:03:42.834 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-03-12_14:59:27-fs-wip-yuri11-testing-2024-03-11-0838-reef-distro-default-smithi/7593742 branch: wip-yuri11-testing-2024-03-11-0838-reef description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/asok_dump_tree} email: yweinste@redhat.com first_in_suite: false job_id: '7593742' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2024-03-12_14:59:27-fs-wip-yuri11-testing-2024-03-11-0838-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuri11-testing-2024-03-11-0838-reef ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 49e4a6794d5502bd66908faf714fc54896c51712 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 49e4a6794d5502bd66908faf714fc54896c51712 kclient: syntax: v2 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri11-testing-2024-03-11-0838-reef sha1: 49e4a6794d5502bd66908faf714fc54896c51712 owner: scheduled_yuriw@teuthology priority: 71 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 9096 sha1: 49e4a6794d5502bd66908faf714fc54896c51712 sleep_before_teardown: 0 subset: 111/120000 suite: fs suite_branch: wip-yuri11-testing-2024-03-11-0838-reef suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_49e4a6794d5502bd66908faf714fc54896c51712/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 49e4a6794d5502bd66908faf714fc54896c51712 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi017.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBqlMRN7UkesTbPmmEl/Fu33YbcUUW+S7CaISm4Tqk3pP+0ezaEyT2I38Sgxt1DP2LZik+P22JmtaEtvCRScUkA= smithi094.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMeHIyWbUAqn+IYD1RDvRs+UR8VUiDaQcRsg7RqsboRUENvrnVUDMtNdw0d+m4rETIWEK58NMqv8ka9jMdfQbZY= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_dump_tree teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-12_14:59:27 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-12T17:03:42.834 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_49e4a6794d5502bd66908faf714fc54896c51712/qa; will attempt to use it 2024-03-12T17:03:42.835 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_49e4a6794d5502bd66908faf714fc54896c51712/qa/tasks 2024-03-12T17:03:42.835 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-12T17:03:42.837 INFO:teuthology.task.internal:Checking packages... 2024-03-12T17:03:42.861 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '49e4a6794d5502bd66908faf714fc54896c51712' 2024-03-12T17:03:42.861 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-12T17:03:42.862 INFO:teuthology.packaging:ref: None 2024-03-12T17:03:42.862 INFO:teuthology.packaging:tag: None 2024-03-12T17:03:42.862 INFO:teuthology.packaging:branch: wip-yuri11-testing-2024-03-11-0838-reef 2024-03-12T17:03:42.862 INFO:teuthology.packaging:sha1: 49e4a6794d5502bd66908faf714fc54896c51712 2024-03-12T17:03:42.862 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuri11-testing-2024-03-11-0838-reef 2024-03-12T17:03:43.093 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-797.g49e4a679 2024-03-12T17:03:43.095 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-12T17:03:43.101 INFO:teuthology.task.internal:no buildpackages task found 2024-03-12T17:03:43.101 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-12T17:03:43.136 INFO:teuthology.task.internal:Saving configuration 2024-03-12T17:03:43.153 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-12T17:03:43.161 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-12T17:03:43.186 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-03-12_14:59:27-fs-wip-yuri11-testing-2024-03-11-0838-reef-distro-default-smithi/7593742', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-12 16:58:49.804604', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBqlMRN7UkesTbPmmEl/Fu33YbcUUW+S7CaISm4Tqk3pP+0ezaEyT2I38Sgxt1DP2LZik+P22JmtaEtvCRScUkA='} 2024-03-12T17:03:43.208 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi094.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-03-12_14:59:27-fs-wip-yuri11-testing-2024-03-11-0838-reef-distro-default-smithi/7593742', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-12 16:58:49.805969', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMeHIyWbUAqn+IYD1RDvRs+UR8VUiDaQcRsg7RqsboRUENvrnVUDMtNdw0d+m4rETIWEK58NMqv8ka9jMdfQbZY='} 2024-03-12T17:03:43.208 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-12T17:03:43.215 INFO:teuthology.task.internal:roles: ubuntu@smithi017.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-03-12T17:03:43.215 INFO:teuthology.task.internal:roles: ubuntu@smithi094.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-03-12T17:03:43.215 INFO:teuthology.run_tasks:Running task console_log... 2024-03-12T17:03:43.298 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f05996d7160>, signals=[15]) 2024-03-12T17:03:43.298 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-12T17:03:43.305 INFO:teuthology.task.internal:Opening connections... 2024-03-12T17:03:43.305 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi017.front.sepia.ceph.com 2024-03-12T17:03:43.307 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T17:03:43.411 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi094.front.sepia.ceph.com 2024-03-12T17:03:43.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T17:03:43.560 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-12T17:03:43.567 DEBUG:teuthology.orchestra.run.smithi017:> uname -m 2024-03-12T17:03:43.586 INFO:teuthology.orchestra.run.smithi017.stdout:x86_64 2024-03-12T17:03:43.586 DEBUG:teuthology.orchestra.run.smithi017:> cat /etc/os-release 2024-03-12T17:03:43.644 INFO:teuthology.orchestra.run.smithi017.stdout:NAME="CentOS Stream" 2024-03-12T17:03:43.644 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION="9" 2024-03-12T17:03:43.644 INFO:teuthology.orchestra.run.smithi017.stdout:ID="centos" 2024-03-12T17:03:43.645 INFO:teuthology.orchestra.run.smithi017.stdout:ID_LIKE="rhel fedora" 2024-03-12T17:03:43.645 INFO:teuthology.orchestra.run.smithi017.stdout:VERSION_ID="9" 2024-03-12T17:03:43.645 INFO:teuthology.orchestra.run.smithi017.stdout:PLATFORM_ID="platform:el9" 2024-03-12T17:03:43.645 INFO:teuthology.orchestra.run.smithi017.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-12T17:03:43.645 INFO:teuthology.orchestra.run.smithi017.stdout:ANSI_COLOR="0;31" 2024-03-12T17:03:43.645 INFO:teuthology.orchestra.run.smithi017.stdout:LOGO="fedora-logo-icon" 2024-03-12T17:03:43.645 INFO:teuthology.orchestra.run.smithi017.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-12T17:03:43.645 INFO:teuthology.orchestra.run.smithi017.stdout:HOME_URL="https://centos.org/" 2024-03-12T17:03:43.645 INFO:teuthology.orchestra.run.smithi017.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-12T17:03:43.645 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-12T17:03:43.645 INFO:teuthology.orchestra.run.smithi017.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-12T17:03:43.646 INFO:teuthology.lock.ops:Updating smithi017.front.sepia.ceph.com on lock server 2024-03-12T17:03:43.674 DEBUG:teuthology.orchestra.run.smithi094:> uname -m 2024-03-12T17:03:43.692 INFO:teuthology.orchestra.run.smithi094.stdout:x86_64 2024-03-12T17:03:43.692 DEBUG:teuthology.orchestra.run.smithi094:> cat /etc/os-release 2024-03-12T17:03:43.749 INFO:teuthology.orchestra.run.smithi094.stdout:NAME="CentOS Stream" 2024-03-12T17:03:43.749 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION="9" 2024-03-12T17:03:43.749 INFO:teuthology.orchestra.run.smithi094.stdout:ID="centos" 2024-03-12T17:03:43.749 INFO:teuthology.orchestra.run.smithi094.stdout:ID_LIKE="rhel fedora" 2024-03-12T17:03:43.749 INFO:teuthology.orchestra.run.smithi094.stdout:VERSION_ID="9" 2024-03-12T17:03:43.750 INFO:teuthology.orchestra.run.smithi094.stdout:PLATFORM_ID="platform:el9" 2024-03-12T17:03:43.750 INFO:teuthology.orchestra.run.smithi094.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-12T17:03:43.750 INFO:teuthology.orchestra.run.smithi094.stdout:ANSI_COLOR="0;31" 2024-03-12T17:03:43.750 INFO:teuthology.orchestra.run.smithi094.stdout:LOGO="fedora-logo-icon" 2024-03-12T17:03:43.750 INFO:teuthology.orchestra.run.smithi094.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-12T17:03:43.750 INFO:teuthology.orchestra.run.smithi094.stdout:HOME_URL="https://centos.org/" 2024-03-12T17:03:43.750 INFO:teuthology.orchestra.run.smithi094.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-12T17:03:43.750 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-12T17:03:43.750 INFO:teuthology.orchestra.run.smithi094.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-12T17:03:43.750 INFO:teuthology.lock.ops:Updating smithi094.front.sepia.ceph.com on lock server 2024-03-12T17:03:43.774 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-12T17:03:43.783 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-12T17:03:43.803 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-12T17:03:43.804 DEBUG:teuthology.orchestra.run.smithi017:> test '!' -e /home/ubuntu/cephtest 2024-03-12T17:03:43.806 DEBUG:teuthology.orchestra.run.smithi094:> test '!' -e /home/ubuntu/cephtest 2024-03-12T17:03:43.822 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-12T17:03:43.837 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-12T17:03:43.837 DEBUG:teuthology.orchestra.run.smithi017:> test -z $(ls -A /var/lib/ceph) 2024-03-12T17:03:43.864 DEBUG:teuthology.orchestra.run.smithi094:> test -z $(ls -A /var/lib/ceph) 2024-03-12T17:03:43.971 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-12T17:03:44.020 INFO:teuthology.run_tasks:Running task kernel... 2024-03-12T17:03:44.036 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2024-03-12T17:03:44.036 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-03-12T17:03:44.036 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-03-12T17:03:44.036 DEBUG:teuthology.orchestra.run.smithi017:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-12T17:03:44.037 DEBUG:teuthology.orchestra.run.smithi094:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-12T17:03:44.053 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-12T17:03:44.053 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-03-12T17:03:44.059 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-12T17:03:44.059 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-03-12T17:03:44.299 DEBUG:teuthology.task.kernel:sha1 for client.1 is bf761b6efc7e0ff8090671a5bd7700e429806836 2024-03-12T17:03:44.299 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "bf761b6efc7e0ff8090671a5bd7700e429806836"... 2024-03-12T17:03:44.299 DEBUG:teuthology.orchestra.run.smithi094:> uname -r 2024-03-12T17:03:44.316 INFO:teuthology.orchestra.run.smithi094.stdout:5.14.0-361.el9.x86_64 2024-03-12T17:03:44.316 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs bf761b6efc7e0ff8090671a5bd7700e429806836 2024-03-12T17:03:44.317 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-12T17:03:44.317 DEBUG:teuthology.orchestra.run.smithi094:> sudo yum upgrade -y linux-firmware 2024-03-12T17:03:44.379 DEBUG:teuthology.task.kernel:sha1 for client.0 is bf761b6efc7e0ff8090671a5bd7700e429806836 2024-03-12T17:03:44.379 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "bf761b6efc7e0ff8090671a5bd7700e429806836"... 2024-03-12T17:03:44.379 DEBUG:teuthology.orchestra.run.smithi017:> uname -r 2024-03-12T17:03:44.397 INFO:teuthology.orchestra.run.smithi017.stdout:5.14.0-361.el9.x86_64 2024-03-12T17:03:44.397 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs bf761b6efc7e0ff8090671a5bd7700e429806836 2024-03-12T17:03:44.397 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-12T17:03:44.398 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum upgrade -y linux-firmware 2024-03-12T17:03:46.792 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS-9 - AppStream 8.8 MB/s | 6.7 MB 00:00 2024-03-12T17:03:46.812 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS-9 - AppStream 8.6 MB/s | 6.7 MB 00:00 2024-03-12T17:03:48.387 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS-9 - BaseOS 4.3 MB/s | 2.0 MB 00:00 2024-03-12T17:03:48.526 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS-9 - BaseOS 3.5 MB/s | 2.0 MB 00:00 2024-03-12T17:03:55.265 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - BaseOS 1.2 MB/s | 8.0 MB 00:06 2024-03-12T17:04:07.010 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - BaseOS 453 kB/s | 8.0 MB 00:18 2024-03-12T17:04:14.940 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - AppStream 2.8 MB/s | 19 MB 00:06 2024-03-12T17:04:25.427 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - CRB 924 kB/s | 6.1 MB 00:06 2024-03-12T17:04:27.161 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - Extras packages 30 kB/s | 15 kB 00:00 2024-03-12T17:04:28.365 INFO:teuthology.orchestra.run.smithi017.stdout:Extra Packages for Enterprise Linux 19 MB/s | 21 MB 00:01 2024-03-12T17:04:33.671 INFO:teuthology.orchestra.run.smithi017.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-03-12T17:04:36.052 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-03-12T17:04:36.075 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-03-12T17:04:36.075 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-03-12T17:04:36.076 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-03-12T17:04:36.076 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrading: 2024-03-12T17:04:36.076 INFO:teuthology.orchestra.run.smithi017.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-03-12T17:04:36.076 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:04:36.076 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-03-12T17:04:36.076 INFO:teuthology.orchestra.run.smithi017.stdout:================================================================================ 2024-03-12T17:04:36.076 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrade 1 Package 2024-03-12T17:04:36.076 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:04:36.076 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 375 M 2024-03-12T17:04:36.076 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-03-12T17:04:40.544 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - AppStream 436 kB/s | 19 MB 00:44 2024-03-12T17:04:44.130 INFO:teuthology.orchestra.run.smithi017.stdout:linux-firmware-20240219-143.el9.noarch.rpm 47 MB/s | 375 MB 00:08 2024-03-12T17:04:44.131 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-03-12T17:04:44.131 INFO:teuthology.orchestra.run.smithi017.stdout:Total 47 MB/s | 375 MB 00:08 2024-03-12T17:04:44.132 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-03-12T17:04:44.224 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-03-12T17:04:44.224 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-03-12T17:04:46.760 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-03-12T17:04:46.761 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-03-12T17:04:49.832 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - CRB 1.1 MB/s | 6.1 MB 00:05 2024-03-12T17:04:51.459 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - Extras packages 59 kB/s | 15 kB 00:00 2024-03-12T17:04:52.244 INFO:teuthology.orchestra.run.smithi094.stdout:Extra Packages for Enterprise Linux 31 MB/s | 21 MB 00:00 2024-03-12T17:04:53.311 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-03-12T17:04:53.528 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-12T17:04:53.633 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-12T17:04:54.872 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-03-12T17:04:54.873 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-12T17:04:55.262 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-12T17:04:55.262 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:04:55.262 INFO:teuthology.orchestra.run.smithi017.stdout:Upgraded: 2024-03-12T17:04:55.262 INFO:teuthology.orchestra.run.smithi017.stdout: linux-firmware-20240219-143.el9.noarch 2024-03-12T17:04:55.262 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:04:55.262 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-03-12T17:04:55.549 INFO:teuthology.task.kernel:Downloading kernel bf761b6efc7e0ff8090671a5bd7700e429806836 on client.0... 2024-03-12T17:04:55.550 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bf761b6efc7e0ff8090671a5bd7700e429806836 2024-03-12T17:04:55.698 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/bf761b6efc7e0ff8090671a5bd7700e429806836/centos/9/flavors/default/x86_64/ 2024-03-12T17:04:55.698 DEBUG:teuthology.orchestra.run.smithi017:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_rc7_gbf761b6efc7e-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/bf761b6efc7e0ff8090671a5bd7700e429806836/centos/9/flavors/default/x86_64/ --input-file=- 2024-03-12T17:04:55.701 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi017.front.sepia.ceph.com to complete... 2024-03-12T17:04:57.144 INFO:teuthology.orchestra.run.smithi094.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2024-03-12T17:04:59.430 INFO:teuthology.orchestra.run.smithi094.stdout:Dependencies resolved. 2024-03-12T17:04:59.441 INFO:teuthology.orchestra.run.smithi094.stdout:================================================================================ 2024-03-12T17:04:59.441 INFO:teuthology.orchestra.run.smithi094.stdout: Package Arch Version Repository Size 2024-03-12T17:04:59.441 INFO:teuthology.orchestra.run.smithi094.stdout:================================================================================ 2024-03-12T17:04:59.441 INFO:teuthology.orchestra.run.smithi094.stdout:Upgrading: 2024-03-12T17:04:59.441 INFO:teuthology.orchestra.run.smithi094.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-03-12T17:04:59.442 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:04:59.442 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction Summary 2024-03-12T17:04:59.442 INFO:teuthology.orchestra.run.smithi094.stdout:================================================================================ 2024-03-12T17:04:59.442 INFO:teuthology.orchestra.run.smithi094.stdout:Upgrade 1 Package 2024-03-12T17:04:59.442 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:04:59.442 INFO:teuthology.orchestra.run.smithi094.stdout:Total download size: 375 M 2024-03-12T17:04:59.442 INFO:teuthology.orchestra.run.smithi094.stdout:Downloading Packages: 2024-03-12T17:05:09.237 INFO:teuthology.orchestra.run.smithi094.stdout:linux-firmware-20240219-143.el9.noarch.rpm 38 MB/s | 375 MB 00:09 2024-03-12T17:05:09.237 INFO:teuthology.orchestra.run.smithi094.stdout:-------------------------------------------------------------------------------- 2024-03-12T17:05:09.238 INFO:teuthology.orchestra.run.smithi094.stdout:Total 38 MB/s | 375 MB 00:09 2024-03-12T17:05:09.238 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction check 2024-03-12T17:05:09.332 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction check succeeded. 2024-03-12T17:05:09.333 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction test 2024-03-12T17:05:11.778 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction test succeeded. 2024-03-12T17:05:11.779 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction 2024-03-12T17:05:18.222 INFO:teuthology.orchestra.run.smithi094.stdout: Preparing : 1/1 2024-03-12T17:05:18.483 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-12T17:05:18.564 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-12T17:05:19.802 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-03-12T17:05:19.802 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-12T17:05:20.190 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-12T17:05:20.190 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:05:20.190 INFO:teuthology.orchestra.run.smithi094.stdout:Upgraded: 2024-03-12T17:05:20.190 INFO:teuthology.orchestra.run.smithi094.stdout: linux-firmware-20240219-143.el9.noarch 2024-03-12T17:05:20.191 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:05:20.191 INFO:teuthology.orchestra.run.smithi094.stdout:Complete! 2024-03-12T17:05:20.487 INFO:teuthology.task.kernel:Downloading kernel bf761b6efc7e0ff8090671a5bd7700e429806836 on client.1... 2024-03-12T17:05:20.487 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bf761b6efc7e0ff8090671a5bd7700e429806836 2024-03-12T17:05:20.831 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/bf761b6efc7e0ff8090671a5bd7700e429806836/centos/9/flavors/default/x86_64/ 2024-03-12T17:05:20.831 DEBUG:teuthology.orchestra.run.smithi094:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_rc7_gbf761b6efc7e-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/bf761b6efc7e0ff8090671a5bd7700e429806836/centos/9/flavors/default/x86_64/ --input-file=- 2024-03-12T17:05:20.834 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi094.front.sepia.ceph.com to complete... 2024-03-12T17:05:33.145 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12 17:05:33 URL:https://3.chacra.ceph.com/r/kernel/testing/bf761b6efc7e0ff8090671a5bd7700e429806836/centos/9/flavors/default/x86_64/kernel-6.8.0_rc7_gbf761b6efc7e-1.x86_64.rpm [336341774/336341774] -> "/tmp/kernel.x86_64.rpm" [1] 2024-03-12T17:05:33.145 INFO:teuthology.orchestra.run.smithi094.stderr:FINISHED --2024-03-12 17:05:33-- 2024-03-12T17:05:33.145 INFO:teuthology.orchestra.run.smithi094.stderr:Total wall clock time: 12s 2024-03-12T17:05:33.146 INFO:teuthology.orchestra.run.smithi094.stderr:Downloaded: 1 files, 321M in 12s (26.7 MB/s) 2024-03-12T17:05:33.148 INFO:teuthology.task.kernel:Installing kernel bf761b6efc7e0ff8090671a5bd7700e429806836 on client.1... 2024-03-12T17:05:33.149 DEBUG:teuthology.orchestra.run.smithi094:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-03-12T17:05:35.077 INFO:teuthology.orchestra.run.smithi094.stdout:Verifying... ######################################## 2024-03-12T17:05:35.216 INFO:teuthology.orchestra.run.smithi094.stdout:Preparing... ######################################## 2024-03-12T17:05:35.295 INFO:teuthology.orchestra.run.smithi094.stdout:Updating / installing... 2024-03-12T17:05:42.736 INFO:teuthology.orchestra.run.smithi094.stdout:kernel-6.8.0_rc7_gbf761b6efc7e-1 ######################################## 2024-03-12T17:05:59.451 INFO:teuthology.orchestra.run.smithi094.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-12T17:06:01.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12 17:06:01 URL:https://3.chacra.ceph.com/r/kernel/testing/bf761b6efc7e0ff8090671a5bd7700e429806836/centos/9/flavors/default/x86_64/kernel-6.8.0_rc7_gbf761b6efc7e-1.x86_64.rpm [336341774/336341774] -> "/tmp/kernel.x86_64.rpm" [1] 2024-03-12T17:06:01.679 INFO:teuthology.orchestra.run.smithi017.stderr:FINISHED --2024-03-12 17:06:01-- 2024-03-12T17:06:01.679 INFO:teuthology.orchestra.run.smithi017.stderr:Total wall clock time: 1m 6s 2024-03-12T17:06:01.680 INFO:teuthology.orchestra.run.smithi017.stderr:Downloaded: 1 files, 321M in 1m 6s (4.89 MB/s) 2024-03-12T17:06:01.683 INFO:teuthology.task.kernel:Installing kernel bf761b6efc7e0ff8090671a5bd7700e429806836 on client.0... 2024-03-12T17:06:01.683 DEBUG:teuthology.orchestra.run.smithi017:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-03-12T17:06:03.715 INFO:teuthology.orchestra.run.smithi017.stdout:Verifying... ######################################## 2024-03-12T17:06:03.772 INFO:teuthology.orchestra.run.smithi017.stdout:Preparing... ######################################## 2024-03-12T17:06:03.857 INFO:teuthology.orchestra.run.smithi017.stdout:Updating / installing... 2024-03-12T17:06:11.699 INFO:teuthology.orchestra.run.smithi017.stdout:kernel-6.8.0_rc7_gbf761b6efc7e-1 ######################################## 2024-03-12T17:06:21.995 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi094.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-03-12T17:06:21.996 DEBUG:teuthology.orchestra.run.smithi094:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-03-12T17:06:22.064 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e 2024-03-12T17:06:22.064 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/System.map 2024-03-12T17:06:22.064 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/config 2024-03-12T17:06:22.064 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel 2024-03-12T17:06:22.065 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch 2024-03-12T17:06:22.065 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86 2024-03-12T17:06:22.065 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto 2024-03-12T17:06:22.065 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-12T17:06:22.065 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-12T17:06:22.065 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-12T17:06:22.065 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-12T17:06:22.065 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-12T17:06:22.065 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-12T17:06:22.065 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-12T17:06:22.065 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto/crc32c-intel.ko 2024-03-12T17:06:22.065 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-12T17:06:22.065 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-12T17:06:22.065 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-12T17:06:22.066 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-12T17:06:22.066 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-12T17:06:22.066 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-12T17:06:22.066 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-12T17:06:22.066 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-12T17:06:22.066 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-12T17:06:22.066 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-12T17:06:22.066 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-12T17:06:22.066 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-12T17:06:22.066 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/kernel 2024-03-12T17:06:22.066 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/kernel/cpu 2024-03-12T17:06:22.066 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/kernel/cpu/mce 2024-03-12T17:06:22.066 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-12T17:06:22.067 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/kvm 2024-03-12T17:06:22.067 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-12T17:06:22.067 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-12T17:06:22.067 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/kvm/kvm.ko 2024-03-12T17:06:22.067 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto 2024-03-12T17:06:22.067 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/ansi_cprng.ko 2024-03-12T17:06:22.067 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/anubis.ko 2024-03-12T17:06:22.067 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/arc4.ko 2024-03-12T17:06:22.067 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/async_tx 2024-03-12T17:06:22.067 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/async_tx/async_memcpy.ko 2024-03-12T17:06:22.067 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/async_tx/async_pq.ko 2024-03-12T17:06:22.067 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-12T17:06:22.067 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/async_tx/async_tx.ko 2024-03-12T17:06:22.067 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/async_tx/async_xor.ko 2024-03-12T17:06:22.068 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/async_tx/raid6test.ko 2024-03-12T17:06:22.068 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/authenc.ko 2024-03-12T17:06:22.068 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/authencesn.ko 2024-03-12T17:06:22.068 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/blake2b_generic.ko 2024-03-12T17:06:22.068 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/blowfish_common.ko 2024-03-12T17:06:22.068 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/blowfish_generic.ko 2024-03-12T17:06:22.068 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/camellia_generic.ko 2024-03-12T17:06:22.068 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/cast5_generic.ko 2024-03-12T17:06:22.068 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/cast6_generic.ko 2024-03-12T17:06:22.068 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/cast_common.ko 2024-03-12T17:06:22.068 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/ccm.ko 2024-03-12T17:06:22.068 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/cmac.ko 2024-03-12T17:06:22.068 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/crc32_generic.ko 2024-03-12T17:06:22.069 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/crypto_engine.ko 2024-03-12T17:06:22.069 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/crypto_user.ko 2024-03-12T17:06:22.069 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/cts.ko 2024-03-12T17:06:22.069 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/des_generic.ko 2024-03-12T17:06:22.069 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/dh_generic.ko 2024-03-12T17:06:22.069 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/echainiv.ko 2024-03-12T17:06:22.069 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/essiv.ko 2024-03-12T17:06:22.069 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/fcrypt.ko 2024-03-12T17:06:22.069 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/khazad.ko 2024-03-12T17:06:22.069 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/lz4.ko 2024-03-12T17:06:22.069 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/lz4hc.ko 2024-03-12T17:06:22.069 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/md4.ko 2024-03-12T17:06:22.070 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/michael_mic.ko 2024-03-12T17:06:22.070 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/pcbc.ko 2024-03-12T17:06:22.070 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/pcrypt.ko 2024-03-12T17:06:22.070 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/rmd160.ko 2024-03-12T17:06:22.070 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/seed.ko 2024-03-12T17:06:22.070 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/serpent_generic.ko 2024-03-12T17:06:22.070 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/tcrypt.ko 2024-03-12T17:06:22.070 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/tea.ko 2024-03-12T17:06:22.070 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/twofish_common.ko 2024-03-12T17:06:22.070 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/twofish_generic.ko 2024-03-12T17:06:22.070 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/vmac.ko 2024-03-12T17:06:22.070 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/wp512.ko 2024-03-12T17:06:22.070 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/xcbc.ko 2024-03-12T17:06:22.071 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/xor.ko 2024-03-12T17:06:22.071 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/xxhash_generic.ko 2024-03-12T17:06:22.071 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers 2024-03-12T17:06:22.071 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/acpi 2024-03-12T17:06:22.071 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-12T17:06:22.071 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/acpi/acpi_pad.ko 2024-03-12T17:06:22.071 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/acpi/custom_method.ko 2024-03-12T17:06:22.071 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/acpi/ec_sys.ko 2024-03-12T17:06:22.071 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/acpi/platform_profile.ko 2024-03-12T17:06:22.071 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/acpi/sbs.ko 2024-03-12T17:06:22.071 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/acpi/sbshc.ko 2024-03-12T17:06:22.071 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/acpi/video.ko 2024-03-12T17:06:22.071 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata 2024-03-12T17:06:22.071 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/acard-ahci.ko 2024-03-12T17:06:22.071 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/ahci_platform.ko 2024-03-12T17:06:22.072 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/ata_generic.ko 2024-03-12T17:06:22.072 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/libahci_platform.ko 2024-03-12T17:06:22.072 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_acpi.ko 2024-03-12T17:06:22.072 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_ali.ko 2024-03-12T17:06:22.072 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_amd.ko 2024-03-12T17:06:22.072 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_artop.ko 2024-03-12T17:06:22.072 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_atiixp.ko 2024-03-12T17:06:22.072 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_atp867x.ko 2024-03-12T17:06:22.072 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_cmd640.ko 2024-03-12T17:06:22.072 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_cmd64x.ko 2024-03-12T17:06:22.072 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_cypress.ko 2024-03-12T17:06:22.072 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_efar.ko 2024-03-12T17:06:22.072 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_hpt366.ko 2024-03-12T17:06:22.072 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_hpt37x.ko 2024-03-12T17:06:22.072 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-12T17:06:22.073 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-12T17:06:22.073 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_it8213.ko 2024-03-12T17:06:22.073 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_it821x.ko 2024-03-12T17:06:22.073 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_jmicron.ko 2024-03-12T17:06:22.073 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_marvell.ko 2024-03-12T17:06:22.073 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_mpiix.ko 2024-03-12T17:06:22.073 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_netcell.ko 2024-03-12T17:06:22.073 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_ninja32.ko 2024-03-12T17:06:22.073 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_ns87410.ko 2024-03-12T17:06:22.073 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_ns87415.ko 2024-03-12T17:06:22.073 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_oldpiix.ko 2024-03-12T17:06:22.073 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_opti.ko 2024-03-12T17:06:22.073 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_optidma.ko 2024-03-12T17:06:22.074 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_pcmcia.ko 2024-03-12T17:06:22.074 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-12T17:06:22.074 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-12T17:06:22.074 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_piccolo.ko 2024-03-12T17:06:22.074 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_rdc.ko 2024-03-12T17:06:22.074 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_sch.ko 2024-03-12T17:06:22.074 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_serverworks.ko 2024-03-12T17:06:22.074 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_sil680.ko 2024-03-12T17:06:22.074 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_sis.ko 2024-03-12T17:06:22.074 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_sl82c105.ko 2024-03-12T17:06:22.074 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_triflex.ko 2024-03-12T17:06:22.074 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_via.ko 2024-03-12T17:06:22.074 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pdc_adma.ko 2024-03-12T17:06:22.074 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/sata_inic162x.ko 2024-03-12T17:06:22.075 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/sata_mv.ko 2024-03-12T17:06:22.075 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/sata_nv.ko 2024-03-12T17:06:22.075 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/sata_promise.ko 2024-03-12T17:06:22.075 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/sata_qstor.ko 2024-03-12T17:06:22.075 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/sata_sil.ko 2024-03-12T17:06:22.075 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/sata_sil24.ko 2024-03-12T17:06:22.075 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/sata_sis.ko 2024-03-12T17:06:22.075 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/sata_svw.ko 2024-03-12T17:06:22.075 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/sata_sx4.ko 2024-03-12T17:06:22.075 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/sata_uli.ko 2024-03-12T17:06:22.075 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/sata_via.ko 2024-03-12T17:06:22.075 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/sata_vsc.ko 2024-03-12T17:06:22.075 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/auxdisplay 2024-03-12T17:06:22.075 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/auxdisplay/ks0108.ko 2024-03-12T17:06:22.075 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/base 2024-03-12T17:06:22.076 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/base/regmap 2024-03-12T17:06:22.076 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/base/regmap/regmap-i2c.ko 2024-03-12T17:06:22.076 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/base/regmap/regmap-mmio.ko 2024-03-12T17:06:22.076 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/bcma 2024-03-12T17:06:22.076 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/bcma/bcma.ko 2024-03-12T17:06:22.076 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block 2024-03-12T17:06:22.076 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block/aoe 2024-03-12T17:06:22.076 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block/aoe/aoe.ko 2024-03-12T17:06:22.076 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block/brd.ko 2024-03-12T17:06:22.076 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block/drbd 2024-03-12T17:06:22.076 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block/drbd/drbd.ko 2024-03-12T17:06:22.076 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block/floppy.ko 2024-03-12T17:06:22.076 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block/loop.ko 2024-03-12T17:06:22.076 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block/mtip32xx 2024-03-12T17:06:22.077 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-12T17:06:22.077 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block/nbd.ko 2024-03-12T17:06:22.077 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block/null_blk 2024-03-12T17:06:22.077 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block/null_blk/null_blk.ko 2024-03-12T17:06:22.077 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block/pktcdvd.ko 2024-03-12T17:06:22.077 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block/rbd.ko 2024-03-12T17:06:22.077 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block/virtio_blk.ko 2024-03-12T17:06:22.077 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block/xen-blkback 2024-03-12T17:06:22.077 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-12T17:06:22.077 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block/xen-blkfront.ko 2024-03-12T17:06:22.077 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block/zram 2024-03-12T17:06:22.077 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block/zram/zram.ko 2024-03-12T17:06:22.077 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char 2024-03-12T17:06:22.077 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/hangcheck-timer.ko 2024-03-12T17:06:22.077 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/hw_random 2024-03-12T17:06:22.078 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-12T17:06:22.078 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-12T17:06:22.078 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-12T17:06:22.078 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/hw_random/via-rng.ko 2024-03-12T17:06:22.078 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-12T17:06:22.078 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/ipmi 2024-03-12T17:06:22.078 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-12T17:06:22.078 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-12T17:06:22.078 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-12T17:06:22.078 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-12T17:06:22.078 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-12T17:06:22.078 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-12T17:06:22.078 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/lp.ko 2024-03-12T17:06:22.078 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/mwave 2024-03-12T17:06:22.079 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/mwave/mwave.ko 2024-03-12T17:06:22.079 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/ppdev.ko 2024-03-12T17:06:22.079 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/tlclk.ko 2024-03-12T17:06:22.079 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/tpm 2024-03-12T17:06:22.079 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/tpm/tpm.ko 2024-03-12T17:06:22.079 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-12T17:06:22.079 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-12T17:06:22.079 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-12T17:06:22.079 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/tpm/tpm_tis.ko 2024-03-12T17:06:22.079 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-03-12T17:06:22.079 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/uv_mmtimer.ko 2024-03-12T17:06:22.079 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/virtio_console.ko 2024-03-12T17:06:22.079 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/cpufreq 2024-03-12T17:06:22.079 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-03-12T17:06:22.079 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-12T17:06:22.079 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-12T17:06:22.080 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-03-12T17:06:22.080 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/cpufreq/powernow-k8.ko 2024-03-12T17:06:22.080 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-12T17:06:22.080 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/crypto 2024-03-12T17:06:22.080 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/crypto/ccp 2024-03-12T17:06:22.080 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-12T17:06:22.080 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/crypto/ccp/ccp.ko 2024-03-12T17:06:22.080 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/crypto/intel 2024-03-12T17:06:22.080 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/crypto/intel/qat 2024-03-12T17:06:22.080 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/crypto/intel/qat/qat_common 2024-03-12T17:06:22.080 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-12T17:06:22.080 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-03-12T17:06:22.080 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-12T17:06:22.080 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/crypto/padlock-aes.ko 2024-03-12T17:06:22.080 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/crypto/padlock-sha.ko 2024-03-12T17:06:22.081 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/crypto/virtio 2024-03-12T17:06:22.081 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-12T17:06:22.081 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/dca 2024-03-12T17:06:22.081 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/dca/dca.ko 2024-03-12T17:06:22.081 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/devfreq 2024-03-12T17:06:22.081 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-03-12T17:06:22.081 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/dma 2024-03-12T17:06:22.081 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/dma/dw 2024-03-12T17:06:22.081 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-12T17:06:22.081 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/dma/ioat 2024-03-12T17:06:22.081 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-12T17:06:22.081 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/edac 2024-03-12T17:06:22.081 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/edac/amd64_edac.ko 2024-03-12T17:06:22.082 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/edac/e752x_edac.ko 2024-03-12T17:06:22.082 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/edac/edac_mce_amd.ko 2024-03-12T17:06:22.082 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/edac/i3000_edac.ko 2024-03-12T17:06:22.082 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/edac/i3200_edac.ko 2024-03-12T17:06:22.082 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/edac/i5100_edac.ko 2024-03-12T17:06:22.082 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/edac/i5400_edac.ko 2024-03-12T17:06:22.082 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/edac/i7300_edac.ko 2024-03-12T17:06:22.082 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/edac/i7core_edac.ko 2024-03-12T17:06:22.082 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/edac/i82975x_edac.ko 2024-03-12T17:06:22.082 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/edac/ie31200_edac.ko 2024-03-12T17:06:22.082 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/edac/sb_edac.ko 2024-03-12T17:06:22.082 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/edac/x38_edac.ko 2024-03-12T17:06:22.082 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/firmware 2024-03-12T17:06:22.082 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/firmware/edd.ko 2024-03-12T17:06:22.082 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-12T17:06:22.083 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/gpio 2024-03-12T17:06:22.083 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/gpio/gpio-ich.ko 2024-03-12T17:06:22.083 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-12T17:06:22.083 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid 2024-03-12T17:06:22.083 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-appleir.ko 2024-03-12T17:06:22.083 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-aureal.ko 2024-03-12T17:06:22.083 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-axff.ko 2024-03-12T17:06:22.083 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-dr.ko 2024-03-12T17:06:22.083 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-elecom.ko 2024-03-12T17:06:22.083 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-elo.ko 2024-03-12T17:06:22.083 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-emsff.ko 2024-03-12T17:06:22.083 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-gaff.ko 2024-03-12T17:06:22.083 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-gt683r.ko 2024-03-12T17:06:22.083 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-gyration.ko 2024-03-12T17:06:22.083 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-12T17:06:22.084 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-12T17:06:22.084 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-holtekff.ko 2024-03-12T17:06:22.084 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-hyperv.ko 2024-03-12T17:06:22.084 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-icade.ko 2024-03-12T17:06:22.084 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-keytouch.ko 2024-03-12T17:06:22.084 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-kye.ko 2024-03-12T17:06:22.084 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-lcpower.ko 2024-03-12T17:06:22.084 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-led.ko 2024-03-12T17:06:22.084 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-lenovo.ko 2024-03-12T17:06:22.084 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-12T17:06:22.084 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-12T17:06:22.084 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-multitouch.ko 2024-03-12T17:06:22.084 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-ortek.ko 2024-03-12T17:06:22.084 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-penmount.ko 2024-03-12T17:06:22.084 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-petalynx.ko 2024-03-12T17:06:22.085 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-picolcd.ko 2024-03-12T17:06:22.085 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-pl.ko 2024-03-12T17:06:22.085 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-plantronics.ko 2024-03-12T17:06:22.085 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-primax.ko 2024-03-12T17:06:22.085 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-rmi.ko 2024-03-12T17:06:22.085 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-12T17:06:22.085 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-roccat-common.ko 2024-03-12T17:06:22.085 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-12T17:06:22.085 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-12T17:06:22.085 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-12T17:06:22.085 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-12T17:06:22.085 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-12T17:06:22.085 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-12T17:06:22.085 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-12T17:06:22.086 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-12T17:06:22.086 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-12T17:06:22.086 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-roccat.ko 2024-03-12T17:06:22.086 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-saitek.ko 2024-03-12T17:06:22.086 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-samsung.ko 2024-03-12T17:06:22.086 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-12T17:06:22.086 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-sjoy.ko 2024-03-12T17:06:22.086 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-sony.ko 2024-03-12T17:06:22.086 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-speedlink.ko 2024-03-12T17:06:22.086 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-steelseries.ko 2024-03-12T17:06:22.086 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-sunplus.ko 2024-03-12T17:06:22.086 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-12T17:06:22.086 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-tivo.ko 2024-03-12T17:06:22.086 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-tmff.ko 2024-03-12T17:06:22.087 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-topseed.ko 2024-03-12T17:06:22.087 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-twinhan.ko 2024-03-12T17:06:22.087 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-uclogic.ko 2024-03-12T17:06:22.087 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-waltop.ko 2024-03-12T17:06:22.087 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-wiimote.ko 2024-03-12T17:06:22.087 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-xinmo.ko 2024-03-12T17:06:22.087 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-zpff.ko 2024-03-12T17:06:22.087 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-zydacron.ko 2024-03-12T17:06:22.087 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/uhid.ko 2024-03-12T17:06:22.087 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/wacom.ko 2024-03-12T17:06:22.087 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hv 2024-03-12T17:06:22.087 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hv/hv_balloon.ko 2024-03-12T17:06:22.087 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hv/hv_utils.ko 2024-03-12T17:06:22.087 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hv/hv_vmbus.ko 2024-03-12T17:06:22.087 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon 2024-03-12T17:06:22.088 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/abituguru.ko 2024-03-12T17:06:22.088 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/abituguru3.ko 2024-03-12T17:06:22.088 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-12T17:06:22.088 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/ad7414.ko 2024-03-12T17:06:22.088 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/ad7418.ko 2024-03-12T17:06:22.088 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/adc128d818.ko 2024-03-12T17:06:22.088 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/adm1025.ko 2024-03-12T17:06:22.088 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/adm1026.ko 2024-03-12T17:06:22.088 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/adm1029.ko 2024-03-12T17:06:22.088 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/adm1031.ko 2024-03-12T17:06:22.088 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/adm9240.ko 2024-03-12T17:06:22.088 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/ads7828.ko 2024-03-12T17:06:22.088 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/adt7410.ko 2024-03-12T17:06:22.088 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/adt7411.ko 2024-03-12T17:06:22.088 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/adt7462.ko 2024-03-12T17:06:22.088 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/adt7470.ko 2024-03-12T17:06:22.089 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/adt7475.ko 2024-03-12T17:06:22.089 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/adt7x10.ko 2024-03-12T17:06:22.089 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/amc6821.ko 2024-03-12T17:06:22.089 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/applesmc.ko 2024-03-12T17:06:22.089 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/asb100.ko 2024-03-12T17:06:22.089 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/asc7621.ko 2024-03-12T17:06:22.089 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-12T17:06:22.089 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/atxp1.ko 2024-03-12T17:06:22.089 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/coretemp.ko 2024-03-12T17:06:22.089 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-12T17:06:22.089 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/dme1737.ko 2024-03-12T17:06:22.089 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/ds1621.ko 2024-03-12T17:06:22.089 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/ds620.ko 2024-03-12T17:06:22.089 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/emc1403.ko 2024-03-12T17:06:22.089 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/emc6w201.ko 2024-03-12T17:06:22.090 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/f71805f.ko 2024-03-12T17:06:22.090 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/f71882fg.ko 2024-03-12T17:06:22.090 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/f75375s.ko 2024-03-12T17:06:22.090 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/fam15h_power.ko 2024-03-12T17:06:22.090 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/fschmd.ko 2024-03-12T17:06:22.090 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/g760a.ko 2024-03-12T17:06:22.090 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/g762.ko 2024-03-12T17:06:22.090 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/gl518sm.ko 2024-03-12T17:06:22.090 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/gl520sm.ko 2024-03-12T17:06:22.090 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-12T17:06:22.090 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/i5500_temp.ko 2024-03-12T17:06:22.090 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/i5k_amb.ko 2024-03-12T17:06:22.090 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/ibmaem.ko 2024-03-12T17:06:22.090 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/ibmpex.ko 2024-03-12T17:06:22.091 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/ina209.ko 2024-03-12T17:06:22.091 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/ina2xx.ko 2024-03-12T17:06:22.091 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/it87.ko 2024-03-12T17:06:22.091 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/k10temp.ko 2024-03-12T17:06:22.091 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/k8temp.ko 2024-03-12T17:06:22.091 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/lineage-pem.ko 2024-03-12T17:06:22.091 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/lm63.ko 2024-03-12T17:06:22.091 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/lm73.ko 2024-03-12T17:06:22.091 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/lm75.ko 2024-03-12T17:06:22.091 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/lm77.ko 2024-03-12T17:06:22.091 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/lm78.ko 2024-03-12T17:06:22.091 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/lm80.ko 2024-03-12T17:06:22.092 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/lm83.ko 2024-03-12T17:06:22.092 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/lm85.ko 2024-03-12T17:06:22.092 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/lm87.ko 2024-03-12T17:06:22.092 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/lm90.ko 2024-03-12T17:06:22.092 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/lm92.ko 2024-03-12T17:06:22.092 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/lm93.ko 2024-03-12T17:06:22.092 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/lm95234.ko 2024-03-12T17:06:22.092 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/lm95241.ko 2024-03-12T17:06:22.092 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/lm95245.ko 2024-03-12T17:06:22.092 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/ltc2945.ko 2024-03-12T17:06:22.092 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/ltc4151.ko 2024-03-12T17:06:22.092 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/ltc4215.ko 2024-03-12T17:06:22.092 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/ltc4222.ko 2024-03-12T17:06:22.092 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/ltc4245.ko 2024-03-12T17:06:22.093 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/ltc4260.ko 2024-03-12T17:06:22.093 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/ltc4261.ko 2024-03-12T17:06:22.093 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/max16065.ko 2024-03-12T17:06:22.093 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/max1619.ko 2024-03-12T17:06:22.093 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/max1668.ko 2024-03-12T17:06:22.093 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/max197.ko 2024-03-12T17:06:22.093 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/max6639.ko 2024-03-12T17:06:22.093 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/max6650.ko 2024-03-12T17:06:22.093 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/max6697.ko 2024-03-12T17:06:22.093 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/mcp3021.ko 2024-03-12T17:06:22.093 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/nct6683.ko 2024-03-12T17:06:22.093 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/nct6775-core.ko 2024-03-12T17:06:22.093 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/nct6775.ko 2024-03-12T17:06:22.093 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/nct7802.ko 2024-03-12T17:06:22.093 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/pc87360.ko 2024-03-12T17:06:22.093 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/pc87427.ko 2024-03-12T17:06:22.093 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/pcf8591.ko 2024-03-12T17:06:22.094 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/pmbus 2024-03-12T17:06:22.094 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-12T17:06:22.094 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-12T17:06:22.094 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-12T17:06:22.094 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-12T17:06:22.094 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-12T17:06:22.094 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-12T17:06:22.094 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-12T17:06:22.094 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-12T17:06:22.094 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-12T17:06:22.094 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-12T17:06:22.094 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-12T17:06:22.094 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-12T17:06:22.094 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/powr1220.ko 2024-03-12T17:06:22.094 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/sch5627.ko 2024-03-12T17:06:22.095 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/sch5636.ko 2024-03-12T17:06:22.095 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-12T17:06:22.095 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/sht15.ko 2024-03-12T17:06:22.095 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/sht21.ko 2024-03-12T17:06:22.095 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/shtc1.ko 2024-03-12T17:06:22.095 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/sis5595.ko 2024-03-12T17:06:22.095 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/smsc47b397.ko 2024-03-12T17:06:22.095 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/smsc47m1.ko 2024-03-12T17:06:22.095 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/smsc47m192.ko 2024-03-12T17:06:22.095 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/thmc50.ko 2024-03-12T17:06:22.095 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/tmp102.ko 2024-03-12T17:06:22.095 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/tmp103.ko 2024-03-12T17:06:22.095 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/tmp401.ko 2024-03-12T17:06:22.095 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/tmp421.ko 2024-03-12T17:06:22.095 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/via-cputemp.ko 2024-03-12T17:06:22.096 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/via686a.ko 2024-03-12T17:06:22.096 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/vt1211.ko 2024-03-12T17:06:22.096 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/vt8231.ko 2024-03-12T17:06:22.096 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/w83627ehf.ko 2024-03-12T17:06:22.096 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/w83627hf.ko 2024-03-12T17:06:22.096 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/w83781d.ko 2024-03-12T17:06:22.096 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/w83791d.ko 2024-03-12T17:06:22.096 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/w83792d.ko 2024-03-12T17:06:22.096 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/w83793.ko 2024-03-12T17:06:22.096 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/w83795.ko 2024-03-12T17:06:22.096 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/w83l785ts.ko 2024-03-12T17:06:22.096 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/w83l786ng.ko 2024-03-12T17:06:22.096 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c 2024-03-12T17:06:22.096 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/algos 2024-03-12T17:06:22.096 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-12T17:06:22.096 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-12T17:06:22.096 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses 2024-03-12T17:06:22.097 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-12T17:06:22.097 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-12T17:06:22.097 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-12T17:06:22.097 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-12T17:06:22.097 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-12T17:06:22.097 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-12T17:06:22.097 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-12T17:06:22.097 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-12T17:06:22.097 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-12T17:06:22.097 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-12T17:06:22.097 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-12T17:06:22.097 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-12T17:06:22.097 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-12T17:06:22.097 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-12T17:06:22.098 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-12T17:06:22.098 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-12T17:06:22.098 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-12T17:06:22.098 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-12T17:06:22.098 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-12T17:06:22.098 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-12T17:06:22.098 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-12T17:06:22.098 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-12T17:06:22.098 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-12T17:06:22.098 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/i2c-dev.ko 2024-03-12T17:06:22.098 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/i2c-mux.ko 2024-03-12T17:06:22.098 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-03-12T17:06:22.098 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/i2c-smbus.ko 2024-03-12T17:06:22.098 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/i2c-stub.ko 2024-03-12T17:06:22.099 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband 2024-03-12T17:06:22.099 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/core 2024-03-12T17:06:22.099 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-12T17:06:22.099 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/core/ib_core.ko 2024-03-12T17:06:22.099 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-12T17:06:22.099 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-12T17:06:22.099 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-12T17:06:22.099 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-12T17:06:22.099 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-12T17:06:22.099 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/hw 2024-03-12T17:06:22.099 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/hw/cxgb4 2024-03-12T17:06:22.099 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-12T17:06:22.099 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/hw/mlx4 2024-03-12T17:06:22.099 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-12T17:06:22.099 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/hw/mlx5 2024-03-12T17:06:22.100 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-12T17:06:22.100 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/hw/mthca 2024-03-12T17:06:22.100 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-12T17:06:22.100 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/ulp 2024-03-12T17:06:22.100 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/ulp/ipoib 2024-03-12T17:06:22.100 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-12T17:06:22.100 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/ulp/iser 2024-03-12T17:06:22.100 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-12T17:06:22.100 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/ulp/isert 2024-03-12T17:06:22.100 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-12T17:06:22.100 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/ulp/srp 2024-03-12T17:06:22.100 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-12T17:06:22.100 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/ulp/srpt 2024-03-12T17:06:22.100 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-12T17:06:22.100 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input 2024-03-12T17:06:22.100 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/gameport 2024-03-12T17:06:22.101 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-12T17:06:22.101 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-12T17:06:22.101 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/gameport/gameport.ko 2024-03-12T17:06:22.101 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/joydev.ko 2024-03-12T17:06:22.101 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/keyboard 2024-03-12T17:06:22.101 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-12T17:06:22.101 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/mouse 2024-03-12T17:06:22.101 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/mouse/appletouch.ko 2024-03-12T17:06:22.101 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/mouse/bcm5974.ko 2024-03-12T17:06:22.101 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/mouse/cyapatp.ko 2024-03-12T17:06:22.101 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-12T17:06:22.101 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/mouse/sermouse.ko 2024-03-12T17:06:22.101 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-12T17:06:22.101 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-12T17:06:22.101 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-12T17:06:22.102 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/rmi4 2024-03-12T17:06:22.102 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-12T17:06:22.102 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/serio 2024-03-12T17:06:22.102 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/serio/altera_ps2.ko 2024-03-12T17:06:22.102 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/serio/arc_ps2.ko 2024-03-12T17:06:22.102 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-12T17:06:22.102 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/serio/serio_raw.ko 2024-03-12T17:06:22.102 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/sparse-keymap.ko 2024-03-12T17:06:22.102 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/leds 2024-03-12T17:06:22.102 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/leds/leds-blinkm.ko 2024-03-12T17:06:22.102 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/leds/leds-lm3530.ko 2024-03-12T17:06:22.102 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/leds/leds-lp3944.ko 2024-03-12T17:06:22.102 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/leds/leds-ss4200.ko 2024-03-12T17:06:22.102 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/leds/trigger 2024-03-12T17:06:22.103 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-12T17:06:22.103 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-12T17:06:22.103 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-12T17:06:22.103 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-12T17:06:22.103 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-12T17:06:22.103 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-12T17:06:22.103 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-12T17:06:22.103 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-12T17:06:22.103 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-12T17:06:22.103 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md 2024-03-12T17:06:22.103 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/bcache 2024-03-12T17:06:22.103 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/bcache/bcache.ko 2024-03-12T17:06:22.103 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/dm-bio-prison.ko 2024-03-12T17:06:22.103 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/dm-cache-smq.ko 2024-03-12T17:06:22.103 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/dm-cache.ko 2024-03-12T17:06:22.104 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/dm-crypt.ko 2024-03-12T17:06:22.104 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/dm-delay.ko 2024-03-12T17:06:22.104 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/dm-flakey.ko 2024-03-12T17:06:22.104 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/dm-log-userspace.ko 2024-03-12T17:06:22.104 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/dm-multipath.ko 2024-03-12T17:06:22.104 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/dm-queue-length.ko 2024-03-12T17:06:22.104 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/dm-raid.ko 2024-03-12T17:06:22.104 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/dm-round-robin.ko 2024-03-12T17:06:22.104 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/dm-service-time.ko 2024-03-12T17:06:22.104 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/dm-switch.ko 2024-03-12T17:06:22.104 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/dm-thin-pool.ko 2024-03-12T17:06:22.104 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/dm-verity.ko 2024-03-12T17:06:22.104 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/persistent-data 2024-03-12T17:06:22.104 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-12T17:06:22.104 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/raid0.ko 2024-03-12T17:06:22.105 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/raid1.ko 2024-03-12T17:06:22.105 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/raid10.ko 2024-03-12T17:06:22.105 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/raid456.ko 2024-03-12T17:06:22.105 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/message 2024-03-12T17:06:22.105 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/message/fusion 2024-03-12T17:06:22.105 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/message/fusion/mptbase.ko 2024-03-12T17:06:22.105 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/message/fusion/mptctl.ko 2024-03-12T17:06:22.105 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/message/fusion/mptfc.ko 2024-03-12T17:06:22.105 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/message/fusion/mptlan.ko 2024-03-12T17:06:22.105 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/message/fusion/mptsas.ko 2024-03-12T17:06:22.105 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/message/fusion/mptscsih.ko 2024-03-12T17:06:22.105 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/message/fusion/mptspi.ko 2024-03-12T17:06:22.105 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/mfd 2024-03-12T17:06:22.105 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/mfd/lpc_ich.ko 2024-03-12T17:06:22.105 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/mfd/lpc_sch.ko 2024-03-12T17:06:22.106 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/mfd/mfd-core.ko 2024-03-12T17:06:22.106 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/mfd/sm501.ko 2024-03-12T17:06:22.106 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/mfd/viperboard.ko 2024-03-12T17:06:22.106 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/mfd/vx855.ko 2024-03-12T17:06:22.106 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/mfd/wl1273-core.ko 2024-03-12T17:06:22.106 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc 2024-03-12T17:06:22.106 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/altera-stapl 2024-03-12T17:06:22.106 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-12T17:06:22.106 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/apds9802als.ko 2024-03-12T17:06:22.106 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/apds990x.ko 2024-03-12T17:06:22.106 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/bh1770glc.ko 2024-03-12T17:06:22.106 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/cb710 2024-03-12T17:06:22.106 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/cb710/cb710.ko 2024-03-12T17:06:22.106 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/eeprom 2024-03-12T17:06:22.106 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/eeprom/at24.ko 2024-03-12T17:06:22.107 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-12T17:06:22.107 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/eeprom/max6875.ko 2024-03-12T17:06:22.107 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/enclosure.ko 2024-03-12T17:06:22.107 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/hpilo.ko 2024-03-12T17:06:22.107 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/isl29003.ko 2024-03-12T17:06:22.107 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/isl29020.ko 2024-03-12T17:06:22.107 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/lis3lv02d 2024-03-12T17:06:22.107 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-12T17:06:22.107 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-12T17:06:22.107 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/mei 2024-03-12T17:06:22.107 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/mei/mei-me.ko 2024-03-12T17:06:22.107 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/mei/mei-txe.ko 2024-03-12T17:06:22.107 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/mei/mei.ko 2024-03-12T17:06:22.107 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/sgi-gru 2024-03-12T17:06:22.108 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/sgi-gru/gru.ko 2024-03-12T17:06:22.108 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/sgi-xp 2024-03-12T17:06:22.108 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/sgi-xp/xp.ko 2024-03-12T17:06:22.108 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/sgi-xp/xpc.ko 2024-03-12T17:06:22.108 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-03-12T17:06:22.108 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/tifm_7xx1.ko 2024-03-12T17:06:22.108 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/tifm_core.ko 2024-03-12T17:06:22.108 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/tsl2550.ko 2024-03-12T17:06:22.108 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/vmw_balloon.ko 2024-03-12T17:06:22.108 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/vmw_vmci 2024-03-12T17:06:22.108 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-12T17:06:22.108 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net 2024-03-12T17:06:22.108 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/bonding 2024-03-12T17:06:22.108 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/bonding/bonding.ko 2024-03-12T17:06:22.108 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/dsa 2024-03-12T17:06:22.109 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/dsa/b53 2024-03-12T17:06:22.109 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-12T17:06:22.109 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-12T17:06:22.109 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-12T17:06:22.109 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/dsa/mv88e6xxx 2024-03-12T17:06:22.109 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-12T17:06:22.109 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/dummy.ko 2024-03-12T17:06:22.109 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/eql.ko 2024-03-12T17:06:22.109 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet 2024-03-12T17:06:22.109 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/3com 2024-03-12T17:06:22.109 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-12T17:06:22.110 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-12T17:06:22.110 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-12T17:06:22.110 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-12T17:06:22.110 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/8390 2024-03-12T17:06:22.110 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-12T17:06:22.110 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-12T17:06:22.110 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-12T17:06:22.110 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-12T17:06:22.110 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/adaptec 2024-03-12T17:06:22.110 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-12T17:06:22.110 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/agere 2024-03-12T17:06:22.110 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-12T17:06:22.110 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/alteon 2024-03-12T17:06:22.110 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-12T17:06:22.111 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/altera 2024-03-12T17:06:22.111 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-12T17:06:22.111 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/amd 2024-03-12T17:06:22.111 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-12T17:06:22.111 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-12T17:06:22.111 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-12T17:06:22.111 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/atheros 2024-03-12T17:06:22.111 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/atheros/alx 2024-03-12T17:06:22.111 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-12T17:06:22.111 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/atheros/atl1c 2024-03-12T17:06:22.111 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-12T17:06:22.111 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/atheros/atl1e 2024-03-12T17:06:22.111 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-12T17:06:22.111 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/atheros/atlx 2024-03-12T17:06:22.111 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-12T17:06:22.112 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-12T17:06:22.112 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/broadcom 2024-03-12T17:06:22.112 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-12T17:06:22.112 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-12T17:06:22.112 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-03-12T17:06:22.112 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-12T17:06:22.112 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-12T17:06:22.112 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/broadcom/genet 2024-03-12T17:06:22.112 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-12T17:06:22.112 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-12T17:06:22.112 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/brocade 2024-03-12T17:06:22.112 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/brocade/bna 2024-03-12T17:06:22.112 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-12T17:06:22.112 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/chelsio 2024-03-12T17:06:22.112 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/chelsio/cxgb 2024-03-12T17:06:22.113 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-12T17:06:22.113 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-03-12T17:06:22.113 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-12T17:06:22.113 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-03-12T17:06:22.113 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-12T17:06:22.113 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-03-12T17:06:22.113 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-12T17:06:22.113 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-03-12T17:06:22.113 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-12T17:06:22.113 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/cisco 2024-03-12T17:06:22.113 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/cisco/enic 2024-03-12T17:06:22.113 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-12T17:06:22.113 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/dec 2024-03-12T17:06:22.113 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/dec/tulip 2024-03-12T17:06:22.114 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-12T17:06:22.114 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-12T17:06:22.114 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-12T17:06:22.114 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-12T17:06:22.114 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-12T17:06:22.114 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-12T17:06:22.114 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/dlink 2024-03-12T17:06:22.114 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-12T17:06:22.114 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-12T17:06:22.114 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/dnet.ko 2024-03-12T17:06:22.114 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/emulex 2024-03-12T17:06:22.115 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/emulex/benet 2024-03-12T17:06:22.115 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-12T17:06:22.115 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/ethoc.ko 2024-03-12T17:06:22.115 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/fealnx.ko 2024-03-12T17:06:22.115 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/intel 2024-03-12T17:06:22.115 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-12T17:06:22.115 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/intel/e1000 2024-03-12T17:06:22.115 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-12T17:06:22.115 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/intel/e1000e 2024-03-12T17:06:22.115 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-12T17:06:22.115 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/intel/fm10k 2024-03-12T17:06:22.115 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-12T17:06:22.115 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/intel/i40e 2024-03-12T17:06:22.115 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-12T17:06:22.115 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/intel/iavf 2024-03-12T17:06:22.116 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-12T17:06:22.116 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/intel/igb 2024-03-12T17:06:22.116 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-12T17:06:22.116 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/intel/igbvf 2024-03-12T17:06:22.116 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-12T17:06:22.116 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/intel/ixgbe 2024-03-12T17:06:22.116 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-12T17:06:22.116 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/intel/ixgbevf 2024-03-12T17:06:22.116 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-12T17:06:22.116 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/jme.ko 2024-03-12T17:06:22.116 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/marvell 2024-03-12T17:06:22.116 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-12T17:06:22.116 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-12T17:06:22.116 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-12T17:06:22.116 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/mellanox 2024-03-12T17:06:22.116 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/mellanox/mlx4 2024-03-12T17:06:22.117 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-12T17:06:22.117 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-12T17:06:22.117 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/mellanox/mlx5 2024-03-12T17:06:22.117 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-03-12T17:06:22.117 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-12T17:06:22.117 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/micrel 2024-03-12T17:06:22.117 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-12T17:06:22.117 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/myricom 2024-03-12T17:06:22.117 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/myricom/myri10ge 2024-03-12T17:06:22.117 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-12T17:06:22.117 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/natsemi 2024-03-12T17:06:22.117 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-12T17:06:22.117 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-12T17:06:22.117 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/neterion 2024-03-12T17:06:22.117 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-12T17:06:22.117 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/nvidia 2024-03-12T17:06:22.117 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-12T17:06:22.118 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/packetengines 2024-03-12T17:06:22.118 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-12T17:06:22.118 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-12T17:06:22.118 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/qlogic 2024-03-12T17:06:22.118 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/qlogic/netxen 2024-03-12T17:06:22.118 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-12T17:06:22.118 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-12T17:06:22.118 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-03-12T17:06:22.118 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-12T17:06:22.118 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/rdc 2024-03-12T17:06:22.118 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-12T17:06:22.118 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/realtek 2024-03-12T17:06:22.118 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-12T17:06:22.118 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-12T17:06:22.119 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-12T17:06:22.119 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-12T17:06:22.119 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/rocker 2024-03-12T17:06:22.119 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-03-12T17:06:22.119 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/sfc 2024-03-12T17:06:22.119 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-12T17:06:22.119 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/silan 2024-03-12T17:06:22.119 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-12T17:06:22.119 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/sis 2024-03-12T17:06:22.119 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-12T17:06:22.119 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-12T17:06:22.119 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/smsc 2024-03-12T17:06:22.119 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-12T17:06:22.119 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-12T17:06:22.119 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-12T17:06:22.119 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-12T17:06:22.120 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/stmicro 2024-03-12T17:06:22.120 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/stmicro/stmmac 2024-03-12T17:06:22.120 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-12T17:06:22.120 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-12T17:06:22.120 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/sun 2024-03-12T17:06:22.120 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-12T17:06:22.120 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-12T17:06:22.120 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-12T17:06:22.120 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-12T17:06:22.120 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/tehuti 2024-03-12T17:06:22.120 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-12T17:06:22.120 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/ti 2024-03-12T17:06:22.120 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-12T17:06:22.120 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/via 2024-03-12T17:06:22.121 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-12T17:06:22.121 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-12T17:06:22.121 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/wiznet 2024-03-12T17:06:22.121 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-12T17:06:22.121 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-12T17:06:22.121 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/xircom 2024-03-12T17:06:22.121 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-12T17:06:22.121 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/geneve.ko 2024-03-12T17:06:22.121 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/hyperv 2024-03-12T17:06:22.121 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-12T17:06:22.121 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ieee802154 2024-03-12T17:06:22.121 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-12T17:06:22.121 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ifb.ko 2024-03-12T17:06:22.121 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ipvlan 2024-03-12T17:06:22.121 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-12T17:06:22.122 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/macvlan.ko 2024-03-12T17:06:22.122 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/macvtap.ko 2024-03-12T17:06:22.122 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/mdio 2024-03-12T17:06:22.122 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/mdio.ko 2024-03-12T17:06:22.122 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-12T17:06:22.122 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-12T17:06:22.122 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-12T17:06:22.122 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/mii.ko 2024-03-12T17:06:22.122 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/net_failover.ko 2024-03-12T17:06:22.122 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/netconsole.ko 2024-03-12T17:06:22.122 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/nlmon.ko 2024-03-12T17:06:22.122 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/pcs 2024-03-12T17:06:22.122 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-12T17:06:22.122 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-12T17:06:22.123 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy 2024-03-12T17:06:22.123 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/amd.ko 2024-03-12T17:06:22.123 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-12T17:06:22.123 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-03-12T17:06:22.123 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-12T17:06:22.123 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/bcm87xx.ko 2024-03-12T17:06:22.123 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/broadcom.ko 2024-03-12T17:06:22.123 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/cicada.ko 2024-03-12T17:06:22.123 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/davicom.ko 2024-03-12T17:06:22.123 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/dp83640.ko 2024-03-12T17:06:22.123 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/et1011c.ko 2024-03-12T17:06:22.123 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/icplus.ko 2024-03-12T17:06:22.123 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/lxt.ko 2024-03-12T17:06:22.123 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/marvell.ko 2024-03-12T17:06:22.123 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/micrel.ko 2024-03-12T17:06:22.124 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/national.ko 2024-03-12T17:06:22.124 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/phylink.ko 2024-03-12T17:06:22.124 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/qsemi.ko 2024-03-12T17:06:22.124 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/realtek.ko 2024-03-12T17:06:22.124 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/smsc.ko 2024-03-12T17:06:22.124 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/ste10Xp.ko 2024-03-12T17:06:22.124 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/vitesse.ko 2024-03-12T17:06:22.124 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ppp 2024-03-12T17:06:22.124 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-12T17:06:22.124 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ppp/ppp_async.ko 2024-03-12T17:06:22.124 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-12T17:06:22.124 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ppp/ppp_generic.ko 2024-03-12T17:06:22.124 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-12T17:06:22.124 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-12T17:06:22.124 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ppp/pppoe.ko 2024-03-12T17:06:22.125 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ppp/pppox.ko 2024-03-12T17:06:22.125 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ppp/pptp.ko 2024-03-12T17:06:22.125 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/slip 2024-03-12T17:06:22.125 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/slip/slhc.ko 2024-03-12T17:06:22.125 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/slip/slip.ko 2024-03-12T17:06:22.125 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/sungem_phy.ko 2024-03-12T17:06:22.125 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/tap.ko 2024-03-12T17:06:22.125 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/team 2024-03-12T17:06:22.125 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/team/team.ko 2024-03-12T17:06:22.125 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-12T17:06:22.125 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-12T17:06:22.125 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-12T17:06:22.125 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/team/team_mode_random.ko 2024-03-12T17:06:22.125 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-12T17:06:22.125 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/tun.ko 2024-03-12T17:06:22.126 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/veth.ko 2024-03-12T17:06:22.126 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/virtio_net.ko 2024-03-12T17:06:22.126 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/vmxnet3 2024-03-12T17:06:22.126 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-12T17:06:22.126 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/vxlan 2024-03-12T17:06:22.126 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/vxlan/vxlan.ko 2024-03-12T17:06:22.126 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/xen-netback 2024-03-12T17:06:22.126 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-12T17:06:22.126 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/xen-netfront.ko 2024-03-12T17:06:22.126 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ntb 2024-03-12T17:06:22.126 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ntb/ntb.ko 2024-03-12T17:06:22.126 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/nvme 2024-03-12T17:06:22.126 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/nvme/host 2024-03-12T17:06:22.126 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/nvme/host/nvme-core.ko 2024-03-12T17:06:22.126 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/nvme/host/nvme.ko 2024-03-12T17:06:22.127 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/parport 2024-03-12T17:06:22.127 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/parport/parport.ko 2024-03-12T17:06:22.127 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/parport/parport_cs.ko 2024-03-12T17:06:22.127 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/parport/parport_pc.ko 2024-03-12T17:06:22.127 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/parport/parport_serial.ko 2024-03-12T17:06:22.127 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/pci 2024-03-12T17:06:22.127 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/pci/hotplug 2024-03-12T17:06:22.127 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-12T17:06:22.127 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/pci/pcie 2024-03-12T17:06:22.127 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/pci/pcie/aer_inject.ko 2024-03-12T17:06:22.127 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/pci/xen-pcifront.ko 2024-03-12T17:06:22.127 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/pcmcia 2024-03-12T17:06:22.127 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/pcmcia/i82092.ko 2024-03-12T17:06:22.127 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/pcmcia/pd6729.ko 2024-03-12T17:06:22.128 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-12T17:06:22.128 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/pinctrl 2024-03-12T17:06:22.128 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/pinctrl/intel 2024-03-12T17:06:22.128 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-12T17:06:22.128 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform 2024-03-12T17:06:22.128 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86 2024-03-12T17:06:22.128 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-12T17:06:22.128 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/acerhdf.ko 2024-03-12T17:06:22.128 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-12T17:06:22.128 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-12T17:06:22.128 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-12T17:06:22.128 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-12T17:06:22.128 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-12T17:06:22.128 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-12T17:06:22.128 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-12T17:06:22.129 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-12T17:06:22.129 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-12T17:06:22.129 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/hdaps.ko 2024-03-12T17:06:22.129 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/intel 2024-03-12T17:06:22.129 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-12T17:06:22.129 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/intel_ips.ko 2024-03-12T17:06:22.129 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-12T17:06:22.129 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-12T17:06:22.129 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-12T17:06:22.129 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-12T17:06:22.129 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-12T17:06:22.129 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-12T17:06:22.129 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-12T17:06:22.129 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-12T17:06:22.129 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-12T17:06:22.130 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/wmi.ko 2024-03-12T17:06:22.130 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/powercap 2024-03-12T17:06:22.130 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-12T17:06:22.130 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-12T17:06:22.130 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/pps 2024-03-12T17:06:22.130 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/pps/clients 2024-03-12T17:06:22.130 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-12T17:06:22.130 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-12T17:06:22.130 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/pps/clients/pps_parport.ko 2024-03-12T17:06:22.130 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/pps/pps_core.ko 2024-03-12T17:06:22.130 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ptp 2024-03-12T17:06:22.130 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ptp/ptp.ko 2024-03-12T17:06:22.130 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ptp/ptp_kvm.ko 2024-03-12T17:06:22.130 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc 2024-03-12T17:06:22.131 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-12T17:06:22.131 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-12T17:06:22.131 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-12T17:06:22.131 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-12T17:06:22.131 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-12T17:06:22.131 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-12T17:06:22.131 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-12T17:06:22.131 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-12T17:06:22.131 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-12T17:06:22.131 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-12T17:06:22.131 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-em3027.ko 2024-03-12T17:06:22.131 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-12T17:06:22.131 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-12T17:06:22.131 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-12T17:06:22.131 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-12T17:06:22.131 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-12T17:06:22.132 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-12T17:06:22.132 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-max6900.ko 2024-03-12T17:06:22.132 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-12T17:06:22.132 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-12T17:06:22.132 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-12T17:06:22.132 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-12T17:06:22.132 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-12T17:06:22.132 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-12T17:06:22.132 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-12T17:06:22.132 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-12T17:06:22.132 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-12T17:06:22.132 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-12T17:06:22.132 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-12T17:06:22.132 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-12T17:06:22.132 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-x1205.ko 2024-03-12T17:06:22.132 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi 2024-03-12T17:06:22.133 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/3w-9xxx.ko 2024-03-12T17:06:22.133 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/3w-sas.ko 2024-03-12T17:06:22.133 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/3w-xxxx.ko 2024-03-12T17:06:22.133 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/BusLogic.ko 2024-03-12T17:06:22.133 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/a100u2w.ko 2024-03-12T17:06:22.133 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/aacraid 2024-03-12T17:06:22.133 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-12T17:06:22.133 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/advansys.ko 2024-03-12T17:06:22.133 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/aic7xxx 2024-03-12T17:06:22.133 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-12T17:06:22.133 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-12T17:06:22.133 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/am53c974.ko 2024-03-12T17:06:22.133 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/arcmsr 2024-03-12T17:06:22.133 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-12T17:06:22.133 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/atp870u.ko 2024-03-12T17:06:22.133 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/be2iscsi 2024-03-12T17:06:22.134 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-12T17:06:22.134 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/bfa 2024-03-12T17:06:22.134 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/bfa/bfa.ko 2024-03-12T17:06:22.134 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/bnx2fc 2024-03-12T17:06:22.134 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-12T17:06:22.134 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/bnx2i 2024-03-12T17:06:22.134 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-12T17:06:22.134 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/ch.ko 2024-03-12T17:06:22.134 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/csiostor 2024-03-12T17:06:22.134 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-12T17:06:22.134 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/cxgbi 2024-03-12T17:06:22.134 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/cxgbi/cxgb3i 2024-03-12T17:06:22.134 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-12T17:06:22.134 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/cxgbi/cxgb4i 2024-03-12T17:06:22.134 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-12T17:06:22.135 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-12T17:06:22.135 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/dc395x.ko 2024-03-12T17:06:22.135 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/device_handler 2024-03-12T17:06:22.135 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-03-12T17:06:22.135 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-03-12T17:06:22.135 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-03-12T17:06:22.135 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-03-12T17:06:22.135 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/dmx3191d.ko 2024-03-12T17:06:22.135 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/esas2r 2024-03-12T17:06:22.135 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-12T17:06:22.135 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/esp_scsi.ko 2024-03-12T17:06:22.135 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/fcoe 2024-03-12T17:06:22.135 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-12T17:06:22.135 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-12T17:06:22.135 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/fnic 2024-03-12T17:06:22.136 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/fnic/fnic.ko 2024-03-12T17:06:22.136 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/hpsa.ko 2024-03-12T17:06:22.136 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/hptiop.ko 2024-03-12T17:06:22.136 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/hv_storvsc.ko 2024-03-12T17:06:22.136 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/initio.ko 2024-03-12T17:06:22.137 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/ipr.ko 2024-03-12T17:06:22.137 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/ips.ko 2024-03-12T17:06:22.137 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/isci 2024-03-12T17:06:22.137 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/isci/isci.ko 2024-03-12T17:06:22.137 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-12T17:06:22.138 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-12T17:06:22.138 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/libfc 2024-03-12T17:06:22.138 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/libfc/libfc.ko 2024-03-12T17:06:22.138 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/libiscsi.ko 2024-03-12T17:06:22.138 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-12T17:06:22.138 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/libsas 2024-03-12T17:06:22.138 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/libsas/libsas.ko 2024-03-12T17:06:22.138 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/lpfc 2024-03-12T17:06:22.138 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-12T17:06:22.138 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/megaraid 2024-03-12T17:06:22.138 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/megaraid.ko 2024-03-12T17:06:22.138 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-12T17:06:22.138 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-12T17:06:22.138 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-12T17:06:22.138 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/mpt3sas 2024-03-12T17:06:22.139 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-12T17:06:22.139 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/mvsas 2024-03-12T17:06:22.139 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-12T17:06:22.139 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/mvumi.ko 2024-03-12T17:06:22.139 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/pm8001 2024-03-12T17:06:22.139 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-12T17:06:22.139 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/pmcraid.ko 2024-03-12T17:06:22.139 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/qla1280.ko 2024-03-12T17:06:22.139 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/qla2xxx 2024-03-12T17:06:22.139 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-12T17:06:22.139 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-12T17:06:22.139 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/qla4xxx 2024-03-12T17:06:22.139 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-12T17:06:22.139 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/raid_class.ko 2024-03-12T17:06:22.139 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/scsi_debug.ko 2024-03-12T17:06:22.140 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-12T17:06:22.140 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-12T17:06:22.140 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-12T17:06:22.140 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-12T17:06:22.140 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-12T17:06:22.140 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/ses.ko 2024-03-12T17:06:22.140 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/st.ko 2024-03-12T17:06:22.140 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/stex.ko 2024-03-12T17:06:22.140 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/sym53c8xx_2 2024-03-12T17:06:22.140 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-12T17:06:22.140 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/virtio_scsi.ko 2024-03-12T17:06:22.140 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-12T17:06:22.140 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/wd719x.ko 2024-03-12T17:06:22.140 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ssb 2024-03-12T17:06:22.140 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ssb/ssb.ko 2024-03-12T17:06:22.140 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/target 2024-03-12T17:06:22.141 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/target/iscsi 2024-03-12T17:06:22.141 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-12T17:06:22.141 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/target/loopback 2024-03-12T17:06:22.141 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-12T17:06:22.141 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/target/target_core_file.ko 2024-03-12T17:06:22.141 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/target/target_core_iblock.ko 2024-03-12T17:06:22.141 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/target/target_core_mod.ko 2024-03-12T17:06:22.141 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/target/target_core_pscsi.ko 2024-03-12T17:06:22.141 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/target/target_core_user.ko 2024-03-12T17:06:22.141 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/target/tcm_fc 2024-03-12T17:06:22.141 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-12T17:06:22.141 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal 2024-03-12T17:06:22.141 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal/intel 2024-03-12T17:06:22.141 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal/intel/int340x_thermal 2024-03-12T17:06:22.141 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-12T17:06:22.141 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-12T17:06:22.141 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-12T17:06:22.142 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-12T17:06:22.142 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-12T17:06:22.142 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-12T17:06:22.142 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-12T17:06:22.142 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-12T17:06:22.142 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-12T17:06:22.142 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-12T17:06:22.142 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-12T17:06:22.142 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-12T17:06:22.142 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-12T17:06:22.142 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-12T17:06:22.142 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-12T17:06:22.142 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-12T17:06:22.142 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-12T17:06:22.142 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-12T17:06:22.143 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/tty 2024-03-12T17:06:22.143 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/tty/ipwireless 2024-03-12T17:06:22.143 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-12T17:06:22.143 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/tty/n_gsm.ko 2024-03-12T17:06:22.143 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/tty/n_hdlc.ko 2024-03-12T17:06:22.143 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/tty/nozomi.ko 2024-03-12T17:06:22.143 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/tty/serial 2024-03-12T17:06:22.143 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/tty/serial/8250 2024-03-12T17:06:22.143 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-12T17:06:22.143 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/tty/serial/arc_uart.ko 2024-03-12T17:06:22.143 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/tty/serial/jsm 2024-03-12T17:06:22.143 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-12T17:06:22.143 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ufs 2024-03-12T17:06:22.143 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ufs/core 2024-03-12T17:06:22.143 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-12T17:06:22.143 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ufs/host 2024-03-12T17:06:22.143 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-12T17:06:22.144 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/uio 2024-03-12T17:06:22.144 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/uio/uio.ko 2024-03-12T17:06:22.144 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/uio/uio_aec.ko 2024-03-12T17:06:22.144 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/uio/uio_cif.ko 2024-03-12T17:06:22.144 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/uio/uio_pci_generic.ko 2024-03-12T17:06:22.144 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/uio/uio_sercos3.ko 2024-03-12T17:06:22.144 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb 2024-03-12T17:06:22.144 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/class 2024-03-12T17:06:22.144 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/class/cdc-acm.ko 2024-03-12T17:06:22.144 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-12T17:06:22.144 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/class/usblp.ko 2024-03-12T17:06:22.144 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/class/usbtmc.ko 2024-03-12T17:06:22.144 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/host 2024-03-12T17:06:22.144 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-12T17:06:22.144 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/image 2024-03-12T17:06:22.144 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/image/mdc800.ko 2024-03-12T17:06:22.145 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/image/microtek.ko 2024-03-12T17:06:22.145 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/misc 2024-03-12T17:06:22.145 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/misc/adutux.ko 2024-03-12T17:06:22.145 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/misc/appledisplay.ko 2024-03-12T17:06:22.145 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/misc/emi26.ko 2024-03-12T17:06:22.145 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/misc/emi62.ko 2024-03-12T17:06:22.145 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/misc/ezusb.ko 2024-03-12T17:06:22.145 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/misc/idmouse.ko 2024-03-12T17:06:22.145 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/misc/iowarrior.ko 2024-03-12T17:06:22.145 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-12T17:06:22.145 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/misc/ldusb.ko 2024-03-12T17:06:22.145 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/misc/legousbtower.ko 2024-03-12T17:06:22.145 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/misc/sisusbvga 2024-03-12T17:06:22.145 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-12T17:06:22.146 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-12T17:06:22.146 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/misc/usb3503.ko 2024-03-12T17:06:22.146 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/misc/usblcd.ko 2024-03-12T17:06:22.146 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-12T17:06:22.146 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/misc/uss720.ko 2024-03-12T17:06:22.146 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/misc/yurex.ko 2024-03-12T17:06:22.146 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/phy 2024-03-12T17:06:22.146 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/phy/phy-generic.ko 2024-03-12T17:06:22.146 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial 2024-03-12T17:06:22.146 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/aircable.ko 2024-03-12T17:06:22.146 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/ark3116.ko 2024-03-12T17:06:22.146 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-12T17:06:22.146 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/ch341.ko 2024-03-12T17:06:22.146 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/cp210x.ko 2024-03-12T17:06:22.146 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/cyberjack.ko 2024-03-12T17:06:22.147 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-12T17:06:22.147 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-12T17:06:22.147 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/empeg.ko 2024-03-12T17:06:22.147 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-12T17:06:22.147 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-12T17:06:22.147 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-12T17:06:22.147 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/io_ti.ko 2024-03-12T17:06:22.147 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/ipaq.ko 2024-03-12T17:06:22.147 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/ipw.ko 2024-03-12T17:06:22.147 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/ir-usb.ko 2024-03-12T17:06:22.147 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-12T17:06:22.147 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/keyspan.ko 2024-03-12T17:06:22.147 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-12T17:06:22.147 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-12T17:06:22.147 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-12T17:06:22.148 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/mct_u232.ko 2024-03-12T17:06:22.148 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/mos7720.ko 2024-03-12T17:06:22.148 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/mos7840.ko 2024-03-12T17:06:22.148 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/navman.ko 2024-03-12T17:06:22.148 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/omninet.ko 2024-03-12T17:06:22.148 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/opticon.ko 2024-03-12T17:06:22.148 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/option.ko 2024-03-12T17:06:22.148 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/oti6858.ko 2024-03-12T17:06:22.148 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/pl2303.ko 2024-03-12T17:06:22.148 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/qcaux.ko 2024-03-12T17:06:22.148 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/qcserial.ko 2024-03-12T17:06:22.148 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/quatech2.ko 2024-03-12T17:06:22.148 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/safe_serial.ko 2024-03-12T17:06:22.148 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/sierra.ko 2024-03-12T17:06:22.148 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-12T17:06:22.148 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/ssu100.ko 2024-03-12T17:06:22.149 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/symbolserial.ko 2024-03-12T17:06:22.149 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-12T17:06:22.149 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-12T17:06:22.149 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/usb_debug.ko 2024-03-12T17:06:22.149 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-12T17:06:22.149 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/visor.ko 2024-03-12T17:06:22.149 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/whiteheat.ko 2024-03-12T17:06:22.149 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-12T17:06:22.149 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/storage 2024-03-12T17:06:22.149 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/storage/uas.ko 2024-03-12T17:06:22.149 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-12T17:06:22.149 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-12T17:06:22.149 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-12T17:06:22.149 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-12T17:06:22.149 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-12T17:06:22.150 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-12T17:06:22.150 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-12T17:06:22.150 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/storage/ums-karma.ko 2024-03-12T17:06:22.150 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-12T17:06:22.150 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-12T17:06:22.150 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-12T17:06:22.150 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-12T17:06:22.150 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-12T17:06:22.150 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/storage/usb-storage.ko 2024-03-12T17:06:22.150 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/usbip 2024-03-12T17:06:22.150 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-12T17:06:22.150 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-12T17:06:22.150 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-12T17:06:22.150 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/vfio 2024-03-12T17:06:22.151 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/vfio/pci 2024-03-12T17:06:22.151 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-12T17:06:22.151 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-12T17:06:22.151 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/vfio/vfio.ko 2024-03-12T17:06:22.151 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-12T17:06:22.151 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/vhost 2024-03-12T17:06:22.151 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/vhost/vhost.ko 2024-03-12T17:06:22.151 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-12T17:06:22.151 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/vhost/vhost_net.ko 2024-03-12T17:06:22.151 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/vhost/vhost_scsi.ko 2024-03-12T17:06:22.151 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/video 2024-03-12T17:06:22.151 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/video/backlight 2024-03-12T17:06:22.151 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/video/backlight/apple_bl.ko 2024-03-12T17:06:22.151 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/video/backlight/lcd.ko 2024-03-12T17:06:22.151 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-12T17:06:22.151 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/virtio 2024-03-12T17:06:22.152 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/virtio/virtio.ko 2024-03-12T17:06:22.152 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/virtio/virtio_balloon.ko 2024-03-12T17:06:22.152 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/virtio/virtio_mmio.ko 2024-03-12T17:06:22.152 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/virtio/virtio_pci.ko 2024-03-12T17:06:22.152 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-03-12T17:06:22.152 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-03-12T17:06:22.152 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/virtio/virtio_ring.ko 2024-03-12T17:06:22.152 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/w1 2024-03-12T17:06:22.152 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/w1/masters 2024-03-12T17:06:22.152 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/w1/masters/ds2482.ko 2024-03-12T17:06:22.152 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/w1/masters/ds2490.ko 2024-03-12T17:06:22.152 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/w1/slaves 2024-03-12T17:06:22.152 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-12T17:06:22.152 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-12T17:06:22.152 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-12T17:06:22.152 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-12T17:06:22.153 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-12T17:06:22.153 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-12T17:06:22.153 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-12T17:06:22.153 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-12T17:06:22.153 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-12T17:06:22.153 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-12T17:06:22.153 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-12T17:06:22.153 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/w1/wire.ko 2024-03-12T17:06:22.153 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog 2024-03-12T17:06:22.153 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-12T17:06:22.153 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-12T17:06:22.153 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-12T17:06:22.153 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/hpwdt.ko 2024-03-12T17:06:22.153 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/i6300esb.ko 2024-03-12T17:06:22.153 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-12T17:06:22.153 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-12T17:06:22.154 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/ib700wdt.ko 2024-03-12T17:06:22.154 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/ibmasr.ko 2024-03-12T17:06:22.154 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-12T17:06:22.154 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-12T17:06:22.154 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/it87_wdt.ko 2024-03-12T17:06:22.154 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/machzwd.ko 2024-03-12T17:06:22.154 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/nv_tco.ko 2024-03-12T17:06:22.154 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-12T17:06:22.154 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-12T17:06:22.154 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-12T17:06:22.154 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-12T17:06:22.154 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/softdog.ko 2024-03-12T17:06:22.154 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-12T17:06:22.154 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/via_wdt.ko 2024-03-12T17:06:22.155 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-12T17:06:22.155 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-12T17:06:22.155 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-12T17:06:22.155 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/wdt_pci.ko 2024-03-12T17:06:22.155 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/xen_wdt.ko 2024-03-12T17:06:22.155 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/xen 2024-03-12T17:06:22.155 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/xen/xen-acpi-processor.ko 2024-03-12T17:06:22.155 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/xen/xen-evtchn.ko 2024-03-12T17:06:22.155 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/xen/xen-gntalloc.ko 2024-03-12T17:06:22.155 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/xen/xen-gntdev.ko 2024-03-12T17:06:22.155 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/xen/xen-pciback 2024-03-12T17:06:22.155 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-12T17:06:22.155 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/xen/xen-privcmd.ko 2024-03-12T17:06:22.155 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/xen/xenfs 2024-03-12T17:06:22.155 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-12T17:06:22.156 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs 2024-03-12T17:06:22.156 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/9p 2024-03-12T17:06:22.156 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/9p/9p.ko 2024-03-12T17:06:22.156 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/affs 2024-03-12T17:06:22.156 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/affs/affs.ko 2024-03-12T17:06:22.156 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/befs 2024-03-12T17:06:22.156 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/befs/befs.ko 2024-03-12T17:06:22.156 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/binfmt_misc.ko 2024-03-12T17:06:22.156 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/btrfs 2024-03-12T17:06:22.156 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/btrfs/btrfs.ko 2024-03-12T17:06:22.156 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/cachefiles 2024-03-12T17:06:22.156 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/cachefiles/cachefiles.ko 2024-03-12T17:06:22.156 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/ceph 2024-03-12T17:06:22.156 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/ceph/ceph.ko 2024-03-12T17:06:22.156 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/coda 2024-03-12T17:06:22.156 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/coda/coda.ko 2024-03-12T17:06:22.157 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/cramfs 2024-03-12T17:06:22.157 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/cramfs/cramfs.ko 2024-03-12T17:06:22.157 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/dlm 2024-03-12T17:06:22.157 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/dlm/dlm.ko 2024-03-12T17:06:22.157 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/ecryptfs 2024-03-12T17:06:22.157 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/ecryptfs/ecryptfs.ko 2024-03-12T17:06:22.157 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/f2fs 2024-03-12T17:06:22.157 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/f2fs/f2fs.ko 2024-03-12T17:06:22.157 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/fat 2024-03-12T17:06:22.157 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/fat/fat.ko 2024-03-12T17:06:22.157 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/fat/msdos.ko 2024-03-12T17:06:22.157 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/fat/vfat.ko 2024-03-12T17:06:22.157 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/fuse 2024-03-12T17:06:22.157 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/fuse/cuse.ko 2024-03-12T17:06:22.157 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/fuse/fuse.ko 2024-03-12T17:06:22.157 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/gfs2 2024-03-12T17:06:22.157 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/gfs2/gfs2.ko 2024-03-12T17:06:22.158 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/hfs 2024-03-12T17:06:22.158 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/hfs/hfs.ko 2024-03-12T17:06:22.158 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/hfsplus 2024-03-12T17:06:22.158 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/hfsplus/hfsplus.ko 2024-03-12T17:06:22.158 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/isofs 2024-03-12T17:06:22.158 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/isofs/isofs.ko 2024-03-12T17:06:22.158 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/jfs 2024-03-12T17:06:22.158 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/jfs/jfs.ko 2024-03-12T17:06:22.158 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/lockd 2024-03-12T17:06:22.158 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/lockd/lockd.ko 2024-03-12T17:06:22.158 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/minix 2024-03-12T17:06:22.158 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/minix/minix.ko 2024-03-12T17:06:22.158 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/netfs 2024-03-12T17:06:22.158 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/netfs/netfs.ko 2024-03-12T17:06:22.158 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nfs 2024-03-12T17:06:22.159 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nfs/blocklayout 2024-03-12T17:06:22.159 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-12T17:06:22.159 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nfs/filelayout 2024-03-12T17:06:22.159 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-12T17:06:22.159 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nfs/flexfilelayout 2024-03-12T17:06:22.159 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-12T17:06:22.159 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nfs/nfs.ko 2024-03-12T17:06:22.159 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nfs/nfsv3.ko 2024-03-12T17:06:22.159 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nfs/nfsv4.ko 2024-03-12T17:06:22.159 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nfs_common 2024-03-12T17:06:22.159 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nfs_common/grace.ko 2024-03-12T17:06:22.159 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nfs_common/nfs_acl.ko 2024-03-12T17:06:22.159 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nfsd 2024-03-12T17:06:22.159 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nfsd/nfsd.ko 2024-03-12T17:06:22.159 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nilfs2 2024-03-12T17:06:22.160 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nilfs2/nilfs2.ko 2024-03-12T17:06:22.160 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls 2024-03-12T17:06:22.160 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/mac-celtic.ko 2024-03-12T17:06:22.160 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/mac-centeuro.ko 2024-03-12T17:06:22.160 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/mac-croatian.ko 2024-03-12T17:06:22.160 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/mac-cyrillic.ko 2024-03-12T17:06:22.160 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/mac-gaelic.ko 2024-03-12T17:06:22.160 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/mac-greek.ko 2024-03-12T17:06:22.160 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/mac-iceland.ko 2024-03-12T17:06:22.160 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/mac-inuit.ko 2024-03-12T17:06:22.160 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/mac-roman.ko 2024-03-12T17:06:22.160 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/mac-romanian.ko 2024-03-12T17:06:22.160 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/mac-turkish.ko 2024-03-12T17:06:22.160 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp1250.ko 2024-03-12T17:06:22.160 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp1251.ko 2024-03-12T17:06:22.160 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp1255.ko 2024-03-12T17:06:22.161 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp737.ko 2024-03-12T17:06:22.161 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp775.ko 2024-03-12T17:06:22.161 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp850.ko 2024-03-12T17:06:22.161 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp852.ko 2024-03-12T17:06:22.161 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp855.ko 2024-03-12T17:06:22.161 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp857.ko 2024-03-12T17:06:22.161 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp860.ko 2024-03-12T17:06:22.161 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp861.ko 2024-03-12T17:06:22.161 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp862.ko 2024-03-12T17:06:22.161 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp863.ko 2024-03-12T17:06:22.161 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp864.ko 2024-03-12T17:06:22.161 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp865.ko 2024-03-12T17:06:22.161 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp866.ko 2024-03-12T17:06:22.161 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp869.ko 2024-03-12T17:06:22.161 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp874.ko 2024-03-12T17:06:22.162 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp932.ko 2024-03-12T17:06:22.162 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp936.ko 2024-03-12T17:06:22.162 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp949.ko 2024-03-12T17:06:22.162 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp950.ko 2024-03-12T17:06:22.162 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_euc-jp.ko 2024-03-12T17:06:22.162 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_iso8859-1.ko 2024-03-12T17:06:22.162 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_iso8859-13.ko 2024-03-12T17:06:22.162 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_iso8859-14.ko 2024-03-12T17:06:22.162 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_iso8859-15.ko 2024-03-12T17:06:22.162 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_iso8859-2.ko 2024-03-12T17:06:22.162 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_iso8859-3.ko 2024-03-12T17:06:22.162 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_iso8859-4.ko 2024-03-12T17:06:22.162 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_iso8859-5.ko 2024-03-12T17:06:22.162 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_iso8859-6.ko 2024-03-12T17:06:22.162 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_iso8859-7.ko 2024-03-12T17:06:22.163 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_iso8859-9.ko 2024-03-12T17:06:22.163 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_koi8-r.ko 2024-03-12T17:06:22.163 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_koi8-ru.ko 2024-03-12T17:06:22.163 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_koi8-u.ko 2024-03-12T17:06:22.163 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-12T17:06:22.163 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_utf8.ko 2024-03-12T17:06:22.163 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/ocfs2 2024-03-12T17:06:22.163 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/ocfs2/cluster 2024-03-12T17:06:22.163 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-12T17:06:22.163 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/ocfs2/dlm 2024-03-12T17:06:22.163 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-12T17:06:22.163 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/ocfs2/dlmfs 2024-03-12T17:06:22.163 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-12T17:06:22.163 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/ocfs2/ocfs2.ko 2024-03-12T17:06:22.163 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-12T17:06:22.164 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-12T17:06:22.164 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-12T17:06:22.164 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/overlayfs 2024-03-12T17:06:22.164 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/overlayfs/overlay.ko 2024-03-12T17:06:22.164 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/pstore 2024-03-12T17:06:22.164 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/pstore/ramoops.ko 2024-03-12T17:06:22.164 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/reiserfs 2024-03-12T17:06:22.164 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/reiserfs/reiserfs.ko 2024-03-12T17:06:22.164 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/romfs 2024-03-12T17:06:22.164 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/romfs/romfs.ko 2024-03-12T17:06:22.164 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/smb 2024-03-12T17:06:22.164 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/smb/client 2024-03-12T17:06:22.164 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/smb/client/cifs.ko 2024-03-12T17:06:22.164 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/smb/common 2024-03-12T17:06:22.164 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/smb/common/cifs_arc4.ko 2024-03-12T17:06:22.165 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/smb/common/cifs_md4.ko 2024-03-12T17:06:22.165 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/squashfs 2024-03-12T17:06:22.165 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/squashfs/squashfs.ko 2024-03-12T17:06:22.165 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/sysv 2024-03-12T17:06:22.165 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/sysv/sysv.ko 2024-03-12T17:06:22.165 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/udf 2024-03-12T17:06:22.165 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/udf/udf.ko 2024-03-12T17:06:22.165 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/ufs 2024-03-12T17:06:22.165 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/ufs/ufs.ko 2024-03-12T17:06:22.165 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/xfs 2024-03-12T17:06:22.165 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/xfs/xfs.ko 2024-03-12T17:06:22.165 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/kernel 2024-03-12T17:06:22.165 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/kernel/rcu 2024-03-12T17:06:22.165 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/kernel/rcu/rcutorture.ko 2024-03-12T17:06:22.165 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/kernel/torture.ko 2024-03-12T17:06:22.165 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/kernel/trace 2024-03-12T17:06:22.166 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-03-12T17:06:22.166 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib 2024-03-12T17:06:22.166 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/asn1_encoder.ko 2024-03-12T17:06:22.166 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/crc-itu-t.ko 2024-03-12T17:06:22.166 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/crc8.ko 2024-03-12T17:06:22.166 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/crypto 2024-03-12T17:06:22.166 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/crypto/libarc4.ko 2024-03-12T17:06:22.166 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/crypto/libdes.ko 2024-03-12T17:06:22.166 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/libcrc32c.ko 2024-03-12T17:06:22.166 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/lru_cache.ko 2024-03-12T17:06:22.166 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/lz4 2024-03-12T17:06:22.166 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/lz4/lz4_compress.ko 2024-03-12T17:06:22.166 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/lz4/lz4hc_compress.ko 2024-03-12T17:06:22.166 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/math 2024-03-12T17:06:22.167 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/math/cordic.ko 2024-03-12T17:06:22.167 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/raid6 2024-03-12T17:06:22.167 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/raid6/raid6_pq.ko 2024-03-12T17:06:22.167 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/reed_solomon 2024-03-12T17:06:22.167 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-12T17:06:22.167 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/ts_bm.ko 2024-03-12T17:06:22.167 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/ts_fsm.ko 2024-03-12T17:06:22.167 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/ts_kmp.ko 2024-03-12T17:06:22.167 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/zstd 2024-03-12T17:06:22.167 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/zstd/zstd_compress.ko 2024-03-12T17:06:22.167 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/mm 2024-03-12T17:06:22.167 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/mm/hwpoison-inject.ko 2024-03-12T17:06:22.167 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net 2024-03-12T17:06:22.167 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/6lowpan 2024-03-12T17:06:22.167 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/6lowpan/6lowpan.ko 2024-03-12T17:06:22.168 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/6lowpan/nhc_dest.ko 2024-03-12T17:06:22.168 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/6lowpan/nhc_fragment.ko 2024-03-12T17:06:22.168 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/6lowpan/nhc_hop.ko 2024-03-12T17:06:22.168 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-12T17:06:22.168 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/6lowpan/nhc_mobility.ko 2024-03-12T17:06:22.168 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/6lowpan/nhc_routing.ko 2024-03-12T17:06:22.168 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/6lowpan/nhc_udp.ko 2024-03-12T17:06:22.168 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/802 2024-03-12T17:06:22.168 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/802/garp.ko 2024-03-12T17:06:22.168 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/802/mrp.ko 2024-03-12T17:06:22.168 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/802/p8022.ko 2024-03-12T17:06:22.168 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/802/psnap.ko 2024-03-12T17:06:22.168 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/802/stp.ko 2024-03-12T17:06:22.168 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/8021q 2024-03-12T17:06:22.168 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/8021q/8021q.ko 2024-03-12T17:06:22.169 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/9p 2024-03-12T17:06:22.169 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/9p/9pnet.ko 2024-03-12T17:06:22.169 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/9p/9pnet_fd.ko 2024-03-12T17:06:22.169 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/9p/9pnet_rdma.ko 2024-03-12T17:06:22.169 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/9p/9pnet_virtio.ko 2024-03-12T17:06:22.169 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/batman-adv 2024-03-12T17:06:22.169 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/batman-adv/batman-adv.ko 2024-03-12T17:06:22.169 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge 2024-03-12T17:06:22.169 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/br_netfilter.ko 2024-03-12T17:06:22.169 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/bridge.ko 2024-03-12T17:06:22.169 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter 2024-03-12T17:06:22.169 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-12T17:06:22.169 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-12T17:06:22.169 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-12T17:06:22.169 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-12T17:06:22.169 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-12T17:06:22.169 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-12T17:06:22.170 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-12T17:06:22.170 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-12T17:06:22.170 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-12T17:06:22.170 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-12T17:06:22.170 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-12T17:06:22.170 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-12T17:06:22.170 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-12T17:06:22.170 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-12T17:06:22.170 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-12T17:06:22.170 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-12T17:06:22.170 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-12T17:06:22.170 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-12T17:06:22.170 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-12T17:06:22.170 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-12T17:06:22.170 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebtables.ko 2024-03-12T17:06:22.171 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-03-12T17:06:22.171 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-12T17:06:22.171 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-12T17:06:22.171 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ceph 2024-03-12T17:06:22.171 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ceph/libceph.ko 2024-03-12T17:06:22.171 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/core 2024-03-12T17:06:22.171 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/core/failover.ko 2024-03-12T17:06:22.171 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/core/pktgen.ko 2024-03-12T17:06:22.171 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/dccp 2024-03-12T17:06:22.171 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/dccp/dccp.ko 2024-03-12T17:06:22.171 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/dccp/dccp_diag.ko 2024-03-12T17:06:22.171 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/dccp/dccp_ipv4.ko 2024-03-12T17:06:22.171 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/dccp/dccp_ipv6.ko 2024-03-12T17:06:22.171 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/dns_resolver 2024-03-12T17:06:22.171 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/dns_resolver/dns_resolver.ko 2024-03-12T17:06:22.172 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/dsa 2024-03-12T17:06:22.172 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/dsa/dsa_core.ko 2024-03-12T17:06:22.172 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/dsa/tag_brcm.ko 2024-03-12T17:06:22.172 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/dsa/tag_dsa.ko 2024-03-12T17:06:22.172 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/dsa/tag_none.ko 2024-03-12T17:06:22.172 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/dsa/tag_trailer.ko 2024-03-12T17:06:22.172 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ieee802154 2024-03-12T17:06:22.172 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ieee802154/6lowpan 2024-03-12T17:06:22.172 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-12T17:06:22.172 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ieee802154/ieee802154.ko 2024-03-12T17:06:22.172 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-12T17:06:22.172 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4 2024-03-12T17:06:22.172 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/ah4.ko 2024-03-12T17:06:22.172 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/esp4.ko 2024-03-12T17:06:22.172 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/fou.ko 2024-03-12T17:06:22.172 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/gre.ko 2024-03-12T17:06:22.173 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/inet_diag.ko 2024-03-12T17:06:22.173 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/ip_gre.ko 2024-03-12T17:06:22.173 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/ip_tunnel.ko 2024-03-12T17:06:22.173 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/ip_vti.ko 2024-03-12T17:06:22.173 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/ipcomp.ko 2024-03-12T17:06:22.173 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/ipip.ko 2024-03-12T17:06:22.173 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter 2024-03-12T17:06:22.173 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-12T17:06:22.173 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-12T17:06:22.173 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-12T17:06:22.173 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-12T17:06:22.173 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-12T17:06:22.173 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-12T17:06:22.173 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-12T17:06:22.173 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-12T17:06:22.173 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-12T17:06:22.174 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-12T17:06:22.174 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-12T17:06:22.174 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-12T17:06:22.174 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-12T17:06:22.174 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-12T17:06:22.174 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-12T17:06:22.174 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-12T17:06:22.174 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-12T17:06:22.174 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-12T17:06:22.174 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-12T17:06:22.174 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-12T17:06:22.174 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-12T17:06:22.174 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/tcp_bic.ko 2024-03-12T17:06:22.174 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/tcp_dctcp.ko 2024-03-12T17:06:22.174 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/tcp_diag.ko 2024-03-12T17:06:22.175 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/tcp_highspeed.ko 2024-03-12T17:06:22.175 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/tcp_htcp.ko 2024-03-12T17:06:22.175 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/tcp_hybla.ko 2024-03-12T17:06:22.175 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/tcp_illinois.ko 2024-03-12T17:06:22.175 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/tcp_lp.ko 2024-03-12T17:06:22.175 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/tcp_scalable.ko 2024-03-12T17:06:22.175 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/tcp_vegas.ko 2024-03-12T17:06:22.175 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/tcp_veno.ko 2024-03-12T17:06:22.175 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/tcp_westwood.ko 2024-03-12T17:06:22.175 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/tcp_yeah.ko 2024-03-12T17:06:22.175 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/tunnel4.ko 2024-03-12T17:06:22.175 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/udp_diag.ko 2024-03-12T17:06:22.175 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/udp_tunnel.ko 2024-03-12T17:06:22.175 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-12T17:06:22.175 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6 2024-03-12T17:06:22.176 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/ah6.ko 2024-03-12T17:06:22.176 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/esp6.ko 2024-03-12T17:06:22.176 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/fou6.ko 2024-03-12T17:06:22.176 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/ip6_tunnel.ko 2024-03-12T17:06:22.176 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-12T17:06:22.176 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/ip6_vti.ko 2024-03-12T17:06:22.176 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/ipcomp6.ko 2024-03-12T17:06:22.176 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter 2024-03-12T17:06:22.176 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-12T17:06:22.176 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-12T17:06:22.176 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-12T17:06:22.176 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-12T17:06:22.176 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-12T17:06:22.176 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-12T17:06:22.176 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-12T17:06:22.176 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-12T17:06:22.177 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-12T17:06:22.177 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-12T17:06:22.177 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-12T17:06:22.177 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-12T17:06:22.177 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-12T17:06:22.177 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-12T17:06:22.177 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-12T17:06:22.177 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-12T17:06:22.177 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-12T17:06:22.177 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-12T17:06:22.177 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-12T17:06:22.177 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-12T17:06:22.177 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-12T17:06:22.177 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-12T17:06:22.177 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-12T17:06:22.177 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-12T17:06:22.177 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/sit.ko 2024-03-12T17:06:22.178 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/tunnel6.ko 2024-03-12T17:06:22.178 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-12T17:06:22.178 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/key 2024-03-12T17:06:22.178 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/key/af_key.ko 2024-03-12T17:06:22.178 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/l2tp 2024-03-12T17:06:22.178 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/l2tp/l2tp_core.ko 2024-03-12T17:06:22.178 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-12T17:06:22.178 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/l2tp/l2tp_eth.ko 2024-03-12T17:06:22.178 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/l2tp/l2tp_ip.ko 2024-03-12T17:06:22.178 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/l2tp/l2tp_ip6.ko 2024-03-12T17:06:22.178 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/l2tp/l2tp_netlink.ko 2024-03-12T17:06:22.178 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/l2tp/l2tp_ppp.ko 2024-03-12T17:06:22.178 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/llc 2024-03-12T17:06:22.178 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/llc/llc.ko 2024-03-12T17:06:22.178 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/mac802154 2024-03-12T17:06:22.179 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/mac802154/mac802154.ko 2024-03-12T17:06:22.179 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/mpls 2024-03-12T17:06:22.179 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/mpls/mpls_gso.ko 2024-03-12T17:06:22.179 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter 2024-03-12T17:06:22.179 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipset 2024-03-12T17:06:22.179 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipset/ip_set.ko 2024-03-12T17:06:22.179 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-12T17:06:22.179 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-12T17:06:22.179 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-12T17:06:22.179 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-12T17:06:22.179 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-12T17:06:22.179 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-12T17:06:22.179 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-12T17:06:22.179 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-12T17:06:22.179 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-12T17:06:22.180 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-12T17:06:22.180 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-12T17:06:22.180 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-12T17:06:22.180 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-12T17:06:22.180 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-12T17:06:22.180 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-12T17:06:22.180 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipvs 2024-03-12T17:06:22.180 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-12T17:06:22.180 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-12T17:06:22.180 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-12T17:06:22.180 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-12T17:06:22.180 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-12T17:06:22.180 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-12T17:06:22.180 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-12T17:06:22.180 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-12T17:06:22.180 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-12T17:06:22.181 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-12T17:06:22.181 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-12T17:06:22.181 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-12T17:06:22.181 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-12T17:06:22.181 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-12T17:06:22.181 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_conncount.ko 2024-03-12T17:06:22.181 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_conntrack.ko 2024-03-12T17:06:22.181 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-12T17:06:22.181 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-12T17:06:22.181 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-12T17:06:22.181 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-12T17:06:22.181 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-12T17:06:22.181 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-12T17:06:22.181 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-12T17:06:22.181 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-12T17:06:22.181 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-12T17:06:22.182 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-12T17:06:22.182 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-12T17:06:22.182 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-12T17:06:22.182 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-12T17:06:22.182 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_flow_table.ko 2024-03-12T17:06:22.182 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-12T17:06:22.182 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_log_syslog.ko 2024-03-12T17:06:22.182 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_nat.ko 2024-03-12T17:06:22.182 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-12T17:06:22.182 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-12T17:06:22.182 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_nat_irc.ko 2024-03-12T17:06:22.182 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_nat_sip.ko 2024-03-12T17:06:22.182 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-12T17:06:22.182 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-12T17:06:22.182 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_tables.ko 2024-03-12T17:06:22.183 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nfnetlink.ko 2024-03-12T17:06:22.183 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-12T17:06:22.183 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nfnetlink_log.ko 2024-03-12T17:06:22.183 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-12T17:06:22.183 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-12T17:06:22.183 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nft_chain_nat.ko 2024-03-12T17:06:22.183 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nft_compat.ko 2024-03-12T17:06:22.183 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nft_ct.ko 2024-03-12T17:06:22.183 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-12T17:06:22.183 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nft_fib.ko 2024-03-12T17:06:22.183 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-12T17:06:22.183 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nft_hash.ko 2024-03-12T17:06:22.183 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nft_limit.ko 2024-03-12T17:06:22.183 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nft_log.ko 2024-03-12T17:06:22.183 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nft_masq.ko 2024-03-12T17:06:22.183 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nft_nat.ko 2024-03-12T17:06:22.184 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nft_numgen.ko 2024-03-12T17:06:22.184 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nft_queue.ko 2024-03-12T17:06:22.184 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nft_quota.ko 2024-03-12T17:06:22.184 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nft_redir.ko 2024-03-12T17:06:22.184 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nft_reject.ko 2024-03-12T17:06:22.184 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nft_reject_inet.ko 2024-03-12T17:06:22.184 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nft_socket.ko 2024-03-12T17:06:22.184 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nft_tunnel.ko 2024-03-12T17:06:22.184 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_AUDIT.ko 2024-03-12T17:06:22.184 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-12T17:06:22.184 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-12T17:06:22.184 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-12T17:06:22.184 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_CT.ko 2024-03-12T17:06:22.184 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_DSCP.ko 2024-03-12T17:06:22.184 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_HL.ko 2024-03-12T17:06:22.184 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_HMARK.ko 2024-03-12T17:06:22.185 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-12T17:06:22.185 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_LED.ko 2024-03-12T17:06:22.185 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_LOG.ko 2024-03-12T17:06:22.185 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-12T17:06:22.185 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_NETMAP.ko 2024-03-12T17:06:22.185 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_NFLOG.ko 2024-03-12T17:06:22.185 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-12T17:06:22.185 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_RATEEST.ko 2024-03-12T17:06:22.185 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-12T17:06:22.185 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_SECMARK.ko 2024-03-12T17:06:22.185 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-12T17:06:22.185 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-12T17:06:22.185 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_TEE.ko 2024-03-12T17:06:22.185 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_TPROXY.ko 2024-03-12T17:06:22.185 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_TRACE.ko 2024-03-12T17:06:22.185 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_addrtype.ko 2024-03-12T17:06:22.186 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_bpf.ko 2024-03-12T17:06:22.186 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_cgroup.ko 2024-03-12T17:06:22.186 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_cluster.ko 2024-03-12T17:06:22.186 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_comment.ko 2024-03-12T17:06:22.186 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_connbytes.ko 2024-03-12T17:06:22.186 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_connlabel.ko 2024-03-12T17:06:22.186 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_connlimit.ko 2024-03-12T17:06:22.186 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_connmark.ko 2024-03-12T17:06:22.186 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_conntrack.ko 2024-03-12T17:06:22.186 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_cpu.ko 2024-03-12T17:06:22.186 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_dccp.ko 2024-03-12T17:06:22.186 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_devgroup.ko 2024-03-12T17:06:22.186 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_dscp.ko 2024-03-12T17:06:22.186 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_ecn.ko 2024-03-12T17:06:22.186 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_esp.ko 2024-03-12T17:06:22.187 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_hashlimit.ko 2024-03-12T17:06:22.187 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_helper.ko 2024-03-12T17:06:22.187 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_hl.ko 2024-03-12T17:06:22.187 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_ipcomp.ko 2024-03-12T17:06:22.187 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_iprange.ko 2024-03-12T17:06:22.187 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_ipvs.ko 2024-03-12T17:06:22.187 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_l2tp.ko 2024-03-12T17:06:22.187 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_length.ko 2024-03-12T17:06:22.187 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_limit.ko 2024-03-12T17:06:22.187 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_mac.ko 2024-03-12T17:06:22.187 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_mark.ko 2024-03-12T17:06:22.187 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_multiport.ko 2024-03-12T17:06:22.187 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_nat.ko 2024-03-12T17:06:22.187 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_nfacct.ko 2024-03-12T17:06:22.187 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_osf.ko 2024-03-12T17:06:22.187 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_owner.ko 2024-03-12T17:06:22.187 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_physdev.ko 2024-03-12T17:06:22.188 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_pkttype.ko 2024-03-12T17:06:22.188 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_policy.ko 2024-03-12T17:06:22.188 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_quota.ko 2024-03-12T17:06:22.188 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_rateest.ko 2024-03-12T17:06:22.188 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_realm.ko 2024-03-12T17:06:22.188 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_recent.ko 2024-03-12T17:06:22.188 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_sctp.ko 2024-03-12T17:06:22.188 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_set.ko 2024-03-12T17:06:22.188 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_socket.ko 2024-03-12T17:06:22.188 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_state.ko 2024-03-12T17:06:22.188 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_statistic.ko 2024-03-12T17:06:22.188 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_string.ko 2024-03-12T17:06:22.188 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_tcpmss.ko 2024-03-12T17:06:22.188 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_time.ko 2024-03-12T17:06:22.188 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_u32.ko 2024-03-12T17:06:22.188 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netlink 2024-03-12T17:06:22.189 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netlink/netlink_diag.ko 2024-03-12T17:06:22.189 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/nsh 2024-03-12T17:06:22.189 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/nsh/nsh.ko 2024-03-12T17:06:22.189 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/openvswitch 2024-03-12T17:06:22.189 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/openvswitch/openvswitch.ko 2024-03-12T17:06:22.189 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/openvswitch/vport-geneve.ko 2024-03-12T17:06:22.189 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/openvswitch/vport-gre.ko 2024-03-12T17:06:22.189 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/openvswitch/vport-vxlan.ko 2024-03-12T17:06:22.189 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/packet 2024-03-12T17:06:22.189 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/packet/af_packet_diag.ko 2024-03-12T17:06:22.189 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/rds 2024-03-12T17:06:22.189 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/rds/rds.ko 2024-03-12T17:06:22.189 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/rds/rds_rdma.ko 2024-03-12T17:06:22.189 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/rds/rds_tcp.ko 2024-03-12T17:06:22.189 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched 2024-03-12T17:06:22.190 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/act_csum.ko 2024-03-12T17:06:22.190 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/act_gact.ko 2024-03-12T17:06:22.190 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/act_mirred.ko 2024-03-12T17:06:22.190 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/act_nat.ko 2024-03-12T17:06:22.190 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/act_pedit.ko 2024-03-12T17:06:22.190 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/act_police.ko 2024-03-12T17:06:22.190 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/act_simple.ko 2024-03-12T17:06:22.190 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/act_skbedit.ko 2024-03-12T17:06:22.190 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/act_vlan.ko 2024-03-12T17:06:22.190 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/cls_basic.ko 2024-03-12T17:06:22.190 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/cls_bpf.ko 2024-03-12T17:06:22.190 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/cls_flow.ko 2024-03-12T17:06:22.190 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/cls_fw.ko 2024-03-12T17:06:22.190 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/cls_route.ko 2024-03-12T17:06:22.190 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/cls_u32.ko 2024-03-12T17:06:22.190 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/em_cmp.ko 2024-03-12T17:06:22.191 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/em_ipset.ko 2024-03-12T17:06:22.191 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/em_meta.ko 2024-03-12T17:06:22.191 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/em_nbyte.ko 2024-03-12T17:06:22.191 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/em_text.ko 2024-03-12T17:06:22.191 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/em_u32.ko 2024-03-12T17:06:22.191 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_choke.ko 2024-03-12T17:06:22.191 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_codel.ko 2024-03-12T17:06:22.191 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_drr.ko 2024-03-12T17:06:22.191 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_fq.ko 2024-03-12T17:06:22.191 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_gred.ko 2024-03-12T17:06:22.191 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_hfsc.ko 2024-03-12T17:06:22.191 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_hhf.ko 2024-03-12T17:06:22.191 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_htb.ko 2024-03-12T17:06:22.191 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_ingress.ko 2024-03-12T17:06:22.192 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_mqprio.ko 2024-03-12T17:06:22.192 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_mqprio_lib.ko 2024-03-12T17:06:22.192 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_multiq.ko 2024-03-12T17:06:22.192 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_netem.ko 2024-03-12T17:06:22.192 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_pie.ko 2024-03-12T17:06:22.192 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_plug.ko 2024-03-12T17:06:22.192 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_prio.ko 2024-03-12T17:06:22.192 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_qfq.ko 2024-03-12T17:06:22.192 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_red.ko 2024-03-12T17:06:22.192 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_sfb.ko 2024-03-12T17:06:22.192 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_sfq.ko 2024-03-12T17:06:22.192 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_tbf.ko 2024-03-12T17:06:22.192 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_teql.ko 2024-03-12T17:06:22.192 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sctp 2024-03-12T17:06:22.192 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sctp/sctp.ko 2024-03-12T17:06:22.192 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sctp/sctp_diag.ko 2024-03-12T17:06:22.193 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sunrpc 2024-03-12T17:06:22.193 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sunrpc/auth_gss 2024-03-12T17:06:22.193 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-12T17:06:22.193 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-12T17:06:22.193 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sunrpc/sunrpc.ko 2024-03-12T17:06:22.193 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sunrpc/xprtrdma 2024-03-12T17:06:22.193 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-12T17:06:22.193 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/tipc 2024-03-12T17:06:22.193 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/tipc/diag.ko 2024-03-12T17:06:22.193 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/tipc/tipc.ko 2024-03-12T17:06:22.193 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/unix 2024-03-12T17:06:22.193 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/unix/unix_diag.ko 2024-03-12T17:06:22.193 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/vmw_vsock 2024-03-12T17:06:22.193 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-12T17:06:22.193 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-12T17:06:22.194 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/vmw_vsock/vsock.ko 2024-03-12T17:06:22.194 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-12T17:06:22.194 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-12T17:06:22.194 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/xfrm 2024-03-12T17:06:22.194 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-12T17:06:22.194 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/security 2024-03-12T17:06:22.194 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/security/keys 2024-03-12T17:06:22.194 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/security/keys/encrypted-keys 2024-03-12T17:06:22.194 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-03-12T17:06:22.194 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/security/keys/trusted-keys 2024-03-12T17:06:22.194 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/security/keys/trusted-keys/trusted.ko 2024-03-12T17:06:22.194 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/virt 2024-03-12T17:06:22.194 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/virt/lib 2024-03-12T17:06:22.194 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/virt/lib/irqbypass.ko 2024-03-12T17:06:22.194 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/modules.alias 2024-03-12T17:06:22.194 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/modules.alias.bin 2024-03-12T17:06:22.195 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/modules.builtin 2024-03-12T17:06:22.195 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/modules.builtin.alias.bin 2024-03-12T17:06:22.195 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/modules.builtin.bin 2024-03-12T17:06:22.195 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/modules.builtin.modinfo 2024-03-12T17:06:22.195 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/modules.dep 2024-03-12T17:06:22.195 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/modules.dep.bin 2024-03-12T17:06:22.195 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/modules.devname 2024-03-12T17:06:22.195 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/modules.order 2024-03-12T17:06:22.195 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/modules.softdep 2024-03-12T17:06:22.195 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/modules.symbols 2024-03-12T17:06:22.195 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/modules.symbols.bin 2024-03-12T17:06:22.195 INFO:teuthology.orchestra.run.smithi094.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/vmlinuz 2024-03-12T17:06:22.199 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-rc7-gbf761b6efc7e 2024-03-12T17:06:22.200 DEBUG:teuthology.orchestra.run.smithi094:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-03-12T17:06:22.221 INFO:teuthology.orchestra.run.smithi094.stdout:postinstall scriptlet (using /bin/sh): 2024-03-12T17:06:22.222 INFO:teuthology.orchestra.run.smithi094.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-03-12T17:06:22.222 INFO:teuthology.orchestra.run.smithi094.stdout: /usr/bin/kernel-install add 6.8.0-rc7-gbf761b6efc7e /lib/modules/6.8.0-rc7-gbf761b6efc7e/vmlinuz 2024-03-12T17:06:22.222 INFO:teuthology.orchestra.run.smithi094.stdout:fi 2024-03-12T17:06:22.222 INFO:teuthology.orchestra.run.smithi094.stdout:for file in vmlinuz System.map config; do 2024-03-12T17:06:22.222 INFO:teuthology.orchestra.run.smithi094.stdout: if ! cmp --silent "/lib/modules/6.8.0-rc7-gbf761b6efc7e/${file}" "/boot/${file}-6.8.0-rc7-gbf761b6efc7e"; then 2024-03-12T17:06:22.222 INFO:teuthology.orchestra.run.smithi094.stdout: cp "/lib/modules/6.8.0-rc7-gbf761b6efc7e/${file}" "/boot/${file}-6.8.0-rc7-gbf761b6efc7e" 2024-03-12T17:06:22.222 INFO:teuthology.orchestra.run.smithi094.stdout: fi 2024-03-12T17:06:22.222 INFO:teuthology.orchestra.run.smithi094.stdout:done 2024-03-12T17:06:22.222 INFO:teuthology.orchestra.run.smithi094.stdout:preuninstall scriptlet (using /bin/sh): 2024-03-12T17:06:22.222 INFO:teuthology.orchestra.run.smithi094.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-03-12T17:06:22.222 INFO:teuthology.orchestra.run.smithi094.stdout:new-kernel-pkg --remove 6.8.0-rc7-gbf761b6efc7e --rminitrd --initrdfile=/boot/initramfs-6.8.0-rc7-gbf761b6efc7e.img 2024-03-12T17:06:22.222 INFO:teuthology.orchestra.run.smithi094.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-03-12T17:06:22.222 INFO:teuthology.orchestra.run.smithi094.stdout:kernel-install remove 6.8.0-rc7-gbf761b6efc7e 2024-03-12T17:06:22.222 INFO:teuthology.orchestra.run.smithi094.stdout:fi 2024-03-12T17:06:22.223 INFO:teuthology.orchestra.run.smithi094.stdout:postuninstall scriptlet (using /bin/sh): 2024-03-12T17:06:22.223 INFO:teuthology.orchestra.run.smithi094.stdout:if [ -x /sbin/update-bootloader ]; then 2024-03-12T17:06:22.223 INFO:teuthology.orchestra.run.smithi094.stdout:/sbin/update-bootloader --remove 6.8.0-rc7-gbf761b6efc7e 2024-03-12T17:06:22.223 INFO:teuthology.orchestra.run.smithi094.stdout:fi 2024-03-12T17:06:22.224 DEBUG:teuthology.orchestra.run.smithi094:> sudo rpm -qi grub2-tools 2024-03-12T17:06:22.298 INFO:teuthology.orchestra.run.smithi094.stdout:Name : grub2-tools 2024-03-12T17:06:22.298 INFO:teuthology.orchestra.run.smithi094.stdout:Epoch : 1 2024-03-12T17:06:22.298 INFO:teuthology.orchestra.run.smithi094.stdout:Version : 2.06 2024-03-12T17:06:22.298 INFO:teuthology.orchestra.run.smithi094.stdout:Release : 68.el9 2024-03-12T17:06:22.299 INFO:teuthology.orchestra.run.smithi094.stdout:Architecture: x86_64 2024-03-12T17:06:22.299 INFO:teuthology.orchestra.run.smithi094.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-12T17:06:22.299 INFO:teuthology.orchestra.run.smithi094.stdout:Group : Unspecified 2024-03-12T17:06:22.299 INFO:teuthology.orchestra.run.smithi094.stdout:Size : 8264254 2024-03-12T17:06:22.299 INFO:teuthology.orchestra.run.smithi094.stdout:License : GPLv3+ 2024-03-12T17:06:22.299 INFO:teuthology.orchestra.run.smithi094.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-12T17:06:22.299 INFO:teuthology.orchestra.run.smithi094.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-12T17:06:22.299 INFO:teuthology.orchestra.run.smithi094.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-12T17:06:22.299 INFO:teuthology.orchestra.run.smithi094.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-12T17:06:22.299 INFO:teuthology.orchestra.run.smithi094.stdout:Packager : builder@centos.org 2024-03-12T17:06:22.299 INFO:teuthology.orchestra.run.smithi094.stdout:Vendor : CentOS 2024-03-12T17:06:22.299 INFO:teuthology.orchestra.run.smithi094.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-12T17:06:22.299 INFO:teuthology.orchestra.run.smithi094.stdout:Summary : Support tools for GRUB. 2024-03-12T17:06:22.299 INFO:teuthology.orchestra.run.smithi094.stdout:Description : 2024-03-12T17:06:22.299 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:06:22.299 INFO:teuthology.orchestra.run.smithi094.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-12T17:06:22.299 INFO:teuthology.orchestra.run.smithi094.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-12T17:06:22.299 INFO:teuthology.orchestra.run.smithi094.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-12T17:06:22.300 INFO:teuthology.orchestra.run.smithi094.stdout:hardware devices. 2024-03-12T17:06:22.300 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:06:22.300 INFO:teuthology.orchestra.run.smithi094.stdout:This subpackage provides tools for support of all platforms. 2024-03-12T17:06:22.300 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-12T17:06:22.301 INFO:teuthology.task.kernel:Updating grub on smithi094 to boot 6.8.0-rc7-gbf761b6efc7e 2024-03-12T17:06:22.301 DEBUG:teuthology.orchestra.run.smithi094:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-12T17:06:22.976 INFO:teuthology.orchestra.run.smithi094.stderr:Generating grub configuration file ... 2024-03-12T17:06:24.289 INFO:teuthology.orchestra.run.smithi094.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-12T17:06:24.336 INFO:teuthology.orchestra.run.smithi094.stderr:done 2024-03-12T17:06:24.338 DEBUG:teuthology.orchestra.run.smithi094:> mktemp 2024-03-12T17:06:24.358 INFO:teuthology.orchestra.run.smithi094.stdout:/tmp/tmp.mrhV1QCsgW 2024-03-12T17:06:24.359 DEBUG:teuthology.orchestra.run.smithi094:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.mrhV1QCsgW 2024-03-12T17:06:24.430 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0666 /tmp/tmp.mrhV1QCsgW 2024-03-12T17:06:24.591 DEBUG:teuthology.orchestra.remote:smithi094:/tmp/tmp.mrhV1QCsgW is 6KB 2024-03-12T17:06:24.639 DEBUG:teuthology.orchestra.run.smithi094:> rm -fr /tmp/tmp.mrhV1QCsgW 2024-03-12T17:06:24.653 DEBUG:teuthology.orchestra.run.smithi094:> sudo /bin/ls /boot/loader/entries || true 2024-03-12T17:06:24.719 INFO:teuthology.orchestra.run.smithi094.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-12T17:06:24.719 INFO:teuthology.orchestra.run.smithi094.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-12T17:06:24.719 INFO:teuthology.orchestra.run.smithi094.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-12T17:06:24.719 INFO:teuthology.orchestra.run.smithi094.stdout:15949e3c88704300882482eddfd7baae-6.8.0-rc7-gbf761b6efc7e.conf 2024-03-12T17:06:24.720 DEBUG:teuthology.orchestra.run.smithi094:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-rc7-gbf761b6efc7e 2024-03-12T17:06:24.885 DEBUG:teuthology.orchestra.run.smithi094:> sudo shutdown -r now 2024-03-12T17:06:25.812 INFO:teuthology.orchestra.run.smithi017.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-12T17:06:49.079 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi017.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-03-12T17:06:49.079 DEBUG:teuthology.orchestra.run.smithi017:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-03-12T17:06:49.149 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e 2024-03-12T17:06:49.149 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/System.map 2024-03-12T17:06:49.149 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/config 2024-03-12T17:06:49.149 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel 2024-03-12T17:06:49.149 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch 2024-03-12T17:06:49.149 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86 2024-03-12T17:06:49.149 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto 2024-03-12T17:06:49.149 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-12T17:06:49.149 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-12T17:06:49.149 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-12T17:06:49.149 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-12T17:06:49.150 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-12T17:06:49.150 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-12T17:06:49.150 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-12T17:06:49.150 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto/crc32c-intel.ko 2024-03-12T17:06:49.150 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-12T17:06:49.150 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-12T17:06:49.150 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-12T17:06:49.150 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-12T17:06:49.150 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-12T17:06:49.150 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-12T17:06:49.150 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-12T17:06:49.150 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-12T17:06:49.150 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-12T17:06:49.150 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-12T17:06:49.151 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-12T17:06:49.151 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-12T17:06:49.151 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/kernel 2024-03-12T17:06:49.151 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/kernel/cpu 2024-03-12T17:06:49.151 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/kernel/cpu/mce 2024-03-12T17:06:49.151 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-12T17:06:49.151 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/kvm 2024-03-12T17:06:49.151 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-12T17:06:49.151 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-12T17:06:49.151 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/arch/x86/kvm/kvm.ko 2024-03-12T17:06:49.151 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto 2024-03-12T17:06:49.151 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/ansi_cprng.ko 2024-03-12T17:06:49.151 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/anubis.ko 2024-03-12T17:06:49.151 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/arc4.ko 2024-03-12T17:06:49.152 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/async_tx 2024-03-12T17:06:49.152 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/async_tx/async_memcpy.ko 2024-03-12T17:06:49.152 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/async_tx/async_pq.ko 2024-03-12T17:06:49.152 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-12T17:06:49.152 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/async_tx/async_tx.ko 2024-03-12T17:06:49.152 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/async_tx/async_xor.ko 2024-03-12T17:06:49.152 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/async_tx/raid6test.ko 2024-03-12T17:06:49.152 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/authenc.ko 2024-03-12T17:06:49.152 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/authencesn.ko 2024-03-12T17:06:49.152 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/blake2b_generic.ko 2024-03-12T17:06:49.152 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/blowfish_common.ko 2024-03-12T17:06:49.152 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/blowfish_generic.ko 2024-03-12T17:06:49.152 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/camellia_generic.ko 2024-03-12T17:06:49.153 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/cast5_generic.ko 2024-03-12T17:06:49.153 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/cast6_generic.ko 2024-03-12T17:06:49.153 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/cast_common.ko 2024-03-12T17:06:49.153 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/ccm.ko 2024-03-12T17:06:49.153 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/cmac.ko 2024-03-12T17:06:49.153 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/crc32_generic.ko 2024-03-12T17:06:49.153 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/crypto_engine.ko 2024-03-12T17:06:49.153 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/crypto_user.ko 2024-03-12T17:06:49.153 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/cts.ko 2024-03-12T17:06:49.153 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/des_generic.ko 2024-03-12T17:06:49.153 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/dh_generic.ko 2024-03-12T17:06:49.153 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/echainiv.ko 2024-03-12T17:06:49.153 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/essiv.ko 2024-03-12T17:06:49.153 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/fcrypt.ko 2024-03-12T17:06:49.154 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/khazad.ko 2024-03-12T17:06:49.154 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/lz4.ko 2024-03-12T17:06:49.154 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/lz4hc.ko 2024-03-12T17:06:49.154 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/md4.ko 2024-03-12T17:06:49.154 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/michael_mic.ko 2024-03-12T17:06:49.154 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/pcbc.ko 2024-03-12T17:06:49.154 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/pcrypt.ko 2024-03-12T17:06:49.154 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/rmd160.ko 2024-03-12T17:06:49.154 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/seed.ko 2024-03-12T17:06:49.154 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/serpent_generic.ko 2024-03-12T17:06:49.154 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/tcrypt.ko 2024-03-12T17:06:49.154 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/tea.ko 2024-03-12T17:06:49.154 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/twofish_common.ko 2024-03-12T17:06:49.154 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/twofish_generic.ko 2024-03-12T17:06:49.155 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/vmac.ko 2024-03-12T17:06:49.155 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/wp512.ko 2024-03-12T17:06:49.155 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/xcbc.ko 2024-03-12T17:06:49.155 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/xor.ko 2024-03-12T17:06:49.155 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/crypto/xxhash_generic.ko 2024-03-12T17:06:49.155 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers 2024-03-12T17:06:49.155 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/acpi 2024-03-12T17:06:49.155 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-12T17:06:49.155 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/acpi/acpi_pad.ko 2024-03-12T17:06:49.155 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/acpi/custom_method.ko 2024-03-12T17:06:49.155 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/acpi/ec_sys.ko 2024-03-12T17:06:49.155 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/acpi/platform_profile.ko 2024-03-12T17:06:49.155 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/acpi/sbs.ko 2024-03-12T17:06:49.155 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/acpi/sbshc.ko 2024-03-12T17:06:49.155 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/acpi/video.ko 2024-03-12T17:06:49.156 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata 2024-03-12T17:06:49.156 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/acard-ahci.ko 2024-03-12T17:06:49.156 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/ahci_platform.ko 2024-03-12T17:06:49.156 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/ata_generic.ko 2024-03-12T17:06:49.156 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/libahci_platform.ko 2024-03-12T17:06:49.156 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_acpi.ko 2024-03-12T17:06:49.156 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_ali.ko 2024-03-12T17:06:49.156 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_amd.ko 2024-03-12T17:06:49.156 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_artop.ko 2024-03-12T17:06:49.156 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_atiixp.ko 2024-03-12T17:06:49.156 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_atp867x.ko 2024-03-12T17:06:49.156 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_cmd640.ko 2024-03-12T17:06:49.157 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_cmd64x.ko 2024-03-12T17:06:49.157 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_cypress.ko 2024-03-12T17:06:49.157 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_efar.ko 2024-03-12T17:06:49.157 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_hpt366.ko 2024-03-12T17:06:49.157 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_hpt37x.ko 2024-03-12T17:06:49.157 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-12T17:06:49.157 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-12T17:06:49.157 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_it8213.ko 2024-03-12T17:06:49.157 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_it821x.ko 2024-03-12T17:06:49.157 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_jmicron.ko 2024-03-12T17:06:49.157 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_marvell.ko 2024-03-12T17:06:49.157 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_mpiix.ko 2024-03-12T17:06:49.157 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_netcell.ko 2024-03-12T17:06:49.157 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_ninja32.ko 2024-03-12T17:06:49.157 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_ns87410.ko 2024-03-12T17:06:49.158 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_ns87415.ko 2024-03-12T17:06:49.158 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_oldpiix.ko 2024-03-12T17:06:49.158 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_opti.ko 2024-03-12T17:06:49.158 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_optidma.ko 2024-03-12T17:06:49.158 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_pcmcia.ko 2024-03-12T17:06:49.158 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-12T17:06:49.158 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-12T17:06:49.158 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_piccolo.ko 2024-03-12T17:06:49.158 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_rdc.ko 2024-03-12T17:06:49.158 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_sch.ko 2024-03-12T17:06:49.158 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_serverworks.ko 2024-03-12T17:06:49.158 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_sil680.ko 2024-03-12T17:06:49.158 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_sis.ko 2024-03-12T17:06:49.158 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_sl82c105.ko 2024-03-12T17:06:49.159 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_triflex.ko 2024-03-12T17:06:49.159 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pata_via.ko 2024-03-12T17:06:49.159 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/pdc_adma.ko 2024-03-12T17:06:49.159 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/sata_inic162x.ko 2024-03-12T17:06:49.159 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/sata_mv.ko 2024-03-12T17:06:49.159 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/sata_nv.ko 2024-03-12T17:06:49.159 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/sata_promise.ko 2024-03-12T17:06:49.159 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/sata_qstor.ko 2024-03-12T17:06:49.159 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/sata_sil.ko 2024-03-12T17:06:49.159 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/sata_sil24.ko 2024-03-12T17:06:49.159 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/sata_sis.ko 2024-03-12T17:06:49.159 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/sata_svw.ko 2024-03-12T17:06:49.159 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/sata_sx4.ko 2024-03-12T17:06:49.159 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/sata_uli.ko 2024-03-12T17:06:49.159 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/sata_via.ko 2024-03-12T17:06:49.160 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ata/sata_vsc.ko 2024-03-12T17:06:49.160 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/auxdisplay 2024-03-12T17:06:49.160 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/auxdisplay/ks0108.ko 2024-03-12T17:06:49.160 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/base 2024-03-12T17:06:49.160 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/base/regmap 2024-03-12T17:06:49.160 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/base/regmap/regmap-i2c.ko 2024-03-12T17:06:49.160 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/base/regmap/regmap-mmio.ko 2024-03-12T17:06:49.160 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/bcma 2024-03-12T17:06:49.160 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/bcma/bcma.ko 2024-03-12T17:06:49.160 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block 2024-03-12T17:06:49.160 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block/aoe 2024-03-12T17:06:49.160 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block/aoe/aoe.ko 2024-03-12T17:06:49.160 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block/brd.ko 2024-03-12T17:06:49.160 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block/drbd 2024-03-12T17:06:49.160 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block/drbd/drbd.ko 2024-03-12T17:06:49.160 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block/floppy.ko 2024-03-12T17:06:49.161 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block/loop.ko 2024-03-12T17:06:49.161 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block/mtip32xx 2024-03-12T17:06:49.161 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-12T17:06:49.161 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block/nbd.ko 2024-03-12T17:06:49.161 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block/null_blk 2024-03-12T17:06:49.161 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block/null_blk/null_blk.ko 2024-03-12T17:06:49.161 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block/pktcdvd.ko 2024-03-12T17:06:49.161 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block/rbd.ko 2024-03-12T17:06:49.161 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block/virtio_blk.ko 2024-03-12T17:06:49.161 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block/xen-blkback 2024-03-12T17:06:49.161 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-12T17:06:49.161 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block/xen-blkfront.ko 2024-03-12T17:06:49.161 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block/zram 2024-03-12T17:06:49.161 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/block/zram/zram.ko 2024-03-12T17:06:49.161 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char 2024-03-12T17:06:49.161 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/hangcheck-timer.ko 2024-03-12T17:06:49.162 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/hw_random 2024-03-12T17:06:49.162 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-12T17:06:49.162 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-12T17:06:49.162 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-12T17:06:49.162 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/hw_random/via-rng.ko 2024-03-12T17:06:49.162 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-12T17:06:49.162 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/ipmi 2024-03-12T17:06:49.162 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-12T17:06:49.162 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-12T17:06:49.162 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-12T17:06:49.162 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-12T17:06:49.162 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-12T17:06:49.162 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-12T17:06:49.163 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/lp.ko 2024-03-12T17:06:49.163 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/mwave 2024-03-12T17:06:49.163 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/mwave/mwave.ko 2024-03-12T17:06:49.163 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/ppdev.ko 2024-03-12T17:06:49.163 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/tlclk.ko 2024-03-12T17:06:49.163 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/tpm 2024-03-12T17:06:49.163 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/tpm/tpm.ko 2024-03-12T17:06:49.163 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-12T17:06:49.163 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-12T17:06:49.163 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-12T17:06:49.163 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/tpm/tpm_tis.ko 2024-03-12T17:06:49.163 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-03-12T17:06:49.163 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/uv_mmtimer.ko 2024-03-12T17:06:49.163 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/char/virtio_console.ko 2024-03-12T17:06:49.163 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/cpufreq 2024-03-12T17:06:49.164 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-03-12T17:06:49.164 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-12T17:06:49.164 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-12T17:06:49.164 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-03-12T17:06:49.164 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/cpufreq/powernow-k8.ko 2024-03-12T17:06:49.164 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-12T17:06:49.164 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/crypto 2024-03-12T17:06:49.164 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/crypto/ccp 2024-03-12T17:06:49.164 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-12T17:06:49.164 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/crypto/ccp/ccp.ko 2024-03-12T17:06:49.164 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/crypto/intel 2024-03-12T17:06:49.164 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/crypto/intel/qat 2024-03-12T17:06:49.164 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/crypto/intel/qat/qat_common 2024-03-12T17:06:49.164 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-12T17:06:49.164 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-03-12T17:06:49.165 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-12T17:06:49.165 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/crypto/padlock-aes.ko 2024-03-12T17:06:49.165 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/crypto/padlock-sha.ko 2024-03-12T17:06:49.165 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/crypto/virtio 2024-03-12T17:06:49.165 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-12T17:06:49.165 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/dca 2024-03-12T17:06:49.165 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/dca/dca.ko 2024-03-12T17:06:49.165 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/devfreq 2024-03-12T17:06:49.165 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-03-12T17:06:49.165 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/dma 2024-03-12T17:06:49.165 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/dma/dw 2024-03-12T17:06:49.165 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-12T17:06:49.165 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/dma/ioat 2024-03-12T17:06:49.165 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-12T17:06:49.165 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/edac 2024-03-12T17:06:49.166 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/edac/amd64_edac.ko 2024-03-12T17:06:49.166 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/edac/e752x_edac.ko 2024-03-12T17:06:49.166 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/edac/edac_mce_amd.ko 2024-03-12T17:06:49.166 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/edac/i3000_edac.ko 2024-03-12T17:06:49.166 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/edac/i3200_edac.ko 2024-03-12T17:06:49.166 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/edac/i5100_edac.ko 2024-03-12T17:06:49.166 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/edac/i5400_edac.ko 2024-03-12T17:06:49.166 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/edac/i7300_edac.ko 2024-03-12T17:06:49.166 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/edac/i7core_edac.ko 2024-03-12T17:06:49.166 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/edac/i82975x_edac.ko 2024-03-12T17:06:49.166 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/edac/ie31200_edac.ko 2024-03-12T17:06:49.166 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/edac/sb_edac.ko 2024-03-12T17:06:49.166 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/edac/x38_edac.ko 2024-03-12T17:06:49.166 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/firmware 2024-03-12T17:06:49.166 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/firmware/edd.ko 2024-03-12T17:06:49.167 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-12T17:06:49.167 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/gpio 2024-03-12T17:06:49.167 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/gpio/gpio-ich.ko 2024-03-12T17:06:49.167 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-12T17:06:49.167 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid 2024-03-12T17:06:49.167 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-appleir.ko 2024-03-12T17:06:49.167 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-aureal.ko 2024-03-12T17:06:49.167 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-axff.ko 2024-03-12T17:06:49.167 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-dr.ko 2024-03-12T17:06:49.167 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-elecom.ko 2024-03-12T17:06:49.167 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-elo.ko 2024-03-12T17:06:49.167 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-emsff.ko 2024-03-12T17:06:49.167 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-gaff.ko 2024-03-12T17:06:49.167 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-gt683r.ko 2024-03-12T17:06:49.167 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-gyration.ko 2024-03-12T17:06:49.168 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-12T17:06:49.168 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-12T17:06:49.168 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-holtekff.ko 2024-03-12T17:06:49.168 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-hyperv.ko 2024-03-12T17:06:49.168 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-icade.ko 2024-03-12T17:06:49.168 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-keytouch.ko 2024-03-12T17:06:49.168 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-kye.ko 2024-03-12T17:06:49.168 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-lcpower.ko 2024-03-12T17:06:49.168 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-led.ko 2024-03-12T17:06:49.168 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-lenovo.ko 2024-03-12T17:06:49.168 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-12T17:06:49.168 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-12T17:06:49.168 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-multitouch.ko 2024-03-12T17:06:49.168 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-ortek.ko 2024-03-12T17:06:49.168 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-penmount.ko 2024-03-12T17:06:49.168 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-petalynx.ko 2024-03-12T17:06:49.169 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-picolcd.ko 2024-03-12T17:06:49.169 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-pl.ko 2024-03-12T17:06:49.169 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-plantronics.ko 2024-03-12T17:06:49.169 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-primax.ko 2024-03-12T17:06:49.169 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-rmi.ko 2024-03-12T17:06:49.169 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-12T17:06:49.169 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-roccat-common.ko 2024-03-12T17:06:49.169 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-12T17:06:49.169 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-12T17:06:49.169 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-12T17:06:49.169 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-12T17:06:49.169 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-12T17:06:49.169 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-12T17:06:49.169 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-12T17:06:49.169 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-12T17:06:49.170 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-12T17:06:49.170 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-roccat.ko 2024-03-12T17:06:49.170 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-saitek.ko 2024-03-12T17:06:49.170 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-samsung.ko 2024-03-12T17:06:49.170 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-12T17:06:49.170 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-sjoy.ko 2024-03-12T17:06:49.170 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-sony.ko 2024-03-12T17:06:49.170 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-speedlink.ko 2024-03-12T17:06:49.170 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-steelseries.ko 2024-03-12T17:06:49.170 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-sunplus.ko 2024-03-12T17:06:49.170 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-12T17:06:49.170 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-tivo.ko 2024-03-12T17:06:49.170 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-tmff.ko 2024-03-12T17:06:49.170 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-topseed.ko 2024-03-12T17:06:49.171 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-twinhan.ko 2024-03-12T17:06:49.171 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-uclogic.ko 2024-03-12T17:06:49.171 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-waltop.ko 2024-03-12T17:06:49.171 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-wiimote.ko 2024-03-12T17:06:49.171 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-xinmo.ko 2024-03-12T17:06:49.171 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-zpff.ko 2024-03-12T17:06:49.171 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/hid-zydacron.ko 2024-03-12T17:06:49.171 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/uhid.ko 2024-03-12T17:06:49.171 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hid/wacom.ko 2024-03-12T17:06:49.171 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hv 2024-03-12T17:06:49.171 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hv/hv_balloon.ko 2024-03-12T17:06:49.171 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hv/hv_utils.ko 2024-03-12T17:06:49.171 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hv/hv_vmbus.ko 2024-03-12T17:06:49.171 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon 2024-03-12T17:06:49.171 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/abituguru.ko 2024-03-12T17:06:49.171 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/abituguru3.ko 2024-03-12T17:06:49.172 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-12T17:06:49.172 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/ad7414.ko 2024-03-12T17:06:49.172 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/ad7418.ko 2024-03-12T17:06:49.172 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/adc128d818.ko 2024-03-12T17:06:49.172 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/adm1025.ko 2024-03-12T17:06:49.172 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/adm1026.ko 2024-03-12T17:06:49.172 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/adm1029.ko 2024-03-12T17:06:49.172 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/adm1031.ko 2024-03-12T17:06:49.172 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/adm9240.ko 2024-03-12T17:06:49.172 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/ads7828.ko 2024-03-12T17:06:49.172 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/adt7410.ko 2024-03-12T17:06:49.172 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/adt7411.ko 2024-03-12T17:06:49.172 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/adt7462.ko 2024-03-12T17:06:49.172 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/adt7470.ko 2024-03-12T17:06:49.173 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/adt7475.ko 2024-03-12T17:06:49.173 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/adt7x10.ko 2024-03-12T17:06:49.173 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/amc6821.ko 2024-03-12T17:06:49.173 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/applesmc.ko 2024-03-12T17:06:49.173 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/asb100.ko 2024-03-12T17:06:49.173 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/asc7621.ko 2024-03-12T17:06:49.173 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-12T17:06:49.173 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/atxp1.ko 2024-03-12T17:06:49.173 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/coretemp.ko 2024-03-12T17:06:49.173 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-12T17:06:49.173 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/dme1737.ko 2024-03-12T17:06:49.173 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/ds1621.ko 2024-03-12T17:06:49.173 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/ds620.ko 2024-03-12T17:06:49.173 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/emc1403.ko 2024-03-12T17:06:49.173 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/emc6w201.ko 2024-03-12T17:06:49.174 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/f71805f.ko 2024-03-12T17:06:49.174 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/f71882fg.ko 2024-03-12T17:06:49.174 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/f75375s.ko 2024-03-12T17:06:49.174 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/fam15h_power.ko 2024-03-12T17:06:49.174 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/fschmd.ko 2024-03-12T17:06:49.174 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/g760a.ko 2024-03-12T17:06:49.174 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/g762.ko 2024-03-12T17:06:49.174 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/gl518sm.ko 2024-03-12T17:06:49.174 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/gl520sm.ko 2024-03-12T17:06:49.174 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-12T17:06:49.174 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/i5500_temp.ko 2024-03-12T17:06:49.174 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/i5k_amb.ko 2024-03-12T17:06:49.174 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/ibmaem.ko 2024-03-12T17:06:49.174 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/ibmpex.ko 2024-03-12T17:06:49.175 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/ina209.ko 2024-03-12T17:06:49.175 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/ina2xx.ko 2024-03-12T17:06:49.175 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/it87.ko 2024-03-12T17:06:49.175 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/k10temp.ko 2024-03-12T17:06:49.175 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/k8temp.ko 2024-03-12T17:06:49.175 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/lineage-pem.ko 2024-03-12T17:06:49.175 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/lm63.ko 2024-03-12T17:06:49.175 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/lm73.ko 2024-03-12T17:06:49.175 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/lm75.ko 2024-03-12T17:06:49.175 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/lm77.ko 2024-03-12T17:06:49.175 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/lm78.ko 2024-03-12T17:06:49.175 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/lm80.ko 2024-03-12T17:06:49.175 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/lm83.ko 2024-03-12T17:06:49.175 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/lm85.ko 2024-03-12T17:06:49.175 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/lm87.ko 2024-03-12T17:06:49.176 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/lm90.ko 2024-03-12T17:06:49.176 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/lm92.ko 2024-03-12T17:06:49.176 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/lm93.ko 2024-03-12T17:06:49.176 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/lm95234.ko 2024-03-12T17:06:49.176 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/lm95241.ko 2024-03-12T17:06:49.176 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/lm95245.ko 2024-03-12T17:06:49.176 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/ltc2945.ko 2024-03-12T17:06:49.176 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/ltc4151.ko 2024-03-12T17:06:49.176 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/ltc4215.ko 2024-03-12T17:06:49.176 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/ltc4222.ko 2024-03-12T17:06:49.176 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/ltc4245.ko 2024-03-12T17:06:49.176 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/ltc4260.ko 2024-03-12T17:06:49.176 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/ltc4261.ko 2024-03-12T17:06:49.176 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/max16065.ko 2024-03-12T17:06:49.177 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/max1619.ko 2024-03-12T17:06:49.177 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/max1668.ko 2024-03-12T17:06:49.177 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/max197.ko 2024-03-12T17:06:49.177 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/max6639.ko 2024-03-12T17:06:49.177 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/max6650.ko 2024-03-12T17:06:49.177 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/max6697.ko 2024-03-12T17:06:49.177 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/mcp3021.ko 2024-03-12T17:06:49.177 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/nct6683.ko 2024-03-12T17:06:49.177 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/nct6775-core.ko 2024-03-12T17:06:49.177 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/nct6775.ko 2024-03-12T17:06:49.177 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/nct7802.ko 2024-03-12T17:06:49.177 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/pc87360.ko 2024-03-12T17:06:49.177 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/pc87427.ko 2024-03-12T17:06:49.177 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/pcf8591.ko 2024-03-12T17:06:49.177 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/pmbus 2024-03-12T17:06:49.177 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-12T17:06:49.178 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-12T17:06:49.178 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-12T17:06:49.178 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-12T17:06:49.178 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-12T17:06:49.178 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-12T17:06:49.178 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-12T17:06:49.178 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-12T17:06:49.178 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-12T17:06:49.178 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-12T17:06:49.178 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-12T17:06:49.178 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-12T17:06:49.178 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/powr1220.ko 2024-03-12T17:06:49.178 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/sch5627.ko 2024-03-12T17:06:49.178 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/sch5636.ko 2024-03-12T17:06:49.178 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-12T17:06:49.179 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/sht15.ko 2024-03-12T17:06:49.179 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/sht21.ko 2024-03-12T17:06:49.179 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/shtc1.ko 2024-03-12T17:06:49.179 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/sis5595.ko 2024-03-12T17:06:49.179 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/smsc47b397.ko 2024-03-12T17:06:49.179 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/smsc47m1.ko 2024-03-12T17:06:49.179 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/smsc47m192.ko 2024-03-12T17:06:49.179 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/thmc50.ko 2024-03-12T17:06:49.179 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/tmp102.ko 2024-03-12T17:06:49.179 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/tmp103.ko 2024-03-12T17:06:49.179 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/tmp401.ko 2024-03-12T17:06:49.179 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/tmp421.ko 2024-03-12T17:06:49.179 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/via-cputemp.ko 2024-03-12T17:06:49.179 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/via686a.ko 2024-03-12T17:06:49.179 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/vt1211.ko 2024-03-12T17:06:49.179 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/vt8231.ko 2024-03-12T17:06:49.180 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/w83627ehf.ko 2024-03-12T17:06:49.180 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/w83627hf.ko 2024-03-12T17:06:49.180 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/w83781d.ko 2024-03-12T17:06:49.180 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/w83791d.ko 2024-03-12T17:06:49.180 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/w83792d.ko 2024-03-12T17:06:49.180 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/w83793.ko 2024-03-12T17:06:49.180 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/w83795.ko 2024-03-12T17:06:49.180 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/w83l785ts.ko 2024-03-12T17:06:49.180 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/hwmon/w83l786ng.ko 2024-03-12T17:06:49.180 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c 2024-03-12T17:06:49.180 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/algos 2024-03-12T17:06:49.180 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-12T17:06:49.180 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-12T17:06:49.180 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses 2024-03-12T17:06:49.180 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-12T17:06:49.181 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-12T17:06:49.181 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-12T17:06:49.181 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-12T17:06:49.181 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-12T17:06:49.181 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-12T17:06:49.181 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-12T17:06:49.181 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-12T17:06:49.181 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-12T17:06:49.181 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-12T17:06:49.181 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-12T17:06:49.181 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-12T17:06:49.181 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-12T17:06:49.181 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-12T17:06:49.181 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-12T17:06:49.182 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-12T17:06:49.182 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-12T17:06:49.182 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-12T17:06:49.182 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-12T17:06:49.182 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-12T17:06:49.182 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-12T17:06:49.182 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-12T17:06:49.182 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-12T17:06:49.182 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/i2c-dev.ko 2024-03-12T17:06:49.182 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/i2c-mux.ko 2024-03-12T17:06:49.182 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-03-12T17:06:49.182 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/i2c-smbus.ko 2024-03-12T17:06:49.182 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/i2c/i2c-stub.ko 2024-03-12T17:06:49.182 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband 2024-03-12T17:06:49.183 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/core 2024-03-12T17:06:49.183 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-12T17:06:49.183 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/core/ib_core.ko 2024-03-12T17:06:49.183 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-12T17:06:49.183 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-12T17:06:49.183 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-12T17:06:49.183 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-12T17:06:49.183 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-12T17:06:49.183 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/hw 2024-03-12T17:06:49.183 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/hw/cxgb4 2024-03-12T17:06:49.183 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-12T17:06:49.183 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/hw/mlx4 2024-03-12T17:06:49.183 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-12T17:06:49.183 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/hw/mlx5 2024-03-12T17:06:49.183 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-12T17:06:49.184 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/hw/mthca 2024-03-12T17:06:49.184 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-12T17:06:49.184 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/ulp 2024-03-12T17:06:49.184 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/ulp/ipoib 2024-03-12T17:06:49.184 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-12T17:06:49.184 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/ulp/iser 2024-03-12T17:06:49.184 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-12T17:06:49.184 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/ulp/isert 2024-03-12T17:06:49.184 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-12T17:06:49.184 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/ulp/srp 2024-03-12T17:06:49.184 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-12T17:06:49.184 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/ulp/srpt 2024-03-12T17:06:49.184 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-12T17:06:49.184 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input 2024-03-12T17:06:49.184 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/gameport 2024-03-12T17:06:49.184 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-12T17:06:49.185 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-12T17:06:49.185 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/gameport/gameport.ko 2024-03-12T17:06:49.185 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/joydev.ko 2024-03-12T17:06:49.185 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/keyboard 2024-03-12T17:06:49.185 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-12T17:06:49.185 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/mouse 2024-03-12T17:06:49.185 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/mouse/appletouch.ko 2024-03-12T17:06:49.185 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/mouse/bcm5974.ko 2024-03-12T17:06:49.185 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/mouse/cyapatp.ko 2024-03-12T17:06:49.185 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-12T17:06:49.185 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/mouse/sermouse.ko 2024-03-12T17:06:49.185 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-12T17:06:49.185 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-12T17:06:49.185 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-12T17:06:49.185 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/rmi4 2024-03-12T17:06:49.186 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-12T17:06:49.186 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/serio 2024-03-12T17:06:49.186 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/serio/altera_ps2.ko 2024-03-12T17:06:49.186 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/serio/arc_ps2.ko 2024-03-12T17:06:49.186 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-12T17:06:49.186 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/serio/serio_raw.ko 2024-03-12T17:06:49.186 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/input/sparse-keymap.ko 2024-03-12T17:06:49.186 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/leds 2024-03-12T17:06:49.186 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/leds/leds-blinkm.ko 2024-03-12T17:06:49.186 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/leds/leds-lm3530.ko 2024-03-12T17:06:49.186 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/leds/leds-lp3944.ko 2024-03-12T17:06:49.186 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/leds/leds-ss4200.ko 2024-03-12T17:06:49.186 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/leds/trigger 2024-03-12T17:06:49.186 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-12T17:06:49.187 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-12T17:06:49.187 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-12T17:06:49.187 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-12T17:06:49.187 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-12T17:06:49.187 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-12T17:06:49.187 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-12T17:06:49.187 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-12T17:06:49.187 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-12T17:06:49.187 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md 2024-03-12T17:06:49.187 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/bcache 2024-03-12T17:06:49.187 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/bcache/bcache.ko 2024-03-12T17:06:49.187 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/dm-bio-prison.ko 2024-03-12T17:06:49.187 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/dm-cache-smq.ko 2024-03-12T17:06:49.187 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/dm-cache.ko 2024-03-12T17:06:49.187 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/dm-crypt.ko 2024-03-12T17:06:49.187 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/dm-delay.ko 2024-03-12T17:06:49.187 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/dm-flakey.ko 2024-03-12T17:06:49.188 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/dm-log-userspace.ko 2024-03-12T17:06:49.188 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/dm-multipath.ko 2024-03-12T17:06:49.188 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/dm-queue-length.ko 2024-03-12T17:06:49.188 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/dm-raid.ko 2024-03-12T17:06:49.188 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/dm-round-robin.ko 2024-03-12T17:06:49.188 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/dm-service-time.ko 2024-03-12T17:06:49.188 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/dm-switch.ko 2024-03-12T17:06:49.188 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/dm-thin-pool.ko 2024-03-12T17:06:49.188 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/dm-verity.ko 2024-03-12T17:06:49.188 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/persistent-data 2024-03-12T17:06:49.188 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-12T17:06:49.188 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/raid0.ko 2024-03-12T17:06:49.188 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/raid1.ko 2024-03-12T17:06:49.188 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/raid10.ko 2024-03-12T17:06:49.188 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/md/raid456.ko 2024-03-12T17:06:49.188 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/message 2024-03-12T17:06:49.189 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/message/fusion 2024-03-12T17:06:49.189 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/message/fusion/mptbase.ko 2024-03-12T17:06:49.189 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/message/fusion/mptctl.ko 2024-03-12T17:06:49.189 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/message/fusion/mptfc.ko 2024-03-12T17:06:49.189 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/message/fusion/mptlan.ko 2024-03-12T17:06:49.189 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/message/fusion/mptsas.ko 2024-03-12T17:06:49.189 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/message/fusion/mptscsih.ko 2024-03-12T17:06:49.189 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/message/fusion/mptspi.ko 2024-03-12T17:06:49.189 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/mfd 2024-03-12T17:06:49.189 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/mfd/lpc_ich.ko 2024-03-12T17:06:49.189 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/mfd/lpc_sch.ko 2024-03-12T17:06:49.189 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/mfd/mfd-core.ko 2024-03-12T17:06:49.189 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/mfd/sm501.ko 2024-03-12T17:06:49.189 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/mfd/viperboard.ko 2024-03-12T17:06:49.189 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/mfd/vx855.ko 2024-03-12T17:06:49.190 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/mfd/wl1273-core.ko 2024-03-12T17:06:49.190 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc 2024-03-12T17:06:49.190 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/altera-stapl 2024-03-12T17:06:49.190 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-12T17:06:49.190 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/apds9802als.ko 2024-03-12T17:06:49.190 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/apds990x.ko 2024-03-12T17:06:49.190 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/bh1770glc.ko 2024-03-12T17:06:49.190 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/cb710 2024-03-12T17:06:49.190 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/cb710/cb710.ko 2024-03-12T17:06:49.191 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/eeprom 2024-03-12T17:06:49.191 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/eeprom/at24.ko 2024-03-12T17:06:49.191 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-12T17:06:49.191 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/eeprom/max6875.ko 2024-03-12T17:06:49.191 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/enclosure.ko 2024-03-12T17:06:49.191 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/hpilo.ko 2024-03-12T17:06:49.191 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/isl29003.ko 2024-03-12T17:06:49.191 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/isl29020.ko 2024-03-12T17:06:49.191 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/lis3lv02d 2024-03-12T17:06:49.191 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-12T17:06:49.191 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-12T17:06:49.191 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/mei 2024-03-12T17:06:49.191 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/mei/mei-me.ko 2024-03-12T17:06:49.193 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/mei/mei-txe.ko 2024-03-12T17:06:49.193 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/mei/mei.ko 2024-03-12T17:06:49.193 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/sgi-gru 2024-03-12T17:06:49.193 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/sgi-gru/gru.ko 2024-03-12T17:06:49.193 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/sgi-xp 2024-03-12T17:06:49.193 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/sgi-xp/xp.ko 2024-03-12T17:06:49.193 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/sgi-xp/xpc.ko 2024-03-12T17:06:49.193 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-03-12T17:06:49.193 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/tifm_7xx1.ko 2024-03-12T17:06:49.193 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/tifm_core.ko 2024-03-12T17:06:49.194 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/tsl2550.ko 2024-03-12T17:06:49.194 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/vmw_balloon.ko 2024-03-12T17:06:49.194 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/vmw_vmci 2024-03-12T17:06:49.194 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-12T17:06:49.194 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net 2024-03-12T17:06:49.194 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/bonding 2024-03-12T17:06:49.194 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/bonding/bonding.ko 2024-03-12T17:06:49.194 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/dsa 2024-03-12T17:06:49.194 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/dsa/b53 2024-03-12T17:06:49.194 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-12T17:06:49.194 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-12T17:06:49.194 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-12T17:06:49.194 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/dsa/mv88e6xxx 2024-03-12T17:06:49.194 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-12T17:06:49.194 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/dummy.ko 2024-03-12T17:06:49.195 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/eql.ko 2024-03-12T17:06:49.195 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet 2024-03-12T17:06:49.195 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/3com 2024-03-12T17:06:49.195 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-12T17:06:49.195 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-12T17:06:49.195 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-12T17:06:49.195 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-12T17:06:49.195 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/8390 2024-03-12T17:06:49.195 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-12T17:06:49.195 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-12T17:06:49.195 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-12T17:06:49.195 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-12T17:06:49.195 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/adaptec 2024-03-12T17:06:49.195 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-12T17:06:49.196 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/agere 2024-03-12T17:06:49.196 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-12T17:06:49.196 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/alteon 2024-03-12T17:06:49.196 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-12T17:06:49.196 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/altera 2024-03-12T17:06:49.196 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-12T17:06:49.196 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/amd 2024-03-12T17:06:49.196 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-12T17:06:49.196 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-12T17:06:49.196 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-12T17:06:49.196 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/atheros 2024-03-12T17:06:49.196 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/atheros/alx 2024-03-12T17:06:49.196 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-12T17:06:49.196 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/atheros/atl1c 2024-03-12T17:06:49.196 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-12T17:06:49.197 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/atheros/atl1e 2024-03-12T17:06:49.197 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-12T17:06:49.197 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/atheros/atlx 2024-03-12T17:06:49.197 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-12T17:06:49.197 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-12T17:06:49.197 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/broadcom 2024-03-12T17:06:49.197 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-12T17:06:49.197 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-12T17:06:49.197 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-03-12T17:06:49.197 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-12T17:06:49.197 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-12T17:06:49.197 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/broadcom/genet 2024-03-12T17:06:49.197 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-12T17:06:49.198 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-12T17:06:49.198 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/brocade 2024-03-12T17:06:49.198 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/brocade/bna 2024-03-12T17:06:49.198 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-12T17:06:49.198 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/chelsio 2024-03-12T17:06:49.198 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/chelsio/cxgb 2024-03-12T17:06:49.198 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-12T17:06:49.198 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-03-12T17:06:49.198 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-12T17:06:49.198 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-03-12T17:06:49.198 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-12T17:06:49.199 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-03-12T17:06:49.199 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-12T17:06:49.199 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-03-12T17:06:49.199 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-12T17:06:49.199 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/cisco 2024-03-12T17:06:49.199 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/cisco/enic 2024-03-12T17:06:49.199 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-12T17:06:49.199 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/dec 2024-03-12T17:06:49.199 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/dec/tulip 2024-03-12T17:06:49.199 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-12T17:06:49.199 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-12T17:06:49.199 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-12T17:06:49.199 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-12T17:06:49.200 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-12T17:06:49.200 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-12T17:06:49.200 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/dlink 2024-03-12T17:06:49.200 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-12T17:06:49.200 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-12T17:06:49.200 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/dnet.ko 2024-03-12T17:06:49.200 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/emulex 2024-03-12T17:06:49.200 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/emulex/benet 2024-03-12T17:06:49.200 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-12T17:06:49.200 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/ethoc.ko 2024-03-12T17:06:49.200 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/fealnx.ko 2024-03-12T17:06:49.200 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/intel 2024-03-12T17:06:49.201 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-12T17:06:49.201 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/intel/e1000 2024-03-12T17:06:49.201 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-12T17:06:49.201 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/intel/e1000e 2024-03-12T17:06:49.201 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-12T17:06:49.201 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/intel/fm10k 2024-03-12T17:06:49.201 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-12T17:06:49.201 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/intel/i40e 2024-03-12T17:06:49.201 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-12T17:06:49.201 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/intel/iavf 2024-03-12T17:06:49.201 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-12T17:06:49.201 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/intel/igb 2024-03-12T17:06:49.202 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-12T17:06:49.202 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/intel/igbvf 2024-03-12T17:06:49.202 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-12T17:06:49.202 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/intel/ixgbe 2024-03-12T17:06:49.202 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-12T17:06:49.202 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/intel/ixgbevf 2024-03-12T17:06:49.202 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-12T17:06:49.202 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/jme.ko 2024-03-12T17:06:49.202 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/marvell 2024-03-12T17:06:49.202 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-12T17:06:49.202 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-12T17:06:49.202 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-12T17:06:49.202 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/mellanox 2024-03-12T17:06:49.202 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/mellanox/mlx4 2024-03-12T17:06:49.202 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-12T17:06:49.203 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-12T17:06:49.203 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/mellanox/mlx5 2024-03-12T17:06:49.203 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-03-12T17:06:49.203 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-12T17:06:49.203 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/micrel 2024-03-12T17:06:49.203 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-12T17:06:49.203 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/myricom 2024-03-12T17:06:49.203 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/myricom/myri10ge 2024-03-12T17:06:49.203 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-12T17:06:49.203 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/natsemi 2024-03-12T17:06:49.203 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-12T17:06:49.203 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-12T17:06:49.203 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/neterion 2024-03-12T17:06:49.203 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-12T17:06:49.204 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/nvidia 2024-03-12T17:06:49.204 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-12T17:06:49.204 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/packetengines 2024-03-12T17:06:49.204 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-12T17:06:49.204 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-12T17:06:49.204 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/qlogic 2024-03-12T17:06:49.204 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/qlogic/netxen 2024-03-12T17:06:49.204 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-12T17:06:49.204 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-12T17:06:49.204 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-03-12T17:06:49.204 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-12T17:06:49.204 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/rdc 2024-03-12T17:06:49.204 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-12T17:06:49.204 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/realtek 2024-03-12T17:06:49.204 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-12T17:06:49.204 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-12T17:06:49.205 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-12T17:06:49.205 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-12T17:06:49.205 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/rocker 2024-03-12T17:06:49.205 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-03-12T17:06:49.205 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/sfc 2024-03-12T17:06:49.205 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-12T17:06:49.205 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/silan 2024-03-12T17:06:49.205 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-12T17:06:49.205 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/sis 2024-03-12T17:06:49.205 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-12T17:06:49.205 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-12T17:06:49.205 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/smsc 2024-03-12T17:06:49.205 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-12T17:06:49.205 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-12T17:06:49.205 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-12T17:06:49.206 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-12T17:06:49.206 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/stmicro 2024-03-12T17:06:49.206 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/stmicro/stmmac 2024-03-12T17:06:49.206 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-12T17:06:49.206 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-12T17:06:49.206 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/sun 2024-03-12T17:06:49.206 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-12T17:06:49.206 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-12T17:06:49.206 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-12T17:06:49.206 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-12T17:06:49.206 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/tehuti 2024-03-12T17:06:49.206 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-12T17:06:49.206 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/ti 2024-03-12T17:06:49.206 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-12T17:06:49.207 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/via 2024-03-12T17:06:49.207 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-12T17:06:49.207 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-12T17:06:49.207 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/wiznet 2024-03-12T17:06:49.207 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-12T17:06:49.207 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-12T17:06:49.207 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/xircom 2024-03-12T17:06:49.207 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-12T17:06:49.207 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/geneve.ko 2024-03-12T17:06:49.207 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/hyperv 2024-03-12T17:06:49.207 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-12T17:06:49.207 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ieee802154 2024-03-12T17:06:49.207 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-12T17:06:49.207 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ifb.ko 2024-03-12T17:06:49.207 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ipvlan 2024-03-12T17:06:49.208 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-12T17:06:49.208 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/macvlan.ko 2024-03-12T17:06:49.208 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/macvtap.ko 2024-03-12T17:06:49.208 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/mdio 2024-03-12T17:06:49.208 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/mdio.ko 2024-03-12T17:06:49.208 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-12T17:06:49.208 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-12T17:06:49.208 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-12T17:06:49.208 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/mii.ko 2024-03-12T17:06:49.208 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/net_failover.ko 2024-03-12T17:06:49.208 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/netconsole.ko 2024-03-12T17:06:49.208 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/nlmon.ko 2024-03-12T17:06:49.208 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/pcs 2024-03-12T17:06:49.208 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-12T17:06:49.208 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-12T17:06:49.209 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy 2024-03-12T17:06:49.209 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/amd.ko 2024-03-12T17:06:49.209 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-12T17:06:49.209 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-03-12T17:06:49.209 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-12T17:06:49.209 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/bcm87xx.ko 2024-03-12T17:06:49.209 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/broadcom.ko 2024-03-12T17:06:49.209 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/cicada.ko 2024-03-12T17:06:49.209 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/davicom.ko 2024-03-12T17:06:49.209 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/dp83640.ko 2024-03-12T17:06:49.209 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/et1011c.ko 2024-03-12T17:06:49.209 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/icplus.ko 2024-03-12T17:06:49.209 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/lxt.ko 2024-03-12T17:06:49.209 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/marvell.ko 2024-03-12T17:06:49.209 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/micrel.ko 2024-03-12T17:06:49.210 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/national.ko 2024-03-12T17:06:49.210 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/phylink.ko 2024-03-12T17:06:49.210 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/qsemi.ko 2024-03-12T17:06:49.210 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/realtek.ko 2024-03-12T17:06:49.210 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/smsc.ko 2024-03-12T17:06:49.210 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/ste10Xp.ko 2024-03-12T17:06:49.210 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/phy/vitesse.ko 2024-03-12T17:06:49.210 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ppp 2024-03-12T17:06:49.210 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-12T17:06:49.210 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ppp/ppp_async.ko 2024-03-12T17:06:49.210 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-12T17:06:49.210 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ppp/ppp_generic.ko 2024-03-12T17:06:49.210 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-12T17:06:49.210 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-12T17:06:49.210 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ppp/pppoe.ko 2024-03-12T17:06:49.211 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ppp/pppox.ko 2024-03-12T17:06:49.211 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/ppp/pptp.ko 2024-03-12T17:06:49.211 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/slip 2024-03-12T17:06:49.211 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/slip/slhc.ko 2024-03-12T17:06:49.211 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/slip/slip.ko 2024-03-12T17:06:49.211 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/sungem_phy.ko 2024-03-12T17:06:49.211 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/tap.ko 2024-03-12T17:06:49.211 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/team 2024-03-12T17:06:49.211 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/team/team.ko 2024-03-12T17:06:49.211 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-12T17:06:49.211 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-12T17:06:49.211 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-12T17:06:49.211 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/team/team_mode_random.ko 2024-03-12T17:06:49.211 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-12T17:06:49.212 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/tun.ko 2024-03-12T17:06:49.212 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/veth.ko 2024-03-12T17:06:49.212 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/virtio_net.ko 2024-03-12T17:06:49.212 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/vmxnet3 2024-03-12T17:06:49.212 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-12T17:06:49.212 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/vxlan 2024-03-12T17:06:49.212 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/vxlan/vxlan.ko 2024-03-12T17:06:49.212 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/xen-netback 2024-03-12T17:06:49.212 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-12T17:06:49.212 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/net/xen-netfront.ko 2024-03-12T17:06:49.212 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ntb 2024-03-12T17:06:49.212 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ntb/ntb.ko 2024-03-12T17:06:49.212 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/nvme 2024-03-12T17:06:49.212 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/nvme/host 2024-03-12T17:06:49.212 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/nvme/host/nvme-core.ko 2024-03-12T17:06:49.213 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/nvme/host/nvme.ko 2024-03-12T17:06:49.213 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/parport 2024-03-12T17:06:49.213 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/parport/parport.ko 2024-03-12T17:06:49.213 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/parport/parport_cs.ko 2024-03-12T17:06:49.213 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/parport/parport_pc.ko 2024-03-12T17:06:49.213 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/parport/parport_serial.ko 2024-03-12T17:06:49.213 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/pci 2024-03-12T17:06:49.213 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/pci/hotplug 2024-03-12T17:06:49.213 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-12T17:06:49.213 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/pci/pcie 2024-03-12T17:06:49.213 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/pci/pcie/aer_inject.ko 2024-03-12T17:06:49.213 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/pci/xen-pcifront.ko 2024-03-12T17:06:49.213 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/pcmcia 2024-03-12T17:06:49.213 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/pcmcia/i82092.ko 2024-03-12T17:06:49.214 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/pcmcia/pd6729.ko 2024-03-12T17:06:49.214 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-12T17:06:49.214 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/pinctrl 2024-03-12T17:06:49.214 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/pinctrl/intel 2024-03-12T17:06:49.214 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-12T17:06:49.214 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform 2024-03-12T17:06:49.214 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86 2024-03-12T17:06:49.214 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-12T17:06:49.214 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/acerhdf.ko 2024-03-12T17:06:49.214 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-12T17:06:49.214 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-12T17:06:49.214 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-12T17:06:49.214 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-12T17:06:49.214 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-12T17:06:49.215 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-12T17:06:49.215 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-12T17:06:49.215 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-12T17:06:49.215 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-12T17:06:49.215 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/hdaps.ko 2024-03-12T17:06:49.215 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/intel 2024-03-12T17:06:49.215 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-12T17:06:49.215 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/intel_ips.ko 2024-03-12T17:06:49.215 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-12T17:06:49.215 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-12T17:06:49.215 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-12T17:06:49.215 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-12T17:06:49.215 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-12T17:06:49.216 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-12T17:06:49.216 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-12T17:06:49.216 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-12T17:06:49.216 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-12T17:06:49.216 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/platform/x86/wmi.ko 2024-03-12T17:06:49.216 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/powercap 2024-03-12T17:06:49.216 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-12T17:06:49.216 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-12T17:06:49.216 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/pps 2024-03-12T17:06:49.216 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/pps/clients 2024-03-12T17:06:49.216 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-12T17:06:49.216 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-12T17:06:49.216 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/pps/clients/pps_parport.ko 2024-03-12T17:06:49.216 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/pps/pps_core.ko 2024-03-12T17:06:49.217 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ptp 2024-03-12T17:06:49.217 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ptp/ptp.ko 2024-03-12T17:06:49.217 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ptp/ptp_kvm.ko 2024-03-12T17:06:49.217 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc 2024-03-12T17:06:49.217 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-12T17:06:49.217 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-12T17:06:49.217 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-12T17:06:49.217 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-12T17:06:49.217 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-12T17:06:49.217 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-12T17:06:49.217 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-12T17:06:49.217 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-12T17:06:49.217 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-12T17:06:49.217 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-12T17:06:49.217 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-em3027.ko 2024-03-12T17:06:49.218 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-12T17:06:49.218 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-12T17:06:49.218 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-12T17:06:49.218 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-12T17:06:49.218 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-12T17:06:49.218 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-12T17:06:49.218 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-max6900.ko 2024-03-12T17:06:49.218 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-12T17:06:49.218 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-12T17:06:49.218 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-12T17:06:49.218 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-12T17:06:49.218 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-12T17:06:49.218 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-12T17:06:49.218 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-12T17:06:49.218 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-12T17:06:49.219 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-12T17:06:49.219 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-12T17:06:49.219 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-12T17:06:49.219 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-12T17:06:49.219 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/rtc/rtc-x1205.ko 2024-03-12T17:06:49.219 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi 2024-03-12T17:06:49.219 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/3w-9xxx.ko 2024-03-12T17:06:49.219 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/3w-sas.ko 2024-03-12T17:06:49.219 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/3w-xxxx.ko 2024-03-12T17:06:49.219 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/BusLogic.ko 2024-03-12T17:06:49.219 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/a100u2w.ko 2024-03-12T17:06:49.219 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/aacraid 2024-03-12T17:06:49.219 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-12T17:06:49.219 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/advansys.ko 2024-03-12T17:06:49.219 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/aic7xxx 2024-03-12T17:06:49.220 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-12T17:06:49.220 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-12T17:06:49.220 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/am53c974.ko 2024-03-12T17:06:49.220 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/arcmsr 2024-03-12T17:06:49.220 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-12T17:06:49.220 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/atp870u.ko 2024-03-12T17:06:49.220 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/be2iscsi 2024-03-12T17:06:49.220 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-12T17:06:49.220 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/bfa 2024-03-12T17:06:49.220 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/bfa/bfa.ko 2024-03-12T17:06:49.220 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/bnx2fc 2024-03-12T17:06:49.220 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-12T17:06:49.220 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/bnx2i 2024-03-12T17:06:49.220 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-12T17:06:49.220 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/ch.ko 2024-03-12T17:06:49.221 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/csiostor 2024-03-12T17:06:49.221 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-12T17:06:49.221 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/cxgbi 2024-03-12T17:06:49.221 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/cxgbi/cxgb3i 2024-03-12T17:06:49.221 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-12T17:06:49.221 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/cxgbi/cxgb4i 2024-03-12T17:06:49.221 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-12T17:06:49.221 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-12T17:06:49.221 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/dc395x.ko 2024-03-12T17:06:49.221 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/device_handler 2024-03-12T17:06:49.221 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-03-12T17:06:49.221 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-03-12T17:06:49.221 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-03-12T17:06:49.221 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-03-12T17:06:49.221 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/dmx3191d.ko 2024-03-12T17:06:49.222 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/esas2r 2024-03-12T17:06:49.222 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-12T17:06:49.222 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/esp_scsi.ko 2024-03-12T17:06:49.222 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/fcoe 2024-03-12T17:06:49.222 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-12T17:06:49.222 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-12T17:06:49.222 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/fnic 2024-03-12T17:06:49.222 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/fnic/fnic.ko 2024-03-12T17:06:49.222 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/hpsa.ko 2024-03-12T17:06:49.222 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/hptiop.ko 2024-03-12T17:06:49.222 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/hv_storvsc.ko 2024-03-12T17:06:49.222 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/initio.ko 2024-03-12T17:06:49.222 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/ipr.ko 2024-03-12T17:06:49.222 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/ips.ko 2024-03-12T17:06:49.223 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/isci 2024-03-12T17:06:49.223 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/isci/isci.ko 2024-03-12T17:06:49.223 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-12T17:06:49.223 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-12T17:06:49.223 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/libfc 2024-03-12T17:06:49.223 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/libfc/libfc.ko 2024-03-12T17:06:49.223 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/libiscsi.ko 2024-03-12T17:06:49.223 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-12T17:06:49.223 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/libsas 2024-03-12T17:06:49.223 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/libsas/libsas.ko 2024-03-12T17:06:49.223 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/lpfc 2024-03-12T17:06:49.223 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-12T17:06:49.223 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/megaraid 2024-03-12T17:06:49.224 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/megaraid.ko 2024-03-12T17:06:49.224 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-12T17:06:49.224 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-12T17:06:49.224 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-12T17:06:49.224 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/mpt3sas 2024-03-12T17:06:49.224 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-12T17:06:49.224 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/mvsas 2024-03-12T17:06:49.224 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-12T17:06:49.224 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/mvumi.ko 2024-03-12T17:06:49.224 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/pm8001 2024-03-12T17:06:49.224 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-12T17:06:49.224 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/pmcraid.ko 2024-03-12T17:06:49.224 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/qla1280.ko 2024-03-12T17:06:49.224 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/qla2xxx 2024-03-12T17:06:49.224 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-12T17:06:49.225 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-12T17:06:49.225 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/qla4xxx 2024-03-12T17:06:49.225 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-12T17:06:49.225 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/raid_class.ko 2024-03-12T17:06:49.225 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/scsi_debug.ko 2024-03-12T17:06:49.225 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-12T17:06:49.225 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-12T17:06:49.225 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-12T17:06:49.225 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-12T17:06:49.225 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-12T17:06:49.225 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/ses.ko 2024-03-12T17:06:49.225 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/st.ko 2024-03-12T17:06:49.225 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/stex.ko 2024-03-12T17:06:49.225 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/sym53c8xx_2 2024-03-12T17:06:49.225 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-12T17:06:49.225 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/virtio_scsi.ko 2024-03-12T17:06:49.226 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-12T17:06:49.226 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/scsi/wd719x.ko 2024-03-12T17:06:49.226 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ssb 2024-03-12T17:06:49.226 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ssb/ssb.ko 2024-03-12T17:06:49.226 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/target 2024-03-12T17:06:49.226 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/target/iscsi 2024-03-12T17:06:49.226 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-12T17:06:49.226 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/target/loopback 2024-03-12T17:06:49.226 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-12T17:06:49.226 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/target/target_core_file.ko 2024-03-12T17:06:49.226 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/target/target_core_iblock.ko 2024-03-12T17:06:49.226 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/target/target_core_mod.ko 2024-03-12T17:06:49.226 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/target/target_core_pscsi.ko 2024-03-12T17:06:49.226 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/target/target_core_user.ko 2024-03-12T17:06:49.226 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/target/tcm_fc 2024-03-12T17:06:49.227 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-12T17:06:49.227 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal 2024-03-12T17:06:49.227 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal/intel 2024-03-12T17:06:49.227 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal/intel/int340x_thermal 2024-03-12T17:06:49.227 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-12T17:06:49.227 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-12T17:06:49.227 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-12T17:06:49.227 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-12T17:06:49.227 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-12T17:06:49.227 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-12T17:06:49.227 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-12T17:06:49.227 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-12T17:06:49.227 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-12T17:06:49.227 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-12T17:06:49.228 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-12T17:06:49.228 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-12T17:06:49.228 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-12T17:06:49.228 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-12T17:06:49.228 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-12T17:06:49.228 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-12T17:06:49.228 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-12T17:06:49.228 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-12T17:06:49.228 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/tty 2024-03-12T17:06:49.228 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/tty/ipwireless 2024-03-12T17:06:49.228 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-12T17:06:49.228 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/tty/n_gsm.ko 2024-03-12T17:06:49.228 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/tty/n_hdlc.ko 2024-03-12T17:06:49.228 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/tty/nozomi.ko 2024-03-12T17:06:49.229 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/tty/serial 2024-03-12T17:06:49.229 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/tty/serial/8250 2024-03-12T17:06:49.229 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-12T17:06:49.229 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/tty/serial/arc_uart.ko 2024-03-12T17:06:49.229 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/tty/serial/jsm 2024-03-12T17:06:49.229 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-12T17:06:49.229 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ufs 2024-03-12T17:06:49.229 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ufs/core 2024-03-12T17:06:49.229 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-12T17:06:49.229 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ufs/host 2024-03-12T17:06:49.229 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-12T17:06:49.229 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/uio 2024-03-12T17:06:49.229 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/uio/uio.ko 2024-03-12T17:06:49.229 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/uio/uio_aec.ko 2024-03-12T17:06:49.229 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/uio/uio_cif.ko 2024-03-12T17:06:49.230 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/uio/uio_pci_generic.ko 2024-03-12T17:06:49.230 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/uio/uio_sercos3.ko 2024-03-12T17:06:49.230 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb 2024-03-12T17:06:49.230 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/class 2024-03-12T17:06:49.230 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/class/cdc-acm.ko 2024-03-12T17:06:49.230 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-12T17:06:49.230 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/class/usblp.ko 2024-03-12T17:06:49.230 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/class/usbtmc.ko 2024-03-12T17:06:49.230 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/host 2024-03-12T17:06:49.230 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-12T17:06:49.230 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/image 2024-03-12T17:06:49.230 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/image/mdc800.ko 2024-03-12T17:06:49.230 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/image/microtek.ko 2024-03-12T17:06:49.230 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/misc 2024-03-12T17:06:49.230 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/misc/adutux.ko 2024-03-12T17:06:49.231 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/misc/appledisplay.ko 2024-03-12T17:06:49.231 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/misc/emi26.ko 2024-03-12T17:06:49.231 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/misc/emi62.ko 2024-03-12T17:06:49.231 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/misc/ezusb.ko 2024-03-12T17:06:49.231 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/misc/idmouse.ko 2024-03-12T17:06:49.231 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/misc/iowarrior.ko 2024-03-12T17:06:49.231 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-12T17:06:49.231 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/misc/ldusb.ko 2024-03-12T17:06:49.231 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/misc/legousbtower.ko 2024-03-12T17:06:49.231 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/misc/sisusbvga 2024-03-12T17:06:49.231 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-12T17:06:49.231 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-12T17:06:49.231 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/misc/usb3503.ko 2024-03-12T17:06:49.231 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/misc/usblcd.ko 2024-03-12T17:06:49.231 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-12T17:06:49.232 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/misc/uss720.ko 2024-03-12T17:06:49.232 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/misc/yurex.ko 2024-03-12T17:06:49.232 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/phy 2024-03-12T17:06:49.232 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/phy/phy-generic.ko 2024-03-12T17:06:49.232 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial 2024-03-12T17:06:49.232 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/aircable.ko 2024-03-12T17:06:49.232 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/ark3116.ko 2024-03-12T17:06:49.232 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-12T17:06:49.232 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/ch341.ko 2024-03-12T17:06:49.232 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/cp210x.ko 2024-03-12T17:06:49.232 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/cyberjack.ko 2024-03-12T17:06:49.232 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-12T17:06:49.232 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-12T17:06:49.232 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/empeg.ko 2024-03-12T17:06:49.232 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-12T17:06:49.232 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-12T17:06:49.233 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-12T17:06:49.233 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/io_ti.ko 2024-03-12T17:06:49.233 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/ipaq.ko 2024-03-12T17:06:49.233 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/ipw.ko 2024-03-12T17:06:49.233 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/ir-usb.ko 2024-03-12T17:06:49.233 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-12T17:06:49.233 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/keyspan.ko 2024-03-12T17:06:49.233 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-12T17:06:49.233 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-12T17:06:49.233 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-12T17:06:49.233 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/mct_u232.ko 2024-03-12T17:06:49.233 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/mos7720.ko 2024-03-12T17:06:49.233 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/mos7840.ko 2024-03-12T17:06:49.233 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/navman.ko 2024-03-12T17:06:49.233 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/omninet.ko 2024-03-12T17:06:49.234 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/opticon.ko 2024-03-12T17:06:49.234 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/option.ko 2024-03-12T17:06:49.234 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/oti6858.ko 2024-03-12T17:06:49.234 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/pl2303.ko 2024-03-12T17:06:49.234 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/qcaux.ko 2024-03-12T17:06:49.234 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/qcserial.ko 2024-03-12T17:06:49.234 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/quatech2.ko 2024-03-12T17:06:49.234 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/safe_serial.ko 2024-03-12T17:06:49.234 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/sierra.ko 2024-03-12T17:06:49.234 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-12T17:06:49.234 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/ssu100.ko 2024-03-12T17:06:49.234 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/symbolserial.ko 2024-03-12T17:06:49.234 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-12T17:06:49.234 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-12T17:06:49.234 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/usb_debug.ko 2024-03-12T17:06:49.235 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-12T17:06:49.235 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/visor.ko 2024-03-12T17:06:49.235 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/whiteheat.ko 2024-03-12T17:06:49.235 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-12T17:06:49.235 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/storage 2024-03-12T17:06:49.235 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/storage/uas.ko 2024-03-12T17:06:49.235 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-12T17:06:49.235 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-12T17:06:49.235 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-12T17:06:49.235 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-12T17:06:49.235 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-12T17:06:49.235 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-12T17:06:49.235 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-12T17:06:49.235 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/storage/ums-karma.ko 2024-03-12T17:06:49.235 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-12T17:06:49.236 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-12T17:06:49.236 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-12T17:06:49.236 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-12T17:06:49.236 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-12T17:06:49.236 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/storage/usb-storage.ko 2024-03-12T17:06:49.236 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/usbip 2024-03-12T17:06:49.236 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-12T17:06:49.236 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-12T17:06:49.236 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-12T17:06:49.236 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/vfio 2024-03-12T17:06:49.236 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/vfio/pci 2024-03-12T17:06:49.236 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-12T17:06:49.236 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-12T17:06:49.236 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/vfio/vfio.ko 2024-03-12T17:06:49.236 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-12T17:06:49.237 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/vhost 2024-03-12T17:06:49.237 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/vhost/vhost.ko 2024-03-12T17:06:49.237 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-12T17:06:49.237 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/vhost/vhost_net.ko 2024-03-12T17:06:49.237 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/vhost/vhost_scsi.ko 2024-03-12T17:06:49.237 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/video 2024-03-12T17:06:49.237 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/video/backlight 2024-03-12T17:06:49.237 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/video/backlight/apple_bl.ko 2024-03-12T17:06:49.237 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/video/backlight/lcd.ko 2024-03-12T17:06:49.237 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-12T17:06:49.237 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/virtio 2024-03-12T17:06:49.237 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/virtio/virtio.ko 2024-03-12T17:06:49.237 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/virtio/virtio_balloon.ko 2024-03-12T17:06:49.237 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/virtio/virtio_mmio.ko 2024-03-12T17:06:49.237 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/virtio/virtio_pci.ko 2024-03-12T17:06:49.238 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-03-12T17:06:49.238 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-03-12T17:06:49.238 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/virtio/virtio_ring.ko 2024-03-12T17:06:49.238 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/w1 2024-03-12T17:06:49.238 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/w1/masters 2024-03-12T17:06:49.238 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/w1/masters/ds2482.ko 2024-03-12T17:06:49.238 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/w1/masters/ds2490.ko 2024-03-12T17:06:49.238 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/w1/slaves 2024-03-12T17:06:49.238 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-12T17:06:49.238 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-12T17:06:49.238 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-12T17:06:49.238 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-12T17:06:49.238 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-12T17:06:49.238 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-12T17:06:49.239 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-12T17:06:49.239 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-12T17:06:49.239 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-12T17:06:49.239 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-12T17:06:49.239 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-12T17:06:49.239 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/w1/wire.ko 2024-03-12T17:06:49.239 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog 2024-03-12T17:06:49.239 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-12T17:06:49.239 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-12T17:06:49.239 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-12T17:06:49.239 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/hpwdt.ko 2024-03-12T17:06:49.239 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/i6300esb.ko 2024-03-12T17:06:49.239 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-12T17:06:49.239 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-12T17:06:49.239 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/ib700wdt.ko 2024-03-12T17:06:49.240 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/ibmasr.ko 2024-03-12T17:06:49.240 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-12T17:06:49.240 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-12T17:06:49.240 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/it87_wdt.ko 2024-03-12T17:06:49.240 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/machzwd.ko 2024-03-12T17:06:49.240 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/nv_tco.ko 2024-03-12T17:06:49.240 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-12T17:06:49.240 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-12T17:06:49.240 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-12T17:06:49.240 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-12T17:06:49.240 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/softdog.ko 2024-03-12T17:06:49.240 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-12T17:06:49.240 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/via_wdt.ko 2024-03-12T17:06:49.240 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-12T17:06:49.241 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-12T17:06:49.241 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-12T17:06:49.241 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/wdt_pci.ko 2024-03-12T17:06:49.241 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/watchdog/xen_wdt.ko 2024-03-12T17:06:49.241 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/xen 2024-03-12T17:06:49.241 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/xen/xen-acpi-processor.ko 2024-03-12T17:06:49.241 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/xen/xen-evtchn.ko 2024-03-12T17:06:49.241 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/xen/xen-gntalloc.ko 2024-03-12T17:06:49.241 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/xen/xen-gntdev.ko 2024-03-12T17:06:49.241 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/xen/xen-pciback 2024-03-12T17:06:49.241 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-12T17:06:49.241 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/xen/xen-privcmd.ko 2024-03-12T17:06:49.241 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/xen/xenfs 2024-03-12T17:06:49.241 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-12T17:06:49.242 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs 2024-03-12T17:06:49.242 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/9p 2024-03-12T17:06:49.242 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/9p/9p.ko 2024-03-12T17:06:49.242 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/affs 2024-03-12T17:06:49.242 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/affs/affs.ko 2024-03-12T17:06:49.242 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/befs 2024-03-12T17:06:49.242 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/befs/befs.ko 2024-03-12T17:06:49.242 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/binfmt_misc.ko 2024-03-12T17:06:49.242 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/btrfs 2024-03-12T17:06:49.242 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/btrfs/btrfs.ko 2024-03-12T17:06:49.242 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/cachefiles 2024-03-12T17:06:49.242 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/cachefiles/cachefiles.ko 2024-03-12T17:06:49.242 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/ceph 2024-03-12T17:06:49.242 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/ceph/ceph.ko 2024-03-12T17:06:49.242 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/coda 2024-03-12T17:06:49.243 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/coda/coda.ko 2024-03-12T17:06:49.243 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/cramfs 2024-03-12T17:06:49.243 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/cramfs/cramfs.ko 2024-03-12T17:06:49.243 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/dlm 2024-03-12T17:06:49.243 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/dlm/dlm.ko 2024-03-12T17:06:49.243 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/ecryptfs 2024-03-12T17:06:49.243 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/ecryptfs/ecryptfs.ko 2024-03-12T17:06:49.243 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/f2fs 2024-03-12T17:06:49.243 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/f2fs/f2fs.ko 2024-03-12T17:06:49.243 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/fat 2024-03-12T17:06:49.243 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/fat/fat.ko 2024-03-12T17:06:49.243 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/fat/msdos.ko 2024-03-12T17:06:49.243 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/fat/vfat.ko 2024-03-12T17:06:49.243 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/fuse 2024-03-12T17:06:49.243 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/fuse/cuse.ko 2024-03-12T17:06:49.244 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/fuse/fuse.ko 2024-03-12T17:06:49.244 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/gfs2 2024-03-12T17:06:49.244 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/gfs2/gfs2.ko 2024-03-12T17:06:49.244 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/hfs 2024-03-12T17:06:49.244 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/hfs/hfs.ko 2024-03-12T17:06:49.244 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/hfsplus 2024-03-12T17:06:49.244 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/hfsplus/hfsplus.ko 2024-03-12T17:06:49.244 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/isofs 2024-03-12T17:06:49.244 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/isofs/isofs.ko 2024-03-12T17:06:49.244 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/jfs 2024-03-12T17:06:49.244 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/jfs/jfs.ko 2024-03-12T17:06:49.244 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/lockd 2024-03-12T17:06:49.244 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/lockd/lockd.ko 2024-03-12T17:06:49.244 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/minix 2024-03-12T17:06:49.244 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/minix/minix.ko 2024-03-12T17:06:49.245 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/netfs 2024-03-12T17:06:49.245 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/netfs/netfs.ko 2024-03-12T17:06:49.245 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nfs 2024-03-12T17:06:49.245 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nfs/blocklayout 2024-03-12T17:06:49.245 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-12T17:06:49.245 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nfs/filelayout 2024-03-12T17:06:49.245 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-12T17:06:49.245 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nfs/flexfilelayout 2024-03-12T17:06:49.245 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-12T17:06:49.245 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nfs/nfs.ko 2024-03-12T17:06:49.245 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nfs/nfsv3.ko 2024-03-12T17:06:49.245 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nfs/nfsv4.ko 2024-03-12T17:06:49.245 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nfs_common 2024-03-12T17:06:49.245 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nfs_common/grace.ko 2024-03-12T17:06:49.245 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nfs_common/nfs_acl.ko 2024-03-12T17:06:49.246 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nfsd 2024-03-12T17:06:49.246 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nfsd/nfsd.ko 2024-03-12T17:06:49.246 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nilfs2 2024-03-12T17:06:49.246 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nilfs2/nilfs2.ko 2024-03-12T17:06:49.246 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls 2024-03-12T17:06:49.246 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/mac-celtic.ko 2024-03-12T17:06:49.246 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/mac-centeuro.ko 2024-03-12T17:06:49.246 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/mac-croatian.ko 2024-03-12T17:06:49.246 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/mac-cyrillic.ko 2024-03-12T17:06:49.246 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/mac-gaelic.ko 2024-03-12T17:06:49.246 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/mac-greek.ko 2024-03-12T17:06:49.246 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/mac-iceland.ko 2024-03-12T17:06:49.246 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/mac-inuit.ko 2024-03-12T17:06:49.246 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/mac-roman.ko 2024-03-12T17:06:49.246 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/mac-romanian.ko 2024-03-12T17:06:49.247 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/mac-turkish.ko 2024-03-12T17:06:49.247 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp1250.ko 2024-03-12T17:06:49.247 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp1251.ko 2024-03-12T17:06:49.247 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp1255.ko 2024-03-12T17:06:49.247 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp737.ko 2024-03-12T17:06:49.247 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp775.ko 2024-03-12T17:06:49.247 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp850.ko 2024-03-12T17:06:49.247 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp852.ko 2024-03-12T17:06:49.247 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp855.ko 2024-03-12T17:06:49.247 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp857.ko 2024-03-12T17:06:49.247 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp860.ko 2024-03-12T17:06:49.247 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp861.ko 2024-03-12T17:06:49.247 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp862.ko 2024-03-12T17:06:49.247 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp863.ko 2024-03-12T17:06:49.247 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp864.ko 2024-03-12T17:06:49.247 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp865.ko 2024-03-12T17:06:49.248 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp866.ko 2024-03-12T17:06:49.248 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp869.ko 2024-03-12T17:06:49.248 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp874.ko 2024-03-12T17:06:49.248 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp932.ko 2024-03-12T17:06:49.248 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp936.ko 2024-03-12T17:06:49.248 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp949.ko 2024-03-12T17:06:49.248 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_cp950.ko 2024-03-12T17:06:49.248 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_euc-jp.ko 2024-03-12T17:06:49.248 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_iso8859-1.ko 2024-03-12T17:06:49.248 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_iso8859-13.ko 2024-03-12T17:06:49.248 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_iso8859-14.ko 2024-03-12T17:06:49.248 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_iso8859-15.ko 2024-03-12T17:06:49.248 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_iso8859-2.ko 2024-03-12T17:06:49.248 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_iso8859-3.ko 2024-03-12T17:06:49.249 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_iso8859-4.ko 2024-03-12T17:06:49.249 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_iso8859-5.ko 2024-03-12T17:06:49.249 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_iso8859-6.ko 2024-03-12T17:06:49.249 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_iso8859-7.ko 2024-03-12T17:06:49.249 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_iso8859-9.ko 2024-03-12T17:06:49.249 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_koi8-r.ko 2024-03-12T17:06:49.249 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_koi8-ru.ko 2024-03-12T17:06:49.249 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_koi8-u.ko 2024-03-12T17:06:49.249 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-12T17:06:49.249 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/nls/nls_utf8.ko 2024-03-12T17:06:49.249 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/ocfs2 2024-03-12T17:06:49.249 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/ocfs2/cluster 2024-03-12T17:06:49.249 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-12T17:06:49.249 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/ocfs2/dlm 2024-03-12T17:06:49.249 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-12T17:06:49.250 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/ocfs2/dlmfs 2024-03-12T17:06:49.250 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-12T17:06:49.250 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/ocfs2/ocfs2.ko 2024-03-12T17:06:49.250 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-12T17:06:49.250 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-12T17:06:49.250 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-12T17:06:49.250 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/overlayfs 2024-03-12T17:06:49.250 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/overlayfs/overlay.ko 2024-03-12T17:06:49.250 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/pstore 2024-03-12T17:06:49.250 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/pstore/ramoops.ko 2024-03-12T17:06:49.250 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/reiserfs 2024-03-12T17:06:49.250 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/reiserfs/reiserfs.ko 2024-03-12T17:06:49.250 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/romfs 2024-03-12T17:06:49.250 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/romfs/romfs.ko 2024-03-12T17:06:49.250 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/smb 2024-03-12T17:06:49.251 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/smb/client 2024-03-12T17:06:49.251 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/smb/client/cifs.ko 2024-03-12T17:06:49.251 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/smb/common 2024-03-12T17:06:49.251 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/smb/common/cifs_arc4.ko 2024-03-12T17:06:49.251 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/smb/common/cifs_md4.ko 2024-03-12T17:06:49.251 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/squashfs 2024-03-12T17:06:49.251 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/squashfs/squashfs.ko 2024-03-12T17:06:49.251 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/sysv 2024-03-12T17:06:49.251 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/sysv/sysv.ko 2024-03-12T17:06:49.251 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/udf 2024-03-12T17:06:49.251 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/udf/udf.ko 2024-03-12T17:06:49.251 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/ufs 2024-03-12T17:06:49.251 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/ufs/ufs.ko 2024-03-12T17:06:49.251 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/xfs 2024-03-12T17:06:49.251 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/fs/xfs/xfs.ko 2024-03-12T17:06:49.252 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/kernel 2024-03-12T17:06:49.252 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/kernel/rcu 2024-03-12T17:06:49.252 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/kernel/rcu/rcutorture.ko 2024-03-12T17:06:49.252 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/kernel/torture.ko 2024-03-12T17:06:49.252 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/kernel/trace 2024-03-12T17:06:49.252 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-03-12T17:06:49.252 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib 2024-03-12T17:06:49.252 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/asn1_encoder.ko 2024-03-12T17:06:49.252 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/crc-itu-t.ko 2024-03-12T17:06:49.252 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/crc8.ko 2024-03-12T17:06:49.252 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/crypto 2024-03-12T17:06:49.252 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/crypto/libarc4.ko 2024-03-12T17:06:49.252 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/crypto/libdes.ko 2024-03-12T17:06:49.252 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/libcrc32c.ko 2024-03-12T17:06:49.252 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/lru_cache.ko 2024-03-12T17:06:49.252 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/lz4 2024-03-12T17:06:49.253 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/lz4/lz4_compress.ko 2024-03-12T17:06:49.253 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/lz4/lz4hc_compress.ko 2024-03-12T17:06:49.253 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/math 2024-03-12T17:06:49.253 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/math/cordic.ko 2024-03-12T17:06:49.253 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/raid6 2024-03-12T17:06:49.253 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/raid6/raid6_pq.ko 2024-03-12T17:06:49.253 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/reed_solomon 2024-03-12T17:06:49.253 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-12T17:06:49.253 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/ts_bm.ko 2024-03-12T17:06:49.253 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/ts_fsm.ko 2024-03-12T17:06:49.253 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/ts_kmp.ko 2024-03-12T17:06:49.253 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/zstd 2024-03-12T17:06:49.253 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/lib/zstd/zstd_compress.ko 2024-03-12T17:06:49.253 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/mm 2024-03-12T17:06:49.253 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/mm/hwpoison-inject.ko 2024-03-12T17:06:49.254 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net 2024-03-12T17:06:49.254 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/6lowpan 2024-03-12T17:06:49.254 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/6lowpan/6lowpan.ko 2024-03-12T17:06:49.254 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/6lowpan/nhc_dest.ko 2024-03-12T17:06:49.254 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/6lowpan/nhc_fragment.ko 2024-03-12T17:06:49.254 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/6lowpan/nhc_hop.ko 2024-03-12T17:06:49.254 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-12T17:06:49.254 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/6lowpan/nhc_mobility.ko 2024-03-12T17:06:49.254 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/6lowpan/nhc_routing.ko 2024-03-12T17:06:49.254 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/6lowpan/nhc_udp.ko 2024-03-12T17:06:49.254 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/802 2024-03-12T17:06:49.254 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/802/garp.ko 2024-03-12T17:06:49.254 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/802/mrp.ko 2024-03-12T17:06:49.254 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/802/p8022.ko 2024-03-12T17:06:49.255 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/802/psnap.ko 2024-03-12T17:06:49.255 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/802/stp.ko 2024-03-12T17:06:49.255 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/8021q 2024-03-12T17:06:49.255 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/8021q/8021q.ko 2024-03-12T17:06:49.255 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/9p 2024-03-12T17:06:49.255 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/9p/9pnet.ko 2024-03-12T17:06:49.255 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/9p/9pnet_fd.ko 2024-03-12T17:06:49.255 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/9p/9pnet_rdma.ko 2024-03-12T17:06:49.255 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/9p/9pnet_virtio.ko 2024-03-12T17:06:49.255 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/batman-adv 2024-03-12T17:06:49.255 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/batman-adv/batman-adv.ko 2024-03-12T17:06:49.255 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge 2024-03-12T17:06:49.255 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/br_netfilter.ko 2024-03-12T17:06:49.255 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/bridge.ko 2024-03-12T17:06:49.255 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter 2024-03-12T17:06:49.256 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-12T17:06:49.256 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-12T17:06:49.256 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-12T17:06:49.256 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-12T17:06:49.256 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-12T17:06:49.256 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-12T17:06:49.256 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-12T17:06:49.256 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-12T17:06:49.256 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-12T17:06:49.256 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-12T17:06:49.256 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-12T17:06:49.256 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-12T17:06:49.256 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-12T17:06:49.256 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-12T17:06:49.256 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-12T17:06:49.257 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-12T17:06:49.257 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-12T17:06:49.257 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-12T17:06:49.257 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-12T17:06:49.257 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-12T17:06:49.257 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/ebtables.ko 2024-03-12T17:06:49.257 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-03-12T17:06:49.257 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-12T17:06:49.257 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-12T17:06:49.257 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ceph 2024-03-12T17:06:49.257 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ceph/libceph.ko 2024-03-12T17:06:49.257 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/core 2024-03-12T17:06:49.257 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/core/failover.ko 2024-03-12T17:06:49.257 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/core/pktgen.ko 2024-03-12T17:06:49.257 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/dccp 2024-03-12T17:06:49.257 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/dccp/dccp.ko 2024-03-12T17:06:49.258 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/dccp/dccp_diag.ko 2024-03-12T17:06:49.258 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/dccp/dccp_ipv4.ko 2024-03-12T17:06:49.258 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/dccp/dccp_ipv6.ko 2024-03-12T17:06:49.258 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/dns_resolver 2024-03-12T17:06:49.258 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/dns_resolver/dns_resolver.ko 2024-03-12T17:06:49.258 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/dsa 2024-03-12T17:06:49.258 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/dsa/dsa_core.ko 2024-03-12T17:06:49.258 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/dsa/tag_brcm.ko 2024-03-12T17:06:49.258 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/dsa/tag_dsa.ko 2024-03-12T17:06:49.258 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/dsa/tag_none.ko 2024-03-12T17:06:49.258 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/dsa/tag_trailer.ko 2024-03-12T17:06:49.258 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ieee802154 2024-03-12T17:06:49.258 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ieee802154/6lowpan 2024-03-12T17:06:49.258 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-12T17:06:49.258 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ieee802154/ieee802154.ko 2024-03-12T17:06:49.259 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-12T17:06:49.259 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4 2024-03-12T17:06:49.259 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/ah4.ko 2024-03-12T17:06:49.259 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/esp4.ko 2024-03-12T17:06:49.259 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/fou.ko 2024-03-12T17:06:49.259 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/gre.ko 2024-03-12T17:06:49.259 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/inet_diag.ko 2024-03-12T17:06:49.259 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/ip_gre.ko 2024-03-12T17:06:49.259 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/ip_tunnel.ko 2024-03-12T17:06:49.259 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/ip_vti.ko 2024-03-12T17:06:49.259 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/ipcomp.ko 2024-03-12T17:06:49.259 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/ipip.ko 2024-03-12T17:06:49.259 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter 2024-03-12T17:06:49.259 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-12T17:06:49.259 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-12T17:06:49.260 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-12T17:06:49.260 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-12T17:06:49.260 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-12T17:06:49.260 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-12T17:06:49.260 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-12T17:06:49.260 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-12T17:06:49.260 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-12T17:06:49.260 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-12T17:06:49.260 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-12T17:06:49.260 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-12T17:06:49.260 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-12T17:06:49.260 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-12T17:06:49.260 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-12T17:06:49.260 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-12T17:06:49.260 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-12T17:06:49.260 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-12T17:06:49.261 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-12T17:06:49.261 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-12T17:06:49.261 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-12T17:06:49.261 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/tcp_bic.ko 2024-03-12T17:06:49.261 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/tcp_dctcp.ko 2024-03-12T17:06:49.261 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/tcp_diag.ko 2024-03-12T17:06:49.261 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/tcp_highspeed.ko 2024-03-12T17:06:49.261 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/tcp_htcp.ko 2024-03-12T17:06:49.261 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/tcp_hybla.ko 2024-03-12T17:06:49.261 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/tcp_illinois.ko 2024-03-12T17:06:49.261 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/tcp_lp.ko 2024-03-12T17:06:49.261 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/tcp_scalable.ko 2024-03-12T17:06:49.261 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/tcp_vegas.ko 2024-03-12T17:06:49.261 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/tcp_veno.ko 2024-03-12T17:06:49.261 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/tcp_westwood.ko 2024-03-12T17:06:49.262 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/tcp_yeah.ko 2024-03-12T17:06:49.262 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/tunnel4.ko 2024-03-12T17:06:49.262 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/udp_diag.ko 2024-03-12T17:06:49.262 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/udp_tunnel.ko 2024-03-12T17:06:49.262 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-12T17:06:49.262 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6 2024-03-12T17:06:49.262 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/ah6.ko 2024-03-12T17:06:49.262 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/esp6.ko 2024-03-12T17:06:49.262 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/fou6.ko 2024-03-12T17:06:49.262 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/ip6_tunnel.ko 2024-03-12T17:06:49.262 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-12T17:06:49.262 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/ip6_vti.ko 2024-03-12T17:06:49.262 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/ipcomp6.ko 2024-03-12T17:06:49.262 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter 2024-03-12T17:06:49.262 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-12T17:06:49.263 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-12T17:06:49.263 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-12T17:06:49.263 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-12T17:06:49.263 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-12T17:06:49.263 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-12T17:06:49.263 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-12T17:06:49.263 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-12T17:06:49.263 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-12T17:06:49.263 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-12T17:06:49.263 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-12T17:06:49.263 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-12T17:06:49.263 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-12T17:06:49.263 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-12T17:06:49.263 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-12T17:06:49.263 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-12T17:06:49.264 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-12T17:06:49.264 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-12T17:06:49.264 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-12T17:06:49.264 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-12T17:06:49.264 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-12T17:06:49.264 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-12T17:06:49.264 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-12T17:06:49.264 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-12T17:06:49.264 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/sit.ko 2024-03-12T17:06:49.264 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/tunnel6.ko 2024-03-12T17:06:49.264 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-12T17:06:49.264 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/key 2024-03-12T17:06:49.264 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/key/af_key.ko 2024-03-12T17:06:49.264 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/l2tp 2024-03-12T17:06:49.264 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/l2tp/l2tp_core.ko 2024-03-12T17:06:49.265 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-12T17:06:49.265 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/l2tp/l2tp_eth.ko 2024-03-12T17:06:49.265 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/l2tp/l2tp_ip.ko 2024-03-12T17:06:49.265 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/l2tp/l2tp_ip6.ko 2024-03-12T17:06:49.265 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/l2tp/l2tp_netlink.ko 2024-03-12T17:06:49.265 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/l2tp/l2tp_ppp.ko 2024-03-12T17:06:49.265 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/llc 2024-03-12T17:06:49.265 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/llc/llc.ko 2024-03-12T17:06:49.265 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/mac802154 2024-03-12T17:06:49.265 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/mac802154/mac802154.ko 2024-03-12T17:06:49.265 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/mpls 2024-03-12T17:06:49.265 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/mpls/mpls_gso.ko 2024-03-12T17:06:49.265 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter 2024-03-12T17:06:49.265 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipset 2024-03-12T17:06:49.265 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipset/ip_set.ko 2024-03-12T17:06:49.266 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-12T17:06:49.266 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-12T17:06:49.266 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-12T17:06:49.266 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-12T17:06:49.266 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-12T17:06:49.266 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-12T17:06:49.266 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-12T17:06:49.266 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-12T17:06:49.266 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-12T17:06:49.266 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-12T17:06:49.266 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-12T17:06:49.266 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-12T17:06:49.266 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-12T17:06:49.266 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-12T17:06:49.266 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-12T17:06:49.267 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipvs 2024-03-12T17:06:49.267 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-12T17:06:49.267 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-12T17:06:49.267 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-12T17:06:49.267 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-12T17:06:49.267 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-12T17:06:49.267 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-12T17:06:49.267 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-12T17:06:49.267 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-12T17:06:49.267 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-12T17:06:49.267 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-12T17:06:49.267 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-12T17:06:49.267 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-12T17:06:49.267 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-12T17:06:49.267 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-12T17:06:49.268 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_conncount.ko 2024-03-12T17:06:49.268 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_conntrack.ko 2024-03-12T17:06:49.268 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-12T17:06:49.268 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-12T17:06:49.268 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-12T17:06:49.268 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-12T17:06:49.268 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-12T17:06:49.268 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-12T17:06:49.268 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-12T17:06:49.268 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-12T17:06:49.268 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-12T17:06:49.268 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-12T17:06:49.268 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-12T17:06:49.268 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-12T17:06:49.268 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-12T17:06:49.269 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_flow_table.ko 2024-03-12T17:06:49.269 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-12T17:06:49.269 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_log_syslog.ko 2024-03-12T17:06:49.269 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_nat.ko 2024-03-12T17:06:49.269 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-12T17:06:49.269 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-12T17:06:49.269 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_nat_irc.ko 2024-03-12T17:06:49.269 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_nat_sip.ko 2024-03-12T17:06:49.269 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-12T17:06:49.269 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-12T17:06:49.269 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nf_tables.ko 2024-03-12T17:06:49.269 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nfnetlink.ko 2024-03-12T17:06:49.269 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-12T17:06:49.269 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nfnetlink_log.ko 2024-03-12T17:06:49.270 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-12T17:06:49.270 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-12T17:06:49.270 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nft_chain_nat.ko 2024-03-12T17:06:49.270 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nft_compat.ko 2024-03-12T17:06:49.270 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nft_ct.ko 2024-03-12T17:06:49.270 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-12T17:06:49.270 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nft_fib.ko 2024-03-12T17:06:49.270 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-12T17:06:49.270 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nft_hash.ko 2024-03-12T17:06:49.270 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nft_limit.ko 2024-03-12T17:06:49.270 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nft_log.ko 2024-03-12T17:06:49.270 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nft_masq.ko 2024-03-12T17:06:49.270 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nft_nat.ko 2024-03-12T17:06:49.270 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nft_numgen.ko 2024-03-12T17:06:49.271 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nft_queue.ko 2024-03-12T17:06:49.271 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nft_quota.ko 2024-03-12T17:06:49.271 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nft_redir.ko 2024-03-12T17:06:49.271 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nft_reject.ko 2024-03-12T17:06:49.271 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nft_reject_inet.ko 2024-03-12T17:06:49.271 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nft_socket.ko 2024-03-12T17:06:49.271 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/nft_tunnel.ko 2024-03-12T17:06:49.271 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_AUDIT.ko 2024-03-12T17:06:49.271 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-12T17:06:49.271 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-12T17:06:49.271 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-12T17:06:49.271 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_CT.ko 2024-03-12T17:06:49.271 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_DSCP.ko 2024-03-12T17:06:49.271 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_HL.ko 2024-03-12T17:06:49.272 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_HMARK.ko 2024-03-12T17:06:49.272 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-12T17:06:49.272 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_LED.ko 2024-03-12T17:06:49.272 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_LOG.ko 2024-03-12T17:06:49.272 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-12T17:06:49.272 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_NETMAP.ko 2024-03-12T17:06:49.272 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_NFLOG.ko 2024-03-12T17:06:49.272 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-12T17:06:49.272 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_RATEEST.ko 2024-03-12T17:06:49.272 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-12T17:06:49.272 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_SECMARK.ko 2024-03-12T17:06:49.272 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-12T17:06:49.272 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-12T17:06:49.272 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_TEE.ko 2024-03-12T17:06:49.272 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_TPROXY.ko 2024-03-12T17:06:49.273 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_TRACE.ko 2024-03-12T17:06:49.273 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_addrtype.ko 2024-03-12T17:06:49.273 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_bpf.ko 2024-03-12T17:06:49.273 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_cgroup.ko 2024-03-12T17:06:49.273 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_cluster.ko 2024-03-12T17:06:49.273 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_comment.ko 2024-03-12T17:06:49.273 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_connbytes.ko 2024-03-12T17:06:49.273 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_connlabel.ko 2024-03-12T17:06:49.273 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_connlimit.ko 2024-03-12T17:06:49.273 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_connmark.ko 2024-03-12T17:06:49.273 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_conntrack.ko 2024-03-12T17:06:49.273 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_cpu.ko 2024-03-12T17:06:49.273 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_dccp.ko 2024-03-12T17:06:49.273 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_devgroup.ko 2024-03-12T17:06:49.273 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_dscp.ko 2024-03-12T17:06:49.273 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_ecn.ko 2024-03-12T17:06:49.274 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_esp.ko 2024-03-12T17:06:49.274 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_hashlimit.ko 2024-03-12T17:06:49.274 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_helper.ko 2024-03-12T17:06:49.274 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_hl.ko 2024-03-12T17:06:49.274 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_ipcomp.ko 2024-03-12T17:06:49.274 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_iprange.ko 2024-03-12T17:06:49.274 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_ipvs.ko 2024-03-12T17:06:49.274 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_l2tp.ko 2024-03-12T17:06:49.274 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_length.ko 2024-03-12T17:06:49.274 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_limit.ko 2024-03-12T17:06:49.274 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_mac.ko 2024-03-12T17:06:49.274 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_mark.ko 2024-03-12T17:06:49.274 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_multiport.ko 2024-03-12T17:06:49.274 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_nat.ko 2024-03-12T17:06:49.275 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_nfacct.ko 2024-03-12T17:06:49.275 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_osf.ko 2024-03-12T17:06:49.275 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_owner.ko 2024-03-12T17:06:49.275 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_physdev.ko 2024-03-12T17:06:49.275 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_pkttype.ko 2024-03-12T17:06:49.275 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_policy.ko 2024-03-12T17:06:49.275 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_quota.ko 2024-03-12T17:06:49.275 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_rateest.ko 2024-03-12T17:06:49.275 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_realm.ko 2024-03-12T17:06:49.275 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_recent.ko 2024-03-12T17:06:49.275 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_sctp.ko 2024-03-12T17:06:49.275 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_set.ko 2024-03-12T17:06:49.275 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_socket.ko 2024-03-12T17:06:49.275 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_state.ko 2024-03-12T17:06:49.275 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_statistic.ko 2024-03-12T17:06:49.275 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_string.ko 2024-03-12T17:06:49.276 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_tcpmss.ko 2024-03-12T17:06:49.276 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_time.ko 2024-03-12T17:06:49.276 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netfilter/xt_u32.ko 2024-03-12T17:06:49.276 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netlink 2024-03-12T17:06:49.276 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/netlink/netlink_diag.ko 2024-03-12T17:06:49.276 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/nsh 2024-03-12T17:06:49.276 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/nsh/nsh.ko 2024-03-12T17:06:49.276 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/openvswitch 2024-03-12T17:06:49.276 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/openvswitch/openvswitch.ko 2024-03-12T17:06:49.276 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/openvswitch/vport-geneve.ko 2024-03-12T17:06:49.276 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/openvswitch/vport-gre.ko 2024-03-12T17:06:49.276 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/openvswitch/vport-vxlan.ko 2024-03-12T17:06:49.276 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/packet 2024-03-12T17:06:49.276 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/packet/af_packet_diag.ko 2024-03-12T17:06:49.277 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/rds 2024-03-12T17:06:49.277 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/rds/rds.ko 2024-03-12T17:06:49.277 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/rds/rds_rdma.ko 2024-03-12T17:06:49.277 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/rds/rds_tcp.ko 2024-03-12T17:06:49.277 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched 2024-03-12T17:06:49.277 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/act_csum.ko 2024-03-12T17:06:49.277 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/act_gact.ko 2024-03-12T17:06:49.277 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/act_mirred.ko 2024-03-12T17:06:49.277 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/act_nat.ko 2024-03-12T17:06:49.277 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/act_pedit.ko 2024-03-12T17:06:49.277 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/act_police.ko 2024-03-12T17:06:49.277 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/act_simple.ko 2024-03-12T17:06:49.277 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/act_skbedit.ko 2024-03-12T17:06:49.277 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/act_vlan.ko 2024-03-12T17:06:49.277 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/cls_basic.ko 2024-03-12T17:06:49.277 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/cls_bpf.ko 2024-03-12T17:06:49.278 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/cls_flow.ko 2024-03-12T17:06:49.278 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/cls_fw.ko 2024-03-12T17:06:49.278 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/cls_route.ko 2024-03-12T17:06:49.278 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/cls_u32.ko 2024-03-12T17:06:49.278 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/em_cmp.ko 2024-03-12T17:06:49.278 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/em_ipset.ko 2024-03-12T17:06:49.278 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/em_meta.ko 2024-03-12T17:06:49.278 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/em_nbyte.ko 2024-03-12T17:06:49.278 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/em_text.ko 2024-03-12T17:06:49.278 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/em_u32.ko 2024-03-12T17:06:49.278 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_choke.ko 2024-03-12T17:06:49.278 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_codel.ko 2024-03-12T17:06:49.278 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_drr.ko 2024-03-12T17:06:49.278 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_fq.ko 2024-03-12T17:06:49.279 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_gred.ko 2024-03-12T17:06:49.279 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_hfsc.ko 2024-03-12T17:06:49.279 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_hhf.ko 2024-03-12T17:06:49.279 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_htb.ko 2024-03-12T17:06:49.279 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_ingress.ko 2024-03-12T17:06:49.279 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_mqprio.ko 2024-03-12T17:06:49.279 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_mqprio_lib.ko 2024-03-12T17:06:49.279 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_multiq.ko 2024-03-12T17:06:49.279 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_netem.ko 2024-03-12T17:06:49.279 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_pie.ko 2024-03-12T17:06:49.279 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_plug.ko 2024-03-12T17:06:49.279 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_prio.ko 2024-03-12T17:06:49.279 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_qfq.ko 2024-03-12T17:06:49.279 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_red.ko 2024-03-12T17:06:49.279 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_sfb.ko 2024-03-12T17:06:49.279 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_sfq.ko 2024-03-12T17:06:49.280 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_tbf.ko 2024-03-12T17:06:49.280 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sched/sch_teql.ko 2024-03-12T17:06:49.280 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sctp 2024-03-12T17:06:49.280 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sctp/sctp.ko 2024-03-12T17:06:49.280 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sctp/sctp_diag.ko 2024-03-12T17:06:49.280 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sunrpc 2024-03-12T17:06:49.280 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sunrpc/auth_gss 2024-03-12T17:06:49.280 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-12T17:06:49.280 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-12T17:06:49.280 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sunrpc/sunrpc.ko 2024-03-12T17:06:49.280 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sunrpc/xprtrdma 2024-03-12T17:06:49.280 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-12T17:06:49.280 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/tipc 2024-03-12T17:06:49.280 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/tipc/diag.ko 2024-03-12T17:06:49.281 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/tipc/tipc.ko 2024-03-12T17:06:49.281 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/unix 2024-03-12T17:06:49.281 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/unix/unix_diag.ko 2024-03-12T17:06:49.281 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/vmw_vsock 2024-03-12T17:06:49.281 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-12T17:06:49.281 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-12T17:06:49.281 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/vmw_vsock/vsock.ko 2024-03-12T17:06:49.281 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-12T17:06:49.281 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-12T17:06:49.281 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/xfrm 2024-03-12T17:06:49.281 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-12T17:06:49.281 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/security 2024-03-12T17:06:49.281 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/security/keys 2024-03-12T17:06:49.281 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/security/keys/encrypted-keys 2024-03-12T17:06:49.282 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-03-12T17:06:49.282 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/security/keys/trusted-keys 2024-03-12T17:06:49.282 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/security/keys/trusted-keys/trusted.ko 2024-03-12T17:06:49.282 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/virt 2024-03-12T17:06:49.282 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/virt/lib 2024-03-12T17:06:49.282 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/kernel/virt/lib/irqbypass.ko 2024-03-12T17:06:49.282 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/modules.alias 2024-03-12T17:06:49.282 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/modules.alias.bin 2024-03-12T17:06:49.282 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/modules.builtin 2024-03-12T17:06:49.282 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/modules.builtin.alias.bin 2024-03-12T17:06:49.282 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/modules.builtin.bin 2024-03-12T17:06:49.282 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/modules.builtin.modinfo 2024-03-12T17:06:49.282 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/modules.dep 2024-03-12T17:06:49.282 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/modules.dep.bin 2024-03-12T17:06:49.283 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/modules.devname 2024-03-12T17:06:49.283 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/modules.order 2024-03-12T17:06:49.283 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/modules.softdep 2024-03-12T17:06:49.283 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/modules.symbols 2024-03-12T17:06:49.283 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/modules.symbols.bin 2024-03-12T17:06:49.283 INFO:teuthology.orchestra.run.smithi017.stdout:/lib/modules/6.8.0-rc7-gbf761b6efc7e/vmlinuz 2024-03-12T17:06:49.287 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-rc7-gbf761b6efc7e 2024-03-12T17:06:49.287 DEBUG:teuthology.orchestra.run.smithi017:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-03-12T17:06:49.309 INFO:teuthology.orchestra.run.smithi017.stdout:postinstall scriptlet (using /bin/sh): 2024-03-12T17:06:49.309 INFO:teuthology.orchestra.run.smithi017.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-03-12T17:06:49.309 INFO:teuthology.orchestra.run.smithi017.stdout: /usr/bin/kernel-install add 6.8.0-rc7-gbf761b6efc7e /lib/modules/6.8.0-rc7-gbf761b6efc7e/vmlinuz 2024-03-12T17:06:49.309 INFO:teuthology.orchestra.run.smithi017.stdout:fi 2024-03-12T17:06:49.310 INFO:teuthology.orchestra.run.smithi017.stdout:for file in vmlinuz System.map config; do 2024-03-12T17:06:49.310 INFO:teuthology.orchestra.run.smithi017.stdout: if ! cmp --silent "/lib/modules/6.8.0-rc7-gbf761b6efc7e/${file}" "/boot/${file}-6.8.0-rc7-gbf761b6efc7e"; then 2024-03-12T17:06:49.310 INFO:teuthology.orchestra.run.smithi017.stdout: cp "/lib/modules/6.8.0-rc7-gbf761b6efc7e/${file}" "/boot/${file}-6.8.0-rc7-gbf761b6efc7e" 2024-03-12T17:06:49.310 INFO:teuthology.orchestra.run.smithi017.stdout: fi 2024-03-12T17:06:49.310 INFO:teuthology.orchestra.run.smithi017.stdout:done 2024-03-12T17:06:49.310 INFO:teuthology.orchestra.run.smithi017.stdout:preuninstall scriptlet (using /bin/sh): 2024-03-12T17:06:49.310 INFO:teuthology.orchestra.run.smithi017.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-03-12T17:06:49.310 INFO:teuthology.orchestra.run.smithi017.stdout:new-kernel-pkg --remove 6.8.0-rc7-gbf761b6efc7e --rminitrd --initrdfile=/boot/initramfs-6.8.0-rc7-gbf761b6efc7e.img 2024-03-12T17:06:49.310 INFO:teuthology.orchestra.run.smithi017.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-03-12T17:06:49.310 INFO:teuthology.orchestra.run.smithi017.stdout:kernel-install remove 6.8.0-rc7-gbf761b6efc7e 2024-03-12T17:06:49.310 INFO:teuthology.orchestra.run.smithi017.stdout:fi 2024-03-12T17:06:49.310 INFO:teuthology.orchestra.run.smithi017.stdout:postuninstall scriptlet (using /bin/sh): 2024-03-12T17:06:49.310 INFO:teuthology.orchestra.run.smithi017.stdout:if [ -x /sbin/update-bootloader ]; then 2024-03-12T17:06:49.310 INFO:teuthology.orchestra.run.smithi017.stdout:/sbin/update-bootloader --remove 6.8.0-rc7-gbf761b6efc7e 2024-03-12T17:06:49.311 INFO:teuthology.orchestra.run.smithi017.stdout:fi 2024-03-12T17:06:49.311 DEBUG:teuthology.orchestra.run.smithi017:> sudo rpm -qi grub2-tools 2024-03-12T17:06:49.389 INFO:teuthology.orchestra.run.smithi017.stdout:Name : grub2-tools 2024-03-12T17:06:49.389 INFO:teuthology.orchestra.run.smithi017.stdout:Epoch : 1 2024-03-12T17:06:49.389 INFO:teuthology.orchestra.run.smithi017.stdout:Version : 2.06 2024-03-12T17:06:49.389 INFO:teuthology.orchestra.run.smithi017.stdout:Release : 68.el9 2024-03-12T17:06:49.389 INFO:teuthology.orchestra.run.smithi017.stdout:Architecture: x86_64 2024-03-12T17:06:49.389 INFO:teuthology.orchestra.run.smithi017.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-12T17:06:49.389 INFO:teuthology.orchestra.run.smithi017.stdout:Group : Unspecified 2024-03-12T17:06:49.389 INFO:teuthology.orchestra.run.smithi017.stdout:Size : 8264254 2024-03-12T17:06:49.389 INFO:teuthology.orchestra.run.smithi017.stdout:License : GPLv3+ 2024-03-12T17:06:49.389 INFO:teuthology.orchestra.run.smithi017.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-12T17:06:49.389 INFO:teuthology.orchestra.run.smithi017.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-12T17:06:49.389 INFO:teuthology.orchestra.run.smithi017.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-12T17:06:49.390 INFO:teuthology.orchestra.run.smithi017.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-12T17:06:49.390 INFO:teuthology.orchestra.run.smithi017.stdout:Packager : builder@centos.org 2024-03-12T17:06:49.390 INFO:teuthology.orchestra.run.smithi017.stdout:Vendor : CentOS 2024-03-12T17:06:49.390 INFO:teuthology.orchestra.run.smithi017.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-12T17:06:49.390 INFO:teuthology.orchestra.run.smithi017.stdout:Summary : Support tools for GRUB. 2024-03-12T17:06:49.390 INFO:teuthology.orchestra.run.smithi017.stdout:Description : 2024-03-12T17:06:49.390 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:06:49.390 INFO:teuthology.orchestra.run.smithi017.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-12T17:06:49.390 INFO:teuthology.orchestra.run.smithi017.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-12T17:06:49.390 INFO:teuthology.orchestra.run.smithi017.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-12T17:06:49.391 INFO:teuthology.orchestra.run.smithi017.stdout:hardware devices. 2024-03-12T17:06:49.391 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:06:49.391 INFO:teuthology.orchestra.run.smithi017.stdout:This subpackage provides tools for support of all platforms. 2024-03-12T17:06:49.391 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-12T17:06:49.391 INFO:teuthology.task.kernel:Updating grub on smithi017 to boot 6.8.0-rc7-gbf761b6efc7e 2024-03-12T17:06:49.392 DEBUG:teuthology.orchestra.run.smithi017:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-12T17:06:50.041 INFO:teuthology.orchestra.run.smithi017.stderr:Generating grub configuration file ... 2024-03-12T17:06:51.546 INFO:teuthology.orchestra.run.smithi017.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-12T17:06:51.570 INFO:teuthology.orchestra.run.smithi017.stderr:done 2024-03-12T17:06:51.576 DEBUG:teuthology.orchestra.run.smithi017:> mktemp 2024-03-12T17:06:51.591 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.wyAFUvRau7 2024-03-12T17:06:51.592 DEBUG:teuthology.orchestra.run.smithi017:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.wyAFUvRau7 2024-03-12T17:06:51.664 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.wyAFUvRau7 2024-03-12T17:06:51.809 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.wyAFUvRau7 is 6KB 2024-03-12T17:06:51.858 DEBUG:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.wyAFUvRau7 2024-03-12T17:06:51.873 DEBUG:teuthology.orchestra.run.smithi017:> sudo /bin/ls /boot/loader/entries || true 2024-03-12T17:06:51.941 INFO:teuthology.orchestra.run.smithi017.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-12T17:06:51.941 INFO:teuthology.orchestra.run.smithi017.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-12T17:06:51.942 INFO:teuthology.orchestra.run.smithi017.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-12T17:06:51.942 INFO:teuthology.orchestra.run.smithi017.stdout:15949e3c88704300882482eddfd7baae-6.8.0-rc7-gbf761b6efc7e.conf 2024-03-12T17:06:51.943 DEBUG:teuthology.orchestra.run.smithi017:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-rc7-gbf761b6efc7e 2024-03-12T17:06:52.092 DEBUG:teuthology.orchestra.run.smithi017:> sudo shutdown -r now 2024-03-12T17:06:54.890 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-03-12T17:06:54.891 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-03-12T17:06:54.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T17:07:22.123 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-03-12T17:07:22.123 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-03-12T17:07:22.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T17:07:54.925 DEBUG:teuthology.orchestra.remote:timed out 2024-03-12T17:08:03.934 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-03-12T17:08:03.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T17:08:04.444 DEBUG:teuthology.orchestra.run.smithi094:> true 2024-03-12T17:08:05.124 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-03-12T17:08:05.124 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.8.0-rc7-gbf761b6efc7e"... 2024-03-12T17:08:05.124 DEBUG:teuthology.orchestra.run.smithi094:> uname -r 2024-03-12T17:08:05.160 INFO:teuthology.orchestra.run.smithi094.stdout:6.8.0-rc7-gbf761b6efc7e 2024-03-12T17:08:05.160 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-rc7-gbf761b6efc7e vs 6.8.0-rc7-gbf761b6efc7e 2024-03-12T17:08:05.160 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-12T17:08:05.160 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-12T17:08:06.164 DEBUG:teuthology.parallel:result is None 2024-03-12T17:08:22.127 DEBUG:teuthology.orchestra.remote:timed out 2024-03-12T17:08:31.128 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-03-12T17:08:31.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T17:08:32.564 DEBUG:teuthology.orchestra.run.smithi017:> true 2024-03-12T17:08:33.261 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-03-12T17:08:33.261 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.8.0-rc7-gbf761b6efc7e"... 2024-03-12T17:08:33.261 DEBUG:teuthology.orchestra.run.smithi017:> uname -r 2024-03-12T17:08:33.300 INFO:teuthology.orchestra.run.smithi017.stdout:6.8.0-rc7-gbf761b6efc7e 2024-03-12T17:08:33.300 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-rc7-gbf761b6efc7e vs 6.8.0-rc7-gbf761b6efc7e 2024-03-12T17:08:33.300 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-12T17:08:33.300 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-12T17:08:34.304 DEBUG:teuthology.parallel:result is None 2024-03-12T17:08:34.304 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-12T17:08:34.311 INFO:teuthology.task.internal:Creating test directory... 2024-03-12T17:08:34.311 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-12T17:08:34.316 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-12T17:08:34.374 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-12T17:08:34.381 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-12T17:08:34.409 INFO:teuthology.task.internal:Creating archive directory... 2024-03-12T17:08:34.409 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-12T17:08:34.413 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-12T17:08:34.489 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-12T17:08:34.496 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-12T17:08:34.496 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-12T17:08:34.502 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-12T17:08:34.658 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-12T17:08:34.686 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-12T17:08:34.724 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-12T17:08:34.929 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-12T17:08:34.935 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-12T17:08:34.943 INFO:teuthology.task.internal:Configuring sudo... 2024-03-12T17:08:34.943 DEBUG:teuthology.orchestra.run.smithi017:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-12T17:08:34.948 DEBUG:teuthology.orchestra.run.smithi094:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-12T17:08:35.049 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-12T17:08:35.059 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-12T17:08:35.059 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-12T17:08:35.064 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-12T17:08:35.117 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-12T17:08:35.209 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-12T17:08:35.407 DEBUG:teuthology.orchestra.run.smithi017:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-12T17:08:35.481 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-12T17:08:35.558 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:08:35.558 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-12T17:08:35.636 DEBUG:teuthology.orchestra.run.smithi094:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-12T17:08:35.724 DEBUG:teuthology.orchestra.run.smithi094:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-12T17:08:35.834 DEBUG:teuthology.orchestra.run.smithi094:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-12T17:08:35.915 DEBUG:teuthology.orchestra.run.smithi094:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-12T17:08:36.013 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-12T17:08:36.014 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-12T17:08:36.111 DEBUG:teuthology.orchestra.run.smithi017:> sudo service rsyslog restart 2024-03-12T17:08:36.116 DEBUG:teuthology.orchestra.run.smithi094:> sudo service rsyslog restart 2024-03-12T17:08:36.229 INFO:teuthology.orchestra.run.smithi017.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-12T17:08:36.278 INFO:teuthology.orchestra.run.smithi094.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-12T17:08:36.499 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-12T17:08:36.507 INFO:teuthology.task.internal:Starting timer... 2024-03-12T17:08:36.507 INFO:teuthology.run_tasks:Running task pcp... 2024-03-12T17:08:36.581 INFO:teuthology.run_tasks:Running task selinux... 2024-03-12T17:08:36.835 DEBUG:teuthology.orchestra.run.smithi017:> sudo service auditd rotate 2024-03-12T17:08:36.959 INFO:teuthology.orchestra.run.smithi017.stdout:Rotating logs: 2024-03-12T17:08:36.963 DEBUG:teuthology.orchestra.run.smithi094:> sudo service auditd rotate 2024-03-12T17:08:37.083 INFO:teuthology.orchestra.run.smithi094.stdout:Rotating logs: 2024-03-12T17:08:37.087 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-12T17:08:37.087 DEBUG:teuthology.orchestra.run.smithi017:> /usr/sbin/getenforce 2024-03-12T17:08:37.142 INFO:teuthology.orchestra.run.smithi017.stdout:Permissive 2024-03-12T17:08:37.142 DEBUG:teuthology.orchestra.run.smithi094:> /usr/sbin/getenforce 2024-03-12T17:08:37.183 INFO:teuthology.orchestra.run.smithi094.stdout:Permissive 2024-03-12T17:08:37.184 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi017.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi094.front.sepia.ceph.com': 'permissive'} 2024-03-12T17:08:37.184 DEBUG:teuthology.orchestra.run.smithi017:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-12T17:08:37.261 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-12T17:08:37.262 DEBUG:teuthology.orchestra.run.smithi094:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-12T17:08:37.347 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-12T17:08:37.347 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-12T17:08:37.347 DEBUG:teuthology.orchestra.run.smithi017:> sudo /usr/sbin/setenforce permissive 2024-03-12T17:08:37.456 DEBUG:teuthology.orchestra.run.smithi094:> sudo /usr/sbin/setenforce permissive 2024-03-12T17:08:37.546 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-12T17:08:37.557 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-12T17:08:37.575 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-12T17:08:37.577 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi017.front.sepia.ceph.com,smithi094.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-12T17:14:45.658 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi017.front.sepia.ceph.com'), Remote(name='ubuntu@smithi094.front.sepia.ceph.com')] 2024-03-12T17:14:45.659 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-03-12T17:14:45.660 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi017.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T17:14:45.815 DEBUG:teuthology.orchestra.run.smithi017:> true 2024-03-12T17:14:45.972 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi017.front.sepia.ceph.com' 2024-03-12T17:14:45.973 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-03-12T17:14:45.973 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi094.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T17:14:46.125 DEBUG:teuthology.orchestra.run.smithi094:> true 2024-03-12T17:14:46.275 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi094.front.sepia.ceph.com' 2024-03-12T17:14:46.275 INFO:teuthology.run_tasks:Running task clock... 2024-03-12T17:14:46.290 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-12T17:14:46.290 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-12T17:14:46.291 DEBUG:teuthology.orchestra.run.smithi017:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-12T17:14:46.298 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-12T17:14:46.298 DEBUG:teuthology.orchestra.run.smithi094:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-12T17:14:46.400 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-12T17:14:46.402 INFO:teuthology.orchestra.run.smithi094.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-12T17:14:46.454 INFO:teuthology.orchestra.run.smithi094.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-12T17:14:46.458 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-12T17:14:46.547 INFO:teuthology.orchestra.run.smithi094.stderr:sudo: ntpd: command not found 2024-03-12T17:14:46.555 INFO:teuthology.orchestra.run.smithi017.stderr:sudo: ntpd: command not found 2024-03-12T17:14:46.590 INFO:teuthology.orchestra.run.smithi094.stdout:506 Cannot talk to daemon 2024-03-12T17:14:46.601 INFO:teuthology.orchestra.run.smithi017.stdout:506 Cannot talk to daemon 2024-03-12T17:14:46.642 INFO:teuthology.orchestra.run.smithi094.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-12T17:14:46.659 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-12T17:14:46.697 INFO:teuthology.orchestra.run.smithi094.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-12T17:14:46.716 INFO:teuthology.orchestra.run.smithi017.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-12T17:14:46.824 INFO:teuthology.orchestra.run.smithi094.stderr:bash: line 1: ntpq: command not found 2024-03-12T17:14:46.833 INFO:teuthology.orchestra.run.smithi094.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-12T17:14:46.834 INFO:teuthology.orchestra.run.smithi094.stdout:=============================================================================== 2024-03-12T17:14:46.834 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-12T17:14:46.834 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-12T17:14:46.834 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-12T17:14:46.834 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-12T17:14:46.860 INFO:teuthology.orchestra.run.smithi017.stderr:bash: line 1: ntpq: command not found 2024-03-12T17:14:46.871 INFO:teuthology.orchestra.run.smithi017.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-12T17:14:46.871 INFO:teuthology.orchestra.run.smithi017.stdout:=============================================================================== 2024-03-12T17:14:46.871 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-12T17:14:46.871 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-12T17:14:46.871 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-12T17:14:46.871 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-12T17:14:46.873 INFO:teuthology.run_tasks:Running task install... 2024-03-12T17:14:46.882 DEBUG:teuthology.task.install:project ceph 2024-03-12T17:14:46.883 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '49e4a6794d5502bd66908faf714fc54896c51712'}} 2024-03-12T17:14:46.883 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '49e4a6794d5502bd66908faf714fc54896c51712'} 2024-03-12T17:14:46.883 INFO:teuthology.task.install:Using flavor: default 2024-03-12T17:14:46.889 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-12T17:14:46.889 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-03-12T17:14:46.889 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '49e4a6794d5502bd66908faf714fc54896c51712', 'tag': None, 'wait_for_package': False} 2024-03-12T17:14:46.890 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=49e4a6794d5502bd66908faf714fc54896c51712 2024-03-12T17:14:46.893 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '49e4a6794d5502bd66908faf714fc54896c51712', 'tag': None, 'wait_for_package': False} 2024-03-12T17:14:46.893 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=49e4a6794d5502bd66908faf714fc54896c51712 2024-03-12T17:14:47.036 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri11-testing-2024-03-11-0838-reef/49e4a6794d5502bd66908faf714fc54896c51712/centos/9/flavors/default/ 2024-03-12T17:14:47.036 INFO:teuthology.task.install.rpm:Package version is 18.2.2-797.g49e4a679 2024-03-12T17:14:47.044 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-yuri11-testing-2024-03-11-0838-reef/49e4a6794d5502bd66908faf714fc54896c51712/centos/9/flavors/default/ 2024-03-12T17:14:47.044 INFO:teuthology.task.install.rpm:Package version is 18.2.2-797.g49e4a679 2024-03-12T17:14:47.375 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri11-testing-2024-03-11-0838-reef/49e4a6794d5502bd66908faf714fc54896c51712/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri11-testing-2024-03-11-0838-reef/49e4a6794d5502bd66908faf714fc54896c51712/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri11-testing-2024-03-11-0838-reef/49e4a6794d5502bd66908faf714fc54896c51712/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-12T17:14:47.375 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-12T17:14:47.375 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-12T17:14:47.378 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri11-testing-2024-03-11-0838-reef/49e4a6794d5502bd66908faf714fc54896c51712/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri11-testing-2024-03-11-0838-reef/49e4a6794d5502bd66908faf714fc54896c51712/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-yuri11-testing-2024-03-11-0838-reef/49e4a6794d5502bd66908faf714fc54896c51712/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-12T17:14:47.378 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:14:47.378 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-12T17:14:47.479 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-12T17:14:47.479 DEBUG:teuthology.orchestra.run.smithi094:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/49e4a6794d5502bd66908faf714fc54896c51712/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-12T17:14:47.487 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-12T17:14:47.487 DEBUG:teuthology.orchestra.run.smithi017:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/49e4a6794d5502bd66908faf714fc54896c51712/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-12T17:14:47.613 DEBUG:teuthology.orchestra.run.smithi094:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-12T17:14:47.627 DEBUG:teuthology.orchestra.run.smithi017:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-12T17:14:47.742 DEBUG:teuthology.orchestra.run.smithi094:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-12T17:14:47.759 DEBUG:teuthology.orchestra.run.smithi017:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-12T17:14:47.836 INFO:teuthology.orchestra.run.smithi094.stdout:check_obsoletes = 1 2024-03-12T17:14:47.841 DEBUG:teuthology.orchestra.run.smithi094:> sudo yum clean all 2024-03-12T17:14:47.854 INFO:teuthology.orchestra.run.smithi017.stdout:check_obsoletes = 1 2024-03-12T17:14:47.858 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum clean all 2024-03-12T17:14:48.182 INFO:teuthology.orchestra.run.smithi094.stdout:74 files removed 2024-03-12T17:14:48.221 DEBUG:teuthology.orchestra.run.smithi094:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-12T17:14:48.230 INFO:teuthology.orchestra.run.smithi017.stdout:74 files removed 2024-03-12T17:14:48.270 DEBUG:teuthology.orchestra.run.smithi017:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-12T17:14:49.341 INFO:teuthology.orchestra.run.smithi017.stdout:ceph packages for x86_64 138 kB/s | 77 kB 00:00 2024-03-12T17:14:49.558 INFO:teuthology.orchestra.run.smithi094.stdout:ceph packages for x86_64 92 kB/s | 77 kB 00:00 2024-03-12T17:14:49.813 INFO:teuthology.orchestra.run.smithi017.stdout:ceph noarch packages 26 kB/s | 9.9 kB 00:00 2024-03-12T17:14:50.150 INFO:teuthology.orchestra.run.smithi094.stdout:ceph noarch packages 20 kB/s | 9.9 kB 00:00 2024-03-12T17:14:50.247 INFO:teuthology.orchestra.run.smithi017.stdout:ceph source packages 5.2 kB/s | 1.9 kB 00:00 2024-03-12T17:14:50.609 INFO:teuthology.orchestra.run.smithi094.stdout:ceph source packages 4.9 kB/s | 1.9 kB 00:00 2024-03-12T17:14:51.668 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS-9 - AppStream 5.0 MB/s | 6.7 MB 00:01 2024-03-12T17:14:51.737 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS-9 - AppStream 6.3 MB/s | 6.7 MB 00:01 2024-03-12T17:14:53.827 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS-9 - BaseOS 2.4 MB/s | 2.0 MB 00:00 2024-03-12T17:14:53.913 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS-9 - BaseOS 2.2 MB/s | 2.0 MB 00:00 2024-03-12T17:15:00.908 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - BaseOS 1.2 MB/s | 8.0 MB 00:06 2024-03-12T17:15:03.362 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - BaseOS 907 kB/s | 8.0 MB 00:09 2024-03-12T17:15:13.509 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - AppStream 2.1 MB/s | 19 MB 00:08 2024-03-12T17:15:20.320 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - AppStream 1.0 MB/s | 19 MB 00:18 2024-03-12T17:15:28.681 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - CRB 1.5 MB/s | 6.1 MB 00:04 2024-03-12T17:15:30.254 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - CRB 485 kB/s | 6.1 MB 00:12 2024-03-12T17:15:30.598 INFO:teuthology.orchestra.run.smithi017.stdout:CentOS Stream 9 - Extras packages 30 kB/s | 15 kB 00:00 2024-03-12T17:15:32.352 INFO:teuthology.orchestra.run.smithi094.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 15 kB 00:00 2024-03-12T17:15:34.932 INFO:teuthology.orchestra.run.smithi094.stdout:Extra Packages for Enterprise Linux 8.6 MB/s | 21 MB 00:02 2024-03-12T17:15:35.884 INFO:teuthology.orchestra.run.smithi017.stdout:Extra Packages for Enterprise Linux 4.0 MB/s | 21 MB 00:05 2024-03-12T17:15:40.698 INFO:teuthology.orchestra.run.smithi094.stdout:lab-extras 43 kB/s | 1.7 kB 00:00 2024-03-12T17:15:41.817 INFO:teuthology.orchestra.run.smithi017.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-03-12T17:15:43.400 INFO:teuthology.orchestra.run.smithi094.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-12T17:15:43.402 INFO:teuthology.orchestra.run.smithi094.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-12T17:15:43.424 INFO:teuthology.orchestra.run.smithi094.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-12T17:15:43.425 INFO:teuthology.orchestra.run.smithi094.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-12T17:15:43.426 INFO:teuthology.orchestra.run.smithi094.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-12T17:15:43.428 INFO:teuthology.orchestra.run.smithi094.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-12T17:15:43.431 INFO:teuthology.orchestra.run.smithi094.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-12T17:15:43.434 INFO:teuthology.orchestra.run.smithi094.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-12T17:15:43.436 INFO:teuthology.orchestra.run.smithi094.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-12T17:15:43.521 INFO:teuthology.orchestra.run.smithi094.stdout:Dependencies resolved. 2024-03-12T17:15:43.535 INFO:teuthology.orchestra.run.smithi094.stdout:=========================================================================================== 2024-03-12T17:15:43.535 INFO:teuthology.orchestra.run.smithi094.stdout: Package Arch Version Repository Size 2024-03-12T17:15:43.535 INFO:teuthology.orchestra.run.smithi094.stdout:=========================================================================================== 2024-03-12T17:15:43.536 INFO:teuthology.orchestra.run.smithi094.stdout:Installing: 2024-03-12T17:15:43.536 INFO:teuthology.orchestra.run.smithi094.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-12T17:15:43.536 INFO:teuthology.orchestra.run.smithi094.stdout: ceph x86_64 2:18.2.2-797.g49e4a679.el9 ceph 6.5 k 2024-03-12T17:15:43.536 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-base x86_64 2:18.2.2-797.g49e4a679.el9 ceph 5.2 M 2024-03-12T17:15:43.536 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-fuse x86_64 2:18.2.2-797.g49e4a679.el9 ceph 844 k 2024-03-12T17:15:43.536 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-797.g49e4a679.el9 ceph 143 k 2024-03-12T17:15:43.536 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr x86_64 2:18.2.2-797.g49e4a679.el9 ceph 1.4 M 2024-03-12T17:15:43.536 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-cephadm noarch 2:18.2.2-797.g49e4a679.el9 ceph-noarch 137 k 2024-03-12T17:15:43.536 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-dashboard noarch 2:18.2.2-797.g49e4a679.el9 ceph-noarch 1.7 M 2024-03-12T17:15:43.536 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-797.g49e4a679.el9 ceph-noarch 7.4 M 2024-03-12T17:15:43.536 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-rook noarch 2:18.2.2-797.g49e4a679.el9 ceph-noarch 49 k 2024-03-12T17:15:43.536 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-radosgw x86_64 2:18.2.2-797.g49e4a679.el9 ceph 7.7 M 2024-03-12T17:15:43.537 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-test x86_64 2:18.2.2-797.g49e4a679.el9 ceph 40 M 2024-03-12T17:15:43.537 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-volume noarch 2:18.2.2-797.g49e4a679.el9 ceph-noarch 264 k 2024-03-12T17:15:43.537 INFO:teuthology.orchestra.run.smithi094.stdout: cephadm noarch 2:18.2.2-797.g49e4a679.el9 ceph-noarch 223 k 2024-03-12T17:15:43.537 INFO:teuthology.orchestra.run.smithi094.stdout: cephfs-mirror x86_64 2:18.2.2-797.g49e4a679.el9 ceph 221 k 2024-03-12T17:15:43.537 INFO:teuthology.orchestra.run.smithi094.stdout: cephfs-top noarch 2:18.2.2-797.g49e4a679.el9 ceph-noarch 18 k 2024-03-12T17:15:43.537 INFO:teuthology.orchestra.run.smithi094.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-12T17:15:43.537 INFO:teuthology.orchestra.run.smithi094.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-12T17:15:43.537 INFO:teuthology.orchestra.run.smithi094.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-12T17:15:43.537 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs-devel x86_64 2:18.2.2-797.g49e4a679.el9 ceph 31 k 2024-03-12T17:15:43.537 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs2 x86_64 2:18.2.2-797.g49e4a679.el9 ceph 702 k 2024-03-12T17:15:43.537 INFO:teuthology.orchestra.run.smithi094.stdout: librados-devel x86_64 2:18.2.2-797.g49e4a679.el9 ceph 127 k 2024-03-12T17:15:43.537 INFO:teuthology.orchestra.run.smithi094.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-12T17:15:43.537 INFO:teuthology.orchestra.run.smithi094.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-12T17:15:43.538 INFO:teuthology.orchestra.run.smithi094.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-12T17:15:43.538 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-12T17:15:43.538 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-12T17:15:43.538 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-12T17:15:43.538 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cephfs x86_64 2:18.2.2-797.g49e4a679.el9 ceph 161 k 2024-03-12T17:15:43.538 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rados x86_64 2:18.2.2-797.g49e4a679.el9 ceph 321 k 2024-03-12T17:15:43.538 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rbd x86_64 2:18.2.2-797.g49e4a679.el9 ceph 298 k 2024-03-12T17:15:43.538 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rgw x86_64 2:18.2.2-797.g49e4a679.el9 ceph 99 k 2024-03-12T17:15:43.538 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-fuse x86_64 2:18.2.2-797.g49e4a679.el9 ceph 87 k 2024-03-12T17:15:43.538 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-mirror x86_64 2:18.2.2-797.g49e4a679.el9 ceph 3.0 M 2024-03-12T17:15:43.538 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-nbd x86_64 2:18.2.2-797.g49e4a679.el9 ceph 172 k 2024-03-12T17:15:43.538 INFO:teuthology.orchestra.run.smithi094.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-12T17:15:43.538 INFO:teuthology.orchestra.run.smithi094.stdout:Upgrading: 2024-03-12T17:15:43.539 INFO:teuthology.orchestra.run.smithi094.stdout: NetworkManager x86_64 1:1.46.0-1.el9 baseos 2.3 M 2024-03-12T17:15:43.539 INFO:teuthology.orchestra.run.smithi094.stdout: NetworkManager-libnm x86_64 1:1.46.0-1.el9 baseos 1.8 M 2024-03-12T17:15:43.539 INFO:teuthology.orchestra.run.smithi094.stdout: NetworkManager-team x86_64 1:1.46.0-1.el9 baseos 42 k 2024-03-12T17:15:43.539 INFO:teuthology.orchestra.run.smithi094.stdout: NetworkManager-tui x86_64 1:1.46.0-1.el9 baseos 248 k 2024-03-12T17:15:43.539 INFO:teuthology.orchestra.run.smithi094.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-12T17:15:43.539 INFO:teuthology.orchestra.run.smithi094.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-12T17:15:43.539 INFO:teuthology.orchestra.run.smithi094.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-12T17:15:43.539 INFO:teuthology.orchestra.run.smithi094.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-12T17:15:43.539 INFO:teuthology.orchestra.run.smithi094.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-12T17:15:43.539 INFO:teuthology.orchestra.run.smithi094.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-12T17:15:43.539 INFO:teuthology.orchestra.run.smithi094.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-12T17:15:43.539 INFO:teuthology.orchestra.run.smithi094.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-12T17:15:43.539 INFO:teuthology.orchestra.run.smithi094.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-12T17:15:43.540 INFO:teuthology.orchestra.run.smithi094.stdout: librados2 x86_64 2:18.2.2-797.g49e4a679.el9 ceph 3.3 M 2024-03-12T17:15:43.540 INFO:teuthology.orchestra.run.smithi094.stdout: librbd1 x86_64 2:18.2.2-797.g49e4a679.el9 ceph 3.0 M 2024-03-12T17:15:43.540 INFO:teuthology.orchestra.run.smithi094.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-12T17:15:43.540 INFO:teuthology.orchestra.run.smithi094.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-12T17:15:43.540 INFO:teuthology.orchestra.run.smithi094.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-12T17:15:43.540 INFO:teuthology.orchestra.run.smithi094.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-12T17:15:43.540 INFO:teuthology.orchestra.run.smithi094.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-12T17:15:43.540 INFO:teuthology.orchestra.run.smithi094.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-12T17:15:43.540 INFO:teuthology.orchestra.run.smithi094.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-12T17:15:43.540 INFO:teuthology.orchestra.run.smithi094.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-12T17:15:43.540 INFO:teuthology.orchestra.run.smithi094.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-12T17:15:43.540 INFO:teuthology.orchestra.run.smithi094.stdout:Installing dependencies: 2024-03-12T17:15:43.540 INFO:teuthology.orchestra.run.smithi094.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-12T17:15:43.540 INFO:teuthology.orchestra.run.smithi094.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-12T17:15:43.541 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-common x86_64 2:18.2.2-797.g49e4a679.el9 ceph 18 M 2024-03-12T17:15:43.541 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-grafana-dashboards noarch 2:18.2.2-797.g49e4a679.el9 ceph-noarch 23 k 2024-03-12T17:15:43.541 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mds x86_64 2:18.2.2-797.g49e4a679.el9 ceph 2.1 M 2024-03-12T17:15:43.541 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-modules-core noarch 2:18.2.2-797.g49e4a679.el9 ceph-noarch 245 k 2024-03-12T17:15:43.541 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mon x86_64 2:18.2.2-797.g49e4a679.el9 ceph 4.4 M 2024-03-12T17:15:43.541 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-osd x86_64 2:18.2.2-797.g49e4a679.el9 ceph 18 M 2024-03-12T17:15:43.541 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-prometheus-alerts noarch 2:18.2.2-797.g49e4a679.el9 ceph-noarch 15 k 2024-03-12T17:15:43.541 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-selinux x86_64 2:18.2.2-797.g49e4a679.el9 ceph 25 k 2024-03-12T17:15:43.541 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-12T17:15:43.541 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-12T17:15:43.541 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-12T17:15:43.541 INFO:teuthology.orchestra.run.smithi094.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-03-12T17:15:43.541 INFO:teuthology.orchestra.run.smithi094.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-12T17:15:43.541 INFO:teuthology.orchestra.run.smithi094.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-12T17:15:43.541 INFO:teuthology.orchestra.run.smithi094.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-12T17:15:43.542 INFO:teuthology.orchestra.run.smithi094.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-12T17:15:43.542 INFO:teuthology.orchestra.run.smithi094.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-12T17:15:43.542 INFO:teuthology.orchestra.run.smithi094.stdout: libcephsqlite x86_64 2:18.2.2-797.g49e4a679.el9 ceph 166 k 2024-03-12T17:15:43.542 INFO:teuthology.orchestra.run.smithi094.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-12T17:15:43.542 INFO:teuthology.orchestra.run.smithi094.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-12T17:15:43.542 INFO:teuthology.orchestra.run.smithi094.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-12T17:15:43.542 INFO:teuthology.orchestra.run.smithi094.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-12T17:15:43.542 INFO:teuthology.orchestra.run.smithi094.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-12T17:15:43.542 INFO:teuthology.orchestra.run.smithi094.stdout: libradosstriper1 x86_64 2:18.2.2-797.g49e4a679.el9 ceph 475 k 2024-03-12T17:15:43.542 INFO:teuthology.orchestra.run.smithi094.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-12T17:15:43.542 INFO:teuthology.orchestra.run.smithi094.stdout: librgw2 x86_64 2:18.2.2-797.g49e4a679.el9 ceph 4.5 M 2024-03-12T17:15:43.542 INFO:teuthology.orchestra.run.smithi094.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-12T17:15:43.542 INFO:teuthology.orchestra.run.smithi094.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-12T17:15:43.543 INFO:teuthology.orchestra.run.smithi094.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-12T17:15:43.543 INFO:teuthology.orchestra.run.smithi094.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-12T17:15:43.543 INFO:teuthology.orchestra.run.smithi094.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-12T17:15:43.543 INFO:teuthology.orchestra.run.smithi094.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-12T17:15:43.543 INFO:teuthology.orchestra.run.smithi094.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-12T17:15:43.543 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-12T17:15:43.543 INFO:teuthology.orchestra.run.smithi094.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-12T17:15:43.543 INFO:teuthology.orchestra.run.smithi094.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-12T17:15:43.543 INFO:teuthology.orchestra.run.smithi094.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-12T17:15:43.543 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-12T17:15:43.543 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-argparse x86_64 2:18.2.2-797.g49e4a679.el9 ceph 45 k 2024-03-12T17:15:43.543 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-common x86_64 2:18.2.2-797.g49e4a679.el9 ceph 126 k 2024-03-12T17:15:43.543 INFO:teuthology.orchestra.run.smithi094.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-12T17:15:43.543 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-12T17:15:43.543 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-12T17:15:43.544 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-12T17:15:43.544 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-12T17:15:43.544 INFO:teuthology.orchestra.run.smithi094.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-12T17:15:43.544 INFO:teuthology.orchestra.run.smithi094.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-12T17:15:43.544 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-12T17:15:43.544 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-12T17:15:43.544 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-12T17:15:43.544 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-12T17:15:43.544 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-12T17:15:43.544 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-12T17:15:43.544 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-12T17:15:43.544 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-12T17:15:43.544 INFO:teuthology.orchestra.run.smithi094.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-12T17:15:43.544 INFO:teuthology.orchestra.run.smithi094.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-12T17:15:43.544 INFO:teuthology.orchestra.run.smithi094.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-12T17:15:43.545 INFO:teuthology.orchestra.run.smithi094.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-12T17:15:43.545 INFO:teuthology.orchestra.run.smithi094.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-12T17:15:43.545 INFO:teuthology.orchestra.run.smithi094.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-12T17:15:43.545 INFO:teuthology.orchestra.run.smithi094.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-12T17:15:43.545 INFO:teuthology.orchestra.run.smithi094.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-12T17:15:43.545 INFO:teuthology.orchestra.run.smithi094.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-12T17:15:43.545 INFO:teuthology.orchestra.run.smithi094.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-12T17:15:43.545 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-12T17:15:43.545 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-12T17:15:43.545 INFO:teuthology.orchestra.run.smithi094.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-12T17:15:43.545 INFO:teuthology.orchestra.run.smithi094.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-12T17:15:43.545 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-12T17:15:43.545 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-12T17:15:43.545 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-12T17:15:43.545 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-12T17:15:43.546 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-12T17:15:43.546 INFO:teuthology.orchestra.run.smithi094.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-12T17:15:43.546 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-12T17:15:43.546 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-12T17:15:43.546 INFO:teuthology.orchestra.run.smithi094.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-12T17:15:43.546 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-12T17:15:43.546 INFO:teuthology.orchestra.run.smithi094.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-12T17:15:43.546 INFO:teuthology.orchestra.run.smithi094.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-12T17:15:43.546 INFO:teuthology.orchestra.run.smithi094.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-12T17:15:43.546 INFO:teuthology.orchestra.run.smithi094.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-12T17:15:43.546 INFO:teuthology.orchestra.run.smithi094.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-12T17:15:43.546 INFO:teuthology.orchestra.run.smithi094.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-12T17:15:43.546 INFO:teuthology.orchestra.run.smithi094.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-12T17:15:43.547 INFO:teuthology.orchestra.run.smithi094.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-12T17:15:43.547 INFO:teuthology.orchestra.run.smithi094.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-12T17:15:43.547 INFO:teuthology.orchestra.run.smithi094.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-12T17:15:43.547 INFO:teuthology.orchestra.run.smithi094.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-12T17:15:43.547 INFO:teuthology.orchestra.run.smithi094.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-12T17:15:43.547 INFO:teuthology.orchestra.run.smithi094.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-12T17:15:43.547 INFO:teuthology.orchestra.run.smithi094.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-12T17:15:43.547 INFO:teuthology.orchestra.run.smithi094.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-12T17:15:43.547 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:15:43.547 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction Summary 2024-03-12T17:15:43.547 INFO:teuthology.orchestra.run.smithi094.stdout:=========================================================================================== 2024-03-12T17:15:43.547 INFO:teuthology.orchestra.run.smithi094.stdout:Install 132 Packages 2024-03-12T17:15:43.547 INFO:teuthology.orchestra.run.smithi094.stdout:Upgrade 24 Packages 2024-03-12T17:15:43.548 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:15:43.548 INFO:teuthology.orchestra.run.smithi094.stdout:Total download size: 204 M 2024-03-12T17:15:43.548 INFO:teuthology.orchestra.run.smithi094.stdout:Downloading Packages: 2024-03-12T17:15:44.614 INFO:teuthology.orchestra.run.smithi017.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-12T17:15:44.616 INFO:teuthology.orchestra.run.smithi017.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-12T17:15:44.637 INFO:teuthology.orchestra.run.smithi017.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-12T17:15:44.639 INFO:teuthology.orchestra.run.smithi017.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-12T17:15:44.640 INFO:teuthology.orchestra.run.smithi017.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-12T17:15:44.642 INFO:teuthology.orchestra.run.smithi017.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-12T17:15:44.644 INFO:teuthology.orchestra.run.smithi017.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-12T17:15:44.648 INFO:teuthology.orchestra.run.smithi017.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-12T17:15:44.650 INFO:teuthology.orchestra.run.smithi017.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-12T17:15:44.700 INFO:teuthology.orchestra.run.smithi094.stdout:(1/156): ceph-18.2.2-797.g49e4a679.el9.x86_64.r 14 kB/s | 6.5 kB 00:00 2024-03-12T17:15:44.741 INFO:teuthology.orchestra.run.smithi017.stdout:Dependencies resolved. 2024-03-12T17:15:44.771 INFO:teuthology.orchestra.run.smithi017.stdout:=========================================================================================== 2024-03-12T17:15:44.771 INFO:teuthology.orchestra.run.smithi017.stdout: Package Arch Version Repository Size 2024-03-12T17:15:44.771 INFO:teuthology.orchestra.run.smithi017.stdout:=========================================================================================== 2024-03-12T17:15:44.771 INFO:teuthology.orchestra.run.smithi017.stdout:Installing: 2024-03-12T17:15:44.771 INFO:teuthology.orchestra.run.smithi017.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-12T17:15:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: ceph x86_64 2:18.2.2-797.g49e4a679.el9 ceph 6.5 k 2024-03-12T17:15:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base x86_64 2:18.2.2-797.g49e4a679.el9 ceph 5.2 M 2024-03-12T17:15:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse x86_64 2:18.2.2-797.g49e4a679.el9 ceph 844 k 2024-03-12T17:15:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache x86_64 2:18.2.2-797.g49e4a679.el9 ceph 143 k 2024-03-12T17:15:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr x86_64 2:18.2.2-797.g49e4a679.el9 ceph 1.4 M 2024-03-12T17:15:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-cephadm noarch 2:18.2.2-797.g49e4a679.el9 ceph-noarch 137 k 2024-03-12T17:15:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard noarch 2:18.2.2-797.g49e4a679.el9 ceph-noarch 1.7 M 2024-03-12T17:15:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.2-797.g49e4a679.el9 ceph-noarch 7.4 M 2024-03-12T17:15:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-rook noarch 2:18.2.2-797.g49e4a679.el9 ceph-noarch 49 k 2024-03-12T17:15:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw x86_64 2:18.2.2-797.g49e4a679.el9 ceph 7.7 M 2024-03-12T17:15:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test x86_64 2:18.2.2-797.g49e4a679.el9 ceph 40 M 2024-03-12T17:15:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-volume noarch 2:18.2.2-797.g49e4a679.el9 ceph-noarch 264 k 2024-03-12T17:15:44.772 INFO:teuthology.orchestra.run.smithi017.stdout: cephadm noarch 2:18.2.2-797.g49e4a679.el9 ceph-noarch 223 k 2024-03-12T17:15:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-mirror x86_64 2:18.2.2-797.g49e4a679.el9 ceph 221 k 2024-03-12T17:15:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-top noarch 2:18.2.2-797.g49e4a679.el9 ceph-noarch 18 k 2024-03-12T17:15:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-12T17:15:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-12T17:15:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-12T17:15:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs-devel x86_64 2:18.2.2-797.g49e4a679.el9 ceph 31 k 2024-03-12T17:15:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2 x86_64 2:18.2.2-797.g49e4a679.el9 ceph 702 k 2024-03-12T17:15:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel x86_64 2:18.2.2-797.g49e4a679.el9 ceph 127 k 2024-03-12T17:15:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-12T17:15:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-12T17:15:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-12T17:15:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-12T17:15:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-12T17:15:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-12T17:15:44.773 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs x86_64 2:18.2.2-797.g49e4a679.el9 ceph 161 k 2024-03-12T17:15:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados x86_64 2:18.2.2-797.g49e4a679.el9 ceph 321 k 2024-03-12T17:15:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd x86_64 2:18.2.2-797.g49e4a679.el9 ceph 298 k 2024-03-12T17:15:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw x86_64 2:18.2.2-797.g49e4a679.el9 ceph 99 k 2024-03-12T17:15:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse x86_64 2:18.2.2-797.g49e4a679.el9 ceph 87 k 2024-03-12T17:15:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror x86_64 2:18.2.2-797.g49e4a679.el9 ceph 3.0 M 2024-03-12T17:15:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd x86_64 2:18.2.2-797.g49e4a679.el9 ceph 172 k 2024-03-12T17:15:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-12T17:15:44.774 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrading: 2024-03-12T17:15:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager x86_64 1:1.46.0-1.el9 baseos 2.3 M 2024-03-12T17:15:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-libnm x86_64 1:1.46.0-1.el9 baseos 1.8 M 2024-03-12T17:15:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-team x86_64 1:1.46.0-1.el9 baseos 42 k 2024-03-12T17:15:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-tui x86_64 1:1.46.0-1.el9 baseos 248 k 2024-03-12T17:15:44.774 INFO:teuthology.orchestra.run.smithi017.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-12T17:15:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-12T17:15:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-12T17:15:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-12T17:15:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-12T17:15:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-12T17:15:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-12T17:15:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-12T17:15:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-12T17:15:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: librados2 x86_64 2:18.2.2-797.g49e4a679.el9 ceph 3.3 M 2024-03-12T17:15:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1 x86_64 2:18.2.2-797.g49e4a679.el9 ceph 3.0 M 2024-03-12T17:15:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-12T17:15:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-12T17:15:44.775 INFO:teuthology.orchestra.run.smithi017.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-12T17:15:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-12T17:15:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-12T17:15:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-12T17:15:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-12T17:15:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-12T17:15:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-12T17:15:44.776 INFO:teuthology.orchestra.run.smithi017.stdout:Installing dependencies: 2024-03-12T17:15:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-12T17:15:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-12T17:15:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common x86_64 2:18.2.2-797.g49e4a679.el9 ceph 18 M 2024-03-12T17:15:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-grafana-dashboards noarch 2:18.2.2-797.g49e4a679.el9 ceph-noarch 23 k 2024-03-12T17:15:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds x86_64 2:18.2.2-797.g49e4a679.el9 ceph 2.1 M 2024-03-12T17:15:44.776 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core noarch 2:18.2.2-797.g49e4a679.el9 ceph-noarch 245 k 2024-03-12T17:15:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon x86_64 2:18.2.2-797.g49e4a679.el9 ceph 4.4 M 2024-03-12T17:15:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd x86_64 2:18.2.2-797.g49e4a679.el9 ceph 18 M 2024-03-12T17:15:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-prometheus-alerts noarch 2:18.2.2-797.g49e4a679.el9 ceph-noarch 15 k 2024-03-12T17:15:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-selinux x86_64 2:18.2.2-797.g49e4a679.el9 ceph 25 k 2024-03-12T17:15:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-12T17:15:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-12T17:15:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-12T17:15:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-03-12T17:15:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-12T17:15:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-12T17:15:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-12T17:15:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-12T17:15:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-12T17:15:44.777 INFO:teuthology.orchestra.run.smithi017.stdout: libcephsqlite x86_64 2:18.2.2-797.g49e4a679.el9 ceph 166 k 2024-03-12T17:15:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-12T17:15:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-12T17:15:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-12T17:15:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-12T17:15:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-12T17:15:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: libradosstriper1 x86_64 2:18.2.2-797.g49e4a679.el9 ceph 475 k 2024-03-12T17:15:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-12T17:15:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: librgw2 x86_64 2:18.2.2-797.g49e4a679.el9 ceph 4.5 M 2024-03-12T17:15:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-12T17:15:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-12T17:15:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-12T17:15:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-12T17:15:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-12T17:15:44.778 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-12T17:15:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-12T17:15:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-12T17:15:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-12T17:15:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-12T17:15:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-12T17:15:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-12T17:15:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-argparse x86_64 2:18.2.2-797.g49e4a679.el9 ceph 45 k 2024-03-12T17:15:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-common x86_64 2:18.2.2-797.g49e4a679.el9 ceph 126 k 2024-03-12T17:15:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-12T17:15:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-12T17:15:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-12T17:15:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-12T17:15:44.779 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-12T17:15:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-12T17:15:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-12T17:15:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-12T17:15:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-12T17:15:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-12T17:15:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-12T17:15:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-12T17:15:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-12T17:15:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-12T17:15:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-12T17:15:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-12T17:15:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-12T17:15:44.780 INFO:teuthology.orchestra.run.smithi017.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-12T17:15:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-12T17:15:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-12T17:15:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-12T17:15:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-12T17:15:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-12T17:15:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-12T17:15:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-12T17:15:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-12T17:15:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-12T17:15:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-12T17:15:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-12T17:15:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-12T17:15:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-12T17:15:44.781 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-12T17:15:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-12T17:15:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-12T17:15:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-12T17:15:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-12T17:15:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-12T17:15:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-12T17:15:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-12T17:15:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-12T17:15:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-12T17:15:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-12T17:15:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-12T17:15:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-12T17:15:44.782 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-12T17:15:44.783 INFO:teuthology.orchestra.run.smithi017.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-12T17:15:44.783 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-12T17:15:44.783 INFO:teuthology.orchestra.run.smithi017.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-12T17:15:44.783 INFO:teuthology.orchestra.run.smithi017.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-12T17:15:44.783 INFO:teuthology.orchestra.run.smithi017.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-12T17:15:44.783 INFO:teuthology.orchestra.run.smithi017.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-12T17:15:44.783 INFO:teuthology.orchestra.run.smithi017.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-12T17:15:44.783 INFO:teuthology.orchestra.run.smithi017.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-12T17:15:44.783 INFO:teuthology.orchestra.run.smithi017.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-12T17:15:44.783 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:15:44.783 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction Summary 2024-03-12T17:15:44.783 INFO:teuthology.orchestra.run.smithi017.stdout:=========================================================================================== 2024-03-12T17:15:44.783 INFO:teuthology.orchestra.run.smithi017.stdout:Install 132 Packages 2024-03-12T17:15:44.783 INFO:teuthology.orchestra.run.smithi017.stdout:Upgrade 24 Packages 2024-03-12T17:15:44.783 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:15:44.784 INFO:teuthology.orchestra.run.smithi017.stdout:Total download size: 204 M 2024-03-12T17:15:44.784 INFO:teuthology.orchestra.run.smithi017.stdout:Downloading Packages: 2024-03-12T17:15:45.724 INFO:teuthology.orchestra.run.smithi094.stdout:(2/156): ceph-fuse-18.2.2-797.g49e4a679.el9.x86 824 kB/s | 844 kB 00:01 2024-03-12T17:15:45.900 INFO:teuthology.orchestra.run.smithi094.stdout:(3/156): ceph-immutable-object-cache-18.2.2-797 818 kB/s | 143 kB 00:00 2024-03-12T17:15:46.168 INFO:teuthology.orchestra.run.smithi017.stdout:(1/156): ceph-18.2.2-797.g49e4a679.el9.x86_64.r 17 kB/s | 6.5 kB 00:00 2024-03-12T17:15:47.025 INFO:teuthology.orchestra.run.smithi094.stdout:(4/156): ceph-mds-18.2.2-797.g49e4a679.el9.x86_ 1.9 MB/s | 2.1 MB 00:01 2024-03-12T17:15:47.199 INFO:teuthology.orchestra.run.smithi017.stdout:(2/156): ceph-fuse-18.2.2-797.g49e4a679.el9.x86 819 kB/s | 844 kB 00:01 2024-03-12T17:15:47.394 INFO:teuthology.orchestra.run.smithi017.stdout:(3/156): ceph-immutable-object-cache-18.2.2-797 739 kB/s | 143 kB 00:00 2024-03-12T17:15:47.608 INFO:teuthology.orchestra.run.smithi094.stdout:(5/156): ceph-mgr-18.2.2-797.g49e4a679.el9.x86_ 2.5 MB/s | 1.4 MB 00:00 2024-03-12T17:15:47.694 INFO:teuthology.orchestra.run.smithi017.stdout:(4/156): ceph-common-18.2.2-797.g49e4a679.el9.x 9.6 MB/s | 18 MB 00:01 2024-03-12T17:15:47.800 INFO:teuthology.orchestra.run.smithi094.stdout:(6/156): ceph-base-18.2.2-797.g49e4a679.el9.x86 1.5 MB/s | 5.2 MB 00:03 2024-03-12T17:15:47.828 INFO:teuthology.orchestra.run.smithi017.stdout:(5/156): ceph-mgr-18.2.2-797.g49e4a679.el9.x86_ 11 MB/s | 1.4 MB 00:00 2024-03-12T17:15:48.136 INFO:teuthology.orchestra.run.smithi017.stdout:(6/156): ceph-mon-18.2.2-797.g49e4a679.el9.x86_ 14 MB/s | 4.4 MB 00:00 2024-03-12T17:15:48.986 INFO:teuthology.orchestra.run.smithi017.stdout:(7/156): ceph-mds-18.2.2-797.g49e4a679.el9.x86_ 1.3 MB/s | 2.1 MB 00:01 2024-03-12T17:15:49.212 INFO:teuthology.orchestra.run.smithi017.stdout:(8/156): ceph-osd-18.2.2-797.g49e4a679.el9.x86_ 16 MB/s | 18 MB 00:01 2024-03-12T17:15:49.234 INFO:teuthology.orchestra.run.smithi094.stdout:(7/156): ceph-mon-18.2.2-797.g49e4a679.el9.x86_ 2.7 MB/s | 4.4 MB 00:01 2024-03-12T17:15:49.262 INFO:teuthology.orchestra.run.smithi017.stdout:(9/156): ceph-selinux-18.2.2-797.g49e4a679.el9. 516 kB/s | 25 kB 00:00 2024-03-12T17:15:51.537 INFO:teuthology.orchestra.run.smithi017.stdout:(10/156): ceph-test-18.2.2-797.g49e4a679.el9.x8 17 MB/s | 40 MB 00:02 2024-03-12T17:15:51.587 INFO:teuthology.orchestra.run.smithi017.stdout:(11/156): cephfs-mirror-18.2.2-797.g49e4a679.el 4.4 MB/s | 221 kB 00:00 2024-03-12T17:15:51.638 INFO:teuthology.orchestra.run.smithi017.stdout:(12/156): libcephfs-devel-18.2.2-797.g49e4a679. 631 kB/s | 31 kB 00:00 2024-03-12T17:15:51.713 INFO:teuthology.orchestra.run.smithi017.stdout:(13/156): libcephfs2-18.2.2-797.g49e4a679.el9.x 9.2 MB/s | 702 kB 00:00 2024-03-12T17:15:51.751 INFO:teuthology.orchestra.run.smithi094.stdout:(8/156): ceph-radosgw-18.2.2-797.g49e4a679.el9. 3.1 MB/s | 7.7 MB 00:02 2024-03-12T17:15:51.763 INFO:teuthology.orchestra.run.smithi017.stdout:(14/156): libcephsqlite-18.2.2-797.g49e4a679.el 3.3 MB/s | 166 kB 00:00 2024-03-12T17:15:51.822 INFO:teuthology.orchestra.run.smithi017.stdout:(15/156): librados-devel-18.2.2-797.g49e4a679.e 2.2 MB/s | 127 kB 00:00 2024-03-12T17:15:51.851 INFO:teuthology.orchestra.run.smithi094.stdout:(9/156): ceph-selinux-18.2.2-797.g49e4a679.el9. 254 kB/s | 25 kB 00:00 2024-03-12T17:15:51.881 INFO:teuthology.orchestra.run.smithi017.stdout:(16/156): libradosstriper1-18.2.2-797.g49e4a679 8.0 MB/s | 475 kB 00:00 2024-03-12T17:15:52.173 INFO:teuthology.orchestra.run.smithi017.stdout:(17/156): librgw2-18.2.2-797.g49e4a679.el9.x86_ 15 MB/s | 4.5 MB 00:00 2024-03-12T17:15:52.214 INFO:teuthology.orchestra.run.smithi017.stdout:(18/156): python3-ceph-argparse-18.2.2-797.g49e 1.1 MB/s | 45 kB 00:00 2024-03-12T17:15:52.265 INFO:teuthology.orchestra.run.smithi017.stdout:(19/156): python3-ceph-common-18.2.2-797.g49e4a 2.5 MB/s | 126 kB 00:00 2024-03-12T17:15:52.315 INFO:teuthology.orchestra.run.smithi017.stdout:(20/156): python3-cephfs-18.2.2-797.g49e4a679.e 3.2 MB/s | 161 kB 00:00 2024-03-12T17:15:52.399 INFO:teuthology.orchestra.run.smithi017.stdout:(21/156): python3-rados-18.2.2-797.g49e4a679.el 3.8 MB/s | 321 kB 00:00 2024-03-12T17:15:52.449 INFO:teuthology.orchestra.run.smithi017.stdout:(22/156): python3-rbd-18.2.2-797.g49e4a679.el9. 5.9 MB/s | 298 kB 00:00 2024-03-12T17:15:52.502 INFO:teuthology.orchestra.run.smithi017.stdout:(23/156): python3-rgw-18.2.2-797.g49e4a679.el9. 2.0 MB/s | 99 kB 00:00 2024-03-12T17:15:52.541 INFO:teuthology.orchestra.run.smithi017.stdout:(24/156): rbd-fuse-18.2.2-797.g49e4a679.el9.x86 2.1 MB/s | 87 kB 00:00 2024-03-12T17:15:52.758 INFO:teuthology.orchestra.run.smithi017.stdout:(25/156): rbd-mirror-18.2.2-797.g49e4a679.el9.x 14 MB/s | 3.0 MB 00:00 2024-03-12T17:15:52.808 INFO:teuthology.orchestra.run.smithi017.stdout:(26/156): rbd-nbd-18.2.2-797.g49e4a679.el9.x86_ 3.4 MB/s | 172 kB 00:00 2024-03-12T17:15:52.850 INFO:teuthology.orchestra.run.smithi017.stdout:(27/156): ceph-grafana-dashboards-18.2.2-797.g4 569 kB/s | 23 kB 00:00 2024-03-12T17:15:52.901 INFO:teuthology.orchestra.run.smithi017.stdout:(28/156): ceph-mgr-cephadm-18.2.2-797.g49e4a679 2.7 MB/s | 137 kB 00:00 2024-03-12T17:15:53.034 INFO:teuthology.orchestra.run.smithi017.stdout:(29/156): ceph-mgr-dashboard-18.2.2-797.g49e4a6 13 MB/s | 1.7 MB 00:00 2024-03-12T17:15:53.143 INFO:teuthology.orchestra.run.smithi017.stdout:(30/156): ceph-base-18.2.2-797.g49e4a679.el9.x8 723 kB/s | 5.2 MB 00:07 2024-03-12T17:15:53.335 INFO:teuthology.orchestra.run.smithi017.stdout:(31/156): ceph-radosgw-18.2.2-797.g49e4a679.el9 1.8 MB/s | 7.7 MB 00:04 2024-03-12T17:15:53.494 INFO:teuthology.orchestra.run.smithi017.stdout:(32/156): ceph-mgr-diskprediction-local-18.2.2- 16 MB/s | 7.4 MB 00:00 2024-03-12T17:15:53.552 INFO:teuthology.orchestra.run.smithi017.stdout:(33/156): ceph-mgr-modules-core-18.2.2-797.g49e 602 kB/s | 245 kB 00:00 2024-03-12T17:15:53.577 INFO:teuthology.orchestra.run.smithi017.stdout:(34/156): ceph-mgr-rook-18.2.2-797.g49e4a679.el 205 kB/s | 49 kB 00:00 2024-03-12T17:15:53.603 INFO:teuthology.orchestra.run.smithi017.stdout:(35/156): ceph-prometheus-alerts-18.2.2-797.g49 138 kB/s | 15 kB 00:00 2024-03-12T17:15:53.653 INFO:teuthology.orchestra.run.smithi017.stdout:(36/156): cephfs-top-18.2.2-797.g49e4a679.el9.n 369 kB/s | 18 kB 00:00 2024-03-12T17:15:53.854 INFO:teuthology.orchestra.run.smithi017.stdout:(37/156): cephadm-18.2.2-797.g49e4a679.el9.noar 815 kB/s | 223 kB 00:00 2024-03-12T17:15:53.878 INFO:teuthology.orchestra.run.smithi017.stdout:(38/156): ceph-volume-18.2.2-797.g49e4a679.el9. 880 kB/s | 264 kB 00:00 2024-03-12T17:15:54.104 INFO:teuthology.orchestra.run.smithi017.stdout:(39/156): boost-program-options-1.75.0-8.el9.x8 480 kB/s | 106 kB 00:00 2024-03-12T17:15:54.346 INFO:teuthology.orchestra.run.smithi017.stdout:(40/156): automake-1.16.2-8.el9.noarch.rpm 958 kB/s | 662 kB 00:00 2024-03-12T17:15:54.379 INFO:teuthology.orchestra.run.smithi017.stdout:(41/156): flex-2.6.4-9.el9.x86_64.rpm 1.1 MB/s | 307 kB 00:00 2024-03-12T17:15:54.438 INFO:teuthology.orchestra.run.smithi017.stdout:(42/156): bison-3.7.4-5.el9.x86_64.rpm 1.5 MB/s | 920 kB 00:00 2024-03-12T17:15:54.463 INFO:teuthology.orchestra.run.smithi017.stdout:(43/156): flexiblas-3.0.4-8.el9.x86_64.rpm 283 kB/s | 32 kB 00:00 2024-03-12T17:15:54.655 INFO:teuthology.orchestra.run.smithi017.stdout:(44/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2024-03-12T17:15:54.681 INFO:teuthology.orchestra.run.smithi017.stdout:(45/156): flexiblas-openblas-openmp-3.0.4-8.el9 71 kB/s | 17 kB 00:00 2024-03-12T17:15:54.705 INFO:teuthology.orchestra.run.smithi017.stdout:(46/156): libaio-devel-0.3.111-13.el9.x86_64.rp 42 kB/s | 10 kB 00:00 2024-03-12T17:15:54.759 INFO:teuthology.orchestra.run.smithi017.stdout:(47/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.5 MB/s | 159 kB 00:00 2024-03-12T17:15:54.806 INFO:teuthology.orchestra.run.smithi017.stdout:(48/156): librdkafka-1.6.1-102.el9.x86_64.rpm 6.6 MB/s | 661 kB 00:00 2024-03-12T17:15:54.831 INFO:teuthology.orchestra.run.smithi017.stdout:(49/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 359 kB/s | 44 kB 00:00 2024-03-12T17:15:54.865 INFO:teuthology.orchestra.run.smithi017.stdout:(50/156): libtool-2.4.6-45.el9.x86_64.rpm 5.7 MB/s | 578 kB 00:00 2024-03-12T17:15:54.890 INFO:teuthology.orchestra.run.smithi017.stdout:(51/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 565 kB/s | 46 kB 00:00 2024-03-12T17:15:54.924 INFO:teuthology.orchestra.run.smithi017.stdout:(52/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.2 MB/s | 282 kB 00:00 2024-03-12T17:15:54.957 INFO:teuthology.orchestra.run.smithi017.stdout:(53/156): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.3 MB/s | 217 kB 00:00 2024-03-12T17:15:54.982 INFO:teuthology.orchestra.run.smithi017.stdout:(54/156): openblas-0.3.21-2.el9.x86_64.rpm 384 kB/s | 34 kB 00:00 2024-03-12T17:15:55.375 INFO:teuthology.orchestra.run.smithi017.stdout:(55/156): openblas-openmp-0.3.21-2.el9.x86_64.r 11 MB/s | 4.7 MB 00:00 2024-03-12T17:15:55.425 INFO:teuthology.orchestra.run.smithi017.stdout:(56/156): postgresql-contrib-13.11-1.el9.x86_64 1.9 MB/s | 811 kB 00:00 2024-03-12T17:15:55.483 INFO:teuthology.orchestra.run.smithi017.stdout:(57/156): postgresql-13.11-1.el9.x86_64.rpm 3.1 MB/s | 1.5 MB 00:00 2024-03-12T17:15:55.508 INFO:teuthology.orchestra.run.smithi017.stdout:(58/156): postgresql-private-libs-13.11-1.el9.x 1.0 MB/s | 134 kB 00:00 2024-03-12T17:15:55.817 INFO:teuthology.orchestra.run.smithi017.stdout:(59/156): postgresql-server-13.11-1.el9.x86_64. 15 MB/s | 5.7 MB 00:00 2024-03-12T17:15:55.834 INFO:teuthology.orchestra.run.smithi017.stdout:(60/156): python3-jsonpatch-1.21-16.el9.noarch. 79 kB/s | 24 kB 00:00 2024-03-12T17:15:56.026 INFO:teuthology.orchestra.run.smithi017.stdout:(61/156): python3-babel-2.9.1-2.el9.noarch.rpm 12 MB/s | 5.8 MB 00:00 2024-03-12T17:15:56.043 INFO:teuthology.orchestra.run.smithi017.stdout:(62/156): python3-jsonpointer-2.0-4.el9.noarch. 93 kB/s | 18 kB 00:00 2024-03-12T17:15:56.068 INFO:teuthology.orchestra.run.smithi017.stdout:(63/156): python3-mako-1.1.4-6.el9.noarch.rpm 661 kB/s | 144 kB 00:00 2024-03-12T17:15:56.085 INFO:teuthology.orchestra.run.smithi017.stdout:(64/156): python3-markupsafe-1.1.1-12.el9.x86_6 550 kB/s | 32 kB 00:00 2024-03-12T17:15:56.143 INFO:teuthology.orchestra.run.smithi017.stdout:(65/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 217 kB 00:00 2024-03-12T17:15:56.385 INFO:teuthology.orchestra.run.smithi017.stdout:(66/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 15 MB/s | 4.8 MB 00:00 2024-03-12T17:15:56.410 INFO:teuthology.orchestra.run.smithi017.stdout:(67/156): python3-oauthlib-3.1.1-5.el9.noarch.r 538 kB/s | 174 kB 00:00 2024-03-12T17:15:56.435 INFO:teuthology.orchestra.run.smithi017.stdout:(68/156): python3-packaging-20.9-5.el9.noarch.r 242 kB/s | 69 kB 00:00 2024-03-12T17:15:56.503 INFO:teuthology.orchestra.run.smithi017.stdout:(69/156): python3-prettytable-0.7.2-27.el9.noar 631 kB/s | 41 kB 00:00 2024-03-12T17:15:56.536 INFO:teuthology.orchestra.run.smithi017.stdout:(70/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 132 kB 00:00 2024-03-12T17:15:56.561 INFO:teuthology.orchestra.run.smithi017.stdout:(71/156): python3-pyasn1-modules-0.4.8-6.el9.no 1.7 MB/s | 211 kB 00:00 2024-03-12T17:15:56.586 INFO:teuthology.orchestra.run.smithi017.stdout:(72/156): python3-pytz-2021.1-5.el9.noarch.rpm 573 kB/s | 47 kB 00:00 2024-03-12T17:15:56.628 INFO:teuthology.orchestra.run.smithi017.stdout:(73/156): python3-requests-oauthlib-1.3.0-12.el 657 kB/s | 43 kB 00:00 2024-03-12T17:15:57.121 INFO:teuthology.orchestra.run.smithi017.stdout:(74/156): python3-toml-0.10.2-6.el9.noarch.rpm 72 kB/s | 39 kB 00:00 2024-03-12T17:15:57.479 INFO:teuthology.orchestra.run.smithi017.stdout:(75/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-03-12T17:15:57.513 INFO:teuthology.orchestra.run.smithi017.stdout:(76/156): socat-1.7.4.1-5.el9.x86_64.rpm 345 kB/s | 300 kB 00:00 2024-03-12T17:15:57.538 INFO:teuthology.orchestra.run.smithi017.stdout:(77/156): uuid-1.6.2-55.el9.x86_64.rpm 139 kB/s | 56 kB 00:00 2024-03-12T17:15:57.563 INFO:teuthology.orchestra.run.smithi017.stdout:(78/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 775 kB/s | 63 kB 00:00 2024-03-12T17:15:57.605 INFO:teuthology.orchestra.run.smithi017.stdout:(79/156): zlib-devel-1.2.11-40.el9.x86_64.rpm 672 kB/s | 44 kB 00:00 2024-03-12T17:15:57.664 INFO:teuthology.orchestra.run.smithi017.stdout:(80/156): fuse-2.9.9-15.el9.x86_64.rpm 634 kB/s | 79 kB 00:00 2024-03-12T17:15:57.689 INFO:teuthology.orchestra.run.smithi017.stdout:(81/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.9 MB/s | 241 kB 00:00 2024-03-12T17:15:57.739 INFO:teuthology.orchestra.run.smithi017.stdout:(82/156): python3-cryptography-36.0.1-4.el9.x86 8.8 MB/s | 1.1 MB 00:00 2024-03-12T17:15:57.764 INFO:teuthology.orchestra.run.smithi017.stdout:(83/156): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 103 kB 00:00 2024-03-12T17:15:57.790 INFO:teuthology.orchestra.run.smithi017.stdout:(84/156): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 124 kB 00:00 2024-03-12T17:15:57.823 INFO:teuthology.orchestra.run.smithi017.stdout:(85/156): python3-urllib3-1.26.5-5.el9.noarch.r 2.2 MB/s | 187 kB 00:00 2024-03-12T17:15:57.957 INFO:teuthology.orchestra.run.smithi017.stdout:(86/156): jq-1.6-16.el9.x86_64.rpm 1.1 MB/s | 187 kB 00:00 2024-03-12T17:15:57.982 INFO:teuthology.orchestra.run.smithi017.stdout:(87/156): libquadmath-11.4.1-3.el9.x86_64.rpm 1.2 MB/s | 195 kB 00:00 2024-03-12T17:15:58.024 INFO:teuthology.orchestra.run.smithi017.stdout:(88/156): libgfortran-11.4.1-3.el9.x86_64.rpm 3.4 MB/s | 803 kB 00:00 2024-03-12T17:15:58.049 INFO:teuthology.orchestra.run.smithi017.stdout:(89/156): python3-requests-2.25.1-8.el9.noarch. 1.9 MB/s | 125 kB 00:00 2024-03-12T17:15:58.116 INFO:teuthology.orchestra.run.smithi017.stdout:(90/156): elfutils-libelf-devel-0.190-2.el9.x86 162 kB/s | 21 kB 00:00 2024-03-12T17:15:58.150 INFO:teuthology.orchestra.run.smithi017.stdout:(91/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 204 kB/s | 25 kB 00:00 2024-03-12T17:15:58.342 INFO:teuthology.orchestra.run.smithi017.stdout:(92/156): python3-devel-3.9.17-2.el9.x86_64.rpm 1.1 MB/s | 245 kB 00:00 2024-03-12T17:15:58.367 INFO:teuthology.orchestra.run.smithi017.stdout:(93/156): python3-jinja2-2.11.3-5.el9.noarch.rp 1.1 MB/s | 248 kB 00:00 2024-03-12T17:15:58.492 INFO:teuthology.orchestra.run.smithi017.stdout:(94/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 627 kB/s | 94 kB 00:00 2024-03-12T17:15:58.693 INFO:teuthology.orchestra.run.smithi017.stdout:(95/156): fmt-8.1.1-5.el9.x86_64.rpm 340 kB/s | 111 kB 00:00 2024-03-12T17:15:58.868 INFO:teuthology.orchestra.run.smithi017.stdout:(96/156): gperftools-libs-2.9.1-2.el9.x86_64.rp 824 kB/s | 309 kB 00:00 2024-03-12T17:15:58.935 INFO:teuthology.orchestra.run.smithi017.stdout:(97/156): libarrow-doc-9.0.0-10.el9.noarch.rpm 395 kB/s | 26 kB 00:00 2024-03-12T17:15:59.027 INFO:teuthology.orchestra.run.smithi017.stdout:(98/156): liboath-2.6.7-2.el9.x86_64.rpm 535 kB/s | 49 kB 00:00 2024-03-12T17:15:59.094 INFO:teuthology.orchestra.run.smithi017.stdout:(99/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-03-12T17:15:59.194 INFO:teuthology.orchestra.run.smithi017.stdout:(100/156): libarrow-9.0.0-10.el9.x86_64.rpm 8.8 MB/s | 4.4 MB 00:00 2024-03-12T17:15:59.386 INFO:teuthology.orchestra.run.smithi017.stdout:(101/156): openssl-devel-3.0.7-27.el9.x86_64.rp 3.1 MB/s | 4.1 MB 00:01 2024-03-12T17:15:59.420 INFO:teuthology.orchestra.run.smithi017.stdout:(102/156): python3-asyncssh-2.13.2-4.el9.noarch 2.4 MB/s | 548 kB 00:00 2024-03-12T17:15:59.461 INFO:teuthology.orchestra.run.smithi017.stdout:(103/156): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.2 MB/s | 838 kB 00:00 2024-03-12T17:15:59.553 INFO:teuthology.orchestra.run.smithi017.stdout:(104/156): python3-cachetools-4.2.4-1.el9.noarc 243 kB/s | 32 kB 00:00 2024-03-12T17:15:59.612 INFO:teuthology.orchestra.run.smithi017.stdout:(105/156): python3-certifi-2021.10.8-2.el9.noar 186 kB/s | 15 kB 00:00 2024-03-12T17:15:59.654 INFO:teuthology.orchestra.run.smithi017.stdout:(106/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.7 MB/s | 172 kB 00:00 2024-03-12T17:15:59.729 INFO:teuthology.orchestra.run.smithi017.stdout:(107/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 127 kB/s | 43 kB 00:00 2024-03-12T17:15:59.779 INFO:teuthology.orchestra.run.smithi017.stdout:(108/156): python3-cherrypy-18.6.1-2.el9.noarch 2.1 MB/s | 358 kB 00:00 2024-03-12T17:15:59.805 INFO:teuthology.orchestra.run.smithi017.stdout:(109/156): python3-jaraco-8.2.1-3.el9.noarch.rp 144 kB/s | 11 kB 00:00 2024-03-12T17:15:59.838 INFO:teuthology.orchestra.run.smithi017.stdout:(110/156): python3-google-auth-2.28.0-1.el9.noa 1.1 MB/s | 203 kB 00:00 2024-03-12T17:15:59.864 INFO:teuthology.orchestra.run.smithi017.stdout:(111/156): python3-jaraco-classes-3.2.1-5.el9.n 211 kB/s | 18 kB 00:00 2024-03-12T17:15:59.889 INFO:teuthology.orchestra.run.smithi017.stdout:(112/156): python3-jaraco-collections-3.0.0-8.e 277 kB/s | 23 kB 00:00 2024-03-12T17:15:59.938 INFO:teuthology.orchestra.run.smithi017.stdout:(113/156): python3-jaraco-functools-3.5.0-2.el9 196 kB/s | 19 kB 00:00 2024-03-12T17:15:59.973 INFO:teuthology.orchestra.run.smithi017.stdout:(114/156): python3-jaraco-text-3.2.0-6.el9.noar 182 kB/s | 20 kB 00:00 2024-03-12T17:16:00.006 INFO:teuthology.orchestra.run.smithi017.stdout:(115/156): python3-logutils-0.3.5-21.el9.noarch 694 kB/s | 46 kB 00:00 2024-03-12T17:16:00.065 INFO:teuthology.orchestra.run.smithi017.stdout:(116/156): python3-more-itertools-8.12.0-2.el9. 864 kB/s | 79 kB 00:00 2024-03-12T17:16:00.090 INFO:teuthology.orchestra.run.smithi017.stdout:(117/156): python3-natsort-7.1.1-5.el9.noarch.r 696 kB/s | 58 kB 00:00 2024-03-12T17:16:00.190 INFO:teuthology.orchestra.run.smithi017.stdout:(118/156): python3-kubernetes-26.1.0-2.el9.noar 3.4 MB/s | 1.0 MB 00:00 2024-03-12T17:16:00.216 INFO:teuthology.orchestra.run.smithi017.stdout:(119/156): python3-portend-3.1.0-2.el9.noarch.r 132 kB/s | 16 kB 00:00 2024-03-12T17:16:00.249 INFO:teuthology.orchestra.run.smithi017.stdout:(120/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.5 MB/s | 272 kB 00:00 2024-03-12T17:16:00.274 INFO:teuthology.orchestra.run.smithi017.stdout:(121/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.1 MB/s | 90 kB 00:00 2024-03-12T17:16:00.368 INFO:teuthology.orchestra.run.smithi017.stdout:(122/156): python3-repoze-lru-0.7-16.el9.noarch 203 kB/s | 31 kB 00:00 2024-03-12T17:16:00.400 INFO:teuthology.orchestra.run.smithi017.stdout:(123/156): python3-rsa-4.9-2.el9.noarch.rpm 474 kB/s | 59 kB 00:00 2024-03-12T17:16:00.434 INFO:teuthology.orchestra.run.smithi017.stdout:(124/156): python3-routes-2.5.1-5.el9.noarch.rp 1.0 MB/s | 188 kB 00:00 2024-03-12T17:16:00.467 INFO:teuthology.orchestra.run.smithi017.stdout:(125/156): python3-tempora-5.0.0-2.el9.noarch.r 366 kB/s | 36 kB 00:00 2024-03-12T17:16:00.516 INFO:teuthology.orchestra.run.smithi017.stdout:(126/156): python3-typing-extensions-4.4.0-2.el 445 kB/s | 51 kB 00:00 2024-03-12T17:16:00.559 INFO:teuthology.orchestra.run.smithi017.stdout:(127/156): python3-webob-1.8.7-6.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-03-12T17:16:00.584 INFO:teuthology.orchestra.run.smithi017.stdout:(128/156): python3-websocket-client-1.2.3-2.el9 770 kB/s | 90 kB 00:00 2024-03-12T17:16:00.627 INFO:teuthology.orchestra.run.smithi017.stdout:(129/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-03-12T17:16:00.652 INFO:teuthology.orchestra.run.smithi017.stdout:(130/156): python3-zc-lockfile-2.0-10.el9.noarc 217 kB/s | 20 kB 00:00 2024-03-12T17:16:00.685 INFO:teuthology.orchestra.run.smithi017.stdout:(131/156): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-03-12T17:16:00.869 INFO:teuthology.orchestra.run.smithi017.stdout:(132/156): thrift-0.15.0-2.el9.x86_64.rpm 6.5 MB/s | 1.6 MB 00:00 2024-03-12T17:16:00.978 INFO:teuthology.orchestra.run.smithi017.stdout:(133/156): xfsdump-3.1.12-4.el9.x86_64.rpm 2.9 MB/s | 321 kB 00:00 2024-03-12T17:16:01.145 INFO:teuthology.orchestra.run.smithi017.stdout:(134/156): librbd1-18.2.2-797.g49e4a679.el9.x86 6.6 MB/s | 3.0 MB 00:00 2024-03-12T17:16:01.245 INFO:teuthology.orchestra.run.smithi017.stdout:(135/156): NetworkManager-1.46.0-1.el9.x86_64.r 8.6 MB/s | 2.3 MB 00:00 2024-03-12T17:16:01.278 INFO:teuthology.orchestra.run.smithi017.stdout:(136/156): NetworkManager-team-1.46.0-1.el9.x86 1.3 MB/s | 42 kB 00:00 2024-03-12T17:16:01.337 INFO:teuthology.orchestra.run.smithi017.stdout:(137/156): NetworkManager-libnm-1.46.0-1.el9.x8 9.5 MB/s | 1.8 MB 00:00 2024-03-12T17:16:01.370 INFO:teuthology.orchestra.run.smithi017.stdout:(138/156): NetworkManager-tui-1.46.0-1.el9.x86_ 2.7 MB/s | 248 kB 00:00 2024-03-12T17:16:01.396 INFO:teuthology.orchestra.run.smithi017.stdout:(139/156): acl-2.3.1-4.el9.x86_64.rpm 1.2 MB/s | 71 kB 00:00 2024-03-12T17:16:01.421 INFO:teuthology.orchestra.run.smithi017.stdout:(140/156): elfutils-debuginfod-client-0.190-2.e 733 kB/s | 36 kB 00:00 2024-03-12T17:16:01.455 INFO:teuthology.orchestra.run.smithi017.stdout:(141/156): elfutils-libelf-0.190-2.el9.x86_64.r 3.2 MB/s | 192 kB 00:00 2024-03-12T17:16:01.488 INFO:teuthology.orchestra.run.smithi017.stdout:(142/156): elfutils-libs-0.190-2.el9.x86_64.rpm 3.8 MB/s | 256 kB 00:00 2024-03-12T17:16:01.513 INFO:teuthology.orchestra.run.smithi017.stdout:(143/156): libacl-2.3.1-4.el9.x86_64.rpm 399 kB/s | 23 kB 00:00 2024-03-12T17:16:01.530 INFO:teuthology.orchestra.run.smithi017.stdout:(144/156): libblkid-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 108 kB 00:00 2024-03-12T17:16:01.564 INFO:teuthology.orchestra.run.smithi017.stdout:(145/156): libfdisk-2.37.4-18.el9.x86_64.rpm 3.1 MB/s | 155 kB 00:00 2024-03-12T17:16:01.589 INFO:teuthology.orchestra.run.smithi017.stdout:(146/156): libmount-2.37.4-18.el9.x86_64.rpm 2.3 MB/s | 136 kB 00:00 2024-03-12T17:16:01.614 INFO:teuthology.orchestra.run.smithi017.stdout:(147/156): libsmartcols-2.37.4-18.el9.x86_64.rp 1.3 MB/s | 64 kB 00:00 2024-03-12T17:16:01.673 INFO:teuthology.orchestra.run.smithi017.stdout:(148/156): libuuid-2.37.4-18.el9.x86_64.rpm 347 kB/s | 29 kB 00:00 2024-03-12T17:16:01.740 INFO:teuthology.orchestra.run.smithi017.stdout:(149/156): openssl-3.0.7-27.el9.x86_64.rpm 9.7 MB/s | 1.2 MB 00:00 2024-03-12T17:16:01.841 INFO:teuthology.orchestra.run.smithi017.stdout:(150/156): openssl-libs-3.0.7-27.el9.x86_64.rpm 13 MB/s | 2.2 MB 00:00 2024-03-12T17:16:01.916 INFO:teuthology.orchestra.run.smithi017.stdout:(151/156): util-linux-2.37.4-18.el9.x86_64.rpm 13 MB/s | 2.3 MB 00:00 2024-03-12T17:16:01.949 INFO:teuthology.orchestra.run.smithi017.stdout:(152/156): util-linux-core-2.37.4-18.el9.x86_64 4.3 MB/s | 465 kB 00:00 2024-03-12T17:16:01.975 INFO:teuthology.orchestra.run.smithi017.stdout:(153/156): util-linux-user-2.37.4-18.el9.x86_64 540 kB/s | 31 kB 00:00 2024-03-12T17:16:02.033 INFO:teuthology.orchestra.run.smithi017.stdout:(154/156): xfsprogs-6.3.0-1.el9.x86_64.rpm 13 MB/s | 1.1 MB 00:00 2024-03-12T17:16:02.200 INFO:teuthology.orchestra.run.smithi017.stdout:(155/156): libacl-devel-2.3.1-4.el9.x86_64.rpm 331 kB/s | 74 kB 00:00 2024-03-12T17:16:02.984 INFO:teuthology.orchestra.run.smithi017.stdout:(156/156): librados2-18.2.2-797.g49e4a679.el9.x 1.4 MB/s | 3.3 MB 00:02 2024-03-12T17:16:02.998 INFO:teuthology.orchestra.run.smithi017.stdout:-------------------------------------------------------------------------------- 2024-03-12T17:16:02.999 INFO:teuthology.orchestra.run.smithi017.stdout:Total 11 MB/s | 204 MB 00:18 2024-03-12T17:16:04.175 INFO:teuthology.orchestra.run.smithi094.stdout:(10/156): ceph-osd-18.2.2-797.g49e4a679.el9.x86 1.1 MB/s | 18 MB 00:16 2024-03-12T17:16:04.300 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction check 2024-03-12T17:16:04.467 INFO:teuthology.orchestra.run.smithi094.stdout:(11/156): cephfs-mirror-18.2.2-797.g49e4a679.el 763 kB/s | 221 kB 00:00 2024-03-12T17:16:04.567 INFO:teuthology.orchestra.run.smithi094.stdout:(12/156): libcephfs-devel-18.2.2-797.g49e4a679. 313 kB/s | 31 kB 00:00 2024-03-12T17:16:04.691 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction check succeeded. 2024-03-12T17:16:04.691 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction test 2024-03-12T17:16:05.143 INFO:teuthology.orchestra.run.smithi094.stdout:(13/156): libcephfs2-18.2.2-797.g49e4a679.el9.x 1.2 MB/s | 702 kB 00:00 2024-03-12T17:16:05.410 INFO:teuthology.orchestra.run.smithi094.stdout:(14/156): libcephsqlite-18.2.2-797.g49e4a679.el 625 kB/s | 166 kB 00:00 2024-03-12T17:16:05.660 INFO:teuthology.orchestra.run.smithi094.stdout:(15/156): ceph-common-18.2.2-797.g49e4a679.el9. 878 kB/s | 18 MB 00:21 2024-03-12T17:16:05.694 INFO:teuthology.orchestra.run.smithi094.stdout:(16/156): librados-devel-18.2.2-797.g49e4a679.e 448 kB/s | 127 kB 00:00 2024-03-12T17:16:06.060 INFO:teuthology.orchestra.run.smithi094.stdout:(17/156): libradosstriper1-18.2.2-797.g49e4a679 1.2 MB/s | 475 kB 00:00 2024-03-12T17:16:06.161 INFO:teuthology.orchestra.run.smithi094.stdout:(18/156): python3-ceph-argparse-18.2.2-797.g49e 453 kB/s | 45 kB 00:00 2024-03-12T17:16:06.344 INFO:teuthology.orchestra.run.smithi094.stdout:(19/156): python3-ceph-common-18.2.2-797.g49e4a 690 kB/s | 126 kB 00:00 2024-03-12T17:16:06.511 INFO:teuthology.orchestra.run.smithi094.stdout:(20/156): python3-cephfs-18.2.2-797.g49e4a679.e 973 kB/s | 161 kB 00:00 2024-03-12T17:16:06.753 INFO:teuthology.orchestra.run.smithi094.stdout:(21/156): python3-rados-18.2.2-797.g49e4a679.el 1.3 MB/s | 321 kB 00:00 2024-03-12T17:16:07.012 INFO:teuthology.orchestra.run.smithi094.stdout:(22/156): python3-rbd-18.2.2-797.g49e4a679.el9. 1.1 MB/s | 298 kB 00:00 2024-03-12T17:16:07.120 INFO:teuthology.orchestra.run.smithi094.stdout:(23/156): python3-rgw-18.2.2-797.g49e4a679.el9. 925 kB/s | 99 kB 00:00 2024-03-12T17:16:07.147 INFO:teuthology.orchestra.run.smithi017.stdout:Transaction test succeeded. 2024-03-12T17:16:07.148 INFO:teuthology.orchestra.run.smithi017.stdout:Running transaction 2024-03-12T17:16:07.212 INFO:teuthology.orchestra.run.smithi094.stdout:(24/156): rbd-fuse-18.2.2-797.g49e4a679.el9.x86 956 kB/s | 87 kB 00:00 2024-03-12T17:16:09.338 INFO:teuthology.orchestra.run.smithi094.stdout:(25/156): rbd-mirror-18.2.2-797.g49e4a679.el9.x 1.4 MB/s | 3.0 MB 00:02 2024-03-12T17:16:09.438 INFO:teuthology.orchestra.run.smithi094.stdout:(26/156): librgw2-18.2.2-797.g49e4a679.el9.x86_ 1.2 MB/s | 4.5 MB 00:03 2024-03-12T17:16:09.680 INFO:teuthology.orchestra.run.smithi094.stdout:(27/156): ceph-grafana-dashboards-18.2.2-797.g4 97 kB/s | 23 kB 00:00 2024-03-12T17:16:09.705 INFO:teuthology.orchestra.run.smithi094.stdout:(28/156): rbd-nbd-18.2.2-797.g49e4a679.el9.x86_ 470 kB/s | 172 kB 00:00 2024-03-12T17:16:09.838 INFO:teuthology.orchestra.run.smithi094.stdout:(29/156): ceph-mgr-cephadm-18.2.2-797.g49e4a679 873 kB/s | 137 kB 00:00 2024-03-12T17:16:11.188 INFO:teuthology.orchestra.run.smithi094.stdout:(30/156): ceph-mgr-dashboard-18.2.2-797.g49e4a6 1.2 MB/s | 1.7 MB 00:01 2024-03-12T17:16:11.439 INFO:teuthology.orchestra.run.smithi094.stdout:(31/156): ceph-mgr-modules-core-18.2.2-797.g49e 986 kB/s | 245 kB 00:00 2024-03-12T17:16:11.539 INFO:teuthology.orchestra.run.smithi094.stdout:(32/156): ceph-mgr-rook-18.2.2-797.g49e4a679.el 497 kB/s | 49 kB 00:00 2024-03-12T17:16:11.639 INFO:teuthology.orchestra.run.smithi094.stdout:(33/156): ceph-prometheus-alerts-18.2.2-797.g49 150 kB/s | 15 kB 00:00 2024-03-12T17:16:11.898 INFO:teuthology.orchestra.run.smithi094.stdout:(34/156): ceph-volume-18.2.2-797.g49e4a679.el9. 1.0 MB/s | 264 kB 00:00 2024-03-12T17:16:12.173 INFO:teuthology.orchestra.run.smithi094.stdout:(35/156): cephadm-18.2.2-797.g49e4a679.el9.noar 815 kB/s | 223 kB 00:00 2024-03-12T17:16:12.273 INFO:teuthology.orchestra.run.smithi094.stdout:(36/156): cephfs-top-18.2.2-797.g49e4a679.el9.n 184 kB/s | 18 kB 00:00 2024-03-12T17:16:12.782 INFO:teuthology.orchestra.run.smithi094.stdout:(37/156): automake-1.16.2-8.el9.noarch.rpm 1.3 MB/s | 662 kB 00:00 2024-03-12T17:16:12.974 INFO:teuthology.orchestra.run.smithi094.stdout:(38/156): bison-3.7.4-5.el9.x86_64.rpm 4.7 MB/s | 920 kB 00:00 2024-03-12T17:16:13.033 INFO:teuthology.orchestra.run.smithi094.stdout:(39/156): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 106 kB 00:00 2024-03-12T17:16:13.116 INFO:teuthology.orchestra.run.smithi094.stdout:(40/156): flex-2.6.4-9.el9.x86_64.rpm 3.6 MB/s | 307 kB 00:00 2024-03-12T17:16:13.175 INFO:teuthology.orchestra.run.smithi094.stdout:(41/156): flexiblas-3.0.4-8.el9.x86_64.rpm 549 kB/s | 32 kB 00:00 2024-03-12T17:16:13.367 INFO:teuthology.orchestra.run.smithi094.stdout:(42/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 16 MB/s | 3.0 MB 00:00 2024-03-12T17:16:13.434 INFO:teuthology.orchestra.run.smithi094.stdout:(43/156): flexiblas-openblas-openmp-3.0.4-8.el9 261 kB/s | 17 kB 00:00 2024-03-12T17:16:13.492 INFO:teuthology.orchestra.run.smithi094.stdout:(44/156): libaio-devel-0.3.111-13.el9.x86_64.rp 175 kB/s | 10 kB 00:00 2024-03-12T17:16:13.559 INFO:teuthology.orchestra.run.smithi094.stdout:(45/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.4 MB/s | 159 kB 00:00 2024-03-12T17:16:13.626 INFO:teuthology.orchestra.run.smithi094.stdout:(46/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 671 kB/s | 44 kB 00:00 2024-03-12T17:16:13.710 INFO:teuthology.orchestra.run.smithi094.stdout:(47/156): librdkafka-1.6.1-102.el9.x86_64.rpm 7.8 MB/s | 661 kB 00:00 2024-03-12T17:16:13.785 INFO:teuthology.orchestra.run.smithi094.stdout:(48/156): libtool-2.4.6-45.el9.x86_64.rpm 7.6 MB/s | 578 kB 00:00 2024-03-12T17:16:13.852 INFO:teuthology.orchestra.run.smithi094.stdout:(49/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 704 kB/s | 46 kB 00:00 2024-03-12T17:16:13.919 INFO:teuthology.orchestra.run.smithi094.stdout:(50/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.2 MB/s | 282 kB 00:00 2024-03-12T17:16:13.951 INFO:teuthology.orchestra.run.smithi017.stdout: Preparing : 1/1 2024-03-12T17:16:13.986 INFO:teuthology.orchestra.run.smithi094.stdout:(51/156): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.2 MB/s | 217 kB 00:00 2024-03-12T17:16:14.044 INFO:teuthology.orchestra.run.smithi094.stdout:(52/156): openblas-0.3.21-2.el9.x86_64.rpm 591 kB/s | 34 kB 00:00 2024-03-12T17:16:14.050 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/180 2024-03-12T17:16:14.098 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/180 2024-03-12T17:16:14.136 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/180 2024-03-12T17:16:14.253 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/180 2024-03-12T17:16:14.302 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/180 2024-03-12T17:16:14.311 INFO:teuthology.orchestra.run.smithi094.stdout:(53/156): openblas-openmp-0.3.21-2.el9.x86_64.r 18 MB/s | 4.7 MB 00:00 2024-03-12T17:16:14.412 INFO:teuthology.orchestra.run.smithi094.stdout:(54/156): postgresql-13.11-1.el9.x86_64.rpm 15 MB/s | 1.5 MB 00:00 2024-03-12T17:16:14.412 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/180 2024-03-12T17:16:14.486 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/180 2024-03-12T17:16:14.512 INFO:teuthology.orchestra.run.smithi094.stdout:(55/156): postgresql-contrib-13.11-1.el9.x86_64 8.0 MB/s | 811 kB 00:00 2024-03-12T17:16:14.536 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/180 2024-03-12T17:16:14.570 INFO:teuthology.orchestra.run.smithi094.stdout:(56/156): postgresql-private-libs-13.11-1.el9.x 2.3 MB/s | 134 kB 00:00 2024-03-12T17:16:14.640 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/180 2024-03-12T17:16:14.854 INFO:teuthology.orchestra.run.smithi094.stdout:(57/156): postgresql-server-13.11-1.el9.x86_64. 20 MB/s | 5.7 MB 00:00 2024-03-12T17:16:15.053 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/180 2024-03-12T17:16:15.090 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : librados2-2:18.2.2-797.g49e4a679.el9.x86_64 10/180 2024-03-12T17:16:15.104 INFO:teuthology.orchestra.run.smithi094.stdout:(58/156): python3-babel-2.9.1-2.el9.noarch.rpm 23 MB/s | 5.8 MB 00:00 2024-03-12T17:16:15.155 INFO:teuthology.orchestra.run.smithi094.stdout:(59/156): python3-jsonpatch-1.21-16.el9.noarch. 499 kB/s | 24 kB 00:00 2024-03-12T17:16:15.197 INFO:teuthology.orchestra.run.smithi094.stdout:(60/156): python3-jsonpointer-2.0-4.el9.noarch. 442 kB/s | 18 kB 00:00 2024-03-12T17:16:15.245 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados2-2:18.2.2-797.g49e4a679.el9.x86_64 10/180 2024-03-12T17:16:15.255 INFO:teuthology.orchestra.run.smithi094.stdout:(61/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.4 MB/s | 144 kB 00:00 2024-03-12T17:16:15.274 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephfs2-2:18.2.2-797.g49e4a679.el9.x86_64 11/180 2024-03-12T17:16:15.297 INFO:teuthology.orchestra.run.smithi094.stdout:(62/156): python3-markupsafe-1.1.1-12.el9.x86_6 772 kB/s | 32 kB 00:00 2024-03-12T17:16:15.398 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephfs2-2:18.2.2-797.g49e4a679.el9.x86_64 11/180 2024-03-12T17:16:15.436 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rados-2:18.2.2-797.g49e4a679.el9.x86_64 12/180 2024-03-12T17:16:15.522 INFO:teuthology.orchestra.run.smithi094.stdout:(63/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 21 MB/s | 4.8 MB 00:00 2024-03-12T17:16:15.524 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 13/180 2024-03-12T17:16:15.589 INFO:teuthology.orchestra.run.smithi094.stdout:(64/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.2 MB/s | 217 kB 00:00 2024-03-12T17:16:15.657 INFO:teuthology.orchestra.run.smithi094.stdout:(65/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 174 kB 00:00 2024-03-12T17:16:15.715 INFO:teuthology.orchestra.run.smithi094.stdout:(66/156): python3-packaging-20.9-5.el9.noarch.r 1.2 MB/s | 69 kB 00:00 2024-03-12T17:16:15.774 INFO:teuthology.orchestra.run.smithi094.stdout:(67/156): python3-prettytable-0.7.2-27.el9.noar 716 kB/s | 41 kB 00:00 2024-03-12T17:16:15.827 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/180 2024-03-12T17:16:15.887 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/180 2024-03-12T17:16:15.913 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephsqlite-2:18.2.2-797.g49e4a679.el9.x86_64 16/180 2024-03-12T17:16:15.916 INFO:teuthology.orchestra.run.smithi094.stdout:(68/156): ceph-mgr-diskprediction-local-18.2.2- 1.2 MB/s | 7.4 MB 00:06 2024-03-12T17:16:15.933 INFO:teuthology.orchestra.run.smithi094.stdout:(69/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 839 kB/s | 132 kB 00:00 2024-03-12T17:16:15.983 INFO:teuthology.orchestra.run.smithi094.stdout:(70/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.2 MB/s | 211 kB 00:00 2024-03-12T17:16:16.008 INFO:teuthology.orchestra.run.smithi094.stdout:(71/156): python3-pytz-2021.1-5.el9.noarch.rpm 634 kB/s | 47 kB 00:00 2024-03-12T17:16:16.042 INFO:teuthology.orchestra.run.smithi094.stdout:(72/156): python3-requests-oauthlib-1.3.0-12.el 745 kB/s | 43 kB 00:00 2024-03-12T17:16:16.081 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libcephsqlite-2:18.2.2-797.g49e4a679.el9.x86_64 16/180 2024-03-12T17:16:16.205 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libradosstriper1-2:18.2.2-797.g49e4a679.el9.x86_ 17/180 2024-03-12T17:16:16.306 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: libradosstriper1-2:18.2.2-797.g49e4a679.el9.x86_ 17/180 2024-03-12T17:16:16.317 INFO:teuthology.orchestra.run.smithi094.stdout:(73/156): python3-toml-0.10.2-6.el9.noarch.rpm 141 kB/s | 39 kB 00:00 2024-03-12T17:16:16.364 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/180 2024-03-12T17:16:16.405 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 19/180 2024-03-12T17:16:16.659 INFO:teuthology.orchestra.run.smithi094.stdout:(74/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-03-12T17:16:16.693 INFO:teuthology.orchestra.run.smithi094.stdout:(75/156): socat-1.7.4.1-5.el9.x86_64.rpm 831 kB/s | 300 kB 00:00 2024-03-12T17:16:16.718 INFO:teuthology.orchestra.run.smithi094.stdout:(76/156): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 56 kB 00:00 2024-03-12T17:16:16.730 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 20/180 2024-03-12T17:16:16.752 INFO:teuthology.orchestra.run.smithi094.stdout:(77/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 63 kB 00:00 2024-03-12T17:16:16.777 INFO:teuthology.orchestra.run.smithi094.stdout:(78/156): zlib-devel-1.2.11-40.el9.x86_64.rpm 763 kB/s | 44 kB 00:00 2024-03-12T17:16:16.810 INFO:teuthology.orchestra.run.smithi094.stdout:(79/156): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2024-03-12T17:16:16.844 INFO:teuthology.orchestra.run.smithi094.stdout:(80/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.5 MB/s | 241 kB 00:00 2024-03-12T17:16:16.905 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 21/180 2024-03-12T17:16:16.919 INFO:teuthology.orchestra.run.smithi094.stdout:(81/156): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.1 MB 00:00 2024-03-12T17:16:16.936 INFO:teuthology.orchestra.run.smithi094.stdout:(82/156): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 103 kB 00:00 2024-03-12T17:16:16.987 INFO:teuthology.orchestra.run.smithi094.stdout:(83/156): python3-pycparser-2.20-6.el9.noarch.r 1.9 MB/s | 124 kB 00:00 2024-03-12T17:16:16.994 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 21/180 2024-03-12T17:16:17.020 INFO:teuthology.orchestra.run.smithi094.stdout:(84/156): python3-urllib3-1.26.5-5.el9.noarch.r 2.2 MB/s | 187 kB 00:00 2024-03-12T17:16:17.095 INFO:teuthology.orchestra.run.smithi094.stdout:(85/156): jq-1.6-16.el9.x86_64.rpm 1.7 MB/s | 187 kB 00:00 2024-03-12T17:16:17.154 INFO:teuthology.orchestra.run.smithi094.stdout:(86/156): libgfortran-11.4.1-3.el9.x86_64.rpm 5.9 MB/s | 803 kB 00:00 2024-03-12T17:16:17.229 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 22/180 2024-03-12T17:16:17.300 INFO:teuthology.orchestra.run.smithi094.stdout:(87/156): libquadmath-11.4.1-3.el9.x86_64.rpm 963 kB/s | 195 kB 00:00 2024-03-12T17:16:17.316 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : NetworkManager-1:1.46.0-1.el9.x86_64 22/180 2024-03-12T17:16:17.346 INFO:teuthology.orchestra.run.smithi094.stdout:(88/156): python3-requests-2.25.1-8.el9.noarch. 653 kB/s | 125 kB 00:00 2024-03-12T17:16:17.786 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 22/180 2024-03-12T17:16:17.830 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 23/180 2024-03-12T17:16:17.869 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : liboath-2.6.7-2.el9.x86_64 24/180 2024-03-12T17:16:17.950 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 25/180 2024-03-12T17:16:18.077 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 26/180 2024-03-12T17:16:18.180 INFO:teuthology.orchestra.run.smithi094.stdout:(89/156): elfutils-libelf-devel-0.190-2.el9.x86 24 kB/s | 21 kB 00:00 2024-03-12T17:16:18.225 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/180 2024-03-12T17:16:18.230 INFO:teuthology.orchestra.run.smithi094.stdout:(90/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 29 kB/s | 25 kB 00:00 2024-03-12T17:16:18.276 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/180 2024-03-12T17:16:18.383 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 29/180 2024-03-12T17:16:18.427 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 30/180 2024-03-12T17:16:18.461 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 31/180 2024-03-12T17:16:18.575 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 32/180 2024-03-12T17:16:18.625 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ceph-common-2:18.2.2-797.g49e4a679.el9.x 33/180 2024-03-12T17:16:18.681 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ceph-argparse-2:18.2.2-797.g49e4a679.el9 34/180 2024-03-12T17:16:18.798 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cephfs-2:18.2.2-797.g49e4a679.el9.x86_64 35/180 2024-03-12T17:16:18.990 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/180 2024-03-12T17:16:19.061 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/180 2024-03-12T17:16:19.622 INFO:teuthology.orchestra.run.smithi094.stdout:(91/156): python3-devel-3.9.17-2.el9.x86_64.rpm 176 kB/s | 245 kB 00:01 2024-03-12T17:16:19.781 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/180 2024-03-12T17:16:19.881 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/180 2024-03-12T17:16:19.993 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 40/180 2024-03-12T17:16:20.041 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 41/180 2024-03-12T17:16:20.078 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 41/180 2024-03-12T17:16:20.151 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 42/180 2024-03-12T17:16:20.197 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librados-devel-2:18.2.2-797.g49e4a679.el9.x86_64 43/180 2024-03-12T17:16:20.239 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/180 2024-03-12T17:16:20.650 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 45/180 2024-03-12T17:16:20.858 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 46/180 2024-03-12T17:16:20.872 INFO:teuthology.orchestra.run.smithi094.stdout:(92/156): python3-jinja2-2.11.3-5.el9.noarch.rp 199 kB/s | 248 kB 00:01 2024-03-12T17:16:20.969 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 47/180 2024-03-12T17:16:21.025 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 48/180 2024-03-12T17:16:21.229 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/180 2024-03-12T17:16:21.297 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 50/180 2024-03-12T17:16:21.445 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : re2-1:20211101-3.el9.x86_64 51/180 2024-03-12T17:16:21.483 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 52/180 2024-03-12T17:16:21.549 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 53/180 2024-03-12T17:16:21.638 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 54/180 2024-03-12T17:16:21.684 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 55/180 2024-03-12T17:16:21.723 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 56/180 2024-03-12T17:16:21.789 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 57/180 2024-03-12T17:16:21.873 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 58/180 2024-03-12T17:16:21.922 INFO:teuthology.orchestra.run.smithi094.stdout:(93/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 89 kB/s | 94 kB 00:01 2024-03-12T17:16:21.935 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 59/180 2024-03-12T17:16:22.023 INFO:teuthology.orchestra.run.smithi094.stdout:(94/156): fmt-8.1.1-5.el9.x86_64.rpm 1.1 MB/s | 111 kB 00:00 2024-03-12T17:16:22.090 INFO:teuthology.orchestra.run.smithi094.stdout:(95/156): gperftools-libs-2.9.1-2.el9.x86_64.rp 4.6 MB/s | 309 kB 00:00 2024-03-12T17:16:22.134 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 60/180 2024-03-12T17:16:22.184 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 61/180 2024-03-12T17:16:22.240 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 62/180 2024-03-12T17:16:22.273 INFO:teuthology.orchestra.run.smithi094.stdout:(96/156): libarrow-9.0.0-10.el9.x86_64.rpm 24 MB/s | 4.4 MB 00:00 2024-03-12T17:16:22.315 INFO:teuthology.orchestra.run.smithi094.stdout:(97/156): libarrow-doc-9.0.0-10.el9.noarch.rpm 638 kB/s | 26 kB 00:00 2024-03-12T17:16:22.357 INFO:teuthology.orchestra.run.smithi094.stdout:(98/156): liboath-2.6.7-2.el9.x86_64.rpm 1.2 MB/s | 49 kB 00:00 2024-03-12T17:16:22.373 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 63/180 2024-03-12T17:16:22.399 INFO:teuthology.orchestra.run.smithi094.stdout:(99/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-03-12T17:16:22.432 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 64/180 2024-03-12T17:16:22.466 INFO:teuthology.orchestra.run.smithi094.stdout:(100/156): parquet-libs-9.0.0-10.el9.x86_64.rpm 12 MB/s | 838 kB 00:00 2024-03-12T17:16:22.479 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 65/180 2024-03-12T17:16:22.515 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 66/180 2024-03-12T17:16:22.516 INFO:teuthology.orchestra.run.smithi094.stdout:(101/156): python3-asyncssh-2.13.2-4.el9.noarch 11 MB/s | 548 kB 00:00 2024-03-12T17:16:22.554 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 67/180 2024-03-12T17:16:22.558 INFO:teuthology.orchestra.run.smithi094.stdout:(102/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2024-03-12T17:16:22.600 INFO:teuthology.orchestra.run.smithi094.stdout:(103/156): python3-cachetools-4.2.4-1.el9.noarc 787 kB/s | 32 kB 00:00 2024-03-12T17:16:22.634 INFO:teuthology.orchestra.run.smithi094.stdout:(104/156): python3-certifi-2021.10.8-2.el9.noar 459 kB/s | 15 kB 00:00 2024-03-12T17:16:22.675 INFO:teuthology.orchestra.run.smithi094.stdout:(105/156): python3-cheroot-8.6.0-4.el9.noarch.r 4.2 MB/s | 172 kB 00:00 2024-03-12T17:16:22.725 INFO:teuthology.orchestra.run.smithi094.stdout:(106/156): python3-cherrypy-18.6.1-2.el9.noarch 7.1 MB/s | 358 kB 00:00 2024-03-12T17:16:22.729 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : fmt-8.1.1-5.el9.x86_64 68/180 2024-03-12T17:16:22.767 INFO:teuthology.orchestra.run.smithi094.stdout:(107/156): python3-google-auth-2.28.0-1.el9.noa 4.8 MB/s | 203 kB 00:00 2024-03-12T17:16:22.790 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 69/180 2024-03-12T17:16:22.809 INFO:teuthology.orchestra.run.smithi094.stdout:(108/156): python3-jaraco-8.2.1-3.el9.noarch.rp 258 kB/s | 11 kB 00:00 2024-03-12T17:16:22.874 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-ply-3.11-14.el9.noarch 70/180 2024-03-12T17:16:22.902 INFO:teuthology.orchestra.run.smithi094.stdout:(109/156): python3-jaraco-classes-3.2.1-5.el9.n 200 kB/s | 18 kB 00:00 2024-03-12T17:16:22.943 INFO:teuthology.orchestra.run.smithi094.stdout:(110/156): python3-jaraco-collections-3.0.0-8.e 568 kB/s | 23 kB 00:00 2024-03-12T17:16:22.960 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 71/180 2024-03-12T17:16:22.985 INFO:teuthology.orchestra.run.smithi094.stdout:(111/156): python3-jaraco-functools-3.5.0-2.el9 473 kB/s | 19 kB 00:00 2024-03-12T17:16:23.044 INFO:teuthology.orchestra.run.smithi094.stdout:(112/156): python3-jaraco-text-3.2.0-6.el9.noar 342 kB/s | 20 kB 00:00 2024-03-12T17:16:23.111 INFO:teuthology.orchestra.run.smithi094.stdout:(113/156): python3-kubernetes-26.1.0-2.el9.noar 15 MB/s | 1.0 MB 00:00 2024-03-12T17:16:23.153 INFO:teuthology.orchestra.run.smithi094.stdout:(114/156): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2024-03-12T17:16:23.195 INFO:teuthology.orchestra.run.smithi094.stdout:(115/156): python3-more-itertools-8.12.0-2.el9. 1.9 MB/s | 79 kB 00:00 2024-03-12T17:16:23.224 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 72/180 2024-03-12T17:16:23.237 INFO:teuthology.orchestra.run.smithi094.stdout:(116/156): python3-natsort-7.1.1-5.el9.noarch.r 1.4 MB/s | 58 kB 00:00 2024-03-12T17:16:23.284 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 73/180 2024-03-12T17:16:23.287 INFO:teuthology.orchestra.run.smithi094.stdout:(117/156): python3-pecan-1.4.2-3.el9.noarch.rpm 5.4 MB/s | 272 kB 00:00 2024-03-12T17:16:23.329 INFO:teuthology.orchestra.run.smithi094.stdout:(118/156): python3-portend-3.1.0-2.el9.noarch.r 401 kB/s | 16 kB 00:00 2024-03-12T17:16:23.362 INFO:teuthology.orchestra.run.smithi094.stdout:(119/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.7 MB/s | 90 kB 00:00 2024-03-12T17:16:23.404 INFO:teuthology.orchestra.run.smithi094.stdout:(120/156): python3-repoze-lru-0.7-16.el9.noarch 754 kB/s | 31 kB 00:00 2024-03-12T17:16:23.446 INFO:teuthology.orchestra.run.smithi094.stdout:(121/156): python3-routes-2.5.1-5.el9.noarch.rp 4.5 MB/s | 188 kB 00:00 2024-03-12T17:16:23.462 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 74/180 2024-03-12T17:16:23.488 INFO:teuthology.orchestra.run.smithi094.stdout:(122/156): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-03-12T17:16:23.514 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 75/180 2024-03-12T17:16:23.579 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 76/180 2024-03-12T17:16:23.617 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : fuse-2.9.9-15.el9.x86_64 77/180 2024-03-12T17:16:23.661 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 78/180 2024-03-12T17:16:23.707 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 79/180 2024-03-12T17:16:23.770 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : uuid-1.6.2-55.el9.x86_64 80/180 2024-03-12T17:16:23.814 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 81/180 2024-03-12T17:16:23.922 INFO:teuthology.orchestra.run.smithi094.stdout:(123/156): ceph-test-18.2.2-797.g49e4a679.el9.x 1.2 MB/s | 40 MB 00:32 2024-03-12T17:16:23.947 INFO:teuthology.orchestra.run.smithi094.stdout:(124/156): python3-tempora-5.0.0-2.el9.noarch.r 78 kB/s | 36 kB 00:00 2024-03-12T17:16:23.948 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 82/180 2024-03-12T17:16:23.993 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 83/180 2024-03-12T17:16:23.997 INFO:teuthology.orchestra.run.smithi094.stdout:(125/156): python3-webob-1.8.7-6.el9.noarch.rpm 4.6 MB/s | 230 kB 00:00 2024-03-12T17:16:24.023 INFO:teuthology.orchestra.run.smithi094.stdout:(126/156): python3-typing-extensions-4.4.0-2.el 514 kB/s | 51 kB 00:00 2024-03-12T17:16:24.037 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 84/180 2024-03-12T17:16:24.048 INFO:teuthology.orchestra.run.smithi094.stdout:(127/156): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-03-12T17:16:24.082 INFO:teuthology.orchestra.run.smithi094.stdout:(128/156): python3-zc-lockfile-2.0-10.el9.noarc 615 kB/s | 20 kB 00:00 2024-03-12T17:16:24.103 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 85/180 2024-03-12T17:16:24.115 INFO:teuthology.orchestra.run.smithi094.stdout:(129/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.6 MB/s | 427 kB 00:00 2024-03-12T17:16:24.149 INFO:teuthology.orchestra.run.smithi094.stdout:(130/156): re2-20211101-3.el9.x86_64.rpm 2.8 MB/s | 192 kB 00:00 2024-03-12T17:16:24.156 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 86/180 2024-03-12T17:16:24.224 INFO:teuthology.orchestra.run.smithi094.stdout:(131/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-03-12T17:16:24.309 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 87/180 2024-03-12T17:16:24.354 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 88/180 2024-03-12T17:16:24.418 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 89/180 2024-03-12T17:16:24.572 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-packaging-20.9-5.el9.noarch 90/180 2024-03-12T17:16:24.643 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 91/180 2024-03-12T17:16:25.668 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/180 2024-03-12T17:16:25.728 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 93/180 2024-03-12T17:16:25.761 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 94/180 2024-03-12T17:16:25.795 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 95/180 2024-03-12T17:16:26.060 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openblas-0.3.21-2.el9.x86_64 96/180 2024-03-12T17:16:26.090 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 97/180 2024-03-12T17:16:26.187 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 98/180 2024-03-12T17:16:26.624 INFO:teuthology.orchestra.run.smithi094.stdout:(132/156): openssl-devel-3.0.7-27.el9.x86_64.rp 501 kB/s | 4.1 MB 00:08 2024-03-12T17:16:26.708 INFO:teuthology.orchestra.run.smithi094.stdout:(133/156): xfsdump-3.1.12-4.el9.x86_64.rpm 3.8 MB/s | 321 kB 00:00 2024-03-12T17:16:26.900 INFO:teuthology.orchestra.run.smithi094.stdout:(134/156): NetworkManager-1.46.0-1.el9.x86_64.r 12 MB/s | 2.3 MB 00:00 2024-03-12T17:16:27.024 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 99/180 2024-03-12T17:16:27.066 INFO:teuthology.orchestra.run.smithi094.stdout:(135/156): NetworkManager-libnm-1.46.0-1.el9.x8 11 MB/s | 1.8 MB 00:00 2024-03-12T17:16:27.165 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 100/180 2024-03-12T17:16:27.292 INFO:teuthology.orchestra.run.smithi094.stdout:(136/156): NetworkManager-team-1.46.0-1.el9.x86 189 kB/s | 42 kB 00:00 2024-03-12T17:16:27.367 INFO:teuthology.orchestra.run.smithi094.stdout:(137/156): NetworkManager-tui-1.46.0-1.el9.x86_ 3.3 MB/s | 248 kB 00:00 2024-03-12T17:16:27.434 INFO:teuthology.orchestra.run.smithi094.stdout:(138/156): acl-2.3.1-4.el9.x86_64.rpm 1.1 MB/s | 71 kB 00:00 2024-03-12T17:16:27.484 INFO:teuthology.orchestra.run.smithi094.stdout:(139/156): elfutils-debuginfod-client-0.190-2.e 739 kB/s | 36 kB 00:00 2024-03-12T17:16:27.609 INFO:teuthology.orchestra.run.smithi094.stdout:(140/156): elfutils-libelf-0.190-2.el9.x86_64.r 1.5 MB/s | 192 kB 00:00 2024-03-12T17:16:27.726 INFO:teuthology.orchestra.run.smithi094.stdout:(141/156): elfutils-libs-0.190-2.el9.x86_64.rpm 2.2 MB/s | 256 kB 00:00 2024-03-12T17:16:27.794 INFO:teuthology.orchestra.run.smithi094.stdout:(142/156): libacl-2.3.1-4.el9.x86_64.rpm 350 kB/s | 23 kB 00:00 2024-03-12T17:16:27.860 INFO:teuthology.orchestra.run.smithi094.stdout:(143/156): libblkid-2.37.4-18.el9.x86_64.rpm 1.6 MB/s | 108 kB 00:00 2024-03-12T17:16:27.927 INFO:teuthology.orchestra.run.smithi094.stdout:(144/156): libfdisk-2.37.4-18.el9.x86_64.rpm 2.3 MB/s | 155 kB 00:00 2024-03-12T17:16:28.002 INFO:teuthology.orchestra.run.smithi094.stdout:(145/156): libmount-2.37.4-18.el9.x86_64.rpm 1.9 MB/s | 136 kB 00:00 2024-03-12T17:16:28.061 INFO:teuthology.orchestra.run.smithi094.stdout:(146/156): libsmartcols-2.37.4-18.el9.x86_64.rp 1.1 MB/s | 64 kB 00:00 2024-03-12T17:16:28.111 INFO:teuthology.orchestra.run.smithi094.stdout:(147/156): libuuid-2.37.4-18.el9.x86_64.rpm 586 kB/s | 29 kB 00:00 2024-03-12T17:16:28.245 INFO:teuthology.orchestra.run.smithi094.stdout:(148/156): openssl-3.0.7-27.el9.x86_64.rpm 9.2 MB/s | 1.2 MB 00:00 2024-03-12T17:16:28.429 INFO:teuthology.orchestra.run.smithi094.stdout:(149/156): openssl-libs-3.0.7-27.el9.x86_64.rpm 12 MB/s | 2.2 MB 00:00 2024-03-12T17:16:28.612 INFO:teuthology.orchestra.run.smithi094.stdout:(150/156): util-linux-2.37.4-18.el9.x86_64.rpm 13 MB/s | 2.3 MB 00:00 2024-03-12T17:16:28.704 INFO:teuthology.orchestra.run.smithi094.stdout:(151/156): util-linux-core-2.37.4-18.el9.x86_64 5.0 MB/s | 465 kB 00:00 2024-03-12T17:16:28.800 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 101/180 2024-03-12T17:16:28.805 INFO:teuthology.orchestra.run.smithi094.stdout:(152/156): util-linux-user-2.37.4-18.el9.x86_64 313 kB/s | 31 kB 00:00 2024-03-12T17:16:28.903 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 102/180 2024-03-12T17:16:28.938 INFO:teuthology.orchestra.run.smithi094.stdout:(153/156): librbd1-18.2.2-797.g49e4a679.el9.x86 653 kB/s | 3.0 MB 00:04 2024-03-12T17:16:28.941 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 103/180 2024-03-12T17:16:28.972 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : jq-1.6-16.el9.x86_64 104/180 2024-03-12T17:16:29.013 INFO:teuthology.orchestra.run.smithi094.stdout:(154/156): xfsprogs-6.3.0-1.el9.x86_64.rpm 5.2 MB/s | 1.1 MB 00:00 2024-03-12T17:16:29.014 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 105/180 2024-03-12T17:16:29.403 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 106/180 2024-03-12T17:16:29.443 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : librbd1-2:18.2.2-797.g49e4a679.el9.x86_64 107/180 2024-03-12T17:16:29.555 INFO:teuthology.orchestra.run.smithi094.stdout:(155/156): librados2-18.2.2-797.g49e4a679.el9.x 620 kB/s | 3.3 MB 00:05 2024-03-12T17:16:29.565 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librbd1-2:18.2.2-797.g49e4a679.el9.x86_64 107/180 2024-03-12T17:16:29.600 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rbd-2:18.2.2-797.g49e4a679.el9.x86_64 108/180 2024-03-12T17:16:29.659 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 109/180 2024-03-12T17:16:29.955 INFO:teuthology.orchestra.run.smithi094.stdout:(156/156): libacl-devel-2.3.1-4.el9.x86_64.rpm 73 kB/s | 74 kB 00:01 2024-03-12T17:16:29.965 INFO:teuthology.orchestra.run.smithi094.stdout:-------------------------------------------------------------------------------- 2024-03-12T17:16:29.965 INFO:teuthology.orchestra.run.smithi094.stdout:Total 4.4 MB/s | 204 MB 00:46 2024-03-12T17:16:30.152 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 110/180 2024-03-12T17:16:30.182 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : librgw2-2:18.2.2-797.g49e4a679.el9.x86_64 111/180 2024-03-12T17:16:30.272 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librgw2-2:18.2.2-797.g49e4a679.el9.x86_64 111/180 2024-03-12T17:16:30.298 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : python3-rgw-2:18.2.2-797.g49e4a679.el9.x86_64 112/180 2024-03-12T17:16:31.200 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction check 2024-03-12T17:16:31.568 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction check succeeded. 2024-03-12T17:16:31.568 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction test 2024-03-12T17:16:32.815 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-common-2:18.2.2-797.g49e4a679.el9.x86_64 113/180 2024-03-12T17:16:32.853 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-common-2:18.2.2-797.g49e4a679.el9.x86_64 113/180 2024-03-12T17:16:33.505 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-common-2:18.2.2-797.g49e4a679.el9.x86_64 113/180 2024-03-12T17:16:33.548 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-base-2:18.2.2-797.g49e4a679.el9.x86_64 114/180 2024-03-12T17:16:33.733 INFO:teuthology.orchestra.run.smithi094.stdout:Transaction test succeeded. 2024-03-12T17:16:33.736 INFO:teuthology.orchestra.run.smithi094.stdout:Running transaction 2024-03-12T17:16:33.740 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-base-2:18.2.2-797.g49e4a679.el9.x86_64 114/180 2024-03-12T17:16:33.740 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-12T17:16:33.740 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-12T17:16:33.740 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:16:33.791 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-selinux-2:18.2.2-797.g49e4a679.el9.x86_64 115/180 2024-03-12T17:16:40.269 INFO:teuthology.orchestra.run.smithi094.stdout: Preparing : 1/1 2024-03-12T17:16:40.376 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/180 2024-03-12T17:16:40.426 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/180 2024-03-12T17:16:40.471 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/180 2024-03-12T17:16:40.581 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/180 2024-03-12T17:16:40.628 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/180 2024-03-12T17:16:40.705 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 5/180 2024-03-12T17:16:40.763 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/180 2024-03-12T17:16:40.803 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/180 2024-03-12T17:16:40.892 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/180 2024-03-12T17:16:41.293 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/180 2024-03-12T17:16:41.334 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : librados2-2:18.2.2-797.g49e4a679.el9.x86_64 10/180 2024-03-12T17:16:41.480 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librados2-2:18.2.2-797.g49e4a679.el9.x86_64 10/180 2024-03-12T17:16:41.519 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcephfs2-2:18.2.2-797.g49e4a679.el9.x86_64 11/180 2024-03-12T17:16:41.633 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libcephfs2-2:18.2.2-797.g49e4a679.el9.x86_64 11/180 2024-03-12T17:16:41.674 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-rados-2:18.2.2-797.g49e4a679.el9.x86_64 12/180 2024-03-12T17:16:41.742 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 13/180 2024-03-12T17:16:42.029 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/180 2024-03-12T17:16:42.090 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/180 2024-03-12T17:16:42.116 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcephsqlite-2:18.2.2-797.g49e4a679.el9.x86_64 16/180 2024-03-12T17:16:42.250 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libcephsqlite-2:18.2.2-797.g49e4a679.el9.x86_64 16/180 2024-03-12T17:16:42.292 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libradosstriper1-2:18.2.2-797.g49e4a679.el9.x86_ 17/180 2024-03-12T17:16:42.382 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: libradosstriper1-2:18.2.2-797.g49e4a679.el9.x86_ 17/180 2024-03-12T17:16:42.440 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/180 2024-03-12T17:16:42.483 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 19/180 2024-03-12T17:16:42.808 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 20/180 2024-03-12T17:16:42.998 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 21/180 2024-03-12T17:16:43.070 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 21/180 2024-03-12T17:16:43.279 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 22/180 2024-03-12T17:16:43.345 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : NetworkManager-1:1.46.0-1.el9.x86_64 22/180 2024-03-12T17:16:43.776 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 22/180 2024-03-12T17:16:43.849 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 23/180 2024-03-12T17:16:43.881 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : liboath-2.6.7-2.el9.x86_64 24/180 2024-03-12T17:16:43.949 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 25/180 2024-03-12T17:16:44.069 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 26/180 2024-03-12T17:16:44.139 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/180 2024-03-12T17:16:44.190 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/180 2024-03-12T17:16:44.282 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 29/180 2024-03-12T17:16:44.329 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 30/180 2024-03-12T17:16:44.363 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 31/180 2024-03-12T17:16:44.473 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 32/180 2024-03-12T17:16:44.509 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-ceph-common-2:18.2.2-797.g49e4a679.el9.x 33/180 2024-03-12T17:16:44.545 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-ceph-argparse-2:18.2.2-797.g49e4a679.el9 34/180 2024-03-12T17:16:44.632 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cephfs-2:18.2.2-797.g49e4a679.el9.x86_64 35/180 2024-03-12T17:16:44.803 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/180 2024-03-12T17:16:44.870 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/180 2024-03-12T17:16:45.556 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/180 2024-03-12T17:16:45.644 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/180 2024-03-12T17:16:45.743 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 40/180 2024-03-12T17:16:45.785 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 41/180 2024-03-12T17:16:45.815 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 41/180 2024-03-12T17:16:45.874 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 42/180 2024-03-12T17:16:45.920 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : librados-devel-2:18.2.2-797.g49e4a679.el9.x86_64 43/180 2024-03-12T17:16:45.956 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/180 2024-03-12T17:16:46.350 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 45/180 2024-03-12T17:16:46.585 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 46/180 2024-03-12T17:16:46.664 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 47/180 2024-03-12T17:16:46.726 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 48/180 2024-03-12T17:16:46.923 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 49/180 2024-03-12T17:16:46.966 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 50/180 2024-03-12T17:16:47.066 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-selinux-2:18.2.2-797.g49e4a679.el9.x86_64 115/180 2024-03-12T17:16:47.067 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /sys 2024-03-12T17:16:47.067 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /proc 2024-03-12T17:16:47.067 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /mnt 2024-03-12T17:16:47.067 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /var/tmp 2024-03-12T17:16:47.067 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /home 2024-03-12T17:16:47.068 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /root 2024-03-12T17:16:47.068 INFO:teuthology.orchestra.run.smithi017.stdout:skipping the directory /tmp 2024-03-12T17:16:47.068 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:16:47.107 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : re2-1:20211101-3.el9.x86_64 51/180 2024-03-12T17:16:47.153 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 52/180 2024-03-12T17:16:47.215 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 53/180 2024-03-12T17:16:47.288 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-volume-2:18.2.2-797.g49e4a679.el9.noarch 116/180 2024-03-12T17:16:47.302 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 54/180 2024-03-12T17:16:47.331 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-volume-2:18.2.2-797.g49e4a679.el9.noarch 116/180 2024-03-12T17:16:47.331 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-12T17:16:47.331 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-12T17:16:47.331 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:16:47.345 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 55/180 2024-03-12T17:16:47.384 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 56/180 2024-03-12T17:16:47.449 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 57/180 2024-03-12T17:16:47.510 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 58/180 2024-03-12T17:16:47.570 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 59/180 2024-03-12T17:16:47.760 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 60/180 2024-03-12T17:16:47.811 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 61/180 2024-03-12T17:16:47.854 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 62/180 2024-03-12T17:16:47.981 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 63/180 2024-03-12T17:16:48.018 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 64/180 2024-03-12T17:16:48.062 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 65/180 2024-03-12T17:16:48.091 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 66/180 2024-03-12T17:16:48.121 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 67/180 2024-03-12T17:16:48.257 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : fmt-8.1.1-5.el9.x86_64 68/180 2024-03-12T17:16:48.307 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 69/180 2024-03-12T17:16:48.373 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-ply-3.11-14.el9.noarch 70/180 2024-03-12T17:16:48.445 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 71/180 2024-03-12T17:16:48.691 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 72/180 2024-03-12T17:16:48.744 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 73/180 2024-03-12T17:16:48.913 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 74/180 2024-03-12T17:16:48.963 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 75/180 2024-03-12T17:16:48.998 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 76/180 2024-03-12T17:16:49.036 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : fuse-2.9.9-15.el9.x86_64 77/180 2024-03-12T17:16:49.077 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 78/180 2024-03-12T17:16:49.083 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-osd-2:18.2.2-797.g49e4a679.el9.x86_64 117/180 2024-03-12T17:16:49.122 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 79/180 2024-03-12T17:16:49.167 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-osd-2:18.2.2-797.g49e4a679.el9.x86_64 117/180 2024-03-12T17:16:49.167 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-12T17:16:49.168 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-12T17:16:49.168 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-12T17:16:49.168 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-12T17:16:49.168 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:16:49.177 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : uuid-1.6.2-55.el9.x86_64 80/180 2024-03-12T17:16:49.223 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 81/180 2024-03-12T17:16:49.350 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 82/180 2024-03-12T17:16:49.394 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 83/180 2024-03-12T17:16:49.408 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mds-2:18.2.2-797.g49e4a679.el9.x86_64 118/180 2024-03-12T17:16:49.429 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 84/180 2024-03-12T17:16:49.482 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 85/180 2024-03-12T17:16:49.490 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mds-2:18.2.2-797.g49e4a679.el9.x86_64 118/180 2024-03-12T17:16:49.490 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-12T17:16:49.490 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-12T17:16:49.490 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-12T17:16:49.490 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-12T17:16:49.490 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:16:49.523 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 86/180 2024-03-12T17:16:49.663 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 87/180 2024-03-12T17:16:49.713 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 88/180 2024-03-12T17:16:49.771 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 89/180 2024-03-12T17:16:49.911 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-packaging-20.9-5.el9.noarch 90/180 2024-03-12T17:16:49.974 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 91/180 2024-03-12T17:16:50.017 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mon-2:18.2.2-797.g49e4a679.el9.x86_64 119/180 2024-03-12T17:16:50.091 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mon-2:18.2.2-797.g49e4a679.el9.x86_64 119/180 2024-03-12T17:16:50.091 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-12T17:16:50.091 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-12T17:16:50.092 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-12T17:16:50.092 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-12T17:16:50.092 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:16:50.219 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : automake-1.16.2-8.el9.noarch 120/180 2024-03-12T17:16:50.796 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: cephadm-2:18.2.2-797.g49e4a679.el9.noarch 121/180 2024-03-12T17:16:50.838 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephadm-2:18.2.2-797.g49e4a679.el9.noarch 121/180 2024-03-12T17:16:50.885 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-797.g49e4a679.el 122/180 2024-03-12T17:16:50.951 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/180 2024-03-12T17:16:50.993 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-797.g49e4a679.e 123/180 2024-03-12T17:16:51.008 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 93/180 2024-03-12T17:16:51.041 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-797.g49e4a679.el9.noar 124/180 2024-03-12T17:16:51.041 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 94/180 2024-03-12T17:16:51.075 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 95/180 2024-03-12T17:16:51.319 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : openblas-0.3.21-2.el9.x86_64 96/180 2024-03-12T17:16:51.354 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 97/180 2024-03-12T17:16:51.368 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-797.g49e4a679.el9.noar 124/180 2024-03-12T17:16:51.400 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-797.g49e4a679.el9.no 125/180 2024-03-12T17:16:51.453 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 98/180 2024-03-12T17:16:52.232 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 99/180 2024-03-12T17:16:52.356 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 100/180 2024-03-12T17:16:52.591 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-797.g49e4a679.el9.no 125/180 2024-03-12T17:16:52.617 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-797.g49e4 126/180 2024-03-12T17:16:52.766 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-797.g49e4 126/180 2024-03-12T17:16:52.939 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-797.g49e4a679.el9 127/180 2024-03-12T17:16:52.969 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-2:18.2.2-797.g49e4a679.el9.x86_64 128/180 2024-03-12T17:16:53.069 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-2:18.2.2-797.g49e4a679.el9.x86_64 128/180 2024-03-12T17:16:53.070 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-12T17:16:53.070 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-12T17:16:53.070 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-12T17:16:53.070 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-12T17:16:53.070 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:16:53.128 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-mgr-rook-2:18.2.2-797.g49e4a679.el9.noarch 129/180 2024-03-12T17:16:53.168 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-797.g49e4a679.el9.noarch 129/180 2024-03-12T17:16:53.237 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-2:18.2.2-797.g49e4a679.el9.x86_64 130/180 2024-03-12T17:16:53.853 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 101/180 2024-03-12T17:16:53.951 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 102/180 2024-03-12T17:16:53.989 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 103/180 2024-03-12T17:16:54.020 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : jq-1.6-16.el9.x86_64 104/180 2024-03-12T17:16:54.059 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libtool-2.4.6-45.el9.x86_64 131/180 2024-03-12T17:16:54.060 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 105/180 2024-03-12T17:16:54.089 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-radosgw-2:18.2.2-797.g49e4a679.el9.x86_64 132/180 2024-03-12T17:16:54.189 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-797.g49e4a679.el9.x86_64 132/180 2024-03-12T17:16:54.189 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-12T17:16:54.190 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-12T17:16:54.190 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-12T17:16:54.190 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-12T17:16:54.190 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:16:54.239 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-797.g49e4a6 133/180 2024-03-12T17:16:54.336 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-797.g49e4a6 133/180 2024-03-12T17:16:54.336 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-12T17:16:54.336 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-12T17:16:54.337 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:16:54.415 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephfs-mirror-2:18.2.2-797.g49e4a679.el9.x86_64 134/180 2024-03-12T17:16:54.418 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 106/180 2024-03-12T17:16:54.458 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : librbd1-2:18.2.2-797.g49e4a679.el9.x86_64 107/180 2024-03-12T17:16:54.524 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-797.g49e4a679.el9.x86_64 134/180 2024-03-12T17:16:54.524 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-12T17:16:54.524 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-12T17:16:54.524 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-12T17:16:54.525 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-12T17:16:54.525 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:16:54.570 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librbd1-2:18.2.2-797.g49e4a679.el9.x86_64 107/180 2024-03-12T17:16:54.606 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-rbd-2:18.2.2-797.g49e4a679.el9.x86_64 108/180 2024-03-12T17:16:54.671 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 109/180 2024-03-12T17:16:54.916 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-mirror-2:18.2.2-797.g49e4a679.el9.x86_64 135/180 2024-03-12T17:16:55.017 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: rbd-mirror-2:18.2.2-797.g49e4a679.el9.x86_64 135/180 2024-03-12T17:16:55.017 INFO:teuthology.orchestra.run.smithi017.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-12T17:16:55.017 INFO:teuthology.orchestra.run.smithi017.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-12T17:16:55.017 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-12T17:16:55.017 INFO:teuthology.orchestra.run.smithi017.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-12T17:16:55.017 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:16:55.127 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 110/180 2024-03-12T17:16:55.153 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : librgw2-2:18.2.2-797.g49e4a679.el9.x86_64 111/180 2024-03-12T17:16:55.244 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librgw2-2:18.2.2-797.g49e4a679.el9.x86_64 111/180 2024-03-12T17:16:55.280 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : python3-rgw-2:18.2.2-797.g49e4a679.el9.x86_64 112/180 2024-03-12T17:16:58.304 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-common-2:18.2.2-797.g49e4a679.el9.x86_64 113/180 2024-03-12T17:16:58.343 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-common-2:18.2.2-797.g49e4a679.el9.x86_64 113/180 2024-03-12T17:16:58.964 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-common-2:18.2.2-797.g49e4a679.el9.x86_64 113/180 2024-03-12T17:16:59.005 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-base-2:18.2.2-797.g49e4a679.el9.x86_64 114/180 2024-03-12T17:16:59.141 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-base-2:18.2.2-797.g49e4a679.el9.x86_64 114/180 2024-03-12T17:16:59.141 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-12T17:16:59.141 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-12T17:16:59.141 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:16:59.181 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-selinux-2:18.2.2-797.g49e4a679.el9.x86_64 115/180 2024-03-12T17:16:59.239 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-test-2:18.2.2-797.g49e4a679.el9.x86_64 136/180 2024-03-12T17:16:59.302 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-fuse-2:18.2.2-797.g49e4a679.el9.x86_64 137/180 2024-03-12T17:16:59.344 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : rbd-nbd-2:18.2.2-797.g49e4a679.el9.x86_64 138/180 2024-03-12T17:16:59.637 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 139/180 2024-03-12T17:16:59.757 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 140/180 2024-03-12T17:16:59.804 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : ceph-fuse-2:18.2.2-797.g49e4a679.el9.x86_64 141/180 2024-03-12T17:16:59.861 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/180 2024-03-12T17:16:59.929 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 143/180 2024-03-12T17:16:59.982 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 144/180 2024-03-12T17:17:00.017 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libcephfs-devel-2:18.2.2-797.g49e4a679.el9.x86_6 145/180 2024-03-12T17:17:00.071 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 146/180 2024-03-12T17:17:00.123 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : NetworkManager-team-1:1.46.0-1.el9.x86_64 147/180 2024-03-12T17:17:00.209 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : NetworkManager-tui-1:1.46.0-1.el9.x86_64 148/180 2024-03-12T17:17:00.358 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 149/180 2024-03-12T17:17:00.412 INFO:teuthology.orchestra.run.smithi017.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 150/180 2024-03-12T17:17:01.420 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 151/180 2024-03-12T17:17:01.477 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 151/180 2024-03-12T17:17:01.538 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 151/180 2024-03-12T17:17:02.983 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : cephfs-top-2:18.2.2-797.g49e4a679.el9.noarch 152/180 2024-03-12T17:17:03.084 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 153/180 2024-03-12T17:17:03.160 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/180 2024-03-12T17:17:03.293 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/180 2024-03-12T17:17:03.329 INFO:teuthology.orchestra.run.smithi017.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/180 2024-03-12T17:17:03.362 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 157/180 2024-03-12T17:17:03.396 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 158/180 2024-03-12T17:17:03.439 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 159/180 2024-03-12T17:17:03.439 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/180 2024-03-12T17:17:03.584 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/180 2024-03-12T17:17:03.634 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 161/180 2024-03-12T17:17:03.634 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 162/180 2024-03-12T17:17:03.781 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 162/180 2024-03-12T17:17:03.825 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 163/180 2024-03-12T17:17:03.870 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 164/180 2024-03-12T17:17:03.903 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 165/180 2024-03-12T17:17:03.936 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 166/180 2024-03-12T17:17:04.007 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 167/180 2024-03-12T17:17:04.085 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 168/180 2024-03-12T17:17:04.132 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 169/180 2024-03-12T17:17:04.166 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 170/180 2024-03-12T17:17:04.200 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 171/180 2024-03-12T17:17:04.265 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 172/180 2024-03-12T17:17:04.305 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 173/180 2024-03-12T17:17:04.347 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 174/180 2024-03-12T17:17:04.348 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 174/180 2024-03-12T17:17:04.658 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 174/180 2024-03-12T17:17:04.659 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 175/180 2024-03-12T17:17:04.805 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 175/180 2024-03-12T17:17:04.861 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 176/180 2024-03-12T17:17:04.895 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 177/180 2024-03-12T17:17:04.931 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 178/180 2024-03-12T17:17:04.971 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 179/180 2024-03-12T17:17:05.096 INFO:teuthology.orchestra.run.smithi017.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 180/180 2024-03-12T17:17:05.379 INFO:teuthology.orchestra.run.smithi017.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 180/180 2024-03-12T17:17:05.380 INFO:teuthology.orchestra.run.smithi017.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-03-12T17:17:05.380 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:17:09.931 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-2:18.2.2-797.g49e4a679.el9.x86_64 1/180 2024-03-12T17:17:09.931 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-base-2:18.2.2-797.g49e4a679.el9.x86_64 2/180 2024-03-12T17:17:09.931 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-common-2:18.2.2-797.g49e4a679.el9.x86_64 3/180 2024-03-12T17:17:09.931 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-fuse-2:18.2.2-797.g49e4a679.el9.x86_64 4/180 2024-03-12T17:17:09.931 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-797.g49e4a6 5/180 2024-03-12T17:17:09.931 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mds-2:18.2.2-797.g49e4a679.el9.x86_64 6/180 2024-03-12T17:17:09.931 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-2:18.2.2-797.g49e4a679.el9.x86_64 7/180 2024-03-12T17:17:09.932 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mon-2:18.2.2-797.g49e4a679.el9.x86_64 8/180 2024-03-12T17:17:09.932 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-osd-2:18.2.2-797.g49e4a679.el9.x86_64 9/180 2024-03-12T17:17:09.932 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-radosgw-2:18.2.2-797.g49e4a679.el9.x86_64 10/180 2024-03-12T17:17:09.932 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-selinux-2:18.2.2-797.g49e4a679.el9.x86_64 11/180 2024-03-12T17:17:09.932 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-test-2:18.2.2-797.g49e4a679.el9.x86_64 12/180 2024-03-12T17:17:09.932 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephfs-mirror-2:18.2.2-797.g49e4a679.el9.x86_64 13/180 2024-03-12T17:17:09.932 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephfs-devel-2:18.2.2-797.g49e4a679.el9.x86_6 14/180 2024-03-12T17:17:09.932 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephfs2-2:18.2.2-797.g49e4a679.el9.x86_64 15/180 2024-03-12T17:17:09.932 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libcephsqlite-2:18.2.2-797.g49e4a679.el9.x86_64 16/180 2024-03-12T17:17:09.932 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados-devel-2:18.2.2-797.g49e4a679.el9.x86_64 17/180 2024-03-12T17:17:09.932 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libradosstriper1-2:18.2.2-797.g49e4a679.el9.x86_ 18/180 2024-03-12T17:17:09.932 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librgw2-2:18.2.2-797.g49e4a679.el9.x86_64 19/180 2024-03-12T17:17:09.932 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ceph-argparse-2:18.2.2-797.g49e4a679.el9 20/180 2024-03-12T17:17:09.933 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ceph-common-2:18.2.2-797.g49e4a679.el9.x 21/180 2024-03-12T17:17:09.933 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cephfs-2:18.2.2-797.g49e4a679.el9.x86_64 22/180 2024-03-12T17:17:09.933 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rados-2:18.2.2-797.g49e4a679.el9.x86_64 23/180 2024-03-12T17:17:09.933 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rbd-2:18.2.2-797.g49e4a679.el9.x86_64 24/180 2024-03-12T17:17:09.933 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rgw-2:18.2.2-797.g49e4a679.el9.x86_64 25/180 2024-03-12T17:17:09.933 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-fuse-2:18.2.2-797.g49e4a679.el9.x86_64 26/180 2024-03-12T17:17:09.933 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-mirror-2:18.2.2-797.g49e4a679.el9.x86_64 27/180 2024-03-12T17:17:09.933 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : rbd-nbd-2:18.2.2-797.g49e4a679.el9.x86_64 28/180 2024-03-12T17:17:09.933 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-797.g49e4a679.e 29/180 2024-03-12T17:17:09.949 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-797.g49e4a679.el9.noar 30/180 2024-03-12T17:17:09.949 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-797.g49e4a679.el9.no 31/180 2024-03-12T17:17:09.949 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-797.g49e4 32/180 2024-03-12T17:17:09.949 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-797.g49e4a679.el9 33/180 2024-03-12T17:17:09.949 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-mgr-rook-2:18.2.2-797.g49e4a679.el9.noarch 34/180 2024-03-12T17:17:09.949 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-797.g49e4a679.el 35/180 2024-03-12T17:17:09.949 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : ceph-volume-2:18.2.2-797.g49e4a679.el9.noarch 36/180 2024-03-12T17:17:09.949 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephadm-2:18.2.2-797.g49e4a679.el9.noarch 37/180 2024-03-12T17:17:09.949 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : cephfs-top-2:18.2.2-797.g49e4a679.el9.noarch 38/180 2024-03-12T17:17:09.949 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/180 2024-03-12T17:17:09.949 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/180 2024-03-12T17:17:09.949 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/180 2024-03-12T17:17:09.950 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flex-2.6.4-9.el9.x86_64 42/180 2024-03-12T17:17:09.950 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 43/180 2024-03-12T17:17:09.950 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 44/180 2024-03-12T17:17:09.950 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 45/180 2024-03-12T17:17:09.950 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 46/180 2024-03-12T17:17:09.950 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 47/180 2024-03-12T17:17:09.950 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 48/180 2024-03-12T17:17:09.950 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 49/180 2024-03-12T17:17:09.950 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 50/180 2024-03-12T17:17:09.950 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 51/180 2024-03-12T17:17:09.950 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 52/180 2024-03-12T17:17:09.950 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 53/180 2024-03-12T17:17:09.951 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 54/180 2024-03-12T17:17:09.951 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 55/180 2024-03-12T17:17:09.951 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-13.11-1.el9.x86_64 56/180 2024-03-12T17:17:09.951 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 57/180 2024-03-12T17:17:09.951 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 58/180 2024-03-12T17:17:09.951 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 59/180 2024-03-12T17:17:09.951 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 60/180 2024-03-12T17:17:09.951 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/180 2024-03-12T17:17:09.951 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/180 2024-03-12T17:17:09.951 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/180 2024-03-12T17:17:09.951 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/180 2024-03-12T17:17:09.951 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/180 2024-03-12T17:17:09.951 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/180 2024-03-12T17:17:09.952 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/180 2024-03-12T17:17:09.952 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 68/180 2024-03-12T17:17:09.952 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 69/180 2024-03-12T17:17:09.952 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 70/180 2024-03-12T17:17:09.952 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 71/180 2024-03-12T17:17:09.952 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 72/180 2024-03-12T17:17:09.952 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 73/180 2024-03-12T17:17:09.952 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 74/180 2024-03-12T17:17:09.952 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 75/180 2024-03-12T17:17:09.952 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 76/180 2024-03-12T17:17:09.952 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 77/180 2024-03-12T17:17:09.952 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 78/180 2024-03-12T17:17:09.952 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 79/180 2024-03-12T17:17:09.952 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 80/180 2024-03-12T17:17:09.953 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 81/180 2024-03-12T17:17:09.953 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 82/180 2024-03-12T17:17:09.953 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-ply-3.11-14.el9.noarch 83/180 2024-03-12T17:17:09.953 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 84/180 2024-03-12T17:17:09.953 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 85/180 2024-03-12T17:17:09.953 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : jq-1.6-16.el9.x86_64 86/180 2024-03-12T17:17:09.953 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 87/180 2024-03-12T17:17:09.953 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 88/180 2024-03-12T17:17:09.953 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 89/180 2024-03-12T17:17:09.953 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 90/180 2024-03-12T17:17:09.953 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 91/180 2024-03-12T17:17:09.954 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 92/180 2024-03-12T17:17:09.954 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 93/180 2024-03-12T17:17:09.954 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 94/180 2024-03-12T17:17:09.954 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 95/180 2024-03-12T17:17:09.954 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 96/180 2024-03-12T17:17:09.954 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 97/180 2024-03-12T17:17:09.954 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 98/180 2024-03-12T17:17:09.954 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 99/180 2024-03-12T17:17:09.954 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/180 2024-03-12T17:17:09.954 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/180 2024-03-12T17:17:09.954 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 102/180 2024-03-12T17:17:09.954 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 103/180 2024-03-12T17:17:09.954 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 104/180 2024-03-12T17:17:09.955 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 105/180 2024-03-12T17:17:09.955 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 106/180 2024-03-12T17:17:09.955 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 107/180 2024-03-12T17:17:09.955 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 108/180 2024-03-12T17:17:09.955 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 109/180 2024-03-12T17:17:09.955 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 110/180 2024-03-12T17:17:09.955 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 111/180 2024-03-12T17:17:09.955 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 112/180 2024-03-12T17:17:09.955 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 113/180 2024-03-12T17:17:09.955 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 114/180 2024-03-12T17:17:09.955 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 115/180 2024-03-12T17:17:09.955 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 116/180 2024-03-12T17:17:09.955 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 117/180 2024-03-12T17:17:09.955 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 118/180 2024-03-12T17:17:09.955 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 119/180 2024-03-12T17:17:09.956 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 120/180 2024-03-12T17:17:09.956 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/180 2024-03-12T17:17:09.956 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 122/180 2024-03-12T17:17:09.956 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 123/180 2024-03-12T17:17:09.956 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 124/180 2024-03-12T17:17:09.956 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 125/180 2024-03-12T17:17:09.956 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 126/180 2024-03-12T17:17:09.956 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 127/180 2024-03-12T17:17:09.956 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 128/180 2024-03-12T17:17:09.956 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 129/180 2024-03-12T17:17:09.956 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 130/180 2024-03-12T17:17:09.956 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : re2-1:20211101-3.el9.x86_64 131/180 2024-03-12T17:17:09.957 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 132/180 2024-03-12T17:17:09.957 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados2-2:18.2.2-797.g49e4a679.el9.x86_64 133/180 2024-03-12T17:17:09.957 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 134/180 2024-03-12T17:17:09.957 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librbd1-2:18.2.2-797.g49e4a679.el9.x86_64 135/180 2024-03-12T17:17:09.957 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 136/180 2024-03-12T17:17:09.957 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 137/180 2024-03-12T17:17:09.957 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 138/180 2024-03-12T17:17:09.957 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-1:1.46.0-1.el9.x86_64 139/180 2024-03-12T17:17:09.957 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 140/180 2024-03-12T17:17:09.957 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 141/180 2024-03-12T17:17:09.957 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 142/180 2024-03-12T17:17:09.957 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-team-1:1.46.0-1.el9.x86_64 143/180 2024-03-12T17:17:09.957 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 144/180 2024-03-12T17:17:09.957 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-tui-1:1.46.0-1.el9.x86_64 145/180 2024-03-12T17:17:09.958 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 146/180 2024-03-12T17:17:09.958 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : acl-2.3.1-4.el9.x86_64 147/180 2024-03-12T17:17:09.958 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : acl-2.3.1-3.el9.x86_64 148/180 2024-03-12T17:17:09.958 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 149/180 2024-03-12T17:17:09.958 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 150/180 2024-03-12T17:17:09.958 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 151/180 2024-03-12T17:17:09.958 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 152/180 2024-03-12T17:17:09.958 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 153/180 2024-03-12T17:17:09.958 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 154/180 2024-03-12T17:17:09.958 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 155/180 2024-03-12T17:17:09.958 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 156/180 2024-03-12T17:17:09.958 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 157/180 2024-03-12T17:17:09.958 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 158/180 2024-03-12T17:17:09.959 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 159/180 2024-03-12T17:17:09.959 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 160/180 2024-03-12T17:17:09.959 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 161/180 2024-03-12T17:17:09.959 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 162/180 2024-03-12T17:17:09.959 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 163/180 2024-03-12T17:17:09.959 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 164/180 2024-03-12T17:17:09.959 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 165/180 2024-03-12T17:17:09.959 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 166/180 2024-03-12T17:17:09.959 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 167/180 2024-03-12T17:17:09.959 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 168/180 2024-03-12T17:17:09.959 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 169/180 2024-03-12T17:17:09.959 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 170/180 2024-03-12T17:17:09.959 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 171/180 2024-03-12T17:17:09.959 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 172/180 2024-03-12T17:17:09.960 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 173/180 2024-03-12T17:17:09.960 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 174/180 2024-03-12T17:17:09.960 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 175/180 2024-03-12T17:17:09.960 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 176/180 2024-03-12T17:17:09.960 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 177/180 2024-03-12T17:17:09.960 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 178/180 2024-03-12T17:17:09.960 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 179/180 2024-03-12T17:17:11.534 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-selinux-2:18.2.2-797.g49e4a679.el9.x86_64 115/180 2024-03-12T17:17:11.534 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /sys 2024-03-12T17:17:11.534 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /proc 2024-03-12T17:17:11.534 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /mnt 2024-03-12T17:17:11.534 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /var/tmp 2024-03-12T17:17:11.534 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /home 2024-03-12T17:17:11.534 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /root 2024-03-12T17:17:11.534 INFO:teuthology.orchestra.run.smithi094.stdout:skipping the directory /tmp 2024-03-12T17:17:11.534 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:11.737 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-volume-2:18.2.2-797.g49e4a679.el9.noarch 116/180 2024-03-12T17:17:11.796 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-volume-2:18.2.2-797.g49e4a679.el9.noarch 116/180 2024-03-12T17:17:11.796 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-12T17:17:11.796 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-12T17:17:11.796 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:12.305 INFO:teuthology.orchestra.run.smithi017.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 180/180 2024-03-12T17:17:12.305 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:17:12.305 INFO:teuthology.orchestra.run.smithi017.stdout:Upgraded: 2024-03-12T17:17:12.305 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-1:1.46.0-1.el9.x86_64 2024-03-12T17:17:12.305 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 2024-03-12T17:17:12.306 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-team-1:1.46.0-1.el9.x86_64 2024-03-12T17:17:12.306 INFO:teuthology.orchestra.run.smithi017.stdout: NetworkManager-tui-1:1.46.0-1.el9.x86_64 2024-03-12T17:17:12.306 INFO:teuthology.orchestra.run.smithi017.stdout: acl-2.3.1-4.el9.x86_64 2024-03-12T17:17:12.306 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-12T17:17:12.306 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-12T17:17:12.306 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-12T17:17:12.306 INFO:teuthology.orchestra.run.smithi017.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-12T17:17:12.306 INFO:teuthology.orchestra.run.smithi017.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-12T17:17:12.306 INFO:teuthology.orchestra.run.smithi017.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-12T17:17:12.306 INFO:teuthology.orchestra.run.smithi017.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-12T17:17:12.306 INFO:teuthology.orchestra.run.smithi017.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-12T17:17:12.306 INFO:teuthology.orchestra.run.smithi017.stdout: librados2-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:12.306 INFO:teuthology.orchestra.run.smithi017.stdout: librbd1-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:12.307 INFO:teuthology.orchestra.run.smithi017.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-12T17:17:12.307 INFO:teuthology.orchestra.run.smithi017.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-12T17:17:12.307 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-12T17:17:12.307 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-12T17:17:12.307 INFO:teuthology.orchestra.run.smithi017.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-12T17:17:12.307 INFO:teuthology.orchestra.run.smithi017.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-12T17:17:12.307 INFO:teuthology.orchestra.run.smithi017.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-12T17:17:12.307 INFO:teuthology.orchestra.run.smithi017.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-12T17:17:12.307 INFO:teuthology.orchestra.run.smithi017.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-12T17:17:12.307 INFO:teuthology.orchestra.run.smithi017.stdout:Installed: 2024-03-12T17:17:12.307 INFO:teuthology.orchestra.run.smithi017.stdout: automake-1.16.2-8.el9.noarch 2024-03-12T17:17:12.308 INFO:teuthology.orchestra.run.smithi017.stdout: bison-3.7.4-5.el9.x86_64 2024-03-12T17:17:12.308 INFO:teuthology.orchestra.run.smithi017.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-12T17:17:12.308 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:12.308 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-base-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:12.308 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-common-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:12.308 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-fuse-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:12.308 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-grafana-dashboards-2:18.2.2-797.g49e4a679.el9.noarch 2024-03-12T17:17:12.308 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-immutable-object-cache-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:12.308 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mds-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:12.308 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:12.308 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-cephadm-2:18.2.2-797.g49e4a679.el9.noarch 2024-03-12T17:17:12.308 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-dashboard-2:18.2.2-797.g49e4a679.el9.noarch 2024-03-12T17:17:12.308 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-diskprediction-local-2:18.2.2-797.g49e4a679.el9.noarch 2024-03-12T17:17:12.308 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-modules-core-2:18.2.2-797.g49e4a679.el9.noarch 2024-03-12T17:17:12.309 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mgr-rook-2:18.2.2-797.g49e4a679.el9.noarch 2024-03-12T17:17:12.309 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-mon-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:12.309 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-osd-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:12.309 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-prometheus-alerts-2:18.2.2-797.g49e4a679.el9.noarch 2024-03-12T17:17:12.309 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-radosgw-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:12.309 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-selinux-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:12.309 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-test-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:12.309 INFO:teuthology.orchestra.run.smithi017.stdout: ceph-volume-2:18.2.2-797.g49e4a679.el9.noarch 2024-03-12T17:17:12.309 INFO:teuthology.orchestra.run.smithi017.stdout: cephadm-2:18.2.2-797.g49e4a679.el9.noarch 2024-03-12T17:17:12.309 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-mirror-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:12.309 INFO:teuthology.orchestra.run.smithi017.stdout: cephfs-top-2:18.2.2-797.g49e4a679.el9.noarch 2024-03-12T17:17:12.309 INFO:teuthology.orchestra.run.smithi017.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-12T17:17:12.309 INFO:teuthology.orchestra.run.smithi017.stdout: flex-2.6.4-9.el9.x86_64 2024-03-12T17:17:12.309 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-12T17:17:12.310 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-12T17:17:12.310 INFO:teuthology.orchestra.run.smithi017.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-12T17:17:12.310 INFO:teuthology.orchestra.run.smithi017.stdout: fmt-8.1.1-5.el9.x86_64 2024-03-12T17:17:12.310 INFO:teuthology.orchestra.run.smithi017.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-12T17:17:12.310 INFO:teuthology.orchestra.run.smithi017.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-12T17:17:12.310 INFO:teuthology.orchestra.run.smithi017.stdout: jq-1.6-16.el9.x86_64 2024-03-12T17:17:12.310 INFO:teuthology.orchestra.run.smithi017.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-12T17:17:12.310 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-12T17:17:12.310 INFO:teuthology.orchestra.run.smithi017.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-12T17:17:12.310 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs-devel-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:12.310 INFO:teuthology.orchestra.run.smithi017.stdout: libcephfs2-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:12.311 INFO:teuthology.orchestra.run.smithi017.stdout: libcephsqlite-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:12.311 INFO:teuthology.orchestra.run.smithi017.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-12T17:17:12.311 INFO:teuthology.orchestra.run.smithi017.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-12T17:17:12.311 INFO:teuthology.orchestra.run.smithi017.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-12T17:17:12.311 INFO:teuthology.orchestra.run.smithi017.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-12T17:17:12.311 INFO:teuthology.orchestra.run.smithi017.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-12T17:17:12.311 INFO:teuthology.orchestra.run.smithi017.stdout: librados-devel-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:12.311 INFO:teuthology.orchestra.run.smithi017.stdout: libradosstriper1-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:12.311 INFO:teuthology.orchestra.run.smithi017.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-12T17:17:12.311 INFO:teuthology.orchestra.run.smithi017.stdout: librgw2-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:12.311 INFO:teuthology.orchestra.run.smithi017.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-12T17:17:12.311 INFO:teuthology.orchestra.run.smithi017.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-12T17:17:12.311 INFO:teuthology.orchestra.run.smithi017.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-12T17:17:12.311 INFO:teuthology.orchestra.run.smithi017.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-12T17:17:12.311 INFO:teuthology.orchestra.run.smithi017.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-12T17:17:12.312 INFO:teuthology.orchestra.run.smithi017.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-12T17:17:12.312 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-12T17:17:12.312 INFO:teuthology.orchestra.run.smithi017.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-12T17:17:12.312 INFO:teuthology.orchestra.run.smithi017.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-12T17:17:12.312 INFO:teuthology.orchestra.run.smithi017.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-12T17:17:12.312 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-13.11-1.el9.x86_64 2024-03-12T17:17:12.312 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-12T17:17:12.312 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-12T17:17:12.312 INFO:teuthology.orchestra.run.smithi017.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-12T17:17:12.312 INFO:teuthology.orchestra.run.smithi017.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-12T17:17:12.312 INFO:teuthology.orchestra.run.smithi017.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-12T17:17:12.313 INFO:teuthology.orchestra.run.smithi017.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-12T17:17:12.313 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-12T17:17:12.313 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-argparse-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:12.313 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ceph-common-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:12.313 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cephfs-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:12.313 INFO:teuthology.orchestra.run.smithi017.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-12T17:17:12.313 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-12T17:17:12.313 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-12T17:17:12.313 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-12T17:17:12.313 INFO:teuthology.orchestra.run.smithi017.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-12T17:17:12.313 INFO:teuthology.orchestra.run.smithi017.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-12T17:17:12.313 INFO:teuthology.orchestra.run.smithi017.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-12T17:17:12.313 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-12T17:17:12.314 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-12T17:17:12.314 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-12T17:17:12.314 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-12T17:17:12.314 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-12T17:17:12.314 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-12T17:17:12.314 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-12T17:17:12.314 INFO:teuthology.orchestra.run.smithi017.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-12T17:17:12.314 INFO:teuthology.orchestra.run.smithi017.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-12T17:17:12.314 INFO:teuthology.orchestra.run.smithi017.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-12T17:17:12.314 INFO:teuthology.orchestra.run.smithi017.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-12T17:17:12.314 INFO:teuthology.orchestra.run.smithi017.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-12T17:17:12.314 INFO:teuthology.orchestra.run.smithi017.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-12T17:17:12.314 INFO:teuthology.orchestra.run.smithi017.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-12T17:17:12.314 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-12T17:17:12.315 INFO:teuthology.orchestra.run.smithi017.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-12T17:17:12.315 INFO:teuthology.orchestra.run.smithi017.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-12T17:17:12.315 INFO:teuthology.orchestra.run.smithi017.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-12T17:17:12.315 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-12T17:17:12.315 INFO:teuthology.orchestra.run.smithi017.stdout: python3-ply-3.11-14.el9.noarch 2024-03-12T17:17:12.315 INFO:teuthology.orchestra.run.smithi017.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-12T17:17:12.315 INFO:teuthology.orchestra.run.smithi017.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-12T17:17:12.315 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-12T17:17:12.315 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-12T17:17:12.315 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-12T17:17:12.315 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-12T17:17:12.315 INFO:teuthology.orchestra.run.smithi017.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-12T17:17:12.315 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rados-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:12.315 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rbd-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:12.315 INFO:teuthology.orchestra.run.smithi017.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-12T17:17:12.316 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-12T17:17:12.316 INFO:teuthology.orchestra.run.smithi017.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-12T17:17:12.316 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rgw-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:12.316 INFO:teuthology.orchestra.run.smithi017.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-12T17:17:12.316 INFO:teuthology.orchestra.run.smithi017.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-12T17:17:12.316 INFO:teuthology.orchestra.run.smithi017.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-12T17:17:12.316 INFO:teuthology.orchestra.run.smithi017.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-12T17:17:12.316 INFO:teuthology.orchestra.run.smithi017.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-12T17:17:12.316 INFO:teuthology.orchestra.run.smithi017.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-12T17:17:12.316 INFO:teuthology.orchestra.run.smithi017.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-12T17:17:12.316 INFO:teuthology.orchestra.run.smithi017.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-12T17:17:12.316 INFO:teuthology.orchestra.run.smithi017.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-12T17:17:12.316 INFO:teuthology.orchestra.run.smithi017.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-12T17:17:12.317 INFO:teuthology.orchestra.run.smithi017.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-12T17:17:12.317 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-fuse-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:12.317 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-mirror-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:12.317 INFO:teuthology.orchestra.run.smithi017.stdout: rbd-nbd-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:12.317 INFO:teuthology.orchestra.run.smithi017.stdout: re2-1:20211101-3.el9.x86_64 2024-03-12T17:17:12.317 INFO:teuthology.orchestra.run.smithi017.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-12T17:17:12.317 INFO:teuthology.orchestra.run.smithi017.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-12T17:17:12.317 INFO:teuthology.orchestra.run.smithi017.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-12T17:17:12.317 INFO:teuthology.orchestra.run.smithi017.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-12T17:17:12.317 INFO:teuthology.orchestra.run.smithi017.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-12T17:17:12.317 INFO:teuthology.orchestra.run.smithi017.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-12T17:17:12.318 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:17:12.318 INFO:teuthology.orchestra.run.smithi017.stdout:Complete! 2024-03-12T17:17:12.932 DEBUG:teuthology.parallel:result is None 2024-03-12T17:17:13.525 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-osd-2:18.2.2-797.g49e4a679.el9.x86_64 117/180 2024-03-12T17:17:13.602 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-osd-2:18.2.2-797.g49e4a679.el9.x86_64 117/180 2024-03-12T17:17:13.602 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-12T17:17:13.602 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-12T17:17:13.602 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-12T17:17:13.602 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-12T17:17:13.602 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:13.826 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mds-2:18.2.2-797.g49e4a679.el9.x86_64 118/180 2024-03-12T17:17:13.893 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mds-2:18.2.2-797.g49e4a679.el9.x86_64 118/180 2024-03-12T17:17:13.972 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-12T17:17:13.972 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-12T17:17:13.972 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-12T17:17:13.973 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-12T17:17:13.973 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:14.393 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mon-2:18.2.2-797.g49e4a679.el9.x86_64 119/180 2024-03-12T17:17:14.461 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mon-2:18.2.2-797.g49e4a679.el9.x86_64 119/180 2024-03-12T17:17:14.461 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-12T17:17:14.461 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-12T17:17:14.461 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-12T17:17:14.461 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-12T17:17:14.462 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:14.586 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : automake-1.16.2-8.el9.noarch 120/180 2024-03-12T17:17:15.185 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: cephadm-2:18.2.2-797.g49e4a679.el9.noarch 121/180 2024-03-12T17:17:15.215 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : cephadm-2:18.2.2-797.g49e4a679.el9.noarch 121/180 2024-03-12T17:17:15.261 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-prometheus-alerts-2:18.2.2-797.g49e4a679.el 122/180 2024-03-12T17:17:15.364 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-grafana-dashboards-2:18.2.2-797.g49e4a679.e 123/180 2024-03-12T17:17:15.393 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-cephadm-2:18.2.2-797.g49e4a679.el9.noar 124/180 2024-03-12T17:17:15.702 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.2-797.g49e4a679.el9.noar 124/180 2024-03-12T17:17:15.736 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-dashboard-2:18.2.2-797.g49e4a679.el9.no 125/180 2024-03-12T17:17:16.851 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.2-797.g49e4a679.el9.no 125/180 2024-03-12T17:17:16.886 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.2-797.g49e4 126/180 2024-03-12T17:17:17.026 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.2-797.g49e4 126/180 2024-03-12T17:17:17.184 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-modules-core-2:18.2.2-797.g49e4a679.el9 127/180 2024-03-12T17:17:17.222 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-2:18.2.2-797.g49e4a679.el9.x86_64 128/180 2024-03-12T17:17:17.288 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-2:18.2.2-797.g49e4a679.el9.x86_64 128/180 2024-03-12T17:17:17.288 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-12T17:17:17.288 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-12T17:17:17.288 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-12T17:17:17.288 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-12T17:17:17.288 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:17.348 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-mgr-rook-2:18.2.2-797.g49e4a679.el9.noarch 129/180 2024-03-12T17:17:17.383 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.2-797.g49e4a679.el9.noarch 129/180 2024-03-12T17:17:17.466 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-2:18.2.2-797.g49e4a679.el9.x86_64 130/180 2024-03-12T17:17:18.294 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libtool-2.4.6-45.el9.x86_64 131/180 2024-03-12T17:17:18.333 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-radosgw-2:18.2.2-797.g49e4a679.el9.x86_64 132/180 2024-03-12T17:17:18.406 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-radosgw-2:18.2.2-797.g49e4a679.el9.x86_64 132/180 2024-03-12T17:17:18.406 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-12T17:17:18.406 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-12T17:17:18.406 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-12T17:17:18.406 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-12T17:17:18.407 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:18.451 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-immutable-object-cache-2:18.2.2-797.g49e4a6 133/180 2024-03-12T17:17:18.518 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.2-797.g49e4a6 133/180 2024-03-12T17:17:18.518 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-12T17:17:18.518 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-12T17:17:18.518 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:18.585 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : cephfs-mirror-2:18.2.2-797.g49e4a679.el9.x86_64 134/180 2024-03-12T17:17:18.659 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: cephfs-mirror-2:18.2.2-797.g49e4a679.el9.x86_64 134/180 2024-03-12T17:17:18.659 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-12T17:17:18.659 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-12T17:17:18.659 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-12T17:17:18.659 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-12T17:17:18.659 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:19.002 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : rbd-mirror-2:18.2.2-797.g49e4a679.el9.x86_64 135/180 2024-03-12T17:17:19.074 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: rbd-mirror-2:18.2.2-797.g49e4a679.el9.x86_64 135/180 2024-03-12T17:17:19.075 INFO:teuthology.orchestra.run.smithi094.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-12T17:17:19.075 INFO:teuthology.orchestra.run.smithi094.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-12T17:17:19.075 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-12T17:17:19.075 INFO:teuthology.orchestra.run.smithi094.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-12T17:17:19.075 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:23.032 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-test-2:18.2.2-797.g49e4a679.el9.x86_64 136/180 2024-03-12T17:17:23.076 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : rbd-fuse-2:18.2.2-797.g49e4a679.el9.x86_64 137/180 2024-03-12T17:17:23.112 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : rbd-nbd-2:18.2.2-797.g49e4a679.el9.x86_64 138/180 2024-03-12T17:17:23.368 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 139/180 2024-03-12T17:17:23.499 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 140/180 2024-03-12T17:17:23.550 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : ceph-fuse-2:18.2.2-797.g49e4a679.el9.x86_64 141/180 2024-03-12T17:17:23.612 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/180 2024-03-12T17:17:23.674 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 143/180 2024-03-12T17:17:23.720 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 144/180 2024-03-12T17:17:23.787 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libcephfs-devel-2:18.2.2-797.g49e4a679.el9.x86_6 145/180 2024-03-12T17:17:23.833 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 146/180 2024-03-12T17:17:23.892 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : NetworkManager-team-1:1.46.0-1.el9.x86_64 147/180 2024-03-12T17:17:23.981 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : NetworkManager-tui-1:1.46.0-1.el9.x86_64 148/180 2024-03-12T17:17:24.102 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 149/180 2024-03-12T17:17:24.132 INFO:teuthology.orchestra.run.smithi094.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 150/180 2024-03-12T17:17:25.056 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 151/180 2024-03-12T17:17:25.114 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 151/180 2024-03-12T17:17:25.169 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 151/180 2024-03-12T17:17:26.508 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : cephfs-top-2:18.2.2-797.g49e4a679.el9.noarch 152/180 2024-03-12T17:17:26.603 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 153/180 2024-03-12T17:17:26.653 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/180 2024-03-12T17:17:26.797 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/180 2024-03-12T17:17:26.831 INFO:teuthology.orchestra.run.smithi094.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/180 2024-03-12T17:17:26.864 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 157/180 2024-03-12T17:17:26.898 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 158/180 2024-03-12T17:17:26.939 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 159/180 2024-03-12T17:17:26.939 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/180 2024-03-12T17:17:27.085 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/180 2024-03-12T17:17:27.128 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 161/180 2024-03-12T17:17:27.128 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 162/180 2024-03-12T17:17:27.292 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 162/180 2024-03-12T17:17:27.336 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 163/180 2024-03-12T17:17:27.381 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 164/180 2024-03-12T17:17:27.415 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 165/180 2024-03-12T17:17:27.447 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 166/180 2024-03-12T17:17:27.514 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 167/180 2024-03-12T17:17:27.585 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 168/180 2024-03-12T17:17:27.627 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 169/180 2024-03-12T17:17:27.660 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 170/180 2024-03-12T17:17:27.694 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 171/180 2024-03-12T17:17:27.728 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 172/180 2024-03-12T17:17:27.761 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 173/180 2024-03-12T17:17:27.798 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 174/180 2024-03-12T17:17:27.798 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 174/180 2024-03-12T17:17:28.136 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 174/180 2024-03-12T17:17:28.136 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 175/180 2024-03-12T17:17:28.250 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 175/180 2024-03-12T17:17:28.281 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 176/180 2024-03-12T17:17:28.314 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 177/180 2024-03-12T17:17:28.351 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 178/180 2024-03-12T17:17:28.424 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 179/180 2024-03-12T17:17:28.546 INFO:teuthology.orchestra.run.smithi094.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 180/180 2024-03-12T17:17:28.787 INFO:teuthology.orchestra.run.smithi094.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 180/180 2024-03-12T17:17:28.787 INFO:teuthology.orchestra.run.smithi094.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-03-12T17:17:28.787 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:33.525 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-2:18.2.2-797.g49e4a679.el9.x86_64 1/180 2024-03-12T17:17:33.525 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-base-2:18.2.2-797.g49e4a679.el9.x86_64 2/180 2024-03-12T17:17:33.525 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-common-2:18.2.2-797.g49e4a679.el9.x86_64 3/180 2024-03-12T17:17:33.525 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-fuse-2:18.2.2-797.g49e4a679.el9.x86_64 4/180 2024-03-12T17:17:33.525 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-immutable-object-cache-2:18.2.2-797.g49e4a6 5/180 2024-03-12T17:17:33.525 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mds-2:18.2.2-797.g49e4a679.el9.x86_64 6/180 2024-03-12T17:17:33.525 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-2:18.2.2-797.g49e4a679.el9.x86_64 7/180 2024-03-12T17:17:33.526 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mon-2:18.2.2-797.g49e4a679.el9.x86_64 8/180 2024-03-12T17:17:33.526 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-osd-2:18.2.2-797.g49e4a679.el9.x86_64 9/180 2024-03-12T17:17:33.526 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-radosgw-2:18.2.2-797.g49e4a679.el9.x86_64 10/180 2024-03-12T17:17:33.526 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-selinux-2:18.2.2-797.g49e4a679.el9.x86_64 11/180 2024-03-12T17:17:33.526 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-test-2:18.2.2-797.g49e4a679.el9.x86_64 12/180 2024-03-12T17:17:33.526 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : cephfs-mirror-2:18.2.2-797.g49e4a679.el9.x86_64 13/180 2024-03-12T17:17:33.526 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcephfs-devel-2:18.2.2-797.g49e4a679.el9.x86_6 14/180 2024-03-12T17:17:33.526 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcephfs2-2:18.2.2-797.g49e4a679.el9.x86_64 15/180 2024-03-12T17:17:33.526 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libcephsqlite-2:18.2.2-797.g49e4a679.el9.x86_64 16/180 2024-03-12T17:17:33.526 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librados-devel-2:18.2.2-797.g49e4a679.el9.x86_64 17/180 2024-03-12T17:17:33.526 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libradosstriper1-2:18.2.2-797.g49e4a679.el9.x86_ 18/180 2024-03-12T17:17:33.526 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librgw2-2:18.2.2-797.g49e4a679.el9.x86_64 19/180 2024-03-12T17:17:33.526 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-ceph-argparse-2:18.2.2-797.g49e4a679.el9 20/180 2024-03-12T17:17:33.527 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-ceph-common-2:18.2.2-797.g49e4a679.el9.x 21/180 2024-03-12T17:17:33.527 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cephfs-2:18.2.2-797.g49e4a679.el9.x86_64 22/180 2024-03-12T17:17:33.527 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-rados-2:18.2.2-797.g49e4a679.el9.x86_64 23/180 2024-03-12T17:17:33.527 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-rbd-2:18.2.2-797.g49e4a679.el9.x86_64 24/180 2024-03-12T17:17:33.527 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-rgw-2:18.2.2-797.g49e4a679.el9.x86_64 25/180 2024-03-12T17:17:33.542 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : rbd-fuse-2:18.2.2-797.g49e4a679.el9.x86_64 26/180 2024-03-12T17:17:33.542 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : rbd-mirror-2:18.2.2-797.g49e4a679.el9.x86_64 27/180 2024-03-12T17:17:33.542 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : rbd-nbd-2:18.2.2-797.g49e4a679.el9.x86_64 28/180 2024-03-12T17:17:33.542 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-grafana-dashboards-2:18.2.2-797.g49e4a679.e 29/180 2024-03-12T17:17:33.542 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-cephadm-2:18.2.2-797.g49e4a679.el9.noar 30/180 2024-03-12T17:17:33.542 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-dashboard-2:18.2.2-797.g49e4a679.el9.no 31/180 2024-03-12T17:17:33.542 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.2-797.g49e4 32/180 2024-03-12T17:17:33.542 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-modules-core-2:18.2.2-797.g49e4a679.el9 33/180 2024-03-12T17:17:33.542 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-mgr-rook-2:18.2.2-797.g49e4a679.el9.noarch 34/180 2024-03-12T17:17:33.542 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-prometheus-alerts-2:18.2.2-797.g49e4a679.el 35/180 2024-03-12T17:17:33.543 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : ceph-volume-2:18.2.2-797.g49e4a679.el9.noarch 36/180 2024-03-12T17:17:33.543 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : cephadm-2:18.2.2-797.g49e4a679.el9.noarch 37/180 2024-03-12T17:17:33.543 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : cephfs-top-2:18.2.2-797.g49e4a679.el9.noarch 38/180 2024-03-12T17:17:33.543 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/180 2024-03-12T17:17:33.543 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/180 2024-03-12T17:17:33.543 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/180 2024-03-12T17:17:33.543 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flex-2.6.4-9.el9.x86_64 42/180 2024-03-12T17:17:33.543 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 43/180 2024-03-12T17:17:33.543 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 44/180 2024-03-12T17:17:33.543 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 45/180 2024-03-12T17:17:33.543 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 46/180 2024-03-12T17:17:33.543 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 47/180 2024-03-12T17:17:33.543 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 48/180 2024-03-12T17:17:33.544 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 49/180 2024-03-12T17:17:33.544 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 50/180 2024-03-12T17:17:33.544 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 51/180 2024-03-12T17:17:33.544 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 52/180 2024-03-12T17:17:33.544 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 53/180 2024-03-12T17:17:33.544 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 54/180 2024-03-12T17:17:33.544 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 55/180 2024-03-12T17:17:33.544 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : postgresql-13.11-1.el9.x86_64 56/180 2024-03-12T17:17:33.544 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 57/180 2024-03-12T17:17:33.544 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 58/180 2024-03-12T17:17:33.544 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 59/180 2024-03-12T17:17:33.544 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 60/180 2024-03-12T17:17:33.545 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/180 2024-03-12T17:17:33.545 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/180 2024-03-12T17:17:33.545 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/180 2024-03-12T17:17:33.545 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/180 2024-03-12T17:17:33.545 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/180 2024-03-12T17:17:33.545 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/180 2024-03-12T17:17:33.545 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/180 2024-03-12T17:17:33.545 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 68/180 2024-03-12T17:17:33.545 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 69/180 2024-03-12T17:17:33.545 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 70/180 2024-03-12T17:17:33.545 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 71/180 2024-03-12T17:17:33.545 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 72/180 2024-03-12T17:17:33.546 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 73/180 2024-03-12T17:17:33.546 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 74/180 2024-03-12T17:17:33.546 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 75/180 2024-03-12T17:17:33.546 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 76/180 2024-03-12T17:17:33.546 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 77/180 2024-03-12T17:17:33.546 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 78/180 2024-03-12T17:17:33.546 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 79/180 2024-03-12T17:17:33.546 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 80/180 2024-03-12T17:17:33.546 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 81/180 2024-03-12T17:17:33.546 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 82/180 2024-03-12T17:17:33.546 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-ply-3.11-14.el9.noarch 83/180 2024-03-12T17:17:33.546 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 84/180 2024-03-12T17:17:33.546 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 85/180 2024-03-12T17:17:33.546 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : jq-1.6-16.el9.x86_64 86/180 2024-03-12T17:17:33.547 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 87/180 2024-03-12T17:17:33.547 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 88/180 2024-03-12T17:17:33.547 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 89/180 2024-03-12T17:17:33.547 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 90/180 2024-03-12T17:17:33.547 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 91/180 2024-03-12T17:17:33.547 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 92/180 2024-03-12T17:17:33.547 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 93/180 2024-03-12T17:17:33.547 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 94/180 2024-03-12T17:17:33.547 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 95/180 2024-03-12T17:17:33.547 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 96/180 2024-03-12T17:17:33.547 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 97/180 2024-03-12T17:17:33.547 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 98/180 2024-03-12T17:17:33.547 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 99/180 2024-03-12T17:17:33.547 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/180 2024-03-12T17:17:33.548 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/180 2024-03-12T17:17:33.548 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 102/180 2024-03-12T17:17:33.548 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 103/180 2024-03-12T17:17:33.548 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 104/180 2024-03-12T17:17:33.548 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 105/180 2024-03-12T17:17:33.548 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 106/180 2024-03-12T17:17:33.548 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 107/180 2024-03-12T17:17:33.548 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 108/180 2024-03-12T17:17:33.548 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 109/180 2024-03-12T17:17:33.548 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 110/180 2024-03-12T17:17:33.548 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 111/180 2024-03-12T17:17:33.548 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 112/180 2024-03-12T17:17:33.548 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 113/180 2024-03-12T17:17:33.548 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 114/180 2024-03-12T17:17:33.548 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 115/180 2024-03-12T17:17:33.549 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 116/180 2024-03-12T17:17:33.549 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 117/180 2024-03-12T17:17:33.549 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 118/180 2024-03-12T17:17:33.549 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 119/180 2024-03-12T17:17:33.549 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 120/180 2024-03-12T17:17:33.549 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 121/180 2024-03-12T17:17:33.549 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 122/180 2024-03-12T17:17:33.549 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 123/180 2024-03-12T17:17:33.549 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 124/180 2024-03-12T17:17:33.549 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 125/180 2024-03-12T17:17:33.549 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 126/180 2024-03-12T17:17:33.549 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 127/180 2024-03-12T17:17:33.549 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 128/180 2024-03-12T17:17:33.550 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 129/180 2024-03-12T17:17:33.550 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 130/180 2024-03-12T17:17:33.550 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : re2-1:20211101-3.el9.x86_64 131/180 2024-03-12T17:17:33.550 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 132/180 2024-03-12T17:17:33.550 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librados2-2:18.2.2-797.g49e4a679.el9.x86_64 133/180 2024-03-12T17:17:33.550 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 134/180 2024-03-12T17:17:33.550 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librbd1-2:18.2.2-797.g49e4a679.el9.x86_64 135/180 2024-03-12T17:17:33.550 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 136/180 2024-03-12T17:17:33.550 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 137/180 2024-03-12T17:17:33.550 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 138/180 2024-03-12T17:17:33.550 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : NetworkManager-1:1.46.0-1.el9.x86_64 139/180 2024-03-12T17:17:33.550 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 140/180 2024-03-12T17:17:33.550 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 141/180 2024-03-12T17:17:33.550 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 142/180 2024-03-12T17:17:33.551 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : NetworkManager-team-1:1.46.0-1.el9.x86_64 143/180 2024-03-12T17:17:33.551 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 144/180 2024-03-12T17:17:33.551 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : NetworkManager-tui-1:1.46.0-1.el9.x86_64 145/180 2024-03-12T17:17:33.551 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 146/180 2024-03-12T17:17:33.551 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : acl-2.3.1-4.el9.x86_64 147/180 2024-03-12T17:17:33.551 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : acl-2.3.1-3.el9.x86_64 148/180 2024-03-12T17:17:33.551 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 149/180 2024-03-12T17:17:33.551 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 150/180 2024-03-12T17:17:33.551 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 151/180 2024-03-12T17:17:33.551 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 152/180 2024-03-12T17:17:33.551 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 153/180 2024-03-12T17:17:33.551 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 154/180 2024-03-12T17:17:33.551 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 155/180 2024-03-12T17:17:33.551 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 156/180 2024-03-12T17:17:33.552 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 157/180 2024-03-12T17:17:33.552 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 158/180 2024-03-12T17:17:33.552 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 159/180 2024-03-12T17:17:33.552 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 160/180 2024-03-12T17:17:33.552 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 161/180 2024-03-12T17:17:33.552 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 162/180 2024-03-12T17:17:33.552 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 163/180 2024-03-12T17:17:33.552 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 164/180 2024-03-12T17:17:33.552 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 165/180 2024-03-12T17:17:33.552 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 166/180 2024-03-12T17:17:33.552 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 167/180 2024-03-12T17:17:33.552 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 168/180 2024-03-12T17:17:33.552 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 169/180 2024-03-12T17:17:33.552 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 170/180 2024-03-12T17:17:33.553 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 171/180 2024-03-12T17:17:33.553 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 172/180 2024-03-12T17:17:33.553 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 173/180 2024-03-12T17:17:33.553 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 174/180 2024-03-12T17:17:33.553 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 175/180 2024-03-12T17:17:33.553 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 176/180 2024-03-12T17:17:33.553 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 177/180 2024-03-12T17:17:33.553 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 178/180 2024-03-12T17:17:33.553 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 179/180 2024-03-12T17:17:35.868 INFO:teuthology.orchestra.run.smithi094.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 180/180 2024-03-12T17:17:35.868 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:35.868 INFO:teuthology.orchestra.run.smithi094.stdout:Upgraded: 2024-03-12T17:17:35.868 INFO:teuthology.orchestra.run.smithi094.stdout: NetworkManager-1:1.46.0-1.el9.x86_64 2024-03-12T17:17:35.868 INFO:teuthology.orchestra.run.smithi094.stdout: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 2024-03-12T17:17:35.868 INFO:teuthology.orchestra.run.smithi094.stdout: NetworkManager-team-1:1.46.0-1.el9.x86_64 2024-03-12T17:17:35.868 INFO:teuthology.orchestra.run.smithi094.stdout: NetworkManager-tui-1:1.46.0-1.el9.x86_64 2024-03-12T17:17:35.869 INFO:teuthology.orchestra.run.smithi094.stdout: acl-2.3.1-4.el9.x86_64 2024-03-12T17:17:35.869 INFO:teuthology.orchestra.run.smithi094.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-12T17:17:35.869 INFO:teuthology.orchestra.run.smithi094.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-12T17:17:35.869 INFO:teuthology.orchestra.run.smithi094.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-12T17:17:35.869 INFO:teuthology.orchestra.run.smithi094.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-12T17:17:35.869 INFO:teuthology.orchestra.run.smithi094.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-12T17:17:35.869 INFO:teuthology.orchestra.run.smithi094.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-12T17:17:35.869 INFO:teuthology.orchestra.run.smithi094.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-12T17:17:35.869 INFO:teuthology.orchestra.run.smithi094.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-12T17:17:35.869 INFO:teuthology.orchestra.run.smithi094.stdout: librados2-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:35.869 INFO:teuthology.orchestra.run.smithi094.stdout: librbd1-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:35.869 INFO:teuthology.orchestra.run.smithi094.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-12T17:17:35.869 INFO:teuthology.orchestra.run.smithi094.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-12T17:17:35.870 INFO:teuthology.orchestra.run.smithi094.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-12T17:17:35.870 INFO:teuthology.orchestra.run.smithi094.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-12T17:17:35.870 INFO:teuthology.orchestra.run.smithi094.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-12T17:17:35.870 INFO:teuthology.orchestra.run.smithi094.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-12T17:17:35.870 INFO:teuthology.orchestra.run.smithi094.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-12T17:17:35.870 INFO:teuthology.orchestra.run.smithi094.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-12T17:17:35.870 INFO:teuthology.orchestra.run.smithi094.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-12T17:17:35.870 INFO:teuthology.orchestra.run.smithi094.stdout:Installed: 2024-03-12T17:17:35.870 INFO:teuthology.orchestra.run.smithi094.stdout: automake-1.16.2-8.el9.noarch 2024-03-12T17:17:35.870 INFO:teuthology.orchestra.run.smithi094.stdout: bison-3.7.4-5.el9.x86_64 2024-03-12T17:17:35.870 INFO:teuthology.orchestra.run.smithi094.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-12T17:17:35.870 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:35.870 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-base-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:35.871 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-common-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:35.871 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-fuse-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:35.871 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-grafana-dashboards-2:18.2.2-797.g49e4a679.el9.noarch 2024-03-12T17:17:35.871 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-immutable-object-cache-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:35.871 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mds-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:35.871 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:35.871 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-cephadm-2:18.2.2-797.g49e4a679.el9.noarch 2024-03-12T17:17:35.871 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-dashboard-2:18.2.2-797.g49e4a679.el9.noarch 2024-03-12T17:17:35.871 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-diskprediction-local-2:18.2.2-797.g49e4a679.el9.noarch 2024-03-12T17:17:35.871 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-modules-core-2:18.2.2-797.g49e4a679.el9.noarch 2024-03-12T17:17:35.871 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mgr-rook-2:18.2.2-797.g49e4a679.el9.noarch 2024-03-12T17:17:35.871 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-mon-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:35.872 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-osd-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:35.872 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-prometheus-alerts-2:18.2.2-797.g49e4a679.el9.noarch 2024-03-12T17:17:35.872 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-radosgw-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:35.872 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-selinux-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:35.872 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-test-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:35.872 INFO:teuthology.orchestra.run.smithi094.stdout: ceph-volume-2:18.2.2-797.g49e4a679.el9.noarch 2024-03-12T17:17:35.872 INFO:teuthology.orchestra.run.smithi094.stdout: cephadm-2:18.2.2-797.g49e4a679.el9.noarch 2024-03-12T17:17:35.872 INFO:teuthology.orchestra.run.smithi094.stdout: cephfs-mirror-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:35.872 INFO:teuthology.orchestra.run.smithi094.stdout: cephfs-top-2:18.2.2-797.g49e4a679.el9.noarch 2024-03-12T17:17:35.872 INFO:teuthology.orchestra.run.smithi094.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-12T17:17:35.872 INFO:teuthology.orchestra.run.smithi094.stdout: flex-2.6.4-9.el9.x86_64 2024-03-12T17:17:35.872 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-12T17:17:35.872 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-12T17:17:35.873 INFO:teuthology.orchestra.run.smithi094.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-12T17:17:35.873 INFO:teuthology.orchestra.run.smithi094.stdout: fmt-8.1.1-5.el9.x86_64 2024-03-12T17:17:35.873 INFO:teuthology.orchestra.run.smithi094.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-12T17:17:35.873 INFO:teuthology.orchestra.run.smithi094.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-12T17:17:35.873 INFO:teuthology.orchestra.run.smithi094.stdout: jq-1.6-16.el9.x86_64 2024-03-12T17:17:35.873 INFO:teuthology.orchestra.run.smithi094.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-12T17:17:35.873 INFO:teuthology.orchestra.run.smithi094.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-12T17:17:35.873 INFO:teuthology.orchestra.run.smithi094.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-12T17:17:35.873 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs-devel-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:35.873 INFO:teuthology.orchestra.run.smithi094.stdout: libcephfs2-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:35.873 INFO:teuthology.orchestra.run.smithi094.stdout: libcephsqlite-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:35.873 INFO:teuthology.orchestra.run.smithi094.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-12T17:17:35.874 INFO:teuthology.orchestra.run.smithi094.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-12T17:17:35.874 INFO:teuthology.orchestra.run.smithi094.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-12T17:17:35.874 INFO:teuthology.orchestra.run.smithi094.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-12T17:17:35.874 INFO:teuthology.orchestra.run.smithi094.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-12T17:17:35.874 INFO:teuthology.orchestra.run.smithi094.stdout: librados-devel-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:35.874 INFO:teuthology.orchestra.run.smithi094.stdout: libradosstriper1-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:35.874 INFO:teuthology.orchestra.run.smithi094.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-12T17:17:35.874 INFO:teuthology.orchestra.run.smithi094.stdout: librgw2-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:35.874 INFO:teuthology.orchestra.run.smithi094.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-12T17:17:35.874 INFO:teuthology.orchestra.run.smithi094.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-12T17:17:35.874 INFO:teuthology.orchestra.run.smithi094.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-12T17:17:35.874 INFO:teuthology.orchestra.run.smithi094.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-12T17:17:35.874 INFO:teuthology.orchestra.run.smithi094.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-12T17:17:35.875 INFO:teuthology.orchestra.run.smithi094.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-12T17:17:35.875 INFO:teuthology.orchestra.run.smithi094.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-12T17:17:35.875 INFO:teuthology.orchestra.run.smithi094.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-12T17:17:35.875 INFO:teuthology.orchestra.run.smithi094.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-12T17:17:35.875 INFO:teuthology.orchestra.run.smithi094.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-12T17:17:35.875 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-13.11-1.el9.x86_64 2024-03-12T17:17:35.875 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-12T17:17:35.875 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-12T17:17:35.875 INFO:teuthology.orchestra.run.smithi094.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-12T17:17:35.875 INFO:teuthology.orchestra.run.smithi094.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-12T17:17:35.875 INFO:teuthology.orchestra.run.smithi094.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-12T17:17:35.875 INFO:teuthology.orchestra.run.smithi094.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-12T17:17:35.876 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-12T17:17:35.876 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-argparse-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:35.876 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ceph-common-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:35.876 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cephfs-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:35.876 INFO:teuthology.orchestra.run.smithi094.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-12T17:17:35.876 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-12T17:17:35.876 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-12T17:17:35.876 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-12T17:17:35.876 INFO:teuthology.orchestra.run.smithi094.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-12T17:17:35.876 INFO:teuthology.orchestra.run.smithi094.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-12T17:17:35.876 INFO:teuthology.orchestra.run.smithi094.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-12T17:17:35.876 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-12T17:17:35.877 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-12T17:17:35.877 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-12T17:17:35.877 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-12T17:17:35.877 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-12T17:17:35.877 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-12T17:17:35.877 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-12T17:17:35.877 INFO:teuthology.orchestra.run.smithi094.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-12T17:17:35.877 INFO:teuthology.orchestra.run.smithi094.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-12T17:17:35.877 INFO:teuthology.orchestra.run.smithi094.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-12T17:17:35.877 INFO:teuthology.orchestra.run.smithi094.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-12T17:17:35.877 INFO:teuthology.orchestra.run.smithi094.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-12T17:17:35.877 INFO:teuthology.orchestra.run.smithi094.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-12T17:17:35.877 INFO:teuthology.orchestra.run.smithi094.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-12T17:17:35.877 INFO:teuthology.orchestra.run.smithi094.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-12T17:17:35.878 INFO:teuthology.orchestra.run.smithi094.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-12T17:17:35.878 INFO:teuthology.orchestra.run.smithi094.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-12T17:17:35.878 INFO:teuthology.orchestra.run.smithi094.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-12T17:17:35.878 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-12T17:17:35.878 INFO:teuthology.orchestra.run.smithi094.stdout: python3-ply-3.11-14.el9.noarch 2024-03-12T17:17:35.878 INFO:teuthology.orchestra.run.smithi094.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-12T17:17:35.878 INFO:teuthology.orchestra.run.smithi094.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-12T17:17:35.878 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-12T17:17:35.878 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-12T17:17:35.878 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-12T17:17:35.878 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-12T17:17:35.878 INFO:teuthology.orchestra.run.smithi094.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-12T17:17:35.878 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rados-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:35.878 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rbd-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:35.879 INFO:teuthology.orchestra.run.smithi094.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-12T17:17:35.879 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-12T17:17:35.879 INFO:teuthology.orchestra.run.smithi094.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-12T17:17:35.879 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rgw-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:35.879 INFO:teuthology.orchestra.run.smithi094.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-12T17:17:35.879 INFO:teuthology.orchestra.run.smithi094.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-12T17:17:35.879 INFO:teuthology.orchestra.run.smithi094.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-12T17:17:35.879 INFO:teuthology.orchestra.run.smithi094.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-12T17:17:35.879 INFO:teuthology.orchestra.run.smithi094.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-12T17:17:35.879 INFO:teuthology.orchestra.run.smithi094.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-12T17:17:35.879 INFO:teuthology.orchestra.run.smithi094.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-12T17:17:35.879 INFO:teuthology.orchestra.run.smithi094.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-12T17:17:35.879 INFO:teuthology.orchestra.run.smithi094.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-12T17:17:35.879 INFO:teuthology.orchestra.run.smithi094.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-12T17:17:35.880 INFO:teuthology.orchestra.run.smithi094.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-12T17:17:35.880 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-fuse-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:35.880 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-mirror-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:35.880 INFO:teuthology.orchestra.run.smithi094.stdout: rbd-nbd-2:18.2.2-797.g49e4a679.el9.x86_64 2024-03-12T17:17:35.880 INFO:teuthology.orchestra.run.smithi094.stdout: re2-1:20211101-3.el9.x86_64 2024-03-12T17:17:35.880 INFO:teuthology.orchestra.run.smithi094.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-12T17:17:35.880 INFO:teuthology.orchestra.run.smithi094.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-12T17:17:35.880 INFO:teuthology.orchestra.run.smithi094.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-12T17:17:35.880 INFO:teuthology.orchestra.run.smithi094.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-12T17:17:35.880 INFO:teuthology.orchestra.run.smithi094.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-12T17:17:35.880 INFO:teuthology.orchestra.run.smithi094.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-12T17:17:35.880 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:35.880 INFO:teuthology.orchestra.run.smithi094.stdout:Complete! 2024-03-12T17:17:36.477 DEBUG:teuthology.parallel:result is None 2024-03-12T17:17:36.478 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=49e4a6794d5502bd66908faf714fc54896c51712 2024-03-12T17:17:36.863 DEBUG:teuthology.orchestra.run.smithi017:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-12T17:17:36.940 INFO:teuthology.orchestra.run.smithi017.stdout:18.2.2-797.g49e4a679.el9 2024-03-12T17:17:36.941 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-797.g49e4a679.el9 2024-03-12T17:17:36.941 INFO:teuthology.task.install:The correct ceph version 18.2.2-797.g49e4a679 is installed. 2024-03-12T17:17:36.943 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=49e4a6794d5502bd66908faf714fc54896c51712 2024-03-12T17:17:37.082 DEBUG:teuthology.orchestra.run.smithi094:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-12T17:17:37.139 INFO:teuthology.orchestra.run.smithi094.stdout:18.2.2-797.g49e4a679.el9 2024-03-12T17:17:37.139 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-797.g49e4a679.el9 2024-03-12T17:17:37.139 INFO:teuthology.task.install:The correct ceph version 18.2.2-797.g49e4a679 is installed. 2024-03-12T17:17:37.141 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-12T17:17:37.141 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:17:37.142 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-12T17:17:37.249 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-12T17:17:37.249 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-12T17:17:37.342 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-12T17:17:37.343 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:17:37.343 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/daemon-helper 2024-03-12T17:17:37.447 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-12T17:17:37.549 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-12T17:17:37.550 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/daemon-helper 2024-03-12T17:17:37.629 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-12T17:17:37.741 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-12T17:17:37.741 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:17:37.742 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-12T17:17:37.847 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-12T17:17:37.994 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-12T17:17:37.995 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-12T17:17:38.072 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-12T17:17:38.186 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-12T17:17:38.186 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:17:38.186 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/usr/bin/stdin-killer 2024-03-12T17:17:38.293 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-12T17:17:38.397 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-12T17:17:38.397 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/usr/bin/stdin-killer 2024-03-12T17:17:38.478 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-12T17:17:38.590 INFO:teuthology.run_tasks:Running task ceph... 2024-03-12T17:17:38.661 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-12T17:17:38.661 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 777 /var/log/ceph 2024-03-12T17:17:38.669 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 777 /var/log/ceph 2024-03-12T17:17:38.767 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-12T17:17:38.767 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-12T17:17:38.774 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-12T17:17:38.870 INFO:tasks.ceph:Creating extra log directories... 2024-03-12T17:17:38.871 DEBUG:teuthology.orchestra.run.smithi017:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-12T17:17:38.878 DEBUG:teuthology.orchestra.run.smithi094:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-12T17:17:38.984 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-03-12T17:17:38.984 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-03-12T17:17:38.984 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-03-12T17:17:38.985 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:17:38.985 DEBUG:teuthology.orchestra.run.smithi017:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-12T17:17:39.041 DEBUG:teuthology.orchestra.run.smithi017:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-12T17:17:39.311 DEBUG:teuthology.orchestra.run.smithi017:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-12T17:17:39.418 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-12T17:17:39.418 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-12T17:17:39.463 DEBUG:teuthology.orchestra.run.smithi094:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-12T17:17:39.667 DEBUG:teuthology.orchestra.run.smithi094:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-12T17:17:39.746 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-12T17:17:39.746 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-12T17:17:39.747 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2024-03-12_14:59:27-fs-wip-yuri11-testing-2024-03-11-0838-reef-distro-default-smithi/7593742', 'branch': 'wip-yuri11-testing-2024-03-11-0838-reef', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/asok_dump_tree}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7593742', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2024-03-12_14:59:27-fs-wip-yuri11-testing-2024-03-11-0838-reef-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri11-testing-2024-03-11-0838-reef'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '49e4a6794d5502bd66908faf714fc54896c51712'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '49e4a6794d5502bd66908faf714fc54896c51712'}}, 'kclient': {'syntax': 'v2'}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri11-testing-2024-03-11-0838-reef', 'sha1': '49e4a6794d5502bd66908faf714fc54896c51712'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 71, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 9096, 'sha1': '49e4a6794d5502bd66908faf714fc54896c51712', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'fs', 'suite_branch': 'wip-yuri11-testing-2024-03-11-0838-reef', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_49e4a6794d5502bd66908faf714fc54896c51712/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '49e4a6794d5502bd66908faf714fc54896c51712', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi017.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBqlMRN7UkesTbPmmEl/Fu33YbcUUW+S7CaISm4Tqk3pP+0ezaEyT2I38Sgxt1DP2LZik+P22JmtaEtvCRScUkA=', 'smithi094.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMeHIyWbUAqn+IYD1RDvRs+UR8VUiDaQcRsg7RqsboRUENvrnVUDMtNdw0d+m4rETIWEK58NMqv8ka9jMdfQbZY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '49e4a6794d5502bd66908faf714fc54896c51712'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '49e4a6794d5502bd66908faf714fc54896c51712', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_dump_tree']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-12_14:59:27', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-12T17:17:39.747 DEBUG:teuthology.orchestra.run.smithi017:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-12T17:17:39.755 DEBUG:teuthology.orchestra.run.smithi094:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-12T17:17:39.807 DEBUG:teuthology.orchestra.run.smithi017:> sudo install -d -m0777 -- /var/run/ceph 2024-03-12T17:17:39.813 DEBUG:teuthology.orchestra.run.smithi094:> sudo install -d -m0777 -- /var/run/ceph 2024-03-12T17:17:39.907 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:17:39.907 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/scratch_devs of=/dev/stdout 2024-03-12T17:17:39.964 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-12T17:17:39.964 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_1 2024-03-12T17:17:40.018 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-12T17:17:40.018 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-12T17:17:40.018 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 631 Links: 1 2024-03-12T17:17:40.019 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-12T17:17:40.019 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-03-12T17:17:40.019 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-03-12 17:17:05.887142872 +0000 2024-03-12T17:17:40.019 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-03-12 17:14:13.070896159 +0000 2024-03-12T17:17:40.019 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-03-12 17:14:13.070896159 +0000 2024-03-12T17:17:40.019 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-03-12 17:14:13.070896159 +0000 2024-03-12T17:17:40.019 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-12T17:17:40.110 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-03-12T17:17:40.110 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-03-12T17:17:40.110 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000218751 s, 2.3 MB/s 2024-03-12T17:17:40.115 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-12T17:17:40.175 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_2 2024-03-12T17:17:40.227 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-12T17:17:40.227 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-12T17:17:40.228 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 653 Links: 1 2024-03-12T17:17:40.228 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-12T17:17:40.228 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-03-12T17:17:40.228 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-03-12 17:17:05.888142861 +0000 2024-03-12T17:17:40.228 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-03-12 17:14:13.654889884 +0000 2024-03-12T17:17:40.228 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-03-12 17:14:13.654889884 +0000 2024-03-12T17:17:40.228 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-03-12 17:14:13.654889884 +0000 2024-03-12T17:17:40.228 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-12T17:17:40.315 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-03-12T17:17:40.316 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-03-12T17:17:40.316 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000234646 s, 2.2 MB/s 2024-03-12T17:17:40.320 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-12T17:17:40.378 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_3 2024-03-12T17:17:40.430 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-12T17:17:40.431 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-12T17:17:40.431 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 671 Links: 1 2024-03-12T17:17:40.431 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-12T17:17:40.431 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-03-12T17:17:40.431 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-03-12 17:17:05.889142851 +0000 2024-03-12T17:17:40.431 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-03-12 17:14:14.221883791 +0000 2024-03-12T17:17:40.431 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-03-12 17:14:14.221883791 +0000 2024-03-12T17:17:40.431 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-03-12 17:14:14.221883791 +0000 2024-03-12T17:17:40.431 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-12T17:17:40.522 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-03-12T17:17:40.522 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-03-12T17:17:40.522 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000222544 s, 2.3 MB/s 2024-03-12T17:17:40.527 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-12T17:17:40.585 DEBUG:teuthology.orchestra.run.smithi017:> stat /dev/vg_nvme/lv_4 2024-03-12T17:17:40.639 INFO:teuthology.orchestra.run.smithi017.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-12T17:17:40.639 INFO:teuthology.orchestra.run.smithi017.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-12T17:17:40.639 INFO:teuthology.orchestra.run.smithi017.stdout:Device: 5h/5d Inode: 688 Links: 1 2024-03-12T17:17:40.639 INFO:teuthology.orchestra.run.smithi017.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-12T17:17:40.639 INFO:teuthology.orchestra.run.smithi017.stdout:Context: system_u:object_r:device_t:s0 2024-03-12T17:17:40.640 INFO:teuthology.orchestra.run.smithi017.stdout:Access: 2024-03-12 17:17:05.890142840 +0000 2024-03-12T17:17:40.640 INFO:teuthology.orchestra.run.smithi017.stdout:Modify: 2024-03-12 17:14:14.785877730 +0000 2024-03-12T17:17:40.640 INFO:teuthology.orchestra.run.smithi017.stdout:Change: 2024-03-12 17:14:14.785877730 +0000 2024-03-12T17:17:40.640 INFO:teuthology.orchestra.run.smithi017.stdout: Birth: 2024-03-12 17:14:14.785877730 +0000 2024-03-12T17:17:40.640 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-12T17:17:40.734 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records in 2024-03-12T17:17:40.734 INFO:teuthology.orchestra.run.smithi017.stderr:1+0 records out 2024-03-12T17:17:40.734 INFO:teuthology.orchestra.run.smithi017.stderr:512 bytes copied, 0.000262846 s, 1.9 MB/s 2024-03-12T17:17:40.739 DEBUG:teuthology.orchestra.run.smithi017:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-12T17:17:40.797 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-12T17:17:40.797 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-12T17:17:40.797 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/scratch_devs of=/dev/stdout 2024-03-12T17:17:40.853 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-12T17:17:40.853 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_1 2024-03-12T17:17:40.903 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-12T17:17:40.903 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-12T17:17:40.903 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 5h/5d Inode: 631 Links: 1 2024-03-12T17:17:40.903 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-12T17:17:40.903 INFO:teuthology.orchestra.run.smithi094.stdout:Context: system_u:object_r:device_t:s0 2024-03-12T17:17:40.903 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-03-12 17:17:29.281570877 +0000 2024-03-12T17:17:40.904 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-03-12 17:14:04.914068467 +0000 2024-03-12T17:17:40.904 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-03-12 17:14:04.914068467 +0000 2024-03-12T17:17:40.904 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: 2024-03-12 17:14:04.914068467 +0000 2024-03-12T17:17:40.904 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-12T17:17:40.982 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-03-12T17:17:40.983 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-03-12T17:17:40.983 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000294348 s, 1.7 MB/s 2024-03-12T17:17:40.986 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-12T17:17:41.039 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_2 2024-03-12T17:17:41.086 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-12T17:17:41.086 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-12T17:17:41.086 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 5h/5d Inode: 650 Links: 1 2024-03-12T17:17:41.086 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-12T17:17:41.086 INFO:teuthology.orchestra.run.smithi094.stdout:Context: system_u:object_r:device_t:s0 2024-03-12T17:17:41.086 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-03-12 17:17:29.282570860 +0000 2024-03-12T17:17:41.086 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-03-12 17:14:05.481058598 +0000 2024-03-12T17:17:41.086 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-03-12 17:14:05.481058598 +0000 2024-03-12T17:17:41.086 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: 2024-03-12 17:14:05.481058598 +0000 2024-03-12T17:17:41.087 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-12T17:17:41.218 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-03-12T17:17:41.219 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-03-12T17:17:41.219 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000277717 s, 1.8 MB/s 2024-03-12T17:17:41.222 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-12T17:17:41.269 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_3 2024-03-12T17:17:41.312 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-12T17:17:41.312 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-12T17:17:41.312 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 5h/5d Inode: 669 Links: 1 2024-03-12T17:17:41.312 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-12T17:17:41.313 INFO:teuthology.orchestra.run.smithi094.stdout:Context: system_u:object_r:device_t:s0 2024-03-12T17:17:41.313 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-03-12 17:17:29.282570860 +0000 2024-03-12T17:17:41.313 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-03-12 17:14:06.060048522 +0000 2024-03-12T17:17:41.313 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-03-12 17:14:06.060048522 +0000 2024-03-12T17:17:41.313 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: 2024-03-12 17:14:06.060048522 +0000 2024-03-12T17:17:41.313 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-12T17:17:41.444 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-03-12T17:17:41.444 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-03-12T17:17:41.444 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000244412 s, 2.1 MB/s 2024-03-12T17:17:41.448 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-12T17:17:41.507 DEBUG:teuthology.orchestra.run.smithi094:> stat /dev/vg_nvme/lv_4 2024-03-12T17:17:41.558 INFO:teuthology.orchestra.run.smithi094.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-12T17:17:41.559 INFO:teuthology.orchestra.run.smithi094.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-12T17:17:41.559 INFO:teuthology.orchestra.run.smithi094.stdout:Device: 5h/5d Inode: 689 Links: 1 2024-03-12T17:17:41.559 INFO:teuthology.orchestra.run.smithi094.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-12T17:17:41.559 INFO:teuthology.orchestra.run.smithi094.stdout:Context: system_u:object_r:device_t:s0 2024-03-12T17:17:41.559 INFO:teuthology.orchestra.run.smithi094.stdout:Access: 2024-03-12 17:17:29.283570842 +0000 2024-03-12T17:17:41.559 INFO:teuthology.orchestra.run.smithi094.stdout:Modify: 2024-03-12 17:14:06.623038725 +0000 2024-03-12T17:17:41.559 INFO:teuthology.orchestra.run.smithi094.stdout:Change: 2024-03-12 17:14:06.623038725 +0000 2024-03-12T17:17:41.559 INFO:teuthology.orchestra.run.smithi094.stdout: Birth: 2024-03-12 17:14:06.623038725 +0000 2024-03-12T17:17:41.559 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-12T17:17:41.646 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records in 2024-03-12T17:17:41.646 INFO:teuthology.orchestra.run.smithi094.stderr:1+0 records out 2024-03-12T17:17:41.646 INFO:teuthology.orchestra.run.smithi094.stderr:512 bytes copied, 0.000252808 s, 2.0 MB/s 2024-03-12T17:17:41.650 DEBUG:teuthology.orchestra.run.smithi094:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-12T17:17:41.704 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-12T17:17:41.704 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi017.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi094.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-12T17:17:41.705 INFO:tasks.ceph:Generating config... 2024-03-12T17:17:41.706 INFO:tasks.ceph:[client] client mount timeout = 600 2024-03-12T17:17:41.706 INFO:tasks.ceph:[client] debug client = 20 2024-03-12T17:17:41.706 INFO:tasks.ceph:[client] debug ms = 1 2024-03-12T17:17:41.706 INFO:tasks.ceph:[client] pid file = 2024-03-12T17:17:41.706 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-03-12T17:17:41.706 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-03-12T17:17:41.706 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-03-12T17:17:41.706 INFO:tasks.ceph:[mds] debug mds = 20 2024-03-12T17:17:41.706 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-03-12T17:17:41.707 INFO:tasks.ceph:[mds] debug ms = 1 2024-03-12T17:17:41.707 INFO:tasks.ceph:[mds] mds debug frag = True 2024-03-12T17:17:41.707 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-03-12T17:17:41.707 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-03-12T17:17:41.707 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-03-12T17:17:41.707 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-03-12T17:17:41.707 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-03-12T17:17:41.707 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-03-12T17:17:41.707 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-12T17:17:41.707 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-12T17:17:41.707 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-12T17:17:41.707 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-12T17:17:41.707 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-12T17:17:41.708 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-03-12T17:17:41.708 INFO:tasks.ceph:[osd] bdev async discard = True 2024-03-12T17:17:41.708 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-03-12T17:17:41.708 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-03-12T17:17:41.708 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-12T17:17:41.708 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-12T17:17:41.708 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-03-12T17:17:41.708 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-03-12T17:17:41.708 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-12T17:17:41.708 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-12T17:17:41.708 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-03-12T17:17:41.708 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-12T17:17:41.708 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-12T17:17:41.708 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-12T17:17:41.708 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-12T17:17:41.709 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-12T17:17:41.709 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-03-12T17:17:41.709 INFO:tasks.ceph:Setting up mon.a... 2024-03-12T17:17:41.709 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-12T17:17:41.863 INFO:teuthology.orchestra.run.smithi017.stdout:creating /etc/ceph/ceph.keyring 2024-03-12T17:17:41.873 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-12T17:17:42.010 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-12T17:17:42.109 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.17'), ('mon.b', '172.21.15.94'), ('mon.c', '[v2:172.21.15.94:3301,v1:172.21.15.94:6790]')] 2024-03-12T17:17:42.110 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.17,172.21.15.94,[v2:172.21.15.94:3301,v1:172.21.15.94:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-03-12T17:17:42.110 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:17:42.111 DEBUG:teuthology.orchestra.run.smithi017:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-12T17:17:42.169 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.17 --add b 172.21.15.94 --addv c '[v2:172.21.15.94:3301,v1:172.21.15.94:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-03-12T17:17:42.326 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-12T17:17:42.326 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool: generated fsid 73425bc1-630f-4bd2-8abb-716ed5d8ca29 2024-03-12T17:17:42.326 INFO:teuthology.orchestra.run.smithi017.stdout:setting min_mon_release = pacific 2024-03-12T17:17:42.326 INFO:teuthology.orchestra.run.smithi017.stdout:epoch 0 2024-03-12T17:17:42.326 INFO:teuthology.orchestra.run.smithi017.stdout:fsid 73425bc1-630f-4bd2-8abb-716ed5d8ca29 2024-03-12T17:17:42.326 INFO:teuthology.orchestra.run.smithi017.stdout:last_changed 2024-03-12T17:17:42.332316+0000 2024-03-12T17:17:42.326 INFO:teuthology.orchestra.run.smithi017.stdout:created 2024-03-12T17:17:42.332316+0000 2024-03-12T17:17:42.326 INFO:teuthology.orchestra.run.smithi017.stdout:min_mon_release 16 (pacific) 2024-03-12T17:17:42.326 INFO:teuthology.orchestra.run.smithi017.stdout:election_strategy: 1 2024-03-12T17:17:42.326 INFO:teuthology.orchestra.run.smithi017.stdout:0: [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] mon.a 2024-03-12T17:17:42.326 INFO:teuthology.orchestra.run.smithi017.stdout:1: [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] mon.b 2024-03-12T17:17:42.326 INFO:teuthology.orchestra.run.smithi017.stdout:2: [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] mon.c 2024-03-12T17:17:42.327 INFO:teuthology.orchestra.run.smithi017.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-03-12T17:17:42.331 DEBUG:teuthology.orchestra.run.smithi017:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-12T17:17:42.383 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 73425bc1-630f-4bd2-8abb-716ed5d8ca29... 2024-03-12T17:17:42.384 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-12T17:17:42.389 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-12T17:17:42.562 INFO:teuthology.orchestra.run.smithi017.stdout:[global] 2024-03-12T17:17:42.562 INFO:teuthology.orchestra.run.smithi017.stdout: chdir = "" 2024-03-12T17:17:42.562 INFO:teuthology.orchestra.run.smithi017.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-12T17:17:42.562 INFO:teuthology.orchestra.run.smithi017.stdout: auth supported = cephx 2024-03-12T17:17:42.562 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:17:42.562 INFO:teuthology.orchestra.run.smithi017.stdout: filestore xattr use omap = true 2024-03-12T17:17:42.562 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:17:42.562 INFO:teuthology.orchestra.run.smithi017.stdout: mon clock drift allowed = 1.000 2024-03-12T17:17:42.563 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:17:42.563 INFO:teuthology.orchestra.run.smithi017.stdout: osd crush chooseleaf type = 0 2024-03-12T17:17:42.563 INFO:teuthology.orchestra.run.smithi017.stdout: auth debug = true 2024-03-12T17:17:42.563 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:17:42.563 INFO:teuthology.orchestra.run.smithi017.stdout: ms die on old message = true 2024-03-12T17:17:42.563 INFO:teuthology.orchestra.run.smithi017.stdout: ms die on bug = true 2024-03-12T17:17:42.563 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:17:42.563 INFO:teuthology.orchestra.run.smithi017.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-12T17:17:42.563 INFO:teuthology.orchestra.run.smithi017.stdout: mon pg warn max object skew = 0 2024-03-12T17:17:42.563 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:17:42.563 INFO:teuthology.orchestra.run.smithi017.stdout: # disable pg_autoscaler by default for new pools 2024-03-12T17:17:42.563 INFO:teuthology.orchestra.run.smithi017.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-12T17:17:42.563 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:17:42.564 INFO:teuthology.orchestra.run.smithi017.stdout: osd pool default size = 2 2024-03-12T17:17:42.564 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:17:42.564 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd allow primary affinity = true 2024-03-12T17:17:42.564 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd allow pg remap = true 2024-03-12T17:17:42.564 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on legacy crush tunables = false 2024-03-12T17:17:42.564 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on crush straw calc version zero = false 2024-03-12T17:17:42.564 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on no sortbitwise = false 2024-03-12T17:17:42.564 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on osd down out interval zero = false 2024-03-12T17:17:42.564 INFO:teuthology.orchestra.run.smithi017.stdout: mon warn on too few osds = false 2024-03-12T17:17:42.564 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-12T17:17:42.564 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-12T17:17:42.564 INFO:teuthology.orchestra.run.smithi017.stdout: mon_allow_pool_size_one = true 2024-03-12T17:17:42.564 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:17:42.564 INFO:teuthology.orchestra.run.smithi017.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-12T17:17:42.564 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:17:42.565 INFO:teuthology.orchestra.run.smithi017.stdout: osd default data pool replay window = 5 2024-03-12T17:17:42.565 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:17:42.565 INFO:teuthology.orchestra.run.smithi017.stdout: mon allow pool delete = true 2024-03-12T17:17:42.565 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:17:42.565 INFO:teuthology.orchestra.run.smithi017.stdout: mon cluster log file level = debug 2024-03-12T17:17:42.565 INFO:teuthology.orchestra.run.smithi017.stdout: debug asserts on shutdown = true 2024-03-12T17:17:42.565 INFO:teuthology.orchestra.run.smithi017.stdout: mon health detail to clog = false 2024-03-12T17:17:42.565 INFO:teuthology.orchestra.run.smithi017.stdout: mon host = "172.21.15.17,172.21.15.94,[v2:172.21.15.94:3301,v1:172.21.15.94:6790]" 2024-03-12T17:17:42.565 INFO:teuthology.orchestra.run.smithi017.stdout: ms die on skipped message = False 2024-03-12T17:17:42.565 INFO:teuthology.orchestra.run.smithi017.stdout: fsid = 73425bc1-630f-4bd2-8abb-716ed5d8ca29 2024-03-12T17:17:42.565 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:17:42.565 INFO:teuthology.orchestra.run.smithi017.stdout:[osd] 2024-03-12T17:17:42.565 INFO:teuthology.orchestra.run.smithi017.stdout: osd journal size = 100 2024-03-12T17:17:42.565 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:17:42.565 INFO:teuthology.orchestra.run.smithi017.stdout: osd scrub load threshold = 5.0 2024-03-12T17:17:42.566 INFO:teuthology.orchestra.run.smithi017.stdout: osd scrub max interval = 600 2024-03-12T17:17:42.566 INFO:teuthology.orchestra.run.smithi017.stdout: osd mclock profile = high_recovery_ops 2024-03-12T17:17:42.566 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:17:42.566 INFO:teuthology.orchestra.run.smithi017.stdout: osd recover clone overlap = true 2024-03-12T17:17:42.566 INFO:teuthology.orchestra.run.smithi017.stdout: osd recovery max chunk = 1048576 2024-03-12T17:17:42.566 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:17:42.566 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug shutdown = true 2024-03-12T17:17:42.566 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug op order = true 2024-03-12T17:17:42.566 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug verify stray on activate = true 2024-03-12T17:17:42.566 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:17:42.566 INFO:teuthology.orchestra.run.smithi017.stdout: osd open classes on start = true 2024-03-12T17:17:42.566 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug pg log writeout = true 2024-03-12T17:17:42.566 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:17:42.566 INFO:teuthology.orchestra.run.smithi017.stdout: osd deep scrub update digest min age = 30 2024-03-12T17:17:42.567 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:17:42.567 INFO:teuthology.orchestra.run.smithi017.stdout: osd map max advance = 10 2024-03-12T17:17:42.567 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:17:42.567 INFO:teuthology.orchestra.run.smithi017.stdout: journal zero on create = true 2024-03-12T17:17:42.567 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:17:42.567 INFO:teuthology.orchestra.run.smithi017.stdout: filestore ondisk finisher threads = 3 2024-03-12T17:17:42.567 INFO:teuthology.orchestra.run.smithi017.stdout: filestore apply finisher threads = 3 2024-03-12T17:17:42.567 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:17:42.567 INFO:teuthology.orchestra.run.smithi017.stdout: bdev debug aio = true 2024-03-12T17:17:42.567 INFO:teuthology.orchestra.run.smithi017.stdout: osd debug misdirected ops = true 2024-03-12T17:17:42.567 INFO:teuthology.orchestra.run.smithi017.stdout: bdev async discard = True 2024-03-12T17:17:42.567 INFO:teuthology.orchestra.run.smithi017.stdout: bdev enable discard = True 2024-03-12T17:17:42.567 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore allocator = bitmap 2024-03-12T17:17:42.567 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore block size = 96636764160 2024-03-12T17:17:42.568 INFO:teuthology.orchestra.run.smithi017.stdout: bluestore fsck on mount = True 2024-03-12T17:17:42.568 INFO:teuthology.orchestra.run.smithi017.stdout: debug bluefs = 1/20 2024-03-12T17:17:42.568 INFO:teuthology.orchestra.run.smithi017.stdout: debug bluestore = 1/20 2024-03-12T17:17:42.568 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-03-12T17:17:42.568 INFO:teuthology.orchestra.run.smithi017.stdout: debug osd = 20 2024-03-12T17:17:42.568 INFO:teuthology.orchestra.run.smithi017.stdout: debug rocksdb = 4/10 2024-03-12T17:17:42.568 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd backfillfull_ratio = 0.85 2024-03-12T17:17:42.568 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd full ratio = 0.9 2024-03-12T17:17:42.568 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd nearfull ratio = 0.8 2024-03-12T17:17:42.568 INFO:teuthology.orchestra.run.smithi017.stdout: osd failsafe full ratio = 0.95 2024-03-12T17:17:42.568 INFO:teuthology.orchestra.run.smithi017.stdout: osd objectstore = bluestore 2024-03-12T17:17:42.568 INFO:teuthology.orchestra.run.smithi017.stdout: osd op complaint time = 180 2024-03-12T17:17:42.568 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:17:42.568 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr] 2024-03-12T17:17:42.568 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-03-12T17:17:42.569 INFO:teuthology.orchestra.run.smithi017.stdout: debug mgr = 20 2024-03-12T17:17:42.569 INFO:teuthology.orchestra.run.smithi017.stdout: debug mon = 20 2024-03-12T17:17:42.569 INFO:teuthology.orchestra.run.smithi017.stdout: debug auth = 20 2024-03-12T17:17:42.569 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min pgs per osd = 4 2024-03-12T17:17:42.569 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min bytes per osd = 10 2024-03-12T17:17:42.569 INFO:teuthology.orchestra.run.smithi017.stdout: mgr/telemetry/nag = false 2024-03-12T17:17:42.569 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:17:42.569 INFO:teuthology.orchestra.run.smithi017.stdout:[mon] 2024-03-12T17:17:42.569 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-03-12T17:17:42.569 INFO:teuthology.orchestra.run.smithi017.stdout: debug mon = 20 2024-03-12T17:17:42.569 INFO:teuthology.orchestra.run.smithi017.stdout: debug paxos = 20 2024-03-12T17:17:42.569 INFO:teuthology.orchestra.run.smithi017.stdout: debug auth = 20 2024-03-12T17:17:42.569 INFO:teuthology.orchestra.run.smithi017.stdout: mon data avail warn = 5 2024-03-12T17:17:42.569 INFO:teuthology.orchestra.run.smithi017.stdout: mon mgr mkfs grace = 240 2024-03-12T17:17:42.570 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min pgs per osd = 4 2024-03-12T17:17:42.570 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd reporter subtree level = osd 2024-03-12T17:17:42.570 INFO:teuthology.orchestra.run.smithi017.stdout: mon osd prime pg temp = true 2024-03-12T17:17:42.570 INFO:teuthology.orchestra.run.smithi017.stdout: mon reweight min bytes per osd = 10 2024-03-12T17:17:42.570 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:17:42.570 INFO:teuthology.orchestra.run.smithi017.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-12T17:17:42.570 INFO:teuthology.orchestra.run.smithi017.stdout: auth mon ticket ttl = 660 # 11m 2024-03-12T17:17:42.570 INFO:teuthology.orchestra.run.smithi017.stdout: auth service ticket ttl = 240 # 4m 2024-03-12T17:17:42.570 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:17:42.570 INFO:teuthology.orchestra.run.smithi017.stdout: # don't complain about insecure global_id in the test suite 2024-03-12T17:17:42.570 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-12T17:17:42.570 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-12T17:17:42.570 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:17:42.571 INFO:teuthology.orchestra.run.smithi017.stdout: # 1m isn't quite enough 2024-03-12T17:17:42.571 INFO:teuthology.orchestra.run.smithi017.stdout: mon_down_mkfs_grace = 2m 2024-03-12T17:17:42.571 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:17:42.571 INFO:teuthology.orchestra.run.smithi017.stdout: mon_warn_on_filestore_osds = false 2024-03-12T17:17:42.571 INFO:teuthology.orchestra.run.smithi017.stdout: mon op complaint time = 120 2024-03-12T17:17:42.571 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:17:42.571 INFO:teuthology.orchestra.run.smithi017.stdout:[client] 2024-03-12T17:17:42.571 INFO:teuthology.orchestra.run.smithi017.stdout: rgw cache enabled = true 2024-03-12T17:17:42.571 INFO:teuthology.orchestra.run.smithi017.stdout: rgw enable ops log = true 2024-03-12T17:17:42.571 INFO:teuthology.orchestra.run.smithi017.stdout: rgw enable usage log = true 2024-03-12T17:17:42.571 INFO:teuthology.orchestra.run.smithi017.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-12T17:17:42.571 INFO:teuthology.orchestra.run.smithi017.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-12T17:17:42.571 INFO:teuthology.orchestra.run.smithi017.stdout: client mount timeout = 600 2024-03-12T17:17:42.571 INFO:teuthology.orchestra.run.smithi017.stdout: debug client = 20 2024-03-12T17:17:42.572 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-03-12T17:17:42.572 INFO:teuthology.orchestra.run.smithi017.stdout: pid file = "" 2024-03-12T17:17:42.572 INFO:teuthology.orchestra.run.smithi017.stdout: rados mon op timeout = 900 2024-03-12T17:17:42.572 INFO:teuthology.orchestra.run.smithi017.stdout: rados osd op timeout = 900 2024-03-12T17:17:42.572 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.a] 2024-03-12T17:17:42.572 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.b] 2024-03-12T17:17:42.572 INFO:teuthology.orchestra.run.smithi017.stdout:[mon.c] 2024-03-12T17:17:42.572 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.a] 2024-03-12T17:17:42.572 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.c] 2024-03-12T17:17:42.572 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.b] 2024-03-12T17:17:42.572 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.d] 2024-03-12T17:17:42.572 INFO:teuthology.orchestra.run.smithi017.stdout:[mds] 2024-03-12T17:17:42.572 INFO:teuthology.orchestra.run.smithi017.stdout: debug mds = 20 2024-03-12T17:17:42.572 INFO:teuthology.orchestra.run.smithi017.stdout: debug mds balancer = 20 2024-03-12T17:17:42.572 INFO:teuthology.orchestra.run.smithi017.stdout: debug ms = 1 2024-03-12T17:17:42.573 INFO:teuthology.orchestra.run.smithi017.stdout: mds debug frag = True 2024-03-12T17:17:42.573 INFO:teuthology.orchestra.run.smithi017.stdout: mds debug scatterstat = True 2024-03-12T17:17:42.573 INFO:teuthology.orchestra.run.smithi017.stdout: mds op complaint time = 180 2024-03-12T17:17:42.573 INFO:teuthology.orchestra.run.smithi017.stdout: mds verify scatter = True 2024-03-12T17:17:42.573 INFO:teuthology.orchestra.run.smithi017.stdout: osd op complaint time = 180 2024-03-12T17:17:42.573 INFO:teuthology.orchestra.run.smithi017.stdout: rados mon op timeout = 900 2024-03-12T17:17:42.573 INFO:teuthology.orchestra.run.smithi017.stdout: rados osd op timeout = 900 2024-03-12T17:17:42.573 INFO:teuthology.orchestra.run.smithi094.stdout:[global] 2024-03-12T17:17:42.574 INFO:teuthology.orchestra.run.smithi094.stdout: chdir = "" 2024-03-12T17:17:42.574 INFO:teuthology.orchestra.run.smithi094.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-12T17:17:42.574 INFO:teuthology.orchestra.run.smithi094.stdout: auth supported = cephx 2024-03-12T17:17:42.574 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:42.574 INFO:teuthology.orchestra.run.smithi094.stdout: filestore xattr use omap = true 2024-03-12T17:17:42.574 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:42.574 INFO:teuthology.orchestra.run.smithi094.stdout: mon clock drift allowed = 1.000 2024-03-12T17:17:42.574 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:42.574 INFO:teuthology.orchestra.run.smithi094.stdout: osd crush chooseleaf type = 0 2024-03-12T17:17:42.574 INFO:teuthology.orchestra.run.smithi094.stdout: auth debug = true 2024-03-12T17:17:42.574 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:42.574 INFO:teuthology.orchestra.run.smithi094.stdout: ms die on old message = true 2024-03-12T17:17:42.574 INFO:teuthology.orchestra.run.smithi094.stdout: ms die on bug = true 2024-03-12T17:17:42.575 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:42.575 INFO:teuthology.orchestra.run.smithi094.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-12T17:17:42.575 INFO:teuthology.orchestra.run.smithi094.stdout: mon pg warn max object skew = 0 2024-03-12T17:17:42.575 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:42.575 INFO:teuthology.orchestra.run.smithi094.stdout: # disable pg_autoscaler by default for new pools 2024-03-12T17:17:42.575 INFO:teuthology.orchestra.run.smithi094.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-12T17:17:42.575 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:42.575 INFO:teuthology.orchestra.run.smithi094.stdout: osd pool default size = 2 2024-03-12T17:17:42.575 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:42.575 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd allow primary affinity = true 2024-03-12T17:17:42.575 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd allow pg remap = true 2024-03-12T17:17:42.575 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on legacy crush tunables = false 2024-03-12T17:17:42.575 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on crush straw calc version zero = false 2024-03-12T17:17:42.575 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on no sortbitwise = false 2024-03-12T17:17:42.576 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on osd down out interval zero = false 2024-03-12T17:17:42.576 INFO:teuthology.orchestra.run.smithi094.stdout: mon warn on too few osds = false 2024-03-12T17:17:42.576 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-12T17:17:42.576 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-12T17:17:42.576 INFO:teuthology.orchestra.run.smithi094.stdout: mon_allow_pool_size_one = true 2024-03-12T17:17:42.576 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:42.576 INFO:teuthology.orchestra.run.smithi094.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-12T17:17:42.576 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:42.576 INFO:teuthology.orchestra.run.smithi094.stdout: osd default data pool replay window = 5 2024-03-12T17:17:42.576 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:42.576 INFO:teuthology.orchestra.run.smithi094.stdout: mon allow pool delete = true 2024-03-12T17:17:42.576 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:42.576 INFO:teuthology.orchestra.run.smithi094.stdout: mon cluster log file level = debug 2024-03-12T17:17:42.576 INFO:teuthology.orchestra.run.smithi094.stdout: debug asserts on shutdown = true 2024-03-12T17:17:42.577 INFO:teuthology.orchestra.run.smithi094.stdout: mon health detail to clog = false 2024-03-12T17:17:42.577 INFO:teuthology.orchestra.run.smithi094.stdout: mon host = "172.21.15.17,172.21.15.94,[v2:172.21.15.94:3301,v1:172.21.15.94:6790]" 2024-03-12T17:17:42.577 INFO:teuthology.orchestra.run.smithi094.stdout: ms die on skipped message = False 2024-03-12T17:17:42.577 INFO:teuthology.orchestra.run.smithi094.stdout: fsid = 73425bc1-630f-4bd2-8abb-716ed5d8ca29 2024-03-12T17:17:42.577 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:42.577 INFO:teuthology.orchestra.run.smithi094.stdout:[osd] 2024-03-12T17:17:42.577 INFO:teuthology.orchestra.run.smithi094.stdout: osd journal size = 100 2024-03-12T17:17:42.577 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:42.577 INFO:teuthology.orchestra.run.smithi094.stdout: osd scrub load threshold = 5.0 2024-03-12T17:17:42.577 INFO:teuthology.orchestra.run.smithi094.stdout: osd scrub max interval = 600 2024-03-12T17:17:42.577 INFO:teuthology.orchestra.run.smithi094.stdout: osd mclock profile = high_recovery_ops 2024-03-12T17:17:42.577 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:42.577 INFO:teuthology.orchestra.run.smithi094.stdout: osd recover clone overlap = true 2024-03-12T17:17:42.577 INFO:teuthology.orchestra.run.smithi094.stdout: osd recovery max chunk = 1048576 2024-03-12T17:17:42.577 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:42.578 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug shutdown = true 2024-03-12T17:17:42.578 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug op order = true 2024-03-12T17:17:42.578 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug verify stray on activate = true 2024-03-12T17:17:42.578 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:42.578 INFO:teuthology.orchestra.run.smithi094.stdout: osd open classes on start = true 2024-03-12T17:17:42.578 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug pg log writeout = true 2024-03-12T17:17:42.578 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:42.578 INFO:teuthology.orchestra.run.smithi094.stdout: osd deep scrub update digest min age = 30 2024-03-12T17:17:42.578 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:42.578 INFO:teuthology.orchestra.run.smithi094.stdout: osd map max advance = 10 2024-03-12T17:17:42.578 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:42.578 INFO:teuthology.orchestra.run.smithi094.stdout: journal zero on create = true 2024-03-12T17:17:42.578 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:42.578 INFO:teuthology.orchestra.run.smithi094.stdout: filestore ondisk finisher threads = 3 2024-03-12T17:17:42.578 INFO:teuthology.orchestra.run.smithi094.stdout: filestore apply finisher threads = 3 2024-03-12T17:17:42.579 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:42.579 INFO:teuthology.orchestra.run.smithi094.stdout: bdev debug aio = true 2024-03-12T17:17:42.579 INFO:teuthology.orchestra.run.smithi094.stdout: osd debug misdirected ops = true 2024-03-12T17:17:42.579 INFO:teuthology.orchestra.run.smithi094.stdout: bdev async discard = True 2024-03-12T17:17:42.579 INFO:teuthology.orchestra.run.smithi094.stdout: bdev enable discard = True 2024-03-12T17:17:42.579 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore allocator = bitmap 2024-03-12T17:17:42.579 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore block size = 96636764160 2024-03-12T17:17:42.579 INFO:teuthology.orchestra.run.smithi094.stdout: bluestore fsck on mount = True 2024-03-12T17:17:42.579 INFO:teuthology.orchestra.run.smithi094.stdout: debug bluefs = 1/20 2024-03-12T17:17:42.579 INFO:teuthology.orchestra.run.smithi094.stdout: debug bluestore = 1/20 2024-03-12T17:17:42.579 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-03-12T17:17:42.579 INFO:teuthology.orchestra.run.smithi094.stdout: debug osd = 20 2024-03-12T17:17:42.579 INFO:teuthology.orchestra.run.smithi094.stdout: debug rocksdb = 4/10 2024-03-12T17:17:42.579 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd backfillfull_ratio = 0.85 2024-03-12T17:17:42.580 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd full ratio = 0.9 2024-03-12T17:17:42.580 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd nearfull ratio = 0.8 2024-03-12T17:17:42.580 INFO:teuthology.orchestra.run.smithi094.stdout: osd failsafe full ratio = 0.95 2024-03-12T17:17:42.580 INFO:teuthology.orchestra.run.smithi094.stdout: osd objectstore = bluestore 2024-03-12T17:17:42.580 INFO:teuthology.orchestra.run.smithi094.stdout: osd op complaint time = 180 2024-03-12T17:17:42.580 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:42.580 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr] 2024-03-12T17:17:42.580 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-03-12T17:17:42.580 INFO:teuthology.orchestra.run.smithi094.stdout: debug mgr = 20 2024-03-12T17:17:42.580 INFO:teuthology.orchestra.run.smithi094.stdout: debug mon = 20 2024-03-12T17:17:42.580 INFO:teuthology.orchestra.run.smithi094.stdout: debug auth = 20 2024-03-12T17:17:42.580 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min pgs per osd = 4 2024-03-12T17:17:42.580 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min bytes per osd = 10 2024-03-12T17:17:42.580 INFO:teuthology.orchestra.run.smithi094.stdout: mgr/telemetry/nag = false 2024-03-12T17:17:42.580 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:42.581 INFO:teuthology.orchestra.run.smithi094.stdout:[mon] 2024-03-12T17:17:42.581 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-03-12T17:17:42.581 INFO:teuthology.orchestra.run.smithi094.stdout: debug mon = 20 2024-03-12T17:17:42.581 INFO:teuthology.orchestra.run.smithi094.stdout: debug paxos = 20 2024-03-12T17:17:42.581 INFO:teuthology.orchestra.run.smithi094.stdout: debug auth = 20 2024-03-12T17:17:42.581 INFO:teuthology.orchestra.run.smithi094.stdout: mon data avail warn = 5 2024-03-12T17:17:42.581 INFO:teuthology.orchestra.run.smithi094.stdout: mon mgr mkfs grace = 240 2024-03-12T17:17:42.581 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min pgs per osd = 4 2024-03-12T17:17:42.581 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd reporter subtree level = osd 2024-03-12T17:17:42.581 INFO:teuthology.orchestra.run.smithi094.stdout: mon osd prime pg temp = true 2024-03-12T17:17:42.581 INFO:teuthology.orchestra.run.smithi094.stdout: mon reweight min bytes per osd = 10 2024-03-12T17:17:42.581 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:42.581 INFO:teuthology.orchestra.run.smithi094.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-12T17:17:42.581 INFO:teuthology.orchestra.run.smithi094.stdout: auth mon ticket ttl = 660 # 11m 2024-03-12T17:17:42.581 INFO:teuthology.orchestra.run.smithi094.stdout: auth service ticket ttl = 240 # 4m 2024-03-12T17:17:42.582 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:42.582 INFO:teuthology.orchestra.run.smithi094.stdout: # don't complain about insecure global_id in the test suite 2024-03-12T17:17:42.582 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-12T17:17:42.582 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-12T17:17:42.582 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:42.582 INFO:teuthology.orchestra.run.smithi094.stdout: # 1m isn't quite enough 2024-03-12T17:17:42.582 INFO:teuthology.orchestra.run.smithi094.stdout: mon_down_mkfs_grace = 2m 2024-03-12T17:17:42.582 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:42.582 INFO:teuthology.orchestra.run.smithi094.stdout: mon_warn_on_filestore_osds = false 2024-03-12T17:17:42.582 INFO:teuthology.orchestra.run.smithi094.stdout: mon op complaint time = 120 2024-03-12T17:17:42.582 INFO:teuthology.orchestra.run.smithi094.stdout: 2024-03-12T17:17:42.582 INFO:teuthology.orchestra.run.smithi094.stdout:[client] 2024-03-12T17:17:42.582 INFO:teuthology.orchestra.run.smithi094.stdout: rgw cache enabled = true 2024-03-12T17:17:42.582 INFO:teuthology.orchestra.run.smithi094.stdout: rgw enable ops log = true 2024-03-12T17:17:42.583 INFO:teuthology.orchestra.run.smithi094.stdout: rgw enable usage log = true 2024-03-12T17:17:42.583 INFO:teuthology.orchestra.run.smithi094.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-12T17:17:42.583 INFO:teuthology.orchestra.run.smithi094.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-12T17:17:42.583 INFO:teuthology.orchestra.run.smithi094.stdout: client mount timeout = 600 2024-03-12T17:17:42.583 INFO:teuthology.orchestra.run.smithi094.stdout: debug client = 20 2024-03-12T17:17:42.583 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-03-12T17:17:42.583 INFO:teuthology.orchestra.run.smithi094.stdout: pid file = "" 2024-03-12T17:17:42.583 INFO:teuthology.orchestra.run.smithi094.stdout: rados mon op timeout = 900 2024-03-12T17:17:42.583 INFO:teuthology.orchestra.run.smithi094.stdout: rados osd op timeout = 900 2024-03-12T17:17:42.583 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.a] 2024-03-12T17:17:42.583 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.b] 2024-03-12T17:17:42.583 INFO:teuthology.orchestra.run.smithi094.stdout:[mon.c] 2024-03-12T17:17:42.583 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.a] 2024-03-12T17:17:42.583 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.c] 2024-03-12T17:17:42.583 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.b] 2024-03-12T17:17:42.583 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.d] 2024-03-12T17:17:42.584 INFO:teuthology.orchestra.run.smithi094.stdout:[mds] 2024-03-12T17:17:42.584 INFO:teuthology.orchestra.run.smithi094.stdout: debug mds = 20 2024-03-12T17:17:42.584 INFO:teuthology.orchestra.run.smithi094.stdout: debug mds balancer = 20 2024-03-12T17:17:42.584 INFO:teuthology.orchestra.run.smithi094.stdout: debug ms = 1 2024-03-12T17:17:42.584 INFO:teuthology.orchestra.run.smithi094.stdout: mds debug frag = True 2024-03-12T17:17:42.584 INFO:teuthology.orchestra.run.smithi094.stdout: mds debug scatterstat = True 2024-03-12T17:17:42.584 INFO:teuthology.orchestra.run.smithi094.stdout: mds op complaint time = 180 2024-03-12T17:17:42.584 INFO:teuthology.orchestra.run.smithi094.stdout: mds verify scatter = True 2024-03-12T17:17:42.584 INFO:teuthology.orchestra.run.smithi094.stdout: osd op complaint time = 180 2024-03-12T17:17:42.584 INFO:teuthology.orchestra.run.smithi094.stdout: rados mon op timeout = 900 2024-03-12T17:17:42.584 INFO:teuthology.orchestra.run.smithi094.stdout: rados osd op timeout = 900 2024-03-12T17:17:42.611 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-12T17:17:42.611 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-12T17:17:42.763 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-12T17:17:42.764 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:17:42.764 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-12T17:17:42.818 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:17:42.819 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-12T17:17:42.870 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi017.front.sepia.ceph.com 2024-03-12T17:17:42.870 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:17:42.871 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-12T17:17:42.871 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-12T17:17:43.021 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:17:43.021 DEBUG:teuthology.orchestra.run.smithi017:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-12T17:17:43.120 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi094.front.sepia.ceph.com 2024-03-12T17:17:43.121 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-12T17:17:43.121 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-12T17:17:43.121 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-12T17:17:43.255 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-12T17:17:43.255 DEBUG:teuthology.orchestra.run.smithi094:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-12T17:17:43.352 INFO:tasks.ceph:Setting up mon nodes... 2024-03-12T17:17:43.352 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-12T17:17:43.352 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-03-12T17:17:43.554 INFO:teuthology.orchestra.run.smithi017.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-03-12T17:17:43.565 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-12T17:17:43.769 INFO:teuthology.orchestra.run.smithi094.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-12T17:17:43.777 INFO:tasks.ceph:Setting up mds nodes... 2024-03-12T17:17:43.777 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-03-12T17:17:43.968 INFO:teuthology.orchestra.run.smithi017.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-03-12T17:17:43.978 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-03-12T17:17:44.080 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-03-12T17:17:44.273 INFO:teuthology.orchestra.run.smithi017.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-03-12T17:17:44.283 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-03-12T17:17:44.370 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-03-12T17:17:44.540 INFO:teuthology.orchestra.run.smithi094.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-03-12T17:17:44.547 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-03-12T17:17:44.629 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-03-12T17:17:44.789 INFO:teuthology.orchestra.run.smithi094.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-03-12T17:17:44.798 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-03-12T17:17:44.878 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-12T17:17:44.878 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-12T17:17:45.016 INFO:teuthology.orchestra.run.smithi017.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-12T17:17:45.074 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-03-12T17:17:45.207 INFO:teuthology.orchestra.run.smithi017.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-03-12T17:17:45.265 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-03-12T17:17:45.389 INFO:teuthology.orchestra.run.smithi094.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-03-12T17:17:45.447 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-03-12T17:17:45.571 INFO:teuthology.orchestra.run.smithi094.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-03-12T17:17:45.621 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-12T17:17:45.621 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi017.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi094.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-12T17:17:45.621 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-12T17:17:45.729 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-12T17:17:45.729 INFO:tasks.ceph:role: osd.0 2024-03-12T17:17:45.729 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi017.front.sepia.ceph.com 2024-03-12T17:17:45.729 DEBUG:teuthology.orchestra.run.smithi017:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-12T17:17:45.828 INFO:teuthology.orchestra.run.smithi017.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-12T17:17:45.828 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-12T17:17:45.828 INFO:teuthology.orchestra.run.smithi017.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-12T17:17:45.828 INFO:teuthology.orchestra.run.smithi017.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-12T17:17:45.828 INFO:teuthology.orchestra.run.smithi017.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-12T17:17:45.828 INFO:teuthology.orchestra.run.smithi017.stdout: = sunit=0 swidth=0 blks 2024-03-12T17:17:45.828 INFO:teuthology.orchestra.run.smithi017.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-12T17:17:45.828 INFO:teuthology.orchestra.run.smithi017.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-12T17:17:45.828 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-12T17:17:45.828 INFO:teuthology.orchestra.run.smithi017.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-12T17:17:45.861 INFO:teuthology.orchestra.run.smithi017.stdout:Discarding blocks...Done. 2024-03-12T17:17:45.867 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi017.front.sepia.ceph.com -o noatime 2024-03-12T17:17:45.867 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-12T17:17:45.977 DEBUG:teuthology.orchestra.run.smithi017:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-12T17:17:46.059 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-12T17:17:46.146 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-12T17:17:46.146 INFO:tasks.ceph:role: osd.1 2024-03-12T17:17:46.146 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi017.front.sepia.ceph.com 2024-03-12T17:17:46.146 DEBUG:teuthology.orchestra.run.smithi017:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-12T17:17:46.233 INFO:teuthology.orchestra.run.smithi017.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-12T17:17:46.233 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-12T17:17:46.233 INFO:teuthology.orchestra.run.smithi017.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-12T17:17:46.233 INFO:teuthology.orchestra.run.smithi017.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-12T17:17:46.234 INFO:teuthology.orchestra.run.smithi017.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-12T17:17:46.234 INFO:teuthology.orchestra.run.smithi017.stdout: = sunit=0 swidth=0 blks 2024-03-12T17:17:46.234 INFO:teuthology.orchestra.run.smithi017.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-12T17:17:46.234 INFO:teuthology.orchestra.run.smithi017.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-12T17:17:46.234 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-12T17:17:46.234 INFO:teuthology.orchestra.run.smithi017.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-12T17:17:46.267 INFO:teuthology.orchestra.run.smithi017.stdout:Discarding blocks...Done. 2024-03-12T17:17:46.274 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi017.front.sepia.ceph.com -o noatime 2024-03-12T17:17:46.274 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-12T17:17:46.385 DEBUG:teuthology.orchestra.run.smithi017:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-12T17:17:46.469 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-12T17:17:46.542 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-12T17:17:46.542 INFO:tasks.ceph:role: osd.2 2024-03-12T17:17:46.542 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi017.front.sepia.ceph.com 2024-03-12T17:17:46.542 DEBUG:teuthology.orchestra.run.smithi017:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-12T17:17:46.614 INFO:teuthology.orchestra.run.smithi017.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-12T17:17:46.614 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-12T17:17:46.614 INFO:teuthology.orchestra.run.smithi017.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-12T17:17:46.614 INFO:teuthology.orchestra.run.smithi017.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-12T17:17:46.614 INFO:teuthology.orchestra.run.smithi017.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-12T17:17:46.614 INFO:teuthology.orchestra.run.smithi017.stdout: = sunit=0 swidth=0 blks 2024-03-12T17:17:46.614 INFO:teuthology.orchestra.run.smithi017.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-12T17:17:46.614 INFO:teuthology.orchestra.run.smithi017.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-12T17:17:46.615 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-12T17:17:46.615 INFO:teuthology.orchestra.run.smithi017.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-12T17:17:46.646 INFO:teuthology.orchestra.run.smithi017.stdout:Discarding blocks...Done. 2024-03-12T17:17:46.652 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi017.front.sepia.ceph.com -o noatime 2024-03-12T17:17:46.652 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-12T17:17:46.743 DEBUG:teuthology.orchestra.run.smithi017:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-12T17:17:46.816 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-12T17:17:46.891 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-12T17:17:46.892 INFO:tasks.ceph:role: osd.3 2024-03-12T17:17:46.892 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi017.front.sepia.ceph.com 2024-03-12T17:17:46.892 DEBUG:teuthology.orchestra.run.smithi017:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-12T17:17:46.972 INFO:teuthology.orchestra.run.smithi017.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-12T17:17:46.972 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-12T17:17:46.972 INFO:teuthology.orchestra.run.smithi017.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-12T17:17:46.972 INFO:teuthology.orchestra.run.smithi017.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-12T17:17:46.972 INFO:teuthology.orchestra.run.smithi017.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-12T17:17:46.972 INFO:teuthology.orchestra.run.smithi017.stdout: = sunit=0 swidth=0 blks 2024-03-12T17:17:46.972 INFO:teuthology.orchestra.run.smithi017.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-12T17:17:46.972 INFO:teuthology.orchestra.run.smithi017.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-12T17:17:46.972 INFO:teuthology.orchestra.run.smithi017.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-12T17:17:46.972 INFO:teuthology.orchestra.run.smithi017.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-12T17:17:47.007 INFO:teuthology.orchestra.run.smithi017.stdout:Discarding blocks...Done. 2024-03-12T17:17:47.012 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi017.front.sepia.ceph.com -o noatime 2024-03-12T17:17:47.013 DEBUG:teuthology.orchestra.run.smithi017:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-03-12T17:17:47.111 DEBUG:teuthology.orchestra.run.smithi017:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-12T17:17:47.190 DEBUG:teuthology.orchestra.run.smithi017:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-12T17:17:47.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:17:47.325+0000 7fd78860e500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-12T17:17:47.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:17:47.326+0000 7fd78860e500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-12T17:17:47.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:17:47.326+0000 7fd78860e500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-12T17:17:47.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:17:47.326+0000 7fd78860e500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-12T17:17:47.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:17:47.326+0000 7fd78860e500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-12T17:17:47.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:17:47.330+0000 7fd78860e500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-12T17:17:50.247 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-12T17:17:50.350 DEBUG:teuthology.orchestra.run.smithi017:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-12T17:17:50.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:17:50.504+0000 7f42d1107500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-12T17:17:50.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:17:50.505+0000 7f42d1107500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-12T17:17:50.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:17:50.505+0000 7f42d1107500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-12T17:17:50.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:17:50.505+0000 7f42d1107500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-12T17:17:50.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:17:50.505+0000 7f42d1107500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-12T17:17:50.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:17:50.507+0000 7f42d1107500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-12T17:17:53.676 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-12T17:17:53.781 DEBUG:teuthology.orchestra.run.smithi017:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-12T17:17:53.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:17:53.932+0000 7f02821a9500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-12T17:17:53.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:17:53.932+0000 7f02821a9500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-12T17:17:53.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:17:53.932+0000 7f02821a9500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-12T17:17:53.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:17:53.932+0000 7f02821a9500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-12T17:17:53.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:17:53.932+0000 7f02821a9500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-12T17:17:53.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:17:53.934+0000 7f02821a9500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-12T17:17:57.114 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-12T17:17:57.215 DEBUG:teuthology.orchestra.run.smithi017:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-12T17:17:57.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:17:57.370+0000 7fe47a825500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-12T17:17:57.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:17:57.370+0000 7fe47a825500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-12T17:17:57.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:17:57.370+0000 7fe47a825500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-12T17:17:57.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:17:57.370+0000 7fe47a825500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-12T17:17:57.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:17:57.370+0000 7fe47a825500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-12T17:17:57.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:17:57.372+0000 7fe47a825500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-12T17:18:00.533 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-12T17:18:00.635 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-03-12T17:18:00.731 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-12T17:18:00.731 INFO:tasks.ceph:role: osd.4 2024-03-12T17:18:00.731 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi094.front.sepia.ceph.com 2024-03-12T17:18:00.731 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-12T17:18:00.823 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-12T17:18:00.823 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-12T17:18:00.823 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-12T17:18:00.824 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-12T17:18:00.824 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-12T17:18:00.824 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2024-03-12T17:18:00.824 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-12T17:18:00.824 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-12T17:18:00.824 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-12T17:18:00.824 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-12T17:18:00.860 INFO:teuthology.orchestra.run.smithi094.stdout:Discarding blocks...Done. 2024-03-12T17:18:00.867 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2024-03-12T17:18:00.867 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-03-12T17:18:00.981 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-03-12T17:18:01.064 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-03-12T17:18:01.143 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-12T17:18:01.143 INFO:tasks.ceph:role: osd.5 2024-03-12T17:18:01.143 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi094.front.sepia.ceph.com 2024-03-12T17:18:01.144 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-12T17:18:01.222 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-12T17:18:01.223 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-12T17:18:01.223 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-12T17:18:01.223 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-12T17:18:01.223 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-12T17:18:01.223 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2024-03-12T17:18:01.223 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-12T17:18:01.223 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-12T17:18:01.223 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-12T17:18:01.223 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-12T17:18:01.256 INFO:teuthology.orchestra.run.smithi094.stdout:Discarding blocks...Done. 2024-03-12T17:18:01.262 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2024-03-12T17:18:01.262 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-03-12T17:18:01.367 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-03-12T17:18:01.440 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-03-12T17:18:01.515 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-12T17:18:01.515 INFO:tasks.ceph:role: osd.6 2024-03-12T17:18:01.516 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi094.front.sepia.ceph.com 2024-03-12T17:18:01.516 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-12T17:18:01.590 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-12T17:18:01.590 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-12T17:18:01.590 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-12T17:18:01.590 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-12T17:18:01.590 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-12T17:18:01.590 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2024-03-12T17:18:01.590 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-12T17:18:01.590 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-12T17:18:01.591 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-12T17:18:01.591 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-12T17:18:01.624 INFO:teuthology.orchestra.run.smithi094.stdout:Discarding blocks...Done. 2024-03-12T17:18:01.630 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2024-03-12T17:18:01.630 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-03-12T17:18:01.721 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-03-12T17:18:01.794 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-03-12T17:18:01.871 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-12T17:18:01.871 INFO:tasks.ceph:role: osd.7 2024-03-12T17:18:01.872 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi094.front.sepia.ceph.com 2024-03-12T17:18:01.872 DEBUG:teuthology.orchestra.run.smithi094:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-12T17:18:01.950 INFO:teuthology.orchestra.run.smithi094.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-12T17:18:01.951 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-12T17:18:01.951 INFO:teuthology.orchestra.run.smithi094.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-12T17:18:01.951 INFO:teuthology.orchestra.run.smithi094.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-12T17:18:01.951 INFO:teuthology.orchestra.run.smithi094.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-12T17:18:01.951 INFO:teuthology.orchestra.run.smithi094.stdout: = sunit=0 swidth=0 blks 2024-03-12T17:18:01.951 INFO:teuthology.orchestra.run.smithi094.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-12T17:18:01.951 INFO:teuthology.orchestra.run.smithi094.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-12T17:18:01.951 INFO:teuthology.orchestra.run.smithi094.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-12T17:18:01.951 INFO:teuthology.orchestra.run.smithi094.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-12T17:18:01.984 INFO:teuthology.orchestra.run.smithi094.stdout:Discarding blocks...Done. 2024-03-12T17:18:01.989 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi094.front.sepia.ceph.com -o noatime 2024-03-12T17:18:01.989 DEBUG:teuthology.orchestra.run.smithi094:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-03-12T17:18:02.081 DEBUG:teuthology.orchestra.run.smithi094:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-03-12T17:18:02.153 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-12T17:18:02.278 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:02.283+0000 7f2b7d88c500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-03-12T17:18:02.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:02.284+0000 7f2b7d88c500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-03-12T17:18:02.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:02.284+0000 7f2b7d88c500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-12T17:18:02.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:02.284+0000 7f2b7d88c500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-12T17:18:02.279 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:02.284+0000 7f2b7d88c500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-12T17:18:02.281 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:02.287+0000 7f2b7d88c500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-03-12T17:18:05.199 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-12T17:18:05.292 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-12T17:18:05.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:05.436+0000 7f7a81dfb500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-03-12T17:18:05.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:05.437+0000 7f7a81dfb500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-03-12T17:18:05.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:05.437+0000 7f7a81dfb500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-12T17:18:05.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:05.437+0000 7f7a81dfb500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-12T17:18:05.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:05.437+0000 7f7a81dfb500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-12T17:18:05.433 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:05.439+0000 7f7a81dfb500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-03-12T17:18:08.601 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-12T17:18:08.695 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-12T17:18:08.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:08.824+0000 7fe343f2b500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-03-12T17:18:08.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:08.824+0000 7fe343f2b500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-03-12T17:18:08.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:08.824+0000 7fe343f2b500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-12T17:18:08.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:08.824+0000 7fe343f2b500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-12T17:18:08.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:08.824+0000 7fe343f2b500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-12T17:18:08.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:08.826+0000 7fe343f2b500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-03-12T17:18:09.749 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:18:09.757 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:18:11.996 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-12T17:18:12.090 DEBUG:teuthology.orchestra.run.smithi094:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-12T17:18:12.221 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:12.227+0000 7f703c09a500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-03-12T17:18:12.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:12.227+0000 7f703c09a500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-03-12T17:18:12.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:12.227+0000 7f703c09a500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-12T17:18:12.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:12.227+0000 7f703c09a500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-12T17:18:12.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:12.227+0000 7f703c09a500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-12T17:18:12.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:12.229+0000 7f703c09a500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-03-12T17:18:15.148 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-12T17:18:15.232 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-12T17:18:15.232 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:18:15.232 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-03-12T17:18:15.335 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:18:15.335 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-03-12T17:18:15.437 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:18:15.437 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-03-12T17:18:15.532 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:18:15.532 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-12T17:18:15.633 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:18:16.023 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-12T17:18:16.129 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:18:16.129 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-12T17:18:16.228 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:18:16.228 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-12T17:18:16.330 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-12T17:18:16.330 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-12T17:18:16.423 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-12T17:18:16.423 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-03-12T17:18:16.510 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-12T17:18:16.510 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-03-12T17:18:16.607 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-12T17:18:16.607 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-03-12T17:18:16.701 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-12T17:18:16.701 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-03-12T17:18:16.793 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-12T17:18:16.793 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-03-12T17:18:16.928 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-12T17:18:16.929 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-03-12T17:18:17.022 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:18:17.022 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-12T17:18:17.082 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:18:17.082 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-03-12T17:18:17.138 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-12T17:18:17.138 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-03-12T17:18:17.191 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-12T17:18:17.192 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-03-12T17:18:17.241 INFO:tasks.ceph:Adding keys to all mons... 2024-03-12T17:18:17.241 DEBUG:teuthology.orchestra.run.smithi017:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-12T17:18:17.249 DEBUG:teuthology.orchestra.run.smithi094:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-12T17:18:17.339 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr.y] 2024-03-12T17:18:17.339 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQA3jvBl52J0IRAAlXujYfGNQsCxv2mWN0a3Gg== 2024-03-12T17:18:17.339 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.a] 2024-03-12T17:18:17.339 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQA3jvBl8pscOhAAg7cRCKubs0xJHi6+fzHsQg== 2024-03-12T17:18:17.340 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.c] 2024-03-12T17:18:17.340 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQA4jvBlyF62EBAALdtfnD6arVS4lYylDoyb3Q== 2024-03-12T17:18:17.340 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.0] 2024-03-12T17:18:17.340 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQA7jvBl3giDExAAnT30pG7fp2lHalG8evhA3g== 2024-03-12T17:18:17.340 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.1] 2024-03-12T17:18:17.340 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQA+jvBlKrEqHhAA40NN4MDLV0Rsncz9gUNSoA== 2024-03-12T17:18:17.340 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.2] 2024-03-12T17:18:17.340 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQBBjvBlgfKmNxAAAQJBRIwNzLm66Vqi/jsgsQ== 2024-03-12T17:18:17.340 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.3] 2024-03-12T17:18:17.340 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQBFjvBl24MrFhAA0EmYMPLOZFvtCbfZeENu7g== 2024-03-12T17:18:17.340 INFO:teuthology.orchestra.run.smithi017.stdout:[mgr.x] 2024-03-12T17:18:17.340 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQA3jvBl2xQ7LhAAmqFemeo/+3y+6TFvK2W6mw== 2024-03-12T17:18:17.340 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.b] 2024-03-12T17:18:17.340 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQA4jvBl7BmXIBAARcXGpnsnW07RmdLKxAOtDw== 2024-03-12T17:18:17.341 INFO:teuthology.orchestra.run.smithi017.stdout:[mds.d] 2024-03-12T17:18:17.341 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQA4jvBl/AJwLxAApE9bwTCmJJE4MkW6U0wg/A== 2024-03-12T17:18:17.341 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.4] 2024-03-12T17:18:17.341 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQBKjvBlIPL1EBAAS1B1kQhpHAn4PM9TvJnmqQ== 2024-03-12T17:18:17.341 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.5] 2024-03-12T17:18:17.341 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQBNjvBl4ncdGhAAQuU1o+s7FbgWGzWk1vgRjQ== 2024-03-12T17:18:17.341 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.6] 2024-03-12T17:18:17.341 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQBQjvBlSJ0wMRAA1+44GX7lMpXP/5xPWlaC9w== 2024-03-12T17:18:17.341 INFO:teuthology.orchestra.run.smithi017.stdout:[osd.7] 2024-03-12T17:18:17.341 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQBUjvBlt2qZDRAA5cpkAXcTcN+xMt0tz2imDg== 2024-03-12T17:18:17.341 INFO:teuthology.orchestra.run.smithi017.stdout:[client.0] 2024-03-12T17:18:17.341 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQA5jvBl3EtgARAAMO0rXhwCHTQ4455DuyFa6w== 2024-03-12T17:18:17.341 INFO:teuthology.orchestra.run.smithi017.stdout:[client.2] 2024-03-12T17:18:17.341 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQA5jvBlZNi5DBAAmWJzui0X1LNEF2McslvhEw== 2024-03-12T17:18:17.341 INFO:teuthology.orchestra.run.smithi017.stdout:[client.1] 2024-03-12T17:18:17.342 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQA5jvBlM7qcFxAA4v58amLyydfK80N6/pBSFA== 2024-03-12T17:18:17.342 INFO:teuthology.orchestra.run.smithi017.stdout:[client.3] 2024-03-12T17:18:17.342 INFO:teuthology.orchestra.run.smithi017.stdout: key = AQA5jvBlwlx1IhAADR44dr9HHJeiLyqM9ji0UA== 2024-03-12T17:18:17.372 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr.y] 2024-03-12T17:18:17.372 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQA3jvBl52J0IRAAlXujYfGNQsCxv2mWN0a3Gg== 2024-03-12T17:18:17.372 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.a] 2024-03-12T17:18:17.373 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQA3jvBl8pscOhAAg7cRCKubs0xJHi6+fzHsQg== 2024-03-12T17:18:17.373 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.c] 2024-03-12T17:18:17.373 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQA4jvBlyF62EBAALdtfnD6arVS4lYylDoyb3Q== 2024-03-12T17:18:17.373 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.0] 2024-03-12T17:18:17.373 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQA7jvBl3giDExAAnT30pG7fp2lHalG8evhA3g== 2024-03-12T17:18:17.373 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.1] 2024-03-12T17:18:17.373 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQA+jvBlKrEqHhAA40NN4MDLV0Rsncz9gUNSoA== 2024-03-12T17:18:17.373 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.2] 2024-03-12T17:18:17.373 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBBjvBlgfKmNxAAAQJBRIwNzLm66Vqi/jsgsQ== 2024-03-12T17:18:17.373 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.3] 2024-03-12T17:18:17.373 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBFjvBl24MrFhAA0EmYMPLOZFvtCbfZeENu7g== 2024-03-12T17:18:17.373 INFO:teuthology.orchestra.run.smithi094.stdout:[mgr.x] 2024-03-12T17:18:17.373 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQA3jvBl2xQ7LhAAmqFemeo/+3y+6TFvK2W6mw== 2024-03-12T17:18:17.373 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.b] 2024-03-12T17:18:17.373 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQA4jvBl7BmXIBAARcXGpnsnW07RmdLKxAOtDw== 2024-03-12T17:18:17.373 INFO:teuthology.orchestra.run.smithi094.stdout:[mds.d] 2024-03-12T17:18:17.374 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQA4jvBl/AJwLxAApE9bwTCmJJE4MkW6U0wg/A== 2024-03-12T17:18:17.374 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.4] 2024-03-12T17:18:17.374 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBKjvBlIPL1EBAAS1B1kQhpHAn4PM9TvJnmqQ== 2024-03-12T17:18:17.374 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.5] 2024-03-12T17:18:17.374 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBNjvBl4ncdGhAAQuU1o+s7FbgWGzWk1vgRjQ== 2024-03-12T17:18:17.374 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.6] 2024-03-12T17:18:17.374 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBQjvBlSJ0wMRAA1+44GX7lMpXP/5xPWlaC9w== 2024-03-12T17:18:17.374 INFO:teuthology.orchestra.run.smithi094.stdout:[osd.7] 2024-03-12T17:18:17.374 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQBUjvBlt2qZDRAA5cpkAXcTcN+xMt0tz2imDg== 2024-03-12T17:18:17.374 INFO:teuthology.orchestra.run.smithi094.stdout:[client.0] 2024-03-12T17:18:17.374 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQA5jvBl3EtgARAAMO0rXhwCHTQ4455DuyFa6w== 2024-03-12T17:18:17.374 INFO:teuthology.orchestra.run.smithi094.stdout:[client.2] 2024-03-12T17:18:17.374 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQA5jvBlZNi5DBAAmWJzui0X1LNEF2McslvhEw== 2024-03-12T17:18:17.374 INFO:teuthology.orchestra.run.smithi094.stdout:[client.1] 2024-03-12T17:18:17.374 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQA5jvBlM7qcFxAA4v58amLyydfK80N6/pBSFA== 2024-03-12T17:18:17.375 INFO:teuthology.orchestra.run.smithi094.stdout:[client.3] 2024-03-12T17:18:17.375 INFO:teuthology.orchestra.run.smithi094.stdout: key = AQA5jvBlwlx1IhAADR44dr9HHJeiLyqM9ji0UA== 2024-03-12T17:18:17.377 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-12T17:18:17.390 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-12T17:18:17.537 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-12T17:18:17.541 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-12T17:18:17.687 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-12T17:18:17.694 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-12T17:18:17.841 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-12T17:18:17.846 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-12T17:18:17.992 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-12T17:18:17.999 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-12T17:18:18.144 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-12T17:18:18.149 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-12T17:18:18.291 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-12T17:18:18.295 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-12T17:18:18.438 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-12T17:18:18.445 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-12T17:18:18.591 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-12T17:18:18.596 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-12T17:18:18.745 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-12T17:18:18.749 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-12T17:18:18.892 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-12T17:18:18.896 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-12T17:18:19.041 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-12T17:18:19.046 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-12T17:18:19.193 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-12T17:18:19.198 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-12T17:18:19.343 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-12T17:18:19.349 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-12T17:18:19.491 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-12T17:18:19.496 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-12T17:18:19.645 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-12T17:18:19.652 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-12T17:18:19.796 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-12T17:18:19.803 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-12T17:18:19.953 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-12T17:18:19.958 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-12T17:18:20.105 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-12T17:18:20.106 DEBUG:teuthology.orchestra.run.smithi017:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-12T17:18:20.202 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-12T17:18:20.367 DEBUG:teuthology.orchestra.run.smithi017:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-12T17:18:20.451 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-03-12T17:18:20.547 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-12T17:18:20.700 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-03-12T17:18:20.777 DEBUG:teuthology.orchestra.run.smithi094:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-03-12T17:18:20.868 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-12T17:18:21.018 DEBUG:teuthology.orchestra.run.smithi094:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-03-12T17:18:21.098 DEBUG:teuthology.orchestra.run.smithi017:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-12T17:18:21.106 DEBUG:teuthology.orchestra.run.smithi094:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-12T17:18:21.157 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-12T17:18:21.158 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-12T17:18:21.158 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-12T17:18:21.164 INFO:tasks.ceph.mon.a:Started 2024-03-12T17:18:21.164 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-12T17:18:21.164 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-12T17:18:21.170 INFO:tasks.ceph.mon.b:Started 2024-03-12T17:18:21.170 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-12T17:18:21.171 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-12T17:18:21.177 INFO:tasks.ceph.mon.c:Started 2024-03-12T17:18:21.177 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-12T17:18:21.177 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-03-12T17:18:21.177 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-03-12T17:18:21.182 INFO:tasks.ceph.mgr.y:Started 2024-03-12T17:18:21.182 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-12T17:18:21.182 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-03-12T17:18:21.187 INFO:tasks.ceph.mgr.x:Started 2024-03-12T17:18:21.187 INFO:tasks.ceph:Setting crush tunables to default 2024-03-12T17:18:21.187 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph osd crush tunables default 2024-03-12T17:18:21.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:21.375+0000 7ff879800640 1 Processor -- start 2024-03-12T17:18:21.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:21.375+0000 7ff879800640 1 -- start start 2024-03-12T17:18:21.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:21.376+0000 7ff879800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff8740d2fa0 0x7ff8740d3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:21.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:21.376+0000 7ff879800640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff8740b5f70 0x7ff8740d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:21.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:21.376+0000 7ff879800640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8740d14e0 con 0x7ff8740b5b50 2024-03-12T17:18:21.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:21.376+0000 7ff879800640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8740b59e0 con 0x7ff8740d2fa0 2024-03-12T17:18:21.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:21.376+0000 7ff879800640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8740d38c0 con 0x7ff8740b5f70 2024-03-12T17:18:21.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:21.376+0000 7ff873400640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff8740b5f70 0x7ff8740d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:21.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:21.377+0000 7ff873400640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff8740b5f70 0x7ff8740d1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.17:52778/0 (socket says 172.21.15.17:52778) 2024-03-12T17:18:21.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:21.377+0000 7ff872a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff8740d2fa0 0x7ff8740d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:21.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:21.377+0000 7ff873400640 1 -- 172.21.15.17:0/2414527218 learned_addr learned my addr 172.21.15.17:0/2414527218 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:21.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:21.377+0000 7ff86a000640 1 --1- 172.21.15.17:0/2414527218 >> v1:172.21.15.94:6789/0 conn(0x7ff8740b5b50 0x7ff8740cd840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.17:34952/0 (socket says 172.21.15.17:34952) 2024-03-12T17:18:21.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:21.377+0000 7ff872a00640 1 -- 172.21.15.17:0/2414527218 >> v2:172.21.15.17:3300/0 conn(0x7ff8740d2fa0 msgr2=0x7ff8740d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-12T17:18:21.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:21.377+0000 7ff872a00640 1 -- 172.21.15.17:0/2414527218 >> v2:172.21.15.17:3300/0 conn(0x7ff8740d2fa0 msgr2=0x7ff8740d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-12T17:18:21.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:21.377+0000 7ff872a00640 1 --2- 172.21.15.17:0/2414527218 >> v2:172.21.15.17:3300/0 conn(0x7ff8740d2fa0 0x7ff8740d3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-12T17:18:21.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:21.377+0000 7ff873400640 1 -- 172.21.15.17:0/2414527218 >> v2:172.21.15.94:3300/0 conn(0x7ff8740b5f70 msgr2=0x7ff8740d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-12T17:18:21.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:21.377+0000 7ff873400640 1 -- 172.21.15.17:0/2414527218 >> v2:172.21.15.94:3300/0 conn(0x7ff8740b5f70 msgr2=0x7ff8740d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-12T17:18:21.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:21.377+0000 7ff873400640 1 --2- 172.21.15.17:0/2414527218 >> v2:172.21.15.94:3300/0 conn(0x7ff8740b5f70 0x7ff8740d1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-12T17:18:21.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:21.377+0000 7ff873400640 1 --2- 172.21.15.17:0/2414527218 >> v2:172.21.15.94:3300/0 conn(0x7ff8740b5f70 0x7ff8740d1f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-12T17:18:21.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:21.377+0000 7ff872a00640 1 --2- 172.21.15.17:0/2414527218 >> v2:172.21.15.17:3300/0 conn(0x7ff8740d2fa0 0x7ff8740d3380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-12T17:18:21.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:21.578+0000 7ff872a00640 1 --2- 172.21.15.17:0/2414527218 >> v2:172.21.15.17:3300/0 conn(0x7ff8740d2fa0 0x7ff8740d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:21.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:21.578+0000 7ff873400640 1 --2- 172.21.15.17:0/2414527218 >> v2:172.21.15.94:3300/0 conn(0x7ff8740b5f70 0x7ff8740d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:21.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:21.578+0000 7ff872a00640 1 -- 172.21.15.17:0/2414527218 >> v2:172.21.15.17:3300/0 conn(0x7ff8740d2fa0 msgr2=0x7ff8740d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-12T17:18:21.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:21.578+0000 7ff872a00640 1 -- 172.21.15.17:0/2414527218 >> v2:172.21.15.17:3300/0 conn(0x7ff8740d2fa0 msgr2=0x7ff8740d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-12T17:18:21.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:21.578+0000 7ff872a00640 1 --2- 172.21.15.17:0/2414527218 >> v2:172.21.15.17:3300/0 conn(0x7ff8740d2fa0 0x7ff8740d3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-12T17:18:21.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:21.579+0000 7ff872a00640 1 --2- 172.21.15.17:0/2414527218 >> v2:172.21.15.17:3300/0 conn(0x7ff8740d2fa0 0x7ff8740d3380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-12T17:18:21.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:21.579+0000 7ff873400640 1 -- 172.21.15.17:0/2414527218 >> v2:172.21.15.94:3300/0 conn(0x7ff8740b5f70 msgr2=0x7ff8740d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-12T17:18:21.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:21.579+0000 7ff873400640 1 -- 172.21.15.17:0/2414527218 >> v2:172.21.15.94:3300/0 conn(0x7ff8740b5f70 msgr2=0x7ff8740d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-12T17:18:21.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:21.579+0000 7ff873400640 1 --2- 172.21.15.17:0/2414527218 >> v2:172.21.15.94:3300/0 conn(0x7ff8740b5f70 0x7ff8740d1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-12T17:18:21.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:21.579+0000 7ff873400640 1 --2- 172.21.15.17:0/2414527218 >> v2:172.21.15.94:3300/0 conn(0x7ff8740b5f70 0x7ff8740d1f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-12T17:18:21.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:21.980+0000 7ff872a00640 1 --2- 172.21.15.17:0/2414527218 >> v2:172.21.15.17:3300/0 conn(0x7ff8740d2fa0 0x7ff8740d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:21.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:21.980+0000 7ff873400640 1 --2- 172.21.15.17:0/2414527218 >> v2:172.21.15.94:3300/0 conn(0x7ff8740b5f70 0x7ff8740d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:21.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:21.981+0000 7ff872a00640 1 -- 172.21.15.17:0/2414527218 >> v2:172.21.15.17:3300/0 conn(0x7ff8740d2fa0 msgr2=0x7ff8740d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-12T17:18:21.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:21.981+0000 7ff872a00640 1 -- 172.21.15.17:0/2414527218 >> v2:172.21.15.17:3300/0 conn(0x7ff8740d2fa0 msgr2=0x7ff8740d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-12T17:18:21.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:21.981+0000 7ff872a00640 1 --2- 172.21.15.17:0/2414527218 >> v2:172.21.15.17:3300/0 conn(0x7ff8740d2fa0 0x7ff8740d3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-12T17:18:21.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:21.981+0000 7ff873400640 1 -- 172.21.15.17:0/2414527218 >> v2:172.21.15.94:3300/0 conn(0x7ff8740b5f70 msgr2=0x7ff8740d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-12T17:18:21.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:21.981+0000 7ff873400640 1 -- 172.21.15.17:0/2414527218 >> v2:172.21.15.94:3300/0 conn(0x7ff8740b5f70 msgr2=0x7ff8740d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-12T17:18:21.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:21.981+0000 7ff873400640 1 --2- 172.21.15.17:0/2414527218 >> v2:172.21.15.94:3300/0 conn(0x7ff8740b5f70 0x7ff8740d1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-12T17:18:21.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:21.981+0000 7ff873400640 1 --2- 172.21.15.17:0/2414527218 >> v2:172.21.15.94:3300/0 conn(0x7ff8740b5f70 0x7ff8740d1f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-12T17:18:21.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:21.981+0000 7ff872a00640 1 --2- 172.21.15.17:0/2414527218 >> v2:172.21.15.17:3300/0 conn(0x7ff8740d2fa0 0x7ff8740d3380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-12T17:18:22.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:22.782+0000 7ff872a00640 1 --2- 172.21.15.17:0/2414527218 >> v2:172.21.15.17:3300/0 conn(0x7ff8740d2fa0 0x7ff8740d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:22.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:22.782+0000 7ff873400640 1 --2- 172.21.15.17:0/2414527218 >> v2:172.21.15.94:3300/0 conn(0x7ff8740b5f70 0x7ff8740d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:22.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:22.783+0000 7ff872a00640 1 -- 172.21.15.17:0/2414527218 >> v2:172.21.15.17:3300/0 conn(0x7ff8740d2fa0 msgr2=0x7ff8740d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-03-12T17:18:22.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:22.783+0000 7ff872a00640 1 -- 172.21.15.17:0/2414527218 >> v2:172.21.15.17:3300/0 conn(0x7ff8740d2fa0 msgr2=0x7ff8740d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-12T17:18:22.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:22.783+0000 7ff872a00640 1 --2- 172.21.15.17:0/2414527218 >> v2:172.21.15.17:3300/0 conn(0x7ff8740d2fa0 0x7ff8740d3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-12T17:18:22.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:22.783+0000 7ff873400640 1 -- 172.21.15.17:0/2414527218 >> v2:172.21.15.94:3300/0 conn(0x7ff8740b5f70 msgr2=0x7ff8740d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-12T17:18:22.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:22.783+0000 7ff873400640 1 -- 172.21.15.17:0/2414527218 >> v2:172.21.15.94:3300/0 conn(0x7ff8740b5f70 msgr2=0x7ff8740d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-12T17:18:22.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:22.783+0000 7ff873400640 1 --2- 172.21.15.17:0/2414527218 >> v2:172.21.15.94:3300/0 conn(0x7ff8740b5f70 0x7ff8740d1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-12T17:18:22.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:22.783+0000 7ff873400640 1 --2- 172.21.15.17:0/2414527218 >> v2:172.21.15.94:3300/0 conn(0x7ff8740b5f70 0x7ff8740d1f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-12T17:18:22.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:22.783+0000 7ff872a00640 1 --2- 172.21.15.17:0/2414527218 >> v2:172.21.15.17:3300/0 conn(0x7ff8740d2fa0 0x7ff8740d3380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-12T17:18:24.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:24.376+0000 7ff870c00640 1 -- 172.21.15.17:0/2414527218 >> v2:172.21.15.94:3300/0 conn(0x7ff8740b5f70 msgr2=0x7ff8740d1f30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-12T17:18:24.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:24.376+0000 7ff870c00640 1 --2- 172.21.15.17:0/2414527218 >> v2:172.21.15.94:3300/0 conn(0x7ff8740b5f70 0x7ff8740d1f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:24.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:24.376+0000 7ff870c00640 1 -- 172.21.15.17:0/2414527218 >> v2:172.21.15.17:3300/0 conn(0x7ff8740d2fa0 msgr2=0x7ff8740d3380 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-12T17:18:24.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:24.376+0000 7ff870c00640 1 --2- 172.21.15.17:0/2414527218 >> v2:172.21.15.17:3300/0 conn(0x7ff8740d2fa0 0x7ff8740d3380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:24.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:24.376+0000 7ff870c00640 1 -- 172.21.15.17:0/2414527218 >> v1:172.21.15.94:6789/0 conn(0x7ff8740b5b50 legacy=0x7ff8740cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:24.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:24.377+0000 7ff870c00640 1 --2- 172.21.15.17:0/2414527218 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff8500072c0 0x7ff850009760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:24.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:24.377+0000 7ff870c00640 1 -- 172.21.15.17:0/2414527218 --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8740b85b0 con 0x7ff8500036b0 2024-03-12T17:18:24.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:24.377+0000 7ff870c00640 1 -- 172.21.15.17:0/2414527218 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8740d38c0 con 0x7ff8500072c0 2024-03-12T17:18:24.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:24.378+0000 7ff86a000640 1 --2- 172.21.15.17:0/2414527218 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff8500072c0 0x7ff850009760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:24.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:24.378+0000 7ff86a000640 1 -- 172.21.15.17:0/2414527218 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff8500072c0 msgr2=0x7ff850009760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-12T17:18:24.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:24.378+0000 7ff86a000640 1 -- 172.21.15.17:0/2414527218 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff8500072c0 msgr2=0x7ff850009760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-12T17:18:24.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:24.378+0000 7ff86a000640 1 --2- 172.21.15.17:0/2414527218 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff8500072c0 0x7ff850009760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-12T17:18:24.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:24.378+0000 7ff86a000640 1 --2- 172.21.15.17:0/2414527218 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff8500072c0 0x7ff850009760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-12T17:18:24.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:24.579+0000 7ff86a000640 1 --2- 172.21.15.17:0/2414527218 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff8500072c0 0x7ff850009760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:24.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:24.580+0000 7ff86a000640 1 -- 172.21.15.17:0/2414527218 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff8500072c0 msgr2=0x7ff850009760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-12T17:18:24.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:24.580+0000 7ff86a000640 1 -- 172.21.15.17:0/2414527218 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff8500072c0 msgr2=0x7ff850009760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-12T17:18:24.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:24.580+0000 7ff86a000640 1 --2- 172.21.15.17:0/2414527218 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff8500072c0 0x7ff850009760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-12T17:18:24.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:24.580+0000 7ff86a000640 1 --2- 172.21.15.17:0/2414527218 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff8500072c0 0x7ff850009760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-12T17:18:24.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:24.981+0000 7ff86a000640 1 --2- 172.21.15.17:0/2414527218 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff8500072c0 0x7ff850009760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:24.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:24.982+0000 7ff86a000640 1 -- 172.21.15.17:0/2414527218 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff8500072c0 msgr2=0x7ff850009760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-12T17:18:24.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:24.982+0000 7ff86a000640 1 -- 172.21.15.17:0/2414527218 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff8500072c0 msgr2=0x7ff850009760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-12T17:18:24.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:24.982+0000 7ff86a000640 1 --2- 172.21.15.17:0/2414527218 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff8500072c0 0x7ff850009760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-12T17:18:24.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:24.982+0000 7ff86a000640 1 --2- 172.21.15.17:0/2414527218 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff8500072c0 0x7ff850009760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-12T17:18:25.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:25.783+0000 7ff86a000640 1 --2- 172.21.15.17:0/2414527218 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff8500072c0 0x7ff850009760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:25.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:25.784+0000 7ff86a000640 1 -- 172.21.15.17:0/2414527218 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff8500072c0 msgr2=0x7ff850009760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-12T17:18:25.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:25.784+0000 7ff86a000640 1 -- 172.21.15.17:0/2414527218 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff8500072c0 msgr2=0x7ff850009760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-12T17:18:25.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:25.784+0000 7ff86a000640 1 --2- 172.21.15.17:0/2414527218 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff8500072c0 0x7ff850009760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-12T17:18:25.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:25.784+0000 7ff86a000640 1 --2- 172.21.15.17:0/2414527218 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff8500072c0 0x7ff850009760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-12T17:18:26.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.413+0000 7ff872000640 1 -- 172.21.15.17:0/2414527218 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1505048822 0 0) 0x7ff8740b85b0 con 0x7ff8500036b0 2024-03-12T17:18:26.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.413+0000 7ff872000640 1 -- 172.21.15.17:0/2414527218 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff858003520 con 0x7ff8500036b0 2024-03-12T17:18:26.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.414+0000 7ff872000640 1 -- 172.21.15.17:0/2414527218 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1999842155 0 0) 0x7ff858003520 con 0x7ff8500036b0 2024-03-12T17:18:26.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.414+0000 7ff872000640 1 -- 172.21.15.17:0/2414527218 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff8500072c0 msgr2=0x7ff850009760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-12T17:18:26.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.414+0000 7ff872000640 1 --2- 172.21.15.17:0/2414527218 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff8500072c0 0x7ff850009760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:26.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.414+0000 7ff872000640 1 -- 172.21.15.17:0/2414527218 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff85000af20 con 0x7ff8500036b0 2024-03-12T17:18:26.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.414+0000 7ff872000640 1 -- 172.21.15.17:0/2414527218 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7ff864009a00 con 0x7ff8500036b0 2024-03-12T17:18:26.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.414+0000 7ff872000640 1 -- 172.21.15.17:0/2414527218 >> v1:172.21.15.17:6789/0 conn(0x7ff8500036b0 legacy=0x7ff850005af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:26.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.414+0000 7ff873400640 1 -- 172.21.15.17:0/2414527218 reap_dead start 2024-03-12T17:18:26.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.414+0000 7ff872000640 1 --2- 172.21.15.17:0/2414527218 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff858003970 0x7ff858003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:26.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.415+0000 7ff872000640 1 --2- 172.21.15.17:0/2414527218 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8580047c0 0x7ff858004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:26.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.415+0000 7ff872000640 1 --2- 172.21.15.17:0/2414527218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8580052a0 0x7ff85800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:26.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.415+0000 7ff872000640 1 -- 172.21.15.17:0/2414527218 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8740d38c0 con 0x7ff8580052a0 2024-03-12T17:18:26.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.415+0000 7ff872000640 1 -- 172.21.15.17:0/2414527218 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff85800c1f0 con 0x7ff8580047c0 2024-03-12T17:18:26.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.415+0000 7ff872000640 1 -- 172.21.15.17:0/2414527218 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff85800c3b0 con 0x7ff858003970 2024-03-12T17:18:26.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.415+0000 7ff872a00640 1 --2- 172.21.15.17:0/2414527218 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff858003970 0x7ff858003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:26.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.416+0000 7ff86a000640 1 --2- 172.21.15.17:0/2414527218 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8580047c0 0x7ff858004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:26.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.416+0000 7ff873400640 1 --2- 172.21.15.17:0/2414527218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8580052a0 0x7ff85800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:26.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.417+0000 7ff873400640 1 -- 172.21.15.17:0/2414527218 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff858003970 msgr2=0x7ff858003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:26.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.417+0000 7ff873400640 1 --2- 172.21.15.17:0/2414527218 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff858003970 0x7ff858003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:26.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.417+0000 7ff873400640 1 -- 172.21.15.17:0/2414527218 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8580047c0 msgr2=0x7ff858004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:26.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.417+0000 7ff873400640 1 --2- 172.21.15.17:0/2414527218 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8580047c0 0x7ff858004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:26.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.417+0000 7ff873400640 1 -- 172.21.15.17:0/2414527218 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff858003520 con 0x7ff8580052a0 2024-03-12T17:18:26.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.420+0000 7ff873400640 1 --2- 172.21.15.17:0/2414527218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8580052a0 0x7ff85800b980 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff8740cd250 tx=0x7ff8580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebd4591c54ff1bc7 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:26.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.421+0000 7ff872000640 1 -- 172.21.15.17:0/2414527218 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c036400 con 0x7ff8580052a0 2024-03-12T17:18:26.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.421+0000 7ff872000640 1 -- 172.21.15.17:0/2414527218 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86c030070 con 0x7ff8580052a0 2024-03-12T17:18:26.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.421+0000 7ff872000640 1 -- 172.21.15.17:0/2414527218 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c0367c0 con 0x7ff8580052a0 2024-03-12T17:18:26.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.422+0000 7ff879800640 1 -- 172.21.15.17:0/2414527218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8580052a0 msgr2=0x7ff85800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:26.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.422+0000 7ff879800640 1 --2- 172.21.15.17:0/2414527218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8580052a0 0x7ff85800b980 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff8740cd250 tx=0x7ff8580057f0 comp rx=0 tx=0).stop 2024-03-12T17:18:26.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.422+0000 7ff879800640 1 -- 172.21.15.17:0/2414527218 shutdown_connections 2024-03-12T17:18:26.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.422+0000 7ff879800640 1 --2- 172.21.15.17:0/2414527218 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8580052a0 0x7ff85800b980 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:26.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.422+0000 7ff879800640 1 --2- 172.21.15.17:0/2414527218 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8580047c0 0x7ff858004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:26.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.422+0000 7ff879800640 1 --2- 172.21.15.17:0/2414527218 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff858003970 0x7ff858003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:26.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.422+0000 7ff879800640 1 -- 172.21.15.17:0/2414527218 >> 172.21.15.17:0/2414527218 conn(0x7ff874065df0 msgr2=0x7ff874066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:26.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.422+0000 7ff879800640 1 -- 172.21.15.17:0/2414527218 shutdown_connections 2024-03-12T17:18:26.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.422+0000 7ff879800640 1 -- 172.21.15.17:0/2414527218 wait complete. 2024-03-12T17:18:26.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.425+0000 7ff879800640 1 Processor -- start 2024-03-12T17:18:26.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.425+0000 7ff879800640 1 -- start start 2024-03-12T17:18:26.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.426+0000 7ff879800640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff858003970 0x7ff87415e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:26.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.426+0000 7ff879800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8580047c0 0x7ff8740cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:26.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.426+0000 7ff879800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8580052a0 0x7ff8740cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:26.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.426+0000 7ff879800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8740c7940 con 0x7ff8580052a0 2024-03-12T17:18:26.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.426+0000 7ff879800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8740cc330 con 0x7ff8580047c0 2024-03-12T17:18:26.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.426+0000 7ff879800640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8740c6d30 con 0x7ff858003970 2024-03-12T17:18:26.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.427+0000 7ff873400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8580052a0 0x7ff8740cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:26.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.427+0000 7ff873400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8580052a0 0x7ff8740cbdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48156/0 (socket says 172.21.15.17:48156) 2024-03-12T17:18:26.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.427+0000 7ff873400640 1 -- 172.21.15.17:0/2612048739 learned_addr learned my addr 172.21.15.17:0/2612048739 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:26.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.427+0000 7ff86a000640 1 --2- 172.21.15.17:0/2612048739 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8580047c0 0x7ff8740cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:26.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.427+0000 7ff872a00640 1 --2- 172.21.15.17:0/2612048739 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff858003970 0x7ff87415e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:26.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.427+0000 7ff86a000640 1 -- 172.21.15.17:0/2612048739 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff858003970 msgr2=0x7ff87415e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:26.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.427+0000 7ff86a000640 1 --2- 172.21.15.17:0/2612048739 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff858003970 0x7ff87415e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:26.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.427+0000 7ff86a000640 1 -- 172.21.15.17:0/2612048739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8580052a0 msgr2=0x7ff8740cbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:26.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.428+0000 7ff86a000640 1 --2- 172.21.15.17:0/2612048739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8580052a0 0x7ff8740cbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:26.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.428+0000 7ff86a000640 1 -- 172.21.15.17:0/2612048739 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8740c7010 con 0x7ff8580047c0 2024-03-12T17:18:26.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.428+0000 7ff86a000640 1 --2- 172.21.15.17:0/2612048739 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8580047c0 0x7ff8740cb8b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff85c017680 tx=0x7ff85c017b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:26.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.429+0000 7ff86b400640 1 -- 172.21.15.17:0/2612048739 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85c015930 con 0x7ff8580047c0 2024-03-12T17:18:26.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.429+0000 7ff86b400640 1 -- 172.21.15.17:0/2612048739 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff85c015a90 con 0x7ff8580047c0 2024-03-12T17:18:26.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.429+0000 7ff86b400640 1 -- 172.21.15.17:0/2612048739 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85c015e20 con 0x7ff8580047c0 2024-03-12T17:18:26.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.429+0000 7ff879800640 1 -- 172.21.15.17:0/2612048739 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8740c72f0 con 0x7ff8580047c0 2024-03-12T17:18:26.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.429+0000 7ff879800640 1 -- 172.21.15.17:0/2612048739 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8740c6950 con 0x7ff8580047c0 2024-03-12T17:18:26.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.429+0000 7ff86b400640 1 -- 172.21.15.17:0/2612048739 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff85c0058d0 con 0x7ff8580047c0 2024-03-12T17:18:26.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.429+0000 7ff86b400640 1 -- 172.21.15.17:0/2612048739 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff85c01d020 con 0x7ff8580047c0 2024-03-12T17:18:26.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.430+0000 7ff879800640 1 -- 172.21.15.17:0/2612048739 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8740b84b0 con 0x7ff8580047c0 2024-03-12T17:18:26.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.438+0000 7ff86b400640 1 -- 172.21.15.17:0/2612048739 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7ff85c041b50 con 0x7ff8580047c0 2024-03-12T17:18:26.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.513+0000 7ff879800640 1 -- 172.21.15.17:0/2612048739 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7ff8740736c0 con 0x7ff8580047c0 2024-03-12T17:18:26.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.520+0000 7ff86b400640 1 -- 172.21.15.17:0/2612048739 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7ff85c030020 con 0x7ff8580047c0 2024-03-12T17:18:26.514 INFO:teuthology.orchestra.run.smithi017.stderr:adjusted tunables profile to default 2024-03-12T17:18:26.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.522+0000 7ff879800640 1 -- 172.21.15.17:0/2612048739 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8580047c0 msgr2=0x7ff8740cb8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:26.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.522+0000 7ff879800640 1 --2- 172.21.15.17:0/2612048739 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8580047c0 0x7ff8740cb8b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff85c017680 tx=0x7ff85c017b40 comp rx=0 tx=0).stop 2024-03-12T17:18:26.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.522+0000 7ff879800640 1 -- 172.21.15.17:0/2612048739 shutdown_connections 2024-03-12T17:18:26.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.522+0000 7ff879800640 1 --2- 172.21.15.17:0/2612048739 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff8580052a0 0x7ff8740cbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:26.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.522+0000 7ff879800640 1 --2- 172.21.15.17:0/2612048739 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff8580047c0 0x7ff8740cb8b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:26.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.522+0000 7ff879800640 1 --2- 172.21.15.17:0/2612048739 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff858003970 0x7ff87415e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:26.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.522+0000 7ff879800640 1 -- 172.21.15.17:0/2612048739 >> 172.21.15.17:0/2612048739 conn(0x7ff874065df0 msgr2=0x7ff8740cd250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:26.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.522+0000 7ff879800640 1 -- 172.21.15.17:0/2612048739 shutdown_connections 2024-03-12T17:18:26.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:26.522+0000 7ff879800640 1 -- 172.21.15.17:0/2612048739 wait complete. 2024-03-12T17:18:26.534 INFO:tasks.ceph:check_enable_crimson: False 2024-03-12T17:18:26.534 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-12T17:18:26.534 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:18:26.534 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-12T17:18:26.621 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:18:26.621 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-12T17:18:26.761 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:18:26.761 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-12T17:18:26.860 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:18:26.860 DEBUG:teuthology.orchestra.run.smithi017:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-12T17:18:26.951 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-12T17:18:26.951 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-03-12T17:18:27.014 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-12T17:18:27.020+0000 7f7d81eda040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-12T17:18:27.053 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-12T17:18:27.053 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-03-12T17:18:27.078 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-12T17:18:27.084+0000 7f7d81eda040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-12T17:18:27.151 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-12T17:18:27.151 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-03-12T17:18:27.247 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-12T17:18:27.247 DEBUG:teuthology.orchestra.run.smithi094:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-03-12T17:18:27.344 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph osd new 9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb 0 2024-03-12T17:18:27.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.521+0000 7f4a7f000640 1 Processor -- start 2024-03-12T17:18:27.516 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.522+0000 7f4a7f000640 1 -- start start 2024-03-12T17:18:27.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.523+0000 7f4a7f000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4a780cd730 0x7f4a780cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:27.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.523+0000 7f4a7f000640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a780d1190 con 0x7f4a780b5b00 2024-03-12T17:18:27.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.523+0000 7f4a7f000640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a780d1460 con 0x7f4a7815cb50 2024-03-12T17:18:27.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.523+0000 7f4a7f000640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a780ce0e0 con 0x7f4a780cd730 2024-03-12T17:18:27.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.523+0000 7f4a7dc00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f4a7815cb50 0x7f4a780d0a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:59646/0 (socket says 172.21.15.94:59646) 2024-03-12T17:18:27.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.523+0000 7f4a7dc00640 1 -- 172.21.15.94:0/1609685737 learned_addr learned my addr 172.21.15.94:0/1609685737 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-12T17:18:27.518 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.523+0000 7f4a7d200640 1 --2- 172.21.15.94:0/1609685737 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4a780cd730 0x7f4a780cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:27.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.524+0000 7f4a77e00640 1 -- 172.21.15.94:0/1609685737 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2093630246 0 0) 0x7f4a780d1460 con 0x7f4a7815cb50 2024-03-12T17:18:27.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.524+0000 7f4a77e00640 1 -- 172.21.15.94:0/1609685737 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a60003520 con 0x7f4a7815cb50 2024-03-12T17:18:27.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.524+0000 7f4a7d200640 1 -- 172.21.15.94:0/1609685737 >> v1:172.21.15.94:6789/0 conn(0x7f4a7815cb50 legacy=0x7f4a780d0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:27.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.524+0000 7f4a7d200640 1 -- 172.21.15.94:0/1609685737 >> v1:172.21.15.17:6789/0 conn(0x7f4a780b5b00 legacy=0x7f4a780b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:27.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.524+0000 7f4a7d200640 1 -- 172.21.15.94:0/1609685737 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a780d1740 con 0x7f4a780cd730 2024-03-12T17:18:27.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.525+0000 7f4a7d200640 1 --2- 172.21.15.94:0/1609685737 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4a780cd730 0x7f4a780cdba0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4a680097d0 tx=0x7f4a6802b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87b7a55cb4b678fe server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:27.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.525+0000 7f4a77e00640 1 -- 172.21.15.94:0/1609685737 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a68030880 con 0x7f4a780cd730 2024-03-12T17:18:27.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.525+0000 7f4a77e00640 1 -- 172.21.15.94:0/1609685737 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a680309e0 con 0x7f4a780cd730 2024-03-12T17:18:27.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.525+0000 7f4a77e00640 1 -- 172.21.15.94:0/1609685737 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a68030d70 con 0x7f4a780cd730 2024-03-12T17:18:27.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.526+0000 7f4a7f000640 1 -- 172.21.15.94:0/1609685737 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4a780cd730 msgr2=0x7f4a780cdba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:27.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.526+0000 7f4a7f000640 1 --2- 172.21.15.94:0/1609685737 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4a780cd730 0x7f4a780cdba0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4a680097d0 tx=0x7f4a6802b9c0 comp rx=0 tx=0).stop 2024-03-12T17:18:27.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.526+0000 7f4a7f000640 1 -- 172.21.15.94:0/1609685737 shutdown_connections 2024-03-12T17:18:27.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.526+0000 7f4a7f000640 1 --2- 172.21.15.94:0/1609685737 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4a780cd730 0x7f4a780cdba0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:27.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.526+0000 7f4a7f000640 1 -- 172.21.15.94:0/1609685737 >> 172.21.15.94:0/1609685737 conn(0x7f4a780cf3e0 msgr2=0x7f4a780cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:27.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.526+0000 7f4a7f000640 1 -- 172.21.15.94:0/1609685737 shutdown_connections 2024-03-12T17:18:27.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.526+0000 7f4a7f000640 1 -- 172.21.15.94:0/1609685737 wait complete. 2024-03-12T17:18:27.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.528+0000 7f4a7f000640 1 Processor -- start 2024-03-12T17:18:27.522 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.528+0000 7f4a7f000640 1 -- start start 2024-03-12T17:18:27.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.529+0000 7f4a7f000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a780b5b00 0x7f4a780b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:27.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.529+0000 7f4a7f000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a780cd730 0x7f4a78159150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:27.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.529+0000 7f4a7f000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4a7815cb50 0x7f4a78159690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:27.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.529+0000 7f4a7f000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a780c9360 con 0x7f4a780b5b00 2024-03-12T17:18:27.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.529+0000 7f4a7f000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a781f3640 con 0x7f4a780cd730 2024-03-12T17:18:27.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.529+0000 7f4a7f000640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a78144e80 con 0x7f4a7815cb50 2024-03-12T17:18:27.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.529+0000 7f4a7d200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a780cd730 0x7f4a78159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:27.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.529+0000 7f4a7e600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4a7815cb50 0x7f4a78159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:27.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.529+0000 7f4a7e600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4a7815cb50 0x7f4a78159690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.94:60894/0 (socket says 172.21.15.94:60894) 2024-03-12T17:18:27.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.529+0000 7f4a7e600640 1 -- 172.21.15.94:0/3542053657 learned_addr learned my addr 172.21.15.94:0/3542053657 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-12T17:18:27.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.529+0000 7f4a7d200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a780cd730 0x7f4a78159150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:48552/0 (socket says 172.21.15.94:48552) 2024-03-12T17:18:27.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.529+0000 7f4a7dc00640 1 --2- 172.21.15.94:0/3542053657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a780b5b00 0x7f4a780b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:27.525 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.530+0000 7f4a7e600640 1 -- 172.21.15.94:0/3542053657 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a780cd730 msgr2=0x7f4a78159150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:27.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.530+0000 7f4a7e600640 1 --2- 172.21.15.94:0/3542053657 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a780cd730 0x7f4a78159150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:27.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.530+0000 7f4a7e600640 1 -- 172.21.15.94:0/3542053657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a780b5b00 msgr2=0x7f4a780b3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:27.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.530+0000 7f4a7e600640 1 --2- 172.21.15.94:0/3542053657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a780b5b00 0x7f4a780b3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:27.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.530+0000 7f4a7e600640 1 -- 172.21.15.94:0/3542053657 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a68009400 con 0x7f4a7815cb50 2024-03-12T17:18:27.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.530+0000 7f4a7e600640 1 --2- 172.21.15.94:0/3542053657 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4a7815cb50 0x7f4a78159690 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4a7000c7d0 tx=0x7f4a7000cc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:27.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.530+0000 7f4a75600640 1 -- 172.21.15.94:0/3542053657 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a70003b70 con 0x7f4a7815cb50 2024-03-12T17:18:27.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.530+0000 7f4a75600640 1 -- 172.21.15.94:0/3542053657 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a70003cf0 con 0x7f4a7815cb50 2024-03-12T17:18:27.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.530+0000 7f4a7f000640 1 -- 172.21.15.94:0/3542053657 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a78145160 con 0x7f4a7815cb50 2024-03-12T17:18:27.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.530+0000 7f4a75600640 1 -- 172.21.15.94:0/3542053657 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7000aa90 con 0x7f4a7815cb50 2024-03-12T17:18:27.526 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.530+0000 7f4a7f000640 1 -- 172.21.15.94:0/3542053657 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a780b4220 con 0x7f4a7815cb50 2024-03-12T17:18:27.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.531+0000 7f4a75600640 1 -- 172.21.15.94:0/3542053657 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4a700050d0 con 0x7f4a7815cb50 2024-03-12T17:18:27.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.531+0000 7f4a75600640 1 -- 172.21.15.94:0/3542053657 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f4a70012880 con 0x7f4a7815cb50 2024-03-12T17:18:27.527 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.531+0000 7f4a7f000640 1 -- 172.21.15.94:0/3542053657 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a78145960 con 0x7f4a7815cb50 2024-03-12T17:18:27.529 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.534+0000 7f4a75600640 1 -- 172.21.15.94:0/3542053657 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f4a78145960 con 0x7f4a7815cb50 2024-03-12T17:18:27.607 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.613+0000 7f4a7f000640 1 -- 172.21.15.94:0/3542053657 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb", "id": 0} v 0) v1 -- 0x7f4a7815c690 con 0x7f4a7815cb50 2024-03-12T17:18:27.615 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.620+0000 7f4a75600640 1 -- 172.21.15.94:0/3542053657 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4a70005560 con 0x7f4a7815cb50 2024-03-12T17:18:27.615 INFO:teuthology.orchestra.run.smithi094.stdout:0 2024-03-12T17:18:27.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.621+0000 7f4a7f000640 1 -- 172.21.15.94:0/3542053657 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4a7815cb50 msgr2=0x7f4a78159690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:27.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.621+0000 7f4a7f000640 1 --2- 172.21.15.94:0/3542053657 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4a7815cb50 0x7f4a78159690 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4a7000c7d0 tx=0x7f4a7000cc90 comp rx=0 tx=0).stop 2024-03-12T17:18:27.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.622+0000 7f4a7f000640 1 -- 172.21.15.94:0/3542053657 shutdown_connections 2024-03-12T17:18:27.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.622+0000 7f4a7f000640 1 --2- 172.21.15.94:0/3542053657 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4a7815cb50 0x7f4a78159690 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:27.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.622+0000 7f4a7f000640 1 --2- 172.21.15.94:0/3542053657 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a780cd730 0x7f4a78159150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:27.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.622+0000 7f4a7f000640 1 --2- 172.21.15.94:0/3542053657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a780b5b00 0x7f4a780b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:27.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.622+0000 7f4a7f000640 1 -- 172.21.15.94:0/3542053657 >> 172.21.15.94:0/3542053657 conn(0x7f4a780cf3e0 msgr2=0x7f4a780cba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:27.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.622+0000 7f4a7f000640 1 -- 172.21.15.94:0/3542053657 shutdown_connections 2024-03-12T17:18:27.617 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.622+0000 7f4a7f000640 1 -- 172.21.15.94:0/3542053657 wait complete. 2024-03-12T17:18:27.633 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph osd new b5a8fe74-1be5-4b16-bf45-4a48fdfcd903 1 2024-03-12T17:18:27.692 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-12T17:18:27.698+0000 7f7d81eda040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-12T17:18:27.756 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-12T17:18:27.761+0000 7f7d81eda040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-12T17:18:27.809 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-12T17:18:27.814+0000 7f7d81eda040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-12T17:18:27.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.823+0000 7f223f200640 1 Processor -- start 2024-03-12T17:18:27.817 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.823+0000 7f223f200640 1 -- start start 2024-03-12T17:18:27.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.824+0000 7f223f200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f22380b5b50 0x7f22380b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:27.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.824+0000 7f223f200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22380d14e0 con 0x7f22380cd840 2024-03-12T17:18:27.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.824+0000 7f223f200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22380b85b0 con 0x7f22380d2fa0 2024-03-12T17:18:27.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.824+0000 7f223f200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22380b59e0 con 0x7f22380b5b50 2024-03-12T17:18:27.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.824+0000 7f2237e00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f22380d2fa0 0x7f22380d3380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:59662/0 (socket says 172.21.15.94:59662) 2024-03-12T17:18:27.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.825+0000 7f2237e00640 1 -- 172.21.15.94:0/2123398436 learned_addr learned my addr 172.21.15.94:0/2123398436 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-12T17:18:27.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.825+0000 7f222fe00640 1 --2- 172.21.15.94:0/2123398436 >> v2:172.21.15.17:3300/0 conn(0x7f22380b5b50 0x7f22380b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:27.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.825+0000 7f2237400640 1 -- 172.21.15.94:0/2123398436 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3164671796 0 0) 0x7f22380b85b0 con 0x7f22380d2fa0 2024-03-12T17:18:27.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.825+0000 7f2237400640 1 -- 172.21.15.94:0/2123398436 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f221c003520 con 0x7f22380d2fa0 2024-03-12T17:18:27.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.825+0000 7f2237400640 1 -- 172.21.15.94:0/2123398436 <== mon.1 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2051133033 0 0) 0x7f221c003520 con 0x7f22380d2fa0 2024-03-12T17:18:27.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.825+0000 7f2237400640 1 -- 172.21.15.94:0/2123398436 >> v2:172.21.15.17:3300/0 conn(0x7f22380b5b50 msgr2=0x7f22380b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:27.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.825+0000 7f2237400640 1 --2- 172.21.15.94:0/2123398436 >> v2:172.21.15.17:3300/0 conn(0x7f22380b5b50 0x7f22380b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:27.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.825+0000 7f2237400640 1 -- 172.21.15.94:0/2123398436 >> v1:172.21.15.17:6789/0 conn(0x7f22380cd840 legacy=0x7f22380d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:27.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.825+0000 7f2237400640 1 -- 172.21.15.94:0/2123398436 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22380b8890 con 0x7f22380d2fa0 2024-03-12T17:18:27.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.825+0000 7f2237400640 1 -- 172.21.15.94:0/2123398436 <== mon.1 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7f2228001670 con 0x7f22380d2fa0 2024-03-12T17:18:27.822 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.825+0000 7f2237400640 1 -- 172.21.15.94:0/2123398436 >> v1:172.21.15.94:6789/0 conn(0x7f22380d2fa0 legacy=0x7f22380d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:27.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.825+0000 7f2237400640 1 --2- 172.21.15.94:0/2123398436 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f221c0039c0 0x7f221c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:27.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.826+0000 7f2237400640 1 --2- 172.21.15.94:0/2123398436 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f221c0047c0 0x7f221c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:27.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.826+0000 7f2237400640 1 --2- 172.21.15.94:0/2123398436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f221c005180 0x7f221c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:27.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.826+0000 7f2237400640 1 -- 172.21.15.94:0/2123398436 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221c00c050 con 0x7f221c005180 2024-03-12T17:18:27.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.826+0000 7f2237400640 1 -- 172.21.15.94:0/2123398436 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f221c00c1c0 con 0x7f221c0047c0 2024-03-12T17:18:27.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.826+0000 7f2237400640 1 -- 172.21.15.94:0/2123398436 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f221c00c380 con 0x7f221c0039c0 2024-03-12T17:18:27.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.826+0000 7f2237e00640 1 --2- 172.21.15.94:0/2123398436 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f221c0039c0 0x7f221c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:27.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.826+0000 7f222fe00640 1 --2- 172.21.15.94:0/2123398436 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f221c0047c0 0x7f221c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:27.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.826+0000 7f223d200640 1 --2- 172.21.15.94:0/2123398436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f221c005180 0x7f221c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:27.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.826+0000 7f2237e00640 1 -- 172.21.15.94:0/2123398436 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f221c0047c0 msgr2=0x7f221c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:27.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.826+0000 7f2237e00640 1 --2- 172.21.15.94:0/2123398436 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f221c0047c0 0x7f221c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:27.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.826+0000 7f2237e00640 1 -- 172.21.15.94:0/2123398436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f221c005180 msgr2=0x7f221c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:27.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.826+0000 7f2237e00640 1 --2- 172.21.15.94:0/2123398436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f221c005180 0x7f221c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:27.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.826+0000 7f2237e00640 1 -- 172.21.15.94:0/2123398436 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f221c003520 con 0x7f221c0039c0 2024-03-12T17:18:27.823 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.826+0000 7f223d200640 1 --2- 172.21.15.94:0/2123398436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f221c005180 0x7f221c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:18:27.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.826+0000 7f223d200640 1 -- 172.21.15.94:0/2123398436 reap_dead start 2024-03-12T17:18:27.824 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.827+0000 7f2237e00640 1 --2- 172.21.15.94:0/2123398436 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f221c0039c0 0x7f221c003de0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f222800c0e0 tx=0x7f221c0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=401d91bd2a211fff server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:27.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.828+0000 7f2237400640 1 -- 172.21.15.94:0/2123398436 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2228005ad0 con 0x7f221c0039c0 2024-03-12T17:18:27.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.828+0000 7f2237400640 1 -- 172.21.15.94:0/2123398436 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2228005c50 con 0x7f221c0039c0 2024-03-12T17:18:27.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.828+0000 7f2237400640 1 -- 172.21.15.94:0/2123398436 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222802c810 con 0x7f221c0039c0 2024-03-12T17:18:27.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.828+0000 7f223f200640 1 -- 172.21.15.94:0/2123398436 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f221c0039c0 msgr2=0x7f221c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:27.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.828+0000 7f223f200640 1 --2- 172.21.15.94:0/2123398436 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f221c0039c0 0x7f221c003de0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f222800c0e0 tx=0x7f221c0057f0 comp rx=0 tx=0).stop 2024-03-12T17:18:27.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.828+0000 7f223f200640 1 -- 172.21.15.94:0/2123398436 shutdown_connections 2024-03-12T17:18:27.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.828+0000 7f223f200640 1 --2- 172.21.15.94:0/2123398436 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f221c0039c0 0x7f221c003de0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:27.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.828+0000 7f223f200640 1 -- 172.21.15.94:0/2123398436 >> 172.21.15.94:0/2123398436 conn(0x7f2238065df0 msgr2=0x7f2238066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:27.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.828+0000 7f223f200640 1 -- 172.21.15.94:0/2123398436 shutdown_connections 2024-03-12T17:18:27.825 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.828+0000 7f223f200640 1 -- 172.21.15.94:0/2123398436 wait complete. 2024-03-12T17:18:27.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.830+0000 7f223f200640 1 Processor -- start 2024-03-12T17:18:27.826 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.830+0000 7f223f200640 1 -- start start 2024-03-12T17:18:27.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.831+0000 7f223f200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f221c0039c0 0x7f2238151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:27.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.831+0000 7f223f200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f22381f3350 0x7f22381515d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:27.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.831+0000 7f223f200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f223815d800 0x7f223815dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:27.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.831+0000 7f223f200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f223815e1c0 con 0x7f223815d800 2024-03-12T17:18:27.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.831+0000 7f223f200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22381f2510 con 0x7f22381f3350 2024-03-12T17:18:27.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.831+0000 7f223f200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f223815e3e0 con 0x7f221c0039c0 2024-03-12T17:18:27.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.831+0000 7f222fe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f22381f3350 0x7f22381515d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:27.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.832+0000 7f2237e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f221c0039c0 0x7f2238151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:27.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.832+0000 7f222fe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f22381f3350 0x7f22381515d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:48556/0 (socket says 172.21.15.94:48556) 2024-03-12T17:18:27.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.832+0000 7f2237e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f221c0039c0 0x7f2238151090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.94:60916/0 (socket says 172.21.15.94:60916) 2024-03-12T17:18:27.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.832+0000 7f222fe00640 1 -- 172.21.15.94:0/199656692 learned_addr learned my addr 172.21.15.94:0/199656692 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-12T17:18:27.828 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.832+0000 7f223d200640 1 --2- 172.21.15.94:0/199656692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f223815d800 0x7f223815dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:27.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.832+0000 7f222fe00640 1 -- 172.21.15.94:0/199656692 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f221c0039c0 msgr2=0x7f2238151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:27.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.832+0000 7f222fe00640 1 --2- 172.21.15.94:0/199656692 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f221c0039c0 0x7f2238151090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:27.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.832+0000 7f222fe00640 1 -- 172.21.15.94:0/199656692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f223815d800 msgr2=0x7f223815dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:27.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.832+0000 7f222fe00640 1 --2- 172.21.15.94:0/199656692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f223815d800 0x7f223815dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:27.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.832+0000 7f222fe00640 1 -- 172.21.15.94:0/199656692 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223815e6c0 con 0x7f22381f3350 2024-03-12T17:18:27.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.832+0000 7f222fe00640 1 --2- 172.21.15.94:0/199656692 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f22381f3350 0x7f22381515d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f22200118c0 tx=0x7f2220011d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:27.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.833+0000 7f2234c00640 1 -- 172.21.15.94:0/199656692 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2220004240 con 0x7f22381f3350 2024-03-12T17:18:27.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.833+0000 7f2234c00640 1 -- 172.21.15.94:0/199656692 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22200043a0 con 0x7f22381f3350 2024-03-12T17:18:27.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.833+0000 7f2234c00640 1 -- 172.21.15.94:0/199656692 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222000fa20 con 0x7f22381f3350 2024-03-12T17:18:27.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.833+0000 7f223f200640 1 -- 172.21.15.94:0/199656692 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f223815e9a0 con 0x7f22381f3350 2024-03-12T17:18:27.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.833+0000 7f223f200640 1 -- 172.21.15.94:0/199656692 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22380c7b90 con 0x7f22381f3350 2024-03-12T17:18:27.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.833+0000 7f2234c00640 1 -- 172.21.15.94:0/199656692 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2220003610 con 0x7f22381f3350 2024-03-12T17:18:27.829 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.833+0000 7f2234c00640 1 -- 172.21.15.94:0/199656692 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f222001e800 con 0x7f22381f3350 2024-03-12T17:18:27.830 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.834+0000 7f223f200640 1 -- 172.21.15.94:0/199656692 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22380c7710 con 0x7f22381f3350 2024-03-12T17:18:27.831 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.836+0000 7f2234c00640 1 -- 172.21.15.94:0/199656692 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f222003db50 con 0x7f22381f3350 2024-03-12T17:18:27.874 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-12T17:18:27.880+0000 7f7d81eda040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-12T17:18:27.910 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.916+0000 7f223f200640 1 -- 172.21.15.94:0/199656692 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b5a8fe74-1be5-4b16-bf45-4a48fdfcd903", "id": 1} v 0) v1 -- 0x7f223808aad0 con 0x7f22381f3350 2024-03-12T17:18:27.917 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.923+0000 7f2234c00640 1 -- 172.21.15.94:0/199656692 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b5a8fe74-1be5-4b16-bf45-4a48fdfcd903", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f222002c030 con 0x7f22381f3350 2024-03-12T17:18:27.917 INFO:teuthology.orchestra.run.smithi094.stdout:1 2024-03-12T17:18:27.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.924+0000 7f223f200640 1 -- 172.21.15.94:0/199656692 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f22381f3350 msgr2=0x7f22381515d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:27.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.924+0000 7f223f200640 1 --2- 172.21.15.94:0/199656692 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f22381f3350 0x7f22381515d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f22200118c0 tx=0x7f2220011d80 comp rx=0 tx=0).stop 2024-03-12T17:18:27.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.924+0000 7f223f200640 1 -- 172.21.15.94:0/199656692 shutdown_connections 2024-03-12T17:18:27.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.924+0000 7f223f200640 1 --2- 172.21.15.94:0/199656692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f223815d800 0x7f223815dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:27.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.924+0000 7f223f200640 1 --2- 172.21.15.94:0/199656692 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f22381f3350 0x7f22381515d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:27.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.924+0000 7f223f200640 1 --2- 172.21.15.94:0/199656692 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f221c0039c0 0x7f2238151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:27.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.924+0000 7f223f200640 1 -- 172.21.15.94:0/199656692 >> 172.21.15.94:0/199656692 conn(0x7f2238065df0 msgr2=0x7f223815c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:27.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.924+0000 7f223f200640 1 -- 172.21.15.94:0/199656692 shutdown_connections 2024-03-12T17:18:27.919 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:27.924+0000 7f223f200640 1 -- 172.21.15.94:0/199656692 wait complete. 2024-03-12T17:18:27.926 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-12T17:18:27.932+0000 7f7d81eda040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-12T17:18:27.933 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-03-12T17:18:27.939+0000 7f440d20e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-12T17:18:27.936 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph osd new 23df2a44-1a0d-4102-80b0-0123937722ba 2 2024-03-12T17:18:28.002 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-03-12T17:18:28.008+0000 7f440d20e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-12T17:18:28.062 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-12T17:18:28.067+0000 7f7d81eda040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-12T17:18:28.125 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.130+0000 7f95cfe00640 1 Processor -- start 2024-03-12T17:18:28.126 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.131+0000 7f95cfe00640 1 -- start start 2024-03-12T17:18:28.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.132+0000 7f95cfe00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f95c80b5b50 0x7f95c80b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:28.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.132+0000 7f95cfe00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f95c80cd840 0x7f95c80cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:28.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.132+0000 7f95cfe00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c80d14e0 con 0x7f95c80d2fa0 2024-03-12T17:18:28.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.132+0000 7f95cfe00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95c80b59e0 con 0x7f95c80b5b50 2024-03-12T17:18:28.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.132+0000 7f95cfe00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c80b85b0 con 0x7f95c80cd840 2024-03-12T17:18:28.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.132+0000 7f95cca00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f95c80b5b50 0x7f95c80b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:28.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.132+0000 7f95cca00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f95c80b5b50 0x7f95c80b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:48558/0 (socket says 172.21.15.94:48558) 2024-03-12T17:18:28.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.132+0000 7f95cde00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f95c80cd840 0x7f95c80cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:28.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.132+0000 7f95cca00640 1 -- 172.21.15.94:0/3481731144 learned_addr learned my addr 172.21.15.94:0/3481731144 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-12T17:18:28.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.133+0000 7f95cca00640 1 -- 172.21.15.94:0/3481731144 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f95c80cd840 msgr2=0x7f95c80cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:28.137 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.133+0000 7f95cca00640 1 --2- 172.21.15.94:0/3481731144 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f95c80cd840 0x7f95c80cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:28.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.133+0000 7f95cca00640 1 -- 172.21.15.94:0/3481731144 >> v1:172.21.15.94:6789/0 conn(0x7f95c80d2fa0 legacy=0x7f95c80d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:28.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.133+0000 7f95cca00640 1 -- 172.21.15.94:0/3481731144 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c80b8890 con 0x7f95c80b5b50 2024-03-12T17:18:28.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.134+0000 7f95cca00640 1 --2- 172.21.15.94:0/3481731144 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f95c80b5b50 0x7f95c80b5f70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f95b4009870 tx=0x7f95b402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f46bc1b7cb63d3f server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:28.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.134+0000 7f95c7e00640 1 -- 172.21.15.94:0/3481731144 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b4030840 con 0x7f95c80b5b50 2024-03-12T17:18:28.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.135+0000 7f95c7e00640 1 -- 172.21.15.94:0/3481731144 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b40309a0 con 0x7f95c80b5b50 2024-03-12T17:18:28.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.135+0000 7f95c7e00640 1 -- 172.21.15.94:0/3481731144 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b4030d30 con 0x7f95c80b5b50 2024-03-12T17:18:28.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.135+0000 7f95cfe00640 1 -- 172.21.15.94:0/3481731144 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f95c80b5b50 msgr2=0x7f95c80b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:28.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.135+0000 7f95cfe00640 1 --2- 172.21.15.94:0/3481731144 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f95c80b5b50 0x7f95c80b5f70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f95b4009870 tx=0x7f95b402b980 comp rx=0 tx=0).stop 2024-03-12T17:18:28.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.135+0000 7f95cfe00640 1 -- 172.21.15.94:0/3481731144 shutdown_connections 2024-03-12T17:18:28.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.135+0000 7f95cfe00640 1 --2- 172.21.15.94:0/3481731144 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f95c80cd840 0x7f95c80cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:28.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.135+0000 7f95cfe00640 1 --2- 172.21.15.94:0/3481731144 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f95c80b5b50 0x7f95c80b5f70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:28.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.135+0000 7f95cfe00640 1 -- 172.21.15.94:0/3481731144 >> 172.21.15.94:0/3481731144 conn(0x7f95c8065df0 msgr2=0x7f95c8066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:28.138 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.135+0000 7f95cfe00640 1 -- 172.21.15.94:0/3481731144 shutdown_connections 2024-03-12T17:18:28.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.135+0000 7f95cfe00640 1 -- 172.21.15.94:0/3481731144 wait complete. 2024-03-12T17:18:28.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.137+0000 7f95cfe00640 1 Processor -- start 2024-03-12T17:18:28.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.137+0000 7f95cfe00640 1 -- start start 2024-03-12T17:18:28.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.138+0000 7f95cfe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f95c80b5b50 0x7f95c8151c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:28.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.138+0000 7f95cfe00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f95c80cd840 0x7f95c80cf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:28.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.138+0000 7f95cfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95c80d2fa0 0x7f95c80cf930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:28.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.138+0000 7f95cfe00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c80cc930 con 0x7f95c80d2fa0 2024-03-12T17:18:28.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.138+0000 7f95cfe00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c815dee0 con 0x7f95c80b5b50 2024-03-12T17:18:28.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.138+0000 7f95cfe00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c815e1c0 con 0x7f95c80cd840 2024-03-12T17:18:28.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.138+0000 7f95cca00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f95c80cd840 0x7f95c80cf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:28.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.138+0000 7f95cd400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f95c80b5b50 0x7f95c8151c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:28.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.138+0000 7f95cca00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f95c80cd840 0x7f95c80cf3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.94:60932/0 (socket says 172.21.15.94:60932) 2024-03-12T17:18:28.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.139+0000 7f95cca00640 1 -- 172.21.15.94:0/1270850035 learned_addr learned my addr 172.21.15.94:0/1270850035 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-12T17:18:28.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.139+0000 7f95cd400640 1 --2- 172.21.15.94:0/1270850035 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f95c80b5b50 0x7f95c8151c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:48562/0 (socket says 172.21.15.94:48562) 2024-03-12T17:18:28.139 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.139+0000 7f95cde00640 1 --2- 172.21.15.94:0/1270850035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95c80d2fa0 0x7f95c80cf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:28.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.139+0000 7f95cca00640 1 -- 172.21.15.94:0/1270850035 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f95c80b5b50 msgr2=0x7f95c8151c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:28.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.139+0000 7f95cca00640 1 --2- 172.21.15.94:0/1270850035 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f95c80b5b50 0x7f95c8151c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:28.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.139+0000 7f95cca00640 1 -- 172.21.15.94:0/1270850035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95c80d2fa0 msgr2=0x7f95c80cf930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:28.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.139+0000 7f95cca00640 1 --2- 172.21.15.94:0/1270850035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95c80d2fa0 0x7f95c80cf930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:28.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.139+0000 7f95cca00640 1 -- 172.21.15.94:0/1270850035 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b40094d0 con 0x7f95c80cd840 2024-03-12T17:18:28.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.139+0000 7f95cd400640 1 --2- 172.21.15.94:0/1270850035 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f95c80b5b50 0x7f95c8151c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-12T17:18:28.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.139+0000 7f95cca00640 1 --2- 172.21.15.94:0/1270850035 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f95c80cd840 0x7f95c80cf3f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f95b40097c0 tx=0x7f95b4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:28.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.140+0000 7f95c5600640 1 -- 172.21.15.94:0/1270850035 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b4039c90 con 0x7f95c80cd840 2024-03-12T17:18:28.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.140+0000 7f95c5600640 1 -- 172.21.15.94:0/1270850035 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b4039df0 con 0x7f95c80cd840 2024-03-12T17:18:28.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.140+0000 7f95c5600640 1 -- 172.21.15.94:0/1270850035 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b40446c0 con 0x7f95c80cd840 2024-03-12T17:18:28.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.140+0000 7f95cfe00640 1 -- 172.21.15.94:0/1270850035 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95c815e4a0 con 0x7f95c80cd840 2024-03-12T17:18:28.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.140+0000 7f95cfe00640 1 -- 172.21.15.94:0/1270850035 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95c815ea60 con 0x7f95c80cd840 2024-03-12T17:18:28.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.140+0000 7f95c5600640 1 -- 172.21.15.94:0/1270850035 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f95b4044b20 con 0x7f95c80cd840 2024-03-12T17:18:28.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.140+0000 7f95c5600640 1 -- 172.21.15.94:0/1270850035 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f95b403e070 con 0x7f95c80cd840 2024-03-12T17:18:28.140 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.141+0000 7f95cfe00640 1 -- 172.21.15.94:0/1270850035 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95c80736c0 con 0x7f95c80cd840 2024-03-12T17:18:28.141 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.143+0000 7f95c5600640 1 -- 172.21.15.94:0/1270850035 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f95b4049070 con 0x7f95c80cd840 2024-03-12T17:18:28.145 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-12T17:18:28.151+0000 7f7d81eda040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-12T17:18:28.201 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-12T17:18:28.206+0000 7f7d81eda040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-12T17:18:28.215 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.221+0000 7f95cfe00640 1 -- 172.21.15.94:0/1270850035 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "osd new", "uuid": "23df2a44-1a0d-4102-80b0-0123937722ba", "id": 2} v 0) v1 -- 0x7f95c80c9200 con 0x7f95c80cd840 2024-03-12T17:18:28.222 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.227+0000 7f95c5600640 1 -- 172.21.15.94:0/1270850035 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "23df2a44-1a0d-4102-80b0-0123937722ba", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f95b4034070 con 0x7f95c80cd840 2024-03-12T17:18:28.222 INFO:teuthology.orchestra.run.smithi094.stdout:2 2024-03-12T17:18:28.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.228+0000 7f95cfe00640 1 -- 172.21.15.94:0/1270850035 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f95c80cd840 msgr2=0x7f95c80cf3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:28.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.228+0000 7f95cfe00640 1 --2- 172.21.15.94:0/1270850035 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f95c80cd840 0x7f95c80cf3f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f95b40097c0 tx=0x7f95b4004730 comp rx=0 tx=0).stop 2024-03-12T17:18:28.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.228+0000 7f95cfe00640 1 -- 172.21.15.94:0/1270850035 shutdown_connections 2024-03-12T17:18:28.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.228+0000 7f95cfe00640 1 --2- 172.21.15.94:0/1270850035 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95c80d2fa0 0x7f95c80cf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:28.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.228+0000 7f95cfe00640 1 --2- 172.21.15.94:0/1270850035 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f95c80cd840 0x7f95c80cf3f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:28.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.228+0000 7f95cfe00640 1 --2- 172.21.15.94:0/1270850035 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f95c80b5b50 0x7f95c8151c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:28.223 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.228+0000 7f95cfe00640 1 -- 172.21.15.94:0/1270850035 >> 172.21.15.94:0/1270850035 conn(0x7f95c8065df0 msgr2=0x7f95c80cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:28.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.229+0000 7f95cfe00640 1 -- 172.21.15.94:0/1270850035 shutdown_connections 2024-03-12T17:18:28.224 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.229+0000 7f95cfe00640 1 -- 172.21.15.94:0/1270850035 wait complete. 2024-03-12T17:18:28.240 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph osd new d13d1eb3-124d-4c8f-b103-830669b01503 3 2024-03-12T17:18:28.264 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-12T17:18:28.270+0000 7f7d81eda040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-12T17:18:28.321 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-12T17:18:28.327+0000 7f7d81eda040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-12T17:18:28.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.427+0000 7f4667e00640 1 Processor -- start 2024-03-12T17:18:28.422 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.427+0000 7f4667e00640 1 -- start start 2024-03-12T17:18:28.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.428+0000 7f4667e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f466815bbb0 0x7f46680ce250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:28.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.429+0000 7f4667e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f46680ce790 0x7f46680cec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:28.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.429+0000 7f4667e00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4668098a60 con 0x7f46680cf1a0 2024-03-12T17:18:28.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.429+0000 7f4667e00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46680cf650 con 0x7f466815bbb0 2024-03-12T17:18:28.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.429+0000 7f4667e00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f466815bf90 con 0x7f46680ce790 2024-03-12T17:18:28.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.429+0000 7f4666000640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f46680ce790 0x7f46680cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:28.424 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.429+0000 7f4666000640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f46680ce790 0x7f46680cec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:48576/0 (socket says 172.21.15.94:48576) 2024-03-12T17:18:28.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.429+0000 7f4666000640 1 -- 172.21.15.94:0/1965001152 learned_addr learned my addr 172.21.15.94:0/1965001152 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-12T17:18:28.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.429+0000 7f4666a00640 1 --2- 172.21.15.94:0/1965001152 >> v2:172.21.15.17:3300/0 conn(0x7f466815bbb0 0x7f46680ce250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:28.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.429+0000 7f4666000640 1 -- 172.21.15.94:0/1965001152 >> v2:172.21.15.17:3300/0 conn(0x7f466815bbb0 msgr2=0x7f46680ce250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:28.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.429+0000 7f4666000640 1 --2- 172.21.15.94:0/1965001152 >> v2:172.21.15.17:3300/0 conn(0x7f466815bbb0 0x7f46680ce250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:28.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.429+0000 7f4666000640 1 -- 172.21.15.94:0/1965001152 >> v1:172.21.15.17:6789/0 conn(0x7f46680cf1a0 legacy=0x7f466815e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:28.425 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.429+0000 7f4666000640 1 -- 172.21.15.94:0/1965001152 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4668098cb0 con 0x7f46680ce790 2024-03-12T17:18:28.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.430+0000 7f4666000640 1 --2- 172.21.15.94:0/1965001152 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46680ce790 0x7f46680cec60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f46680718f0 tx=0x7f465402b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79a4e8230c76c823 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:28.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.431+0000 7f4665600640 1 -- 172.21.15.94:0/1965001152 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4654031870 con 0x7f46680ce790 2024-03-12T17:18:28.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.431+0000 7f4665600640 1 -- 172.21.15.94:0/1965001152 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46540319d0 con 0x7f46680ce790 2024-03-12T17:18:28.426 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.431+0000 7f4665600640 1 -- 172.21.15.94:0/1965001152 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4654031d60 con 0x7f46680ce790 2024-03-12T17:18:28.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.431+0000 7f4667e00640 1 -- 172.21.15.94:0/1965001152 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46680ce790 msgr2=0x7f46680cec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:28.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.431+0000 7f4667e00640 1 --2- 172.21.15.94:0/1965001152 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46680ce790 0x7f46680cec60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f46680718f0 tx=0x7f465402b910 comp rx=0 tx=0).stop 2024-03-12T17:18:28.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.431+0000 7f4667e00640 1 -- 172.21.15.94:0/1965001152 shutdown_connections 2024-03-12T17:18:28.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.431+0000 7f4667e00640 1 --2- 172.21.15.94:0/1965001152 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46680ce790 0x7f46680cec60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:28.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.431+0000 7f4667e00640 1 --2- 172.21.15.94:0/1965001152 >> v2:172.21.15.17:3300/0 conn(0x7f466815bbb0 0x7f46680ce250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:28.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.431+0000 7f4667e00640 1 -- 172.21.15.94:0/1965001152 >> 172.21.15.94:0/1965001152 conn(0x7f46680b2170 msgr2=0x7f46680b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:28.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.432+0000 7f4667e00640 1 -- 172.21.15.94:0/1965001152 shutdown_connections 2024-03-12T17:18:28.427 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.432+0000 7f4667e00640 1 -- 172.21.15.94:0/1965001152 wait complete. 2024-03-12T17:18:28.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.433+0000 7f4667e00640 1 Processor -- start 2024-03-12T17:18:28.428 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.433+0000 7f4667e00640 1 -- start start 2024-03-12T17:18:28.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.434+0000 7f4667e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f46680ce790 0x7f4668153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:28.430 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.434+0000 7f4667e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46680cf1a0 0x7f46680c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:28.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.434+0000 7f4667e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f466815bbb0 0x7f466806f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:28.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.434+0000 7f4667e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4668154190 con 0x7f46680cf1a0 2024-03-12T17:18:28.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.434+0000 7f4667e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46680c9a80 con 0x7f466815bbb0 2024-03-12T17:18:28.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.434+0000 7f4667e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46680c8f00 con 0x7f46680ce790 2024-03-12T17:18:28.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.434+0000 7f4667400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f466815bbb0 0x7f466806f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:28.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.434+0000 7f4666a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f46680ce790 0x7f4668153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:28.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.434+0000 7f4667400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f466815bbb0 0x7f466806f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:48584/0 (socket says 172.21.15.94:48584) 2024-03-12T17:18:28.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.434+0000 7f4666a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f46680ce790 0x7f4668153c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.94:60944/0 (socket says 172.21.15.94:60944) 2024-03-12T17:18:28.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.434+0000 7f4667400640 1 -- 172.21.15.94:0/31177692 learned_addr learned my addr 172.21.15.94:0/31177692 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-12T17:18:28.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.435+0000 7f4666000640 1 --2- 172.21.15.94:0/31177692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46680cf1a0 0x7f46680c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:28.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.435+0000 7f4667400640 1 -- 172.21.15.94:0/31177692 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f46680ce790 msgr2=0x7f4668153c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:28.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.435+0000 7f4667400640 1 --2- 172.21.15.94:0/31177692 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f46680ce790 0x7f4668153c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:28.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.435+0000 7f4667400640 1 -- 172.21.15.94:0/31177692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46680cf1a0 msgr2=0x7f46680c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:28.431 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.435+0000 7f4667400640 1 --2- 172.21.15.94:0/31177692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46680cf1a0 0x7f46680c85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:28.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.435+0000 7f4667400640 1 -- 172.21.15.94:0/31177692 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46540094d0 con 0x7f466815bbb0 2024-03-12T17:18:28.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.435+0000 7f4666000640 1 --2- 172.21.15.94:0/31177692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46680cf1a0 0x7f46680c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:18:28.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.435+0000 7f4667400640 1 --2- 172.21.15.94:0/31177692 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f466815bbb0 0x7f466806f560 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f466000c780 tx=0x7f466000cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:28.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.435+0000 7f465ea00640 1 -- 172.21.15.94:0/31177692 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4660004b60 con 0x7f466815bbb0 2024-03-12T17:18:28.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.435+0000 7f465ea00640 1 -- 172.21.15.94:0/31177692 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466000ce90 con 0x7f466815bbb0 2024-03-12T17:18:28.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.435+0000 7f465ea00640 1 -- 172.21.15.94:0/31177692 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466000a850 con 0x7f466815bbb0 2024-03-12T17:18:28.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.435+0000 7f4667e00640 1 -- 172.21.15.94:0/31177692 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46680c91e0 con 0x7f466815bbb0 2024-03-12T17:18:28.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.436+0000 7f4667e00640 1 -- 172.21.15.94:0/31177692 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46680c97a0 con 0x7f466815bbb0 2024-03-12T17:18:28.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.436+0000 7f465ea00640 1 -- 172.21.15.94:0/31177692 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f466000a9b0 con 0x7f466815bbb0 2024-03-12T17:18:28.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.436+0000 7f465ea00640 1 -- 172.21.15.94:0/31177692 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f4660005030 con 0x7f466815bbb0 2024-03-12T17:18:28.432 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.437+0000 7f4667e00640 1 -- 172.21.15.94:0/31177692 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46680ad3c0 con 0x7f466815bbb0 2024-03-12T17:18:28.434 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.439+0000 7f465ea00640 1 -- 172.21.15.94:0/31177692 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f46680ad3c0 con 0x7f466815bbb0 2024-03-12T17:18:28.513 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.518+0000 7f4667e00640 1 -- 172.21.15.94:0/31177692 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d13d1eb3-124d-4c8f-b103-830669b01503", "id": 3} v 0) v1 -- 0x7f46680caab0 con 0x7f466815bbb0 2024-03-12T17:18:28.519 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.524+0000 7f465ea00640 1 -- 172.21.15.94:0/31177692 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d13d1eb3-124d-4c8f-b103-830669b01503", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f466000ac60 con 0x7f466815bbb0 2024-03-12T17:18:28.519 INFO:teuthology.orchestra.run.smithi094.stdout:3 2024-03-12T17:18:28.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.525+0000 7f4667e00640 1 -- 172.21.15.94:0/31177692 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f466815bbb0 msgr2=0x7f466806f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:28.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.525+0000 7f4667e00640 1 --2- 172.21.15.94:0/31177692 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f466815bbb0 0x7f466806f560 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f466000c780 tx=0x7f466000cc40 comp rx=0 tx=0).stop 2024-03-12T17:18:28.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.525+0000 7f4667e00640 1 -- 172.21.15.94:0/31177692 shutdown_connections 2024-03-12T17:18:28.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.525+0000 7f4667e00640 1 --2- 172.21.15.94:0/31177692 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f466815bbb0 0x7f466806f560 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:28.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.525+0000 7f4667e00640 1 --2- 172.21.15.94:0/31177692 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46680cf1a0 0x7f46680c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:28.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.525+0000 7f4667e00640 1 --2- 172.21.15.94:0/31177692 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f46680ce790 0x7f4668153c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:28.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.525+0000 7f4667e00640 1 -- 172.21.15.94:0/31177692 >> 172.21.15.94:0/31177692 conn(0x7f46680b2170 msgr2=0x7f46680cb150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:28.520 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.525+0000 7f4667e00640 1 -- 172.21.15.94:0/31177692 shutdown_connections 2024-03-12T17:18:28.521 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.525+0000 7f4667e00640 1 -- 172.21.15.94:0/31177692 wait complete. 2024-03-12T17:18:28.536 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph osd new fd2ec44e-2a3c-48a4-a177-0badb6048e32 4 2024-03-12T17:18:28.607 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-03-12T17:18:28.613+0000 7f440d20e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-12T17:18:28.672 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-03-12T17:18:28.677+0000 7f440d20e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-12T17:18:28.722 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.728+0000 7fb6d6c00640 1 Processor -- start 2024-03-12T17:18:28.723 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.728+0000 7fb6d6c00640 1 -- start start 2024-03-12T17:18:28.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.729+0000 7fb6d6c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6d0069ce0 0x7fb6d006a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:28.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.729+0000 7fb6d6c00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6d006a680 con 0x7fb6d015cbc0 2024-03-12T17:18:28.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.729+0000 7fb6d6c00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6d00aea00 con 0x7fb6d00cbe20 2024-03-12T17:18:28.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.729+0000 7fb6d6c00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d00c5b40 con 0x7fb6d0069ce0 2024-03-12T17:18:28.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.730+0000 7fb6d4e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6d0069ce0 0x7fb6d006a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:28.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.730+0000 7fb6d4e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6d0069ce0 0x7fb6d006a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.94:60954/0 (socket says 172.21.15.94:60954) 2024-03-12T17:18:28.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.730+0000 7fb6d4e00640 1 -- 172.21.15.94:0/570435673 learned_addr learned my addr 172.21.15.94:0/570435673 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-12T17:18:28.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.730+0000 7fb6d4e00640 1 -- 172.21.15.94:0/570435673 >> v1:172.21.15.94:6789/0 conn(0x7fb6d00cbe20 legacy=0x7fb6d00cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:28.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.730+0000 7fb6d4e00640 1 -- 172.21.15.94:0/570435673 >> v1:172.21.15.17:6789/0 conn(0x7fb6d015cbc0 legacy=0x7fb6d00b18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:28.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.730+0000 7fb6cfe00640 1 -- 172.21.15.94:0/570435673 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4231017953 0 0) 0x7fb6d00aea00 con 0x7fb6d00cbe20 2024-03-12T17:18:28.725 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.730+0000 7fb6d4e00640 1 -- 172.21.15.94:0/570435673 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6d00c5e20 con 0x7fb6d0069ce0 2024-03-12T17:18:28.726 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-03-12T17:18:28.732+0000 7f440d20e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-12T17:18:28.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.732+0000 7fb6d4e00640 1 --2- 172.21.15.94:0/570435673 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6d0069ce0 0x7fb6d006a140 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc0098a0 tx=0x7fb6bc02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e335914e16dcf4a server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:28.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.732+0000 7fb6cfe00640 1 -- 172.21.15.94:0/570435673 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc030840 con 0x7fb6d0069ce0 2024-03-12T17:18:28.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.732+0000 7fb6cfe00640 1 -- 172.21.15.94:0/570435673 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6bc0309a0 con 0x7fb6d0069ce0 2024-03-12T17:18:28.727 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.732+0000 7fb6cfe00640 1 -- 172.21.15.94:0/570435673 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc030d30 con 0x7fb6d0069ce0 2024-03-12T17:18:28.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.733+0000 7fb6d6c00640 1 -- 172.21.15.94:0/570435673 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6d0069ce0 msgr2=0x7fb6d006a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:28.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.733+0000 7fb6d6c00640 1 --2- 172.21.15.94:0/570435673 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6d0069ce0 0x7fb6d006a140 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc0098a0 tx=0x7fb6bc02b980 comp rx=0 tx=0).stop 2024-03-12T17:18:28.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.733+0000 7fb6d6c00640 1 -- 172.21.15.94:0/570435673 shutdown_connections 2024-03-12T17:18:28.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.733+0000 7fb6d6c00640 1 --2- 172.21.15.94:0/570435673 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6d0069ce0 0x7fb6d006a140 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:28.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.733+0000 7fb6d6c00640 1 -- 172.21.15.94:0/570435673 >> 172.21.15.94:0/570435673 conn(0x7fb6d0098a60 msgr2=0x7fb6d00b11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:28.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.733+0000 7fb6d6c00640 1 -- 172.21.15.94:0/570435673 shutdown_connections 2024-03-12T17:18:28.728 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.733+0000 7fb6d6c00640 1 -- 172.21.15.94:0/570435673 wait complete. 2024-03-12T17:18:28.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.735+0000 7fb6d6c00640 1 Processor -- start 2024-03-12T17:18:28.729 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.735+0000 7fb6d6c00640 1 -- start start 2024-03-12T17:18:28.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.736+0000 7fb6d6c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6d0069ce0 0x7fb6d01f2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:28.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.736+0000 7fb6d6c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6d00cbe20 0x7fb6d00c7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:28.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.736+0000 7fb6d6c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6d00c9540 0x7fb6d015d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:28.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.736+0000 7fb6d6c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d01f2c30 con 0x7fb6d00c9540 2024-03-12T17:18:28.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.736+0000 7fb6d6c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d01f2f10 con 0x7fb6d00cbe20 2024-03-12T17:18:28.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.736+0000 7fb6d6c00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6d01f31f0 con 0x7fb6d0069ce0 2024-03-12T17:18:28.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.736+0000 7fb6d4e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6d00cbe20 0x7fb6d00c7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:28.732 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.736+0000 7fb6d5800640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6d0069ce0 0x7fb6d01f2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:28.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.736+0000 7fb6d4e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6d00cbe20 0x7fb6d00c7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:48592/0 (socket says 172.21.15.94:48592) 2024-03-12T17:18:28.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.736+0000 7fb6d4e00640 1 -- 172.21.15.94:0/4198488770 learned_addr learned my addr 172.21.15.94:0/4198488770 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-12T17:18:28.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.736+0000 7fb6d6200640 1 --2- 172.21.15.94:0/4198488770 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6d00c9540 0x7fb6d015d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:28.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.736+0000 7fb6d4e00640 1 -- 172.21.15.94:0/4198488770 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6d0069ce0 msgr2=0x7fb6d01f2370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:28.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.736+0000 7fb6d4e00640 1 --2- 172.21.15.94:0/4198488770 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6d0069ce0 0x7fb6d01f2370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:28.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.736+0000 7fb6d4e00640 1 -- 172.21.15.94:0/4198488770 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6d00c9540 msgr2=0x7fb6d015d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:28.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.736+0000 7fb6d4e00640 1 --2- 172.21.15.94:0/4198488770 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6d00c9540 0x7fb6d015d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:28.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.736+0000 7fb6d4e00640 1 -- 172.21.15.94:0/4198488770 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6bc0094d0 con 0x7fb6d00cbe20 2024-03-12T17:18:28.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.736+0000 7fb6d5800640 1 --2- 172.21.15.94:0/4198488770 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6d0069ce0 0x7fb6d01f2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-12T17:18:28.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.736+0000 7fb6d6200640 1 --2- 172.21.15.94:0/4198488770 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6d00c9540 0x7fb6d015d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:18:28.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.737+0000 7fb6d4e00640 1 --2- 172.21.15.94:0/4198488770 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6d00cbe20 0x7fb6d00c7730 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc000c00 tx=0x7fb6bc004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:28.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.737+0000 7fb6cd600640 1 -- 172.21.15.94:0/4198488770 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc0307f0 con 0x7fb6d00cbe20 2024-03-12T17:18:28.733 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.737+0000 7fb6cd600640 1 -- 172.21.15.94:0/4198488770 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6bc039d90 con 0x7fb6d00cbe20 2024-03-12T17:18:28.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.737+0000 7fb6cd600640 1 -- 172.21.15.94:0/4198488770 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6bc043630 con 0x7fb6d00cbe20 2024-03-12T17:18:28.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.737+0000 7fb6d6c00640 1 -- 172.21.15.94:0/4198488770 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6d015d050 con 0x7fb6d00cbe20 2024-03-12T17:18:28.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.737+0000 7fb6d6c00640 1 -- 172.21.15.94:0/4198488770 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6d01f28b0 con 0x7fb6d00cbe20 2024-03-12T17:18:28.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.737+0000 7fb6cd600640 1 -- 172.21.15.94:0/4198488770 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb6bc043a90 con 0x7fb6d00cbe20 2024-03-12T17:18:28.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.737+0000 7fb6cd600640 1 -- 172.21.15.94:0/4198488770 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fb6bc043d40 con 0x7fb6d00cbe20 2024-03-12T17:18:28.734 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.738+0000 7fb6d6c00640 1 -- 172.21.15.94:0/4198488770 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6d004e030 con 0x7fb6d00cbe20 2024-03-12T17:18:28.735 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.740+0000 7fb6cd600640 1 -- 172.21.15.94:0/4198488770 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7fb6bc048070 con 0x7fb6d00cbe20 2024-03-12T17:18:28.792 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-12T17:18:28.797+0000 7f7d81eda040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-12T17:18:28.792 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-03-12T17:18:28.798+0000 7f440d20e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-12T17:18:28.813 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.818+0000 7fb6d6c00640 1 -- 172.21.15.94:0/4198488770 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fd2ec44e-2a3c-48a4-a177-0badb6048e32", "id": 4} v 0) v1 -- 0x7fb6d00ca2c0 con 0x7fb6d00cbe20 2024-03-12T17:18:28.819 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.824+0000 7fb6cd600640 1 -- 172.21.15.94:0/4198488770 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fd2ec44e-2a3c-48a4-a177-0badb6048e32", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb6bc034070 con 0x7fb6d00cbe20 2024-03-12T17:18:28.819 INFO:teuthology.orchestra.run.smithi094.stdout:4 2024-03-12T17:18:28.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.825+0000 7fb6d6c00640 1 -- 172.21.15.94:0/4198488770 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6d00cbe20 msgr2=0x7fb6d00c7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:28.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.825+0000 7fb6d6c00640 1 --2- 172.21.15.94:0/4198488770 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6d00cbe20 0x7fb6d00c7730 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb6bc000c00 tx=0x7fb6bc004730 comp rx=0 tx=0).stop 2024-03-12T17:18:28.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.825+0000 7fb6d6c00640 1 -- 172.21.15.94:0/4198488770 shutdown_connections 2024-03-12T17:18:28.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.825+0000 7fb6d6c00640 1 --2- 172.21.15.94:0/4198488770 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6d00c9540 0x7fb6d015d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:28.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.825+0000 7fb6d6c00640 1 --2- 172.21.15.94:0/4198488770 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6d00cbe20 0x7fb6d00c7730 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:28.820 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.825+0000 7fb6d6c00640 1 --2- 172.21.15.94:0/4198488770 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6d0069ce0 0x7fb6d01f2370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:28.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.825+0000 7fb6d6c00640 1 -- 172.21.15.94:0/4198488770 >> 172.21.15.94:0/4198488770 conn(0x7fb6d0098a60 msgr2=0x7fb6d00c4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:28.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.825+0000 7fb6d6c00640 1 -- 172.21.15.94:0/4198488770 shutdown_connections 2024-03-12T17:18:28.821 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:28.826+0000 7fb6d6c00640 1 -- 172.21.15.94:0/4198488770 wait complete. 2024-03-12T17:18:28.836 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph osd new a1d66b17-d782-49a4-8e0f-94f0a8b4251b 5 2024-03-12T17:18:28.846 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-03-12T17:18:28.851+0000 7f440d20e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-12T17:18:28.960 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-12T17:18:28.966+0000 7f7d81eda040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-12T17:18:28.982 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-03-12T17:18:28.987+0000 7f440d20e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-12T17:18:29.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.019+0000 7f2bb0a00640 1 Processor -- start 2024-03-12T17:18:29.014 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.019+0000 7f2bb0a00640 1 -- start start 2024-03-12T17:18:29.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.021+0000 7f2bb0a00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2bac0d2fa0 0x7f2bac0d3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:29.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.021+0000 7f2bb0a00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bac0d14e0 con 0x7f2bac0b5f70 2024-03-12T17:18:29.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.021+0000 7f2bb0a00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bac0d38c0 con 0x7f2bac0b5b50 2024-03-12T17:18:29.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.021+0000 7f2bb0a00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bac0b59e0 con 0x7f2bac0d2fa0 2024-03-12T17:18:29.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.021+0000 7f2ba9e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2bac0d2fa0 0x7f2bac0d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:29.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.021+0000 7f2ba9e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2bac0d2fa0 0x7f2bac0d3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:48606/0 (socket says 172.21.15.94:48606) 2024-03-12T17:18:29.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.021+0000 7f2ba9e00640 1 -- 172.21.15.94:0/2967497866 learned_addr learned my addr 172.21.15.94:0/2967497866 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-12T17:18:29.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.021+0000 7f2ba9e00640 1 -- 172.21.15.94:0/2967497866 >> v1:172.21.15.94:6789/0 conn(0x7f2bac0b5b50 legacy=0x7f2bac0cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:29.016 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.021+0000 7f2ba9e00640 1 -- 172.21.15.94:0/2967497866 >> v1:172.21.15.17:6789/0 conn(0x7f2bac0b5f70 legacy=0x7f2bac0d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:29.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.021+0000 7f2ba9e00640 1 -- 172.21.15.94:0/2967497866 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bac0b85b0 con 0x7f2bac0d2fa0 2024-03-12T17:18:29.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.022+0000 7f2ba9e00640 1 --2- 172.21.15.94:0/2967497866 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bac0d2fa0 0x7f2bac0d3380 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c009870 tx=0x7f2b9c02b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b13fc2cadd36071 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:29.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.022+0000 7f2ba8a00640 1 -- 172.21.15.94:0/2967497866 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c030860 con 0x7f2bac0d2fa0 2024-03-12T17:18:29.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.023+0000 7f2ba8a00640 1 -- 172.21.15.94:0/2967497866 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b9c0309c0 con 0x7f2bac0d2fa0 2024-03-12T17:18:29.017 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.023+0000 7f2ba8a00640 1 -- 172.21.15.94:0/2967497866 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c030d50 con 0x7f2bac0d2fa0 2024-03-12T17:18:29.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.023+0000 7f2bb0a00640 1 -- 172.21.15.94:0/2967497866 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bac0d2fa0 msgr2=0x7f2bac0d3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:29.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.023+0000 7f2bb0a00640 1 --2- 172.21.15.94:0/2967497866 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bac0d2fa0 0x7f2bac0d3380 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c009870 tx=0x7f2b9c02b9a0 comp rx=0 tx=0).stop 2024-03-12T17:18:29.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.023+0000 7f2bb0a00640 1 -- 172.21.15.94:0/2967497866 shutdown_connections 2024-03-12T17:18:29.018 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.023+0000 7f2bb0a00640 1 --2- 172.21.15.94:0/2967497866 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bac0d2fa0 0x7f2bac0d3380 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:29.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.023+0000 7f2bb0a00640 1 -- 172.21.15.94:0/2967497866 >> 172.21.15.94:0/2967497866 conn(0x7f2bac065df0 msgr2=0x7f2bac066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:29.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.023+0000 7f2bb0a00640 1 -- 172.21.15.94:0/2967497866 shutdown_connections 2024-03-12T17:18:29.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.023+0000 7f2bb0a00640 1 -- 172.21.15.94:0/2967497866 wait complete. 2024-03-12T17:18:29.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.025+0000 7f2bb0a00640 1 Processor -- start 2024-03-12T17:18:29.019 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.025+0000 7f2bb0a00640 1 -- start start 2024-03-12T17:18:29.022 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.026+0000 7f2bb0a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bac0b5b50 0x7f2bac1f1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:29.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.026+0000 7f2bb0a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bac0b5f70 0x7f2bac15d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:29.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.026+0000 7f2bb0a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2bac0d2fa0 0x7f2bac0c7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:29.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.026+0000 7f2bb0a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac0c9e40 con 0x7f2bac0b5f70 2024-03-12T17:18:29.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.026+0000 7f2bb0a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac0ca120 con 0x7f2bac0b5b50 2024-03-12T17:18:29.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.026+0000 7f2bb0a00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac0ca400 con 0x7f2bac0d2fa0 2024-03-12T17:18:29.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.026+0000 7f2ba9e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bac0b5b50 0x7f2bac1f1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:29.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.026+0000 7f2ba9e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bac0b5b50 0x7f2bac1f1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:48608/0 (socket says 172.21.15.94:48608) 2024-03-12T17:18:29.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.026+0000 7f2ba9e00640 1 -- 172.21.15.94:0/230126411 learned_addr learned my addr 172.21.15.94:0/230126411 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-12T17:18:29.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.026+0000 7f2baa800640 1 --2- 172.21.15.94:0/230126411 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2bac0d2fa0 0x7f2bac0c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:29.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.026+0000 7f2ba9400640 1 --2- 172.21.15.94:0/230126411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bac0b5f70 0x7f2bac15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:29.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.027+0000 7f2baa800640 1 -- 172.21.15.94:0/230126411 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bac0b5b50 msgr2=0x7f2bac1f1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:29.023 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.027+0000 7f2baa800640 1 --2- 172.21.15.94:0/230126411 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bac0b5b50 0x7f2bac1f1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:29.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.027+0000 7f2baa800640 1 -- 172.21.15.94:0/230126411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bac0b5f70 msgr2=0x7f2bac15d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:29.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.027+0000 7f2baa800640 1 --2- 172.21.15.94:0/230126411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bac0b5f70 0x7f2bac15d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:29.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.027+0000 7f2baa800640 1 -- 172.21.15.94:0/230126411 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b9c0094d0 con 0x7f2bac0d2fa0 2024-03-12T17:18:29.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.027+0000 7f2ba9e00640 1 --2- 172.21.15.94:0/230126411 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bac0b5b50 0x7f2bac1f1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-12T17:18:29.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.027+0000 7f2baa800640 1 --2- 172.21.15.94:0/230126411 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2bac0d2fa0 0x7f2bac0c7580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2ba400be20 tx=0x7f2ba400bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:29.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.027+0000 7f2ba2000640 1 -- 172.21.15.94:0/230126411 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba400ce70 con 0x7f2bac0d2fa0 2024-03-12T17:18:29.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.027+0000 7f2ba2000640 1 -- 172.21.15.94:0/230126411 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba4014440 con 0x7f2bac0d2fa0 2024-03-12T17:18:29.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.027+0000 7f2bb0a00640 1 -- 172.21.15.94:0/230126411 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bac0ca6e0 con 0x7f2bac0d2fa0 2024-03-12T17:18:29.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.027+0000 7f2ba2000640 1 -- 172.21.15.94:0/230126411 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba4014830 con 0x7f2bac0d2fa0 2024-03-12T17:18:29.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.027+0000 7f2bb0a00640 1 -- 172.21.15.94:0/230126411 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bac0c9ad0 con 0x7f2bac0d2fa0 2024-03-12T17:18:29.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.028+0000 7f2ba2000640 1 -- 172.21.15.94:0/230126411 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2ba4014c90 con 0x7f2bac0d2fa0 2024-03-12T17:18:29.024 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.028+0000 7f2ba2000640 1 -- 172.21.15.94:0/230126411 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f2ba401e9c0 con 0x7f2bac0d2fa0 2024-03-12T17:18:29.025 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.028+0000 7f2bb0a00640 1 -- 172.21.15.94:0/230126411 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bac0736c0 con 0x7f2bac0d2fa0 2024-03-12T17:18:29.027 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.033+0000 7f2ba2000640 1 -- 172.21.15.94:0/230126411 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f2ba4019070 con 0x7f2bac0d2fa0 2024-03-12T17:18:29.069 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-03-12T17:18:29.074+0000 7f440d20e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-12T17:18:29.105 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-12T17:18:29.110+0000 7f7d81eda040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-12T17:18:29.105 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.111+0000 7f2bb0a00640 1 -- 172.21.15.94:0/230126411 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a1d66b17-d782-49a4-8e0f-94f0a8b4251b", "id": 5} v 0) v1 -- 0x7f2bac0cd010 con 0x7f2bac0d2fa0 2024-03-12T17:18:29.112 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.117+0000 7f2ba2000640 1 -- 172.21.15.94:0/230126411 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a1d66b17-d782-49a4-8e0f-94f0a8b4251b", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2ba401e570 con 0x7f2bac0d2fa0 2024-03-12T17:18:29.112 INFO:teuthology.orchestra.run.smithi094.stdout:5 2024-03-12T17:18:29.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.118+0000 7f2bb0a00640 1 -- 172.21.15.94:0/230126411 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2bac0d2fa0 msgr2=0x7f2bac0c7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:29.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.118+0000 7f2bb0a00640 1 --2- 172.21.15.94:0/230126411 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2bac0d2fa0 0x7f2bac0c7580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2ba400be20 tx=0x7f2ba400bf10 comp rx=0 tx=0).stop 2024-03-12T17:18:29.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.119+0000 7f2bb0a00640 1 -- 172.21.15.94:0/230126411 shutdown_connections 2024-03-12T17:18:29.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.119+0000 7f2bb0a00640 1 --2- 172.21.15.94:0/230126411 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2bac0d2fa0 0x7f2bac0c7580 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:29.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.119+0000 7f2bb0a00640 1 --2- 172.21.15.94:0/230126411 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bac0b5f70 0x7f2bac15d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:29.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.119+0000 7f2bb0a00640 1 --2- 172.21.15.94:0/230126411 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bac0b5b50 0x7f2bac1f1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:29.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.119+0000 7f2bb0a00640 1 -- 172.21.15.94:0/230126411 >> 172.21.15.94:0/230126411 conn(0x7f2bac065df0 msgr2=0x7f2bac0b2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:29.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.119+0000 7f2bb0a00640 1 -- 172.21.15.94:0/230126411 shutdown_connections 2024-03-12T17:18:29.114 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.119+0000 7f2bb0a00640 1 -- 172.21.15.94:0/230126411 wait complete. 2024-03-12T17:18:29.127 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-03-12T17:18:29.132+0000 7f440d20e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-12T17:18:29.130 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph osd new da027f37-269f-4e84-a7ed-522ed722876c 6 2024-03-12T17:18:29.161 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-12T17:18:29.167+0000 7f7d81eda040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-12T17:18:29.189 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-03-12T17:18:29.195+0000 7f440d20e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-12T17:18:29.248 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-03-12T17:18:29.253+0000 7f440d20e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-12T17:18:29.291 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-12T17:18:29.297+0000 7f7d81eda040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-12T17:18:29.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.364+0000 7f4886000640 1 Processor -- start 2024-03-12T17:18:29.359 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.365+0000 7f4886000640 1 -- start start 2024-03-12T17:18:29.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.366+0000 7f4886000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f48800cd730 0x7f48800cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:29.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.366+0000 7f4886000640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f48800b5b00 0x7f48800b5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:29.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.366+0000 7f4886000640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48800d1190 con 0x7f488015cb50 2024-03-12T17:18:29.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.366+0000 7f4886000640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48800ce0e0 con 0x7f48800cd730 2024-03-12T17:18:29.361 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.366+0000 7f4886000640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48800d1460 con 0x7f48800b5b00 2024-03-12T17:18:29.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.367+0000 7f487fe00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f48800cd730 0x7f48800cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:29.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.367+0000 7f487fe00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f48800cd730 0x7f48800cdba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.94:36020/0 (socket says 172.21.15.94:36020) 2024-03-12T17:18:29.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.367+0000 7f4884c00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f488015cb50 0x7f48800d0a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.94:51738/0 (socket says 172.21.15.94:51738) 2024-03-12T17:18:29.362 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.367+0000 7f487fe00640 1 -- 172.21.15.94:0/1754664081 learned_addr learned my addr 172.21.15.94:0/1754664081 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-12T17:18:29.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.367+0000 7f4885600640 1 --2- 172.21.15.94:0/1754664081 >> v2:172.21.15.94:3300/0 conn(0x7f48800b5b00 0x7f48800b5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:29.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.367+0000 7f4885600640 1 -- 172.21.15.94:0/1754664081 >> v2:172.21.15.17:3300/0 conn(0x7f48800cd730 msgr2=0x7f48800cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:29.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.367+0000 7f4885600640 1 --2- 172.21.15.94:0/1754664081 >> v2:172.21.15.17:3300/0 conn(0x7f48800cd730 0x7f48800cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:29.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.367+0000 7f4885600640 1 -- 172.21.15.94:0/1754664081 >> v1:172.21.15.17:6789/0 conn(0x7f488015cb50 legacy=0x7f48800d0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:29.363 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.367+0000 7f4885600640 1 -- 172.21.15.94:0/1754664081 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48800d1740 con 0x7f48800b5b00 2024-03-12T17:18:29.364 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.368+0000 7f4885600640 1 --2- 172.21.15.94:0/1754664081 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48800b5b00 0x7f48800b5f00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f48800b4f60 tx=0x7f487802bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17915ac0b175589e server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:29.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.368+0000 7f487f400640 1 -- 172.21.15.94:0/1754664081 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487802cd00 con 0x7f48800b5b00 2024-03-12T17:18:29.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.368+0000 7f487f400640 1 -- 172.21.15.94:0/1754664081 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487802ce60 con 0x7f48800b5b00 2024-03-12T17:18:29.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.368+0000 7f487f400640 1 -- 172.21.15.94:0/1754664081 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4878034660 con 0x7f48800b5b00 2024-03-12T17:18:29.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.369+0000 7f4886000640 1 -- 172.21.15.94:0/1754664081 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48800b5b00 msgr2=0x7f48800b5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:29.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.369+0000 7f4886000640 1 --2- 172.21.15.94:0/1754664081 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48800b5b00 0x7f48800b5f00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f48800b4f60 tx=0x7f487802bf50 comp rx=0 tx=0).stop 2024-03-12T17:18:29.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.369+0000 7f4886000640 1 -- 172.21.15.94:0/1754664081 shutdown_connections 2024-03-12T17:18:29.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.369+0000 7f4886000640 1 --2- 172.21.15.94:0/1754664081 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48800b5b00 0x7f48800b5f00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:29.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.369+0000 7f4886000640 1 --2- 172.21.15.94:0/1754664081 >> v2:172.21.15.17:3300/0 conn(0x7f48800cd730 0x7f48800cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:29.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.369+0000 7f4886000640 1 -- 172.21.15.94:0/1754664081 >> 172.21.15.94:0/1754664081 conn(0x7f48800cf3e0 msgr2=0x7f48800cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:29.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.369+0000 7f4886000640 1 -- 172.21.15.94:0/1754664081 shutdown_connections 2024-03-12T17:18:29.365 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.369+0000 7f4886000640 1 -- 172.21.15.94:0/1754664081 wait complete. 2024-03-12T17:18:29.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.371+0000 7f4886000640 1 Processor -- start 2024-03-12T17:18:29.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.371+0000 7f4886000640 1 -- start start 2024-03-12T17:18:29.368 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.372+0000 7f4886000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48800b5b00 0x7f488015fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:29.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.372+0000 7f4886000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48800cd730 0x7f48801548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:29.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.372+0000 7f4886000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f488015cb50 0x7f4880153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:29.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.372+0000 7f4886000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4880156810 con 0x7f48800cd730 2024-03-12T17:18:29.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.372+0000 7f4886000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488015f270 con 0x7f48800b5b00 2024-03-12T17:18:29.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.372+0000 7f4886000640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f488015f550 con 0x7f488015cb50 2024-03-12T17:18:29.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.372+0000 7f4884c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48800b5b00 0x7f488015fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:29.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.372+0000 7f4884c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48800b5b00 0x7f488015fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.94:48620/0 (socket says 172.21.15.94:48620) 2024-03-12T17:18:29.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.372+0000 7f4884c00640 1 -- 172.21.15.94:0/2150148495 learned_addr learned my addr 172.21.15.94:0/2150148495 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-12T17:18:29.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.372+0000 7f4885600640 1 --2- 172.21.15.94:0/2150148495 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f488015cb50 0x7f4880153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:29.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.372+0000 7f487fe00640 1 --2- 172.21.15.94:0/2150148495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48800cd730 0x7f48801548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:29.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.373+0000 7f4884c00640 1 -- 172.21.15.94:0/2150148495 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f488015cb50 msgr2=0x7f4880153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:29.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.373+0000 7f4884c00640 1 --2- 172.21.15.94:0/2150148495 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f488015cb50 0x7f4880153970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:29.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.373+0000 7f4884c00640 1 -- 172.21.15.94:0/2150148495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48800cd730 msgr2=0x7f48801548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:29.369 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.373+0000 7f4884c00640 1 --2- 172.21.15.94:0/2150148495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48800cd730 0x7f48801548c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:29.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.373+0000 7f4884c00640 1 -- 172.21.15.94:0/2150148495 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4878009a70 con 0x7f48800b5b00 2024-03-12T17:18:29.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.373+0000 7f4884c00640 1 --2- 172.21.15.94:0/2150148495 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48800b5b00 0x7f488015fd50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f487400c3e0 tx=0x7f487400c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:29.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.373+0000 7f487cc00640 1 -- 172.21.15.94:0/2150148495 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48740074e0 con 0x7f48800b5b00 2024-03-12T17:18:29.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.373+0000 7f487cc00640 1 -- 172.21.15.94:0/2150148495 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4874007640 con 0x7f48800b5b00 2024-03-12T17:18:29.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.373+0000 7f487cc00640 1 -- 172.21.15.94:0/2150148495 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48740049e0 con 0x7f48800b5b00 2024-03-12T17:18:29.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.373+0000 7f4886000640 1 -- 172.21.15.94:0/2150148495 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f488015f830 con 0x7f48800b5b00 2024-03-12T17:18:29.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.373+0000 7f4886000640 1 -- 172.21.15.94:0/2150148495 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4880154e00 con 0x7f48800b5b00 2024-03-12T17:18:29.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.374+0000 7f487cc00640 1 -- 172.21.15.94:0/2150148495 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4874013400 con 0x7f48800b5b00 2024-03-12T17:18:29.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.374+0000 7f487cc00640 1 -- 172.21.15.94:0/2150148495 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f4874013ca0 con 0x7f48800b5b00 2024-03-12T17:18:29.370 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.374+0000 7f4886000640 1 -- 172.21.15.94:0/2150148495 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f488004e030 con 0x7f48800b5b00 2024-03-12T17:18:29.371 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.377+0000 7f487cc00640 1 -- 172.21.15.94:0/2150148495 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f48740136b0 con 0x7f48800b5b00 2024-03-12T17:18:29.407 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-12T17:18:29.412+0000 7f7d81eda040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-12T17:18:29.450 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.455+0000 7f4886000640 1 -- 172.21.15.94:0/2150148495 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd new", "uuid": "da027f37-269f-4e84-a7ed-522ed722876c", "id": 6} v 0) v1 -- 0x7f48800b62f0 con 0x7f48800b5b00 2024-03-12T17:18:29.455 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.460+0000 7f487cc00640 1 -- 172.21.15.94:0/2150148495 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "da027f37-269f-4e84-a7ed-522ed722876c", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4874013850 con 0x7f48800b5b00 2024-03-12T17:18:29.455 INFO:teuthology.orchestra.run.smithi094.stdout:6 2024-03-12T17:18:29.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.462+0000 7f4886000640 1 -- 172.21.15.94:0/2150148495 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48800b5b00 msgr2=0x7f488015fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:29.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.462+0000 7f4886000640 1 --2- 172.21.15.94:0/2150148495 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48800b5b00 0x7f488015fd50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f487400c3e0 tx=0x7f487400c8a0 comp rx=0 tx=0).stop 2024-03-12T17:18:29.457 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.462+0000 7f4886000640 1 -- 172.21.15.94:0/2150148495 shutdown_connections 2024-03-12T17:18:29.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.462+0000 7f4886000640 1 --2- 172.21.15.94:0/2150148495 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f488015cb50 0x7f4880153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:29.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.462+0000 7f4886000640 1 --2- 172.21.15.94:0/2150148495 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48800cd730 0x7f48801548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:29.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.462+0000 7f4886000640 1 --2- 172.21.15.94:0/2150148495 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48800b5b00 0x7f488015fd50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:29.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.462+0000 7f4886000640 1 -- 172.21.15.94:0/2150148495 >> 172.21.15.94:0/2150148495 conn(0x7f48800cf3e0 msgr2=0x7f4880158c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:29.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.462+0000 7f4886000640 1 -- 172.21.15.94:0/2150148495 shutdown_connections 2024-03-12T17:18:29.458 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.462+0000 7f4886000640 1 -- 172.21.15.94:0/2150148495 wait complete. 2024-03-12T17:18:29.472 DEBUG:teuthology.orchestra.run.smithi094:> sudo ceph --cluster ceph osd new 58a7945a-f2c4-4783-8d9c-08b44b54281f 7 2024-03-12T17:18:29.592 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-12T17:18:29.597+0000 7f7d81eda040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-12T17:18:29.643 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-12T17:18:29.649+0000 7f7d81eda040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-12T17:18:29.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.707+0000 7fec8b400640 1 Processor -- start 2024-03-12T17:18:29.702 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.707+0000 7fec8b400640 1 -- start start 2024-03-12T17:18:29.703 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.709+0000 7fec8b400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fec840afe20 0x7fec840cf820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:29.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.709+0000 7fec8b400640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec840cece0 con 0x7fec8415ced0 2024-03-12T17:18:29.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.709+0000 7fec8b400640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec8415d7a0 con 0x7fec840992c0 2024-03-12T17:18:29.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.709+0000 7fec8b400640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec8415e3b0 con 0x7fec840afe20 2024-03-12T17:18:29.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.709+0000 7fec7be00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7fec840992c0 0x7fec840cf110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.94:59694/0 (socket says 172.21.15.94:59694) 2024-03-12T17:18:29.704 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.709+0000 7fec7be00640 1 -- 172.21.15.94:0/980602244 learned_addr learned my addr 172.21.15.94:0/980602244 (peer_addr_for_me v1:172.21.15.94:0/0) 2024-03-12T17:18:29.707 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.709+0000 7fec89400640 1 --2- 172.21.15.94:0/980602244 >> v2:172.21.15.17:3300/0 conn(0x7fec840afe20 0x7fec840cf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:29.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.710+0000 7fec83e00640 1 -- 172.21.15.94:0/980602244 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2949954 0 0) 0x7fec8415d7a0 con 0x7fec840992c0 2024-03-12T17:18:29.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.710+0000 7fec83e00640 1 -- 172.21.15.94:0/980602244 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec74003520 con 0x7fec840992c0 2024-03-12T17:18:29.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.710+0000 7fec83e00640 1 -- 172.21.15.94:0/980602244 <== mon.1 v1:172.21.15.94:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4148668834 0 0) 0x7fec74003520 con 0x7fec840992c0 2024-03-12T17:18:29.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.710+0000 7fec83e00640 1 -- 172.21.15.94:0/980602244 >> v2:172.21.15.17:3300/0 conn(0x7fec840afe20 msgr2=0x7fec840cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:29.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.710+0000 7fec83e00640 1 --2- 172.21.15.94:0/980602244 >> v2:172.21.15.17:3300/0 conn(0x7fec840afe20 0x7fec840cf820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:29.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.710+0000 7fec83e00640 1 -- 172.21.15.94:0/980602244 >> v1:172.21.15.17:6789/0 conn(0x7fec8415ced0 legacy=0x7fec84098bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:29.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.710+0000 7fec83e00640 1 -- 172.21.15.94:0/980602244 --> v1:172.21.15.94:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec8415da80 con 0x7fec840992c0 2024-03-12T17:18:29.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.710+0000 7fec83e00640 1 -- 172.21.15.94:0/980602244 <== mon.1 v1:172.21.15.94:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7fec64001670 con 0x7fec840992c0 2024-03-12T17:18:29.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.710+0000 7fec83e00640 1 -- 172.21.15.94:0/980602244 >> v1:172.21.15.94:6789/0 conn(0x7fec840992c0 legacy=0x7fec840cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:29.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.710+0000 7fec83e00640 1 --2- 172.21.15.94:0/980602244 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec740039c0 0x7fec74003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:29.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.710+0000 7fec83e00640 1 --2- 172.21.15.94:0/980602244 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec740047c0 0x7fec74004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:29.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.710+0000 7fec83e00640 1 --2- 172.21.15.94:0/980602244 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fec74005180 0x7fec7400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:29.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.710+0000 7fec83e00640 1 -- 172.21.15.94:0/980602244 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8415e3b0 con 0x7fec740047c0 2024-03-12T17:18:29.708 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.710+0000 7fec83e00640 1 -- 172.21.15.94:0/980602244 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7400c080 con 0x7fec740039c0 2024-03-12T17:18:29.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.710+0000 7fec83e00640 1 -- 172.21.15.94:0/980602244 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec7400c240 con 0x7fec74005180 2024-03-12T17:18:29.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.710+0000 7fec88a00640 1 --2- 172.21.15.94:0/980602244 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec740039c0 0x7fec74003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:29.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.710+0000 7fec89400640 1 --2- 172.21.15.94:0/980602244 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fec74005180 0x7fec7400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:29.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.711+0000 7fec7be00640 1 --2- 172.21.15.94:0/980602244 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec740047c0 0x7fec74004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:29.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.711+0000 7fec88a00640 1 -- 172.21.15.94:0/980602244 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fec74005180 msgr2=0x7fec7400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:29.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.711+0000 7fec88a00640 1 --2- 172.21.15.94:0/980602244 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fec74005180 0x7fec7400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:29.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.711+0000 7fec88a00640 1 -- 172.21.15.94:0/980602244 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec740047c0 msgr2=0x7fec74004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:29.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.711+0000 7fec88a00640 1 --2- 172.21.15.94:0/980602244 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec740047c0 0x7fec74004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:29.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.711+0000 7fec88a00640 1 -- 172.21.15.94:0/980602244 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec74003520 con 0x7fec740039c0 2024-03-12T17:18:29.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.711+0000 7fec89400640 1 -- 172.21.15.94:0/980602244 reap_dead start 2024-03-12T17:18:29.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.712+0000 7fec88a00640 1 --2- 172.21.15.94:0/980602244 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec740039c0 0x7fec74003de0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fec6c001750 tx=0x7fec740057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a63c88b3077b78c server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:29.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.712+0000 7fec83e00640 1 -- 172.21.15.94:0/980602244 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6c0052d0 con 0x7fec740039c0 2024-03-12T17:18:29.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.712+0000 7fec83e00640 1 -- 172.21.15.94:0/980602244 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6c02e050 con 0x7fec740039c0 2024-03-12T17:18:29.709 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.712+0000 7fec83e00640 1 -- 172.21.15.94:0/980602244 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6c003830 con 0x7fec740039c0 2024-03-12T17:18:29.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.713+0000 7fec8b400640 1 -- 172.21.15.94:0/980602244 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec740039c0 msgr2=0x7fec74003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:29.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.713+0000 7fec8b400640 1 --2- 172.21.15.94:0/980602244 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec740039c0 0x7fec74003de0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fec6c001750 tx=0x7fec740057f0 comp rx=0 tx=0).stop 2024-03-12T17:18:29.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.713+0000 7fec8b400640 1 -- 172.21.15.94:0/980602244 shutdown_connections 2024-03-12T17:18:29.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.713+0000 7fec8b400640 1 --2- 172.21.15.94:0/980602244 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec740039c0 0x7fec74003de0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:29.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.713+0000 7fec8b400640 1 -- 172.21.15.94:0/980602244 >> 172.21.15.94:0/980602244 conn(0x7fec840b2460 msgr2=0x7fec840b2870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:29.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.713+0000 7fec8b400640 1 -- 172.21.15.94:0/980602244 shutdown_connections 2024-03-12T17:18:29.710 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.713+0000 7fec8b400640 1 -- 172.21.15.94:0/980602244 wait complete. 2024-03-12T17:18:29.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.715+0000 7fec8b400640 1 Processor -- start 2024-03-12T17:18:29.712 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.715+0000 7fec8b400640 1 -- start start 2024-03-12T17:18:29.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.716+0000 7fec8b400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fec740039c0 0x7fec84158a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:29.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.716+0000 7fec8b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec84158f90 0x7fec840b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:29.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.716+0000 7fec8b400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec840b5110 0x7fec840c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:29.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.716+0000 7fec8b400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec840b3b30 con 0x7fec84158f90 2024-03-12T17:18:29.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.716+0000 7fec8b400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec840b3e10 con 0x7fec840b5110 2024-03-12T17:18:29.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.716+0000 7fec8b400640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec840b40f0 con 0x7fec740039c0 2024-03-12T17:18:29.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.716+0000 7fec88a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fec740039c0 0x7fec84158a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:29.713 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.716+0000 7fec89400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec840b5110 0x7fec840c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:29.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.716+0000 7fec88a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fec740039c0 0x7fec84158a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.94:32770/0 (socket says 172.21.15.94:32770) 2024-03-12T17:18:29.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.716+0000 7fec88a00640 1 -- 172.21.15.94:0/4223540630 learned_addr learned my addr 172.21.15.94:0/4223540630 (peer_addr_for_me v2:172.21.15.94:0/0) 2024-03-12T17:18:29.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.716+0000 7fec7be00640 1 --2- 172.21.15.94:0/4223540630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec84158f90 0x7fec840b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:29.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.716+0000 7fec89400640 1 -- 172.21.15.94:0/4223540630 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fec740039c0 msgr2=0x7fec84158a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:29.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.716+0000 7fec89400640 1 --2- 172.21.15.94:0/4223540630 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fec740039c0 0x7fec84158a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:29.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.716+0000 7fec89400640 1 -- 172.21.15.94:0/4223540630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec84158f90 msgr2=0x7fec840b4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:29.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.716+0000 7fec89400640 1 --2- 172.21.15.94:0/4223540630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec84158f90 0x7fec840b4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:29.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.716+0000 7fec89400640 1 -- 172.21.15.94:0/4223540630 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec840b43d0 con 0x7fec840b5110 2024-03-12T17:18:29.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.716+0000 7fec7be00640 1 --2- 172.21.15.94:0/4223540630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec84158f90 0x7fec840b4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:18:29.714 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.717+0000 7fec89400640 1 --2- 172.21.15.94:0/4223540630 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec840b5110 0x7fec840c7a40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fec84071a80 tx=0x7fec7c00f580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:29.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.717+0000 7fec81600640 1 -- 172.21.15.94:0/4223540630 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7c00e040 con 0x7fec840b5110 2024-03-12T17:18:29.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.717+0000 7fec81600640 1 -- 172.21.15.94:0/4223540630 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7c00f040 con 0x7fec840b5110 2024-03-12T17:18:29.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.717+0000 7fec81600640 1 -- 172.21.15.94:0/4223540630 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7c015430 con 0x7fec840b5110 2024-03-12T17:18:29.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.717+0000 7fec8b400640 1 -- 172.21.15.94:0/4223540630 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec840b46b0 con 0x7fec840b5110 2024-03-12T17:18:29.715 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.717+0000 7fec8b400640 1 -- 172.21.15.94:0/4223540630 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec841545b0 con 0x7fec840b5110 2024-03-12T17:18:29.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.717+0000 7fec81600640 1 -- 172.21.15.94:0/4223540630 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fec7c015890 con 0x7fec840b5110 2024-03-12T17:18:29.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.717+0000 7fec81600640 1 -- 172.21.15.94:0/4223540630 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fec7c021410 con 0x7fec840b5110 2024-03-12T17:18:29.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.718+0000 7fec8b400640 1 -- 172.21.15.94:0/4223540630 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec84066930 con 0x7fec840b5110 2024-03-12T17:18:29.716 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.720+0000 7fec81600640 1 -- 172.21.15.94:0/4223540630 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7fec7c015b40 con 0x7fec840b5110 2024-03-12T17:18:29.726 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-03-12T17:18:29.731+0000 7f440d20e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-12T17:18:29.793 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.798+0000 7fec8b400640 1 -- 172.21.15.94:0/4223540630 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd new", "uuid": "58a7945a-f2c4-4783-8d9c-08b44b54281f", "id": 7} v 0) v1 -- 0x7fec841547a0 con 0x7fec840b5110 2024-03-12T17:18:29.799 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.804+0000 7fec81600640 1 -- 172.21.15.94:0/4223540630 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "58a7945a-f2c4-4783-8d9c-08b44b54281f", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fec7c015db0 con 0x7fec840b5110 2024-03-12T17:18:29.799 INFO:teuthology.orchestra.run.smithi094.stdout:7 2024-03-12T17:18:29.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.806+0000 7fec8b400640 1 -- 172.21.15.94:0/4223540630 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec840b5110 msgr2=0x7fec840c7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:29.800 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.806+0000 7fec8b400640 1 --2- 172.21.15.94:0/4223540630 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec840b5110 0x7fec840c7a40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fec84071a80 tx=0x7fec7c00f580 comp rx=0 tx=0).stop 2024-03-12T17:18:29.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.806+0000 7fec8b400640 1 -- 172.21.15.94:0/4223540630 shutdown_connections 2024-03-12T17:18:29.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.806+0000 7fec8b400640 1 --2- 172.21.15.94:0/4223540630 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fec840b5110 0x7fec840c7a40 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:29.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.806+0000 7fec8b400640 1 --2- 172.21.15.94:0/4223540630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fec84158f90 0x7fec840b4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:29.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.806+0000 7fec8b400640 1 --2- 172.21.15.94:0/4223540630 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fec740039c0 0x7fec84158a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:29.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.806+0000 7fec8b400640 1 -- 172.21.15.94:0/4223540630 >> 172.21.15.94:0/4223540630 conn(0x7fec840b2460 msgr2=0x7fec840cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:29.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.806+0000 7fec8b400640 1 -- 172.21.15.94:0/4223540630 shutdown_connections 2024-03-12T17:18:29.801 INFO:teuthology.orchestra.run.smithi094.stderr:2024-03-12T17:18:29.806+0000 7fec8b400640 1 -- 172.21.15.94:0/4223540630 wait complete. 2024-03-12T17:18:29.816 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-12T17:18:29.816 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-03-12T17:18:29.824 INFO:tasks.ceph.osd.0:Started 2024-03-12T17:18:29.824 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-12T17:18:29.824 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-03-12T17:18:29.825 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-12T17:18:29.831+0000 7f7d81eda040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-12T17:18:29.832 INFO:tasks.ceph.osd.1:Started 2024-03-12T17:18:29.832 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-12T17:18:29.832 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-03-12T17:18:29.837 INFO:tasks.ceph.osd.2:Started 2024-03-12T17:18:29.837 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-12T17:18:29.838 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-03-12T17:18:29.843 INFO:tasks.ceph.osd.3:Started 2024-03-12T17:18:29.843 INFO:tasks.ceph.osd.4:Restarting daemon 2024-03-12T17:18:29.843 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-03-12T17:18:29.849 INFO:tasks.ceph.osd.4:Started 2024-03-12T17:18:29.849 INFO:tasks.ceph.osd.5:Restarting daemon 2024-03-12T17:18:29.849 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-03-12T17:18:29.854 INFO:tasks.ceph.osd.5:Started 2024-03-12T17:18:29.854 INFO:tasks.ceph.osd.6:Restarting daemon 2024-03-12T17:18:29.854 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-03-12T17:18:29.859 INFO:tasks.ceph.osd.6:Started 2024-03-12T17:18:29.859 INFO:tasks.ceph.osd.7:Restarting daemon 2024-03-12T17:18:29.859 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-03-12T17:18:29.865 INFO:tasks.ceph.osd.7:Started 2024-03-12T17:18:29.865 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T17:18:29.905 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-03-12T17:18:29.910+0000 7f440d20e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-12T17:18:30.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.102+0000 7f525a000640 1 Processor -- start 2024-03-12T17:18:30.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.102+0000 7f525a000640 1 -- start start 2024-03-12T17:18:30.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.103+0000 7f525a000640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f52540b5b50 0x7f52540b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:30.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.103+0000 7f525a000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f52540cd840 0x7f52540cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:30.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.103+0000 7f525a000640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52540d14e0 con 0x7f52540d2fa0 2024-03-12T17:18:30.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.103+0000 7f525a000640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52540b59e0 con 0x7f52540b5b50 2024-03-12T17:18:30.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.103+0000 7f525a000640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52540b85b0 con 0x7f52540cd840 2024-03-12T17:18:30.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.104+0000 7f5253400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f52540d2fa0 0x7f52540d3380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34042/0 (socket says 172.21.15.17:34042) 2024-03-12T17:18:30.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.104+0000 7f5253400640 1 -- 172.21.15.17:0/3883374527 learned_addr learned my addr 172.21.15.17:0/3883374527 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:18:30.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.104+0000 7f5253e00640 1 --2- 172.21.15.17:0/3883374527 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f52540cd840 0x7f52540cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:30.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.104+0000 7f524be00640 1 --2- 172.21.15.17:0/3883374527 >> v2:172.21.15.94:3300/0 conn(0x7f52540b5b50 0x7f52540b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:30.099 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-03-12T17:18:30.104+0000 7f440d20e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-12T17:18:30.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.104+0000 7f524be00640 1 -- 172.21.15.17:0/3883374527 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f52540cd840 msgr2=0x7f52540cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:30.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.104+0000 7f524be00640 1 --2- 172.21.15.17:0/3883374527 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f52540cd840 0x7f52540cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:30.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.104+0000 7f524be00640 1 -- 172.21.15.17:0/3883374527 >> v1:172.21.15.17:6789/0 conn(0x7f52540d2fa0 legacy=0x7f52540d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:30.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.104+0000 7f5252a00640 1 -- 172.21.15.17:0/3883374527 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2105053037 0 0) 0x7f52540d14e0 con 0x7f52540d2fa0 2024-03-12T17:18:30.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.104+0000 7f524be00640 1 -- 172.21.15.17:0/3883374527 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52540b8890 con 0x7f52540b5b50 2024-03-12T17:18:30.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.105+0000 7f524be00640 1 --2- 172.21.15.17:0/3883374527 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f52540b5b50 0x7f52540b5f70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f523c0097a0 tx=0x7f523c02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f70cff32105c2a00 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:30.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.106+0000 7f5252a00640 1 -- 172.21.15.17:0/3883374527 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c02d040 con 0x7f52540b5b50 2024-03-12T17:18:30.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.106+0000 7f5252a00640 1 -- 172.21.15.17:0/3883374527 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523c031810 con 0x7f52540b5b50 2024-03-12T17:18:30.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.106+0000 7f5252a00640 1 -- 172.21.15.17:0/3883374527 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523c031ba0 con 0x7f52540b5b50 2024-03-12T17:18:30.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.106+0000 7f525a000640 1 -- 172.21.15.17:0/3883374527 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f52540b5b50 msgr2=0x7f52540b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:30.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.106+0000 7f525a000640 1 --2- 172.21.15.17:0/3883374527 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f52540b5b50 0x7f52540b5f70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f523c0097a0 tx=0x7f523c02b8b0 comp rx=0 tx=0).stop 2024-03-12T17:18:30.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.106+0000 7f525a000640 1 -- 172.21.15.17:0/3883374527 shutdown_connections 2024-03-12T17:18:30.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.106+0000 7f525a000640 1 --2- 172.21.15.17:0/3883374527 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f52540cd840 0x7f52540cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:30.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.106+0000 7f525a000640 1 --2- 172.21.15.17:0/3883374527 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f52540b5b50 0x7f52540b5f70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:30.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.106+0000 7f525a000640 1 -- 172.21.15.17:0/3883374527 >> 172.21.15.17:0/3883374527 conn(0x7f5254065df0 msgr2=0x7f5254066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:30.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.106+0000 7f525a000640 1 -- 172.21.15.17:0/3883374527 shutdown_connections 2024-03-12T17:18:30.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.106+0000 7f525a000640 1 -- 172.21.15.17:0/3883374527 wait complete. 2024-03-12T17:18:30.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.108+0000 7f525a000640 1 Processor -- start 2024-03-12T17:18:30.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.108+0000 7f525a000640 1 -- start start 2024-03-12T17:18:30.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.109+0000 7f525a000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52540b5b50 0x7f5254150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:30.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.109+0000 7f525a000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f52540cd840 0x7f525415e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:30.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.109+0000 7f525a000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f52540d2fa0 0x7f525415edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:30.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.109+0000 7f525a000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525415f7c0 con 0x7f52540b5b50 2024-03-12T17:18:30.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.109+0000 7f525a000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52540ca800 con 0x7f52540d2fa0 2024-03-12T17:18:30.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.109+0000 7f525a000640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52540caae0 con 0x7f52540cd840 2024-03-12T17:18:30.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.109+0000 7f5253400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52540b5b50 0x7f5254150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:30.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.109+0000 7f5253400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52540b5b50 0x7f5254150ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48168/0 (socket says 172.21.15.17:48168) 2024-03-12T17:18:30.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.109+0000 7f5253400640 1 -- 172.21.15.17:0/3706856875 learned_addr learned my addr 172.21.15.17:0/3706856875 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:30.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.109+0000 7f524be00640 1 --2- 172.21.15.17:0/3706856875 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f52540cd840 0x7f525415e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:30.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.110+0000 7f5253e00640 1 --2- 172.21.15.17:0/3706856875 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f52540d2fa0 0x7f525415edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:30.105 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.110+0000 7f5253400640 1 -- 172.21.15.17:0/3706856875 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f52540cd840 msgr2=0x7f525415e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:30.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.110+0000 7f5253400640 1 --2- 172.21.15.17:0/3706856875 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f52540cd840 0x7f525415e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:30.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.110+0000 7f5253400640 1 -- 172.21.15.17:0/3706856875 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f52540d2fa0 msgr2=0x7f525415edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:30.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.110+0000 7f5253400640 1 --2- 172.21.15.17:0/3706856875 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f52540d2fa0 0x7f525415edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:30.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.110+0000 7f5253400640 1 -- 172.21.15.17:0/3706856875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523c009400 con 0x7f52540b5b50 2024-03-12T17:18:30.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.110+0000 7f5253400640 1 --2- 172.21.15.17:0/3706856875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52540b5b50 0x7f5254150ff0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f524400c430 tx=0x7f524400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:30.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.110+0000 7f524b400640 1 -- 172.21.15.17:0/3706856875 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52440074e0 con 0x7f52540b5b50 2024-03-12T17:18:30.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.110+0000 7f524b400640 1 -- 172.21.15.17:0/3706856875 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5244007660 con 0x7f52540b5b50 2024-03-12T17:18:30.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.110+0000 7f524b400640 1 -- 172.21.15.17:0/3706856875 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5244004a20 con 0x7f52540b5b50 2024-03-12T17:18:30.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.110+0000 7f525a000640 1 -- 172.21.15.17:0/3706856875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52540cadc0 con 0x7f52540b5b50 2024-03-12T17:18:30.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.111+0000 7f525a000640 1 -- 172.21.15.17:0/3706856875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52540cb380 con 0x7f52540b5b50 2024-03-12T17:18:30.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.111+0000 7f524b400640 1 -- 172.21.15.17:0/3706856875 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f524401d3f0 con 0x7f52540b5b50 2024-03-12T17:18:30.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.111+0000 7f524b400640 1 -- 172.21.15.17:0/3706856875 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f5244013b70 con 0x7f52540b5b50 2024-03-12T17:18:30.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.112+0000 7f525a000640 1 -- 172.21.15.17:0/3706856875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52540c8880 con 0x7f52540b5b50 2024-03-12T17:18:30.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.117+0000 7f524b400640 1 -- 172.21.15.17:0/3706856875 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f5244013d80 con 0x7f52540b5b50 2024-03-12T17:18:30.153 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-03-12T17:18:30.158+0000 7f440d20e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-12T17:18:30.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.193+0000 7f525a000640 1 -- 172.21.15.17:0/3706856875 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52540736c0 con 0x7f52540b5b50 2024-03-12T17:18:30.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.194+0000 7f524b400640 1 -- 172.21.15.17:0/3706856875 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f5244013410 con 0x7f52540b5b50 2024-03-12T17:18:30.188 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:18:30.188 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":10,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:18:29.801638+0000","last_up_change":"0.000000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:18:30.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.195+0000 7f525a000640 1 -- 172.21.15.17:0/3706856875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52540b5b50 msgr2=0x7f5254150ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:30.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.195+0000 7f525a000640 1 --2- 172.21.15.17:0/3706856875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52540b5b50 0x7f5254150ff0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f524400c430 tx=0x7f524400c8f0 comp rx=0 tx=0).stop 2024-03-12T17:18:30.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.195+0000 7f525a000640 1 -- 172.21.15.17:0/3706856875 shutdown_connections 2024-03-12T17:18:30.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.195+0000 7f525a000640 1 --2- 172.21.15.17:0/3706856875 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f52540d2fa0 0x7f525415edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:30.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.195+0000 7f525a000640 1 --2- 172.21.15.17:0/3706856875 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f52540cd840 0x7f525415e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:30.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.195+0000 7f525a000640 1 --2- 172.21.15.17:0/3706856875 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52540b5b50 0x7f5254150ff0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:30.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.195+0000 7f525a000640 1 -- 172.21.15.17:0/3706856875 >> 172.21.15.17:0/3706856875 conn(0x7f5254065df0 msgr2=0x7f52540d3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:30.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.195+0000 7f525a000640 1 -- 172.21.15.17:0/3706856875 shutdown_connections 2024-03-12T17:18:30.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:30.195+0000 7f525a000640 1 -- 172.21.15.17:0/3706856875 wait complete. 2024-03-12T17:18:30.206 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-12T17:18:30.206 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-12T17:18:30.277 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-03-12T17:18:30.282+0000 7f440d20e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-12T17:18:30.390 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-03-12T17:18:30.395+0000 7f440d20e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-12T17:18:30.536 INFO:tasks.ceph.osd.7.smithi094.stderr:2024-03-12T17:18:30.541+0000 7f8f4cea3500 -1 Falling back to public interface 2024-03-12T17:18:30.539 INFO:tasks.ceph.osd.4.smithi094.stderr:2024-03-12T17:18:30.545+0000 7f7b2be0e500 -1 Falling back to public interface 2024-03-12T17:18:30.540 INFO:tasks.ceph.osd.5.smithi094.stderr:2024-03-12T17:18:30.546+0000 7f81ac216500 -1 Falling back to public interface 2024-03-12T17:18:30.541 INFO:tasks.ceph.osd.5.smithi094.stderr:2024-03-12T17:18:30.547+0000 7f81aa800640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6809/0: (98) Address already in use 2024-03-12T17:18:30.544 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-03-12T17:18:30.550+0000 7f4073186500 -1 Falling back to public interface 2024-03-12T17:18:30.561 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-03-12T17:18:30.567+0000 7fd0b2ea1500 -1 Falling back to public interface 2024-03-12T17:18:30.563 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-03-12T17:18:30.569+0000 7f4a8a411500 -1 Falling back to public interface 2024-03-12T17:18:30.568 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-03-12T17:18:30.574+0000 7f794e425500 -1 Falling back to public interface 2024-03-12T17:18:30.571 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-03-12T17:18:30.577+0000 7f440d20e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-12T17:18:30.573 INFO:tasks.ceph.osd.6.smithi094.stderr:2024-03-12T17:18:30.579+0000 7f99fa372500 -1 Falling back to public interface 2024-03-12T17:18:30.623 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-03-12T17:18:30.628+0000 7f440d20e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-12T17:18:30.792 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-03-12T17:18:30.797+0000 7f440d20e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-12T17:18:30.927 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-12T17:18:30.932+0000 7f7d81eda040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-12T17:18:31.012 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-12T17:18:31.163 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.169+0000 7ffb3ae00640 1 Processor -- start 2024-03-12T17:18:31.164 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.169+0000 7ffb3ae00640 1 -- start start 2024-03-12T17:18:31.165 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.170+0000 7ffb3ae00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ffb3415cc60 0x7ffb340b83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:31.165 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.170+0000 7ffb3ae00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffb340b88f0 0x7ffb340b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:31.165 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.170+0000 7ffb3ae00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb340b6ae0 con 0x7ffb340b4b30 2024-03-12T17:18:31.165 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.170+0000 7ffb3ae00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb340b4fc0 con 0x7ffb3415cc60 2024-03-12T17:18:31.165 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.170+0000 7ffb3ae00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb340b7f80 con 0x7ffb340b88f0 2024-03-12T17:18:31.165 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.171+0000 7ffb2be00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffb340b88f0 0x7ffb340b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:31.165 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.171+0000 7ffb33e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ffb3415cc60 0x7ffb340b83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:31.166 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.171+0000 7ffb2be00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffb340b88f0 0x7ffb340b45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.17:46178/0 (socket says 172.21.15.17:46178) 2024-03-12T17:18:31.166 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.171+0000 7ffb2be00640 1 -- 172.21.15.17:0/542854042 learned_addr learned my addr 172.21.15.17:0/542854042 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:31.166 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.171+0000 7ffb2be00640 1 -- 172.21.15.17:0/542854042 >> v2:172.21.15.94:3300/0 conn(0x7ffb3415cc60 msgr2=0x7ffb340b83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:31.166 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.171+0000 7ffb2be00640 1 --2- 172.21.15.17:0/542854042 >> v2:172.21.15.94:3300/0 conn(0x7ffb3415cc60 0x7ffb340b83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:31.166 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.171+0000 7ffb2be00640 1 -- 172.21.15.17:0/542854042 >> v1:172.21.15.94:6789/0 conn(0x7ffb340b4b30 legacy=0x7ffb34160810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:31.166 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.171+0000 7ffb2be00640 1 -- 172.21.15.17:0/542854042 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb340b5ed0 con 0x7ffb340b88f0 2024-03-12T17:18:31.167 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.172+0000 7ffb2be00640 1 --2- 172.21.15.17:0/542854042 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffb340b88f0 0x7ffb340b45f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c009870 tx=0x7ffb1c02ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e310d595c02cf8c3 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:31.168 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.173+0000 7ffb33400640 1 -- 172.21.15.17:0/542854042 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c02f840 con 0x7ffb340b88f0 2024-03-12T17:18:31.168 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.173+0000 7ffb33400640 1 -- 172.21.15.17:0/542854042 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb1c02f9a0 con 0x7ffb340b88f0 2024-03-12T17:18:31.168 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.173+0000 7ffb33400640 1 -- 172.21.15.17:0/542854042 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb1c02fd30 con 0x7ffb340b88f0 2024-03-12T17:18:31.168 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.173+0000 7ffb3ae00640 1 -- 172.21.15.17:0/542854042 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffb340b88f0 msgr2=0x7ffb340b45f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:31.168 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.173+0000 7ffb3ae00640 1 --2- 172.21.15.17:0/542854042 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffb340b88f0 0x7ffb340b45f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ffb1c009870 tx=0x7ffb1c02ba20 comp rx=0 tx=0).stop 2024-03-12T17:18:31.168 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.173+0000 7ffb3ae00640 1 -- 172.21.15.17:0/542854042 shutdown_connections 2024-03-12T17:18:31.168 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.173+0000 7ffb3ae00640 1 --2- 172.21.15.17:0/542854042 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffb340b88f0 0x7ffb340b45f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:31.169 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.173+0000 7ffb3ae00640 1 --2- 172.21.15.17:0/542854042 >> v2:172.21.15.94:3300/0 conn(0x7ffb3415cc60 0x7ffb340b83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:31.169 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.173+0000 7ffb3ae00640 1 -- 172.21.15.17:0/542854042 >> 172.21.15.17:0/542854042 conn(0x7ffb34071800 msgr2=0x7ffb34071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:31.169 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.173+0000 7ffb3ae00640 1 -- 172.21.15.17:0/542854042 shutdown_connections 2024-03-12T17:18:31.169 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.174+0000 7ffb3ae00640 1 -- 172.21.15.17:0/542854042 wait complete. 2024-03-12T17:18:31.169 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.175+0000 7ffb3ae00640 1 Processor -- start 2024-03-12T17:18:31.169 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.175+0000 7ffb3ae00640 1 -- start start 2024-03-12T17:18:31.172 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.176+0000 7ffb3ae00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb340b4b30 0x7ffb340ca8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:31.172 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.176+0000 7ffb3ae00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffb3415cc60 0x7ffb3415fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:31.172 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.176+0000 7ffb3ae00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb340c70f0 0x7ffb3406b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:31.173 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.176+0000 7ffb3ae00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb340c7e90 con 0x7ffb340b4b30 2024-03-12T17:18:31.173 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.176+0000 7ffb3ae00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb340caec0 con 0x7ffb340c70f0 2024-03-12T17:18:31.173 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.176+0000 7ffb3ae00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb340cb440 con 0x7ffb3415cc60 2024-03-12T17:18:31.173 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.177+0000 7ffb33e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb340b4b30 0x7ffb340ca8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:31.173 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.177+0000 7ffb33e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb340b4b30 0x7ffb340ca8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48176/0 (socket says 172.21.15.17:48176) 2024-03-12T17:18:31.173 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.177+0000 7ffb33e00640 1 -- 172.21.15.17:0/3290502206 learned_addr learned my addr 172.21.15.17:0/3290502206 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:31.173 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.177+0000 7ffb2be00640 1 --2- 172.21.15.17:0/3290502206 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffb3415cc60 0x7ffb3415fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:31.173 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.177+0000 7ffb38e00640 1 --2- 172.21.15.17:0/3290502206 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb340c70f0 0x7ffb3406b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:31.173 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.177+0000 7ffb33e00640 1 -- 172.21.15.17:0/3290502206 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffb3415cc60 msgr2=0x7ffb3415fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:31.173 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.177+0000 7ffb33e00640 1 --2- 172.21.15.17:0/3290502206 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffb3415cc60 0x7ffb3415fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:31.173 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.177+0000 7ffb33e00640 1 -- 172.21.15.17:0/3290502206 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb340c70f0 msgr2=0x7ffb3406b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:31.173 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.177+0000 7ffb33e00640 1 --2- 172.21.15.17:0/3290502206 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb340c70f0 0x7ffb3406b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:31.173 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.177+0000 7ffb33e00640 1 -- 172.21.15.17:0/3290502206 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb1c0094d0 con 0x7ffb340b4b30 2024-03-12T17:18:31.173 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.177+0000 7ffb33e00640 1 --2- 172.21.15.17:0/3290502206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb340b4b30 0x7ffb340ca8a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ffb2400e870 tx=0x7ffb2400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:31.174 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.178+0000 7ffb30c00640 1 -- 172.21.15.17:0/3290502206 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb240094f0 con 0x7ffb340b4b30 2024-03-12T17:18:31.174 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.178+0000 7ffb30c00640 1 -- 172.21.15.17:0/3290502206 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb2400c940 con 0x7ffb340b4b30 2024-03-12T17:18:31.174 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.178+0000 7ffb30c00640 1 -- 172.21.15.17:0/3290502206 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb2400ccf0 con 0x7ffb340b4b30 2024-03-12T17:18:31.174 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.178+0000 7ffb3ae00640 1 -- 172.21.15.17:0/3290502206 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb3414da90 con 0x7ffb340b4b30 2024-03-12T17:18:31.174 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.178+0000 7ffb3ae00640 1 -- 172.21.15.17:0/3290502206 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb340c7bb0 con 0x7ffb340b4b30 2024-03-12T17:18:31.174 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.178+0000 7ffb30c00640 1 -- 172.21.15.17:0/3290502206 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ffb24005c90 con 0x7ffb340b4b30 2024-03-12T17:18:31.174 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.178+0000 7ffb30c00640 1 -- 172.21.15.17:0/3290502206 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7ffb240067f0 con 0x7ffb340b4b30 2024-03-12T17:18:31.174 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.179+0000 7ffb3ae00640 1 -- 172.21.15.17:0/3290502206 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb3404e0a0 con 0x7ffb340b4b30 2024-03-12T17:18:31.175 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.182+0000 7ffb30c00640 1 -- 172.21.15.17:0/3290502206 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7ffb24021060 con 0x7ffb340b4b30 2024-03-12T17:18:31.244 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.247+0000 7ffb3ae00640 1 -- 172.21.15.17:0/3290502206 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffb340b2b30 con 0x7ffb340b4b30 2024-03-12T17:18:31.244 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.248+0000 7ffb30c00640 1 -- 172.21.15.17:0/3290502206 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7ffb24017070 con 0x7ffb340b4b30 2024-03-12T17:18:31.244 INFO:teuthology.misc.health.smithi017.stdout: 2024-03-12T17:18:31.244 INFO:teuthology.misc.health.smithi017.stdout:{"epoch":10,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:18:29.801638+0000","last_up_change":"0.000000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:18:31.245 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.249+0000 7ffb3ae00640 1 -- 172.21.15.17:0/3290502206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb340b4b30 msgr2=0x7ffb340ca8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:31.245 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.249+0000 7ffb3ae00640 1 --2- 172.21.15.17:0/3290502206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb340b4b30 0x7ffb340ca8a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ffb2400e870 tx=0x7ffb2400ed30 comp rx=0 tx=0).stop 2024-03-12T17:18:31.245 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.249+0000 7ffb3ae00640 1 -- 172.21.15.17:0/3290502206 shutdown_connections 2024-03-12T17:18:31.245 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.249+0000 7ffb3ae00640 1 --2- 172.21.15.17:0/3290502206 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb340c70f0 0x7ffb3406b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:31.245 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.249+0000 7ffb3ae00640 1 --2- 172.21.15.17:0/3290502206 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffb3415cc60 0x7ffb3415fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:31.246 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.249+0000 7ffb3ae00640 1 --2- 172.21.15.17:0/3290502206 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb340b4b30 0x7ffb340ca8a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:31.246 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.249+0000 7ffb3ae00640 1 -- 172.21.15.17:0/3290502206 >> 172.21.15.17:0/3290502206 conn(0x7ffb34071800 msgr2=0x7ffb3415c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:31.246 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.249+0000 7ffb3ae00640 1 -- 172.21.15.17:0/3290502206 shutdown_connections 2024-03-12T17:18:31.246 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:31.250+0000 7ffb3ae00640 1 -- 172.21.15.17:0/3290502206 wait complete. 2024-03-12T17:18:31.250 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-12T17:18:31.256+0000 7f7d81eda040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-12T17:18:31.256 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-12T17:18:31.313 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-12T17:18:31.319+0000 7f7d81eda040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-12T17:18:31.451 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-12T17:18:31.457+0000 7f7d81eda040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-12T17:18:31.776 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-03-12T17:18:31.781+0000 7f440d20e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-12T17:18:32.079 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-03-12T17:18:32.084+0000 7f440d20e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-12T17:18:32.138 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-03-12T17:18:32.143+0000 7f440d20e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-12T17:18:32.269 INFO:tasks.ceph.mgr.x.smithi094.stderr:2024-03-12T17:18:32.274+0000 7f440d20e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-12T17:18:32.488 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-12T17:18:32.494+0000 7f7d23200640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-12T17:18:32.491 INFO:tasks.ceph.mgr.y.smithi017.stderr:2024-03-12T17:18:32.497+0000 7f7d23200640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-12T17:18:34.122 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-03-12T17:18:34.127+0000 7f794e425500 -1 osd.3 0 log_to_monitors true 2024-03-12T17:18:34.124 INFO:tasks.ceph.osd.6.smithi094.stderr:2024-03-12T17:18:34.130+0000 7f99fa372500 -1 osd.6 0 log_to_monitors true 2024-03-12T17:18:34.125 INFO:tasks.ceph.osd.5.smithi094.stderr:2024-03-12T17:18:34.130+0000 7f81ac216500 -1 osd.5 0 log_to_monitors true 2024-03-12T17:18:34.131 INFO:tasks.ceph.osd.4.smithi094.stderr:2024-03-12T17:18:34.136+0000 7f7b2be0e500 -1 osd.4 0 log_to_monitors true 2024-03-12T17:18:34.131 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-03-12T17:18:34.137+0000 7f4a8a411500 -1 osd.1 0 log_to_monitors true 2024-03-12T17:18:34.306 INFO:tasks.ceph.osd.7.smithi094.stderr:2024-03-12T17:18:34.311+0000 7f8f4cea3500 -1 osd.7 0 log_to_monitors true 2024-03-12T17:18:34.308 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-03-12T17:18:34.314+0000 7f4073186500 -1 osd.0 0 log_to_monitors true 2024-03-12T17:18:34.369 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-03-12T17:18:34.375+0000 7fd0b2ea1500 -1 osd.2 0 log_to_monitors true 2024-03-12T17:18:37.133 INFO:tasks.ceph.osd.6.smithi094.stderr:2024-03-12T17:18:37.138+0000 7f99f4800640 -1 osd.6 0 waiting for initial osdmap 2024-03-12T17:18:37.140 INFO:tasks.ceph.osd.6.smithi094.stderr:2024-03-12T17:18:37.145+0000 7f99eb200640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-12T17:18:37.150 INFO:tasks.ceph.osd.4.smithi094.stderr:2024-03-12T17:18:37.155+0000 7f7b25c00640 -1 osd.4 0 waiting for initial osdmap 2024-03-12T17:18:37.159 INFO:tasks.ceph.osd.4.smithi094.stderr:2024-03-12T17:18:37.164+0000 7f7b1c600640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-12T17:18:37.172 INFO:tasks.ceph.osd.5.smithi094.stderr:2024-03-12T17:18:37.178+0000 7f81a6200640 -1 osd.5 0 waiting for initial osdmap 2024-03-12T17:18:37.182 INFO:tasks.ceph.osd.5.smithi094.stderr:2024-03-12T17:18:37.187+0000 7f819cc00640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-12T17:18:37.191 INFO:tasks.ceph.osd.7.smithi094.stderr:2024-03-12T17:18:37.197+0000 7f8f47400640 -1 osd.7 0 waiting for initial osdmap 2024-03-12T17:18:37.197 INFO:tasks.ceph.osd.7.smithi094.stderr:2024-03-12T17:18:37.203+0000 7f8f3de00640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-12T17:18:37.199 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-03-12T17:18:37.205+0000 7fd0ad400640 -1 osd.2 0 waiting for initial osdmap 2024-03-12T17:18:37.208 INFO:tasks.ceph.osd.2.smithi017.stderr:2024-03-12T17:18:37.214+0000 7fd0a3e00640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-12T17:18:37.217 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-03-12T17:18:37.223+0000 7f4a84200640 -1 osd.1 0 waiting for initial osdmap 2024-03-12T17:18:37.223 INFO:tasks.ceph.osd.1.smithi017.stderr:2024-03-12T17:18:37.229+0000 7f4a7ac00640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-12T17:18:37.241 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-03-12T17:18:37.247+0000 7f406f400640 -1 osd.0 0 waiting for initial osdmap 2024-03-12T17:18:37.247 INFO:tasks.ceph.osd.0.smithi017.stderr:2024-03-12T17:18:37.253+0000 7f4064000640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-12T17:18:37.275 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-03-12T17:18:37.281+0000 7f7948200640 -1 osd.3 0 waiting for initial osdmap 2024-03-12T17:18:37.279 INFO:tasks.ceph.osd.3.smithi017.stderr:2024-03-12T17:18:37.285+0000 7f793ec00640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-12T17:18:38.062 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-12T17:18:38.260 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.265+0000 7fb786400640 1 Processor -- start 2024-03-12T17:18:38.260 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.265+0000 7fb786400640 1 -- start start 2024-03-12T17:18:38.262 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.267+0000 7fb786400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb78015cc60 0x7fb7800b83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:38.263 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.267+0000 7fb786400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb7800b88f0 0x7fb7800b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:38.263 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.267+0000 7fb786400640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb7800b4b30 0x7fb780160810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:38.263 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.267+0000 7fb786400640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7800b4fc0 con 0x7fb78015cc60 2024-03-12T17:18:38.263 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.267+0000 7fb786400640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7800b6ae0 con 0x7fb7800b4b30 2024-03-12T17:18:38.263 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.267+0000 7fb786400640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7800b5ed0 con 0x7fb7800b88f0 2024-03-12T17:18:38.263 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.267+0000 7fb77f400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb78015cc60 0x7fb7800b83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:38.263 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.267+0000 7fb77f400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb78015cc60 0x7fb7800b83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56824/0 (socket says 172.21.15.17:56824) 2024-03-12T17:18:38.263 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.267+0000 7fb77f400640 1 -- 172.21.15.17:0/927418934 learned_addr learned my addr 172.21.15.17:0/927418934 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:38.263 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.267+0000 7fb77fe00640 1 --2- 172.21.15.17:0/927418934 >> v2:172.21.15.94:3300/0 conn(0x7fb7800b4b30 0x7fb780160810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:38.263 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.267+0000 7fb77ea00640 1 --2- 172.21.15.17:0/927418934 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb7800b88f0 0x7fb7800b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:38.263 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.267+0000 7fb77f400640 1 -- 172.21.15.17:0/927418934 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb7800b88f0 msgr2=0x7fb7800b45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:38.264 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.267+0000 7fb77f400640 1 --2- 172.21.15.17:0/927418934 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb7800b88f0 0x7fb7800b45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:38.264 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.267+0000 7fb77f400640 1 -- 172.21.15.17:0/927418934 >> v2:172.21.15.94:3300/0 conn(0x7fb7800b4b30 msgr2=0x7fb780160810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:38.264 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.267+0000 7fb77f400640 1 --2- 172.21.15.17:0/927418934 >> v2:172.21.15.94:3300/0 conn(0x7fb7800b4b30 0x7fb780160810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:38.264 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.267+0000 7fb77f400640 1 -- 172.21.15.17:0/927418934 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7800b61b0 con 0x7fb78015cc60 2024-03-12T17:18:38.264 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.269+0000 7fb77f400640 1 --2- 172.21.15.17:0/927418934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb78015cc60 0x7fb7800b83b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb7800d36f0 tx=0x7fb77002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf3272e6b56d059 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:38.265 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.269+0000 7fb77e000640 1 -- 172.21.15.17:0/927418934 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb770030860 con 0x7fb78015cc60 2024-03-12T17:18:38.265 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.269+0000 7fb77e000640 1 -- 172.21.15.17:0/927418934 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7700309c0 con 0x7fb78015cc60 2024-03-12T17:18:38.266 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.269+0000 7fb77e000640 1 -- 172.21.15.17:0/927418934 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb770030d50 con 0x7fb78015cc60 2024-03-12T17:18:38.266 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.269+0000 7fb786400640 1 -- 172.21.15.17:0/927418934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb78015cc60 msgr2=0x7fb7800b83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:38.266 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.269+0000 7fb786400640 1 --2- 172.21.15.17:0/927418934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb78015cc60 0x7fb7800b83b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb7800d36f0 tx=0x7fb77002b9a0 comp rx=0 tx=0).stop 2024-03-12T17:18:38.266 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.269+0000 7fb786400640 1 -- 172.21.15.17:0/927418934 shutdown_connections 2024-03-12T17:18:38.266 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.270+0000 7fb786400640 1 --2- 172.21.15.17:0/927418934 >> v2:172.21.15.94:3300/0 conn(0x7fb7800b4b30 0x7fb780160810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:38.266 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.270+0000 7fb786400640 1 --2- 172.21.15.17:0/927418934 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb7800b88f0 0x7fb7800b45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:38.266 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.270+0000 7fb786400640 1 --2- 172.21.15.17:0/927418934 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb78015cc60 0x7fb7800b83b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:38.266 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.270+0000 7fb786400640 1 -- 172.21.15.17:0/927418934 >> 172.21.15.17:0/927418934 conn(0x7fb780071800 msgr2=0x7fb780071c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:38.266 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.270+0000 7fb786400640 1 -- 172.21.15.17:0/927418934 shutdown_connections 2024-03-12T17:18:38.266 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.270+0000 7fb786400640 1 -- 172.21.15.17:0/927418934 wait complete. 2024-03-12T17:18:38.266 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.271+0000 7fb786400640 1 Processor -- start 2024-03-12T17:18:38.266 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.271+0000 7fb786400640 1 -- start start 2024-03-12T17:18:38.268 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.272+0000 7fb786400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb7800b4b30 0x7fb7801f7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:38.268 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.272+0000 7fb786400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7800b88f0 0x7fb7800cc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:38.268 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.272+0000 7fb786400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb78015cc60 0x7fb7800cc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:38.268 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.272+0000 7fb786400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7800cb290 con 0x7fb7800b88f0 2024-03-12T17:18:38.268 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.273+0000 7fb786400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7800cb570 con 0x7fb78015cc60 2024-03-12T17:18:38.269 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.273+0000 7fb786400640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7800cb850 con 0x7fb7800b4b30 2024-03-12T17:18:38.269 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.273+0000 7fb77ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7800b88f0 0x7fb7800cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:38.269 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.273+0000 7fb77ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7800b88f0 0x7fb7800cc330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56838/0 (socket says 172.21.15.17:56838) 2024-03-12T17:18:38.269 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.273+0000 7fb77ea00640 1 -- 172.21.15.17:0/312688666 learned_addr learned my addr 172.21.15.17:0/312688666 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:38.269 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.273+0000 7fb77fe00640 1 --2- 172.21.15.17:0/312688666 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb78015cc60 0x7fb7800cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:38.269 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.273+0000 7fb77f400640 1 --2- 172.21.15.17:0/312688666 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb7800b4b30 0x7fb7801f7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:38.269 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.273+0000 7fb77ea00640 1 -- 172.21.15.17:0/312688666 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb7800b4b30 msgr2=0x7fb7801f7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:38.269 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.273+0000 7fb77ea00640 1 --2- 172.21.15.17:0/312688666 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb7800b4b30 0x7fb7801f7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:38.269 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.273+0000 7fb77ea00640 1 -- 172.21.15.17:0/312688666 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb78015cc60 msgr2=0x7fb7800cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:38.269 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.273+0000 7fb77ea00640 1 --2- 172.21.15.17:0/312688666 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb78015cc60 0x7fb7800cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:38.269 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.273+0000 7fb77ea00640 1 -- 172.21.15.17:0/312688666 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7700094d0 con 0x7fb7800b88f0 2024-03-12T17:18:38.269 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.274+0000 7fb77ea00640 1 --2- 172.21.15.17:0/312688666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7800b88f0 0x7fb7800cc330 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb76c00d800 tx=0x7fb76c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:38.269 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.274+0000 7fb777400640 1 -- 172.21.15.17:0/312688666 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c00b6c0 con 0x7fb7800b88f0 2024-03-12T17:18:38.269 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.274+0000 7fb777400640 1 -- 172.21.15.17:0/312688666 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76c00b820 con 0x7fb7800b88f0 2024-03-12T17:18:38.270 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.274+0000 7fb777400640 1 -- 172.21.15.17:0/312688666 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c00bbb0 con 0x7fb7800b88f0 2024-03-12T17:18:38.270 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.274+0000 7fb786400640 1 -- 172.21.15.17:0/312688666 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7800cbb30 con 0x7fb7800b88f0 2024-03-12T17:18:38.270 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.274+0000 7fb786400640 1 -- 172.21.15.17:0/312688666 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb780159dc0 con 0x7fb7800b88f0 2024-03-12T17:18:38.270 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.275+0000 7fb786400640 1 -- 172.21.15.17:0/312688666 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb78004e0a0 con 0x7fb7800b88f0 2024-03-12T17:18:38.270 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.276+0000 7fb777400640 1 -- 172.21.15.17:0/312688666 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 4) v1 ==== 89081+0+0 (secure 0 0 0) 0x7fb76c00bd10 con 0x7fb7800b88f0 2024-03-12T17:18:38.271 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.277+0000 7fb777400640 1 --2- 172.21.15.17:0/312688666 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb76006ab70 0x7fb76006d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:38.271 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.278+0000 7fb777400640 1 -- 172.21.15.17:0/312688666 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fb76c089310 con 0x7fb7800b88f0 2024-03-12T17:18:38.272 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.278+0000 7fb77f400640 1 --2- 172.21.15.17:0/312688666 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb76006ab70 0x7fb76006d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:38.273 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.279+0000 7fb77f400640 1 --2- 172.21.15.17:0/312688666 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb76006ab70 0x7fb76006d030 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb770036000 tx=0x7fb77003b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:38.277 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.283+0000 7fb777400640 1 -- 172.21.15.17:0/312688666 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fb76c054aa0 con 0x7fb7800b88f0 2024-03-12T17:18:38.471 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.477+0000 7fb786400640 1 -- 172.21.15.17:0/312688666 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7800b5a80 con 0x7fb7800b88f0 2024-03-12T17:18:38.472 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.478+0000 7fb777400640 1 -- 172.21.15.17:0/312688666 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10392 (secure 0 0 0) 0x7fb76c0580c0 con 0x7fb7800b88f0 2024-03-12T17:18:38.473 INFO:teuthology.misc.health.smithi017.stdout: 2024-03-12T17:18:38.473 INFO:teuthology.misc.health.smithi017.stdout:{"epoch":13,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:18:38.144756+0000","last_up_change":"2024-03-12T17:18:38.144756+0000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":37305},{"type":"v1","addr":"172.21.15.17:6801","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":37305},{"type":"v1","addr":"172.21.15.17:6803","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":37305},{"type":"v1","addr":"172.21.15.17:6807","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":37305},{"type":"v1","addr":"172.21.15.17:6805","nonce":37305}]},"public_addr":"172.21.15.17:6801/37305","cluster_addr":"172.21.15.17:6803/37305","heartbeat_back_addr":"172.21.15.17:6807/37305","heartbeat_front_addr":"172.21.15.17:6805/37305","state":["exists","up"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":37307},{"type":"v1","addr":"172.21.15.17:6814","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":37307},{"type":"v1","addr":"172.21.15.17:6818","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":37307},{"type":"v1","addr":"172.21.15.17:6827","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":37307},{"type":"v1","addr":"172.21.15.17:6823","nonce":37307}]},"public_addr":"172.21.15.17:6814/37307","cluster_addr":"172.21.15.17:6818/37307","heartbeat_back_addr":"172.21.15.17:6827/37307","heartbeat_front_addr":"172.21.15.17:6823/37307","state":["exists","up"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":37303},{"type":"v1","addr":"172.21.15.17:6809","nonce":37303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":37303},{"type":"v1","addr":"172.21.15.17:6811","nonce":37303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":37303},{"type":"v1","addr":"172.21.15.17:6819","nonce":37303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":37303},{"type":"v1","addr":"172.21.15.17:6815","nonce":37303}]},"public_addr":"172.21.15.17:6809/37303","cluster_addr":"172.21.15.17:6811/37303","heartbeat_back_addr":"172.21.15.17:6819/37303","heartbeat_front_addr":"172.21.15.17:6815/37303","state":["exists","up"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":37308},{"type":"v1","addr":"172.21.15.17:6822","nonce":37308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":37308},{"type":"v1","addr":"172.21.15.17:6826","nonce":37308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":37308},{"type":"v1","addr":"172.21.15.17:6831","nonce":37308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":37308},{"type":"v1","addr":"172.21.15.17:6829","nonce":37308}]},"public_addr":"172.21.15.17:6822/37308","cluster_addr":"172.21.15.17:6826/37308","heartbeat_back_addr":"172.21.15.17:6831/37308","heartbeat_front_addr":"172.21.15.17:6829/37308","state":["exists","up"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":37465},{"type":"v1","addr":"172.21.15.94:6809","nonce":37465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6811","nonce":37465},{"type":"v1","addr":"172.21.15.94:6813","nonce":37465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6819","nonce":37465},{"type":"v1","addr":"172.21.15.94:6822","nonce":37465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6815","nonce":37465},{"type":"v1","addr":"172.21.15.94:6817","nonce":37465}]},"public_addr":"172.21.15.94:6809/37465","cluster_addr":"172.21.15.94:6813/37465","heartbeat_back_addr":"172.21.15.94:6822/37465","heartbeat_front_addr":"172.21.15.94:6817/37465","state":["exists","up"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":37464},{"type":"v1","addr":"172.21.15.94:6812","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":37464},{"type":"v1","addr":"172.21.15.94:6816","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":37464},{"type":"v1","addr":"172.21.15.94:6823","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":37464},{"type":"v1","addr":"172.21.15.94:6820","nonce":37464}]},"public_addr":"172.21.15.94:6812/37464","cluster_addr":"172.21.15.94:6816/37464","heartbeat_back_addr":"172.21.15.94:6823/37464","heartbeat_front_addr":"172.21.15.94:6820/37464","state":["exists","up"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":37467},{"type":"v1","addr":"172.21.15.94:6825","nonce":37467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":37467},{"type":"v1","addr":"172.21.15.94:6827","nonce":37467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":37467},{"type":"v1","addr":"172.21.15.94:6831","nonce":37467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":37467},{"type":"v1","addr":"172.21.15.94:6829","nonce":37467}]},"public_addr":"172.21.15.94:6825/37467","cluster_addr":"172.21.15.94:6827/37467","heartbeat_back_addr":"172.21.15.94:6831/37467","heartbeat_front_addr":"172.21.15.94:6829/37467","state":["exists","up"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":37466},{"type":"v1","addr":"172.21.15.94:6801","nonce":37466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":37466},{"type":"v1","addr":"172.21.15.94:6803","nonce":37466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":37466},{"type":"v1","addr":"172.21.15.94:6807","nonce":37466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":37466},{"type":"v1","addr":"172.21.15.94:6805","nonce":37466}]},"public_addr":"172.21.15.94:6801/37466","cluster_addr":"172.21.15.94:6803/37466","heartbeat_back_addr":"172.21.15.94:6807/37466","heartbeat_front_addr":"172.21.15.94:6805/37466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:18:38.475 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.480+0000 7fb786400640 1 -- 172.21.15.17:0/312688666 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb76006ab70 msgr2=0x7fb76006d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:38.475 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.480+0000 7fb786400640 1 --2- 172.21.15.17:0/312688666 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb76006ab70 0x7fb76006d030 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb770036000 tx=0x7fb77003b040 comp rx=0 tx=0).stop 2024-03-12T17:18:38.475 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.480+0000 7fb786400640 1 -- 172.21.15.17:0/312688666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7800b88f0 msgr2=0x7fb7800cc330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:38.475 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.480+0000 7fb786400640 1 --2- 172.21.15.17:0/312688666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7800b88f0 0x7fb7800cc330 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb76c00d800 tx=0x7fb76c00dcc0 comp rx=0 tx=0).stop 2024-03-12T17:18:38.475 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.480+0000 7fb786400640 1 -- 172.21.15.17:0/312688666 shutdown_connections 2024-03-12T17:18:38.475 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.480+0000 7fb786400640 1 --2- 172.21.15.17:0/312688666 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb76006ab70 0x7fb76006d030 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:38.475 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.480+0000 7fb786400640 1 --2- 172.21.15.17:0/312688666 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb78015cc60 0x7fb7800cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:38.476 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.481+0000 7fb786400640 1 --2- 172.21.15.17:0/312688666 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb7800b88f0 0x7fb7800cc330 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:38.476 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.481+0000 7fb786400640 1 --2- 172.21.15.17:0/312688666 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb7800b4b30 0x7fb7801f7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:38.476 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.481+0000 7fb786400640 1 -- 172.21.15.17:0/312688666 >> 172.21.15.17:0/312688666 conn(0x7fb780071800 msgr2=0x7fb7800b1bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:38.476 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.481+0000 7fb786400640 1 -- 172.21.15.17:0/312688666 shutdown_connections 2024-03-12T17:18:38.476 INFO:teuthology.misc.health.smithi017.stderr:2024-03-12T17:18:38.481+0000 7fb786400640 1 -- 172.21.15.17:0/312688666 wait complete. 2024-03-12T17:18:38.489 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-03-12T17:18:38.489 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-12T17:18:38.489 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-12T17:18:38.490 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-12T17:18:38.495 INFO:tasks.ceph.mds.a:Started 2024-03-12T17:18:38.495 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-12T17:18:38.495 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-12T17:18:38.500 INFO:tasks.ceph.mds.c:Started 2024-03-12T17:18:38.500 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-12T17:18:38.500 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-12T17:18:38.508 INFO:tasks.ceph.mds.b:Started 2024-03-12T17:18:38.508 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-12T17:18:38.508 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-12T17:18:38.517 INFO:tasks.ceph.mds.d:Started 2024-03-12T17:18:38.517 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-03-12T17:18:38.517 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T17:18:38.648 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2024-03-12T17:18:38.649 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2024-03-12T17:18:38.666 INFO:tasks.ceph.mds.b.smithi094.stdout:starting mds.b at 2024-03-12T17:18:38.672 INFO:tasks.ceph.mds.d.smithi094.stdout:starting mds.d at 2024-03-12T17:18:38.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.708+0000 7feb9c400640 1 Processor -- start 2024-03-12T17:18:38.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.708+0000 7feb9c400640 1 -- start start 2024-03-12T17:18:38.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.709+0000 7feb9c400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7feb940d2fa0 0x7feb940d3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:38.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.709+0000 7feb9c400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feb940b5f70 0x7feb940d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:38.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.709+0000 7feb9c400640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb940d14e0 con 0x7feb940b5b50 2024-03-12T17:18:38.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.709+0000 7feb9c400640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb940b59e0 con 0x7feb940d2fa0 2024-03-12T17:18:38.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.709+0000 7feb9c400640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb940d38c0 con 0x7feb940b5f70 2024-03-12T17:18:38.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.709+0000 7feb99a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7feb940d2fa0 0x7feb940d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:38.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.709+0000 7feb99a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7feb940d2fa0 0x7feb940d3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56876/0 (socket says 172.21.15.17:56876) 2024-03-12T17:18:38.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.709+0000 7feb99a00640 1 -- 172.21.15.17:0/4124262050 learned_addr learned my addr 172.21.15.17:0/4124262050 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:38.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.709+0000 7feb99000640 1 --1- 172.21.15.17:0/4124262050 >> v1:172.21.15.17:6789/0 conn(0x7feb940b5b50 0x7feb940cd840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:45702/0 (socket says 172.21.15.17:45702) 2024-03-12T17:18:38.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.709+0000 7feb9a400640 1 --2- 172.21.15.17:0/4124262050 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feb940b5f70 0x7feb940d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:38.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.710+0000 7feb99a00640 1 -- 172.21.15.17:0/4124262050 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feb940b5f70 msgr2=0x7feb940d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:38.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.710+0000 7feb99a00640 1 --2- 172.21.15.17:0/4124262050 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feb940b5f70 0x7feb940d1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:38.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.710+0000 7feb99a00640 1 -- 172.21.15.17:0/4124262050 >> v1:172.21.15.17:6789/0 conn(0x7feb940b5b50 legacy=0x7feb940cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:38.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.710+0000 7feb99a00640 1 -- 172.21.15.17:0/4124262050 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb940b85b0 con 0x7feb940d2fa0 2024-03-12T17:18:38.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.711+0000 7feb99a00640 1 --2- 172.21.15.17:0/4124262050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb940d2fa0 0x7feb940d3380 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7feb88009870 tx=0x7feb8802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99bf90437834a743 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:38.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.711+0000 7feb93e00640 1 -- 172.21.15.17:0/4124262050 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb88030840 con 0x7feb940d2fa0 2024-03-12T17:18:38.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.711+0000 7feb93e00640 1 -- 172.21.15.17:0/4124262050 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb880309a0 con 0x7feb940d2fa0 2024-03-12T17:18:38.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.711+0000 7feb93e00640 1 -- 172.21.15.17:0/4124262050 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb88030d30 con 0x7feb940d2fa0 2024-03-12T17:18:38.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.712+0000 7feb9c400640 1 -- 172.21.15.17:0/4124262050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb940d2fa0 msgr2=0x7feb940d3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:38.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.712+0000 7feb9c400640 1 --2- 172.21.15.17:0/4124262050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb940d2fa0 0x7feb940d3380 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7feb88009870 tx=0x7feb8802b980 comp rx=0 tx=0).stop 2024-03-12T17:18:38.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.712+0000 7feb9c400640 1 -- 172.21.15.17:0/4124262050 shutdown_connections 2024-03-12T17:18:38.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.712+0000 7feb9c400640 1 --2- 172.21.15.17:0/4124262050 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feb940b5f70 0x7feb940d1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:38.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.712+0000 7feb9c400640 1 --2- 172.21.15.17:0/4124262050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb940d2fa0 0x7feb940d3380 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:38.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.712+0000 7feb9c400640 1 -- 172.21.15.17:0/4124262050 >> 172.21.15.17:0/4124262050 conn(0x7feb94065df0 msgr2=0x7feb94066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:38.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.712+0000 7feb9c400640 1 -- 172.21.15.17:0/4124262050 shutdown_connections 2024-03-12T17:18:38.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.712+0000 7feb9c400640 1 -- 172.21.15.17:0/4124262050 wait complete. 2024-03-12T17:18:38.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.713+0000 7feb9c400640 1 Processor -- start 2024-03-12T17:18:38.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.713+0000 7feb9c400640 1 -- start start 2024-03-12T17:18:38.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.714+0000 7feb9c400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb940b5b50 0x7feb9415db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:38.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.714+0000 7feb9c400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feb940b5f70 0x7feb940c7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:38.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.714+0000 7feb9c400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb940d2fa0 0x7feb9415f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:38.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.714+0000 7feb9c400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb941f5b20 con 0x7feb940b5b50 2024-03-12T17:18:38.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.714+0000 7feb9c400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb941f5e00 con 0x7feb940d2fa0 2024-03-12T17:18:38.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.714+0000 7feb9c400640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb941f60e0 con 0x7feb940b5f70 2024-03-12T17:18:38.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.715+0000 7feb99a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb940b5b50 0x7feb9415db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:38.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.715+0000 7feb99a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb940b5b50 0x7feb9415db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56888/0 (socket says 172.21.15.17:56888) 2024-03-12T17:18:38.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.715+0000 7feb99a00640 1 -- 172.21.15.17:0/37179574 learned_addr learned my addr 172.21.15.17:0/37179574 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:38.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.715+0000 7feb99000640 1 --2- 172.21.15.17:0/37179574 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feb940b5f70 0x7feb940c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:38.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.715+0000 7feb9a400640 1 --2- 172.21.15.17:0/37179574 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb940d2fa0 0x7feb9415f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:38.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.715+0000 7feb99a00640 1 -- 172.21.15.17:0/37179574 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feb940b5f70 msgr2=0x7feb940c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:38.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.715+0000 7feb99a00640 1 --2- 172.21.15.17:0/37179574 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feb940b5f70 0x7feb940c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:38.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.715+0000 7feb99a00640 1 -- 172.21.15.17:0/37179574 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb940d2fa0 msgr2=0x7feb9415f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:38.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.715+0000 7feb99a00640 1 --2- 172.21.15.17:0/37179574 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb940d2fa0 0x7feb9415f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:38.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.715+0000 7feb99a00640 1 -- 172.21.15.17:0/37179574 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb880094d0 con 0x7feb940b5b50 2024-03-12T17:18:38.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.715+0000 7feb9a400640 1 --2- 172.21.15.17:0/37179574 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb940d2fa0 0x7feb9415f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:18:38.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.715+0000 7feb99000640 1 --2- 172.21.15.17:0/37179574 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feb940b5f70 0x7feb940c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:18:38.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.715+0000 7feb99a00640 1 --2- 172.21.15.17:0/37179574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb940b5b50 0x7feb9415db40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7feb88000c00 tx=0x7feb88004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:38.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.716+0000 7feb91600640 1 -- 172.21.15.17:0/37179574 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb88039a90 con 0x7feb940b5b50 2024-03-12T17:18:38.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.716+0000 7feb91600640 1 -- 172.21.15.17:0/37179574 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb88039bf0 con 0x7feb940b5b50 2024-03-12T17:18:38.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.716+0000 7feb91600640 1 -- 172.21.15.17:0/37179574 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb88043410 con 0x7feb940b5b50 2024-03-12T17:18:38.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.716+0000 7feb9c400640 1 -- 172.21.15.17:0/37179574 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb941f63c0 con 0x7feb940b5b50 2024-03-12T17:18:38.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.716+0000 7feb9c400640 1 -- 172.21.15.17:0/37179574 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb941f57b0 con 0x7feb940b5b50 2024-03-12T17:18:38.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.717+0000 7feb9c400640 1 -- 172.21.15.17:0/37179574 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb941f6220 con 0x7feb940b5b50 2024-03-12T17:18:38.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.718+0000 7feb91600640 1 -- 172.21.15.17:0/37179574 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 4) v1 ==== 89081+0+0 (secure 0 0 0) 0x7feb8802f390 con 0x7feb940b5b50 2024-03-12T17:18:38.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.718+0000 7feb91600640 1 --2- 172.21.15.17:0/37179574 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7feb7406ab70 0x7feb7406d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:38.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.719+0000 7feb91600640 1 -- 172.21.15.17:0/37179574 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7feb880ab090 con 0x7feb940b5b50 2024-03-12T17:18:38.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.719+0000 7feb99000640 1 --2- 172.21.15.17:0/37179574 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7feb7406ab70 0x7feb7406d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:38.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.720+0000 7feb99000640 1 --2- 172.21.15.17:0/37179574 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7feb7406ab70 0x7feb7406d030 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7feb9415c2b0 tx=0x7feb80009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:38.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.723+0000 7feb91600640 1 -- 172.21.15.17:0/37179574 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7feb880de4f0 con 0x7feb940b5b50 2024-03-12T17:18:38.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.916+0000 7feb9c400640 1 -- 172.21.15.17:0/37179574 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb940736c0 con 0x7feb940b5b50 2024-03-12T17:18:38.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.918+0000 7feb91600640 1 -- 172.21.15.17:0/37179574 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10392 (secure 0 0 0) 0x7feb88048090 con 0x7feb940b5b50 2024-03-12T17:18:38.912 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:18:38.913 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":13,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:18:38.144756+0000","last_up_change":"2024-03-12T17:18:38.144756+0000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":37305},{"type":"v1","addr":"172.21.15.17:6801","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":37305},{"type":"v1","addr":"172.21.15.17:6803","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":37305},{"type":"v1","addr":"172.21.15.17:6807","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":37305},{"type":"v1","addr":"172.21.15.17:6805","nonce":37305}]},"public_addr":"172.21.15.17:6801/37305","cluster_addr":"172.21.15.17:6803/37305","heartbeat_back_addr":"172.21.15.17:6807/37305","heartbeat_front_addr":"172.21.15.17:6805/37305","state":["exists","up"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":37307},{"type":"v1","addr":"172.21.15.17:6814","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":37307},{"type":"v1","addr":"172.21.15.17:6818","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":37307},{"type":"v1","addr":"172.21.15.17:6827","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":37307},{"type":"v1","addr":"172.21.15.17:6823","nonce":37307}]},"public_addr":"172.21.15.17:6814/37307","cluster_addr":"172.21.15.17:6818/37307","heartbeat_back_addr":"172.21.15.17:6827/37307","heartbeat_front_addr":"172.21.15.17:6823/37307","state":["exists","up"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":37303},{"type":"v1","addr":"172.21.15.17:6809","nonce":37303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":37303},{"type":"v1","addr":"172.21.15.17:6811","nonce":37303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":37303},{"type":"v1","addr":"172.21.15.17:6819","nonce":37303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":37303},{"type":"v1","addr":"172.21.15.17:6815","nonce":37303}]},"public_addr":"172.21.15.17:6809/37303","cluster_addr":"172.21.15.17:6811/37303","heartbeat_back_addr":"172.21.15.17:6819/37303","heartbeat_front_addr":"172.21.15.17:6815/37303","state":["exists","up"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":37308},{"type":"v1","addr":"172.21.15.17:6822","nonce":37308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":37308},{"type":"v1","addr":"172.21.15.17:6826","nonce":37308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":37308},{"type":"v1","addr":"172.21.15.17:6831","nonce":37308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":37308},{"type":"v1","addr":"172.21.15.17:6829","nonce":37308}]},"public_addr":"172.21.15.17:6822/37308","cluster_addr":"172.21.15.17:6826/37308","heartbeat_back_addr":"172.21.15.17:6831/37308","heartbeat_front_addr":"172.21.15.17:6829/37308","state":["exists","up"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":37465},{"type":"v1","addr":"172.21.15.94:6809","nonce":37465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6811","nonce":37465},{"type":"v1","addr":"172.21.15.94:6813","nonce":37465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6819","nonce":37465},{"type":"v1","addr":"172.21.15.94:6822","nonce":37465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6815","nonce":37465},{"type":"v1","addr":"172.21.15.94:6817","nonce":37465}]},"public_addr":"172.21.15.94:6809/37465","cluster_addr":"172.21.15.94:6813/37465","heartbeat_back_addr":"172.21.15.94:6822/37465","heartbeat_front_addr":"172.21.15.94:6817/37465","state":["exists","up"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":37464},{"type":"v1","addr":"172.21.15.94:6812","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":37464},{"type":"v1","addr":"172.21.15.94:6816","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":37464},{"type":"v1","addr":"172.21.15.94:6823","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":37464},{"type":"v1","addr":"172.21.15.94:6820","nonce":37464}]},"public_addr":"172.21.15.94:6812/37464","cluster_addr":"172.21.15.94:6816/37464","heartbeat_back_addr":"172.21.15.94:6823/37464","heartbeat_front_addr":"172.21.15.94:6820/37464","state":["exists","up"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":37467},{"type":"v1","addr":"172.21.15.94:6825","nonce":37467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":37467},{"type":"v1","addr":"172.21.15.94:6827","nonce":37467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":37467},{"type":"v1","addr":"172.21.15.94:6831","nonce":37467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":37467},{"type":"v1","addr":"172.21.15.94:6829","nonce":37467}]},"public_addr":"172.21.15.94:6825/37467","cluster_addr":"172.21.15.94:6827/37467","heartbeat_back_addr":"172.21.15.94:6831/37467","heartbeat_front_addr":"172.21.15.94:6829/37467","state":["exists","up"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":37466},{"type":"v1","addr":"172.21.15.94:6801","nonce":37466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":37466},{"type":"v1","addr":"172.21.15.94:6803","nonce":37466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":37466},{"type":"v1","addr":"172.21.15.94:6807","nonce":37466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":37466},{"type":"v1","addr":"172.21.15.94:6805","nonce":37466}]},"public_addr":"172.21.15.94:6801/37466","cluster_addr":"172.21.15.94:6803/37466","heartbeat_back_addr":"172.21.15.94:6807/37466","heartbeat_front_addr":"172.21.15.94:6805/37466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:18:38.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.920+0000 7feb9c400640 1 -- 172.21.15.17:0/37179574 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7feb7406ab70 msgr2=0x7feb7406d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:38.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.920+0000 7feb9c400640 1 --2- 172.21.15.17:0/37179574 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7feb7406ab70 0x7feb7406d030 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7feb9415c2b0 tx=0x7feb80009040 comp rx=0 tx=0).stop 2024-03-12T17:18:38.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.920+0000 7feb9c400640 1 -- 172.21.15.17:0/37179574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb940b5b50 msgr2=0x7feb9415db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:38.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.920+0000 7feb9c400640 1 --2- 172.21.15.17:0/37179574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb940b5b50 0x7feb9415db40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7feb88000c00 tx=0x7feb88004730 comp rx=0 tx=0).stop 2024-03-12T17:18:38.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.920+0000 7feb9c400640 1 -- 172.21.15.17:0/37179574 shutdown_connections 2024-03-12T17:18:38.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.920+0000 7feb9c400640 1 --2- 172.21.15.17:0/37179574 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7feb7406ab70 0x7feb7406d030 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:38.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.920+0000 7feb9c400640 1 --2- 172.21.15.17:0/37179574 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb940d2fa0 0x7feb9415f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:38.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.920+0000 7feb9c400640 1 --2- 172.21.15.17:0/37179574 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feb940b5f70 0x7feb940c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:38.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.920+0000 7feb9c400640 1 --2- 172.21.15.17:0/37179574 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb940b5b50 0x7feb9415db40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:38.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.920+0000 7feb9c400640 1 -- 172.21.15.17:0/37179574 >> 172.21.15.17:0/37179574 conn(0x7feb94065df0 msgr2=0x7feb940cd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:38.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.920+0000 7feb9c400640 1 -- 172.21.15.17:0/37179574 shutdown_connections 2024-03-12T17:18:38.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:38.920+0000 7feb9c400640 1 -- 172.21.15.17:0/37179574 wait complete. 2024-03-12T17:18:38.930 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-03-12T17:18:38.931 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-12T17:18:39.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.144+0000 7f193be00640 1 Processor -- start 2024-03-12T17:18:39.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.144+0000 7f193be00640 1 -- start start 2024-03-12T17:18:39.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.145+0000 7f193be00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f193c15caa0 0x7f193c160790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:39.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.146+0000 7f193be00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f193c161650 con 0x7f193c0cfa40 2024-03-12T17:18:39.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.146+0000 7f193be00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f193c161090 con 0x7f193c15ce80 2024-03-12T17:18:39.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.146+0000 7f193be00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193c161370 con 0x7f193c15caa0 2024-03-12T17:18:39.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.146+0000 7f193b400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f193c0cfa40 0x7f193c0d12d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:45718/0 (socket says 172.21.15.17:45718) 2024-03-12T17:18:39.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.146+0000 7f193b400640 1 -- 172.21.15.17:0/1117405158 learned_addr learned my addr 172.21.15.17:0/1117405158 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:18:39.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.146+0000 7f193aa00640 1 --2- 172.21.15.17:0/1117405158 >> v2:172.21.15.17:3300/0 conn(0x7f193c15caa0 0x7f193c160790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:39.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.146+0000 7f193aa00640 1 -- 172.21.15.17:0/1117405158 >> v1:172.21.15.94:6789/0 conn(0x7f193c15ce80 legacy=0x7f193c0cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:39.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.146+0000 7f1939600640 1 -- 172.21.15.17:0/1117405158 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1534826720 0 0) 0x7f193c161650 con 0x7f193c0cfa40 2024-03-12T17:18:39.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.146+0000 7f193aa00640 1 -- 172.21.15.17:0/1117405158 >> v1:172.21.15.17:6789/0 conn(0x7f193c0cfa40 legacy=0x7f193c0d12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:39.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.146+0000 7f193aa00640 1 -- 172.21.15.17:0/1117405158 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f193c0d0ad0 con 0x7f193c15caa0 2024-03-12T17:18:39.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.148+0000 7f193aa00640 1 --2- 172.21.15.17:0/1117405158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f193c15caa0 0x7f193c160790 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f192c0097a0 tx=0x7f192c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636f8188cd85f932 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:39.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.148+0000 7f1939600640 1 -- 172.21.15.17:0/1117405158 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c030610 con 0x7f193c15caa0 2024-03-12T17:18:39.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.148+0000 7f1939600640 1 -- 172.21.15.17:0/1117405158 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192c030770 con 0x7f193c15caa0 2024-03-12T17:18:39.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.148+0000 7f1939600640 1 -- 172.21.15.17:0/1117405158 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192c030b00 con 0x7f193c15caa0 2024-03-12T17:18:39.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.148+0000 7f193be00640 1 -- 172.21.15.17:0/1117405158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f193c15caa0 msgr2=0x7f193c160790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:39.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.148+0000 7f193be00640 1 --2- 172.21.15.17:0/1117405158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f193c15caa0 0x7f193c160790 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f192c0097a0 tx=0x7f192c02b960 comp rx=0 tx=0).stop 2024-03-12T17:18:39.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.149+0000 7f193be00640 1 -- 172.21.15.17:0/1117405158 shutdown_connections 2024-03-12T17:18:39.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.149+0000 7f193be00640 1 --2- 172.21.15.17:0/1117405158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f193c15caa0 0x7f193c160790 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:39.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.149+0000 7f193be00640 1 -- 172.21.15.17:0/1117405158 >> 172.21.15.17:0/1117405158 conn(0x7f193c06b160 msgr2=0x7f193c06b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:39.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.149+0000 7f193be00640 1 -- 172.21.15.17:0/1117405158 shutdown_connections 2024-03-12T17:18:39.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.149+0000 7f193be00640 1 -- 172.21.15.17:0/1117405158 wait complete. 2024-03-12T17:18:39.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.151+0000 7f193be00640 1 Processor -- start 2024-03-12T17:18:39.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.151+0000 7f193be00640 1 -- start start 2024-03-12T17:18:39.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.153+0000 7f193be00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f193c0cfa40 0x7f193c148960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:39.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.153+0000 7f193be00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f193c15caa0 0x7f193c14aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:39.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.153+0000 7f193be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f193c15ce80 0x7f193c1490f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:39.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.153+0000 7f193be00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193c148ea0 con 0x7f193c15ce80 2024-03-12T17:18:39.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.153+0000 7f193be00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193c14af70 con 0x7f193c0cfa40 2024-03-12T17:18:39.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.153+0000 7f193be00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f193c14a5a0 con 0x7f193c15caa0 2024-03-12T17:18:39.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.153+0000 7f193b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f193c15ce80 0x7f193c1490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:39.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.153+0000 7f193b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f193c15ce80 0x7f193c1490f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56912/0 (socket says 172.21.15.17:56912) 2024-03-12T17:18:39.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.153+0000 7f193b400640 1 -- 172.21.15.17:0/4078823245 learned_addr learned my addr 172.21.15.17:0/4078823245 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:39.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.153+0000 7f193aa00640 1 --2- 172.21.15.17:0/4078823245 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f193c0cfa40 0x7f193c148960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:39.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.154+0000 7f193a000640 1 --2- 172.21.15.17:0/4078823245 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f193c15caa0 0x7f193c14aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:39.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.154+0000 7f193b400640 1 -- 172.21.15.17:0/4078823245 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f193c15caa0 msgr2=0x7f193c14aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:39.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.154+0000 7f193b400640 1 --2- 172.21.15.17:0/4078823245 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f193c15caa0 0x7f193c14aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:39.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.154+0000 7f193b400640 1 -- 172.21.15.17:0/4078823245 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f193c0cfa40 msgr2=0x7f193c148960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:39.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.154+0000 7f193b400640 1 --2- 172.21.15.17:0/4078823245 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f193c0cfa40 0x7f193c148960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:39.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.154+0000 7f193b400640 1 -- 172.21.15.17:0/4078823245 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f192c009400 con 0x7f193c15ce80 2024-03-12T17:18:39.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.154+0000 7f193a000640 1 --2- 172.21.15.17:0/4078823245 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f193c15caa0 0x7f193c14aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:18:39.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.154+0000 7f193b400640 1 --2- 172.21.15.17:0/4078823245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f193c15ce80 0x7f193c1490f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f193400c7e0 tx=0x7f193400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:39.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.154+0000 7f1932a00640 1 -- 172.21.15.17:0/4078823245 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193400a5e0 con 0x7f193c15ce80 2024-03-12T17:18:39.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.154+0000 7f1932a00640 1 -- 172.21.15.17:0/4078823245 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193400a760 con 0x7f193c15ce80 2024-03-12T17:18:39.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.154+0000 7f1932a00640 1 -- 172.21.15.17:0/4078823245 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193400ab10 con 0x7f193c15ce80 2024-03-12T17:18:39.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.154+0000 7f193be00640 1 -- 172.21.15.17:0/4078823245 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f193c149990 con 0x7f193c15ce80 2024-03-12T17:18:39.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.155+0000 7f193be00640 1 -- 172.21.15.17:0/4078823245 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f193c149f50 con 0x7f193c15ce80 2024-03-12T17:18:39.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.156+0000 7f193be00640 1 -- 172.21.15.17:0/4078823245 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f193c072360 con 0x7f193c15ce80 2024-03-12T17:18:39.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.156+0000 7f1932a00640 1 -- 172.21.15.17:0/4078823245 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 4) v1 ==== 89081+0+0 (secure 0 0 0) 0x7f193400ac70 con 0x7f193c15ce80 2024-03-12T17:18:39.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.158+0000 7f1932a00640 1 --2- 172.21.15.17:0/4078823245 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f191c06ab70 0x7f191c06d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:39.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.158+0000 7f1932a00640 1 -- 172.21.15.17:0/4078823245 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f1934088380 con 0x7f193c15ce80 2024-03-12T17:18:39.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.158+0000 7f193aa00640 1 --2- 172.21.15.17:0/4078823245 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f191c06ab70 0x7f191c06d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:39.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.159+0000 7f193aa00640 1 --2- 172.21.15.17:0/4078823245 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f191c06ab70 0x7f191c06d030 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f192c036000 tx=0x7f192c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:39.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.163+0000 7f1932a00640 1 -- 172.21.15.17:0/4078823245 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f1934053a80 con 0x7f193c15ce80 2024-03-12T17:18:39.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.405+0000 7f193be00640 1 -- 172.21.15.17:0/4078823245 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f193c04e030 con 0x7f193c15ce80 2024-03-12T17:18:39.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.406+0000 7f1932a00640 1 -- 172.21.15.17:0/4078823245 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1256 (secure 0 0 0) 0x7f1934018070 con 0x7f193c15ce80 2024-03-12T17:18:39.401 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:18:39.401 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6836/3710914262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3710914262},{"type":"v1","addr":"172.21.15.17:6836","nonce":3710914262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-03-12T17:18:39.401 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 2 2024-03-12T17:18:39.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.409+0000 7f193be00640 1 -- 172.21.15.17:0/4078823245 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f191c06ab70 msgr2=0x7f191c06d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:39.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.409+0000 7f193be00640 1 --2- 172.21.15.17:0/4078823245 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f191c06ab70 0x7f191c06d030 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f192c036000 tx=0x7f192c008030 comp rx=0 tx=0).stop 2024-03-12T17:18:39.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.409+0000 7f193be00640 1 -- 172.21.15.17:0/4078823245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f193c15ce80 msgr2=0x7f193c1490f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:39.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.409+0000 7f193be00640 1 --2- 172.21.15.17:0/4078823245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f193c15ce80 0x7f193c1490f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f193400c7e0 tx=0x7f193400cca0 comp rx=0 tx=0).stop 2024-03-12T17:18:39.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.409+0000 7f193be00640 1 -- 172.21.15.17:0/4078823245 shutdown_connections 2024-03-12T17:18:39.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.409+0000 7f193be00640 1 --2- 172.21.15.17:0/4078823245 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f191c06ab70 0x7f191c06d030 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:39.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.409+0000 7f193be00640 1 --2- 172.21.15.17:0/4078823245 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f193c15ce80 0x7f193c1490f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:39.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.409+0000 7f193be00640 1 --2- 172.21.15.17:0/4078823245 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f193c15caa0 0x7f193c14aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:39.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.409+0000 7f193be00640 1 --2- 172.21.15.17:0/4078823245 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f193c0cfa40 0x7f193c148960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:39.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.409+0000 7f193be00640 1 -- 172.21.15.17:0/4078823245 >> 172.21.15.17:0/4078823245 conn(0x7f193c06b160 msgr2=0x7f193c0c5c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:39.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.409+0000 7f193be00640 1 -- 172.21.15.17:0/4078823245 shutdown_connections 2024-03-12T17:18:39.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:39.409+0000 7f193be00640 1 -- 172.21.15.17:0/4078823245 wait complete. 2024-03-12T17:18:39.915 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:18:39.923 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:18:41.422 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-12T17:18:41.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.645+0000 7f2365200640 1 Processor -- start 2024-03-12T17:18:41.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.645+0000 7f2365200640 1 -- start start 2024-03-12T17:18:41.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.646+0000 7f2365200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23600d2fa0 0x7f23600d3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:41.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.646+0000 7f2365200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f23600b5f70 0x7f23600d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:41.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.646+0000 7f2365200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23600d14e0 con 0x7f23600b5b50 2024-03-12T17:18:41.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.646+0000 7f2365200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23600b59e0 con 0x7f23600b5f70 2024-03-12T17:18:41.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.646+0000 7f2365200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23600d38c0 con 0x7f23600d2fa0 2024-03-12T17:18:41.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.647+0000 7f235e800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f23600b5f70 0x7f23600d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:41.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.647+0000 7f235d400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f23600b5b50 0x7f23600cd840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:45734/0 (socket says 172.21.15.17:45734) 2024-03-12T17:18:41.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.647+0000 7f235d400640 1 -- 172.21.15.17:0/3519782956 learned_addr learned my addr 172.21.15.17:0/3519782956 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:18:41.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.647+0000 7f235de00640 1 --2- 172.21.15.17:0/3519782956 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23600d2fa0 0x7f23600d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:41.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.647+0000 7f235e800640 1 -- 172.21.15.17:0/3519782956 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23600d2fa0 msgr2=0x7f23600d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:41.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.647+0000 7f235e800640 1 --2- 172.21.15.17:0/3519782956 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23600d2fa0 0x7f23600d3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:41.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.647+0000 7f235e800640 1 -- 172.21.15.17:0/3519782956 >> v1:172.21.15.17:6789/0 conn(0x7f23600b5b50 legacy=0x7f23600cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:41.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.647+0000 7f235ca00640 1 -- 172.21.15.17:0/3519782956 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 664195732 0 0) 0x7f23600d14e0 con 0x7f23600b5b50 2024-03-12T17:18:41.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.647+0000 7f235e800640 1 -- 172.21.15.17:0/3519782956 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23600b85b0 con 0x7f23600b5f70 2024-03-12T17:18:41.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.649+0000 7f235e800640 1 --2- 172.21.15.17:0/3519782956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23600b5f70 0x7f23600d1f30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2358009d90 tx=0x7f235802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52512371d098effd server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:41.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.649+0000 7f235ca00640 1 -- 172.21.15.17:0/3519782956 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235802cc50 con 0x7f23600b5f70 2024-03-12T17:18:41.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.649+0000 7f235ca00640 1 -- 172.21.15.17:0/3519782956 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f235802cdb0 con 0x7f23600b5f70 2024-03-12T17:18:41.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.649+0000 7f235ca00640 1 -- 172.21.15.17:0/3519782956 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2358034660 con 0x7f23600b5f70 2024-03-12T17:18:41.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.650+0000 7f2365200640 1 -- 172.21.15.17:0/3519782956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23600b5f70 msgr2=0x7f23600d1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:41.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.650+0000 7f2365200640 1 --2- 172.21.15.17:0/3519782956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23600b5f70 0x7f23600d1f30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2358009d90 tx=0x7f235802bea0 comp rx=0 tx=0).stop 2024-03-12T17:18:41.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.650+0000 7f2365200640 1 -- 172.21.15.17:0/3519782956 shutdown_connections 2024-03-12T17:18:41.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.650+0000 7f2365200640 1 --2- 172.21.15.17:0/3519782956 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23600b5f70 0x7f23600d1f30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:41.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.650+0000 7f2365200640 1 --2- 172.21.15.17:0/3519782956 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23600d2fa0 0x7f23600d3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:41.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.650+0000 7f2365200640 1 -- 172.21.15.17:0/3519782956 >> 172.21.15.17:0/3519782956 conn(0x7f2360065df0 msgr2=0x7f2360066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:41.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.650+0000 7f2365200640 1 -- 172.21.15.17:0/3519782956 shutdown_connections 2024-03-12T17:18:41.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.650+0000 7f2365200640 1 -- 172.21.15.17:0/3519782956 wait complete. 2024-03-12T17:18:41.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.652+0000 7f2365200640 1 Processor -- start 2024-03-12T17:18:41.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.652+0000 7f2365200640 1 -- start start 2024-03-12T17:18:41.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.653+0000 7f2365200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23600b5b50 0x7f23601f1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:41.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.653+0000 7f2365200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23600b5f70 0x7f23600cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:41.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.653+0000 7f2365200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23600d2fa0 0x7f236015ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:41.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.653+0000 7f2365200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23600ccac0 con 0x7f23600b5f70 2024-03-12T17:18:41.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.653+0000 7f2365200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23601f24c0 con 0x7f23600b5b50 2024-03-12T17:18:41.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.653+0000 7f2365200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23600cc7e0 con 0x7f23600d2fa0 2024-03-12T17:18:41.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.653+0000 7f235d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23600b5f70 0x7f23600cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:41.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.653+0000 7f235d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23600b5f70 0x7f23600cbeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:56952/0 (socket says 172.21.15.17:56952) 2024-03-12T17:18:41.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.653+0000 7f235d400640 1 -- 172.21.15.17:0/934759491 learned_addr learned my addr 172.21.15.17:0/934759491 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:41.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.653+0000 7f235de00640 1 --2- 172.21.15.17:0/934759491 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23600b5b50 0x7f23601f1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:41.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.653+0000 7f235e800640 1 --2- 172.21.15.17:0/934759491 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23600d2fa0 0x7f236015ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:41.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.654+0000 7f235d400640 1 -- 172.21.15.17:0/934759491 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23600d2fa0 msgr2=0x7f236015ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:41.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.654+0000 7f235d400640 1 --2- 172.21.15.17:0/934759491 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23600d2fa0 0x7f236015ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:41.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.654+0000 7f235d400640 1 -- 172.21.15.17:0/934759491 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23600b5b50 msgr2=0x7f23601f1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:41.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.654+0000 7f235d400640 1 --2- 172.21.15.17:0/934759491 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23600b5b50 0x7f23601f1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:41.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.654+0000 7f235d400640 1 -- 172.21.15.17:0/934759491 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2358009a70 con 0x7f23600b5f70 2024-03-12T17:18:41.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.654+0000 7f235d400640 1 --2- 172.21.15.17:0/934759491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23600b5f70 0x7f23600cbeb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f234c00c430 tx=0x7f234c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:41.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.654+0000 7f2356000640 1 -- 172.21.15.17:0/934759491 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234c0074e0 con 0x7f23600b5f70 2024-03-12T17:18:41.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.654+0000 7f2356000640 1 -- 172.21.15.17:0/934759491 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f234c007660 con 0x7f23600b5f70 2024-03-12T17:18:41.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.654+0000 7f2356000640 1 -- 172.21.15.17:0/934759491 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f234c004a20 con 0x7f23600b5f70 2024-03-12T17:18:41.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.654+0000 7f2365200640 1 -- 172.21.15.17:0/934759491 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23600c7bb0 con 0x7f23600b5f70 2024-03-12T17:18:41.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.654+0000 7f2365200640 1 -- 172.21.15.17:0/934759491 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23600c8170 con 0x7f23600b5f70 2024-03-12T17:18:41.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.656+0000 7f2365200640 1 -- 172.21.15.17:0/934759491 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23600c7a10 con 0x7f23600b5f70 2024-03-12T17:18:41.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.657+0000 7f2356000640 1 -- 172.21.15.17:0/934759491 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 4) v1 ==== 89081+0+0 (secure 0 0 0) 0x7f234c004b80 con 0x7f23600b5f70 2024-03-12T17:18:41.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.658+0000 7f2356000640 1 --2- 172.21.15.17:0/934759491 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f234006ab70 0x7f234006d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:41.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.658+0000 7f2356000640 1 -- 172.21.15.17:0/934759491 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f234c088d80 con 0x7f23600b5f70 2024-03-12T17:18:41.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.658+0000 7f235de00640 1 --2- 172.21.15.17:0/934759491 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f234006ab70 0x7f234006d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:41.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.659+0000 7f235de00640 1 --2- 172.21.15.17:0/934759491 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f234006ab70 0x7f234006d030 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2350006fd0 tx=0x7f2350008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:41.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.664+0000 7f2356000640 1 -- 172.21.15.17:0/934759491 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f23600c7a10 con 0x7f23600b5f70 2024-03-12T17:18:41.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.912+0000 7f2365200640 1 -- 172.21.15.17:0/934759491 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23600c7a10 con 0x7f23600b5f70 2024-03-12T17:18:41.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.913+0000 7f2356000640 1 -- 172.21.15.17:0/934759491 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3521 (secure 0 0 0) 0x7f23600c7a10 con 0x7f23600b5f70 2024-03-12T17:18:41.908 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:18:41.908 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/4055209511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":4055209511},{"type":"v1","addr":"172.21.15.94:6833","nonce":4055209511}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4220,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/2079001512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2079001512},{"type":"v1","addr":"172.21.15.94:6835","nonce":2079001512}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6836/3710914262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3710914262},{"type":"v1","addr":"172.21.15.17:6836","nonce":3710914262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/749237500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6835","nonce":749237500},{"type":"v1","addr":"172.21.15.17:6837","nonce":749237500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-03-12T17:18:41.908 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 3 2024-03-12T17:18:41.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.915+0000 7f2365200640 1 -- 172.21.15.17:0/934759491 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f234006ab70 msgr2=0x7f234006d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:41.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.915+0000 7f2365200640 1 --2- 172.21.15.17:0/934759491 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f234006ab70 0x7f234006d030 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2350006fd0 tx=0x7f2350008040 comp rx=0 tx=0).stop 2024-03-12T17:18:41.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.915+0000 7f2365200640 1 -- 172.21.15.17:0/934759491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23600b5f70 msgr2=0x7f23600cbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:41.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.915+0000 7f2365200640 1 --2- 172.21.15.17:0/934759491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23600b5f70 0x7f23600cbeb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f234c00c430 tx=0x7f234c00c8f0 comp rx=0 tx=0).stop 2024-03-12T17:18:41.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.916+0000 7f2365200640 1 -- 172.21.15.17:0/934759491 shutdown_connections 2024-03-12T17:18:41.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.916+0000 7f2365200640 1 --2- 172.21.15.17:0/934759491 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f234006ab70 0x7f234006d030 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:41.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.916+0000 7f2365200640 1 --2- 172.21.15.17:0/934759491 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23600d2fa0 0x7f236015ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:41.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.916+0000 7f2365200640 1 --2- 172.21.15.17:0/934759491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23600b5f70 0x7f23600cbeb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:41.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.916+0000 7f2365200640 1 --2- 172.21.15.17:0/934759491 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23600b5b50 0x7f23601f1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:41.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.916+0000 7f2365200640 1 -- 172.21.15.17:0/934759491 >> 172.21.15.17:0/934759491 conn(0x7f2360065df0 msgr2=0x7f23600b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:41.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.916+0000 7f2365200640 1 -- 172.21.15.17:0/934759491 shutdown_connections 2024-03-12T17:18:41.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:41.916+0000 7f2365200640 1 -- 172.21.15.17:0/934759491 wait complete. 2024-03-12T17:18:41.928 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T17:18:42.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.127+0000 7f4cf4600640 1 Processor -- start 2024-03-12T17:18:42.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.127+0000 7f4cf4600640 1 -- start start 2024-03-12T17:18:42.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.128+0000 7f4cf4600640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4cec0b1e20 0x7f4cec0b0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:42.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.128+0000 7f4cf4600640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cec0b0610 con 0x7f4cec0cb1f0 2024-03-12T17:18:42.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.128+0000 7f4cf4600640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cec0cf270 con 0x7f4cec098b40 2024-03-12T17:18:42.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.128+0000 7f4cf4600640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cec0cf550 con 0x7f4cec0b1e20 2024-03-12T17:18:42.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.129+0000 7f4cf2600640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4cec0b1e20 0x7f4cec0b0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:42.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.129+0000 7f4cf2600640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4cec0b1e20 0x7f4cec0b0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47866/0 (socket says 172.21.15.17:47866) 2024-03-12T17:18:42.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.129+0000 7f4cf1200640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f4cec0cb1f0 0x7f4cec0b1710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37710/0 (socket says 172.21.15.17:37710) 2024-03-12T17:18:42.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.129+0000 7f4cf2600640 1 -- 172.21.15.17:0/2407678722 learned_addr learned my addr 172.21.15.17:0/2407678722 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:42.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.129+0000 7f4cf2600640 1 -- 172.21.15.17:0/2407678722 >> v1:172.21.15.94:6789/0 conn(0x7f4cec098b40 legacy=0x7f4cec098f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:42.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.129+0000 7f4cf2600640 1 -- 172.21.15.17:0/2407678722 >> v1:172.21.15.17:6789/0 conn(0x7f4cec0cb1f0 legacy=0x7f4cec0b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:42.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.129+0000 7f4cf2600640 1 -- 172.21.15.17:0/2407678722 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cec0affc0 con 0x7f4cec0b1e20 2024-03-12T17:18:42.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.130+0000 7f4cf2600640 1 --2- 172.21.15.17:0/2407678722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cec0b1e20 0x7f4cec0b0aa0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc009870 tx=0x7f4cdc02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b2b79da19ec662f server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:42.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.131+0000 7f4cebe00640 1 -- 172.21.15.17:0/2407678722 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc030860 con 0x7f4cec0b1e20 2024-03-12T17:18:42.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.131+0000 7f4cebe00640 1 -- 172.21.15.17:0/2407678722 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cdc0309c0 con 0x7f4cec0b1e20 2024-03-12T17:18:42.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.131+0000 7f4cebe00640 1 -- 172.21.15.17:0/2407678722 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc030d50 con 0x7f4cec0b1e20 2024-03-12T17:18:42.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.131+0000 7f4cf4600640 1 -- 172.21.15.17:0/2407678722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cec0b1e20 msgr2=0x7f4cec0b0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:42.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.131+0000 7f4cf4600640 1 --2- 172.21.15.17:0/2407678722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cec0b1e20 0x7f4cec0b0aa0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc009870 tx=0x7f4cdc02b9a0 comp rx=0 tx=0).stop 2024-03-12T17:18:42.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.131+0000 7f4cf4600640 1 -- 172.21.15.17:0/2407678722 shutdown_connections 2024-03-12T17:18:42.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.131+0000 7f4cf4600640 1 --2- 172.21.15.17:0/2407678722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cec0b1e20 0x7f4cec0b0aa0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:42.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.131+0000 7f4cf4600640 1 -- 172.21.15.17:0/2407678722 >> 172.21.15.17:0/2407678722 conn(0x7f4cec0b23d0 msgr2=0x7f4cec0b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:42.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.131+0000 7f4cf4600640 1 -- 172.21.15.17:0/2407678722 shutdown_connections 2024-03-12T17:18:42.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.131+0000 7f4cf4600640 1 -- 172.21.15.17:0/2407678722 wait complete. 2024-03-12T17:18:42.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.133+0000 7f4cf4600640 1 Processor -- start 2024-03-12T17:18:42.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.133+0000 7f4cf4600640 1 -- start start 2024-03-12T17:18:42.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.134+0000 7f4cf4600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4cec098b40 0x7f4cec1f6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:42.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.134+0000 7f4cf4600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4cec0b1e20 0x7f4cec151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:42.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.134+0000 7f4cf4600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cec0cb1f0 0x7f4cec154d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:42.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.134+0000 7f4cf4600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec155610 con 0x7f4cec0cb1f0 2024-03-12T17:18:42.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.134+0000 7f4cf4600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec1558f0 con 0x7f4cec0b1e20 2024-03-12T17:18:42.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.134+0000 7f4cf4600640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cec155bd0 con 0x7f4cec098b40 2024-03-12T17:18:42.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.135+0000 7f4cf2600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cec0cb1f0 0x7f4cec154d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:42.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.135+0000 7f4cf2600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cec0cb1f0 0x7f4cec154d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47876/0 (socket says 172.21.15.17:47876) 2024-03-12T17:18:42.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.135+0000 7f4cf2600640 1 -- 172.21.15.17:0/3082847140 learned_addr learned my addr 172.21.15.17:0/3082847140 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:42.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.135+0000 7f4cf1200640 1 --2- 172.21.15.17:0/3082847140 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4cec0b1e20 0x7f4cec151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:42.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.135+0000 7f4cf1c00640 1 --2- 172.21.15.17:0/3082847140 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4cec098b40 0x7f4cec1f6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:42.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.135+0000 7f4cf2600640 1 -- 172.21.15.17:0/3082847140 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4cec098b40 msgr2=0x7f4cec1f6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:42.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.135+0000 7f4cf2600640 1 --2- 172.21.15.17:0/3082847140 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4cec098b40 0x7f4cec1f6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:42.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.135+0000 7f4cf2600640 1 -- 172.21.15.17:0/3082847140 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4cec0b1e20 msgr2=0x7f4cec151fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:42.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.135+0000 7f4cf2600640 1 --2- 172.21.15.17:0/3082847140 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4cec0b1e20 0x7f4cec151fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:42.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.135+0000 7f4cf2600640 1 -- 172.21.15.17:0/3082847140 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cdc0094d0 con 0x7f4cec0cb1f0 2024-03-12T17:18:42.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.135+0000 7f4cf2600640 1 --2- 172.21.15.17:0/3082847140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cec0cb1f0 0x7f4cec154d00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc02b9e0 tx=0x7f4cdc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:42.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.136+0000 7f4ce9600640 1 -- 172.21.15.17:0/3082847140 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc043400 con 0x7f4cec0cb1f0 2024-03-12T17:18:42.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.136+0000 7f4ce9600640 1 -- 172.21.15.17:0/3082847140 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cdc043580 con 0x7f4cec0cb1f0 2024-03-12T17:18:42.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.136+0000 7f4cf4600640 1 -- 172.21.15.17:0/3082847140 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cec155eb0 con 0x7f4cec0cb1f0 2024-03-12T17:18:42.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.136+0000 7f4ce9600640 1 -- 172.21.15.17:0/3082847140 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc043930 con 0x7f4cec0cb1f0 2024-03-12T17:18:42.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.136+0000 7f4cf4600640 1 -- 172.21.15.17:0/3082847140 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cec155240 con 0x7f4cec0cb1f0 2024-03-12T17:18:42.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.137+0000 7f4cf4600640 1 -- 172.21.15.17:0/3082847140 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cec0ccb50 con 0x7f4cec0cb1f0 2024-03-12T17:18:42.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.138+0000 7f4ce9600640 1 -- 172.21.15.17:0/3082847140 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 4) v1 ==== 89081+0+0 (secure 0 0 0) 0x7f4cdc043a90 con 0x7f4cec0cb1f0 2024-03-12T17:18:42.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.139+0000 7f4ce9600640 1 --2- 172.21.15.17:0/3082847140 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f4ccc06aba0 0x7f4ccc06d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:42.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.139+0000 7f4ce9600640 1 -- 172.21.15.17:0/3082847140 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4cdc03e070 con 0x7f4cec0cb1f0 2024-03-12T17:18:42.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.139+0000 7f4cf1c00640 1 --2- 172.21.15.17:0/3082847140 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f4ccc06aba0 0x7f4ccc06d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:42.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.140+0000 7f4cf1c00640 1 --2- 172.21.15.17:0/3082847140 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f4ccc06aba0 0x7f4ccc06d060 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4ce4003d90 tx=0x7f4ce4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:42.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.144+0000 7f4ce9600640 1 -- 172.21.15.17:0/3082847140 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f4cec0ccb50 con 0x7f4cec0cb1f0 2024-03-12T17:18:42.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.354+0000 7f4cf4600640 1 -- 172.21.15.17:0/3082847140 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4cec0ccb50 con 0x7f4cec0cb1f0 2024-03-12T17:18:42.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.356+0000 7f4ce9600640 1 -- 172.21.15.17:0/3082847140 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12334 (secure 0 0 0) 0x7f4cec0ccb50 con 0x7f4cec0cb1f0 2024-03-12T17:18:42.350 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:18:42.350 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":17,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:18:42.164602+0000","last_up_change":"2024-03-12T17:18:38.144756+0000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-12T17:18:39.552910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":37305},{"type":"v1","addr":"172.21.15.17:6801","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":37305},{"type":"v1","addr":"172.21.15.17:6803","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":37305},{"type":"v1","addr":"172.21.15.17:6807","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":37305},{"type":"v1","addr":"172.21.15.17:6805","nonce":37305}]},"public_addr":"172.21.15.17:6801/37305","cluster_addr":"172.21.15.17:6803/37305","heartbeat_back_addr":"172.21.15.17:6807/37305","heartbeat_front_addr":"172.21.15.17:6805/37305","state":["exists","up"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":37307},{"type":"v1","addr":"172.21.15.17:6814","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":37307},{"type":"v1","addr":"172.21.15.17:6818","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":37307},{"type":"v1","addr":"172.21.15.17:6827","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":37307},{"type":"v1","addr":"172.21.15.17:6823","nonce":37307}]},"public_addr":"172.21.15.17:6814/37307","cluster_addr":"172.21.15.17:6818/37307","heartbeat_back_addr":"172.21.15.17:6827/37307","heartbeat_front_addr":"172.21.15.17:6823/37307","state":["exists","up"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":37303},{"type":"v1","addr":"172.21.15.17:6809","nonce":37303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":37303},{"type":"v1","addr":"172.21.15.17:6811","nonce":37303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":37303},{"type":"v1","addr":"172.21.15.17:6819","nonce":37303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":37303},{"type":"v1","addr":"172.21.15.17:6815","nonce":37303}]},"public_addr":"172.21.15.17:6809/37303","cluster_addr":"172.21.15.17:6811/37303","heartbeat_back_addr":"172.21.15.17:6819/37303","heartbeat_front_addr":"172.21.15.17:6815/37303","state":["exists","up"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":37308},{"type":"v1","addr":"172.21.15.17:6822","nonce":37308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":37308},{"type":"v1","addr":"172.21.15.17:6826","nonce":37308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":37308},{"type":"v1","addr":"172.21.15.17:6831","nonce":37308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":37308},{"type":"v1","addr":"172.21.15.17:6829","nonce":37308}]},"public_addr":"172.21.15.17:6822/37308","cluster_addr":"172.21.15.17:6826/37308","heartbeat_back_addr":"172.21.15.17:6831/37308","heartbeat_front_addr":"172.21.15.17:6829/37308","state":["exists","up"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":37465},{"type":"v1","addr":"172.21.15.94:6809","nonce":37465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6811","nonce":37465},{"type":"v1","addr":"172.21.15.94:6813","nonce":37465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6819","nonce":37465},{"type":"v1","addr":"172.21.15.94:6822","nonce":37465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6815","nonce":37465},{"type":"v1","addr":"172.21.15.94:6817","nonce":37465}]},"public_addr":"172.21.15.94:6809/37465","cluster_addr":"172.21.15.94:6813/37465","heartbeat_back_addr":"172.21.15.94:6822/37465","heartbeat_front_addr":"172.21.15.94:6817/37465","state":["exists","up"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":37464},{"type":"v1","addr":"172.21.15.94:6812","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":37464},{"type":"v1","addr":"172.21.15.94:6816","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":37464},{"type":"v1","addr":"172.21.15.94:6823","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":37464},{"type":"v1","addr":"172.21.15.94:6820","nonce":37464}]},"public_addr":"172.21.15.94:6812/37464","cluster_addr":"172.21.15.94:6816/37464","heartbeat_back_addr":"172.21.15.94:6823/37464","heartbeat_front_addr":"172.21.15.94:6820/37464","state":["exists","up"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":37467},{"type":"v1","addr":"172.21.15.94:6825","nonce":37467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":37467},{"type":"v1","addr":"172.21.15.94:6827","nonce":37467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":37467},{"type":"v1","addr":"172.21.15.94:6831","nonce":37467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":37467},{"type":"v1","addr":"172.21.15.94:6829","nonce":37467}]},"public_addr":"172.21.15.94:6825/37467","cluster_addr":"172.21.15.94:6827/37467","heartbeat_back_addr":"172.21.15.94:6831/37467","heartbeat_front_addr":"172.21.15.94:6829/37467","state":["exists","up"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":37466},{"type":"v1","addr":"172.21.15.94:6801","nonce":37466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":37466},{"type":"v1","addr":"172.21.15.94:6803","nonce":37466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":37466},{"type":"v1","addr":"172.21.15.94:6807","nonce":37466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":37466},{"type":"v1","addr":"172.21.15.94:6805","nonce":37466}]},"public_addr":"172.21.15.94:6801/37466","cluster_addr":"172.21.15.94:6803/37466","heartbeat_back_addr":"172.21.15.94:6807/37466","heartbeat_front_addr":"172.21.15.94:6805/37466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.327217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.186966+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.419986+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.150585+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.120621+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.121576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.181257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.293188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:18:42.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.358+0000 7f4cf4600640 1 -- 172.21.15.17:0/3082847140 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f4ccc06aba0 msgr2=0x7f4ccc06d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:42.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.358+0000 7f4cf4600640 1 --2- 172.21.15.17:0/3082847140 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f4ccc06aba0 0x7f4ccc06d060 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4ce4003d90 tx=0x7f4ce4009040 comp rx=0 tx=0).stop 2024-03-12T17:18:42.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.359+0000 7f4cf4600640 1 -- 172.21.15.17:0/3082847140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cec0cb1f0 msgr2=0x7f4cec154d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:42.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.359+0000 7f4cf4600640 1 --2- 172.21.15.17:0/3082847140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cec0cb1f0 0x7f4cec154d00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc02b9e0 tx=0x7f4cdc004730 comp rx=0 tx=0).stop 2024-03-12T17:18:42.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.359+0000 7f4cf4600640 1 -- 172.21.15.17:0/3082847140 shutdown_connections 2024-03-12T17:18:42.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.359+0000 7f4cf4600640 1 --2- 172.21.15.17:0/3082847140 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f4ccc06aba0 0x7f4ccc06d060 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:42.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.359+0000 7f4cf4600640 1 --2- 172.21.15.17:0/3082847140 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4cec0cb1f0 0x7f4cec154d00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:42.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.359+0000 7f4cf4600640 1 --2- 172.21.15.17:0/3082847140 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4cec0b1e20 0x7f4cec151fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:42.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.359+0000 7f4cf4600640 1 --2- 172.21.15.17:0/3082847140 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4cec098b40 0x7f4cec1f6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:42.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.359+0000 7f4cf4600640 1 -- 172.21.15.17:0/3082847140 >> 172.21.15.17:0/3082847140 conn(0x7f4cec0b23d0 msgr2=0x7f4cec0ae520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:42.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.359+0000 7f4cf4600640 1 -- 172.21.15.17:0/3082847140 shutdown_connections 2024-03-12T17:18:42.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.359+0000 7f4cf4600640 1 -- 172.21.15.17:0/3082847140 wait complete. 2024-03-12T17:18:42.372 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-12T17:18:39.552910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-12T17:18:42.373 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-12T17:18:42.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.580+0000 7fafcea00640 1 Processor -- start 2024-03-12T17:18:42.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.581+0000 7fafcea00640 1 -- start start 2024-03-12T17:18:42.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.582+0000 7fafcea00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fafc80d2fa0 0x7fafc80d3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:42.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.582+0000 7fafcea00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fafc80b5b50 0x7fafc80b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:42.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.582+0000 7fafcea00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafc80d14e0 con 0x7fafc80cd840 2024-03-12T17:18:42.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.582+0000 7fafcea00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafc80b59e0 con 0x7fafc80d2fa0 2024-03-12T17:18:42.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.582+0000 7fafcea00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc80d38c0 con 0x7fafc80b5b50 2024-03-12T17:18:42.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.582+0000 7fafc7e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fafc80d2fa0 0x7fafc80d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:42.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.582+0000 7fafc7e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fafc80d2fa0 0x7fafc80d3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47878/0 (socket says 172.21.15.17:47878) 2024-03-12T17:18:42.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.582+0000 7fafc7e00640 1 -- 172.21.15.17:0/4219328656 learned_addr learned my addr 172.21.15.17:0/4219328656 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:42.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.583+0000 7fafbfe00640 1 --2- 172.21.15.17:0/4219328656 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fafc80b5b50 0x7fafc80b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:42.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.583+0000 7fafc7e00640 1 -- 172.21.15.17:0/4219328656 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fafc80b5b50 msgr2=0x7fafc80b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:42.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.583+0000 7fafc7e00640 1 --2- 172.21.15.17:0/4219328656 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fafc80b5b50 0x7fafc80b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:42.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.583+0000 7fafc7e00640 1 -- 172.21.15.17:0/4219328656 >> v1:172.21.15.94:6789/0 conn(0x7fafc80cd840 legacy=0x7fafc80d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:42.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.583+0000 7fafc7e00640 1 -- 172.21.15.17:0/4219328656 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc80b85b0 con 0x7fafc80d2fa0 2024-03-12T17:18:42.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.583+0000 7fafbfe00640 1 --2- 172.21.15.17:0/4219328656 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fafc80b5b50 0x7fafc80b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:18:42.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.584+0000 7fafc7e00640 1 --2- 172.21.15.17:0/4219328656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafc80d2fa0 0x7fafc80d3380 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fafb8009870 tx=0x7fafb802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac422931a636fab1 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:42.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.584+0000 7fafc7400640 1 -- 172.21.15.17:0/4219328656 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb8031640 con 0x7fafc80d2fa0 2024-03-12T17:18:42.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.584+0000 7fafc7400640 1 -- 172.21.15.17:0/4219328656 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb80317a0 con 0x7fafc80d2fa0 2024-03-12T17:18:42.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.584+0000 7fafc7400640 1 -- 172.21.15.17:0/4219328656 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb8031b30 con 0x7fafc80d2fa0 2024-03-12T17:18:42.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.585+0000 7fafcea00640 1 -- 172.21.15.17:0/4219328656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafc80d2fa0 msgr2=0x7fafc80d3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:42.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.585+0000 7fafcea00640 1 --2- 172.21.15.17:0/4219328656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafc80d2fa0 0x7fafc80d3380 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fafb8009870 tx=0x7fafb802b8f0 comp rx=0 tx=0).stop 2024-03-12T17:18:42.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.586+0000 7fafcea00640 1 -- 172.21.15.17:0/4219328656 shutdown_connections 2024-03-12T17:18:42.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.586+0000 7fafcea00640 1 --2- 172.21.15.17:0/4219328656 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fafc80b5b50 0x7fafc80b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:42.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.586+0000 7fafcea00640 1 --2- 172.21.15.17:0/4219328656 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafc80d2fa0 0x7fafc80d3380 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:42.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.586+0000 7fafcea00640 1 -- 172.21.15.17:0/4219328656 >> 172.21.15.17:0/4219328656 conn(0x7fafc8065df0 msgr2=0x7fafc8066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:42.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.586+0000 7fafcea00640 1 -- 172.21.15.17:0/4219328656 shutdown_connections 2024-03-12T17:18:42.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.586+0000 7fafcea00640 1 -- 172.21.15.17:0/4219328656 wait complete. 2024-03-12T17:18:42.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.588+0000 7fafcea00640 1 Processor -- start 2024-03-12T17:18:42.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.588+0000 7fafcea00640 1 -- start start 2024-03-12T17:18:42.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.589+0000 7fafcea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafc80b5b50 0x7fafc815adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:42.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.589+0000 7fafcea00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafc80cd840 0x7fafc815f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:42.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.589+0000 7fafcea00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fafc80d2fa0 0x7fafc815f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:42.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.589+0000 7fafcea00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc80cb340 con 0x7fafc80b5b50 2024-03-12T17:18:42.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.589+0000 7fafcea00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc815b330 con 0x7fafc80cd840 2024-03-12T17:18:42.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.589+0000 7fafcea00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc815fc10 con 0x7fafc80d2fa0 2024-03-12T17:18:42.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.589+0000 7fafc7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafc80b5b50 0x7fafc815adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:42.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.589+0000 7fafc7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafc80b5b50 0x7fafc815adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47890/0 (socket says 172.21.15.17:47890) 2024-03-12T17:18:42.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.589+0000 7fafc7e00640 1 -- 172.21.15.17:0/2280091237 learned_addr learned my addr 172.21.15.17:0/2280091237 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:42.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.589+0000 7fafcca00640 1 --2- 172.21.15.17:0/2280091237 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fafc80d2fa0 0x7fafc815f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:42.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.589+0000 7fafc7e00640 1 -- 172.21.15.17:0/2280091237 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fafc80d2fa0 msgr2=0x7fafc815f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:42.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.589+0000 7fafbfe00640 1 --2- 172.21.15.17:0/2280091237 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafc80cd840 0x7fafc815f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:42.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.590+0000 7fafc7e00640 1 --2- 172.21.15.17:0/2280091237 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fafc80d2fa0 0x7fafc815f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:42.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.590+0000 7fafc7e00640 1 -- 172.21.15.17:0/2280091237 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafc80cd840 msgr2=0x7fafc815f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:42.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.590+0000 7fafc7e00640 1 --2- 172.21.15.17:0/2280091237 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafc80cd840 0x7fafc815f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:42.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.590+0000 7fafc7e00640 1 -- 172.21.15.17:0/2280091237 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb80094d0 con 0x7fafc80b5b50 2024-03-12T17:18:42.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.590+0000 7fafcca00640 1 --2- 172.21.15.17:0/2280091237 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fafc80d2fa0 0x7fafc815f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:18:42.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.590+0000 7fafc7e00640 1 --2- 172.21.15.17:0/2280091237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafc80b5b50 0x7fafc815adf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fafb8009870 tx=0x7fafb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:42.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.590+0000 7fafc4c00640 1 -- 172.21.15.17:0/2280091237 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb803ac60 con 0x7fafc80b5b50 2024-03-12T17:18:42.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.590+0000 7fafc4c00640 1 -- 172.21.15.17:0/2280091237 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb803adc0 con 0x7fafc80b5b50 2024-03-12T17:18:42.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.590+0000 7fafc4c00640 1 -- 172.21.15.17:0/2280091237 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb8044630 con 0x7fafc80b5b50 2024-03-12T17:18:42.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.590+0000 7fafcea00640 1 -- 172.21.15.17:0/2280091237 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc80cac80 con 0x7fafc80b5b50 2024-03-12T17:18:42.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.590+0000 7fafcea00640 1 -- 172.21.15.17:0/2280091237 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc815b7c0 con 0x7fafc80b5b50 2024-03-12T17:18:42.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.592+0000 7fafcea00640 1 -- 172.21.15.17:0/2280091237 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafc80736c0 con 0x7fafc80b5b50 2024-03-12T17:18:42.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.593+0000 7fafc4c00640 1 -- 172.21.15.17:0/2280091237 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 4) v1 ==== 89081+0+0 (secure 0 0 0) 0x7fafb802f050 con 0x7fafc80b5b50 2024-03-12T17:18:42.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.594+0000 7fafc4c00640 1 --2- 172.21.15.17:0/2280091237 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fafa406ab70 0x7fafa406d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:42.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.594+0000 7fafc4c00640 1 -- 172.21.15.17:0/2280091237 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fafb80aafe0 con 0x7fafc80b5b50 2024-03-12T17:18:42.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.594+0000 7fafbfe00640 1 --2- 172.21.15.17:0/2280091237 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fafa406ab70 0x7fafa406d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:42.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.595+0000 7fafbfe00640 1 --2- 172.21.15.17:0/2280091237 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fafa406ab70 0x7fafa406d030 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fafc8067170 tx=0x7fafb0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:42.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.599+0000 7fafc4c00640 1 -- 172.21.15.17:0/2280091237 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fafb80764c0 con 0x7fafc80b5b50 2024-03-12T17:18:42.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.801+0000 7fafcea00640 1 -- 172.21.15.17:0/2280091237 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fafc8066e10 con 0x7fafc80b5b50 2024-03-12T17:18:42.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.802+0000 7fafc4c00640 1 -- 172.21.15.17:0/2280091237 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fafb8031e60 con 0x7fafc80b5b50 2024-03-12T17:18:42.796 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-03-12T17:18:42.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.804+0000 7fafcea00640 1 -- 172.21.15.17:0/2280091237 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fafa406ab70 msgr2=0x7fafa406d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:42.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.804+0000 7fafcea00640 1 --2- 172.21.15.17:0/2280091237 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fafa406ab70 0x7fafa406d030 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fafc8067170 tx=0x7fafb0008040 comp rx=0 tx=0).stop 2024-03-12T17:18:42.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.804+0000 7fafcea00640 1 -- 172.21.15.17:0/2280091237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafc80b5b50 msgr2=0x7fafc815adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:42.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.804+0000 7fafcea00640 1 --2- 172.21.15.17:0/2280091237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafc80b5b50 0x7fafc815adf0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fafb8009870 tx=0x7fafb80046c0 comp rx=0 tx=0).stop 2024-03-12T17:18:42.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.804+0000 7fafcea00640 1 -- 172.21.15.17:0/2280091237 shutdown_connections 2024-03-12T17:18:42.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.804+0000 7fafcea00640 1 --2- 172.21.15.17:0/2280091237 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fafa406ab70 0x7fafa406d030 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:42.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.804+0000 7fafcea00640 1 --2- 172.21.15.17:0/2280091237 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fafc80d2fa0 0x7fafc815f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:42.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.804+0000 7fafcea00640 1 --2- 172.21.15.17:0/2280091237 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafc80cd840 0x7fafc815f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:42.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.804+0000 7fafcea00640 1 --2- 172.21.15.17:0/2280091237 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafc80b5b50 0x7fafc815adf0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:42.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.805+0000 7fafcea00640 1 -- 172.21.15.17:0/2280091237 >> 172.21.15.17:0/2280091237 conn(0x7fafc8065df0 msgr2=0x7fafc80c8540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:42.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.805+0000 7fafcea00640 1 -- 172.21.15.17:0/2280091237 shutdown_connections 2024-03-12T17:18:42.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:42.805+0000 7fafcea00640 1 -- 172.21.15.17:0/2280091237 wait complete. 2024-03-12T17:18:42.818 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-12T17:18:43.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.052+0000 7f85b1400640 1 Processor -- start 2024-03-12T17:18:43.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.052+0000 7f85b1400640 1 -- start start 2024-03-12T17:18:43.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.054+0000 7f85b1400640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f85ac146650 0x7f85ac0ae330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:43.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.054+0000 7f85b1400640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85ac0abd60 con 0x7f85ac1610e0 2024-03-12T17:18:43.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.054+0000 7f85b1400640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85ac1617e0 con 0x7f85ac0ab8d0 2024-03-12T17:18:43.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.054+0000 7f85b1400640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85ac0adc30 con 0x7f85ac146650 2024-03-12T17:18:43.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.054+0000 7f85ab200640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f85ac1610e0 0x7f85ac06c8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37724/0 (socket says 172.21.15.17:37724) 2024-03-12T17:18:43.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.054+0000 7f85ab200640 1 -- 172.21.15.17:0/3367137473 learned_addr learned my addr 172.21.15.17:0/3367137473 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:18:43.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.054+0000 7f85aa800640 1 --2- 172.21.15.17:0/3367137473 >> v2:172.21.15.94:3300/0 conn(0x7f85ac146650 0x7f85ac0ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:43.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.055+0000 7f85a9400640 1 -- 172.21.15.17:0/3367137473 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1504136853 0 0) 0x7f85ac0abd60 con 0x7f85ac1610e0 2024-03-12T17:18:43.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.055+0000 7f85a9400640 1 -- 172.21.15.17:0/3367137473 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8590003520 con 0x7f85ac1610e0 2024-03-12T17:18:43.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.055+0000 7f85a9400640 1 -- 172.21.15.17:0/3367137473 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 814033257 0 0) 0x7f8590003520 con 0x7f85ac1610e0 2024-03-12T17:18:43.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.055+0000 7f85a9400640 1 -- 172.21.15.17:0/3367137473 >> v2:172.21.15.94:3300/0 conn(0x7f85ac146650 msgr2=0x7f85ac0ae330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:43.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.055+0000 7f85a9400640 1 --2- 172.21.15.17:0/3367137473 >> v2:172.21.15.94:3300/0 conn(0x7f85ac146650 0x7f85ac0ae330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:43.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.055+0000 7f85a9400640 1 -- 172.21.15.17:0/3367137473 >> v1:172.21.15.94:6789/0 conn(0x7f85ac0ab8d0 legacy=0x7f85ac1609d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:43.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.055+0000 7f85a9400640 1 -- 172.21.15.17:0/3367137473 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ac0b3d10 con 0x7f85ac1610e0 2024-03-12T17:18:43.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.055+0000 7f85a9400640 1 -- 172.21.15.17:0/3367137473 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7f85a40019f0 con 0x7f85ac1610e0 2024-03-12T17:18:43.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.055+0000 7f85a9400640 1 -- 172.21.15.17:0/3367137473 >> v1:172.21.15.17:6789/0 conn(0x7f85ac1610e0 legacy=0x7f85ac06c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:43.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.055+0000 7f85a9400640 1 --2- 172.21.15.17:0/3367137473 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8590003970 0x7f8590003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:43.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.055+0000 7f85a9400640 1 --2- 172.21.15.17:0/3367137473 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8590004370 0x7f8590004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:43.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.055+0000 7f85a9400640 1 --2- 172.21.15.17:0/3367137473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8590005040 0x7f859000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:43.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.055+0000 7f85a9400640 1 -- 172.21.15.17:0/3367137473 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac0adc30 con 0x7f8590005040 2024-03-12T17:18:43.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.055+0000 7f85a9400640 1 -- 172.21.15.17:0/3367137473 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f859000bfa0 con 0x7f8590003970 2024-03-12T17:18:43.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.055+0000 7f85a9400640 1 -- 172.21.15.17:0/3367137473 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f859000c160 con 0x7f8590004370 2024-03-12T17:18:43.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.056+0000 7f85ab200640 1 --2- 172.21.15.17:0/3367137473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8590005040 0x7f859000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:43.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.056+0000 7f85aa800640 1 --2- 172.21.15.17:0/3367137473 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8590003970 0x7f8590003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:43.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.056+0000 7f85a9e00640 1 --2- 172.21.15.17:0/3367137473 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8590004370 0x7f8590004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:43.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.056+0000 7f85ab200640 1 -- 172.21.15.17:0/3367137473 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8590004370 msgr2=0x7f8590004840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:43.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.056+0000 7f85ab200640 1 --2- 172.21.15.17:0/3367137473 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8590004370 0x7f8590004840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:43.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.056+0000 7f85ab200640 1 -- 172.21.15.17:0/3367137473 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8590003970 msgr2=0x7f8590003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:43.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.056+0000 7f85ab200640 1 --2- 172.21.15.17:0/3367137473 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8590003970 0x7f8590003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:43.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.056+0000 7f85ab200640 1 -- 172.21.15.17:0/3367137473 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8590003520 con 0x7f8590005040 2024-03-12T17:18:43.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.057+0000 7f85ab200640 1 -- 172.21.15.17:0/3367137473 reap_dead start 2024-03-12T17:18:43.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.057+0000 7f85ab200640 1 --2- 172.21.15.17:0/3367137473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8590005040 0x7f859000b980 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f85a400a7a0 tx=0x7f85900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b190e114f7119266 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:43.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.057+0000 7f85a9400640 1 -- 172.21.15.17:0/3367137473 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a4034630 con 0x7f8590005040 2024-03-12T17:18:43.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.057+0000 7f85a9400640 1 -- 172.21.15.17:0/3367137473 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a402f070 con 0x7f8590005040 2024-03-12T17:18:43.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.057+0000 7f85a9400640 1 -- 172.21.15.17:0/3367137473 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a40349f0 con 0x7f8590005040 2024-03-12T17:18:43.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.058+0000 7f85b1400640 1 -- 172.21.15.17:0/3367137473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8590005040 msgr2=0x7f859000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:43.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.058+0000 7f85b1400640 1 --2- 172.21.15.17:0/3367137473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8590005040 0x7f859000b980 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f85a400a7a0 tx=0x7f85900057f0 comp rx=0 tx=0).stop 2024-03-12T17:18:43.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.058+0000 7f85b1400640 1 -- 172.21.15.17:0/3367137473 shutdown_connections 2024-03-12T17:18:43.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.058+0000 7f85b1400640 1 --2- 172.21.15.17:0/3367137473 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8590005040 0x7f859000b980 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:43.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.058+0000 7f85b1400640 1 -- 172.21.15.17:0/3367137473 >> 172.21.15.17:0/3367137473 conn(0x7f85ac0b0a30 msgr2=0x7f85ac0b0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:43.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.058+0000 7f85b1400640 1 -- 172.21.15.17:0/3367137473 shutdown_connections 2024-03-12T17:18:43.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.058+0000 7f85b1400640 1 -- 172.21.15.17:0/3367137473 wait complete. 2024-03-12T17:18:43.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.060+0000 7f85b1400640 1 Processor -- start 2024-03-12T17:18:43.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.060+0000 7f85b1400640 1 -- start start 2024-03-12T17:18:43.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.061+0000 7f85b1400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8590005040 0x7f85ac0c6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:43.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.061+0000 7f85b1400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85ac0b1e60 0x7f85ac15c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:43.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.061+0000 7f85b1400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f85ac0af620 0x7f85ac0afaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:43.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.061+0000 7f85b1400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac0c5e80 con 0x7f85ac0b1e60 2024-03-12T17:18:43.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.061+0000 7f85b1400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac0affe0 con 0x7f8590005040 2024-03-12T17:18:43.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.061+0000 7f85b1400640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac0c5270 con 0x7f85ac0af620 2024-03-12T17:18:43.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.061+0000 7f85a9e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85ac0b1e60 0x7f85ac15c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:43.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.061+0000 7f85a9e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85ac0b1e60 0x7f85ac15c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47912/0 (socket says 172.21.15.17:47912) 2024-03-12T17:18:43.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.061+0000 7f85a9e00640 1 -- 172.21.15.17:0/1872386146 learned_addr learned my addr 172.21.15.17:0/1872386146 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:43.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.061+0000 7f85aa800640 1 --2- 172.21.15.17:0/1872386146 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8590005040 0x7f85ac0c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:43.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.061+0000 7f85ab200640 1 --2- 172.21.15.17:0/1872386146 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f85ac0af620 0x7f85ac0afaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:43.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.062+0000 7f85a9e00640 1 -- 172.21.15.17:0/1872386146 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f85ac0af620 msgr2=0x7f85ac0afaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:43.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.062+0000 7f85a9e00640 1 --2- 172.21.15.17:0/1872386146 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f85ac0af620 0x7f85ac0afaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:43.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.062+0000 7f85a9e00640 1 -- 172.21.15.17:0/1872386146 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8590005040 msgr2=0x7f85ac0c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:43.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.062+0000 7f85a9e00640 1 --2- 172.21.15.17:0/1872386146 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8590005040 0x7f85ac0c6310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:43.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.062+0000 7f85a9e00640 1 -- 172.21.15.17:0/1872386146 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ac0c5550 con 0x7f85ac0b1e60 2024-03-12T17:18:43.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.062+0000 7f85a9e00640 1 --2- 172.21.15.17:0/1872386146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85ac0b1e60 0x7f85ac15c870 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f859800f7c0 tx=0x7f859800fbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:43.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.062+0000 7f85a2a00640 1 -- 172.21.15.17:0/1872386146 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85980050d0 con 0x7f85ac0b1e60 2024-03-12T17:18:43.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.062+0000 7f85a2a00640 1 -- 172.21.15.17:0/1872386146 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8598005270 con 0x7f85ac0b1e60 2024-03-12T17:18:43.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.062+0000 7f85b1400640 1 -- 172.21.15.17:0/1872386146 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85ac0c5830 con 0x7f85ac0b1e60 2024-03-12T17:18:43.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.062+0000 7f85a2a00640 1 -- 172.21.15.17:0/1872386146 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859800d730 con 0x7f85ac0b1e60 2024-03-12T17:18:43.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.062+0000 7f85b1400640 1 -- 172.21.15.17:0/1872386146 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85ac0b22c0 con 0x7f85ac0b1e60 2024-03-12T17:18:43.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.064+0000 7f85b1400640 1 -- 172.21.15.17:0/1872386146 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85ac0c6850 con 0x7f85ac0b1e60 2024-03-12T17:18:43.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.065+0000 7f85a2a00640 1 -- 172.21.15.17:0/1872386146 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 4) v1 ==== 89081+0+0 (secure 0 0 0) 0x7f859800d890 con 0x7f85ac0b1e60 2024-03-12T17:18:43.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.065+0000 7f85a2a00640 1 --2- 172.21.15.17:0/1872386146 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f858c06ab70 0x7f858c06d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:43.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.066+0000 7f85a2a00640 1 -- 172.21.15.17:0/1872386146 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8598088f00 con 0x7f85ac0b1e60 2024-03-12T17:18:43.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.066+0000 7f85aa800640 1 --2- 172.21.15.17:0/1872386146 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f858c06ab70 0x7f858c06d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:43.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.066+0000 7f85aa800640 1 --2- 172.21.15.17:0/1872386146 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f858c06ab70 0x7f858c06d030 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f859c009b40 tx=0x7f859c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:43.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.070+0000 7f85a2a00640 1 -- 172.21.15.17:0/1872386146 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f85980543e0 con 0x7f85ac0b1e60 2024-03-12T17:18:43.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.273+0000 7f85b1400640 1 -- 172.21.15.17:0/1872386146 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f85ac0736c0 con 0x7f85ac0b1e60 2024-03-12T17:18:43.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.274+0000 7f85a2a00640 1 -- 172.21.15.17:0/1872386146 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f8598057a00 con 0x7f85ac0b1e60 2024-03-12T17:18:43.268 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:18:43.268 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2024-03-12T17:18:43.268 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:18:43.268 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2024-03-12T17:18:43.268 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2024-03-12T17:18:43.268 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:18:43.268 INFO:teuthology.orchestra.run.smithi017.stdout:] 2024-03-12T17:18:43.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.277+0000 7f85b1400640 1 -- 172.21.15.17:0/1872386146 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f858c06ab70 msgr2=0x7f858c06d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:43.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.277+0000 7f85b1400640 1 --2- 172.21.15.17:0/1872386146 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f858c06ab70 0x7f858c06d030 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f859c009b40 tx=0x7f859c009190 comp rx=0 tx=0).stop 2024-03-12T17:18:43.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.277+0000 7f85b1400640 1 -- 172.21.15.17:0/1872386146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85ac0b1e60 msgr2=0x7f85ac15c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:43.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.277+0000 7f85b1400640 1 --2- 172.21.15.17:0/1872386146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85ac0b1e60 0x7f85ac15c870 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f859800f7c0 tx=0x7f859800fbc0 comp rx=0 tx=0).stop 2024-03-12T17:18:43.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.277+0000 7f85b1400640 1 -- 172.21.15.17:0/1872386146 shutdown_connections 2024-03-12T17:18:43.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.277+0000 7f85b1400640 1 --2- 172.21.15.17:0/1872386146 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f858c06ab70 0x7f858c06d030 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:43.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.277+0000 7f85b1400640 1 --2- 172.21.15.17:0/1872386146 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f85ac0af620 0x7f85ac0afaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:43.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.277+0000 7f85b1400640 1 --2- 172.21.15.17:0/1872386146 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85ac0b1e60 0x7f85ac15c870 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:43.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.277+0000 7f85b1400640 1 --2- 172.21.15.17:0/1872386146 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8590005040 0x7f85ac0c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:43.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.277+0000 7f85b1400640 1 -- 172.21.15.17:0/1872386146 >> 172.21.15.17:0/1872386146 conn(0x7f85ac0b0a30 msgr2=0x7f85ac144900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:43.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.277+0000 7f85b1400640 1 -- 172.21.15.17:0/1872386146 shutdown_connections 2024-03-12T17:18:43.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.277+0000 7f85b1400640 1 -- 172.21.15.17:0/1872386146 wait complete. 2024-03-12T17:18:43.289 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-12T17:18:43.290 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-12T17:18:43.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.525+0000 7f2145e00640 1 Processor -- start 2024-03-12T17:18:43.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.525+0000 7f2145e00640 1 -- start start 2024-03-12T17:18:43.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.526+0000 7f2145e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f21400d2c50 0x7f21400d1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:43.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.526+0000 7f2145e00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21400d0030 con 0x7f21400d27d0 2024-03-12T17:18:43.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.526+0000 7f2145e00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21400cf160 con 0x7f214015cb50 2024-03-12T17:18:43.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.526+0000 7f2145e00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21400cf420 con 0x7f21400d2c50 2024-03-12T17:18:43.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.526+0000 7f2144a00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f214015cb50 0x7f21400cdab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.17:51182/0 (socket says 172.21.15.17:51182) 2024-03-12T17:18:43.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.527+0000 7f2144a00640 1 -- 172.21.15.17:0/2649786914 learned_addr learned my addr 172.21.15.17:0/2649786914 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:18:43.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.527+0000 7f2137e00640 1 --1- 172.21.15.17:0/2649786914 >> v1:172.21.15.17:6789/0 conn(0x7f21400d27d0 0x7f21400d0b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37730/0 (socket says 172.21.15.17:37730) 2024-03-12T17:18:43.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.527+0000 7f2145400640 1 --2- 172.21.15.17:0/2649786914 >> v2:172.21.15.94:3300/0 conn(0x7f21400d2c50 0x7f21400d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:43.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.527+0000 7f213fe00640 1 -- 172.21.15.17:0/2649786914 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2372985162 0 0) 0x7f21400cf160 con 0x7f214015cb50 2024-03-12T17:18:43.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.527+0000 7f213fe00640 1 -- 172.21.15.17:0/2649786914 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2124003520 con 0x7f214015cb50 2024-03-12T17:18:43.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.527+0000 7f213fe00640 1 -- 172.21.15.17:0/2649786914 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4235737633 0 0) 0x7f21400d0030 con 0x7f21400d27d0 2024-03-12T17:18:43.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.527+0000 7f213fe00640 1 -- 172.21.15.17:0/2649786914 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21400cf160 con 0x7f21400d27d0 2024-03-12T17:18:43.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.527+0000 7f2145400640 1 -- 172.21.15.17:0/2649786914 >> v1:172.21.15.94:6789/0 conn(0x7f214015cb50 legacy=0x7f21400cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:43.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.527+0000 7f2145400640 1 -- 172.21.15.17:0/2649786914 >> v1:172.21.15.17:6789/0 conn(0x7f21400d27d0 legacy=0x7f21400d0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:43.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.527+0000 7f2145400640 1 -- 172.21.15.17:0/2649786914 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21400cf700 con 0x7f21400d2c50 2024-03-12T17:18:43.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.528+0000 7f2145400640 1 --2- 172.21.15.17:0/2649786914 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f21400d2c50 0x7f21400d1260 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2138009d90 tx=0x7f213802bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7878c16d9de4b5f8 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:43.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.529+0000 7f213fe00640 1 -- 172.21.15.17:0/2649786914 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213802cd00 con 0x7f21400d2c50 2024-03-12T17:18:43.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.529+0000 7f213fe00640 1 -- 172.21.15.17:0/2649786914 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213802ce60 con 0x7f21400d2c50 2024-03-12T17:18:43.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.529+0000 7f213fe00640 1 -- 172.21.15.17:0/2649786914 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2138034660 con 0x7f21400d2c50 2024-03-12T17:18:43.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.529+0000 7f2145e00640 1 -- 172.21.15.17:0/2649786914 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f21400d2c50 msgr2=0x7f21400d1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:43.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.529+0000 7f2145e00640 1 --2- 172.21.15.17:0/2649786914 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f21400d2c50 0x7f21400d1260 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2138009d90 tx=0x7f213802bf50 comp rx=0 tx=0).stop 2024-03-12T17:18:43.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.529+0000 7f2145e00640 1 -- 172.21.15.17:0/2649786914 shutdown_connections 2024-03-12T17:18:43.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.529+0000 7f2145e00640 1 --2- 172.21.15.17:0/2649786914 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f21400d2c50 0x7f21400d1260 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:43.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.529+0000 7f2145e00640 1 -- 172.21.15.17:0/2649786914 >> 172.21.15.17:0/2649786914 conn(0x7f214006afd0 msgr2=0x7f214006b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:43.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.529+0000 7f2145e00640 1 -- 172.21.15.17:0/2649786914 shutdown_connections 2024-03-12T17:18:43.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.530+0000 7f2145e00640 1 -- 172.21.15.17:0/2649786914 wait complete. 2024-03-12T17:18:43.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.531+0000 7f2145e00640 1 Processor -- start 2024-03-12T17:18:43.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.531+0000 7f2145e00640 1 -- start start 2024-03-12T17:18:43.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.532+0000 7f2145e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f21400d27d0 0x7f21400b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:43.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.532+0000 7f2145e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f21400d2c50 0x7f21400c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:43.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.532+0000 7f2145e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f214015cb50 0x7f21400cb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:43.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.532+0000 7f2145e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21400c7270 con 0x7f214015cb50 2024-03-12T17:18:43.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.532+0000 7f2145e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21400c7550 con 0x7f21400d2c50 2024-03-12T17:18:43.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.532+0000 7f2145e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21400c7830 con 0x7f21400d27d0 2024-03-12T17:18:43.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.533+0000 7f2145400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f214015cb50 0x7f21400cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:43.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.533+0000 7f2145400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f214015cb50 0x7f21400cb110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47924/0 (socket says 172.21.15.17:47924) 2024-03-12T17:18:43.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.533+0000 7f2145400640 1 -- 172.21.15.17:0/2984878058 learned_addr learned my addr 172.21.15.17:0/2984878058 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:43.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.533+0000 7f2137e00640 1 --2- 172.21.15.17:0/2984878058 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f21400d2c50 0x7f21400c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:43.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.533+0000 7f2144a00640 1 --2- 172.21.15.17:0/2984878058 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f21400d27d0 0x7f21400b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:43.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.533+0000 7f2145400640 1 -- 172.21.15.17:0/2984878058 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f21400d27d0 msgr2=0x7f21400b4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:43.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.533+0000 7f2145400640 1 --2- 172.21.15.17:0/2984878058 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f21400d27d0 0x7f21400b4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:43.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.533+0000 7f2145400640 1 -- 172.21.15.17:0/2984878058 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f21400d2c50 msgr2=0x7f21400c8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:43.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.533+0000 7f2145400640 1 --2- 172.21.15.17:0/2984878058 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f21400d2c50 0x7f21400c8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:43.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.533+0000 7f2145400640 1 -- 172.21.15.17:0/2984878058 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2138009a70 con 0x7f214015cb50 2024-03-12T17:18:43.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.534+0000 7f2145400640 1 --2- 172.21.15.17:0/2984878058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f214015cb50 0x7f21400cb110 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2138009d90 tx=0x7f2138004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:43.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.534+0000 7f213d600640 1 -- 172.21.15.17:0/2984878058 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213803d600 con 0x7f214015cb50 2024-03-12T17:18:43.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.534+0000 7f213d600640 1 -- 172.21.15.17:0/2984878058 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213803d780 con 0x7f214015cb50 2024-03-12T17:18:43.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.534+0000 7f2145e00640 1 -- 172.21.15.17:0/2984878058 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21400c7b10 con 0x7f214015cb50 2024-03-12T17:18:43.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.534+0000 7f213d600640 1 -- 172.21.15.17:0/2984878058 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213803db30 con 0x7f214015cb50 2024-03-12T17:18:43.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.534+0000 7f2145e00640 1 -- 172.21.15.17:0/2984878058 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21400c8e90 con 0x7f214015cb50 2024-03-12T17:18:43.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.535+0000 7f2145e00640 1 -- 172.21.15.17:0/2984878058 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f214004e030 con 0x7f214015cb50 2024-03-12T17:18:43.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.536+0000 7f213d600640 1 -- 172.21.15.17:0/2984878058 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 4) v1 ==== 89081+0+0 (secure 0 0 0) 0x7f213803b040 con 0x7f214015cb50 2024-03-12T17:18:43.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.537+0000 7f213d600640 1 --2- 172.21.15.17:0/2984878058 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f212006aba0 0x7f212006d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:43.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.537+0000 7f213d600640 1 -- 172.21.15.17:0/2984878058 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f21380aaf50 con 0x7f214015cb50 2024-03-12T17:18:43.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.537+0000 7f2144a00640 1 --2- 172.21.15.17:0/2984878058 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f212006aba0 0x7f212006d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:43.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.538+0000 7f2144a00640 1 --2- 172.21.15.17:0/2984878058 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f212006aba0 0x7f212006d060 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f212c000f60 tx=0x7f212c007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:43.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.541+0000 7f213d600640 1 -- 172.21.15.17:0/2984878058 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f2138076600 con 0x7f214015cb50 2024-03-12T17:18:43.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:43.740+0000 7f2145e00640 1 -- 172.21.15.17:0/2984878058 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f21400d0550 con 0x7f214015cb50 2024-03-12T17:18:44.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.343+0000 7f213d600640 1 -- 172.21.15.17:0/2984878058 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f21380769d0 con 0x7f214015cb50 2024-03-12T17:18:44.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.345+0000 7f213d600640 1 -- 172.21.15.17:0/2984878058 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2138072e80 con 0x7f214015cb50 2024-03-12T17:18:44.340 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2024-03-12T17:18:44.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.351+0000 7f2145e00640 1 -- 172.21.15.17:0/2984878058 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f212006aba0 msgr2=0x7f212006d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:44.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.351+0000 7f2145e00640 1 --2- 172.21.15.17:0/2984878058 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f212006aba0 0x7f212006d060 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f212c000f60 tx=0x7f212c007d50 comp rx=0 tx=0).stop 2024-03-12T17:18:44.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.351+0000 7f2145e00640 1 -- 172.21.15.17:0/2984878058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f214015cb50 msgr2=0x7f21400cb110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:44.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.351+0000 7f2145e00640 1 --2- 172.21.15.17:0/2984878058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f214015cb50 0x7f21400cb110 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2138009d90 tx=0x7f2138004a40 comp rx=0 tx=0).stop 2024-03-12T17:18:44.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.352+0000 7f2145e00640 1 -- 172.21.15.17:0/2984878058 shutdown_connections 2024-03-12T17:18:44.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.352+0000 7f2145e00640 1 --2- 172.21.15.17:0/2984878058 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f212006aba0 0x7f212006d060 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:44.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.352+0000 7f2145e00640 1 --2- 172.21.15.17:0/2984878058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f214015cb50 0x7f21400cb110 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:44.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.352+0000 7f2145e00640 1 --2- 172.21.15.17:0/2984878058 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f21400d2c50 0x7f21400c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:44.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.352+0000 7f2145e00640 1 --2- 172.21.15.17:0/2984878058 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f21400d27d0 0x7f21400b4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:44.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.352+0000 7f2145e00640 1 -- 172.21.15.17:0/2984878058 >> 172.21.15.17:0/2984878058 conn(0x7f214006afd0 msgr2=0x7f214015dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:44.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.353+0000 7f2145e00640 1 -- 172.21.15.17:0/2984878058 shutdown_connections 2024-03-12T17:18:44.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.353+0000 7f2145e00640 1 -- 172.21.15.17:0/2984878058 wait complete. 2024-03-12T17:18:44.371 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-12T17:18:44.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.592+0000 7fe327000640 1 Processor -- start 2024-03-12T17:18:44.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.593+0000 7fe327000640 1 -- start start 2024-03-12T17:18:44.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.595+0000 7fe327000640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe3201598a0 0x7fe3200ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:44.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.595+0000 7fe327000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe320159c80 0x7fe3200cadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:44.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.595+0000 7fe327000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe3200cb310 0x7fe3200cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:44.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.595+0000 7fe327000640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3200cd380 con 0x7fe3200cb310 2024-03-12T17:18:44.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.595+0000 7fe327000640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3200cdf00 con 0x7fe3201598a0 2024-03-12T17:18:44.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.595+0000 7fe327000640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3200cd5d0 con 0x7fe320159c80 2024-03-12T17:18:44.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.595+0000 7fe325000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe3200cb310 0x7fe3200cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:44.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.595+0000 7fe325000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe3200cb310 0x7fe3200cbef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47940/0 (socket says 172.21.15.17:47940) 2024-03-12T17:18:44.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.595+0000 7fe325000640 1 -- 172.21.15.17:0/3198980084 learned_addr learned my addr 172.21.15.17:0/3198980084 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:44.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.595+0000 7fe31fe00640 1 --2- 172.21.15.17:0/3198980084 >> v2:172.21.15.94:3300/0 conn(0x7fe3201598a0 0x7fe3200ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:44.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.595+0000 7fe317400640 1 --2- 172.21.15.17:0/3198980084 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe320159c80 0x7fe3200cadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:44.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.596+0000 7fe325000640 1 -- 172.21.15.17:0/3198980084 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe320159c80 msgr2=0x7fe3200cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:44.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.596+0000 7fe325000640 1 --2- 172.21.15.17:0/3198980084 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe320159c80 0x7fe3200cadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:44.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.596+0000 7fe325000640 1 -- 172.21.15.17:0/3198980084 >> v2:172.21.15.94:3300/0 conn(0x7fe3201598a0 msgr2=0x7fe3200ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:44.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.596+0000 7fe325000640 1 --2- 172.21.15.17:0/3198980084 >> v2:172.21.15.94:3300/0 conn(0x7fe3201598a0 0x7fe3200ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:44.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.596+0000 7fe325000640 1 -- 172.21.15.17:0/3198980084 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3200cd8b0 con 0x7fe3200cb310 2024-03-12T17:18:44.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.597+0000 7fe325000640 1 --2- 172.21.15.17:0/3198980084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3200cb310 0x7fe3200cbef0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe3200cf3b0 tx=0x7fe31802e170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8fc09bef1db5fbe server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:44.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.597+0000 7fe31f400640 1 -- 172.21.15.17:0/3198980084 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe318036440 con 0x7fe3200cb310 2024-03-12T17:18:44.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.597+0000 7fe31f400640 1 -- 172.21.15.17:0/3198980084 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3180365a0 con 0x7fe3200cb310 2024-03-12T17:18:44.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.597+0000 7fe31f400640 1 -- 172.21.15.17:0/3198980084 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe318036930 con 0x7fe3200cb310 2024-03-12T17:18:44.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.598+0000 7fe327000640 1 -- 172.21.15.17:0/3198980084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3200cb310 msgr2=0x7fe3200cbef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:44.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.598+0000 7fe327000640 1 --2- 172.21.15.17:0/3198980084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3200cb310 0x7fe3200cbef0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe3200cf3b0 tx=0x7fe31802e170 comp rx=0 tx=0).stop 2024-03-12T17:18:44.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.598+0000 7fe327000640 1 -- 172.21.15.17:0/3198980084 shutdown_connections 2024-03-12T17:18:44.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.598+0000 7fe327000640 1 --2- 172.21.15.17:0/3198980084 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3200cb310 0x7fe3200cbef0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:44.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.598+0000 7fe327000640 1 --2- 172.21.15.17:0/3198980084 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe320159c80 0x7fe3200cadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:44.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.598+0000 7fe327000640 1 --2- 172.21.15.17:0/3198980084 >> v2:172.21.15.94:3300/0 conn(0x7fe3201598a0 0x7fe3200ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:44.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.598+0000 7fe327000640 1 -- 172.21.15.17:0/3198980084 >> 172.21.15.17:0/3198980084 conn(0x7fe320098a60 msgr2=0x7fe3200b1320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:44.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.599+0000 7fe327000640 1 -- 172.21.15.17:0/3198980084 shutdown_connections 2024-03-12T17:18:44.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.599+0000 7fe327000640 1 -- 172.21.15.17:0/3198980084 wait complete. 2024-03-12T17:18:44.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.600+0000 7fe327000640 1 Processor -- start 2024-03-12T17:18:44.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.601+0000 7fe327000640 1 -- start start 2024-03-12T17:18:44.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.601+0000 7fe327000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe3200cb310 0x7fe320151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:44.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.601+0000 7fe327000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3201598a0 0x7fe3200b3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:44.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.601+0000 7fe327000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe320159c80 0x7fe3201577a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:44.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.601+0000 7fe327000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32015aff0 con 0x7fe320159c80 2024-03-12T17:18:44.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.602+0000 7fe327000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe32015b2d0 con 0x7fe3201598a0 2024-03-12T17:18:44.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.602+0000 7fe327000640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe32015ba50 con 0x7fe3200cb310 2024-03-12T17:18:44.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.602+0000 7fe325000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe320159c80 0x7fe3201577a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:44.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.602+0000 7fe325000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe320159c80 0x7fe3201577a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47954/0 (socket says 172.21.15.17:47954) 2024-03-12T17:18:44.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.602+0000 7fe325000640 1 -- 172.21.15.17:0/4075323693 learned_addr learned my addr 172.21.15.17:0/4075323693 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:44.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.602+0000 7fe31fe00640 1 --2- 172.21.15.17:0/4075323693 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe3200cb310 0x7fe320151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:44.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.602+0000 7fe317400640 1 --2- 172.21.15.17:0/4075323693 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3201598a0 0x7fe3200b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:44.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.602+0000 7fe325000640 1 -- 172.21.15.17:0/4075323693 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe3200cb310 msgr2=0x7fe320151820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:44.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.602+0000 7fe325000640 1 --2- 172.21.15.17:0/4075323693 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe3200cb310 0x7fe320151820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:44.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.602+0000 7fe325000640 1 -- 172.21.15.17:0/4075323693 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3201598a0 msgr2=0x7fe3200b3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:44.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.602+0000 7fe325000640 1 --2- 172.21.15.17:0/4075323693 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3201598a0 0x7fe3200b3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:44.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.602+0000 7fe325000640 1 -- 172.21.15.17:0/4075323693 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe31800b770 con 0x7fe320159c80 2024-03-12T17:18:44.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.602+0000 7fe317400640 1 --2- 172.21.15.17:0/4075323693 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3201598a0 0x7fe3200b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:18:44.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.603+0000 7fe325000640 1 --2- 172.21.15.17:0/4075323693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe320159c80 0x7fe3201577a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe31802e1b0 tx=0x7fe3180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:44.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.603+0000 7fe31cc00640 1 -- 172.21.15.17:0/4075323693 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe318036440 con 0x7fe320159c80 2024-03-12T17:18:44.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.603+0000 7fe31cc00640 1 -- 172.21.15.17:0/4075323693 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe318034980 con 0x7fe320159c80 2024-03-12T17:18:44.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.603+0000 7fe327000640 1 -- 172.21.15.17:0/4075323693 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe32015bd30 con 0x7fe320159c80 2024-03-12T17:18:44.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.603+0000 7fe31cc00640 1 -- 172.21.15.17:0/4075323693 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe318034d10 con 0x7fe320159c80 2024-03-12T17:18:44.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.603+0000 7fe327000640 1 -- 172.21.15.17:0/4075323693 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe320151d60 con 0x7fe320159c80 2024-03-12T17:18:44.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.604+0000 7fe327000640 1 -- 172.21.15.17:0/4075323693 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe32015c250 con 0x7fe320159c80 2024-03-12T17:18:44.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.605+0000 7fe31cc00640 1 -- 172.21.15.17:0/4075323693 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fe31804a3b0 con 0x7fe320159c80 2024-03-12T17:18:44.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.607+0000 7fe31cc00640 1 --2- 172.21.15.17:0/4075323693 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe2fc06ac00 0x7fe2fc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:44.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.607+0000 7fe31cc00640 1 -- 172.21.15.17:0/4075323693 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fe3180ab6c0 con 0x7fe320159c80 2024-03-12T17:18:44.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.607+0000 7fe31fe00640 1 --2- 172.21.15.17:0/4075323693 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe2fc06ac00 0x7fe2fc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:44.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.608+0000 7fe31fe00640 1 --2- 172.21.15.17:0/4075323693 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe2fc06ac00 0x7fe2fc06d0c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe310009a60 tx=0x7fe310003990 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:44.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.612+0000 7fe31cc00640 1 -- 172.21.15.17:0/4075323693 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fe32015c250 con 0x7fe320159c80 2024-03-12T17:18:44.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:44.812+0000 7fe327000640 1 -- 172.21.15.17:0/4075323693 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe32015c250 con 0x7fe320159c80 2024-03-12T17:18:45.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.344+0000 7fe31cc00640 1 -- 172.21.15.17:0/4075323693 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe32015c250 con 0x7fe320159c80 2024-03-12T17:18:45.340 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2024-03-12T17:18:45.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.355+0000 7fe327000640 1 -- 172.21.15.17:0/4075323693 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe2fc06ac00 msgr2=0x7fe2fc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:45.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.355+0000 7fe327000640 1 --2- 172.21.15.17:0/4075323693 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe2fc06ac00 0x7fe2fc06d0c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe310009a60 tx=0x7fe310003990 comp rx=0 tx=0).stop 2024-03-12T17:18:45.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.355+0000 7fe327000640 1 -- 172.21.15.17:0/4075323693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe320159c80 msgr2=0x7fe3201577a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:45.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.355+0000 7fe327000640 1 --2- 172.21.15.17:0/4075323693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe320159c80 0x7fe3201577a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe31802e1b0 tx=0x7fe3180046c0 comp rx=0 tx=0).stop 2024-03-12T17:18:45.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.356+0000 7fe327000640 1 -- 172.21.15.17:0/4075323693 shutdown_connections 2024-03-12T17:18:45.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.356+0000 7fe327000640 1 --2- 172.21.15.17:0/4075323693 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe2fc06ac00 0x7fe2fc06d0c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:45.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.356+0000 7fe327000640 1 --2- 172.21.15.17:0/4075323693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe320159c80 0x7fe3201577a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:45.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.356+0000 7fe327000640 1 --2- 172.21.15.17:0/4075323693 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3201598a0 0x7fe3200b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:45.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.356+0000 7fe327000640 1 --2- 172.21.15.17:0/4075323693 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe3200cb310 0x7fe320151820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:45.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.356+0000 7fe327000640 1 -- 172.21.15.17:0/4075323693 >> 172.21.15.17:0/4075323693 conn(0x7fe320098a60 msgr2=0x7fe3200ac790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:45.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.356+0000 7fe327000640 1 -- 172.21.15.17:0/4075323693 shutdown_connections 2024-03-12T17:18:45.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.356+0000 7fe327000640 1 -- 172.21.15.17:0/4075323693 wait complete. 2024-03-12T17:18:45.387 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-12T17:18:45.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.581+0000 7f2744400640 1 Processor -- start 2024-03-12T17:18:45.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.582+0000 7f2744400640 1 -- start start 2024-03-12T17:18:45.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.583+0000 7f2744400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f273c161a80 0x7f273c161e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:45.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.583+0000 7f2744400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f273c0b2830 0x7f273c0ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:45.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.583+0000 7f2744400640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f273c06d040 con 0x7f273c0b1780 2024-03-12T17:18:45.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.583+0000 7f2744400640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f273c06ce40 con 0x7f273c0b2830 2024-03-12T17:18:45.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.583+0000 7f2744400640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273c06d320 con 0x7f273c161a80 2024-03-12T17:18:45.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.584+0000 7f2742400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f273c0b2830 0x7f273c0ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:45.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.584+0000 7f2742400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f273c0b2830 0x7f273c0ce4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47956/0 (socket says 172.21.15.17:47956) 2024-03-12T17:18:45.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.584+0000 7f2742400640 1 -- 172.21.15.17:0/1611153165 learned_addr learned my addr 172.21.15.17:0/1611153165 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:45.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.584+0000 7f2741a00640 1 --2- 172.21.15.17:0/1611153165 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f273c161a80 0x7f273c161e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:45.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.584+0000 7f2742400640 1 -- 172.21.15.17:0/1611153165 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f273c161a80 msgr2=0x7f273c161e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:45.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.584+0000 7f2742400640 1 --2- 172.21.15.17:0/1611153165 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f273c161a80 0x7f273c161e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:45.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.584+0000 7f2742400640 1 -- 172.21.15.17:0/1611153165 >> v1:172.21.15.17:6789/0 conn(0x7f273c0b1780 legacy=0x7f273c0b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:45.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.584+0000 7f2742400640 1 -- 172.21.15.17:0/1611153165 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f273c06d600 con 0x7f273c0b2830 2024-03-12T17:18:45.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.584+0000 7f273be00640 1 -- 172.21.15.17:0/1611153165 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 431815715 0 0) 0x7f273c06d040 con 0x7f273c0b1780 2024-03-12T17:18:45.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.585+0000 7f2742400640 1 --2- 172.21.15.17:0/1611153165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f273c0b2830 0x7f273c0ce4a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2734009e50 tx=0x7f273402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e03cf5cf836bf4a1 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:45.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.586+0000 7f273be00640 1 -- 172.21.15.17:0/1611153165 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273402cb00 con 0x7f273c0b2830 2024-03-12T17:18:45.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.586+0000 7f273be00640 1 -- 172.21.15.17:0/1611153165 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273402cc60 con 0x7f273c0b2830 2024-03-12T17:18:45.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.586+0000 7f273be00640 1 -- 172.21.15.17:0/1611153165 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27340343f0 con 0x7f273c0b2830 2024-03-12T17:18:45.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.586+0000 7f2744400640 1 -- 172.21.15.17:0/1611153165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f273c0b2830 msgr2=0x7f273c0ce4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:45.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.586+0000 7f2744400640 1 --2- 172.21.15.17:0/1611153165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f273c0b2830 0x7f273c0ce4a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2734009e50 tx=0x7f273402bf60 comp rx=0 tx=0).stop 2024-03-12T17:18:45.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.586+0000 7f2744400640 1 -- 172.21.15.17:0/1611153165 shutdown_connections 2024-03-12T17:18:45.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.586+0000 7f2744400640 1 --2- 172.21.15.17:0/1611153165 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f273c0b2830 0x7f273c0ce4a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:45.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.586+0000 7f2744400640 1 --2- 172.21.15.17:0/1611153165 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f273c161a80 0x7f273c161e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:45.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.586+0000 7f2744400640 1 -- 172.21.15.17:0/1611153165 >> 172.21.15.17:0/1611153165 conn(0x7f273c069ce0 msgr2=0x7f273c06a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:45.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.587+0000 7f2744400640 1 -- 172.21.15.17:0/1611153165 shutdown_connections 2024-03-12T17:18:45.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.587+0000 7f2744400640 1 -- 172.21.15.17:0/1611153165 wait complete. 2024-03-12T17:18:45.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.589+0000 7f2744400640 1 Processor -- start 2024-03-12T17:18:45.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.589+0000 7f2744400640 1 -- start start 2024-03-12T17:18:45.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.590+0000 7f2744400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f273c0b1780 0x7f273c152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:45.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.590+0000 7f2744400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f273c0b2830 0x7f273c14f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:45.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.590+0000 7f2744400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f273c161a80 0x7f273c1f9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:45.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.590+0000 7f2744400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273c1fa5a0 con 0x7f273c0b1780 2024-03-12T17:18:45.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.590+0000 7f2744400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273c1fa880 con 0x7f273c161a80 2024-03-12T17:18:45.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.590+0000 7f2744400640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273c151d10 con 0x7f273c0b2830 2024-03-12T17:18:45.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.590+0000 7f2741a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f273c0b1780 0x7f273c152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:45.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.590+0000 7f2741a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f273c0b1780 0x7f273c152510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47960/0 (socket says 172.21.15.17:47960) 2024-03-12T17:18:45.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.590+0000 7f2741a00640 1 -- 172.21.15.17:0/3842533959 learned_addr learned my addr 172.21.15.17:0/3842533959 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:45.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.591+0000 7f2742400640 1 --2- 172.21.15.17:0/3842533959 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f273c161a80 0x7f273c1f9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:45.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.591+0000 7f2741000640 1 --2- 172.21.15.17:0/3842533959 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f273c0b2830 0x7f273c14f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:45.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.591+0000 7f2741a00640 1 -- 172.21.15.17:0/3842533959 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f273c0b2830 msgr2=0x7f273c14f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:45.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.591+0000 7f2741a00640 1 --2- 172.21.15.17:0/3842533959 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f273c0b2830 0x7f273c14f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:45.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.591+0000 7f2741a00640 1 -- 172.21.15.17:0/3842533959 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f273c161a80 msgr2=0x7f273c1f9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:45.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.591+0000 7f2741a00640 1 --2- 172.21.15.17:0/3842533959 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f273c161a80 0x7f273c1f9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:45.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.591+0000 7f2741a00640 1 -- 172.21.15.17:0/3842533959 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2734009b30 con 0x7f273c0b1780 2024-03-12T17:18:45.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.591+0000 7f2742400640 1 --2- 172.21.15.17:0/3842533959 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f273c161a80 0x7f273c1f9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:18:45.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.591+0000 7f2741a00640 1 --2- 172.21.15.17:0/3842533959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f273c0b1780 0x7f273c152510 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f272c00d5f0 tx=0x7f272c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:45.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.591+0000 7f2739600640 1 -- 172.21.15.17:0/3842533959 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c0125f0 con 0x7f273c0b1780 2024-03-12T17:18:45.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.591+0000 7f2739600640 1 -- 172.21.15.17:0/3842533959 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272c012750 con 0x7f273c0b1780 2024-03-12T17:18:45.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.591+0000 7f2739600640 1 -- 172.21.15.17:0/3842533959 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c012b00 con 0x7f273c0b1780 2024-03-12T17:18:45.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.591+0000 7f2744400640 1 -- 172.21.15.17:0/3842533959 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f273c151ff0 con 0x7f273c0b1780 2024-03-12T17:18:45.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.592+0000 7f2744400640 1 -- 172.21.15.17:0/3842533959 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f273c155cd0 con 0x7f273c0b1780 2024-03-12T17:18:45.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.593+0000 7f2744400640 1 -- 172.21.15.17:0/3842533959 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f273c0736c0 con 0x7f273c0b1780 2024-03-12T17:18:45.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.594+0000 7f2739600640 1 -- 172.21.15.17:0/3842533959 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f272c012c60 con 0x7f273c0b1780 2024-03-12T17:18:45.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.595+0000 7f2739600640 1 --2- 172.21.15.17:0/3842533959 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f271c06ac00 0x7f271c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:45.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.595+0000 7f2739600640 1 -- 172.21.15.17:0/3842533959 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f272c089880 con 0x7f273c0b1780 2024-03-12T17:18:45.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.595+0000 7f2741000640 1 --2- 172.21.15.17:0/3842533959 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f271c06ac00 0x7f271c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:45.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.596+0000 7f2741000640 1 --2- 172.21.15.17:0/3842533959 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f271c06ac00 0x7f271c06d0c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f273c1fab80 tx=0x7f2728009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:45.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.600+0000 7f2739600640 1 -- 172.21.15.17:0/3842533959 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f272c054a20 con 0x7f273c0b1780 2024-03-12T17:18:45.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.840+0000 7f2744400640 1 -- 172.21.15.17:0/3842533959 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f273c164180 con 0x7f273c0b1780 2024-03-12T17:18:45.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.849+0000 7f2739600640 1 -- 172.21.15.17:0/3842533959 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f272c058040 con 0x7f273c0b1780 2024-03-12T17:18:45.843 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 2 and data pool 3 2024-03-12T17:18:45.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.853+0000 7f2744400640 1 -- 172.21.15.17:0/3842533959 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f271c06ac00 msgr2=0x7f271c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:45.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.853+0000 7f2744400640 1 --2- 172.21.15.17:0/3842533959 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f271c06ac00 0x7f271c06d0c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f273c1fab80 tx=0x7f2728009040 comp rx=0 tx=0).stop 2024-03-12T17:18:45.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.853+0000 7f2744400640 1 -- 172.21.15.17:0/3842533959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f273c0b1780 msgr2=0x7f273c152510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:45.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.853+0000 7f2744400640 1 --2- 172.21.15.17:0/3842533959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f273c0b1780 0x7f273c152510 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f272c00d5f0 tx=0x7f272c00dab0 comp rx=0 tx=0).stop 2024-03-12T17:18:45.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.856+0000 7f2744400640 1 -- 172.21.15.17:0/3842533959 shutdown_connections 2024-03-12T17:18:45.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.856+0000 7f2744400640 1 --2- 172.21.15.17:0/3842533959 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f271c06ac00 0x7f271c06d0c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:45.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.856+0000 7f2744400640 1 --2- 172.21.15.17:0/3842533959 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f273c161a80 0x7f273c1f9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:45.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.856+0000 7f2744400640 1 --2- 172.21.15.17:0/3842533959 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f273c0b2830 0x7f273c14f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:45.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.856+0000 7f2744400640 1 --2- 172.21.15.17:0/3842533959 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f273c0b1780 0x7f273c152510 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:45.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.856+0000 7f2744400640 1 -- 172.21.15.17:0/3842533959 >> 172.21.15.17:0/3842533959 conn(0x7f273c069ce0 msgr2=0x7f273c0ccc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:45.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.857+0000 7f2744400640 1 -- 172.21.15.17:0/3842533959 shutdown_connections 2024-03-12T17:18:45.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:45.857+0000 7f2744400640 1 -- 172.21.15.17:0/3842533959 wait complete. 2024-03-12T17:18:45.882 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T17:18:46.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.060+0000 7fc1dd400640 1 Processor -- start 2024-03-12T17:18:46.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.060+0000 7fc1dd400640 1 -- start start 2024-03-12T17:18:46.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.062+0000 7fc1dd400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc1d8159a50 0x7fc1d815cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:46.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.062+0000 7fc1dd400640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1d815beb0 con 0x7fc1d80b2d30 2024-03-12T17:18:46.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.062+0000 7fc1dd400640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1d815c190 con 0x7fc1d80b35f0 2024-03-12T17:18:46.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.062+0000 7fc1dd400640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d815c470 con 0x7fc1d8159a50 2024-03-12T17:18:46.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.062+0000 7fc1d7200640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fc1d80b2d30 0x7fc1d8099710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37758/0 (socket says 172.21.15.17:37758) 2024-03-12T17:18:46.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.062+0000 7fc1d7200640 1 -- 172.21.15.17:0/2528417037 learned_addr learned my addr 172.21.15.17:0/2528417037 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:18:46.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.062+0000 7fc1d6800640 1 --2- 172.21.15.17:0/2528417037 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc1d8159a50 0x7fc1d815cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:46.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.063+0000 7fc1d5400640 1 -- 172.21.15.17:0/2528417037 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 144911197 0 0) 0x7fc1d815beb0 con 0x7fc1d80b2d30 2024-03-12T17:18:46.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.063+0000 7fc1d5400640 1 -- 172.21.15.17:0/2528417037 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1b8003520 con 0x7fc1d80b2d30 2024-03-12T17:18:46.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.063+0000 7fc1d5400640 1 -- 172.21.15.17:0/2528417037 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2310661215 0 0) 0x7fc1b8003520 con 0x7fc1d80b2d30 2024-03-12T17:18:46.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.063+0000 7fc1d5400640 1 -- 172.21.15.17:0/2528417037 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc1d8159a50 msgr2=0x7fc1d815cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:46.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.063+0000 7fc1d5400640 1 --2- 172.21.15.17:0/2528417037 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc1d8159a50 0x7fc1d815cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:46.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.063+0000 7fc1d5400640 1 -- 172.21.15.17:0/2528417037 >> v1:172.21.15.94:6789/0 conn(0x7fc1d80b35f0 legacy=0x7fc1d80b2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:46.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.063+0000 7fc1d5400640 1 -- 172.21.15.17:0/2528417037 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d815c750 con 0x7fc1d80b2d30 2024-03-12T17:18:46.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.063+0000 7fc1d5400640 1 -- 172.21.15.17:0/2528417037 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7fc1d0001670 con 0x7fc1d80b2d30 2024-03-12T17:18:46.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.063+0000 7fc1d5400640 1 -- 172.21.15.17:0/2528417037 >> v1:172.21.15.17:6789/0 conn(0x7fc1d80b2d30 legacy=0x7fc1d8099710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:46.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.063+0000 7fc1d5400640 1 --2- 172.21.15.17:0/2528417037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1b80039a0 0x7fc1b8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:46.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.063+0000 7fc1d5400640 1 --2- 172.21.15.17:0/2528417037 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1b80047c0 0x7fc1b8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:46.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.063+0000 7fc1d5400640 1 --2- 172.21.15.17:0/2528417037 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc1d8159a50 0x7fc1b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:46.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.063+0000 7fc1d5400640 1 -- 172.21.15.17:0/2528417037 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d815c470 con 0x7fc1b80039a0 2024-03-12T17:18:46.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.063+0000 7fc1d5400640 1 -- 172.21.15.17:0/2528417037 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b800dd00 con 0x7fc1b80047c0 2024-03-12T17:18:46.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.063+0000 7fc1d5400640 1 -- 172.21.15.17:0/2528417037 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b800dec0 con 0x7fc1d8159a50 2024-03-12T17:18:46.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.063+0000 7fc1d6800640 1 --2- 172.21.15.17:0/2528417037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1b80039a0 0x7fc1b8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:46.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.064+0000 7fc1d7200640 1 --2- 172.21.15.17:0/2528417037 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc1d8159a50 0x7fc1b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:46.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.064+0000 7fc1d6800640 1 -- 172.21.15.17:0/2528417037 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc1d8159a50 msgr2=0x7fc1b8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:46.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.064+0000 7fc1d6800640 1 --2- 172.21.15.17:0/2528417037 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc1d8159a50 0x7fc1b8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:46.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.064+0000 7fc1d6800640 1 -- 172.21.15.17:0/2528417037 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1b80047c0 msgr2=0x7fc1b8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:46.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.064+0000 7fc1d6800640 1 --2- 172.21.15.17:0/2528417037 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1b80047c0 0x7fc1b8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:46.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.064+0000 7fc1d6800640 1 -- 172.21.15.17:0/2528417037 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b8003520 con 0x7fc1b80039a0 2024-03-12T17:18:46.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.064+0000 7fc1d7200640 1 --2- 172.21.15.17:0/2528417037 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc1d8159a50 0x7fc1b8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:18:46.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.065+0000 7fc1d6800640 1 --2- 172.21.15.17:0/2528417037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1b80039a0 0x7fc1b8003dc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8009a90 tx=0x7fc1b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e59ed342a6183ff server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:46.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.065+0000 7fc1d5400640 1 -- 172.21.15.17:0/2528417037 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c802c660 con 0x7fc1b80039a0 2024-03-12T17:18:46.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.065+0000 7fc1d5400640 1 -- 172.21.15.17:0/2528417037 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c802c7c0 con 0x7fc1b80039a0 2024-03-12T17:18:46.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.065+0000 7fc1d5400640 1 -- 172.21.15.17:0/2528417037 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c802cb50 con 0x7fc1b80039a0 2024-03-12T17:18:46.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.066+0000 7fc1dd400640 1 -- 172.21.15.17:0/2528417037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1b80039a0 msgr2=0x7fc1b8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:46.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.066+0000 7fc1dd400640 1 --2- 172.21.15.17:0/2528417037 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1b80039a0 0x7fc1b8003dc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8009a90 tx=0x7fc1b80057f0 comp rx=0 tx=0).stop 2024-03-12T17:18:46.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.066+0000 7fc1d7200640 1 -- 172.21.15.17:0/2528417037 reap_dead start 2024-03-12T17:18:46.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.066+0000 7fc1dd400640 1 -- 172.21.15.17:0/2528417037 shutdown_connections 2024-03-12T17:18:46.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.066+0000 7fc1dd400640 1 -- 172.21.15.17:0/2528417037 >> 172.21.15.17:0/2528417037 conn(0x7fc1d8098a60 msgr2=0x7fc1d80b4b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:46.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.066+0000 7fc1dd400640 1 -- 172.21.15.17:0/2528417037 shutdown_connections 2024-03-12T17:18:46.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.066+0000 7fc1dd400640 1 -- 172.21.15.17:0/2528417037 wait complete. 2024-03-12T17:18:46.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.068+0000 7fc1dd400640 1 Processor -- start 2024-03-12T17:18:46.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.068+0000 7fc1dd400640 1 -- start start 2024-03-12T17:18:46.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.069+0000 7fc1dd400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1b80039a0 0x7fc1d8150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:46.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.069+0000 7fc1dd400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1d8099bb0 0x7fc1d809a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:46.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.069+0000 7fc1dd400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc1d809a570 0x7fc1d809c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:46.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.069+0000 7fc1dd400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d81514b0 con 0x7fc1d8099bb0 2024-03-12T17:18:46.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.069+0000 7fc1dd400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d809a9f0 con 0x7fc1b80039a0 2024-03-12T17:18:46.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.069+0000 7fc1dd400640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d80adc20 con 0x7fc1d809a570 2024-03-12T17:18:46.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.069+0000 7fc1d5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1d8099bb0 0x7fc1d809a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:46.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.069+0000 7fc1d5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1d8099bb0 0x7fc1d809a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47984/0 (socket says 172.21.15.17:47984) 2024-03-12T17:18:46.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.069+0000 7fc1d5e00640 1 -- 172.21.15.17:0/708117759 learned_addr learned my addr 172.21.15.17:0/708117759 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:46.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.069+0000 7fc1d6800640 1 --2- 172.21.15.17:0/708117759 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1b80039a0 0x7fc1d8150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:46.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.069+0000 7fc1d7200640 1 --2- 172.21.15.17:0/708117759 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc1d809a570 0x7fc1d809c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:46.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.069+0000 7fc1d5e00640 1 -- 172.21.15.17:0/708117759 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc1d809a570 msgr2=0x7fc1d809c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:46.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.069+0000 7fc1d5e00640 1 --2- 172.21.15.17:0/708117759 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc1d809a570 0x7fc1d809c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:46.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.069+0000 7fc1d5e00640 1 -- 172.21.15.17:0/708117759 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1b80039a0 msgr2=0x7fc1d8150f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:46.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.069+0000 7fc1d5e00640 1 --2- 172.21.15.17:0/708117759 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1b80039a0 0x7fc1d8150f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:46.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.069+0000 7fc1d5e00640 1 -- 172.21.15.17:0/708117759 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d80adf00 con 0x7fc1d8099bb0 2024-03-12T17:18:46.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.070+0000 7fc1d6800640 1 --2- 172.21.15.17:0/708117759 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1b80039a0 0x7fc1d8150f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:18:46.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.070+0000 7fc1d5e00640 1 --2- 172.21.15.17:0/708117759 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1d8099bb0 0x7fc1d809a030 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc1c000c800 tx=0x7fc1c000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:46.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.070+0000 7fc1cea00640 1 -- 172.21.15.17:0/708117759 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c0003b70 con 0x7fc1d8099bb0 2024-03-12T17:18:46.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.070+0000 7fc1cea00640 1 -- 172.21.15.17:0/708117759 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1c0003cf0 con 0x7fc1d8099bb0 2024-03-12T17:18:46.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.070+0000 7fc1cea00640 1 -- 172.21.15.17:0/708117759 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1c000aa90 con 0x7fc1d8099bb0 2024-03-12T17:18:46.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.070+0000 7fc1dd400640 1 -- 172.21.15.17:0/708117759 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d80ae1e0 con 0x7fc1d8099bb0 2024-03-12T17:18:46.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.070+0000 7fc1dd400640 1 -- 172.21.15.17:0/708117759 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d80ae7a0 con 0x7fc1d8099bb0 2024-03-12T17:18:46.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.071+0000 7fc1dd400640 1 -- 172.21.15.17:0/708117759 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1d80736c0 con 0x7fc1d8099bb0 2024-03-12T17:18:46.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.072+0000 7fc1cea00640 1 -- 172.21.15.17:0/708117759 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fc1c000abf0 con 0x7fc1d8099bb0 2024-03-12T17:18:46.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.073+0000 7fc1cea00640 1 --2- 172.21.15.17:0/708117759 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc1b406ac00 0x7fc1b406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:46.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.073+0000 7fc1cea00640 1 -- 172.21.15.17:0/708117759 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1c00892e0 con 0x7fc1d8099bb0 2024-03-12T17:18:46.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.074+0000 7fc1d6800640 1 --2- 172.21.15.17:0/708117759 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc1b406ac00 0x7fc1b406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:46.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.074+0000 7fc1d6800640 1 --2- 172.21.15.17:0/708117759 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc1b406ac00 0x7fc1b406d0c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8036000 tx=0x7fc1c8030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:46.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.078+0000 7fc1cea00640 1 -- 172.21.15.17:0/708117759 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fc1c0054420 con 0x7fc1d8099bb0 2024-03-12T17:18:46.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.275+0000 7fc1dd400640 1 -- 172.21.15.17:0/708117759 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1d806ed70 con 0x7fc1d8099bb0 2024-03-12T17:18:46.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.278+0000 7fc1cea00640 1 -- 172.21.15.17:0/708117759 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16002 (secure 0 0 0) 0x7fc1c0003e60 con 0x7fc1d8099bb0 2024-03-12T17:18:46.275 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:18:46.275 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":20,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:18:45.842029+0000","last_up_change":"2024-03-12T17:18:38.144756+0000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-12T17:18:39.552910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-12T17:18:43.794908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-12T17:18:44.867006+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":37305},{"type":"v1","addr":"172.21.15.17:6801","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":37305},{"type":"v1","addr":"172.21.15.17:6803","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":37305},{"type":"v1","addr":"172.21.15.17:6807","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":37305},{"type":"v1","addr":"172.21.15.17:6805","nonce":37305}]},"public_addr":"172.21.15.17:6801/37305","cluster_addr":"172.21.15.17:6803/37305","heartbeat_back_addr":"172.21.15.17:6807/37305","heartbeat_front_addr":"172.21.15.17:6805/37305","state":["exists","up"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":37307},{"type":"v1","addr":"172.21.15.17:6814","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":37307},{"type":"v1","addr":"172.21.15.17:6818","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":37307},{"type":"v1","addr":"172.21.15.17:6827","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":37307},{"type":"v1","addr":"172.21.15.17:6823","nonce":37307}]},"public_addr":"172.21.15.17:6814/37307","cluster_addr":"172.21.15.17:6818/37307","heartbeat_back_addr":"172.21.15.17:6827/37307","heartbeat_front_addr":"172.21.15.17:6823/37307","state":["exists","up"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":37303},{"type":"v1","addr":"172.21.15.17:6809","nonce":37303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":37303},{"type":"v1","addr":"172.21.15.17:6811","nonce":37303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":37303},{"type":"v1","addr":"172.21.15.17:6819","nonce":37303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":37303},{"type":"v1","addr":"172.21.15.17:6815","nonce":37303}]},"public_addr":"172.21.15.17:6809/37303","cluster_addr":"172.21.15.17:6811/37303","heartbeat_back_addr":"172.21.15.17:6819/37303","heartbeat_front_addr":"172.21.15.17:6815/37303","state":["exists","up"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":37308},{"type":"v1","addr":"172.21.15.17:6822","nonce":37308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":37308},{"type":"v1","addr":"172.21.15.17:6826","nonce":37308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":37308},{"type":"v1","addr":"172.21.15.17:6831","nonce":37308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":37308},{"type":"v1","addr":"172.21.15.17:6829","nonce":37308}]},"public_addr":"172.21.15.17:6822/37308","cluster_addr":"172.21.15.17:6826/37308","heartbeat_back_addr":"172.21.15.17:6831/37308","heartbeat_front_addr":"172.21.15.17:6829/37308","state":["exists","up"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":37465},{"type":"v1","addr":"172.21.15.94:6809","nonce":37465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6811","nonce":37465},{"type":"v1","addr":"172.21.15.94:6813","nonce":37465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6819","nonce":37465},{"type":"v1","addr":"172.21.15.94:6822","nonce":37465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6815","nonce":37465},{"type":"v1","addr":"172.21.15.94:6817","nonce":37465}]},"public_addr":"172.21.15.94:6809/37465","cluster_addr":"172.21.15.94:6813/37465","heartbeat_back_addr":"172.21.15.94:6822/37465","heartbeat_front_addr":"172.21.15.94:6817/37465","state":["exists","up"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":37464},{"type":"v1","addr":"172.21.15.94:6812","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":37464},{"type":"v1","addr":"172.21.15.94:6816","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":37464},{"type":"v1","addr":"172.21.15.94:6823","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":37464},{"type":"v1","addr":"172.21.15.94:6820","nonce":37464}]},"public_addr":"172.21.15.94:6812/37464","cluster_addr":"172.21.15.94:6816/37464","heartbeat_back_addr":"172.21.15.94:6823/37464","heartbeat_front_addr":"172.21.15.94:6820/37464","state":["exists","up"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":37467},{"type":"v1","addr":"172.21.15.94:6825","nonce":37467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":37467},{"type":"v1","addr":"172.21.15.94:6827","nonce":37467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":37467},{"type":"v1","addr":"172.21.15.94:6831","nonce":37467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":37467},{"type":"v1","addr":"172.21.15.94:6829","nonce":37467}]},"public_addr":"172.21.15.94:6825/37467","cluster_addr":"172.21.15.94:6827/37467","heartbeat_back_addr":"172.21.15.94:6831/37467","heartbeat_front_addr":"172.21.15.94:6829/37467","state":["exists","up"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":37466},{"type":"v1","addr":"172.21.15.94:6801","nonce":37466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":37466},{"type":"v1","addr":"172.21.15.94:6803","nonce":37466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":37466},{"type":"v1","addr":"172.21.15.94:6807","nonce":37466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":37466},{"type":"v1","addr":"172.21.15.94:6805","nonce":37466}]},"public_addr":"172.21.15.94:6801/37466","cluster_addr":"172.21.15.94:6803/37466","heartbeat_back_addr":"172.21.15.94:6807/37466","heartbeat_front_addr":"172.21.15.94:6805/37466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.327217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.186966+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.419986+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.150585+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.120621+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.121576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.181257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.293188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:18:46.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.281+0000 7fc1dd400640 1 -- 172.21.15.17:0/708117759 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc1b406ac00 msgr2=0x7fc1b406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:46.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.281+0000 7fc1dd400640 1 --2- 172.21.15.17:0/708117759 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc1b406ac00 0x7fc1b406d0c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8036000 tx=0x7fc1c8030000 comp rx=0 tx=0).stop 2024-03-12T17:18:46.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.281+0000 7fc1dd400640 1 -- 172.21.15.17:0/708117759 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1d8099bb0 msgr2=0x7fc1d809a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:46.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.281+0000 7fc1dd400640 1 --2- 172.21.15.17:0/708117759 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1d8099bb0 0x7fc1d809a030 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc1c000c800 tx=0x7fc1c000ccc0 comp rx=0 tx=0).stop 2024-03-12T17:18:46.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.281+0000 7fc1dd400640 1 -- 172.21.15.17:0/708117759 shutdown_connections 2024-03-12T17:18:46.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.281+0000 7fc1dd400640 1 --2- 172.21.15.17:0/708117759 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc1b406ac00 0x7fc1b406d0c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:46.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.281+0000 7fc1dd400640 1 --2- 172.21.15.17:0/708117759 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc1d809a570 0x7fc1d809c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:46.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.281+0000 7fc1dd400640 1 --2- 172.21.15.17:0/708117759 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1d8099bb0 0x7fc1d809a030 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:46.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.281+0000 7fc1dd400640 1 --2- 172.21.15.17:0/708117759 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1b80039a0 0x7fc1d8150f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:46.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.281+0000 7fc1dd400640 1 -- 172.21.15.17:0/708117759 >> 172.21.15.17:0/708117759 conn(0x7fc1d8098a60 msgr2=0x7fc1d8156ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:46.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.281+0000 7fc1dd400640 1 -- 172.21.15.17:0/708117759 shutdown_connections 2024-03-12T17:18:46.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.281+0000 7fc1dd400640 1 -- 172.21.15.17:0/708117759 wait complete. 2024-03-12T17:18:46.292 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T17:18:46.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.498+0000 7f8a7d400640 1 Processor -- start 2024-03-12T17:18:46.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.498+0000 7f8a7d400640 1 -- start start 2024-03-12T17:18:46.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.500+0000 7f8a7d400640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8a780b2070 0x7f8a780b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:46.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.500+0000 7f8a7d400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8a780cb970 0x7f8a780cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:46.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.500+0000 7f8a7d400640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a780ce320 con 0x7f8a78144240 2024-03-12T17:18:46.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.500+0000 7f8a7d400640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a780cc320 con 0x7f8a780cb970 2024-03-12T17:18:46.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.500+0000 7f8a7d400640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a78144620 con 0x7f8a780b2070 2024-03-12T17:18:46.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.500+0000 7f8a77200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8a780cb970 0x7f8a780cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:46.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.500+0000 7f8a77200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8a780cb970 0x7f8a780cbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47992/0 (socket says 172.21.15.17:47992) 2024-03-12T17:18:46.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.500+0000 7f8a77200640 1 -- 172.21.15.17:0/117828417 learned_addr learned my addr 172.21.15.17:0/117828417 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:46.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.501+0000 7f8a6fe00640 1 --2- 172.21.15.17:0/117828417 >> v2:172.21.15.94:3300/0 conn(0x7f8a780b2070 0x7f8a780b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:46.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.501+0000 7f8a77200640 1 -- 172.21.15.17:0/117828417 >> v2:172.21.15.94:3300/0 conn(0x7f8a780b2070 msgr2=0x7f8a780b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:46.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.501+0000 7f8a77200640 1 --2- 172.21.15.17:0/117828417 >> v2:172.21.15.94:3300/0 conn(0x7f8a780b2070 0x7f8a780b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:46.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.501+0000 7f8a77200640 1 -- 172.21.15.17:0/117828417 >> v1:172.21.15.94:6789/0 conn(0x7f8a78144240 legacy=0x7f8a780ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:46.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.501+0000 7f8a77200640 1 -- 172.21.15.17:0/117828417 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a7815f3d0 con 0x7f8a780cb970 2024-03-12T17:18:46.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.502+0000 7f8a77200640 1 --2- 172.21.15.17:0/117828417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a780cb970 0x7f8a780cbde0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8a7815bfe0 tx=0x7f8a7002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf623289b2425d75 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:46.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.502+0000 7f8a75e00640 1 -- 172.21.15.17:0/117828417 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7002ca80 con 0x7f8a780cb970 2024-03-12T17:18:46.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.502+0000 7f8a75e00640 1 -- 172.21.15.17:0/117828417 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a7002cbe0 con 0x7f8a780cb970 2024-03-12T17:18:46.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.502+0000 7f8a75e00640 1 -- 172.21.15.17:0/117828417 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a700343f0 con 0x7f8a780cb970 2024-03-12T17:18:46.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.503+0000 7f8a7d400640 1 -- 172.21.15.17:0/117828417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a780cb970 msgr2=0x7f8a780cbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:46.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.503+0000 7f8a7d400640 1 --2- 172.21.15.17:0/117828417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a780cb970 0x7f8a780cbde0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8a7815bfe0 tx=0x7f8a7002bee0 comp rx=0 tx=0).stop 2024-03-12T17:18:46.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.503+0000 7f8a7d400640 1 -- 172.21.15.17:0/117828417 shutdown_connections 2024-03-12T17:18:46.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.503+0000 7f8a7d400640 1 --2- 172.21.15.17:0/117828417 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a780cb970 0x7f8a780cbde0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:46.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.503+0000 7f8a7d400640 1 --2- 172.21.15.17:0/117828417 >> v2:172.21.15.94:3300/0 conn(0x7f8a780b2070 0x7f8a780b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:46.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.503+0000 7f8a7d400640 1 -- 172.21.15.17:0/117828417 >> 172.21.15.17:0/117828417 conn(0x7f8a78069ce0 msgr2=0x7f8a7806a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:46.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.503+0000 7f8a7d400640 1 -- 172.21.15.17:0/117828417 shutdown_connections 2024-03-12T17:18:46.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.503+0000 7f8a7d400640 1 -- 172.21.15.17:0/117828417 wait complete. 2024-03-12T17:18:46.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.505+0000 7f8a7d400640 1 Processor -- start 2024-03-12T17:18:46.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.505+0000 7f8a7d400640 1 -- start start 2024-03-12T17:18:46.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.506+0000 7f8a7d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a780b2070 0x7f8a780c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:46.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.506+0000 7f8a7d400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a780cb970 0x7f8a781f5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:46.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.506+0000 7f8a7d400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8a78144240 0x7f8a780c3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:46.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.506+0000 7f8a7d400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a78141200 con 0x7f8a780b2070 2024-03-12T17:18:46.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.506+0000 7f8a7d400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a780c63e0 con 0x7f8a780cb970 2024-03-12T17:18:46.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.506+0000 7f8a7d400640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a781f6610 con 0x7f8a78144240 2024-03-12T17:18:46.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.506+0000 7f8a76800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a780b2070 0x7f8a780c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:46.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.506+0000 7f8a76800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a780b2070 0x7f8a780c5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48000/0 (socket says 172.21.15.17:48000) 2024-03-12T17:18:46.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.506+0000 7f8a76800640 1 -- 172.21.15.17:0/3609859541 learned_addr learned my addr 172.21.15.17:0/3609859541 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:46.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.507+0000 7f8a6fe00640 1 --2- 172.21.15.17:0/3609859541 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a780cb970 0x7f8a781f5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:46.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.507+0000 7f8a77200640 1 --2- 172.21.15.17:0/3609859541 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8a78144240 0x7f8a780c3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:46.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.507+0000 7f8a76800640 1 -- 172.21.15.17:0/3609859541 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8a78144240 msgr2=0x7f8a780c3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:46.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.507+0000 7f8a76800640 1 --2- 172.21.15.17:0/3609859541 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8a78144240 0x7f8a780c3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:46.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.507+0000 7f8a76800640 1 -- 172.21.15.17:0/3609859541 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a780cb970 msgr2=0x7f8a781f5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:46.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.507+0000 7f8a76800640 1 --2- 172.21.15.17:0/3609859541 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a780cb970 0x7f8a781f5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:46.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.507+0000 7f8a76800640 1 -- 172.21.15.17:0/3609859541 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a70009b30 con 0x7f8a780b2070 2024-03-12T17:18:46.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.507+0000 7f8a6fe00640 1 --2- 172.21.15.17:0/3609859541 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a780cb970 0x7f8a781f5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:18:46.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.507+0000 7f8a77200640 1 --2- 172.21.15.17:0/3609859541 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8a78144240 0x7f8a780c3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:18:46.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.507+0000 7f8a76800640 1 --2- 172.21.15.17:0/3609859541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a780b2070 0x7f8a780c5ea0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8a6800b3f0 tx=0x7f8a6800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:46.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.507+0000 7f8a6ea00640 1 -- 172.21.15.17:0/3609859541 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a68011830 con 0x7f8a780b2070 2024-03-12T17:18:46.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.507+0000 7f8a6ea00640 1 -- 172.21.15.17:0/3609859541 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a68011990 con 0x7f8a780b2070 2024-03-12T17:18:46.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.507+0000 7f8a6ea00640 1 -- 172.21.15.17:0/3609859541 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a68011d40 con 0x7f8a780b2070 2024-03-12T17:18:46.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.507+0000 7f8a7d400640 1 -- 172.21.15.17:0/3609859541 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a781f68f0 con 0x7f8a780b2070 2024-03-12T17:18:46.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.507+0000 7f8a7d400640 1 -- 172.21.15.17:0/3609859541 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a78141730 con 0x7f8a780b2070 2024-03-12T17:18:46.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.509+0000 7f8a7d400640 1 -- 172.21.15.17:0/3609859541 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a781f6b10 con 0x7f8a780b2070 2024-03-12T17:18:46.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.509+0000 7f8a6ea00640 1 -- 172.21.15.17:0/3609859541 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f8a6801a400 con 0x7f8a780b2070 2024-03-12T17:18:46.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.510+0000 7f8a6ea00640 1 --2- 172.21.15.17:0/3609859541 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f8a5406ac00 0x7f8a5406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:46.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.510+0000 7f8a6ea00640 1 -- 172.21.15.17:0/3609859541 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a68089210 con 0x7f8a780b2070 2024-03-12T17:18:46.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.510+0000 7f8a6fe00640 1 --2- 172.21.15.17:0/3609859541 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f8a5406ac00 0x7f8a5406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:46.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.511+0000 7f8a6fe00640 1 --2- 172.21.15.17:0/3609859541 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f8a5406ac00 0x7f8a5406d0c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8a7815e100 tx=0x7f8a60008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:46.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.515+0000 7f8a6ea00640 1 -- 172.21.15.17:0/3609859541 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f8a680543d0 con 0x7f8a780b2070 2024-03-12T17:18:46.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.714+0000 7f8a7d400640 1 -- 172.21.15.17:0/3609859541 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a780736c0 con 0x7f8a780b2070 2024-03-12T17:18:46.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.717+0000 7f8a6ea00640 1 -- 172.21.15.17:0/3609859541 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16002 (secure 0 0 0) 0x7f8a680579f0 con 0x7f8a780b2070 2024-03-12T17:18:46.711 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:18:46.712 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":20,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:18:45.842029+0000","last_up_change":"2024-03-12T17:18:38.144756+0000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-12T17:18:39.552910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-12T17:18:43.794908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-12T17:18:44.867006+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":37305},{"type":"v1","addr":"172.21.15.17:6801","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":37305},{"type":"v1","addr":"172.21.15.17:6803","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":37305},{"type":"v1","addr":"172.21.15.17:6807","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":37305},{"type":"v1","addr":"172.21.15.17:6805","nonce":37305}]},"public_addr":"172.21.15.17:6801/37305","cluster_addr":"172.21.15.17:6803/37305","heartbeat_back_addr":"172.21.15.17:6807/37305","heartbeat_front_addr":"172.21.15.17:6805/37305","state":["exists","up"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":37307},{"type":"v1","addr":"172.21.15.17:6814","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":37307},{"type":"v1","addr":"172.21.15.17:6818","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":37307},{"type":"v1","addr":"172.21.15.17:6827","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":37307},{"type":"v1","addr":"172.21.15.17:6823","nonce":37307}]},"public_addr":"172.21.15.17:6814/37307","cluster_addr":"172.21.15.17:6818/37307","heartbeat_back_addr":"172.21.15.17:6827/37307","heartbeat_front_addr":"172.21.15.17:6823/37307","state":["exists","up"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":37303},{"type":"v1","addr":"172.21.15.17:6809","nonce":37303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":37303},{"type":"v1","addr":"172.21.15.17:6811","nonce":37303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":37303},{"type":"v1","addr":"172.21.15.17:6819","nonce":37303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":37303},{"type":"v1","addr":"172.21.15.17:6815","nonce":37303}]},"public_addr":"172.21.15.17:6809/37303","cluster_addr":"172.21.15.17:6811/37303","heartbeat_back_addr":"172.21.15.17:6819/37303","heartbeat_front_addr":"172.21.15.17:6815/37303","state":["exists","up"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":37308},{"type":"v1","addr":"172.21.15.17:6822","nonce":37308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":37308},{"type":"v1","addr":"172.21.15.17:6826","nonce":37308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":37308},{"type":"v1","addr":"172.21.15.17:6831","nonce":37308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":37308},{"type":"v1","addr":"172.21.15.17:6829","nonce":37308}]},"public_addr":"172.21.15.17:6822/37308","cluster_addr":"172.21.15.17:6826/37308","heartbeat_back_addr":"172.21.15.17:6831/37308","heartbeat_front_addr":"172.21.15.17:6829/37308","state":["exists","up"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":37465},{"type":"v1","addr":"172.21.15.94:6809","nonce":37465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6811","nonce":37465},{"type":"v1","addr":"172.21.15.94:6813","nonce":37465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6819","nonce":37465},{"type":"v1","addr":"172.21.15.94:6822","nonce":37465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6815","nonce":37465},{"type":"v1","addr":"172.21.15.94:6817","nonce":37465}]},"public_addr":"172.21.15.94:6809/37465","cluster_addr":"172.21.15.94:6813/37465","heartbeat_back_addr":"172.21.15.94:6822/37465","heartbeat_front_addr":"172.21.15.94:6817/37465","state":["exists","up"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":37464},{"type":"v1","addr":"172.21.15.94:6812","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":37464},{"type":"v1","addr":"172.21.15.94:6816","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":37464},{"type":"v1","addr":"172.21.15.94:6823","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":37464},{"type":"v1","addr":"172.21.15.94:6820","nonce":37464}]},"public_addr":"172.21.15.94:6812/37464","cluster_addr":"172.21.15.94:6816/37464","heartbeat_back_addr":"172.21.15.94:6823/37464","heartbeat_front_addr":"172.21.15.94:6820/37464","state":["exists","up"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":37467},{"type":"v1","addr":"172.21.15.94:6825","nonce":37467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":37467},{"type":"v1","addr":"172.21.15.94:6827","nonce":37467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":37467},{"type":"v1","addr":"172.21.15.94:6831","nonce":37467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":37467},{"type":"v1","addr":"172.21.15.94:6829","nonce":37467}]},"public_addr":"172.21.15.94:6825/37467","cluster_addr":"172.21.15.94:6827/37467","heartbeat_back_addr":"172.21.15.94:6831/37467","heartbeat_front_addr":"172.21.15.94:6829/37467","state":["exists","up"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":37466},{"type":"v1","addr":"172.21.15.94:6801","nonce":37466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":37466},{"type":"v1","addr":"172.21.15.94:6803","nonce":37466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":37466},{"type":"v1","addr":"172.21.15.94:6807","nonce":37466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":37466},{"type":"v1","addr":"172.21.15.94:6805","nonce":37466}]},"public_addr":"172.21.15.94:6801/37466","cluster_addr":"172.21.15.94:6803/37466","heartbeat_back_addr":"172.21.15.94:6807/37466","heartbeat_front_addr":"172.21.15.94:6805/37466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.327217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.186966+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.419986+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.150585+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.120621+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.121576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.181257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.293188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:18:46.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.720+0000 7f8a7d400640 1 -- 172.21.15.17:0/3609859541 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f8a5406ac00 msgr2=0x7f8a5406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:46.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.720+0000 7f8a7d400640 1 --2- 172.21.15.17:0/3609859541 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f8a5406ac00 0x7f8a5406d0c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8a7815e100 tx=0x7f8a60008040 comp rx=0 tx=0).stop 2024-03-12T17:18:46.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.720+0000 7f8a7d400640 1 -- 172.21.15.17:0/3609859541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a780b2070 msgr2=0x7f8a780c5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:46.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.720+0000 7f8a7d400640 1 --2- 172.21.15.17:0/3609859541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a780b2070 0x7f8a780c5ea0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8a6800b3f0 tx=0x7f8a6800b8b0 comp rx=0 tx=0).stop 2024-03-12T17:18:46.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.720+0000 7f8a7d400640 1 -- 172.21.15.17:0/3609859541 shutdown_connections 2024-03-12T17:18:46.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.720+0000 7f8a7d400640 1 --2- 172.21.15.17:0/3609859541 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f8a5406ac00 0x7f8a5406d0c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:46.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.720+0000 7f8a7d400640 1 --2- 172.21.15.17:0/3609859541 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8a78144240 0x7f8a780c3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:46.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.720+0000 7f8a7d400640 1 --2- 172.21.15.17:0/3609859541 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8a780cb970 0x7f8a781f5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:46.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.720+0000 7f8a7d400640 1 --2- 172.21.15.17:0/3609859541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8a780b2070 0x7f8a780c5ea0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:46.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.720+0000 7f8a7d400640 1 -- 172.21.15.17:0/3609859541 >> 172.21.15.17:0/3609859541 conn(0x7f8a78069ce0 msgr2=0x7f8a7806d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:46.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.720+0000 7f8a7d400640 1 -- 172.21.15.17:0/3609859541 shutdown_connections 2024-03-12T17:18:46.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.720+0000 7f8a7d400640 1 -- 172.21.15.17:0/3609859541 wait complete. 2024-03-12T17:18:46.733 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-12T17:18:46.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.960+0000 7fafb3200640 1 Processor -- start 2024-03-12T17:18:47.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.960+0000 7fafb3200640 1 -- start start 2024-03-12T17:18:47.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.961+0000 7fafb3200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fafac098b40 0x7fafac098f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:47.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.961+0000 7fafb3200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafac0b0610 con 0x7fafac0b1e20 2024-03-12T17:18:47.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.961+0000 7fafb3200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafac099460 con 0x7fafac0cb1f0 2024-03-12T17:18:47.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.961+0000 7fafb3200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafac0cf270 con 0x7fafac098b40 2024-03-12T17:18:47.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.961+0000 7fafb1200640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fafac0b1e20 0x7fafac0b0aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37774/0 (socket says 172.21.15.17:37774) 2024-03-12T17:18:47.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.961+0000 7fafb1200640 1 -- 172.21.15.17:0/1315252839 learned_addr learned my addr 172.21.15.17:0/1315252839 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:18:47.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.962+0000 7fafabe00640 1 --2- 172.21.15.17:0/1315252839 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fafac098b40 0x7fafac098f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:47.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.962+0000 7fafaaa00640 1 -- 172.21.15.17:0/1315252839 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2002186448 0 0) 0x7fafac0b0610 con 0x7fafac0b1e20 2024-03-12T17:18:47.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.962+0000 7fafaaa00640 1 -- 172.21.15.17:0/1315252839 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf8c003520 con 0x7fafac0b1e20 2024-03-12T17:18:47.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.962+0000 7fafaaa00640 1 -- 172.21.15.17:0/1315252839 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2519293658 0 0) 0x7faf8c003520 con 0x7fafac0b1e20 2024-03-12T17:18:47.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.962+0000 7fafaaa00640 1 -- 172.21.15.17:0/1315252839 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fafac098b40 msgr2=0x7fafac098f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:47.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.962+0000 7fafaaa00640 1 --2- 172.21.15.17:0/1315252839 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fafac098b40 0x7fafac098f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:47.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.962+0000 7fafaaa00640 1 -- 172.21.15.17:0/1315252839 >> v1:172.21.15.94:6789/0 conn(0x7fafac0cb1f0 legacy=0x7fafac0b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:47.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.962+0000 7fafaaa00640 1 -- 172.21.15.17:0/1315252839 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafac0cf550 con 0x7fafac0b1e20 2024-03-12T17:18:47.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.962+0000 7fafaaa00640 1 -- 172.21.15.17:0/1315252839 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7fafa4001670 con 0x7fafac0b1e20 2024-03-12T17:18:47.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.962+0000 7fafaaa00640 1 -- 172.21.15.17:0/1315252839 >> v1:172.21.15.17:6789/0 conn(0x7fafac0b1e20 legacy=0x7fafac0b0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:47.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.962+0000 7fafaaa00640 1 --2- 172.21.15.17:0/1315252839 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fafac098b40 0x7faf8c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:47.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.962+0000 7fafaaa00640 1 --2- 172.21.15.17:0/1315252839 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf8c003f70 0x7faf8c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:47.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.962+0000 7fafaaa00640 1 --2- 172.21.15.17:0/1315252839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf8c004d00 0x7faf8c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:47.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.962+0000 7fafaaa00640 1 -- 172.21.15.17:0/1315252839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafac0cf270 con 0x7faf8c004d00 2024-03-12T17:18:47.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.962+0000 7fafaaa00640 1 -- 172.21.15.17:0/1315252839 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8c00bac0 con 0x7faf8c003f70 2024-03-12T17:18:47.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.962+0000 7fafaaa00640 1 -- 172.21.15.17:0/1315252839 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf8c00bc80 con 0x7fafac098b40 2024-03-12T17:18:47.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.963+0000 7fafb1200640 1 --2- 172.21.15.17:0/1315252839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf8c004d00 0x7faf8c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:47.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.963+0000 7fafabe00640 1 --2- 172.21.15.17:0/1315252839 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fafac098b40 0x7faf8c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:47.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.963+0000 7fafab400640 1 --2- 172.21.15.17:0/1315252839 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf8c003f70 0x7faf8c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:47.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.963+0000 7fafb1200640 1 -- 172.21.15.17:0/1315252839 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fafac098b40 msgr2=0x7faf8c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:47.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.963+0000 7fafb1200640 1 --2- 172.21.15.17:0/1315252839 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fafac098b40 0x7faf8c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:47.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.963+0000 7fafb1200640 1 -- 172.21.15.17:0/1315252839 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf8c003f70 msgr2=0x7faf8c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:47.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.963+0000 7fafb1200640 1 --2- 172.21.15.17:0/1315252839 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf8c003f70 0x7faf8c0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:47.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.963+0000 7fafb1200640 1 -- 172.21.15.17:0/1315252839 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8c003520 con 0x7faf8c004d00 2024-03-12T17:18:47.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.964+0000 7fafb1200640 1 --2- 172.21.15.17:0/1315252839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf8c004d00 0x7faf8c005180 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fafa400c0e0 tx=0x7faf8c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e6dadde2baee7bf server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:47.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.964+0000 7fafaaa00640 1 -- 172.21.15.17:0/1315252839 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa4005ad0 con 0x7faf8c004d00 2024-03-12T17:18:47.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.964+0000 7fafaaa00640 1 -- 172.21.15.17:0/1315252839 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa4005c30 con 0x7faf8c004d00 2024-03-12T17:18:47.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.964+0000 7fafaaa00640 1 -- 172.21.15.17:0/1315252839 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa402ca50 con 0x7faf8c004d00 2024-03-12T17:18:47.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.965+0000 7fafb3200640 1 -- 172.21.15.17:0/1315252839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf8c004d00 msgr2=0x7faf8c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:47.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.965+0000 7fafb3200640 1 --2- 172.21.15.17:0/1315252839 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf8c004d00 0x7faf8c005180 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fafa400c0e0 tx=0x7faf8c0057f0 comp rx=0 tx=0).stop 2024-03-12T17:18:47.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.965+0000 7fafb1200640 1 -- 172.21.15.17:0/1315252839 reap_dead start 2024-03-12T17:18:47.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.965+0000 7fafb3200640 1 -- 172.21.15.17:0/1315252839 shutdown_connections 2024-03-12T17:18:47.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.965+0000 7fafb3200640 1 -- 172.21.15.17:0/1315252839 >> 172.21.15.17:0/1315252839 conn(0x7fafac0b23d0 msgr2=0x7fafac0b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:47.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.965+0000 7fafb3200640 1 -- 172.21.15.17:0/1315252839 shutdown_connections 2024-03-12T17:18:47.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.965+0000 7fafb3200640 1 -- 172.21.15.17:0/1315252839 wait complete. 2024-03-12T17:18:47.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.967+0000 7fafb3200640 1 Processor -- start 2024-03-12T17:18:47.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.967+0000 7fafb3200640 1 -- start start 2024-03-12T17:18:47.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.968+0000 7fafb3200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf8c004d00 0x7fafac1579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:47.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.968+0000 7fafb3200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fafac0cdfa0 0x7fafac0c6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:47.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.968+0000 7fafb3200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafac1588b0 0x7fafac158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:47.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.968+0000 7fafb3200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafac159280 con 0x7faf8c004d00 2024-03-12T17:18:47.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.968+0000 7fafb3200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafac1f2d80 con 0x7fafac1588b0 2024-03-12T17:18:47.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.968+0000 7fafb3200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafac1f2450 con 0x7fafac0cdfa0 2024-03-12T17:18:47.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.968+0000 7fafabe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf8c004d00 0x7fafac1579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:47.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.968+0000 7fafabe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf8c004d00 0x7fafac1579a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48020/0 (socket says 172.21.15.17:48020) 2024-03-12T17:18:47.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.968+0000 7fafabe00640 1 -- 172.21.15.17:0/1341047589 learned_addr learned my addr 172.21.15.17:0/1341047589 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:47.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.968+0000 7fafb1200640 1 --2- 172.21.15.17:0/1341047589 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafac1588b0 0x7fafac158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:47.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.968+0000 7fafab400640 1 --2- 172.21.15.17:0/1341047589 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fafac0cdfa0 0x7fafac0c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:47.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.969+0000 7fafabe00640 1 -- 172.21.15.17:0/1341047589 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fafac0cdfa0 msgr2=0x7fafac0c6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:47.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.969+0000 7fafabe00640 1 --2- 172.21.15.17:0/1341047589 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fafac0cdfa0 0x7fafac0c6490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:47.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.969+0000 7fafabe00640 1 -- 172.21.15.17:0/1341047589 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafac1588b0 msgr2=0x7fafac158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:47.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.969+0000 7fafabe00640 1 --2- 172.21.15.17:0/1341047589 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafac1588b0 0x7fafac158d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:47.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.969+0000 7fafabe00640 1 -- 172.21.15.17:0/1341047589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafac1f2730 con 0x7faf8c004d00 2024-03-12T17:18:47.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.969+0000 7fafb1200640 1 --2- 172.21.15.17:0/1341047589 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafac1588b0 0x7fafac158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:18:47.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.969+0000 7fafabe00640 1 --2- 172.21.15.17:0/1341047589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf8c004d00 0x7fafac1579a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faf9c011630 tx=0x7faf9c011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:47.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.969+0000 7fafa3e00640 1 -- 172.21.15.17:0/1341047589 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c00f920 con 0x7faf8c004d00 2024-03-12T17:18:47.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.969+0000 7fafa3e00640 1 -- 172.21.15.17:0/1341047589 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9c00fa80 con 0x7faf8c004d00 2024-03-12T17:18:47.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.969+0000 7fafa3e00640 1 -- 172.21.15.17:0/1341047589 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c00fdf0 con 0x7faf8c004d00 2024-03-12T17:18:47.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.969+0000 7fafb3200640 1 -- 172.21.15.17:0/1341047589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafac1f2a10 con 0x7faf8c004d00 2024-03-12T17:18:47.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.969+0000 7fafb3200640 1 -- 172.21.15.17:0/1341047589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafac157ee0 con 0x7faf8c004d00 2024-03-12T17:18:47.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.971+0000 7fafb3200640 1 -- 172.21.15.17:0/1341047589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafac0736c0 con 0x7faf8c004d00 2024-03-12T17:18:47.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.971+0000 7fafa3e00640 1 -- 172.21.15.17:0/1341047589 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7faf9c015460 con 0x7faf8c004d00 2024-03-12T17:18:47.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.972+0000 7fafa3e00640 1 --2- 172.21.15.17:0/1341047589 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faf8806ac50 0x7faf8806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:47.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.972+0000 7fafa3e00640 1 -- 172.21.15.17:0/1341047589 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf9c089b50 con 0x7faf8c004d00 2024-03-12T17:18:47.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.973+0000 7fafab400640 1 --2- 172.21.15.17:0/1341047589 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faf8806ac50 0x7faf8806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:47.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.973+0000 7fafab400640 1 --2- 172.21.15.17:0/1341047589 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faf8806ac50 0x7faf8806d110 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fafac0ce3a0 tx=0x7faf94009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:47.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:46.977+0000 7fafa3e00640 1 -- 172.21.15.17:0/1341047589 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7faf9c054e10 con 0x7faf8c004d00 2024-03-12T17:18:47.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:47.217+0000 7fafb3200640 1 -- 172.21.15.17:0/1341047589 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fafac0b3060 con 0x7faf8c004d00 2024-03-12T17:18:47.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:47.856+0000 7fafa3e00640 1 -- 172.21.15.17:0/1341047589 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7faf9c058430 con 0x7faf8c004d00 2024-03-12T17:18:47.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:47.859+0000 7fafb3200640 1 -- 172.21.15.17:0/1341047589 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faf8806ac50 msgr2=0x7faf8806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:47.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:47.859+0000 7fafb3200640 1 --2- 172.21.15.17:0/1341047589 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faf8806ac50 0x7faf8806d110 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fafac0ce3a0 tx=0x7faf94009040 comp rx=0 tx=0).stop 2024-03-12T17:18:47.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:47.859+0000 7fafb3200640 1 -- 172.21.15.17:0/1341047589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf8c004d00 msgr2=0x7fafac1579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:47.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:47.859+0000 7fafb3200640 1 --2- 172.21.15.17:0/1341047589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf8c004d00 0x7fafac1579a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faf9c011630 tx=0x7faf9c011af0 comp rx=0 tx=0).stop 2024-03-12T17:18:47.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:47.860+0000 7fafb3200640 1 -- 172.21.15.17:0/1341047589 shutdown_connections 2024-03-12T17:18:47.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:47.860+0000 7fafb3200640 1 --2- 172.21.15.17:0/1341047589 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faf8806ac50 0x7faf8806d110 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:47.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:47.860+0000 7fafb3200640 1 --2- 172.21.15.17:0/1341047589 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafac1588b0 0x7fafac158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:47.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:47.860+0000 7fafb3200640 1 --2- 172.21.15.17:0/1341047589 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fafac0cdfa0 0x7fafac0c6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:47.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:47.860+0000 7fafb3200640 1 --2- 172.21.15.17:0/1341047589 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf8c004d00 0x7fafac1579a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:47.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:47.860+0000 7fafb3200640 1 -- 172.21.15.17:0/1341047589 >> 172.21.15.17:0/1341047589 conn(0x7fafac0b23d0 msgr2=0x7fafac0b6170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:47.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:47.860+0000 7fafb3200640 1 -- 172.21.15.17:0/1341047589 shutdown_connections 2024-03-12T17:18:47.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:47.860+0000 7fafb3200640 1 -- 172.21.15.17:0/1341047589 wait complete. 2024-03-12T17:18:47.877 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-12T17:18:47.877 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-12T17:18:48.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.110+0000 7f96d3000640 1 Processor -- start 2024-03-12T17:18:48.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.110+0000 7f96d3000640 1 -- start start 2024-03-12T17:18:48.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.111+0000 7f96d3000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f96cc158f90 0x7f96cc0cac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:48.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.111+0000 7f96d3000640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f96cc070b00 0x7f96cc06c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:48.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.112+0000 7f96d3000640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96cc0b3700 con 0x7f96cc06e2b0 2024-03-12T17:18:48.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.112+0000 7f96d3000640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96cc0ad990 con 0x7f96cc158f90 2024-03-12T17:18:48.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.112+0000 7f96d3000640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96cc0ad6b0 con 0x7f96cc070b00 2024-03-12T17:18:48.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.112+0000 7f96cbe00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f96cc158f90 0x7f96cc0cac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:48.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.112+0000 7f96cbe00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f96cc158f90 0x7f96cc0cac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48030/0 (socket says 172.21.15.17:48030) 2024-03-12T17:18:48.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.112+0000 7f96cbe00640 1 -- 172.21.15.17:0/860967458 learned_addr learned my addr 172.21.15.17:0/860967458 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:48.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.112+0000 7f96c3e00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f96cc06e2b0 0x7f96cc0703f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37778/0 (socket says 172.21.15.17:37778) 2024-03-12T17:18:48.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.112+0000 7f96d1000640 1 --2- 172.21.15.17:0/860967458 >> v2:172.21.15.94:3300/0 conn(0x7f96cc070b00 0x7f96cc06c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:48.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.113+0000 7f96cbe00640 1 -- 172.21.15.17:0/860967458 >> v2:172.21.15.94:3300/0 conn(0x7f96cc070b00 msgr2=0x7f96cc06c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:48.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.113+0000 7f96cbe00640 1 --2- 172.21.15.17:0/860967458 >> v2:172.21.15.94:3300/0 conn(0x7f96cc070b00 0x7f96cc06c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:48.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.113+0000 7f96cbe00640 1 -- 172.21.15.17:0/860967458 >> v1:172.21.15.17:6789/0 conn(0x7f96cc06e2b0 legacy=0x7f96cc0703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:48.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.113+0000 7f96cbe00640 1 -- 172.21.15.17:0/860967458 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96cc15cc80 con 0x7f96cc158f90 2024-03-12T17:18:48.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.113+0000 7f96d1000640 1 --2- 172.21.15.17:0/860967458 >> v2:172.21.15.94:3300/0 conn(0x7f96cc070b00 0x7f96cc06c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:18:48.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.113+0000 7f96cb400640 1 -- 172.21.15.17:0/860967458 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3037163000 0 0) 0x7f96cc0b3700 con 0x7f96cc06e2b0 2024-03-12T17:18:48.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.114+0000 7f96cbe00640 1 --2- 172.21.15.17:0/860967458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96cc158f90 0x7f96cc0cac60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f96cc0ce650 tx=0x7f96bc02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f5ee15a1ebed57e server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:48.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.114+0000 7f96cb400640 1 -- 172.21.15.17:0/860967458 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc030860 con 0x7f96cc158f90 2024-03-12T17:18:48.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.114+0000 7f96cb400640 1 -- 172.21.15.17:0/860967458 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96bc0309c0 con 0x7f96cc158f90 2024-03-12T17:18:48.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.114+0000 7f96cb400640 1 -- 172.21.15.17:0/860967458 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc030d50 con 0x7f96cc158f90 2024-03-12T17:18:48.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.115+0000 7f96d3000640 1 -- 172.21.15.17:0/860967458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96cc158f90 msgr2=0x7f96cc0cac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:48.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.115+0000 7f96d3000640 1 --2- 172.21.15.17:0/860967458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96cc158f90 0x7f96cc0cac60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f96cc0ce650 tx=0x7f96bc02b9a0 comp rx=0 tx=0).stop 2024-03-12T17:18:48.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.115+0000 7f96d3000640 1 -- 172.21.15.17:0/860967458 shutdown_connections 2024-03-12T17:18:48.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.115+0000 7f96d3000640 1 --2- 172.21.15.17:0/860967458 >> v2:172.21.15.94:3300/0 conn(0x7f96cc070b00 0x7f96cc06c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:48.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.115+0000 7f96d3000640 1 --2- 172.21.15.17:0/860967458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96cc158f90 0x7f96cc0cac60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:48.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.115+0000 7f96d3000640 1 -- 172.21.15.17:0/860967458 >> 172.21.15.17:0/860967458 conn(0x7f96cc069ce0 msgr2=0x7f96cc06a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:48.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.115+0000 7f96d3000640 1 -- 172.21.15.17:0/860967458 shutdown_connections 2024-03-12T17:18:48.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.115+0000 7f96d3000640 1 -- 172.21.15.17:0/860967458 wait complete. 2024-03-12T17:18:48.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.117+0000 7f96d3000640 1 Processor -- start 2024-03-12T17:18:48.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.117+0000 7f96d3000640 1 -- start start 2024-03-12T17:18:48.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.118+0000 7f96d3000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96cc06e2b0 0x7f96cc147490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:48.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.118+0000 7f96d3000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f96cc070b00 0x7f96cc1479d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:48.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.118+0000 7f96d3000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96cc158f90 0x7f96cc14ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:48.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.118+0000 7f96d3000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc1f6750 con 0x7f96cc06e2b0 2024-03-12T17:18:48.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.118+0000 7f96d3000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc1f5b40 con 0x7f96cc158f90 2024-03-12T17:18:48.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.118+0000 7f96d3000640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc1f5e20 con 0x7f96cc070b00 2024-03-12T17:18:48.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.118+0000 7f96cbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96cc06e2b0 0x7f96cc147490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:48.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.118+0000 7f96cbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96cc06e2b0 0x7f96cc147490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48036/0 (socket says 172.21.15.17:48036) 2024-03-12T17:18:48.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.118+0000 7f96cbe00640 1 -- 172.21.15.17:0/3653043285 learned_addr learned my addr 172.21.15.17:0/3653043285 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:48.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.118+0000 7f96cbe00640 1 -- 172.21.15.17:0/3653043285 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f96cc070b00 msgr2=0x7f96cc1479d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:48.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.118+0000 7f96cbe00640 1 --2- 172.21.15.17:0/3653043285 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f96cc070b00 0x7f96cc1479d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:48.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.118+0000 7f96cbe00640 1 -- 172.21.15.17:0/3653043285 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96cc158f90 msgr2=0x7f96cc14ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:48.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.118+0000 7f96cbe00640 1 --2- 172.21.15.17:0/3653043285 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96cc158f90 0x7f96cc14ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:48.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.119+0000 7f96cbe00640 1 -- 172.21.15.17:0/3653043285 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96bc0094d0 con 0x7f96cc06e2b0 2024-03-12T17:18:48.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.119+0000 7f96cbe00640 1 --2- 172.21.15.17:0/3653043285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96cc06e2b0 0x7f96cc147490 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f96bc000c00 tx=0x7f96bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:48.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.119+0000 7f96c8c00640 1 -- 172.21.15.17:0/3653043285 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc03e070 con 0x7f96cc06e2b0 2024-03-12T17:18:48.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.119+0000 7f96c8c00640 1 -- 172.21.15.17:0/3653043285 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96bc004030 con 0x7f96cc06e2b0 2024-03-12T17:18:48.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.119+0000 7f96d3000640 1 -- 172.21.15.17:0/3653043285 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96cc1f6100 con 0x7f96cc06e2b0 2024-03-12T17:18:48.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.119+0000 7f96c8c00640 1 -- 172.21.15.17:0/3653043285 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc0043c0 con 0x7f96cc06e2b0 2024-03-12T17:18:48.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.119+0000 7f96d3000640 1 -- 172.21.15.17:0/3653043285 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96cc1415d0 con 0x7f96cc06e2b0 2024-03-12T17:18:48.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.120+0000 7f96d3000640 1 -- 172.21.15.17:0/3653043285 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96cc0736c0 con 0x7f96cc06e2b0 2024-03-12T17:18:48.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.121+0000 7f96c8c00640 1 -- 172.21.15.17:0/3653043285 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f96bc042070 con 0x7f96cc06e2b0 2024-03-12T17:18:48.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.122+0000 7f96c8c00640 1 --2- 172.21.15.17:0/3653043285 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f96a806ac00 0x7f96a806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:48.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.122+0000 7f96c8c00640 1 -- 172.21.15.17:0/3653043285 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f96bc0ab360 con 0x7f96cc06e2b0 2024-03-12T17:18:48.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.122+0000 7f96c3e00640 1 --2- 172.21.15.17:0/3653043285 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f96a806ac00 0x7f96a806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:48.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.123+0000 7f96c3e00640 1 --2- 172.21.15.17:0/3653043285 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f96a806ac00 0x7f96a806d0c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f96b4007fd0 tx=0x7f96b4007900 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:48.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.127+0000 7f96c8c00640 1 -- 172.21.15.17:0/3653043285 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f96bc0765c0 con 0x7f96cc06e2b0 2024-03-12T17:18:48.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:48.367+0000 7f96d3000640 1 -- 172.21.15.17:0/3653043285 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f96cc15c950 con 0x7f96cc06e2b0 2024-03-12T17:18:49.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.361+0000 7f96c8c00640 1 -- 172.21.15.17:0/3653043285 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7f96bc079be0 con 0x7f96cc06e2b0 2024-03-12T17:18:49.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.364+0000 7f96d3000640 1 -- 172.21.15.17:0/3653043285 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f96a806ac00 msgr2=0x7f96a806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:49.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.364+0000 7f96d3000640 1 --2- 172.21.15.17:0/3653043285 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f96a806ac00 0x7f96a806d0c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f96b4007fd0 tx=0x7f96b4007900 comp rx=0 tx=0).stop 2024-03-12T17:18:49.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.364+0000 7f96d3000640 1 -- 172.21.15.17:0/3653043285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96cc06e2b0 msgr2=0x7f96cc147490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:49.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.364+0000 7f96d3000640 1 --2- 172.21.15.17:0/3653043285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96cc06e2b0 0x7f96cc147490 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f96bc000c00 tx=0x7f96bc0046c0 comp rx=0 tx=0).stop 2024-03-12T17:18:49.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.365+0000 7f96d3000640 1 -- 172.21.15.17:0/3653043285 shutdown_connections 2024-03-12T17:18:49.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.365+0000 7f96d3000640 1 --2- 172.21.15.17:0/3653043285 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f96a806ac00 0x7f96a806d0c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:49.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.365+0000 7f96d3000640 1 --2- 172.21.15.17:0/3653043285 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f96cc158f90 0x7f96cc14ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:49.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.365+0000 7f96d3000640 1 --2- 172.21.15.17:0/3653043285 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f96cc070b00 0x7f96cc1479d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:49.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.365+0000 7f96d3000640 1 --2- 172.21.15.17:0/3653043285 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f96cc06e2b0 0x7f96cc147490 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:49.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.365+0000 7f96d3000640 1 -- 172.21.15.17:0/3653043285 >> 172.21.15.17:0/3653043285 conn(0x7f96cc069ce0 msgr2=0x7f96cc149ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:49.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.365+0000 7f96d3000640 1 -- 172.21.15.17:0/3653043285 shutdown_connections 2024-03-12T17:18:49.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.365+0000 7f96d3000640 1 -- 172.21.15.17:0/3653043285 wait complete. 2024-03-12T17:18:49.383 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-12T17:18:49.384 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-12T17:18:49.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.601+0000 7f3769200640 1 Processor -- start 2024-03-12T17:18:49.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.601+0000 7f3769200640 1 -- start start 2024-03-12T17:18:49.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.603+0000 7f3769200640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f37640cc080 0x7f37640b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:49.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.603+0000 7f3769200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37640ce320 con 0x7f3764144240 2024-03-12T17:18:49.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.603+0000 7f3769200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3764144620 con 0x7f37640b2070 2024-03-12T17:18:49.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.603+0000 7f3769200640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f376415f3d0 con 0x7f37640cc080 2024-03-12T17:18:49.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.603+0000 7f3761e00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f3764144240 0x7f37640ce7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37792/0 (socket says 172.21.15.17:37792) 2024-03-12T17:18:49.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.603+0000 7f3761e00640 1 -- 172.21.15.17:0/56464725 learned_addr learned my addr 172.21.15.17:0/56464725 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:18:49.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.603+0000 7f3762800640 1 --2- 172.21.15.17:0/56464725 >> v2:172.21.15.94:3300/0 conn(0x7f37640cc080 0x7f37640b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:49.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.604+0000 7f3761400640 1 -- 172.21.15.17:0/56464725 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 933791446 0 0) 0x7f37640ce320 con 0x7f3764144240 2024-03-12T17:18:49.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.604+0000 7f3761400640 1 -- 172.21.15.17:0/56464725 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3748003520 con 0x7f3764144240 2024-03-12T17:18:49.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.604+0000 7f3761400640 1 -- 172.21.15.17:0/56464725 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1663741510 0 0) 0x7f3748003520 con 0x7f3764144240 2024-03-12T17:18:49.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.604+0000 7f3761400640 1 -- 172.21.15.17:0/56464725 >> v2:172.21.15.94:3300/0 conn(0x7f37640cc080 msgr2=0x7f37640b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:49.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.604+0000 7f3761400640 1 --2- 172.21.15.17:0/56464725 >> v2:172.21.15.94:3300/0 conn(0x7f37640cc080 0x7f37640b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:49.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.604+0000 7f3761400640 1 -- 172.21.15.17:0/56464725 >> v1:172.21.15.94:6789/0 conn(0x7f37640b2070 legacy=0x7f37640cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:49.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.604+0000 7f3761400640 1 -- 172.21.15.17:0/56464725 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37640cd9f0 con 0x7f3764144240 2024-03-12T17:18:49.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.604+0000 7f3761400640 1 -- 172.21.15.17:0/56464725 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7f37540019f0 con 0x7f3764144240 2024-03-12T17:18:49.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.604+0000 7f3761400640 1 -- 172.21.15.17:0/56464725 >> v1:172.21.15.17:6789/0 conn(0x7f3764144240 legacy=0x7f37640ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:49.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.604+0000 7f3761400640 1 --2- 172.21.15.17:0/56464725 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37480039c0 0x7f3748003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:49.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.604+0000 7f3761400640 1 --2- 172.21.15.17:0/56464725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37480047c0 0x7f3748004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:49.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.604+0000 7f3761400640 1 --2- 172.21.15.17:0/56464725 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3748005180 0x7f374800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:49.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.604+0000 7f3761400640 1 -- 172.21.15.17:0/56464725 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376415f3d0 con 0x7f37480047c0 2024-03-12T17:18:49.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.604+0000 7f3761400640 1 -- 172.21.15.17:0/56464725 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374800c080 con 0x7f37480039c0 2024-03-12T17:18:49.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.604+0000 7f3761400640 1 -- 172.21.15.17:0/56464725 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f374800c240 con 0x7f3748005180 2024-03-12T17:18:49.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.605+0000 7f3759400640 1 --2- 172.21.15.17:0/56464725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37480047c0 0x7f3748004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:49.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.605+0000 7f3761e00640 1 --2- 172.21.15.17:0/56464725 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37480039c0 0x7f3748003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:49.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.605+0000 7f3759400640 1 -- 172.21.15.17:0/56464725 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3748005180 msgr2=0x7f374800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:49.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.605+0000 7f3759400640 1 --2- 172.21.15.17:0/56464725 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3748005180 0x7f374800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:49.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.605+0000 7f3759400640 1 -- 172.21.15.17:0/56464725 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37480039c0 msgr2=0x7f3748003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:49.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.605+0000 7f3759400640 1 --2- 172.21.15.17:0/56464725 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37480039c0 0x7f3748003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:49.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.605+0000 7f3759400640 1 -- 172.21.15.17:0/56464725 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3748003520 con 0x7f37480047c0 2024-03-12T17:18:49.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.605+0000 7f3762800640 1 -- 172.21.15.17:0/56464725 reap_dead start 2024-03-12T17:18:49.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.606+0000 7f3759400640 1 --2- 172.21.15.17:0/56464725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37480047c0 0x7f3748004c40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f374c001750 tx=0x7f37480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b5ee9f8bb2acd2d server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:49.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.606+0000 7f3761400640 1 -- 172.21.15.17:0/56464725 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c0052d0 con 0x7f37480047c0 2024-03-12T17:18:49.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.606+0000 7f3761400640 1 -- 172.21.15.17:0/56464725 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374c02e050 con 0x7f37480047c0 2024-03-12T17:18:49.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.606+0000 7f3761400640 1 -- 172.21.15.17:0/56464725 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c003830 con 0x7f37480047c0 2024-03-12T17:18:49.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.607+0000 7f3769200640 1 -- 172.21.15.17:0/56464725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37480047c0 msgr2=0x7f3748004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:49.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.607+0000 7f3769200640 1 --2- 172.21.15.17:0/56464725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37480047c0 0x7f3748004c40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f374c001750 tx=0x7f37480057f0 comp rx=0 tx=0).stop 2024-03-12T17:18:49.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.607+0000 7f3769200640 1 -- 172.21.15.17:0/56464725 shutdown_connections 2024-03-12T17:18:49.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.607+0000 7f3769200640 1 --2- 172.21.15.17:0/56464725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37480047c0 0x7f3748004c40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:49.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.607+0000 7f3769200640 1 -- 172.21.15.17:0/56464725 >> 172.21.15.17:0/56464725 conn(0x7f3764069ce0 msgr2=0x7f376406a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:49.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.607+0000 7f3769200640 1 -- 172.21.15.17:0/56464725 shutdown_connections 2024-03-12T17:18:49.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.607+0000 7f3769200640 1 -- 172.21.15.17:0/56464725 wait complete. 2024-03-12T17:18:49.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.609+0000 7f3769200640 1 Processor -- start 2024-03-12T17:18:49.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.609+0000 7f3769200640 1 -- start start 2024-03-12T17:18:49.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.610+0000 7f3769200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37480047c0 0x7f3764159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:49.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.610+0000 7f3769200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f376406d640 0x7f376406dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:49.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.610+0000 7f3769200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37640ac920 0x7f37640acda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:49.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.610+0000 7f3769200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376406c3f0 con 0x7f37480047c0 2024-03-12T17:18:49.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.610+0000 7f3769200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37640ad2e0 con 0x7f37640ac920 2024-03-12T17:18:49.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.610+0000 7f3769200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f376406e0e0 con 0x7f376406d640 2024-03-12T17:18:49.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.611+0000 7f3761e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37480047c0 0x7f3764159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:49.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.611+0000 7f3761e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37480047c0 0x7f3764159ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48058/0 (socket says 172.21.15.17:48058) 2024-03-12T17:18:49.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.611+0000 7f3761e00640 1 -- 172.21.15.17:0/2561189967 learned_addr learned my addr 172.21.15.17:0/2561189967 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:49.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.611+0000 7f3759400640 1 --2- 172.21.15.17:0/2561189967 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f376406d640 0x7f376406dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:49.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.611+0000 7f3762800640 1 --2- 172.21.15.17:0/2561189967 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37640ac920 0x7f37640acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:49.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.611+0000 7f3761e00640 1 -- 172.21.15.17:0/2561189967 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f376406d640 msgr2=0x7f376406dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:49.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.611+0000 7f3761e00640 1 --2- 172.21.15.17:0/2561189967 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f376406d640 0x7f376406dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:49.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.611+0000 7f3761e00640 1 -- 172.21.15.17:0/2561189967 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37640ac920 msgr2=0x7f37640acda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:49.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.611+0000 7f3761e00640 1 --2- 172.21.15.17:0/2561189967 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37640ac920 0x7f37640acda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:49.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.611+0000 7f3761e00640 1 -- 172.21.15.17:0/2561189967 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376406c5d0 con 0x7f37480047c0 2024-03-12T17:18:49.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.611+0000 7f3759400640 1 --2- 172.21.15.17:0/2561189967 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f376406d640 0x7f376406dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:18:49.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.611+0000 7f3761e00640 1 --2- 172.21.15.17:0/2561189967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37480047c0 0x7f3764159ce0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f37540079e0 tx=0x7f375400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:49.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.612+0000 7f375aa00640 1 -- 172.21.15.17:0/2561189967 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375400ee50 con 0x7f37480047c0 2024-03-12T17:18:49.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.612+0000 7f375aa00640 1 -- 172.21.15.17:0/2561189967 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3754013420 con 0x7f37480047c0 2024-03-12T17:18:49.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.612+0000 7f375aa00640 1 -- 172.21.15.17:0/2561189967 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37540137d0 con 0x7f37480047c0 2024-03-12T17:18:49.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.612+0000 7f3769200640 1 -- 172.21.15.17:0/2561189967 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f376406c8b0 con 0x7f37480047c0 2024-03-12T17:18:49.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.612+0000 7f3769200640 1 -- 172.21.15.17:0/2561189967 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3764139520 con 0x7f37480047c0 2024-03-12T17:18:49.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.613+0000 7f3769200640 1 -- 172.21.15.17:0/2561189967 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f376406cdd0 con 0x7f37480047c0 2024-03-12T17:18:49.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.614+0000 7f375aa00640 1 -- 172.21.15.17:0/2561189967 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f3754013930 con 0x7f37480047c0 2024-03-12T17:18:49.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.615+0000 7f375aa00640 1 --2- 172.21.15.17:0/2561189967 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f374006ac30 0x7f374006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:49.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.615+0000 7f375aa00640 1 -- 172.21.15.17:0/2561189967 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3754089b00 con 0x7f37480047c0 2024-03-12T17:18:49.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.615+0000 7f3759400640 1 --2- 172.21.15.17:0/2561189967 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f374006ac30 0x7f374006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:49.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.616+0000 7f3759400640 1 --2- 172.21.15.17:0/2561189967 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f374006ac30 0x7f374006d0f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f374c033000 tx=0x7f374c009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:49.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.619+0000 7f375aa00640 1 -- 172.21.15.17:0/2561189967 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f376406cdd0 con 0x7f37480047c0 2024-03-12T17:18:49.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.856+0000 7f3769200640 1 -- 172.21.15.17:0/2561189967 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f376406cdd0 con 0x7f37480047c0 2024-03-12T17:18:49.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.857+0000 7f375aa00640 1 -- 172.21.15.17:0/2561189967 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4725 (secure 0 0 0) 0x7f376406cdd0 con 0x7f37480047c0 2024-03-12T17:18:49.852 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:18:49.852 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/4055209511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":4055209511},{"type":"v1","addr":"172.21.15.94:6833","nonce":4055209511}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4220,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/2079001512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2079001512},{"type":"v1","addr":"172.21.15.94:6835","nonce":2079001512}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6836/3710914262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3710914262},{"type":"v1","addr":"172.21.15.17:6836","nonce":3710914262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T17:18:45.842660+0000","modified":"2024-03-12T17:18:49.354081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6837/749237500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6835","nonce":749237500},{"type":"v1","addr":"172.21.15.17:6837","nonce":749237500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-12T17:18:49.852 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 7 2024-03-12T17:18:49.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.860+0000 7f3769200640 1 -- 172.21.15.17:0/2561189967 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f374006ac30 msgr2=0x7f374006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:49.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.860+0000 7f3769200640 1 --2- 172.21.15.17:0/2561189967 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f374006ac30 0x7f374006d0f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f374c033000 tx=0x7f374c009030 comp rx=0 tx=0).stop 2024-03-12T17:18:49.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.860+0000 7f3769200640 1 -- 172.21.15.17:0/2561189967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37480047c0 msgr2=0x7f3764159ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:49.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.860+0000 7f3769200640 1 --2- 172.21.15.17:0/2561189967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37480047c0 0x7f3764159ce0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f37540079e0 tx=0x7f375400e530 comp rx=0 tx=0).stop 2024-03-12T17:18:49.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.860+0000 7f3769200640 1 -- 172.21.15.17:0/2561189967 shutdown_connections 2024-03-12T17:18:49.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.860+0000 7f3769200640 1 --2- 172.21.15.17:0/2561189967 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f374006ac30 0x7f374006d0f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:49.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.860+0000 7f3769200640 1 --2- 172.21.15.17:0/2561189967 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f37640ac920 0x7f37640acda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:49.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.860+0000 7f3769200640 1 --2- 172.21.15.17:0/2561189967 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f376406d640 0x7f376406dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:49.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.860+0000 7f3769200640 1 --2- 172.21.15.17:0/2561189967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f37480047c0 0x7f3764159ce0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:49.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.860+0000 7f3769200640 1 -- 172.21.15.17:0/2561189967 >> 172.21.15.17:0/2561189967 conn(0x7f3764069ce0 msgr2=0x7f37640ae3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:49.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.860+0000 7f3769200640 1 -- 172.21.15.17:0/2561189967 shutdown_connections 2024-03-12T17:18:49.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:49.860+0000 7f3769200640 1 -- 172.21.15.17:0/2561189967 wait complete. 2024-03-12T17:18:49.874 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T17:18:50.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.104+0000 7eff6be00640 1 Processor -- start 2024-03-12T17:18:50.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.104+0000 7eff6be00640 1 -- start start 2024-03-12T17:18:50.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.106+0000 7eff6be00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7eff6c1441f0 0x7eff6c070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:50.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.106+0000 7eff6be00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7eff6c15ae20 0x7eff6c06d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:50.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.106+0000 7eff6be00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff6c0a7660 con 0x7eff6c0b3b70 2024-03-12T17:18:50.102 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.106+0000 7eff6be00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff6c15e460 con 0x7eff6c1441f0 2024-03-12T17:18:50.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.106+0000 7eff6be00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c1445d0 con 0x7eff6c15ae20 2024-03-12T17:18:50.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.106+0000 7eff6aa00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7eff6c1441f0 0x7eff6c070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:50.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.106+0000 7eff6b400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7eff6c0b3b70 0x7eff6c15e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37800/0 (socket says 172.21.15.17:37800) 2024-03-12T17:18:50.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.106+0000 7eff6aa00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7eff6c1441f0 0x7eff6c070240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48068/0 (socket says 172.21.15.17:48068) 2024-03-12T17:18:50.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.106+0000 7eff6b400640 1 -- 172.21.15.17:0/2863198183 learned_addr learned my addr 172.21.15.17:0/2863198183 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:18:50.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.106+0000 7eff6a000640 1 --2- 172.21.15.17:0/2863198183 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7eff6c15ae20 0x7eff6c06d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:50.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.107+0000 7eff6aa00640 1 -- 172.21.15.17:0/2863198183 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7eff6c15ae20 msgr2=0x7eff6c06d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:50.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.107+0000 7eff6aa00640 1 --2- 172.21.15.17:0/2863198183 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7eff6c15ae20 0x7eff6c06d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:50.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.107+0000 7eff6aa00640 1 -- 172.21.15.17:0/2863198183 >> v1:172.21.15.17:6789/0 conn(0x7eff6c0b3b70 legacy=0x7eff6c15e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:50.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.107+0000 7eff6aa00640 1 -- 172.21.15.17:0/2863198183 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6c15b3e0 con 0x7eff6c1441f0 2024-03-12T17:18:50.104 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.107+0000 7eff69600640 1 -- 172.21.15.17:0/2863198183 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3576451460 0 0) 0x7eff6c0a7660 con 0x7eff6c0b3b70 2024-03-12T17:18:50.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.108+0000 7eff6aa00640 1 --2- 172.21.15.17:0/2863198183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff6c1441f0 0x7eff6c070240 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7eff5c0097a0 tx=0x7eff5c02b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df71a6a83f25dbe5 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:50.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.108+0000 7eff69600640 1 -- 172.21.15.17:0/2863198183 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c030800 con 0x7eff6c1441f0 2024-03-12T17:18:50.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.108+0000 7eff69600640 1 -- 172.21.15.17:0/2863198183 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5c030960 con 0x7eff6c1441f0 2024-03-12T17:18:50.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.108+0000 7eff69600640 1 -- 172.21.15.17:0/2863198183 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c030cf0 con 0x7eff6c1441f0 2024-03-12T17:18:50.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.109+0000 7eff6be00640 1 -- 172.21.15.17:0/2863198183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff6c1441f0 msgr2=0x7eff6c070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:50.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.109+0000 7eff6be00640 1 --2- 172.21.15.17:0/2863198183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff6c1441f0 0x7eff6c070240 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7eff5c0097a0 tx=0x7eff5c02b940 comp rx=0 tx=0).stop 2024-03-12T17:18:50.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.109+0000 7eff6be00640 1 -- 172.21.15.17:0/2863198183 shutdown_connections 2024-03-12T17:18:50.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.109+0000 7eff6be00640 1 --2- 172.21.15.17:0/2863198183 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7eff6c15ae20 0x7eff6c06d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:50.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.109+0000 7eff6be00640 1 --2- 172.21.15.17:0/2863198183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff6c1441f0 0x7eff6c070240 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:50.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.109+0000 7eff6be00640 1 -- 172.21.15.17:0/2863198183 >> 172.21.15.17:0/2863198183 conn(0x7eff6c069ce0 msgr2=0x7eff6c06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:50.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.109+0000 7eff6be00640 1 -- 172.21.15.17:0/2863198183 shutdown_connections 2024-03-12T17:18:50.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.109+0000 7eff6be00640 1 -- 172.21.15.17:0/2863198183 wait complete. 2024-03-12T17:18:50.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.110+0000 7eff6be00640 1 Processor -- start 2024-03-12T17:18:50.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.111+0000 7eff6be00640 1 -- start start 2024-03-12T17:18:50.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.111+0000 7eff6be00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff6c0b3b70 0x7eff6c13eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:50.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.111+0000 7eff6be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff6c1441f0 0x7eff6c1e37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:50.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.112+0000 7eff6be00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7eff6c15ae20 0x7eff6c1e3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:50.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.112+0000 7eff6be00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c139960 con 0x7eff6c1441f0 2024-03-12T17:18:50.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.112+0000 7eff6be00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c13f460 con 0x7eff6c0b3b70 2024-03-12T17:18:50.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.112+0000 7eff6be00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff6c13f740 con 0x7eff6c15ae20 2024-03-12T17:18:50.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.112+0000 7eff6a000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff6c1441f0 0x7eff6c1e37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:50.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.112+0000 7eff6a000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff6c1441f0 0x7eff6c1e37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48082/0 (socket says 172.21.15.17:48082) 2024-03-12T17:18:50.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.112+0000 7eff6a000640 1 -- 172.21.15.17:0/2137764562 learned_addr learned my addr 172.21.15.17:0/2137764562 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:50.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.112+0000 7eff6a000640 1 -- 172.21.15.17:0/2137764562 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7eff6c15ae20 msgr2=0x7eff6c1e3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:50.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.112+0000 7eff6b400640 1 --2- 172.21.15.17:0/2137764562 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7eff6c15ae20 0x7eff6c1e3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:50.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.112+0000 7eff6aa00640 1 --2- 172.21.15.17:0/2137764562 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff6c0b3b70 0x7eff6c13eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:50.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.112+0000 7eff6a000640 1 --2- 172.21.15.17:0/2137764562 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7eff6c15ae20 0x7eff6c1e3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:50.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.112+0000 7eff6a000640 1 -- 172.21.15.17:0/2137764562 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff6c0b3b70 msgr2=0x7eff6c13eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:50.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.112+0000 7eff6a000640 1 --2- 172.21.15.17:0/2137764562 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff6c0b3b70 0x7eff6c13eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:50.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.112+0000 7eff6a000640 1 -- 172.21.15.17:0/2137764562 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff5c009400 con 0x7eff6c1441f0 2024-03-12T17:18:50.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.112+0000 7eff6aa00640 1 --2- 172.21.15.17:0/2137764562 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff6c0b3b70 0x7eff6c13eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:18:50.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.113+0000 7eff6a000640 1 --2- 172.21.15.17:0/2137764562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff6c1441f0 0x7eff6c1e37a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7eff5800d5f0 tx=0x7eff5800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:50.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.113+0000 7eff62a00640 1 -- 172.21.15.17:0/2137764562 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff580125f0 con 0x7eff6c1441f0 2024-03-12T17:18:50.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.113+0000 7eff62a00640 1 -- 172.21.15.17:0/2137764562 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff58012750 con 0x7eff6c1441f0 2024-03-12T17:18:50.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.113+0000 7eff6be00640 1 -- 172.21.15.17:0/2137764562 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff6c13fa20 con 0x7eff6c1441f0 2024-03-12T17:18:50.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.113+0000 7eff62a00640 1 -- 172.21.15.17:0/2137764562 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff58012b00 con 0x7eff6c1441f0 2024-03-12T17:18:50.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.113+0000 7eff6be00640 1 -- 172.21.15.17:0/2137764562 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff6c13f070 con 0x7eff6c1441f0 2024-03-12T17:18:50.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.114+0000 7eff6be00640 1 -- 172.21.15.17:0/2137764562 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff6c13f200 con 0x7eff6c1441f0 2024-03-12T17:18:50.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.115+0000 7eff62a00640 1 -- 172.21.15.17:0/2137764562 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7eff58012c60 con 0x7eff6c1441f0 2024-03-12T17:18:50.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.116+0000 7eff62a00640 1 --2- 172.21.15.17:0/2137764562 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7eff4c06ac00 0x7eff4c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:50.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.116+0000 7eff62a00640 1 -- 172.21.15.17:0/2137764562 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff58089880 con 0x7eff6c1441f0 2024-03-12T17:18:50.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.116+0000 7eff6aa00640 1 --2- 172.21.15.17:0/2137764562 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7eff4c06ac00 0x7eff4c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:50.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.117+0000 7eff6aa00640 1 --2- 172.21.15.17:0/2137764562 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7eff4c06ac00 0x7eff4c06d0c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7eff5c036000 tx=0x7eff5c03b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:50.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.121+0000 7eff62a00640 1 -- 172.21.15.17:0/2137764562 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7eff580549c0 con 0x7eff6c1441f0 2024-03-12T17:18:50.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.325+0000 7eff6be00640 1 -- 172.21.15.17:0/2137764562 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff6c04e030 con 0x7eff6c1441f0 2024-03-12T17:18:50.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.328+0000 7eff62a00640 1 -- 172.21.15.17:0/2137764562 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15989 (secure 0 0 0) 0x7eff58057fe0 con 0x7eff6c1441f0 2024-03-12T17:18:50.322 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:18:50.323 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":21,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:18:46.845635+0000","last_up_change":"2024-03-12T17:18:38.144756+0000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-12T17:18:39.552910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-12T17:18:43.794908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-12T17:18:44.867006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":37305},{"type":"v1","addr":"172.21.15.17:6801","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":37305},{"type":"v1","addr":"172.21.15.17:6803","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":37305},{"type":"v1","addr":"172.21.15.17:6807","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":37305},{"type":"v1","addr":"172.21.15.17:6805","nonce":37305}]},"public_addr":"172.21.15.17:6801/37305","cluster_addr":"172.21.15.17:6803/37305","heartbeat_back_addr":"172.21.15.17:6807/37305","heartbeat_front_addr":"172.21.15.17:6805/37305","state":["exists","up"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":37307},{"type":"v1","addr":"172.21.15.17:6814","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":37307},{"type":"v1","addr":"172.21.15.17:6818","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":37307},{"type":"v1","addr":"172.21.15.17:6827","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":37307},{"type":"v1","addr":"172.21.15.17:6823","nonce":37307}]},"public_addr":"172.21.15.17:6814/37307","cluster_addr":"172.21.15.17:6818/37307","heartbeat_back_addr":"172.21.15.17:6827/37307","heartbeat_front_addr":"172.21.15.17:6823/37307","state":["exists","up"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":37303},{"type":"v1","addr":"172.21.15.17:6809","nonce":37303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":37303},{"type":"v1","addr":"172.21.15.17:6811","nonce":37303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":37303},{"type":"v1","addr":"172.21.15.17:6819","nonce":37303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":37303},{"type":"v1","addr":"172.21.15.17:6815","nonce":37303}]},"public_addr":"172.21.15.17:6809/37303","cluster_addr":"172.21.15.17:6811/37303","heartbeat_back_addr":"172.21.15.17:6819/37303","heartbeat_front_addr":"172.21.15.17:6815/37303","state":["exists","up"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":37308},{"type":"v1","addr":"172.21.15.17:6822","nonce":37308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":37308},{"type":"v1","addr":"172.21.15.17:6826","nonce":37308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":37308},{"type":"v1","addr":"172.21.15.17:6831","nonce":37308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":37308},{"type":"v1","addr":"172.21.15.17:6829","nonce":37308}]},"public_addr":"172.21.15.17:6822/37308","cluster_addr":"172.21.15.17:6826/37308","heartbeat_back_addr":"172.21.15.17:6831/37308","heartbeat_front_addr":"172.21.15.17:6829/37308","state":["exists","up"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":37465},{"type":"v1","addr":"172.21.15.94:6809","nonce":37465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6811","nonce":37465},{"type":"v1","addr":"172.21.15.94:6813","nonce":37465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6819","nonce":37465},{"type":"v1","addr":"172.21.15.94:6822","nonce":37465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6815","nonce":37465},{"type":"v1","addr":"172.21.15.94:6817","nonce":37465}]},"public_addr":"172.21.15.94:6809/37465","cluster_addr":"172.21.15.94:6813/37465","heartbeat_back_addr":"172.21.15.94:6822/37465","heartbeat_front_addr":"172.21.15.94:6817/37465","state":["exists","up"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":37464},{"type":"v1","addr":"172.21.15.94:6812","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":37464},{"type":"v1","addr":"172.21.15.94:6816","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":37464},{"type":"v1","addr":"172.21.15.94:6823","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":37464},{"type":"v1","addr":"172.21.15.94:6820","nonce":37464}]},"public_addr":"172.21.15.94:6812/37464","cluster_addr":"172.21.15.94:6816/37464","heartbeat_back_addr":"172.21.15.94:6823/37464","heartbeat_front_addr":"172.21.15.94:6820/37464","state":["exists","up"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":37467},{"type":"v1","addr":"172.21.15.94:6825","nonce":37467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":37467},{"type":"v1","addr":"172.21.15.94:6827","nonce":37467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":37467},{"type":"v1","addr":"172.21.15.94:6831","nonce":37467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":37467},{"type":"v1","addr":"172.21.15.94:6829","nonce":37467}]},"public_addr":"172.21.15.94:6825/37467","cluster_addr":"172.21.15.94:6827/37467","heartbeat_back_addr":"172.21.15.94:6831/37467","heartbeat_front_addr":"172.21.15.94:6829/37467","state":["exists","up"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":37466},{"type":"v1","addr":"172.21.15.94:6801","nonce":37466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":37466},{"type":"v1","addr":"172.21.15.94:6803","nonce":37466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":37466},{"type":"v1","addr":"172.21.15.94:6807","nonce":37466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":37466},{"type":"v1","addr":"172.21.15.94:6805","nonce":37466}]},"public_addr":"172.21.15.94:6801/37466","cluster_addr":"172.21.15.94:6803/37466","heartbeat_back_addr":"172.21.15.94:6807/37466","heartbeat_front_addr":"172.21.15.94:6805/37466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.327217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.186966+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.419986+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.150585+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.120621+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.121576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.181257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.293188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:18:50.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.330+0000 7eff6be00640 1 -- 172.21.15.17:0/2137764562 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7eff4c06ac00 msgr2=0x7eff4c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:50.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.331+0000 7eff6be00640 1 --2- 172.21.15.17:0/2137764562 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7eff4c06ac00 0x7eff4c06d0c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7eff5c036000 tx=0x7eff5c03b040 comp rx=0 tx=0).stop 2024-03-12T17:18:50.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.331+0000 7eff6be00640 1 -- 172.21.15.17:0/2137764562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff6c1441f0 msgr2=0x7eff6c1e37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:50.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.331+0000 7eff6be00640 1 --2- 172.21.15.17:0/2137764562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff6c1441f0 0x7eff6c1e37a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7eff5800d5f0 tx=0x7eff5800dab0 comp rx=0 tx=0).stop 2024-03-12T17:18:50.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.331+0000 7eff6be00640 1 -- 172.21.15.17:0/2137764562 shutdown_connections 2024-03-12T17:18:50.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.331+0000 7eff6be00640 1 --2- 172.21.15.17:0/2137764562 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7eff4c06ac00 0x7eff4c06d0c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:50.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.331+0000 7eff6be00640 1 --2- 172.21.15.17:0/2137764562 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7eff6c15ae20 0x7eff6c1e3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:50.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.331+0000 7eff6be00640 1 --2- 172.21.15.17:0/2137764562 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7eff6c1441f0 0x7eff6c1e37a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:50.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.331+0000 7eff6be00640 1 --2- 172.21.15.17:0/2137764562 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7eff6c0b3b70 0x7eff6c13eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:50.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.331+0000 7eff6be00640 1 -- 172.21.15.17:0/2137764562 >> 172.21.15.17:0/2137764562 conn(0x7eff6c069ce0 msgr2=0x7eff6c1428b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:50.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.331+0000 7eff6be00640 1 -- 172.21.15.17:0/2137764562 shutdown_connections 2024-03-12T17:18:50.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.331+0000 7eff6be00640 1 -- 172.21.15.17:0/2137764562 wait complete. 2024-03-12T17:18:50.344 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-12T17:18:50.344 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-12T17:18:50.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.562+0000 7f76acc00640 1 Processor -- start 2024-03-12T17:18:50.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.562+0000 7f76acc00640 1 -- start start 2024-03-12T17:18:50.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.563+0000 7f76acc00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f76a80b5b50 0x7f76a80b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:50.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.563+0000 7f76acc00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f76a80cd840 0x7f76a80cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:50.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.563+0000 7f76acc00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76a80d14e0 con 0x7f76a80d2fa0 2024-03-12T17:18:50.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.563+0000 7f76acc00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76a80b59e0 con 0x7f76a80cd840 2024-03-12T17:18:50.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.563+0000 7f76acc00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a80b85b0 con 0x7f76a80b5b50 2024-03-12T17:18:50.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.564+0000 7f76a5e00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f76a80d2fa0 0x7f76a80d3380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.17:51224/0 (socket says 172.21.15.17:51224) 2024-03-12T17:18:50.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.564+0000 7f76a5e00640 1 -- 172.21.15.17:0/2781273478 learned_addr learned my addr 172.21.15.17:0/2781273478 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:18:50.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.564+0000 7f76a5400640 1 --2- 172.21.15.17:0/2781273478 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f76a80b5b50 0x7f76a80b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:50.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.565+0000 7f76a6800640 1 --2- 172.21.15.17:0/2781273478 >> v2:172.21.15.17:3300/0 conn(0x7f76a80cd840 0x7f76a80cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:50.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.565+0000 7f76a4a00640 1 -- 172.21.15.17:0/2781273478 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1485587806 0 0) 0x7f76a80d14e0 con 0x7f76a80d2fa0 2024-03-12T17:18:50.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.565+0000 7f76a4a00640 1 -- 172.21.15.17:0/2781273478 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f768c003520 con 0x7f76a80d2fa0 2024-03-12T17:18:50.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.565+0000 7f76a5400640 1 -- 172.21.15.17:0/2781273478 >> v2:172.21.15.17:3300/0 conn(0x7f76a80cd840 msgr2=0x7f76a80cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:50.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.565+0000 7f76a5400640 1 --2- 172.21.15.17:0/2781273478 >> v2:172.21.15.17:3300/0 conn(0x7f76a80cd840 0x7f76a80cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:50.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.565+0000 7f76a5400640 1 -- 172.21.15.17:0/2781273478 >> v1:172.21.15.94:6789/0 conn(0x7f76a80d2fa0 legacy=0x7f76a80d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:50.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.565+0000 7f76a5400640 1 -- 172.21.15.17:0/2781273478 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a80b8890 con 0x7f76a80b5b50 2024-03-12T17:18:50.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.566+0000 7f76a5400640 1 --2- 172.21.15.17:0/2781273478 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f76a80b5b50 0x7f76a80b5f70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f76900097a0 tx=0x7f769002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56b52056bfe93db0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:50.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.567+0000 7f76a4a00640 1 -- 172.21.15.17:0/2781273478 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7690031830 con 0x7f76a80b5b50 2024-03-12T17:18:50.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.567+0000 7f76a4a00640 1 -- 172.21.15.17:0/2781273478 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7690031990 con 0x7f76a80b5b50 2024-03-12T17:18:50.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.567+0000 7f76a4a00640 1 -- 172.21.15.17:0/2781273478 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7690031d00 con 0x7f76a80b5b50 2024-03-12T17:18:50.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.567+0000 7f76acc00640 1 -- 172.21.15.17:0/2781273478 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f76a80b5b50 msgr2=0x7f76a80b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:50.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.567+0000 7f76acc00640 1 --2- 172.21.15.17:0/2781273478 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f76a80b5b50 0x7f76a80b5f70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f76900097a0 tx=0x7f769002b8d0 comp rx=0 tx=0).stop 2024-03-12T17:18:50.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.567+0000 7f76acc00640 1 -- 172.21.15.17:0/2781273478 shutdown_connections 2024-03-12T17:18:50.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.567+0000 7f76acc00640 1 --2- 172.21.15.17:0/2781273478 >> v2:172.21.15.17:3300/0 conn(0x7f76a80cd840 0x7f76a80cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:50.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.567+0000 7f76acc00640 1 --2- 172.21.15.17:0/2781273478 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f76a80b5b50 0x7f76a80b5f70 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:50.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.567+0000 7f76acc00640 1 -- 172.21.15.17:0/2781273478 >> 172.21.15.17:0/2781273478 conn(0x7f76a8065df0 msgr2=0x7f76a8066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:50.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.567+0000 7f76acc00640 1 -- 172.21.15.17:0/2781273478 shutdown_connections 2024-03-12T17:18:50.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.567+0000 7f76acc00640 1 -- 172.21.15.17:0/2781273478 wait complete. 2024-03-12T17:18:50.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.569+0000 7f76acc00640 1 Processor -- start 2024-03-12T17:18:50.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.569+0000 7f76acc00640 1 -- start start 2024-03-12T17:18:50.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.570+0000 7f76acc00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76a80b5b50 0x7f76a80c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:50.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.570+0000 7f76acc00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f76a80cd840 0x7f76a81589f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:50.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.570+0000 7f76acc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76a80d2fa0 0x7f76a8158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:50.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.570+0000 7f76acc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a8157210 con 0x7f76a80d2fa0 2024-03-12T17:18:50.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.570+0000 7f76acc00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a8156a00 con 0x7f76a80b5b50 2024-03-12T17:18:50.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.570+0000 7f76acc00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a8155dc0 con 0x7f76a80cd840 2024-03-12T17:18:50.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.571+0000 7f76a6800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76a80d2fa0 0x7f76a8158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:50.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.571+0000 7f76a6800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76a80d2fa0 0x7f76a8158f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48094/0 (socket says 172.21.15.17:48094) 2024-03-12T17:18:50.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.571+0000 7f76a6800640 1 -- 172.21.15.17:0/2410788397 learned_addr learned my addr 172.21.15.17:0/2410788397 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:50.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.571+0000 7f76a5e00640 1 --2- 172.21.15.17:0/2410788397 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76a80b5b50 0x7f76a80c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:50.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.571+0000 7f76a5400640 1 --2- 172.21.15.17:0/2410788397 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f76a80cd840 0x7f76a81589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:50.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.571+0000 7f76a6800640 1 -- 172.21.15.17:0/2410788397 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f76a80cd840 msgr2=0x7f76a81589f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:50.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.571+0000 7f76a6800640 1 --2- 172.21.15.17:0/2410788397 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f76a80cd840 0x7f76a81589f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:50.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.571+0000 7f76a6800640 1 -- 172.21.15.17:0/2410788397 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76a80b5b50 msgr2=0x7f76a80c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:50.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.571+0000 7f76a6800640 1 --2- 172.21.15.17:0/2410788397 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76a80b5b50 0x7f76a80c8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:50.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.571+0000 7f76a6800640 1 -- 172.21.15.17:0/2410788397 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7690009400 con 0x7f76a80d2fa0 2024-03-12T17:18:50.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.571+0000 7f76a5e00640 1 --2- 172.21.15.17:0/2410788397 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76a80b5b50 0x7f76a80c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:18:50.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.571+0000 7f76a6800640 1 --2- 172.21.15.17:0/2410788397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76a80d2fa0 0x7f76a8158f30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f76a000d800 tx=0x7f76a000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:50.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.572+0000 7f769e000640 1 -- 172.21.15.17:0/2410788397 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a000b6c0 con 0x7f76a80d2fa0 2024-03-12T17:18:50.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.572+0000 7f769e000640 1 -- 172.21.15.17:0/2410788397 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a000b840 con 0x7f76a80d2fa0 2024-03-12T17:18:50.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.572+0000 7f769e000640 1 -- 172.21.15.17:0/2410788397 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a000bbf0 con 0x7f76a80d2fa0 2024-03-12T17:18:50.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.572+0000 7f76acc00640 1 -- 172.21.15.17:0/2410788397 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76a8156c50 con 0x7f76a80d2fa0 2024-03-12T17:18:50.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.572+0000 7f76acc00640 1 -- 172.21.15.17:0/2410788397 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76a815d470 con 0x7f76a80d2fa0 2024-03-12T17:18:50.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.573+0000 7f76acc00640 1 -- 172.21.15.17:0/2410788397 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76a815d2d0 con 0x7f76a80d2fa0 2024-03-12T17:18:50.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.574+0000 7f769e000640 1 -- 172.21.15.17:0/2410788397 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f76a000bd50 con 0x7f76a80d2fa0 2024-03-12T17:18:50.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.575+0000 7f769e000640 1 --2- 172.21.15.17:0/2410788397 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f768406ac00 0x7f768406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:50.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.575+0000 7f769e000640 1 -- 172.21.15.17:0/2410788397 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f76a00898a0 con 0x7f76a80d2fa0 2024-03-12T17:18:50.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.575+0000 7f76a5e00640 1 --2- 172.21.15.17:0/2410788397 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f768406ac00 0x7f768406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:50.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.576+0000 7f76a5e00640 1 --2- 172.21.15.17:0/2410788397 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f768406ac00 0x7f768406d0c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7698001560 tx=0x7f7698009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:50.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.579+0000 7f769e000640 1 -- 172.21.15.17:0/2410788397 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f76a815d2d0 con 0x7f76a80d2fa0 2024-03-12T17:18:50.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.775+0000 7f76acc00640 1 -- 172.21.15.17:0/2410788397 --> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f76a80b8240 con 0x7f768406ac00 2024-03-12T17:18:50.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.785+0000 7f769e000640 1 -- 172.21.15.17:0/2410788397 <== mgr.4104 v2:172.21.15.17:6832/37052 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264386 (secure 0 0 0) 0x7f7698001d90 con 0x7f768406ac00 2024-03-12T17:18:50.783 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:18:50.784 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-03-12T17:18:50.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.791+0000 7f76acc00640 1 -- 172.21.15.17:0/2410788397 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f768406ac00 msgr2=0x7f768406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:50.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.791+0000 7f76acc00640 1 --2- 172.21.15.17:0/2410788397 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f768406ac00 0x7f768406d0c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7698001560 tx=0x7f7698009040 comp rx=0 tx=0).stop 2024-03-12T17:18:50.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.791+0000 7f76acc00640 1 -- 172.21.15.17:0/2410788397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76a80d2fa0 msgr2=0x7f76a8158f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:50.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.791+0000 7f76acc00640 1 --2- 172.21.15.17:0/2410788397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76a80d2fa0 0x7f76a8158f30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f76a000d800 tx=0x7f76a000dcc0 comp rx=0 tx=0).stop 2024-03-12T17:18:50.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.791+0000 7f76acc00640 1 -- 172.21.15.17:0/2410788397 shutdown_connections 2024-03-12T17:18:50.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.791+0000 7f76acc00640 1 --2- 172.21.15.17:0/2410788397 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f768406ac00 0x7f768406d0c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:50.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.791+0000 7f76acc00640 1 --2- 172.21.15.17:0/2410788397 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f76a80d2fa0 0x7f76a8158f30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:50.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.791+0000 7f76acc00640 1 --2- 172.21.15.17:0/2410788397 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f76a80cd840 0x7f76a81589f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:50.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.791+0000 7f76acc00640 1 --2- 172.21.15.17:0/2410788397 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f76a80b5b50 0x7f76a80c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:50.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.791+0000 7f76acc00640 1 -- 172.21.15.17:0/2410788397 >> 172.21.15.17:0/2410788397 conn(0x7f76a8065df0 msgr2=0x7f76a806b300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:50.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.791+0000 7f76acc00640 1 -- 172.21.15.17:0/2410788397 shutdown_connections 2024-03-12T17:18:50.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:50.792+0000 7f76acc00640 1 -- 172.21.15.17:0/2410788397 wait complete. 2024-03-12T17:18:50.805 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-03-12T17:18:49.476868+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":160,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252284,"kb_used_data":2920,"kb_used_omap":13,"kb_used_meta":248818,"kb_avail":754722436,"statfs":{"total":773094113280,"available":772835774464,"internally_reserved":0,"allocated":2990080,"data_stored":1790012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":254789720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":58,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.913404"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858955+0000","last_change":"2024-03-12T17:18:45.899195+0000","last_active":"2024-03-12T17:18:46.858955+0000","last_peered":"2024-03-12T17:18:46.858955+0000","last_clean":"2024-03-12T17:18:46.858955+0000","last_became_active":"2024-03-12T17:18:45.898885+0000","last_became_peered":"2024-03-12T17:18:45.898885+0000","last_unstale":"2024-03-12T17:18:46.858955+0000","last_undegraded":"2024-03-12T17:18:46.858955+0000","last_fullsized":"2024-03-12T17:18:46.858955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:36:07.517436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944636+0000","last_change":"2024-03-12T17:18:45.863461+0000","last_active":"2024-03-12T17:18:46.944636+0000","last_peered":"2024-03-12T17:18:46.944636+0000","last_clean":"2024-03-12T17:18:46.944636+0000","last_became_active":"2024-03-12T17:18:45.861872+0000","last_became_peered":"2024-03-12T17:18:45.861872+0000","last_unstale":"2024-03-12T17:18:46.944636+0000","last_undegraded":"2024-03-12T17:18:46.944636+0000","last_fullsized":"2024-03-12T17:18:46.944636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:17:33.168888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947273+0000","last_change":"2024-03-12T17:18:45.862114+0000","last_active":"2024-03-12T17:18:46.947273+0000","last_peered":"2024-03-12T17:18:46.947273+0000","last_clean":"2024-03-12T17:18:46.947273+0000","last_became_active":"2024-03-12T17:18:45.861875+0000","last_became_peered":"2024-03-12T17:18:45.861875+0000","last_unstale":"2024-03-12T17:18:46.947273+0000","last_undegraded":"2024-03-12T17:18:46.947273+0000","last_fullsized":"2024-03-12T17:18:46.947273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:56:38.943678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858269+0000","last_change":"2024-03-12T17:18:45.878850+0000","last_active":"2024-03-12T17:18:46.858269+0000","last_peered":"2024-03-12T17:18:46.858269+0000","last_clean":"2024-03-12T17:18:46.858269+0000","last_became_active":"2024-03-12T17:18:45.878507+0000","last_became_peered":"2024-03-12T17:18:45.878507+0000","last_unstale":"2024-03-12T17:18:46.858269+0000","last_undegraded":"2024-03-12T17:18:46.858269+0000","last_fullsized":"2024-03-12T17:18:46.858269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:05:09.374271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857739+0000","last_change":"2024-03-12T17:18:45.894717+0000","last_active":"2024-03-12T17:18:46.857739+0000","last_peered":"2024-03-12T17:18:46.857739+0000","last_clean":"2024-03-12T17:18:46.857739+0000","last_became_active":"2024-03-12T17:18:45.894426+0000","last_became_peered":"2024-03-12T17:18:45.894426+0000","last_unstale":"2024-03-12T17:18:46.857739+0000","last_undegraded":"2024-03-12T17:18:46.857739+0000","last_fullsized":"2024-03-12T17:18:46.857739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:09:10.961008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857512+0000","last_change":"2024-03-12T17:18:45.870293+0000","last_active":"2024-03-12T17:18:46.857512+0000","last_peered":"2024-03-12T17:18:46.857512+0000","last_clean":"2024-03-12T17:18:46.857512+0000","last_became_active":"2024-03-12T17:18:45.869629+0000","last_became_peered":"2024-03-12T17:18:45.869629+0000","last_unstale":"2024-03-12T17:18:46.857512+0000","last_undegraded":"2024-03-12T17:18:46.857512+0000","last_fullsized":"2024-03-12T17:18:46.857512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:24:13.883507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857215+0000","last_change":"2024-03-12T17:18:45.894712+0000","last_active":"2024-03-12T17:18:46.857215+0000","last_peered":"2024-03-12T17:18:46.857215+0000","last_clean":"2024-03-12T17:18:46.857215+0000","last_became_active":"2024-03-12T17:18:45.894385+0000","last_became_peered":"2024-03-12T17:18:45.894385+0000","last_unstale":"2024-03-12T17:18:46.857215+0000","last_undegraded":"2024-03-12T17:18:46.857215+0000","last_fullsized":"2024-03-12T17:18:46.857215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:21:11.051648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.946712+0000","last_change":"2024-03-12T17:18:45.878221+0000","last_active":"2024-03-12T17:18:46.946712+0000","last_peered":"2024-03-12T17:18:46.946712+0000","last_clean":"2024-03-12T17:18:46.946712+0000","last_became_active":"2024-03-12T17:18:45.877953+0000","last_became_peered":"2024-03-12T17:18:45.877953+0000","last_unstale":"2024-03-12T17:18:46.946712+0000","last_undegraded":"2024-03-12T17:18:46.946712+0000","last_fullsized":"2024-03-12T17:18:46.946712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:45:08.333283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.859164+0000","last_change":"2024-03-12T17:18:45.900699+0000","last_active":"2024-03-12T17:18:46.859164+0000","last_peered":"2024-03-12T17:18:46.859164+0000","last_clean":"2024-03-12T17:18:46.859164+0000","last_became_active":"2024-03-12T17:18:45.900360+0000","last_became_peered":"2024-03-12T17:18:45.900360+0000","last_unstale":"2024-03-12T17:18:46.859164+0000","last_undegraded":"2024-03-12T17:18:46.859164+0000","last_fullsized":"2024-03-12T17:18:46.859164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:03:15.594609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.945139+0000","last_change":"2024-03-12T17:18:45.888417+0000","last_active":"2024-03-12T17:18:46.945139+0000","last_peered":"2024-03-12T17:18:46.945139+0000","last_clean":"2024-03-12T17:18:46.945139+0000","last_became_active":"2024-03-12T17:18:45.888207+0000","last_became_peered":"2024-03-12T17:18:45.888207+0000","last_unstale":"2024-03-12T17:18:46.945139+0000","last_undegraded":"2024-03-12T17:18:46.945139+0000","last_fullsized":"2024-03-12T17:18:46.945139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:42:22.352573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944829+0000","last_change":"2024-03-12T17:18:45.887868+0000","last_active":"2024-03-12T17:18:46.944829+0000","last_peered":"2024-03-12T17:18:46.944829+0000","last_clean":"2024-03-12T17:18:46.944829+0000","last_became_active":"2024-03-12T17:18:45.887591+0000","last_became_peered":"2024-03-12T17:18:45.887591+0000","last_unstale":"2024-03-12T17:18:46.944829+0000","last_undegraded":"2024-03-12T17:18:46.944829+0000","last_fullsized":"2024-03-12T17:18:46.944829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:54:36.712407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.946540+0000","last_change":"2024-03-12T17:18:45.891669+0000","last_active":"2024-03-12T17:18:46.946540+0000","last_peered":"2024-03-12T17:18:46.946540+0000","last_clean":"2024-03-12T17:18:46.946540+0000","last_became_active":"2024-03-12T17:18:45.891084+0000","last_became_peered":"2024-03-12T17:18:45.891084+0000","last_unstale":"2024-03-12T17:18:46.946540+0000","last_undegraded":"2024-03-12T17:18:46.946540+0000","last_fullsized":"2024-03-12T17:18:46.946540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:35:29.274137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947674+0000","last_change":"2024-03-12T17:18:45.885085+0000","last_active":"2024-03-12T17:18:46.947674+0000","last_peered":"2024-03-12T17:18:46.947674+0000","last_clean":"2024-03-12T17:18:46.947674+0000","last_became_active":"2024-03-12T17:18:45.884827+0000","last_became_peered":"2024-03-12T17:18:45.884827+0000","last_unstale":"2024-03-12T17:18:46.947674+0000","last_undegraded":"2024-03-12T17:18:46.947674+0000","last_fullsized":"2024-03-12T17:18:46.947674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:42:22.754824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.948191+0000","last_change":"2024-03-12T17:18:45.863039+0000","last_active":"2024-03-12T17:18:46.948191+0000","last_peered":"2024-03-12T17:18:46.948191+0000","last_clean":"2024-03-12T17:18:46.948191+0000","last_became_active":"2024-03-12T17:18:45.862844+0000","last_became_peered":"2024-03-12T17:18:45.862844+0000","last_unstale":"2024-03-12T17:18:46.948191+0000","last_undegraded":"2024-03-12T17:18:46.948191+0000","last_fullsized":"2024-03-12T17:18:46.948191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:23:06.063091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944953+0000","last_change":"2024-03-12T17:18:45.885881+0000","last_active":"2024-03-12T17:18:46.944953+0000","last_peered":"2024-03-12T17:18:46.944953+0000","last_clean":"2024-03-12T17:18:46.944953+0000","last_became_active":"2024-03-12T17:18:45.885609+0000","last_became_peered":"2024-03-12T17:18:45.885609+0000","last_unstale":"2024-03-12T17:18:46.944953+0000","last_undegraded":"2024-03-12T17:18:46.944953+0000","last_fullsized":"2024-03-12T17:18:46.944953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:45:08.333283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857415+0000","last_change":"2024-03-12T17:18:45.871970+0000","last_active":"2024-03-12T17:18:46.857415+0000","last_peered":"2024-03-12T17:18:46.857415+0000","last_clean":"2024-03-12T17:18:46.857415+0000","last_became_active":"2024-03-12T17:18:45.868988+0000","last_became_peered":"2024-03-12T17:18:45.868988+0000","last_unstale":"2024-03-12T17:18:46.857415+0000","last_undegraded":"2024-03-12T17:18:46.857415+0000","last_fullsized":"2024-03-12T17:18:46.857415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:10:29.099400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.859788+0000","last_change":"2024-03-12T17:18:45.899893+0000","last_active":"2024-03-12T17:18:46.859788+0000","last_peered":"2024-03-12T17:18:46.859788+0000","last_clean":"2024-03-12T17:18:46.859788+0000","last_became_active":"2024-03-12T17:18:45.899578+0000","last_became_peered":"2024-03-12T17:18:45.899578+0000","last_unstale":"2024-03-12T17:18:46.859788+0000","last_undegraded":"2024-03-12T17:18:46.859788+0000","last_fullsized":"2024-03-12T17:18:46.859788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:36:07.517436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.854019+0000","last_change":"2024-03-12T17:18:45.890825+0000","last_active":"2024-03-12T17:18:46.854019+0000","last_peered":"2024-03-12T17:18:46.854019+0000","last_clean":"2024-03-12T17:18:46.854019+0000","last_became_active":"2024-03-12T17:18:45.890508+0000","last_became_peered":"2024-03-12T17:18:45.890508+0000","last_unstale":"2024-03-12T17:18:46.854019+0000","last_undegraded":"2024-03-12T17:18:46.854019+0000","last_fullsized":"2024-03-12T17:18:46.854019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:54:36.712407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858619+0000","last_change":"2024-03-12T17:18:45.896948+0000","last_active":"2024-03-12T17:18:46.858619+0000","last_peered":"2024-03-12T17:18:46.858619+0000","last_clean":"2024-03-12T17:18:46.858619+0000","last_became_active":"2024-03-12T17:18:45.896617+0000","last_became_peered":"2024-03-12T17:18:45.896617+0000","last_unstale":"2024-03-12T17:18:46.858619+0000","last_undegraded":"2024-03-12T17:18:46.858619+0000","last_fullsized":"2024-03-12T17:18:46.858619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:34:35.638243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944492+0000","last_change":"2024-03-12T17:18:45.892628+0000","last_active":"2024-03-12T17:18:46.944492+0000","last_peered":"2024-03-12T17:18:46.944492+0000","last_clean":"2024-03-12T17:18:46.944492+0000","last_became_active":"2024-03-12T17:18:45.892322+0000","last_became_peered":"2024-03-12T17:18:45.892322+0000","last_unstale":"2024-03-12T17:18:46.944492+0000","last_undegraded":"2024-03-12T17:18:46.944492+0000","last_fullsized":"2024-03-12T17:18:46.944492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:48:29.172720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.946982+0000","last_change":"2024-03-12T17:18:45.891015+0000","last_active":"2024-03-12T17:18:46.946982+0000","last_peered":"2024-03-12T17:18:46.946982+0000","last_clean":"2024-03-12T17:18:46.946982+0000","last_became_active":"2024-03-12T17:18:45.890711+0000","last_became_peered":"2024-03-12T17:18:45.890711+0000","last_unstale":"2024-03-12T17:18:46.946982+0000","last_undegraded":"2024-03-12T17:18:46.946982+0000","last_fullsized":"2024-03-12T17:18:46.946982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:45:08.333283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857744+0000","last_change":"2024-03-12T17:18:45.893500+0000","last_active":"2024-03-12T17:18:46.857744+0000","last_peered":"2024-03-12T17:18:46.857744+0000","last_clean":"2024-03-12T17:18:46.857744+0000","last_became_active":"2024-03-12T17:18:45.893188+0000","last_became_peered":"2024-03-12T17:18:45.893188+0000","last_unstale":"2024-03-12T17:18:46.857744+0000","last_undegraded":"2024-03-12T17:18:46.857744+0000","last_fullsized":"2024-03-12T17:18:46.857744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:34:35.638243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947702+0000","last_change":"2024-03-12T17:18:45.890189+0000","last_active":"2024-03-12T17:18:46.947702+0000","last_peered":"2024-03-12T17:18:46.947702+0000","last_clean":"2024-03-12T17:18:46.947702+0000","last_became_active":"2024-03-12T17:18:45.889243+0000","last_became_peered":"2024-03-12T17:18:45.889243+0000","last_unstale":"2024-03-12T17:18:46.947702+0000","last_undegraded":"2024-03-12T17:18:46.947702+0000","last_fullsized":"2024-03-12T17:18:46.947702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:23:06.063091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.856808+0000","last_change":"2024-03-12T17:18:45.879908+0000","last_active":"2024-03-12T17:18:46.856808+0000","last_peered":"2024-03-12T17:18:46.856808+0000","last_clean":"2024-03-12T17:18:46.856808+0000","last_became_active":"2024-03-12T17:18:45.879061+0000","last_became_peered":"2024-03-12T17:18:45.879061+0000","last_unstale":"2024-03-12T17:18:46.856808+0000","last_undegraded":"2024-03-12T17:18:46.856808+0000","last_fullsized":"2024-03-12T17:18:46.856808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:21:11.051648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947866+0000","last_change":"2024-03-12T17:18:45.876848+0000","last_active":"2024-03-12T17:18:46.947866+0000","last_peered":"2024-03-12T17:18:46.947866+0000","last_clean":"2024-03-12T17:18:46.947866+0000","last_became_active":"2024-03-12T17:18:45.876658+0000","last_became_peered":"2024-03-12T17:18:45.876658+0000","last_unstale":"2024-03-12T17:18:46.947866+0000","last_undegraded":"2024-03-12T17:18:46.947866+0000","last_fullsized":"2024-03-12T17:18:46.947866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:15:10.118237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.945388+0000","last_change":"2024-03-12T17:18:45.897934+0000","last_active":"2024-03-12T17:18:46.945388+0000","last_peered":"2024-03-12T17:18:46.945388+0000","last_clean":"2024-03-12T17:18:46.945388+0000","last_became_active":"2024-03-12T17:18:45.897632+0000","last_became_peered":"2024-03-12T17:18:45.897632+0000","last_unstale":"2024-03-12T17:18:46.945388+0000","last_undegraded":"2024-03-12T17:18:46.945388+0000","last_fullsized":"2024-03-12T17:18:46.945388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:23:06.063091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.945707+0000","last_change":"2024-03-12T17:18:45.882068+0000","last_active":"2024-03-12T17:18:46.945707+0000","last_peered":"2024-03-12T17:18:46.945707+0000","last_clean":"2024-03-12T17:18:46.945707+0000","last_became_active":"2024-03-12T17:18:45.881609+0000","last_became_peered":"2024-03-12T17:18:45.881609+0000","last_unstale":"2024-03-12T17:18:46.945707+0000","last_undegraded":"2024-03-12T17:18:46.945707+0000","last_fullsized":"2024-03-12T17:18:46.945707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:42:22.754824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947829+0000","last_change":"2024-03-12T17:18:45.875604+0000","last_active":"2024-03-12T17:18:46.947829+0000","last_peered":"2024-03-12T17:18:46.947829+0000","last_clean":"2024-03-12T17:18:46.947829+0000","last_became_active":"2024-03-12T17:18:45.875300+0000","last_became_peered":"2024-03-12T17:18:45.875300+0000","last_unstale":"2024-03-12T17:18:46.947829+0000","last_undegraded":"2024-03-12T17:18:46.947829+0000","last_fullsized":"2024-03-12T17:18:46.947829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:24:13.883507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947088+0000","last_change":"2024-03-12T17:18:45.879642+0000","last_active":"2024-03-12T17:18:46.947088+0000","last_peered":"2024-03-12T17:18:46.947088+0000","last_clean":"2024-03-12T17:18:46.947088+0000","last_became_active":"2024-03-12T17:18:45.879390+0000","last_became_peered":"2024-03-12T17:18:45.879390+0000","last_unstale":"2024-03-12T17:18:46.947088+0000","last_undegraded":"2024-03-12T17:18:46.947088+0000","last_fullsized":"2024-03-12T17:18:46.947088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:25:10.176932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857915+0000","last_change":"2024-03-12T17:18:45.878596+0000","last_active":"2024-03-12T17:18:46.857915+0000","last_peered":"2024-03-12T17:18:46.857915+0000","last_clean":"2024-03-12T17:18:46.857915+0000","last_became_active":"2024-03-12T17:18:45.878223+0000","last_became_peered":"2024-03-12T17:18:45.878223+0000","last_unstale":"2024-03-12T17:18:46.857915+0000","last_undegraded":"2024-03-12T17:18:46.857915+0000","last_fullsized":"2024-03-12T17:18:46.857915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:42:22.754824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.853503+0000","last_change":"2024-03-12T17:18:45.869021+0000","last_active":"2024-03-12T17:18:46.853503+0000","last_peered":"2024-03-12T17:18:46.853503+0000","last_clean":"2024-03-12T17:18:46.853503+0000","last_became_active":"2024-03-12T17:18:45.868790+0000","last_became_peered":"2024-03-12T17:18:45.868790+0000","last_unstale":"2024-03-12T17:18:46.853503+0000","last_undegraded":"2024-03-12T17:18:46.853503+0000","last_fullsized":"2024-03-12T17:18:46.853503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:20:31.313923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944482+0000","last_change":"2024-03-12T17:18:45.886248+0000","last_active":"2024-03-12T17:18:46.944482+0000","last_peered":"2024-03-12T17:18:46.944482+0000","last_clean":"2024-03-12T17:18:46.944482+0000","last_became_active":"2024-03-12T17:18:45.885636+0000","last_became_peered":"2024-03-12T17:18:45.885636+0000","last_unstale":"2024-03-12T17:18:46.944482+0000","last_undegraded":"2024-03-12T17:18:46.944482+0000","last_fullsized":"2024-03-12T17:18:46.944482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:10:25.044042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.945966+0000","last_change":"2024-03-12T17:18:45.878245+0000","last_active":"2024-03-12T17:18:46.945966+0000","last_peered":"2024-03-12T17:18:46.945966+0000","last_clean":"2024-03-12T17:18:46.945966+0000","last_became_active":"2024-03-12T17:18:45.874458+0000","last_became_peered":"2024-03-12T17:18:45.874458+0000","last_unstale":"2024-03-12T17:18:46.945966+0000","last_undegraded":"2024-03-12T17:18:46.945966+0000","last_fullsized":"2024-03-12T17:18:46.945966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:32:01.111631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947680+0000","last_change":"2024-03-12T17:18:45.375951+0000","last_active":"2024-03-12T17:18:46.947680+0000","last_peered":"2024-03-12T17:18:46.947680+0000","last_clean":"2024-03-12T17:18:46.947680+0000","last_became_active":"2024-03-12T17:18:45.375616+0000","last_became_peered":"2024-03-12T17:18:45.375616+0000","last_unstale":"2024-03-12T17:18:46.947680+0000","last_undegraded":"2024-03-12T17:18:46.947680+0000","last_fullsized":"2024-03-12T17:18:46.947680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:07:53.768009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947190+0000","last_change":"2024-03-12T17:18:45.883654+0000","last_active":"2024-03-12T17:18:46.947190+0000","last_peered":"2024-03-12T17:18:46.947190+0000","last_clean":"2024-03-12T17:18:46.947190+0000","last_became_active":"2024-03-12T17:18:45.883247+0000","last_became_peered":"2024-03-12T17:18:45.883247+0000","last_unstale":"2024-03-12T17:18:46.947190+0000","last_undegraded":"2024-03-12T17:18:46.947190+0000","last_fullsized":"2024-03-12T17:18:46.947190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:24:13.883507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944269+0000","last_change":"2024-03-12T17:18:45.377143+0000","last_active":"2024-03-12T17:18:46.944269+0000","last_peered":"2024-03-12T17:18:46.944269+0000","last_clean":"2024-03-12T17:18:46.944269+0000","last_became_active":"2024-03-12T17:18:45.376587+0000","last_became_peered":"2024-03-12T17:18:45.376587+0000","last_unstale":"2024-03-12T17:18:46.944269+0000","last_undegraded":"2024-03-12T17:18:46.944269+0000","last_fullsized":"2024-03-12T17:18:46.944269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:12:48.811874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947685+0000","last_change":"2024-03-12T17:18:45.368141+0000","last_active":"2024-03-12T17:18:46.947685+0000","last_peered":"2024-03-12T17:18:46.947685+0000","last_clean":"2024-03-12T17:18:46.947685+0000","last_became_active":"2024-03-12T17:18:45.367922+0000","last_became_peered":"2024-03-12T17:18:45.367922+0000","last_unstale":"2024-03-12T17:18:46.947685+0000","last_undegraded":"2024-03-12T17:18:46.947685+0000","last_fullsized":"2024-03-12T17:18:46.947685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:23:50.392288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.946810+0000","last_change":"2024-03-12T17:18:45.864983+0000","last_active":"2024-03-12T17:18:46.946810+0000","last_peered":"2024-03-12T17:18:46.946810+0000","last_clean":"2024-03-12T17:18:46.946810+0000","last_became_active":"2024-03-12T17:18:45.864648+0000","last_became_peered":"2024-03-12T17:18:45.864648+0000","last_unstale":"2024-03-12T17:18:46.946810+0000","last_undegraded":"2024-03-12T17:18:46.946810+0000","last_fullsized":"2024-03-12T17:18:46.946810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:25:10.176932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857020+0000","last_change":"2024-03-12T17:18:45.365029+0000","last_active":"2024-03-12T17:18:46.857020+0000","last_peered":"2024-03-12T17:18:46.857020+0000","last_clean":"2024-03-12T17:18:46.857020+0000","last_became_active":"2024-03-12T17:18:45.364621+0000","last_became_peered":"2024-03-12T17:18:45.364621+0000","last_unstale":"2024-03-12T17:18:46.857020+0000","last_undegraded":"2024-03-12T17:18:46.857020+0000","last_fullsized":"2024-03-12T17:18:46.857020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:01:22.087219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944672+0000","last_change":"2024-03-12T17:18:45.879492+0000","last_active":"2024-03-12T17:18:46.944672+0000","last_peered":"2024-03-12T17:18:46.944672+0000","last_clean":"2024-03-12T17:18:46.944672+0000","last_became_active":"2024-03-12T17:18:45.879232+0000","last_became_peered":"2024-03-12T17:18:45.879232+0000","last_unstale":"2024-03-12T17:18:46.944672+0000","last_undegraded":"2024-03-12T17:18:46.944672+0000","last_fullsized":"2024-03-12T17:18:46.944672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:10:29.099400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.945211+0000","last_change":"2024-03-12T17:18:45.382641+0000","last_active":"2024-03-12T17:18:46.945211+0000","last_peered":"2024-03-12T17:18:46.945211+0000","last_clean":"2024-03-12T17:18:46.945211+0000","last_became_active":"2024-03-12T17:18:45.381871+0000","last_became_peered":"2024-03-12T17:18:45.381871+0000","last_unstale":"2024-03-12T17:18:46.945211+0000","last_undegraded":"2024-03-12T17:18:46.945211+0000","last_fullsized":"2024-03-12T17:18:46.945211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:07:53.768009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.859233+0000","last_change":"2024-03-12T17:18:45.893641+0000","last_active":"2024-03-12T17:18:46.859233+0000","last_peered":"2024-03-12T17:18:46.859233+0000","last_clean":"2024-03-12T17:18:46.859233+0000","last_became_active":"2024-03-12T17:18:45.893285+0000","last_became_peered":"2024-03-12T17:18:45.893285+0000","last_unstale":"2024-03-12T17:18:46.859233+0000","last_undegraded":"2024-03-12T17:18:46.859233+0000","last_fullsized":"2024-03-12T17:18:46.859233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:15:10.118237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.859238+0000","last_change":"2024-03-12T17:18:45.376164+0000","last_active":"2024-03-12T17:18:46.859238+0000","last_peered":"2024-03-12T17:18:46.859238+0000","last_clean":"2024-03-12T17:18:46.859238+0000","last_became_active":"2024-03-12T17:18:45.374280+0000","last_became_peered":"2024-03-12T17:18:45.374280+0000","last_unstale":"2024-03-12T17:18:46.859238+0000","last_undegraded":"2024-03-12T17:18:46.859238+0000","last_fullsized":"2024-03-12T17:18:46.859238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:23:50.392288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.949144+0000","last_change":"2024-03-12T17:18:45.878892+0000","last_active":"2024-03-12T17:18:46.949144+0000","last_peered":"2024-03-12T17:18:46.949144+0000","last_clean":"2024-03-12T17:18:46.949144+0000","last_became_active":"2024-03-12T17:18:45.878651+0000","last_became_peered":"2024-03-12T17:18:45.878651+0000","last_unstale":"2024-03-12T17:18:46.949144+0000","last_undegraded":"2024-03-12T17:18:46.949144+0000","last_fullsized":"2024-03-12T17:18:46.949144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:10:25.044042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.945945+0000","last_change":"2024-03-12T17:18:45.382325+0000","last_active":"2024-03-12T17:18:46.945945+0000","last_peered":"2024-03-12T17:18:46.945945+0000","last_clean":"2024-03-12T17:18:46.945945+0000","last_became_active":"2024-03-12T17:18:45.382056+0000","last_became_peered":"2024-03-12T17:18:45.382056+0000","last_unstale":"2024-03-12T17:18:46.945945+0000","last_undegraded":"2024-03-12T17:18:46.945945+0000","last_fullsized":"2024-03-12T17:18:46.945945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:35:28.129493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.946639+0000","last_change":"2024-03-12T17:18:45.895888+0000","last_active":"2024-03-12T17:18:46.946639+0000","last_peered":"2024-03-12T17:18:46.946639+0000","last_clean":"2024-03-12T17:18:46.946639+0000","last_became_active":"2024-03-12T17:18:45.895314+0000","last_became_peered":"2024-03-12T17:18:45.895314+0000","last_unstale":"2024-03-12T17:18:46.946639+0000","last_undegraded":"2024-03-12T17:18:46.946639+0000","last_fullsized":"2024-03-12T17:18:46.946639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:28:48.535350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944549+0000","last_change":"2024-03-12T17:18:45.381040+0000","last_active":"2024-03-12T17:18:46.944549+0000","last_peered":"2024-03-12T17:18:46.944549+0000","last_clean":"2024-03-12T17:18:46.944549+0000","last_became_active":"2024-03-12T17:18:45.380400+0000","last_became_peered":"2024-03-12T17:18:45.380400+0000","last_unstale":"2024-03-12T17:18:46.944549+0000","last_undegraded":"2024-03-12T17:18:46.944549+0000","last_fullsized":"2024-03-12T17:18:46.944549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:48:10.442245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857838+0000","last_change":"2024-03-12T17:18:45.896661+0000","last_active":"2024-03-12T17:18:46.857838+0000","last_peered":"2024-03-12T17:18:46.857838+0000","last_clean":"2024-03-12T17:18:46.857838+0000","last_became_active":"2024-03-12T17:18:45.896381+0000","last_became_peered":"2024-03-12T17:18:45.896381+0000","last_unstale":"2024-03-12T17:18:46.857838+0000","last_undegraded":"2024-03-12T17:18:46.857838+0000","last_fullsized":"2024-03-12T17:18:46.857838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:17:13.547169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947292+0000","last_change":"2024-03-12T17:18:45.365459+0000","last_active":"2024-03-12T17:18:46.947292+0000","last_peered":"2024-03-12T17:18:46.947292+0000","last_clean":"2024-03-12T17:18:46.947292+0000","last_became_active":"2024-03-12T17:18:45.365123+0000","last_became_peered":"2024-03-12T17:18:45.365123+0000","last_unstale":"2024-03-12T17:18:46.947292+0000","last_undegraded":"2024-03-12T17:18:46.947292+0000","last_fullsized":"2024-03-12T17:18:46.947292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:12:45.021044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.948430+0000","last_change":"2024-03-12T17:18:45.888078+0000","last_active":"2024-03-12T17:18:46.948430+0000","last_peered":"2024-03-12T17:18:46.948430+0000","last_clean":"2024-03-12T17:18:46.948430+0000","last_became_active":"2024-03-12T17:18:45.887793+0000","last_became_peered":"2024-03-12T17:18:45.887793+0000","last_unstale":"2024-03-12T17:18:46.948430+0000","last_undegraded":"2024-03-12T17:18:46.948430+0000","last_fullsized":"2024-03-12T17:18:46.948430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:17:33.168888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858044+0000","last_change":"2024-03-12T17:18:45.378988+0000","last_active":"2024-03-12T17:18:46.858044+0000","last_peered":"2024-03-12T17:18:46.858044+0000","last_clean":"2024-03-12T17:18:46.858044+0000","last_became_active":"2024-03-12T17:18:45.378697+0000","last_became_peered":"2024-03-12T17:18:45.378697+0000","last_unstale":"2024-03-12T17:18:46.858044+0000","last_undegraded":"2024-03-12T17:18:46.858044+0000","last_fullsized":"2024-03-12T17:18:46.858044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:07:53.768009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857986+0000","last_change":"2024-03-12T17:18:45.899356+0000","last_active":"2024-03-12T17:18:46.857986+0000","last_peered":"2024-03-12T17:18:46.857986+0000","last_clean":"2024-03-12T17:18:46.857986+0000","last_became_active":"2024-03-12T17:18:45.899010+0000","last_became_peered":"2024-03-12T17:18:45.899010+0000","last_unstale":"2024-03-12T17:18:46.857986+0000","last_undegraded":"2024-03-12T17:18:46.857986+0000","last_fullsized":"2024-03-12T17:18:46.857986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:05:09.374271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944237+0000","last_change":"2024-03-12T17:18:45.376515+0000","last_active":"2024-03-12T17:18:46.944237+0000","last_peered":"2024-03-12T17:18:46.944237+0000","last_clean":"2024-03-12T17:18:46.944237+0000","last_became_active":"2024-03-12T17:18:45.376229+0000","last_became_peered":"2024-03-12T17:18:45.376229+0000","last_unstale":"2024-03-12T17:18:46.944237+0000","last_undegraded":"2024-03-12T17:18:46.944237+0000","last_fullsized":"2024-03-12T17:18:46.944237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:33:40.644061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944239+0000","last_change":"2024-03-12T17:18:45.885557+0000","last_active":"2024-03-12T17:18:46.944239+0000","last_peered":"2024-03-12T17:18:46.944239+0000","last_clean":"2024-03-12T17:18:46.944239+0000","last_became_active":"2024-03-12T17:18:45.885214+0000","last_became_peered":"2024-03-12T17:18:45.885214+0000","last_unstale":"2024-03-12T17:18:46.944239+0000","last_undegraded":"2024-03-12T17:18:46.944239+0000","last_fullsized":"2024-03-12T17:18:46.944239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:56:38.943678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.853537+0000","last_change":"2024-03-12T17:18:45.368912+0000","last_active":"2024-03-12T17:18:46.853537+0000","last_peered":"2024-03-12T17:18:46.853537+0000","last_clean":"2024-03-12T17:18:46.853537+0000","last_became_active":"2024-03-12T17:18:45.368576+0000","last_became_peered":"2024-03-12T17:18:45.368576+0000","last_unstale":"2024-03-12T17:18:46.853537+0000","last_undegraded":"2024-03-12T17:18:46.853537+0000","last_fullsized":"2024-03-12T17:18:46.853537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:23:50.392288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857414+0000","last_change":"2024-03-12T17:18:45.898975+0000","last_active":"2024-03-12T17:18:46.857414+0000","last_peered":"2024-03-12T17:18:46.857414+0000","last_clean":"2024-03-12T17:18:46.857414+0000","last_became_active":"2024-03-12T17:18:45.898704+0000","last_became_peered":"2024-03-12T17:18:45.898704+0000","last_unstale":"2024-03-12T17:18:46.857414+0000","last_undegraded":"2024-03-12T17:18:46.857414+0000","last_fullsized":"2024-03-12T17:18:46.857414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:42:22.754824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.946552+0000","last_change":"2024-03-12T17:18:45.366523+0000","last_active":"2024-03-12T17:18:46.946552+0000","last_peered":"2024-03-12T17:18:46.946552+0000","last_clean":"2024-03-12T17:18:46.946552+0000","last_became_active":"2024-03-12T17:18:45.366135+0000","last_became_peered":"2024-03-12T17:18:45.366135+0000","last_unstale":"2024-03-12T17:18:46.946552+0000","last_undegraded":"2024-03-12T17:18:46.946552+0000","last_fullsized":"2024-03-12T17:18:46.946552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T00:52:36.901043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858186+0000","last_change":"2024-03-12T17:18:45.898571+0000","last_active":"2024-03-12T17:18:46.858186+0000","last_peered":"2024-03-12T17:18:46.858186+0000","last_clean":"2024-03-12T17:18:46.858186+0000","last_became_active":"2024-03-12T17:18:45.898306+0000","last_became_peered":"2024-03-12T17:18:45.898306+0000","last_unstale":"2024-03-12T17:18:46.858186+0000","last_undegraded":"2024-03-12T17:18:46.858186+0000","last_fullsized":"2024-03-12T17:18:46.858186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:15:10.118237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.854032+0000","last_change":"2024-03-12T17:18:45.373982+0000","last_active":"2024-03-12T17:18:46.854032+0000","last_peered":"2024-03-12T17:18:46.854032+0000","last_clean":"2024-03-12T17:18:46.854032+0000","last_became_active":"2024-03-12T17:18:45.373647+0000","last_became_peered":"2024-03-12T17:18:45.373647+0000","last_unstale":"2024-03-12T17:18:46.854032+0000","last_undegraded":"2024-03-12T17:18:46.854032+0000","last_fullsized":"2024-03-12T17:18:46.854032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:07:53.768009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.859231+0000","last_change":"2024-03-12T17:18:45.903054+0000","last_active":"2024-03-12T17:18:46.859231+0000","last_peered":"2024-03-12T17:18:46.859231+0000","last_clean":"2024-03-12T17:18:46.859231+0000","last_became_active":"2024-03-12T17:18:45.902762+0000","last_became_peered":"2024-03-12T17:18:45.902762+0000","last_unstale":"2024-03-12T17:18:46.859231+0000","last_undegraded":"2024-03-12T17:18:46.859231+0000","last_fullsized":"2024-03-12T17:18:46.859231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:41:17.395467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.946192+0000","last_change":"2024-03-12T17:18:45.377581+0000","last_active":"2024-03-12T17:18:46.946192+0000","last_peered":"2024-03-12T17:18:46.946192+0000","last_clean":"2024-03-12T17:18:46.946192+0000","last_became_active":"2024-03-12T17:18:45.373688+0000","last_became_peered":"2024-03-12T17:18:45.373688+0000","last_unstale":"2024-03-12T17:18:46.946192+0000","last_undegraded":"2024-03-12T17:18:46.946192+0000","last_fullsized":"2024-03-12T17:18:46.946192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:31:59.966986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858775+0000","last_change":"2024-03-12T17:18:45.879835+0000","last_active":"2024-03-12T17:18:46.858775+0000","last_peered":"2024-03-12T17:18:46.858775+0000","last_clean":"2024-03-12T17:18:46.858775+0000","last_became_active":"2024-03-12T17:18:45.879498+0000","last_became_peered":"2024-03-12T17:18:45.879498+0000","last_unstale":"2024-03-12T17:18:46.858775+0000","last_undegraded":"2024-03-12T17:18:46.858775+0000","last_fullsized":"2024-03-12T17:18:46.858775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:41:17.395467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.853981+0000","last_change":"2024-03-12T17:18:45.376596+0000","last_active":"2024-03-12T17:18:46.853981+0000","last_peered":"2024-03-12T17:18:46.853981+0000","last_clean":"2024-03-12T17:18:46.853981+0000","last_became_active":"2024-03-12T17:18:45.376256+0000","last_became_peered":"2024-03-12T17:18:45.376256+0000","last_unstale":"2024-03-12T17:18:46.853981+0000","last_undegraded":"2024-03-12T17:18:46.853981+0000","last_fullsized":"2024-03-12T17:18:46.853981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:29:41.118150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858115+0000","last_change":"2024-03-12T17:18:45.900428+0000","last_active":"2024-03-12T17:18:46.858115+0000","last_peered":"2024-03-12T17:18:46.858115+0000","last_clean":"2024-03-12T17:18:46.858115+0000","last_became_active":"2024-03-12T17:18:45.900179+0000","last_became_peered":"2024-03-12T17:18:45.900179+0000","last_unstale":"2024-03-12T17:18:46.858115+0000","last_undegraded":"2024-03-12T17:18:46.858115+0000","last_fullsized":"2024-03-12T17:18:46.858115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:38:05.092463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-12T17:18:45.881910+0000","last_change":"2024-03-12T17:18:41.331756+0000","last_active":"2024-03-12T17:18:45.881910+0000","last_peered":"2024-03-12T17:18:45.881910+0000","last_clean":"2024-03-12T17:18:45.881910+0000","last_became_active":"2024-03-12T17:18:41.329237+0000","last_became_peered":"2024-03-12T17:18:41.329237+0000","last_unstale":"2024-03-12T17:18:45.881910+0000","last_undegraded":"2024-03-12T17:18:45.881910+0000","last_fullsized":"2024-03-12T17:18:45.881910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:40.152422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:40.152422+0000","last_clean_scrub_stamp":"2024-03-12T17:18:40.152422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:35:43.664403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857578+0000","last_change":"2024-03-12T17:18:45.367331+0000","last_active":"2024-03-12T17:18:46.857578+0000","last_peered":"2024-03-12T17:18:46.857578+0000","last_clean":"2024-03-12T17:18:46.857578+0000","last_became_active":"2024-03-12T17:18:45.367018+0000","last_became_peered":"2024-03-12T17:18:45.367018+0000","last_unstale":"2024-03-12T17:18:46.857578+0000","last_undegraded":"2024-03-12T17:18:46.857578+0000","last_fullsized":"2024-03-12T17:18:46.857578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:12:48.811874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947416+0000","last_change":"2024-03-12T17:18:45.870828+0000","last_active":"2024-03-12T17:18:46.947416+0000","last_peered":"2024-03-12T17:18:46.947416+0000","last_clean":"2024-03-12T17:18:46.947416+0000","last_became_active":"2024-03-12T17:18:45.870373+0000","last_became_peered":"2024-03-12T17:18:45.870373+0000","last_unstale":"2024-03-12T17:18:46.947416+0000","last_undegraded":"2024-03-12T17:18:46.947416+0000","last_fullsized":"2024-03-12T17:18:46.947416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:17:33.168888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.856696+0000","last_change":"2024-03-12T17:18:45.379833+0000","last_active":"2024-03-12T17:18:46.856696+0000","last_peered":"2024-03-12T17:18:46.856696+0000","last_clean":"2024-03-12T17:18:46.856696+0000","last_became_active":"2024-03-12T17:18:45.379554+0000","last_became_peered":"2024-03-12T17:18:45.379554+0000","last_unstale":"2024-03-12T17:18:46.856696+0000","last_undegraded":"2024-03-12T17:18:46.856696+0000","last_fullsized":"2024-03-12T17:18:46.856696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:23:50.392288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.949504+0000","last_change":"2024-03-12T17:18:45.885222+0000","last_active":"2024-03-12T17:18:46.949504+0000","last_peered":"2024-03-12T17:18:46.949504+0000","last_clean":"2024-03-12T17:18:46.949504+0000","last_became_active":"2024-03-12T17:18:45.883636+0000","last_became_peered":"2024-03-12T17:18:45.883636+0000","last_unstale":"2024-03-12T17:18:46.949504+0000","last_undegraded":"2024-03-12T17:18:46.949504+0000","last_fullsized":"2024-03-12T17:18:46.949504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:54:36.712407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.853528+0000","last_change":"2024-03-12T17:18:45.364610+0000","last_active":"2024-03-12T17:18:46.853528+0000","last_peered":"2024-03-12T17:18:46.853528+0000","last_clean":"2024-03-12T17:18:46.853528+0000","last_became_active":"2024-03-12T17:18:45.364255+0000","last_became_peered":"2024-03-12T17:18:45.364255+0000","last_unstale":"2024-03-12T17:18:46.853528+0000","last_undegraded":"2024-03-12T17:18:46.853528+0000","last_fullsized":"2024-03-12T17:18:46.853528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:12:48.811874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944834+0000","last_change":"2024-03-12T17:18:45.857097+0000","last_active":"2024-03-12T17:18:46.944834+0000","last_peered":"2024-03-12T17:18:46.944834+0000","last_clean":"2024-03-12T17:18:46.944834+0000","last_became_active":"2024-03-12T17:18:45.856205+0000","last_became_peered":"2024-03-12T17:18:45.856205+0000","last_unstale":"2024-03-12T17:18:46.944834+0000","last_undegraded":"2024-03-12T17:18:46.944834+0000","last_fullsized":"2024-03-12T17:18:46.944834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:24:13.883507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858257+0000","last_change":"2024-03-12T17:18:45.371153+0000","last_active":"2024-03-12T17:18:46.858257+0000","last_peered":"2024-03-12T17:18:46.858257+0000","last_clean":"2024-03-12T17:18:46.858257+0000","last_became_active":"2024-03-12T17:18:45.369025+0000","last_became_peered":"2024-03-12T17:18:45.369025+0000","last_unstale":"2024-03-12T17:18:46.858257+0000","last_undegraded":"2024-03-12T17:18:46.858257+0000","last_fullsized":"2024-03-12T17:18:46.858257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:20:41.753321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.946051+0000","last_change":"2024-03-12T17:18:45.888296+0000","last_active":"2024-03-12T17:18:46.946051+0000","last_peered":"2024-03-12T17:18:46.946051+0000","last_clean":"2024-03-12T17:18:46.946051+0000","last_became_active":"2024-03-12T17:18:45.886034+0000","last_became_peered":"2024-03-12T17:18:45.886034+0000","last_unstale":"2024-03-12T17:18:46.946051+0000","last_undegraded":"2024-03-12T17:18:46.946051+0000","last_fullsized":"2024-03-12T17:18:46.946051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:35:49.382412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944808+0000","last_change":"2024-03-12T17:18:45.373944+0000","last_active":"2024-03-12T17:18:46.944808+0000","last_peered":"2024-03-12T17:18:46.944808+0000","last_clean":"2024-03-12T17:18:46.944808+0000","last_became_active":"2024-03-12T17:18:45.372641+0000","last_became_peered":"2024-03-12T17:18:45.372641+0000","last_unstale":"2024-03-12T17:18:46.944808+0000","last_undegraded":"2024-03-12T17:18:46.944808+0000","last_fullsized":"2024-03-12T17:18:46.944808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:29:41.118150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858537+0000","last_change":"2024-03-12T17:18:45.881154+0000","last_active":"2024-03-12T17:18:46.858537+0000","last_peered":"2024-03-12T17:18:46.858537+0000","last_clean":"2024-03-12T17:18:46.858537+0000","last_became_active":"2024-03-12T17:18:45.880178+0000","last_became_peered":"2024-03-12T17:18:45.880178+0000","last_unstale":"2024-03-12T17:18:46.858537+0000","last_undegraded":"2024-03-12T17:18:46.858537+0000","last_fullsized":"2024-03-12T17:18:46.858537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:17:33.168888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858695+0000","last_change":"2024-03-12T17:18:45.384960+0000","last_active":"2024-03-12T17:18:46.858695+0000","last_peered":"2024-03-12T17:18:46.858695+0000","last_clean":"2024-03-12T17:18:46.858695+0000","last_became_active":"2024-03-12T17:18:45.384751+0000","last_became_peered":"2024-03-12T17:18:45.384751+0000","last_unstale":"2024-03-12T17:18:46.858695+0000","last_undegraded":"2024-03-12T17:18:46.858695+0000","last_fullsized":"2024-03-12T17:18:46.858695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:35:48.237768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944647+0000","last_change":"2024-03-12T17:18:45.856343+0000","last_active":"2024-03-12T17:18:46.944647+0000","last_peered":"2024-03-12T17:18:46.944647+0000","last_clean":"2024-03-12T17:18:46.944647+0000","last_became_active":"2024-03-12T17:18:45.856040+0000","last_became_peered":"2024-03-12T17:18:45.856040+0000","last_unstale":"2024-03-12T17:18:46.944647+0000","last_undegraded":"2024-03-12T17:18:46.944647+0000","last_fullsized":"2024-03-12T17:18:46.944647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:23:06.063091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944717+0000","last_change":"2024-03-12T17:18:45.378083+0000","last_active":"2024-03-12T17:18:46.944717+0000","last_peered":"2024-03-12T17:18:46.944717+0000","last_clean":"2024-03-12T17:18:46.944717+0000","last_became_active":"2024-03-12T17:18:45.377137+0000","last_became_peered":"2024-03-12T17:18:45.377137+0000","last_unstale":"2024-03-12T17:18:46.944717+0000","last_undegraded":"2024-03-12T17:18:46.944717+0000","last_fullsized":"2024-03-12T17:18:46.944717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:28:47.390706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.948100+0000","last_change":"2024-03-12T17:18:45.889958+0000","last_active":"2024-03-12T17:18:46.948100+0000","last_peered":"2024-03-12T17:18:46.948100+0000","last_clean":"2024-03-12T17:18:46.948100+0000","last_became_active":"2024-03-12T17:18:45.889667+0000","last_became_peered":"2024-03-12T17:18:45.889667+0000","last_unstale":"2024-03-12T17:18:46.948100+0000","last_undegraded":"2024-03-12T17:18:46.948100+0000","last_fullsized":"2024-03-12T17:18:46.948100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:21:11.051648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.945277+0000","last_change":"2024-03-12T17:18:45.382531+0000","last_active":"2024-03-12T17:18:46.945277+0000","last_peered":"2024-03-12T17:18:46.945277+0000","last_clean":"2024-03-12T17:18:46.945277+0000","last_became_active":"2024-03-12T17:18:45.381932+0000","last_became_peered":"2024-03-12T17:18:45.381932+0000","last_unstale":"2024-03-12T17:18:46.945277+0000","last_undegraded":"2024-03-12T17:18:46.945277+0000","last_fullsized":"2024-03-12T17:18:46.945277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:20:41.753321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.948605+0000","last_change":"2024-03-12T17:18:45.861290+0000","last_active":"2024-03-12T17:18:46.948605+0000","last_peered":"2024-03-12T17:18:46.948605+0000","last_clean":"2024-03-12T17:18:46.948605+0000","last_became_active":"2024-03-12T17:18:45.860724+0000","last_became_peered":"2024-03-12T17:18:45.860724+0000","last_unstale":"2024-03-12T17:18:46.948605+0000","last_undegraded":"2024-03-12T17:18:46.948605+0000","last_fullsized":"2024-03-12T17:18:46.948605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:48:29.172720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.856696+0000","last_change":"2024-03-12T17:18:45.384765+0000","last_active":"2024-03-12T17:18:46.856696+0000","last_peered":"2024-03-12T17:18:46.856696+0000","last_clean":"2024-03-12T17:18:46.856696+0000","last_became_active":"2024-03-12T17:18:45.384463+0000","last_became_peered":"2024-03-12T17:18:45.384463+0000","last_unstale":"2024-03-12T17:18:46.856696+0000","last_undegraded":"2024-03-12T17:18:46.856696+0000","last_fullsized":"2024-03-12T17:18:46.856696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:29:41.118150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.946022+0000","last_change":"2024-03-12T17:18:45.883260+0000","last_active":"2024-03-12T17:18:46.946022+0000","last_peered":"2024-03-12T17:18:46.946022+0000","last_clean":"2024-03-12T17:18:46.946022+0000","last_became_active":"2024-03-12T17:18:45.882864+0000","last_became_peered":"2024-03-12T17:18:45.882864+0000","last_unstale":"2024-03-12T17:18:46.946022+0000","last_undegraded":"2024-03-12T17:18:46.946022+0000","last_fullsized":"2024-03-12T17:18:46.946022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:07:54.912653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.945167+0000","last_change":"2024-03-12T17:18:45.380347+0000","last_active":"2024-03-12T17:18:46.945167+0000","last_peered":"2024-03-12T17:18:46.945167+0000","last_clean":"2024-03-12T17:18:46.945167+0000","last_became_active":"2024-03-12T17:18:45.378500+0000","last_became_peered":"2024-03-12T17:18:45.378500+0000","last_unstale":"2024-03-12T17:18:46.945167+0000","last_undegraded":"2024-03-12T17:18:46.945167+0000","last_fullsized":"2024-03-12T17:18:46.945167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:52:30.297945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.946901+0000","last_change":"2024-03-12T17:18:45.876651+0000","last_active":"2024-03-12T17:18:46.946901+0000","last_peered":"2024-03-12T17:18:46.946901+0000","last_clean":"2024-03-12T17:18:46.946901+0000","last_became_active":"2024-03-12T17:18:45.875075+0000","last_became_peered":"2024-03-12T17:18:45.875075+0000","last_unstale":"2024-03-12T17:18:46.946901+0000","last_undegraded":"2024-03-12T17:18:46.946901+0000","last_fullsized":"2024-03-12T17:18:46.946901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:41:17.395467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944618+0000","last_change":"2024-03-12T17:18:45.380761+0000","last_active":"2024-03-12T17:18:46.944618+0000","last_peered":"2024-03-12T17:18:46.944618+0000","last_clean":"2024-03-12T17:18:46.944618+0000","last_became_active":"2024-03-12T17:18:45.379967+0000","last_became_peered":"2024-03-12T17:18:45.379967+0000","last_unstale":"2024-03-12T17:18:46.944618+0000","last_undegraded":"2024-03-12T17:18:46.944618+0000","last_fullsized":"2024-03-12T17:18:46.944618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:35:48.237768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947573+0000","last_change":"2024-03-12T17:18:45.874583+0000","last_active":"2024-03-12T17:18:46.947573+0000","last_peered":"2024-03-12T17:18:46.947573+0000","last_clean":"2024-03-12T17:18:46.947573+0000","last_became_active":"2024-03-12T17:18:45.873218+0000","last_became_peered":"2024-03-12T17:18:45.873218+0000","last_unstale":"2024-03-12T17:18:46.947573+0000","last_undegraded":"2024-03-12T17:18:46.947573+0000","last_fullsized":"2024-03-12T17:18:46.947573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:10:29.099400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858419+0000","last_change":"2024-03-12T17:18:45.380027+0000","last_active":"2024-03-12T17:18:46.858419+0000","last_peered":"2024-03-12T17:18:46.858419+0000","last_clean":"2024-03-12T17:18:46.858419+0000","last_became_active":"2024-03-12T17:18:45.379670+0000","last_became_peered":"2024-03-12T17:18:45.379670+0000","last_unstale":"2024-03-12T17:18:46.858419+0000","last_undegraded":"2024-03-12T17:18:46.858419+0000","last_fullsized":"2024-03-12T17:18:46.858419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:31:59.966986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944190+0000","last_change":"2024-03-12T17:18:45.892768+0000","last_active":"2024-03-12T17:18:46.944190+0000","last_peered":"2024-03-12T17:18:46.944190+0000","last_clean":"2024-03-12T17:18:46.944190+0000","last_became_active":"2024-03-12T17:18:45.890848+0000","last_became_peered":"2024-03-12T17:18:45.890848+0000","last_unstale":"2024-03-12T17:18:46.944190+0000","last_undegraded":"2024-03-12T17:18:46.944190+0000","last_fullsized":"2024-03-12T17:18:46.944190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:17:33.168888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858274+0000","last_change":"2024-03-12T17:18:45.885223+0000","last_active":"2024-03-12T17:18:46.858274+0000","last_peered":"2024-03-12T17:18:46.858274+0000","last_clean":"2024-03-12T17:18:46.858274+0000","last_became_active":"2024-03-12T17:18:45.884899+0000","last_became_peered":"2024-03-12T17:18:45.884899+0000","last_unstale":"2024-03-12T17:18:46.858274+0000","last_undegraded":"2024-03-12T17:18:46.858274+0000","last_fullsized":"2024-03-12T17:18:46.858274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:45:08.333283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857514+0000","last_change":"2024-03-12T17:18:45.386513+0000","last_active":"2024-03-12T17:18:46.857514+0000","last_peered":"2024-03-12T17:18:46.857514+0000","last_clean":"2024-03-12T17:18:46.857514+0000","last_became_active":"2024-03-12T17:18:45.386189+0000","last_became_peered":"2024-03-12T17:18:45.386189+0000","last_unstale":"2024-03-12T17:18:46.857514+0000","last_undegraded":"2024-03-12T17:18:46.857514+0000","last_fullsized":"2024-03-12T17:18:46.857514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:35:28.129493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858523+0000","last_change":"2024-03-12T17:18:45.894835+0000","last_active":"2024-03-12T17:18:46.858523+0000","last_peered":"2024-03-12T17:18:46.858523+0000","last_clean":"2024-03-12T17:18:46.858523+0000","last_became_active":"2024-03-12T17:18:45.894485+0000","last_became_peered":"2024-03-12T17:18:45.894485+0000","last_unstale":"2024-03-12T17:18:46.858523+0000","last_undegraded":"2024-03-12T17:18:46.858523+0000","last_fullsized":"2024-03-12T17:18:46.858523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:48:29.172720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858357+0000","last_change":"2024-03-12T17:18:45.384828+0000","last_active":"2024-03-12T17:18:46.858357+0000","last_peered":"2024-03-12T17:18:46.858357+0000","last_clean":"2024-03-12T17:18:46.858357+0000","last_became_active":"2024-03-12T17:18:45.384524+0000","last_became_peered":"2024-03-12T17:18:45.384524+0000","last_unstale":"2024-03-12T17:18:46.858357+0000","last_undegraded":"2024-03-12T17:18:46.858357+0000","last_fullsized":"2024-03-12T17:18:46.858357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:28:47.390706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.948954+0000","last_change":"2024-03-12T17:18:45.874183+0000","last_active":"2024-03-12T17:18:46.948954+0000","last_peered":"2024-03-12T17:18:46.948954+0000","last_clean":"2024-03-12T17:18:46.948954+0000","last_became_active":"2024-03-12T17:18:45.873893+0000","last_became_peered":"2024-03-12T17:18:45.873893+0000","last_unstale":"2024-03-12T17:18:46.948954+0000","last_undegraded":"2024-03-12T17:18:46.948954+0000","last_fullsized":"2024-03-12T17:18:46.948954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:42:22.352573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.948036+0000","last_change":"2024-03-12T17:18:45.377991+0000","last_active":"2024-03-12T17:18:46.948036+0000","last_peered":"2024-03-12T17:18:46.948036+0000","last_clean":"2024-03-12T17:18:46.948036+0000","last_became_active":"2024-03-12T17:18:45.375429+0000","last_became_peered":"2024-03-12T17:18:45.375429+0000","last_unstale":"2024-03-12T17:18:46.948036+0000","last_undegraded":"2024-03-12T17:18:46.948036+0000","last_fullsized":"2024-03-12T17:18:46.948036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:12:48.811874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.948053+0000","last_change":"2024-03-12T17:18:45.890541+0000","last_active":"2024-03-12T17:18:46.948053+0000","last_peered":"2024-03-12T17:18:46.948053+0000","last_clean":"2024-03-12T17:18:46.948053+0000","last_became_active":"2024-03-12T17:18:45.890352+0000","last_became_peered":"2024-03-12T17:18:45.890352+0000","last_unstale":"2024-03-12T17:18:46.948053+0000","last_undegraded":"2024-03-12T17:18:46.948053+0000","last_fullsized":"2024-03-12T17:18:46.948053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:05:09.374271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.949344+0000","last_change":"2024-03-12T17:18:45.374531+0000","last_active":"2024-03-12T17:18:46.949344+0000","last_peered":"2024-03-12T17:18:46.949344+0000","last_clean":"2024-03-12T17:18:46.949344+0000","last_became_active":"2024-03-12T17:18:45.373202+0000","last_became_peered":"2024-03-12T17:18:45.373202+0000","last_unstale":"2024-03-12T17:18:46.949344+0000","last_undegraded":"2024-03-12T17:18:46.949344+0000","last_fullsized":"2024-03-12T17:18:46.949344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:01:22.087219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":815104,"data_stored":666519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.22}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.296}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.589}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.744}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8660000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1909999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4020000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":229376,"data_stored":77133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.631}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8660000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5529999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31340,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340500,"statfs":{"total":96636764160,"available":96604672000,"internally_reserved":0,"allocated":221184,"data_stored":75659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.161}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.706}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.613}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6829999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3149999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4609999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8700000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":229376,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.405}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.321}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7090000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5820000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":229376,"data_stored":77133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4670000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.526}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.669}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":217088,"data_stored":75569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.593}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.028}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8049999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9530000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31344,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340496,"statfs":{"total":96636764160,"available":96604667904,"internally_reserved":0,"allocated":225280,"data_stored":75729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1819999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.272}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.788}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1259999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.052}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2229999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0739999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":823296,"data_stored":666575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.339}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.591}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6240000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3660000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-12T17:18:50.810 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-12T17:18:51.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.079+0000 7f6249200640 1 Processor -- start 2024-03-12T17:18:51.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.079+0000 7f6249200640 1 -- start start 2024-03-12T17:18:51.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.080+0000 7f6249200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f62440cf540 0x7f62440b5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:51.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.080+0000 7f6249200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f62440adcb0 0x7f62440cf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:51.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.080+0000 7f6249200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62440cfe60 con 0x7f6244069ce0 2024-03-12T17:18:51.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.080+0000 7f6249200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62440ae190 con 0x7f62440adcb0 2024-03-12T17:18:51.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.080+0000 7f6249200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62440ae470 con 0x7f62440cf540 2024-03-12T17:18:51.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.081+0000 7f6243e00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f6244069ce0 0x7f624406a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37810/0 (socket says 172.21.15.17:37810) 2024-03-12T17:18:51.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.081+0000 7f6243e00640 1 -- 172.21.15.17:0/248768885 learned_addr learned my addr 172.21.15.17:0/248768885 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:18:51.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.081+0000 7f6242a00640 1 --2- 172.21.15.17:0/248768885 >> v2:172.21.15.17:3300/0 conn(0x7f62440adcb0 0x7f62440cf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:51.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.081+0000 7f6243400640 1 --2- 172.21.15.17:0/248768885 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f62440cf540 0x7f62440b5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:51.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.081+0000 7f6242a00640 1 -- 172.21.15.17:0/248768885 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f62440cf540 msgr2=0x7f62440b5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:51.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.081+0000 7f6242a00640 1 --2- 172.21.15.17:0/248768885 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f62440cf540 0x7f62440b5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:51.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.081+0000 7f6242a00640 1 -- 172.21.15.17:0/248768885 >> v1:172.21.15.17:6789/0 conn(0x7f6244069ce0 legacy=0x7f624406a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:51.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.081+0000 7f6242a00640 1 -- 172.21.15.17:0/248768885 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62440ae750 con 0x7f62440adcb0 2024-03-12T17:18:51.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.081+0000 7f6243400640 1 --2- 172.21.15.17:0/248768885 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f62440cf540 0x7f62440b5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:18:51.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.081+0000 7f6242000640 1 -- 172.21.15.17:0/248768885 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 140796302 0 0) 0x7f62440cfe60 con 0x7f6244069ce0 2024-03-12T17:18:51.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.082+0000 7f6242a00640 1 --2- 172.21.15.17:0/248768885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62440adcb0 0x7f62440cf920 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f622c0097a0 tx=0x7f622c02b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=962b36f1859ddbe3 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:51.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.082+0000 7f6242000640 1 -- 172.21.15.17:0/248768885 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622c031780 con 0x7f62440adcb0 2024-03-12T17:18:51.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.082+0000 7f6242000640 1 -- 172.21.15.17:0/248768885 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f622c0318e0 con 0x7f62440adcb0 2024-03-12T17:18:51.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.083+0000 7f6242000640 1 -- 172.21.15.17:0/248768885 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622c031c70 con 0x7f62440adcb0 2024-03-12T17:18:51.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.083+0000 7f6249200640 1 -- 172.21.15.17:0/248768885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62440adcb0 msgr2=0x7f62440cf920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:51.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.083+0000 7f6249200640 1 --2- 172.21.15.17:0/248768885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62440adcb0 0x7f62440cf920 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f622c0097a0 tx=0x7f622c02b820 comp rx=0 tx=0).stop 2024-03-12T17:18:51.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.083+0000 7f6249200640 1 -- 172.21.15.17:0/248768885 shutdown_connections 2024-03-12T17:18:51.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.083+0000 7f6249200640 1 --2- 172.21.15.17:0/248768885 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f62440adcb0 0x7f62440cf920 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:51.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.083+0000 7f6249200640 1 --2- 172.21.15.17:0/248768885 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f62440cf540 0x7f62440b5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:51.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.083+0000 7f6249200640 1 -- 172.21.15.17:0/248768885 >> 172.21.15.17:0/248768885 conn(0x7f6244098a60 msgr2=0x7f62440b4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:51.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.083+0000 7f6249200640 1 -- 172.21.15.17:0/248768885 shutdown_connections 2024-03-12T17:18:51.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.083+0000 7f6249200640 1 -- 172.21.15.17:0/248768885 wait complete. 2024-03-12T17:18:51.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.085+0000 7f6249200640 1 Processor -- start 2024-03-12T17:18:51.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.085+0000 7f6249200640 1 -- start start 2024-03-12T17:18:51.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.086+0000 7f6249200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6244069ce0 0x7f62441f2370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:51.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.086+0000 7f6249200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f62440adcb0 0x7f62440b4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:51.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.086+0000 7f6249200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62440cf540 0x7f624413fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:51.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.086+0000 7f6249200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62441f29a0 con 0x7f6244069ce0 2024-03-12T17:18:51.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.086+0000 7f6249200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62441f2c80 con 0x7f62440cf540 2024-03-12T17:18:51.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.086+0000 7f6249200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62441f2f60 con 0x7f62440adcb0 2024-03-12T17:18:51.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.086+0000 7f6243400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6244069ce0 0x7f62441f2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:51.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.086+0000 7f6243400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6244069ce0 0x7f62441f2370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48118/0 (socket says 172.21.15.17:48118) 2024-03-12T17:18:51.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.086+0000 7f6243400640 1 -- 172.21.15.17:0/3607031605 learned_addr learned my addr 172.21.15.17:0/3607031605 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:51.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.087+0000 7f6242a00640 1 --2- 172.21.15.17:0/3607031605 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f62440adcb0 0x7f62440b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:51.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.087+0000 7f6243e00640 1 --2- 172.21.15.17:0/3607031605 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62440cf540 0x7f624413fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:51.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.087+0000 7f6243400640 1 -- 172.21.15.17:0/3607031605 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f62440adcb0 msgr2=0x7f62440b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:51.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.087+0000 7f6243400640 1 --2- 172.21.15.17:0/3607031605 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f62440adcb0 0x7f62440b4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:51.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.087+0000 7f6243400640 1 -- 172.21.15.17:0/3607031605 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62440cf540 msgr2=0x7f624413fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:51.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.087+0000 7f6243400640 1 --2- 172.21.15.17:0/3607031605 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62440cf540 0x7f624413fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:51.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.087+0000 7f6243400640 1 -- 172.21.15.17:0/3607031605 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f622c009400 con 0x7f6244069ce0 2024-03-12T17:18:51.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.087+0000 7f6242a00640 1 --2- 172.21.15.17:0/3607031605 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f62440adcb0 0x7f62440b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:18:51.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.087+0000 7f6243e00640 1 --2- 172.21.15.17:0/3607031605 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62440cf540 0x7f624413fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:18:51.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.087+0000 7f6243400640 1 --2- 172.21.15.17:0/3607031605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6244069ce0 0x7f62441f2370 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f623400e7e0 tx=0x7f623400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:51.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.087+0000 7f623b400640 1 -- 172.21.15.17:0/3607031605 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6234004030 con 0x7f6244069ce0 2024-03-12T17:18:51.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.087+0000 7f623b400640 1 -- 172.21.15.17:0/3607031605 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6234004190 con 0x7f6244069ce0 2024-03-12T17:18:51.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.087+0000 7f623b400640 1 -- 172.21.15.17:0/3607031605 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6234004520 con 0x7f6244069ce0 2024-03-12T17:18:51.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.088+0000 7f6249200640 1 -- 172.21.15.17:0/3607031605 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6244144520 con 0x7f6244069ce0 2024-03-12T17:18:51.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.088+0000 7f6249200640 1 -- 172.21.15.17:0/3607031605 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62440b2700 con 0x7f6244069ce0 2024-03-12T17:18:51.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.089+0000 7f6249200640 1 -- 172.21.15.17:0/3607031605 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62440ad0a0 con 0x7f6244069ce0 2024-03-12T17:18:51.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.090+0000 7f623b400640 1 -- 172.21.15.17:0/3607031605 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f623400c6d0 con 0x7f6244069ce0 2024-03-12T17:18:51.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.090+0000 7f623b400640 1 --2- 172.21.15.17:0/3607031605 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f622006ac00 0x7f622006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:51.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.091+0000 7f623b400640 1 -- 172.21.15.17:0/3607031605 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f62340890e0 con 0x7f6244069ce0 2024-03-12T17:18:51.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.091+0000 7f6242a00640 1 --2- 172.21.15.17:0/3607031605 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f622006ac00 0x7f622006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:51.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.091+0000 7f6242a00640 1 --2- 172.21.15.17:0/3607031605 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f622006ac00 0x7f622006d0c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f622c036000 tx=0x7f622c03d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:51.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.095+0000 7f623b400640 1 -- 172.21.15.17:0/3607031605 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f6234054220 con 0x7f6244069ce0 2024-03-12T17:18:51.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.289+0000 7f6249200640 1 -- 172.21.15.17:0/3607031605 --> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f62441443a0 con 0x7f622006ac00 2024-03-12T17:18:51.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.300+0000 7f623b400640 1 -- 172.21.15.17:0/3607031605 <== mgr.4104 v2:172.21.15.17:6832/37052 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264386 (secure 0 0 0) 0x7f622c031b50 con 0x7f622006ac00 2024-03-12T17:18:51.298 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:18:51.300 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-03-12T17:18:51.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.306+0000 7f6249200640 1 -- 172.21.15.17:0/3607031605 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f622006ac00 msgr2=0x7f622006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:51.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.306+0000 7f6249200640 1 --2- 172.21.15.17:0/3607031605 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f622006ac00 0x7f622006d0c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f622c036000 tx=0x7f622c03d040 comp rx=0 tx=0).stop 2024-03-12T17:18:51.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.306+0000 7f6249200640 1 -- 172.21.15.17:0/3607031605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6244069ce0 msgr2=0x7f62441f2370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:51.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.306+0000 7f6249200640 1 --2- 172.21.15.17:0/3607031605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6244069ce0 0x7f62441f2370 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f623400e7e0 tx=0x7f623400eca0 comp rx=0 tx=0).stop 2024-03-12T17:18:51.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.306+0000 7f6249200640 1 -- 172.21.15.17:0/3607031605 shutdown_connections 2024-03-12T17:18:51.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.306+0000 7f6249200640 1 --2- 172.21.15.17:0/3607031605 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f622006ac00 0x7f622006d0c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:51.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.306+0000 7f6249200640 1 --2- 172.21.15.17:0/3607031605 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f62440cf540 0x7f624413fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:51.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.306+0000 7f6249200640 1 --2- 172.21.15.17:0/3607031605 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f62440adcb0 0x7f62440b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:51.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.306+0000 7f6249200640 1 --2- 172.21.15.17:0/3607031605 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6244069ce0 0x7f62441f2370 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:51.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.306+0000 7f6249200640 1 -- 172.21.15.17:0/3607031605 >> 172.21.15.17:0/3607031605 conn(0x7f6244098a60 msgr2=0x7f62440af230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:51.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.306+0000 7f6249200640 1 -- 172.21.15.17:0/3607031605 shutdown_connections 2024-03-12T17:18:51.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.306+0000 7f6249200640 1 -- 172.21.15.17:0/3607031605 wait complete. 2024-03-12T17:18:51.319 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-03-12T17:18:49.476868+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":160,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252284,"kb_used_data":2920,"kb_used_omap":13,"kb_used_meta":248818,"kb_avail":754722436,"statfs":{"total":773094113280,"available":772835774464,"internally_reserved":0,"allocated":2990080,"data_stored":1790012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":254789720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":58,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.913404"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858955+0000","last_change":"2024-03-12T17:18:45.899195+0000","last_active":"2024-03-12T17:18:46.858955+0000","last_peered":"2024-03-12T17:18:46.858955+0000","last_clean":"2024-03-12T17:18:46.858955+0000","last_became_active":"2024-03-12T17:18:45.898885+0000","last_became_peered":"2024-03-12T17:18:45.898885+0000","last_unstale":"2024-03-12T17:18:46.858955+0000","last_undegraded":"2024-03-12T17:18:46.858955+0000","last_fullsized":"2024-03-12T17:18:46.858955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:36:07.517436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944636+0000","last_change":"2024-03-12T17:18:45.863461+0000","last_active":"2024-03-12T17:18:46.944636+0000","last_peered":"2024-03-12T17:18:46.944636+0000","last_clean":"2024-03-12T17:18:46.944636+0000","last_became_active":"2024-03-12T17:18:45.861872+0000","last_became_peered":"2024-03-12T17:18:45.861872+0000","last_unstale":"2024-03-12T17:18:46.944636+0000","last_undegraded":"2024-03-12T17:18:46.944636+0000","last_fullsized":"2024-03-12T17:18:46.944636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:17:33.168888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947273+0000","last_change":"2024-03-12T17:18:45.862114+0000","last_active":"2024-03-12T17:18:46.947273+0000","last_peered":"2024-03-12T17:18:46.947273+0000","last_clean":"2024-03-12T17:18:46.947273+0000","last_became_active":"2024-03-12T17:18:45.861875+0000","last_became_peered":"2024-03-12T17:18:45.861875+0000","last_unstale":"2024-03-12T17:18:46.947273+0000","last_undegraded":"2024-03-12T17:18:46.947273+0000","last_fullsized":"2024-03-12T17:18:46.947273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:56:38.943678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858269+0000","last_change":"2024-03-12T17:18:45.878850+0000","last_active":"2024-03-12T17:18:46.858269+0000","last_peered":"2024-03-12T17:18:46.858269+0000","last_clean":"2024-03-12T17:18:46.858269+0000","last_became_active":"2024-03-12T17:18:45.878507+0000","last_became_peered":"2024-03-12T17:18:45.878507+0000","last_unstale":"2024-03-12T17:18:46.858269+0000","last_undegraded":"2024-03-12T17:18:46.858269+0000","last_fullsized":"2024-03-12T17:18:46.858269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:05:09.374271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857739+0000","last_change":"2024-03-12T17:18:45.894717+0000","last_active":"2024-03-12T17:18:46.857739+0000","last_peered":"2024-03-12T17:18:46.857739+0000","last_clean":"2024-03-12T17:18:46.857739+0000","last_became_active":"2024-03-12T17:18:45.894426+0000","last_became_peered":"2024-03-12T17:18:45.894426+0000","last_unstale":"2024-03-12T17:18:46.857739+0000","last_undegraded":"2024-03-12T17:18:46.857739+0000","last_fullsized":"2024-03-12T17:18:46.857739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:09:10.961008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857512+0000","last_change":"2024-03-12T17:18:45.870293+0000","last_active":"2024-03-12T17:18:46.857512+0000","last_peered":"2024-03-12T17:18:46.857512+0000","last_clean":"2024-03-12T17:18:46.857512+0000","last_became_active":"2024-03-12T17:18:45.869629+0000","last_became_peered":"2024-03-12T17:18:45.869629+0000","last_unstale":"2024-03-12T17:18:46.857512+0000","last_undegraded":"2024-03-12T17:18:46.857512+0000","last_fullsized":"2024-03-12T17:18:46.857512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:24:13.883507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857215+0000","last_change":"2024-03-12T17:18:45.894712+0000","last_active":"2024-03-12T17:18:46.857215+0000","last_peered":"2024-03-12T17:18:46.857215+0000","last_clean":"2024-03-12T17:18:46.857215+0000","last_became_active":"2024-03-12T17:18:45.894385+0000","last_became_peered":"2024-03-12T17:18:45.894385+0000","last_unstale":"2024-03-12T17:18:46.857215+0000","last_undegraded":"2024-03-12T17:18:46.857215+0000","last_fullsized":"2024-03-12T17:18:46.857215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:21:11.051648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.946712+0000","last_change":"2024-03-12T17:18:45.878221+0000","last_active":"2024-03-12T17:18:46.946712+0000","last_peered":"2024-03-12T17:18:46.946712+0000","last_clean":"2024-03-12T17:18:46.946712+0000","last_became_active":"2024-03-12T17:18:45.877953+0000","last_became_peered":"2024-03-12T17:18:45.877953+0000","last_unstale":"2024-03-12T17:18:46.946712+0000","last_undegraded":"2024-03-12T17:18:46.946712+0000","last_fullsized":"2024-03-12T17:18:46.946712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:45:08.333283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.859164+0000","last_change":"2024-03-12T17:18:45.900699+0000","last_active":"2024-03-12T17:18:46.859164+0000","last_peered":"2024-03-12T17:18:46.859164+0000","last_clean":"2024-03-12T17:18:46.859164+0000","last_became_active":"2024-03-12T17:18:45.900360+0000","last_became_peered":"2024-03-12T17:18:45.900360+0000","last_unstale":"2024-03-12T17:18:46.859164+0000","last_undegraded":"2024-03-12T17:18:46.859164+0000","last_fullsized":"2024-03-12T17:18:46.859164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:03:15.594609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.945139+0000","last_change":"2024-03-12T17:18:45.888417+0000","last_active":"2024-03-12T17:18:46.945139+0000","last_peered":"2024-03-12T17:18:46.945139+0000","last_clean":"2024-03-12T17:18:46.945139+0000","last_became_active":"2024-03-12T17:18:45.888207+0000","last_became_peered":"2024-03-12T17:18:45.888207+0000","last_unstale":"2024-03-12T17:18:46.945139+0000","last_undegraded":"2024-03-12T17:18:46.945139+0000","last_fullsized":"2024-03-12T17:18:46.945139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:42:22.352573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944829+0000","last_change":"2024-03-12T17:18:45.887868+0000","last_active":"2024-03-12T17:18:46.944829+0000","last_peered":"2024-03-12T17:18:46.944829+0000","last_clean":"2024-03-12T17:18:46.944829+0000","last_became_active":"2024-03-12T17:18:45.887591+0000","last_became_peered":"2024-03-12T17:18:45.887591+0000","last_unstale":"2024-03-12T17:18:46.944829+0000","last_undegraded":"2024-03-12T17:18:46.944829+0000","last_fullsized":"2024-03-12T17:18:46.944829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:54:36.712407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.946540+0000","last_change":"2024-03-12T17:18:45.891669+0000","last_active":"2024-03-12T17:18:46.946540+0000","last_peered":"2024-03-12T17:18:46.946540+0000","last_clean":"2024-03-12T17:18:46.946540+0000","last_became_active":"2024-03-12T17:18:45.891084+0000","last_became_peered":"2024-03-12T17:18:45.891084+0000","last_unstale":"2024-03-12T17:18:46.946540+0000","last_undegraded":"2024-03-12T17:18:46.946540+0000","last_fullsized":"2024-03-12T17:18:46.946540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:35:29.274137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947674+0000","last_change":"2024-03-12T17:18:45.885085+0000","last_active":"2024-03-12T17:18:46.947674+0000","last_peered":"2024-03-12T17:18:46.947674+0000","last_clean":"2024-03-12T17:18:46.947674+0000","last_became_active":"2024-03-12T17:18:45.884827+0000","last_became_peered":"2024-03-12T17:18:45.884827+0000","last_unstale":"2024-03-12T17:18:46.947674+0000","last_undegraded":"2024-03-12T17:18:46.947674+0000","last_fullsized":"2024-03-12T17:18:46.947674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:42:22.754824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.948191+0000","last_change":"2024-03-12T17:18:45.863039+0000","last_active":"2024-03-12T17:18:46.948191+0000","last_peered":"2024-03-12T17:18:46.948191+0000","last_clean":"2024-03-12T17:18:46.948191+0000","last_became_active":"2024-03-12T17:18:45.862844+0000","last_became_peered":"2024-03-12T17:18:45.862844+0000","last_unstale":"2024-03-12T17:18:46.948191+0000","last_undegraded":"2024-03-12T17:18:46.948191+0000","last_fullsized":"2024-03-12T17:18:46.948191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:23:06.063091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944953+0000","last_change":"2024-03-12T17:18:45.885881+0000","last_active":"2024-03-12T17:18:46.944953+0000","last_peered":"2024-03-12T17:18:46.944953+0000","last_clean":"2024-03-12T17:18:46.944953+0000","last_became_active":"2024-03-12T17:18:45.885609+0000","last_became_peered":"2024-03-12T17:18:45.885609+0000","last_unstale":"2024-03-12T17:18:46.944953+0000","last_undegraded":"2024-03-12T17:18:46.944953+0000","last_fullsized":"2024-03-12T17:18:46.944953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:45:08.333283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857415+0000","last_change":"2024-03-12T17:18:45.871970+0000","last_active":"2024-03-12T17:18:46.857415+0000","last_peered":"2024-03-12T17:18:46.857415+0000","last_clean":"2024-03-12T17:18:46.857415+0000","last_became_active":"2024-03-12T17:18:45.868988+0000","last_became_peered":"2024-03-12T17:18:45.868988+0000","last_unstale":"2024-03-12T17:18:46.857415+0000","last_undegraded":"2024-03-12T17:18:46.857415+0000","last_fullsized":"2024-03-12T17:18:46.857415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:10:29.099400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.859788+0000","last_change":"2024-03-12T17:18:45.899893+0000","last_active":"2024-03-12T17:18:46.859788+0000","last_peered":"2024-03-12T17:18:46.859788+0000","last_clean":"2024-03-12T17:18:46.859788+0000","last_became_active":"2024-03-12T17:18:45.899578+0000","last_became_peered":"2024-03-12T17:18:45.899578+0000","last_unstale":"2024-03-12T17:18:46.859788+0000","last_undegraded":"2024-03-12T17:18:46.859788+0000","last_fullsized":"2024-03-12T17:18:46.859788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:36:07.517436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.854019+0000","last_change":"2024-03-12T17:18:45.890825+0000","last_active":"2024-03-12T17:18:46.854019+0000","last_peered":"2024-03-12T17:18:46.854019+0000","last_clean":"2024-03-12T17:18:46.854019+0000","last_became_active":"2024-03-12T17:18:45.890508+0000","last_became_peered":"2024-03-12T17:18:45.890508+0000","last_unstale":"2024-03-12T17:18:46.854019+0000","last_undegraded":"2024-03-12T17:18:46.854019+0000","last_fullsized":"2024-03-12T17:18:46.854019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:54:36.712407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858619+0000","last_change":"2024-03-12T17:18:45.896948+0000","last_active":"2024-03-12T17:18:46.858619+0000","last_peered":"2024-03-12T17:18:46.858619+0000","last_clean":"2024-03-12T17:18:46.858619+0000","last_became_active":"2024-03-12T17:18:45.896617+0000","last_became_peered":"2024-03-12T17:18:45.896617+0000","last_unstale":"2024-03-12T17:18:46.858619+0000","last_undegraded":"2024-03-12T17:18:46.858619+0000","last_fullsized":"2024-03-12T17:18:46.858619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:34:35.638243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944492+0000","last_change":"2024-03-12T17:18:45.892628+0000","last_active":"2024-03-12T17:18:46.944492+0000","last_peered":"2024-03-12T17:18:46.944492+0000","last_clean":"2024-03-12T17:18:46.944492+0000","last_became_active":"2024-03-12T17:18:45.892322+0000","last_became_peered":"2024-03-12T17:18:45.892322+0000","last_unstale":"2024-03-12T17:18:46.944492+0000","last_undegraded":"2024-03-12T17:18:46.944492+0000","last_fullsized":"2024-03-12T17:18:46.944492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:48:29.172720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.946982+0000","last_change":"2024-03-12T17:18:45.891015+0000","last_active":"2024-03-12T17:18:46.946982+0000","last_peered":"2024-03-12T17:18:46.946982+0000","last_clean":"2024-03-12T17:18:46.946982+0000","last_became_active":"2024-03-12T17:18:45.890711+0000","last_became_peered":"2024-03-12T17:18:45.890711+0000","last_unstale":"2024-03-12T17:18:46.946982+0000","last_undegraded":"2024-03-12T17:18:46.946982+0000","last_fullsized":"2024-03-12T17:18:46.946982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:45:08.333283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857744+0000","last_change":"2024-03-12T17:18:45.893500+0000","last_active":"2024-03-12T17:18:46.857744+0000","last_peered":"2024-03-12T17:18:46.857744+0000","last_clean":"2024-03-12T17:18:46.857744+0000","last_became_active":"2024-03-12T17:18:45.893188+0000","last_became_peered":"2024-03-12T17:18:45.893188+0000","last_unstale":"2024-03-12T17:18:46.857744+0000","last_undegraded":"2024-03-12T17:18:46.857744+0000","last_fullsized":"2024-03-12T17:18:46.857744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:34:35.638243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947702+0000","last_change":"2024-03-12T17:18:45.890189+0000","last_active":"2024-03-12T17:18:46.947702+0000","last_peered":"2024-03-12T17:18:46.947702+0000","last_clean":"2024-03-12T17:18:46.947702+0000","last_became_active":"2024-03-12T17:18:45.889243+0000","last_became_peered":"2024-03-12T17:18:45.889243+0000","last_unstale":"2024-03-12T17:18:46.947702+0000","last_undegraded":"2024-03-12T17:18:46.947702+0000","last_fullsized":"2024-03-12T17:18:46.947702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:23:06.063091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.856808+0000","last_change":"2024-03-12T17:18:45.879908+0000","last_active":"2024-03-12T17:18:46.856808+0000","last_peered":"2024-03-12T17:18:46.856808+0000","last_clean":"2024-03-12T17:18:46.856808+0000","last_became_active":"2024-03-12T17:18:45.879061+0000","last_became_peered":"2024-03-12T17:18:45.879061+0000","last_unstale":"2024-03-12T17:18:46.856808+0000","last_undegraded":"2024-03-12T17:18:46.856808+0000","last_fullsized":"2024-03-12T17:18:46.856808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:21:11.051648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947866+0000","last_change":"2024-03-12T17:18:45.876848+0000","last_active":"2024-03-12T17:18:46.947866+0000","last_peered":"2024-03-12T17:18:46.947866+0000","last_clean":"2024-03-12T17:18:46.947866+0000","last_became_active":"2024-03-12T17:18:45.876658+0000","last_became_peered":"2024-03-12T17:18:45.876658+0000","last_unstale":"2024-03-12T17:18:46.947866+0000","last_undegraded":"2024-03-12T17:18:46.947866+0000","last_fullsized":"2024-03-12T17:18:46.947866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:15:10.118237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.945388+0000","last_change":"2024-03-12T17:18:45.897934+0000","last_active":"2024-03-12T17:18:46.945388+0000","last_peered":"2024-03-12T17:18:46.945388+0000","last_clean":"2024-03-12T17:18:46.945388+0000","last_became_active":"2024-03-12T17:18:45.897632+0000","last_became_peered":"2024-03-12T17:18:45.897632+0000","last_unstale":"2024-03-12T17:18:46.945388+0000","last_undegraded":"2024-03-12T17:18:46.945388+0000","last_fullsized":"2024-03-12T17:18:46.945388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:23:06.063091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.945707+0000","last_change":"2024-03-12T17:18:45.882068+0000","last_active":"2024-03-12T17:18:46.945707+0000","last_peered":"2024-03-12T17:18:46.945707+0000","last_clean":"2024-03-12T17:18:46.945707+0000","last_became_active":"2024-03-12T17:18:45.881609+0000","last_became_peered":"2024-03-12T17:18:45.881609+0000","last_unstale":"2024-03-12T17:18:46.945707+0000","last_undegraded":"2024-03-12T17:18:46.945707+0000","last_fullsized":"2024-03-12T17:18:46.945707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:42:22.754824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947829+0000","last_change":"2024-03-12T17:18:45.875604+0000","last_active":"2024-03-12T17:18:46.947829+0000","last_peered":"2024-03-12T17:18:46.947829+0000","last_clean":"2024-03-12T17:18:46.947829+0000","last_became_active":"2024-03-12T17:18:45.875300+0000","last_became_peered":"2024-03-12T17:18:45.875300+0000","last_unstale":"2024-03-12T17:18:46.947829+0000","last_undegraded":"2024-03-12T17:18:46.947829+0000","last_fullsized":"2024-03-12T17:18:46.947829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:24:13.883507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947088+0000","last_change":"2024-03-12T17:18:45.879642+0000","last_active":"2024-03-12T17:18:46.947088+0000","last_peered":"2024-03-12T17:18:46.947088+0000","last_clean":"2024-03-12T17:18:46.947088+0000","last_became_active":"2024-03-12T17:18:45.879390+0000","last_became_peered":"2024-03-12T17:18:45.879390+0000","last_unstale":"2024-03-12T17:18:46.947088+0000","last_undegraded":"2024-03-12T17:18:46.947088+0000","last_fullsized":"2024-03-12T17:18:46.947088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:25:10.176932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857915+0000","last_change":"2024-03-12T17:18:45.878596+0000","last_active":"2024-03-12T17:18:46.857915+0000","last_peered":"2024-03-12T17:18:46.857915+0000","last_clean":"2024-03-12T17:18:46.857915+0000","last_became_active":"2024-03-12T17:18:45.878223+0000","last_became_peered":"2024-03-12T17:18:45.878223+0000","last_unstale":"2024-03-12T17:18:46.857915+0000","last_undegraded":"2024-03-12T17:18:46.857915+0000","last_fullsized":"2024-03-12T17:18:46.857915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:42:22.754824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.853503+0000","last_change":"2024-03-12T17:18:45.869021+0000","last_active":"2024-03-12T17:18:46.853503+0000","last_peered":"2024-03-12T17:18:46.853503+0000","last_clean":"2024-03-12T17:18:46.853503+0000","last_became_active":"2024-03-12T17:18:45.868790+0000","last_became_peered":"2024-03-12T17:18:45.868790+0000","last_unstale":"2024-03-12T17:18:46.853503+0000","last_undegraded":"2024-03-12T17:18:46.853503+0000","last_fullsized":"2024-03-12T17:18:46.853503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:20:31.313923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944482+0000","last_change":"2024-03-12T17:18:45.886248+0000","last_active":"2024-03-12T17:18:46.944482+0000","last_peered":"2024-03-12T17:18:46.944482+0000","last_clean":"2024-03-12T17:18:46.944482+0000","last_became_active":"2024-03-12T17:18:45.885636+0000","last_became_peered":"2024-03-12T17:18:45.885636+0000","last_unstale":"2024-03-12T17:18:46.944482+0000","last_undegraded":"2024-03-12T17:18:46.944482+0000","last_fullsized":"2024-03-12T17:18:46.944482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:10:25.044042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.945966+0000","last_change":"2024-03-12T17:18:45.878245+0000","last_active":"2024-03-12T17:18:46.945966+0000","last_peered":"2024-03-12T17:18:46.945966+0000","last_clean":"2024-03-12T17:18:46.945966+0000","last_became_active":"2024-03-12T17:18:45.874458+0000","last_became_peered":"2024-03-12T17:18:45.874458+0000","last_unstale":"2024-03-12T17:18:46.945966+0000","last_undegraded":"2024-03-12T17:18:46.945966+0000","last_fullsized":"2024-03-12T17:18:46.945966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:32:01.111631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947680+0000","last_change":"2024-03-12T17:18:45.375951+0000","last_active":"2024-03-12T17:18:46.947680+0000","last_peered":"2024-03-12T17:18:46.947680+0000","last_clean":"2024-03-12T17:18:46.947680+0000","last_became_active":"2024-03-12T17:18:45.375616+0000","last_became_peered":"2024-03-12T17:18:45.375616+0000","last_unstale":"2024-03-12T17:18:46.947680+0000","last_undegraded":"2024-03-12T17:18:46.947680+0000","last_fullsized":"2024-03-12T17:18:46.947680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:07:53.768009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947190+0000","last_change":"2024-03-12T17:18:45.883654+0000","last_active":"2024-03-12T17:18:46.947190+0000","last_peered":"2024-03-12T17:18:46.947190+0000","last_clean":"2024-03-12T17:18:46.947190+0000","last_became_active":"2024-03-12T17:18:45.883247+0000","last_became_peered":"2024-03-12T17:18:45.883247+0000","last_unstale":"2024-03-12T17:18:46.947190+0000","last_undegraded":"2024-03-12T17:18:46.947190+0000","last_fullsized":"2024-03-12T17:18:46.947190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:24:13.883507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944269+0000","last_change":"2024-03-12T17:18:45.377143+0000","last_active":"2024-03-12T17:18:46.944269+0000","last_peered":"2024-03-12T17:18:46.944269+0000","last_clean":"2024-03-12T17:18:46.944269+0000","last_became_active":"2024-03-12T17:18:45.376587+0000","last_became_peered":"2024-03-12T17:18:45.376587+0000","last_unstale":"2024-03-12T17:18:46.944269+0000","last_undegraded":"2024-03-12T17:18:46.944269+0000","last_fullsized":"2024-03-12T17:18:46.944269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:12:48.811874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947685+0000","last_change":"2024-03-12T17:18:45.368141+0000","last_active":"2024-03-12T17:18:46.947685+0000","last_peered":"2024-03-12T17:18:46.947685+0000","last_clean":"2024-03-12T17:18:46.947685+0000","last_became_active":"2024-03-12T17:18:45.367922+0000","last_became_peered":"2024-03-12T17:18:45.367922+0000","last_unstale":"2024-03-12T17:18:46.947685+0000","last_undegraded":"2024-03-12T17:18:46.947685+0000","last_fullsized":"2024-03-12T17:18:46.947685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:23:50.392288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.946810+0000","last_change":"2024-03-12T17:18:45.864983+0000","last_active":"2024-03-12T17:18:46.946810+0000","last_peered":"2024-03-12T17:18:46.946810+0000","last_clean":"2024-03-12T17:18:46.946810+0000","last_became_active":"2024-03-12T17:18:45.864648+0000","last_became_peered":"2024-03-12T17:18:45.864648+0000","last_unstale":"2024-03-12T17:18:46.946810+0000","last_undegraded":"2024-03-12T17:18:46.946810+0000","last_fullsized":"2024-03-12T17:18:46.946810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:25:10.176932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857020+0000","last_change":"2024-03-12T17:18:45.365029+0000","last_active":"2024-03-12T17:18:46.857020+0000","last_peered":"2024-03-12T17:18:46.857020+0000","last_clean":"2024-03-12T17:18:46.857020+0000","last_became_active":"2024-03-12T17:18:45.364621+0000","last_became_peered":"2024-03-12T17:18:45.364621+0000","last_unstale":"2024-03-12T17:18:46.857020+0000","last_undegraded":"2024-03-12T17:18:46.857020+0000","last_fullsized":"2024-03-12T17:18:46.857020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:01:22.087219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944672+0000","last_change":"2024-03-12T17:18:45.879492+0000","last_active":"2024-03-12T17:18:46.944672+0000","last_peered":"2024-03-12T17:18:46.944672+0000","last_clean":"2024-03-12T17:18:46.944672+0000","last_became_active":"2024-03-12T17:18:45.879232+0000","last_became_peered":"2024-03-12T17:18:45.879232+0000","last_unstale":"2024-03-12T17:18:46.944672+0000","last_undegraded":"2024-03-12T17:18:46.944672+0000","last_fullsized":"2024-03-12T17:18:46.944672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:10:29.099400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.945211+0000","last_change":"2024-03-12T17:18:45.382641+0000","last_active":"2024-03-12T17:18:46.945211+0000","last_peered":"2024-03-12T17:18:46.945211+0000","last_clean":"2024-03-12T17:18:46.945211+0000","last_became_active":"2024-03-12T17:18:45.381871+0000","last_became_peered":"2024-03-12T17:18:45.381871+0000","last_unstale":"2024-03-12T17:18:46.945211+0000","last_undegraded":"2024-03-12T17:18:46.945211+0000","last_fullsized":"2024-03-12T17:18:46.945211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:07:53.768009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.859233+0000","last_change":"2024-03-12T17:18:45.893641+0000","last_active":"2024-03-12T17:18:46.859233+0000","last_peered":"2024-03-12T17:18:46.859233+0000","last_clean":"2024-03-12T17:18:46.859233+0000","last_became_active":"2024-03-12T17:18:45.893285+0000","last_became_peered":"2024-03-12T17:18:45.893285+0000","last_unstale":"2024-03-12T17:18:46.859233+0000","last_undegraded":"2024-03-12T17:18:46.859233+0000","last_fullsized":"2024-03-12T17:18:46.859233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:15:10.118237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.859238+0000","last_change":"2024-03-12T17:18:45.376164+0000","last_active":"2024-03-12T17:18:46.859238+0000","last_peered":"2024-03-12T17:18:46.859238+0000","last_clean":"2024-03-12T17:18:46.859238+0000","last_became_active":"2024-03-12T17:18:45.374280+0000","last_became_peered":"2024-03-12T17:18:45.374280+0000","last_unstale":"2024-03-12T17:18:46.859238+0000","last_undegraded":"2024-03-12T17:18:46.859238+0000","last_fullsized":"2024-03-12T17:18:46.859238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:23:50.392288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.949144+0000","last_change":"2024-03-12T17:18:45.878892+0000","last_active":"2024-03-12T17:18:46.949144+0000","last_peered":"2024-03-12T17:18:46.949144+0000","last_clean":"2024-03-12T17:18:46.949144+0000","last_became_active":"2024-03-12T17:18:45.878651+0000","last_became_peered":"2024-03-12T17:18:45.878651+0000","last_unstale":"2024-03-12T17:18:46.949144+0000","last_undegraded":"2024-03-12T17:18:46.949144+0000","last_fullsized":"2024-03-12T17:18:46.949144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:10:25.044042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.945945+0000","last_change":"2024-03-12T17:18:45.382325+0000","last_active":"2024-03-12T17:18:46.945945+0000","last_peered":"2024-03-12T17:18:46.945945+0000","last_clean":"2024-03-12T17:18:46.945945+0000","last_became_active":"2024-03-12T17:18:45.382056+0000","last_became_peered":"2024-03-12T17:18:45.382056+0000","last_unstale":"2024-03-12T17:18:46.945945+0000","last_undegraded":"2024-03-12T17:18:46.945945+0000","last_fullsized":"2024-03-12T17:18:46.945945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:35:28.129493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.946639+0000","last_change":"2024-03-12T17:18:45.895888+0000","last_active":"2024-03-12T17:18:46.946639+0000","last_peered":"2024-03-12T17:18:46.946639+0000","last_clean":"2024-03-12T17:18:46.946639+0000","last_became_active":"2024-03-12T17:18:45.895314+0000","last_became_peered":"2024-03-12T17:18:45.895314+0000","last_unstale":"2024-03-12T17:18:46.946639+0000","last_undegraded":"2024-03-12T17:18:46.946639+0000","last_fullsized":"2024-03-12T17:18:46.946639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:28:48.535350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944549+0000","last_change":"2024-03-12T17:18:45.381040+0000","last_active":"2024-03-12T17:18:46.944549+0000","last_peered":"2024-03-12T17:18:46.944549+0000","last_clean":"2024-03-12T17:18:46.944549+0000","last_became_active":"2024-03-12T17:18:45.380400+0000","last_became_peered":"2024-03-12T17:18:45.380400+0000","last_unstale":"2024-03-12T17:18:46.944549+0000","last_undegraded":"2024-03-12T17:18:46.944549+0000","last_fullsized":"2024-03-12T17:18:46.944549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:48:10.442245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857838+0000","last_change":"2024-03-12T17:18:45.896661+0000","last_active":"2024-03-12T17:18:46.857838+0000","last_peered":"2024-03-12T17:18:46.857838+0000","last_clean":"2024-03-12T17:18:46.857838+0000","last_became_active":"2024-03-12T17:18:45.896381+0000","last_became_peered":"2024-03-12T17:18:45.896381+0000","last_unstale":"2024-03-12T17:18:46.857838+0000","last_undegraded":"2024-03-12T17:18:46.857838+0000","last_fullsized":"2024-03-12T17:18:46.857838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:17:13.547169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947292+0000","last_change":"2024-03-12T17:18:45.365459+0000","last_active":"2024-03-12T17:18:46.947292+0000","last_peered":"2024-03-12T17:18:46.947292+0000","last_clean":"2024-03-12T17:18:46.947292+0000","last_became_active":"2024-03-12T17:18:45.365123+0000","last_became_peered":"2024-03-12T17:18:45.365123+0000","last_unstale":"2024-03-12T17:18:46.947292+0000","last_undegraded":"2024-03-12T17:18:46.947292+0000","last_fullsized":"2024-03-12T17:18:46.947292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:12:45.021044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.948430+0000","last_change":"2024-03-12T17:18:45.888078+0000","last_active":"2024-03-12T17:18:46.948430+0000","last_peered":"2024-03-12T17:18:46.948430+0000","last_clean":"2024-03-12T17:18:46.948430+0000","last_became_active":"2024-03-12T17:18:45.887793+0000","last_became_peered":"2024-03-12T17:18:45.887793+0000","last_unstale":"2024-03-12T17:18:46.948430+0000","last_undegraded":"2024-03-12T17:18:46.948430+0000","last_fullsized":"2024-03-12T17:18:46.948430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:17:33.168888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858044+0000","last_change":"2024-03-12T17:18:45.378988+0000","last_active":"2024-03-12T17:18:46.858044+0000","last_peered":"2024-03-12T17:18:46.858044+0000","last_clean":"2024-03-12T17:18:46.858044+0000","last_became_active":"2024-03-12T17:18:45.378697+0000","last_became_peered":"2024-03-12T17:18:45.378697+0000","last_unstale":"2024-03-12T17:18:46.858044+0000","last_undegraded":"2024-03-12T17:18:46.858044+0000","last_fullsized":"2024-03-12T17:18:46.858044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:07:53.768009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857986+0000","last_change":"2024-03-12T17:18:45.899356+0000","last_active":"2024-03-12T17:18:46.857986+0000","last_peered":"2024-03-12T17:18:46.857986+0000","last_clean":"2024-03-12T17:18:46.857986+0000","last_became_active":"2024-03-12T17:18:45.899010+0000","last_became_peered":"2024-03-12T17:18:45.899010+0000","last_unstale":"2024-03-12T17:18:46.857986+0000","last_undegraded":"2024-03-12T17:18:46.857986+0000","last_fullsized":"2024-03-12T17:18:46.857986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:05:09.374271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944237+0000","last_change":"2024-03-12T17:18:45.376515+0000","last_active":"2024-03-12T17:18:46.944237+0000","last_peered":"2024-03-12T17:18:46.944237+0000","last_clean":"2024-03-12T17:18:46.944237+0000","last_became_active":"2024-03-12T17:18:45.376229+0000","last_became_peered":"2024-03-12T17:18:45.376229+0000","last_unstale":"2024-03-12T17:18:46.944237+0000","last_undegraded":"2024-03-12T17:18:46.944237+0000","last_fullsized":"2024-03-12T17:18:46.944237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:33:40.644061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944239+0000","last_change":"2024-03-12T17:18:45.885557+0000","last_active":"2024-03-12T17:18:46.944239+0000","last_peered":"2024-03-12T17:18:46.944239+0000","last_clean":"2024-03-12T17:18:46.944239+0000","last_became_active":"2024-03-12T17:18:45.885214+0000","last_became_peered":"2024-03-12T17:18:45.885214+0000","last_unstale":"2024-03-12T17:18:46.944239+0000","last_undegraded":"2024-03-12T17:18:46.944239+0000","last_fullsized":"2024-03-12T17:18:46.944239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:56:38.943678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.853537+0000","last_change":"2024-03-12T17:18:45.368912+0000","last_active":"2024-03-12T17:18:46.853537+0000","last_peered":"2024-03-12T17:18:46.853537+0000","last_clean":"2024-03-12T17:18:46.853537+0000","last_became_active":"2024-03-12T17:18:45.368576+0000","last_became_peered":"2024-03-12T17:18:45.368576+0000","last_unstale":"2024-03-12T17:18:46.853537+0000","last_undegraded":"2024-03-12T17:18:46.853537+0000","last_fullsized":"2024-03-12T17:18:46.853537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:23:50.392288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857414+0000","last_change":"2024-03-12T17:18:45.898975+0000","last_active":"2024-03-12T17:18:46.857414+0000","last_peered":"2024-03-12T17:18:46.857414+0000","last_clean":"2024-03-12T17:18:46.857414+0000","last_became_active":"2024-03-12T17:18:45.898704+0000","last_became_peered":"2024-03-12T17:18:45.898704+0000","last_unstale":"2024-03-12T17:18:46.857414+0000","last_undegraded":"2024-03-12T17:18:46.857414+0000","last_fullsized":"2024-03-12T17:18:46.857414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:42:22.754824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.946552+0000","last_change":"2024-03-12T17:18:45.366523+0000","last_active":"2024-03-12T17:18:46.946552+0000","last_peered":"2024-03-12T17:18:46.946552+0000","last_clean":"2024-03-12T17:18:46.946552+0000","last_became_active":"2024-03-12T17:18:45.366135+0000","last_became_peered":"2024-03-12T17:18:45.366135+0000","last_unstale":"2024-03-12T17:18:46.946552+0000","last_undegraded":"2024-03-12T17:18:46.946552+0000","last_fullsized":"2024-03-12T17:18:46.946552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T00:52:36.901043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858186+0000","last_change":"2024-03-12T17:18:45.898571+0000","last_active":"2024-03-12T17:18:46.858186+0000","last_peered":"2024-03-12T17:18:46.858186+0000","last_clean":"2024-03-12T17:18:46.858186+0000","last_became_active":"2024-03-12T17:18:45.898306+0000","last_became_peered":"2024-03-12T17:18:45.898306+0000","last_unstale":"2024-03-12T17:18:46.858186+0000","last_undegraded":"2024-03-12T17:18:46.858186+0000","last_fullsized":"2024-03-12T17:18:46.858186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:15:10.118237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.854032+0000","last_change":"2024-03-12T17:18:45.373982+0000","last_active":"2024-03-12T17:18:46.854032+0000","last_peered":"2024-03-12T17:18:46.854032+0000","last_clean":"2024-03-12T17:18:46.854032+0000","last_became_active":"2024-03-12T17:18:45.373647+0000","last_became_peered":"2024-03-12T17:18:45.373647+0000","last_unstale":"2024-03-12T17:18:46.854032+0000","last_undegraded":"2024-03-12T17:18:46.854032+0000","last_fullsized":"2024-03-12T17:18:46.854032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:07:53.768009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.859231+0000","last_change":"2024-03-12T17:18:45.903054+0000","last_active":"2024-03-12T17:18:46.859231+0000","last_peered":"2024-03-12T17:18:46.859231+0000","last_clean":"2024-03-12T17:18:46.859231+0000","last_became_active":"2024-03-12T17:18:45.902762+0000","last_became_peered":"2024-03-12T17:18:45.902762+0000","last_unstale":"2024-03-12T17:18:46.859231+0000","last_undegraded":"2024-03-12T17:18:46.859231+0000","last_fullsized":"2024-03-12T17:18:46.859231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:41:17.395467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.946192+0000","last_change":"2024-03-12T17:18:45.377581+0000","last_active":"2024-03-12T17:18:46.946192+0000","last_peered":"2024-03-12T17:18:46.946192+0000","last_clean":"2024-03-12T17:18:46.946192+0000","last_became_active":"2024-03-12T17:18:45.373688+0000","last_became_peered":"2024-03-12T17:18:45.373688+0000","last_unstale":"2024-03-12T17:18:46.946192+0000","last_undegraded":"2024-03-12T17:18:46.946192+0000","last_fullsized":"2024-03-12T17:18:46.946192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:31:59.966986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858775+0000","last_change":"2024-03-12T17:18:45.879835+0000","last_active":"2024-03-12T17:18:46.858775+0000","last_peered":"2024-03-12T17:18:46.858775+0000","last_clean":"2024-03-12T17:18:46.858775+0000","last_became_active":"2024-03-12T17:18:45.879498+0000","last_became_peered":"2024-03-12T17:18:45.879498+0000","last_unstale":"2024-03-12T17:18:46.858775+0000","last_undegraded":"2024-03-12T17:18:46.858775+0000","last_fullsized":"2024-03-12T17:18:46.858775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:41:17.395467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.853981+0000","last_change":"2024-03-12T17:18:45.376596+0000","last_active":"2024-03-12T17:18:46.853981+0000","last_peered":"2024-03-12T17:18:46.853981+0000","last_clean":"2024-03-12T17:18:46.853981+0000","last_became_active":"2024-03-12T17:18:45.376256+0000","last_became_peered":"2024-03-12T17:18:45.376256+0000","last_unstale":"2024-03-12T17:18:46.853981+0000","last_undegraded":"2024-03-12T17:18:46.853981+0000","last_fullsized":"2024-03-12T17:18:46.853981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:29:41.118150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858115+0000","last_change":"2024-03-12T17:18:45.900428+0000","last_active":"2024-03-12T17:18:46.858115+0000","last_peered":"2024-03-12T17:18:46.858115+0000","last_clean":"2024-03-12T17:18:46.858115+0000","last_became_active":"2024-03-12T17:18:45.900179+0000","last_became_peered":"2024-03-12T17:18:45.900179+0000","last_unstale":"2024-03-12T17:18:46.858115+0000","last_undegraded":"2024-03-12T17:18:46.858115+0000","last_fullsized":"2024-03-12T17:18:46.858115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:38:05.092463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-12T17:18:45.881910+0000","last_change":"2024-03-12T17:18:41.331756+0000","last_active":"2024-03-12T17:18:45.881910+0000","last_peered":"2024-03-12T17:18:45.881910+0000","last_clean":"2024-03-12T17:18:45.881910+0000","last_became_active":"2024-03-12T17:18:41.329237+0000","last_became_peered":"2024-03-12T17:18:41.329237+0000","last_unstale":"2024-03-12T17:18:45.881910+0000","last_undegraded":"2024-03-12T17:18:45.881910+0000","last_fullsized":"2024-03-12T17:18:45.881910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:40.152422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:40.152422+0000","last_clean_scrub_stamp":"2024-03-12T17:18:40.152422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:35:43.664403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857578+0000","last_change":"2024-03-12T17:18:45.367331+0000","last_active":"2024-03-12T17:18:46.857578+0000","last_peered":"2024-03-12T17:18:46.857578+0000","last_clean":"2024-03-12T17:18:46.857578+0000","last_became_active":"2024-03-12T17:18:45.367018+0000","last_became_peered":"2024-03-12T17:18:45.367018+0000","last_unstale":"2024-03-12T17:18:46.857578+0000","last_undegraded":"2024-03-12T17:18:46.857578+0000","last_fullsized":"2024-03-12T17:18:46.857578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:12:48.811874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947416+0000","last_change":"2024-03-12T17:18:45.870828+0000","last_active":"2024-03-12T17:18:46.947416+0000","last_peered":"2024-03-12T17:18:46.947416+0000","last_clean":"2024-03-12T17:18:46.947416+0000","last_became_active":"2024-03-12T17:18:45.870373+0000","last_became_peered":"2024-03-12T17:18:45.870373+0000","last_unstale":"2024-03-12T17:18:46.947416+0000","last_undegraded":"2024-03-12T17:18:46.947416+0000","last_fullsized":"2024-03-12T17:18:46.947416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:17:33.168888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.856696+0000","last_change":"2024-03-12T17:18:45.379833+0000","last_active":"2024-03-12T17:18:46.856696+0000","last_peered":"2024-03-12T17:18:46.856696+0000","last_clean":"2024-03-12T17:18:46.856696+0000","last_became_active":"2024-03-12T17:18:45.379554+0000","last_became_peered":"2024-03-12T17:18:45.379554+0000","last_unstale":"2024-03-12T17:18:46.856696+0000","last_undegraded":"2024-03-12T17:18:46.856696+0000","last_fullsized":"2024-03-12T17:18:46.856696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:23:50.392288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.949504+0000","last_change":"2024-03-12T17:18:45.885222+0000","last_active":"2024-03-12T17:18:46.949504+0000","last_peered":"2024-03-12T17:18:46.949504+0000","last_clean":"2024-03-12T17:18:46.949504+0000","last_became_active":"2024-03-12T17:18:45.883636+0000","last_became_peered":"2024-03-12T17:18:45.883636+0000","last_unstale":"2024-03-12T17:18:46.949504+0000","last_undegraded":"2024-03-12T17:18:46.949504+0000","last_fullsized":"2024-03-12T17:18:46.949504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:54:36.712407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.853528+0000","last_change":"2024-03-12T17:18:45.364610+0000","last_active":"2024-03-12T17:18:46.853528+0000","last_peered":"2024-03-12T17:18:46.853528+0000","last_clean":"2024-03-12T17:18:46.853528+0000","last_became_active":"2024-03-12T17:18:45.364255+0000","last_became_peered":"2024-03-12T17:18:45.364255+0000","last_unstale":"2024-03-12T17:18:46.853528+0000","last_undegraded":"2024-03-12T17:18:46.853528+0000","last_fullsized":"2024-03-12T17:18:46.853528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:12:48.811874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944834+0000","last_change":"2024-03-12T17:18:45.857097+0000","last_active":"2024-03-12T17:18:46.944834+0000","last_peered":"2024-03-12T17:18:46.944834+0000","last_clean":"2024-03-12T17:18:46.944834+0000","last_became_active":"2024-03-12T17:18:45.856205+0000","last_became_peered":"2024-03-12T17:18:45.856205+0000","last_unstale":"2024-03-12T17:18:46.944834+0000","last_undegraded":"2024-03-12T17:18:46.944834+0000","last_fullsized":"2024-03-12T17:18:46.944834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:24:13.883507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858257+0000","last_change":"2024-03-12T17:18:45.371153+0000","last_active":"2024-03-12T17:18:46.858257+0000","last_peered":"2024-03-12T17:18:46.858257+0000","last_clean":"2024-03-12T17:18:46.858257+0000","last_became_active":"2024-03-12T17:18:45.369025+0000","last_became_peered":"2024-03-12T17:18:45.369025+0000","last_unstale":"2024-03-12T17:18:46.858257+0000","last_undegraded":"2024-03-12T17:18:46.858257+0000","last_fullsized":"2024-03-12T17:18:46.858257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:20:41.753321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.946051+0000","last_change":"2024-03-12T17:18:45.888296+0000","last_active":"2024-03-12T17:18:46.946051+0000","last_peered":"2024-03-12T17:18:46.946051+0000","last_clean":"2024-03-12T17:18:46.946051+0000","last_became_active":"2024-03-12T17:18:45.886034+0000","last_became_peered":"2024-03-12T17:18:45.886034+0000","last_unstale":"2024-03-12T17:18:46.946051+0000","last_undegraded":"2024-03-12T17:18:46.946051+0000","last_fullsized":"2024-03-12T17:18:46.946051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:35:49.382412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944808+0000","last_change":"2024-03-12T17:18:45.373944+0000","last_active":"2024-03-12T17:18:46.944808+0000","last_peered":"2024-03-12T17:18:46.944808+0000","last_clean":"2024-03-12T17:18:46.944808+0000","last_became_active":"2024-03-12T17:18:45.372641+0000","last_became_peered":"2024-03-12T17:18:45.372641+0000","last_unstale":"2024-03-12T17:18:46.944808+0000","last_undegraded":"2024-03-12T17:18:46.944808+0000","last_fullsized":"2024-03-12T17:18:46.944808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:29:41.118150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858537+0000","last_change":"2024-03-12T17:18:45.881154+0000","last_active":"2024-03-12T17:18:46.858537+0000","last_peered":"2024-03-12T17:18:46.858537+0000","last_clean":"2024-03-12T17:18:46.858537+0000","last_became_active":"2024-03-12T17:18:45.880178+0000","last_became_peered":"2024-03-12T17:18:45.880178+0000","last_unstale":"2024-03-12T17:18:46.858537+0000","last_undegraded":"2024-03-12T17:18:46.858537+0000","last_fullsized":"2024-03-12T17:18:46.858537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:17:33.168888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858695+0000","last_change":"2024-03-12T17:18:45.384960+0000","last_active":"2024-03-12T17:18:46.858695+0000","last_peered":"2024-03-12T17:18:46.858695+0000","last_clean":"2024-03-12T17:18:46.858695+0000","last_became_active":"2024-03-12T17:18:45.384751+0000","last_became_peered":"2024-03-12T17:18:45.384751+0000","last_unstale":"2024-03-12T17:18:46.858695+0000","last_undegraded":"2024-03-12T17:18:46.858695+0000","last_fullsized":"2024-03-12T17:18:46.858695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:35:48.237768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944647+0000","last_change":"2024-03-12T17:18:45.856343+0000","last_active":"2024-03-12T17:18:46.944647+0000","last_peered":"2024-03-12T17:18:46.944647+0000","last_clean":"2024-03-12T17:18:46.944647+0000","last_became_active":"2024-03-12T17:18:45.856040+0000","last_became_peered":"2024-03-12T17:18:45.856040+0000","last_unstale":"2024-03-12T17:18:46.944647+0000","last_undegraded":"2024-03-12T17:18:46.944647+0000","last_fullsized":"2024-03-12T17:18:46.944647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:23:06.063091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944717+0000","last_change":"2024-03-12T17:18:45.378083+0000","last_active":"2024-03-12T17:18:46.944717+0000","last_peered":"2024-03-12T17:18:46.944717+0000","last_clean":"2024-03-12T17:18:46.944717+0000","last_became_active":"2024-03-12T17:18:45.377137+0000","last_became_peered":"2024-03-12T17:18:45.377137+0000","last_unstale":"2024-03-12T17:18:46.944717+0000","last_undegraded":"2024-03-12T17:18:46.944717+0000","last_fullsized":"2024-03-12T17:18:46.944717+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:28:47.390706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.948100+0000","last_change":"2024-03-12T17:18:45.889958+0000","last_active":"2024-03-12T17:18:46.948100+0000","last_peered":"2024-03-12T17:18:46.948100+0000","last_clean":"2024-03-12T17:18:46.948100+0000","last_became_active":"2024-03-12T17:18:45.889667+0000","last_became_peered":"2024-03-12T17:18:45.889667+0000","last_unstale":"2024-03-12T17:18:46.948100+0000","last_undegraded":"2024-03-12T17:18:46.948100+0000","last_fullsized":"2024-03-12T17:18:46.948100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:21:11.051648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.945277+0000","last_change":"2024-03-12T17:18:45.382531+0000","last_active":"2024-03-12T17:18:46.945277+0000","last_peered":"2024-03-12T17:18:46.945277+0000","last_clean":"2024-03-12T17:18:46.945277+0000","last_became_active":"2024-03-12T17:18:45.381932+0000","last_became_peered":"2024-03-12T17:18:45.381932+0000","last_unstale":"2024-03-12T17:18:46.945277+0000","last_undegraded":"2024-03-12T17:18:46.945277+0000","last_fullsized":"2024-03-12T17:18:46.945277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:20:41.753321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.948605+0000","last_change":"2024-03-12T17:18:45.861290+0000","last_active":"2024-03-12T17:18:46.948605+0000","last_peered":"2024-03-12T17:18:46.948605+0000","last_clean":"2024-03-12T17:18:46.948605+0000","last_became_active":"2024-03-12T17:18:45.860724+0000","last_became_peered":"2024-03-12T17:18:45.860724+0000","last_unstale":"2024-03-12T17:18:46.948605+0000","last_undegraded":"2024-03-12T17:18:46.948605+0000","last_fullsized":"2024-03-12T17:18:46.948605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:48:29.172720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.856696+0000","last_change":"2024-03-12T17:18:45.384765+0000","last_active":"2024-03-12T17:18:46.856696+0000","last_peered":"2024-03-12T17:18:46.856696+0000","last_clean":"2024-03-12T17:18:46.856696+0000","last_became_active":"2024-03-12T17:18:45.384463+0000","last_became_peered":"2024-03-12T17:18:45.384463+0000","last_unstale":"2024-03-12T17:18:46.856696+0000","last_undegraded":"2024-03-12T17:18:46.856696+0000","last_fullsized":"2024-03-12T17:18:46.856696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:29:41.118150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.946022+0000","last_change":"2024-03-12T17:18:45.883260+0000","last_active":"2024-03-12T17:18:46.946022+0000","last_peered":"2024-03-12T17:18:46.946022+0000","last_clean":"2024-03-12T17:18:46.946022+0000","last_became_active":"2024-03-12T17:18:45.882864+0000","last_became_peered":"2024-03-12T17:18:45.882864+0000","last_unstale":"2024-03-12T17:18:46.946022+0000","last_undegraded":"2024-03-12T17:18:46.946022+0000","last_fullsized":"2024-03-12T17:18:46.946022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:07:54.912653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.945167+0000","last_change":"2024-03-12T17:18:45.380347+0000","last_active":"2024-03-12T17:18:46.945167+0000","last_peered":"2024-03-12T17:18:46.945167+0000","last_clean":"2024-03-12T17:18:46.945167+0000","last_became_active":"2024-03-12T17:18:45.378500+0000","last_became_peered":"2024-03-12T17:18:45.378500+0000","last_unstale":"2024-03-12T17:18:46.945167+0000","last_undegraded":"2024-03-12T17:18:46.945167+0000","last_fullsized":"2024-03-12T17:18:46.945167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:52:30.297945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.946901+0000","last_change":"2024-03-12T17:18:45.876651+0000","last_active":"2024-03-12T17:18:46.946901+0000","last_peered":"2024-03-12T17:18:46.946901+0000","last_clean":"2024-03-12T17:18:46.946901+0000","last_became_active":"2024-03-12T17:18:45.875075+0000","last_became_peered":"2024-03-12T17:18:45.875075+0000","last_unstale":"2024-03-12T17:18:46.946901+0000","last_undegraded":"2024-03-12T17:18:46.946901+0000","last_fullsized":"2024-03-12T17:18:46.946901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:41:17.395467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944618+0000","last_change":"2024-03-12T17:18:45.380761+0000","last_active":"2024-03-12T17:18:46.944618+0000","last_peered":"2024-03-12T17:18:46.944618+0000","last_clean":"2024-03-12T17:18:46.944618+0000","last_became_active":"2024-03-12T17:18:45.379967+0000","last_became_peered":"2024-03-12T17:18:45.379967+0000","last_unstale":"2024-03-12T17:18:46.944618+0000","last_undegraded":"2024-03-12T17:18:46.944618+0000","last_fullsized":"2024-03-12T17:18:46.944618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:35:48.237768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947573+0000","last_change":"2024-03-12T17:18:45.874583+0000","last_active":"2024-03-12T17:18:46.947573+0000","last_peered":"2024-03-12T17:18:46.947573+0000","last_clean":"2024-03-12T17:18:46.947573+0000","last_became_active":"2024-03-12T17:18:45.873218+0000","last_became_peered":"2024-03-12T17:18:45.873218+0000","last_unstale":"2024-03-12T17:18:46.947573+0000","last_undegraded":"2024-03-12T17:18:46.947573+0000","last_fullsized":"2024-03-12T17:18:46.947573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:10:29.099400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858419+0000","last_change":"2024-03-12T17:18:45.380027+0000","last_active":"2024-03-12T17:18:46.858419+0000","last_peered":"2024-03-12T17:18:46.858419+0000","last_clean":"2024-03-12T17:18:46.858419+0000","last_became_active":"2024-03-12T17:18:45.379670+0000","last_became_peered":"2024-03-12T17:18:45.379670+0000","last_unstale":"2024-03-12T17:18:46.858419+0000","last_undegraded":"2024-03-12T17:18:46.858419+0000","last_fullsized":"2024-03-12T17:18:46.858419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:31:59.966986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944190+0000","last_change":"2024-03-12T17:18:45.892768+0000","last_active":"2024-03-12T17:18:46.944190+0000","last_peered":"2024-03-12T17:18:46.944190+0000","last_clean":"2024-03-12T17:18:46.944190+0000","last_became_active":"2024-03-12T17:18:45.890848+0000","last_became_peered":"2024-03-12T17:18:45.890848+0000","last_unstale":"2024-03-12T17:18:46.944190+0000","last_undegraded":"2024-03-12T17:18:46.944190+0000","last_fullsized":"2024-03-12T17:18:46.944190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:17:33.168888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858274+0000","last_change":"2024-03-12T17:18:45.885223+0000","last_active":"2024-03-12T17:18:46.858274+0000","last_peered":"2024-03-12T17:18:46.858274+0000","last_clean":"2024-03-12T17:18:46.858274+0000","last_became_active":"2024-03-12T17:18:45.884899+0000","last_became_peered":"2024-03-12T17:18:45.884899+0000","last_unstale":"2024-03-12T17:18:46.858274+0000","last_undegraded":"2024-03-12T17:18:46.858274+0000","last_fullsized":"2024-03-12T17:18:46.858274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:45:08.333283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857514+0000","last_change":"2024-03-12T17:18:45.386513+0000","last_active":"2024-03-12T17:18:46.857514+0000","last_peered":"2024-03-12T17:18:46.857514+0000","last_clean":"2024-03-12T17:18:46.857514+0000","last_became_active":"2024-03-12T17:18:45.386189+0000","last_became_peered":"2024-03-12T17:18:45.386189+0000","last_unstale":"2024-03-12T17:18:46.857514+0000","last_undegraded":"2024-03-12T17:18:46.857514+0000","last_fullsized":"2024-03-12T17:18:46.857514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:35:28.129493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858523+0000","last_change":"2024-03-12T17:18:45.894835+0000","last_active":"2024-03-12T17:18:46.858523+0000","last_peered":"2024-03-12T17:18:46.858523+0000","last_clean":"2024-03-12T17:18:46.858523+0000","last_became_active":"2024-03-12T17:18:45.894485+0000","last_became_peered":"2024-03-12T17:18:45.894485+0000","last_unstale":"2024-03-12T17:18:46.858523+0000","last_undegraded":"2024-03-12T17:18:46.858523+0000","last_fullsized":"2024-03-12T17:18:46.858523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:48:29.172720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858357+0000","last_change":"2024-03-12T17:18:45.384828+0000","last_active":"2024-03-12T17:18:46.858357+0000","last_peered":"2024-03-12T17:18:46.858357+0000","last_clean":"2024-03-12T17:18:46.858357+0000","last_became_active":"2024-03-12T17:18:45.384524+0000","last_became_peered":"2024-03-12T17:18:45.384524+0000","last_unstale":"2024-03-12T17:18:46.858357+0000","last_undegraded":"2024-03-12T17:18:46.858357+0000","last_fullsized":"2024-03-12T17:18:46.858357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:28:47.390706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.948954+0000","last_change":"2024-03-12T17:18:45.874183+0000","last_active":"2024-03-12T17:18:46.948954+0000","last_peered":"2024-03-12T17:18:46.948954+0000","last_clean":"2024-03-12T17:18:46.948954+0000","last_became_active":"2024-03-12T17:18:45.873893+0000","last_became_peered":"2024-03-12T17:18:45.873893+0000","last_unstale":"2024-03-12T17:18:46.948954+0000","last_undegraded":"2024-03-12T17:18:46.948954+0000","last_fullsized":"2024-03-12T17:18:46.948954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:42:22.352573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.948036+0000","last_change":"2024-03-12T17:18:45.377991+0000","last_active":"2024-03-12T17:18:46.948036+0000","last_peered":"2024-03-12T17:18:46.948036+0000","last_clean":"2024-03-12T17:18:46.948036+0000","last_became_active":"2024-03-12T17:18:45.375429+0000","last_became_peered":"2024-03-12T17:18:45.375429+0000","last_unstale":"2024-03-12T17:18:46.948036+0000","last_undegraded":"2024-03-12T17:18:46.948036+0000","last_fullsized":"2024-03-12T17:18:46.948036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:12:48.811874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.948053+0000","last_change":"2024-03-12T17:18:45.890541+0000","last_active":"2024-03-12T17:18:46.948053+0000","last_peered":"2024-03-12T17:18:46.948053+0000","last_clean":"2024-03-12T17:18:46.948053+0000","last_became_active":"2024-03-12T17:18:45.890352+0000","last_became_peered":"2024-03-12T17:18:45.890352+0000","last_unstale":"2024-03-12T17:18:46.948053+0000","last_undegraded":"2024-03-12T17:18:46.948053+0000","last_fullsized":"2024-03-12T17:18:46.948053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:05:09.374271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.949344+0000","last_change":"2024-03-12T17:18:45.374531+0000","last_active":"2024-03-12T17:18:46.949344+0000","last_peered":"2024-03-12T17:18:46.949344+0000","last_clean":"2024-03-12T17:18:46.949344+0000","last_became_active":"2024-03-12T17:18:45.373202+0000","last_became_peered":"2024-03-12T17:18:45.373202+0000","last_unstale":"2024-03-12T17:18:46.949344+0000","last_undegraded":"2024-03-12T17:18:46.949344+0000","last_fullsized":"2024-03-12T17:18:46.949344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:01:22.087219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":815104,"data_stored":666519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.22}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.296}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.589}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.744}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8660000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1909999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4020000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":229376,"data_stored":77133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.631}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8660000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5529999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31340,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340500,"statfs":{"total":96636764160,"available":96604672000,"internally_reserved":0,"allocated":221184,"data_stored":75659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.161}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.706}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.613}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6829999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3149999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4609999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8700000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":229376,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.405}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.321}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7090000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5820000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":229376,"data_stored":77133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.371}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4670000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.526}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.669}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":217088,"data_stored":75569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.593}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.028}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8049999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9530000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31344,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340496,"statfs":{"total":96636764160,"available":96604667904,"internally_reserved":0,"allocated":225280,"data_stored":75729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1819999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.272}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.788}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1259999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.052}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.2229999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0739999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":823296,"data_stored":666575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.339}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.591}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6240000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3660000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-12T17:18:51.324 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-12T17:18:51.324 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-12T17:18:51.324 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-12T17:18:51.325 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-12T17:18:51.325 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-12T17:18:51.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.591+0000 7fda2d200640 1 Processor -- start 2024-03-12T17:18:51.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.591+0000 7fda2d200640 1 -- start start 2024-03-12T17:18:51.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.593+0000 7fda2d200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fda2815caa0 0x7fda28160790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:51.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.593+0000 7fda2d200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda28161650 con 0x7fda2815ce80 2024-03-12T17:18:51.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.593+0000 7fda2d200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda28161090 con 0x7fda280cfa40 2024-03-12T17:18:51.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.593+0000 7fda2d200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda28161370 con 0x7fda2815caa0 2024-03-12T17:18:51.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.593+0000 7fda1ea00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fda2815ce80 0x7fda280cf330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37814/0 (socket says 172.21.15.17:37814) 2024-03-12T17:18:51.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.593+0000 7fda1ea00640 1 -- 172.21.15.17:0/2028083057 learned_addr learned my addr 172.21.15.17:0/2028083057 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:18:51.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.594+0000 7fda27400640 1 --2- 172.21.15.17:0/2028083057 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fda2815caa0 0x7fda28160790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:51.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.594+0000 7fda26a00640 1 -- 172.21.15.17:0/2028083057 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 63370951 0 0) 0x7fda28161650 con 0x7fda2815ce80 2024-03-12T17:18:51.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.594+0000 7fda26a00640 1 -- 172.21.15.17:0/2028083057 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda0c003520 con 0x7fda2815ce80 2024-03-12T17:18:51.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.594+0000 7fda26a00640 1 -- 172.21.15.17:0/2028083057 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2088707011 0 0) 0x7fda0c003520 con 0x7fda2815ce80 2024-03-12T17:18:51.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.594+0000 7fda26a00640 1 -- 172.21.15.17:0/2028083057 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fda2815caa0 msgr2=0x7fda28160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:51.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.594+0000 7fda26a00640 1 --2- 172.21.15.17:0/2028083057 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fda2815caa0 0x7fda28160790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:51.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.594+0000 7fda26a00640 1 -- 172.21.15.17:0/2028083057 >> v1:172.21.15.94:6789/0 conn(0x7fda280cfa40 legacy=0x7fda280d12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:51.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.594+0000 7fda26a00640 1 -- 172.21.15.17:0/2028083057 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda280d0ad0 con 0x7fda2815ce80 2024-03-12T17:18:51.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.594+0000 7fda26a00640 1 -- 172.21.15.17:0/2028083057 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7fda10001670 con 0x7fda2815ce80 2024-03-12T17:18:51.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.594+0000 7fda26a00640 1 -- 172.21.15.17:0/2028083057 >> v1:172.21.15.17:6789/0 conn(0x7fda2815ce80 legacy=0x7fda280cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:51.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.595+0000 7fda26a00640 1 --2- 172.21.15.17:0/2028083057 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda0c0039a0 0x7fda0c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:51.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.595+0000 7fda26a00640 1 --2- 172.21.15.17:0/2028083057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda0c0047c0 0x7fda0c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:51.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.595+0000 7fda26a00640 1 --2- 172.21.15.17:0/2028083057 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fda2815caa0 0x7fda0c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:51.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.595+0000 7fda26a00640 1 -- 172.21.15.17:0/2028083057 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda28161370 con 0x7fda0c0047c0 2024-03-12T17:18:51.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.595+0000 7fda26a00640 1 -- 172.21.15.17:0/2028083057 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c00ba30 con 0x7fda0c0039a0 2024-03-12T17:18:51.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.595+0000 7fda26a00640 1 -- 172.21.15.17:0/2028083057 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda0c00bbf0 con 0x7fda2815caa0 2024-03-12T17:18:51.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.595+0000 7fda1ea00640 1 --2- 172.21.15.17:0/2028083057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda0c0047c0 0x7fda0c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:51.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.595+0000 7fda27400640 1 --2- 172.21.15.17:0/2028083057 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda0c0039a0 0x7fda0c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:51.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.595+0000 7fda1ea00640 1 -- 172.21.15.17:0/2028083057 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fda2815caa0 msgr2=0x7fda0c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:51.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.595+0000 7fda27e00640 1 --2- 172.21.15.17:0/2028083057 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fda2815caa0 0x7fda0c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:51.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.595+0000 7fda1ea00640 1 --2- 172.21.15.17:0/2028083057 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fda2815caa0 0x7fda0c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:51.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.595+0000 7fda1ea00640 1 -- 172.21.15.17:0/2028083057 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda0c0039a0 msgr2=0x7fda0c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:51.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.595+0000 7fda1ea00640 1 --2- 172.21.15.17:0/2028083057 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda0c0039a0 0x7fda0c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:51.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.595+0000 7fda1ea00640 1 -- 172.21.15.17:0/2028083057 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda0c003520 con 0x7fda0c0047c0 2024-03-12T17:18:51.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.596+0000 7fda27e00640 1 --2- 172.21.15.17:0/2028083057 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fda2815caa0 0x7fda0c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:18:51.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.597+0000 7fda1ea00640 1 --2- 172.21.15.17:0/2028083057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda0c0047c0 0x7fda0c004c40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fda10001eb0 tx=0x7fda0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2adadcf062539e47 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:51.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.597+0000 7fda26a00640 1 -- 172.21.15.17:0/2028083057 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda10005ad0 con 0x7fda0c0047c0 2024-03-12T17:18:51.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.597+0000 7fda26a00640 1 -- 172.21.15.17:0/2028083057 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda10005c30 con 0x7fda0c0047c0 2024-03-12T17:18:51.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.597+0000 7fda26a00640 1 -- 172.21.15.17:0/2028083057 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1002c810 con 0x7fda0c0047c0 2024-03-12T17:18:51.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.597+0000 7fda2d200640 1 -- 172.21.15.17:0/2028083057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda0c0047c0 msgr2=0x7fda0c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:51.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.597+0000 7fda2d200640 1 --2- 172.21.15.17:0/2028083057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda0c0047c0 0x7fda0c004c40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fda10001eb0 tx=0x7fda0c0057f0 comp rx=0 tx=0).stop 2024-03-12T17:18:51.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.597+0000 7fda27e00640 1 -- 172.21.15.17:0/2028083057 reap_dead start 2024-03-12T17:18:51.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.598+0000 7fda2d200640 1 -- 172.21.15.17:0/2028083057 shutdown_connections 2024-03-12T17:18:51.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.598+0000 7fda2d200640 1 -- 172.21.15.17:0/2028083057 >> 172.21.15.17:0/2028083057 conn(0x7fda2806b160 msgr2=0x7fda2806b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:51.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.598+0000 7fda2d200640 1 -- 172.21.15.17:0/2028083057 shutdown_connections 2024-03-12T17:18:51.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.598+0000 7fda2d200640 1 -- 172.21.15.17:0/2028083057 wait complete. 2024-03-12T17:18:51.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.599+0000 7fda2d200640 1 Processor -- start 2024-03-12T17:18:51.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.600+0000 7fda2d200640 1 -- start start 2024-03-12T17:18:51.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.600+0000 7fda2d200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda0c0047c0 0x7fda281f4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:51.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.601+0000 7fda2d200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda280c8e90 0x7fda280b1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:51.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.601+0000 7fda2d200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fda280b1850 0x7fda280cbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:51.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.601+0000 7fda2d200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda281f2240 con 0x7fda280c8e90 2024-03-12T17:18:51.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.601+0000 7fda2d200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda281f24e0 con 0x7fda0c0047c0 2024-03-12T17:18:51.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.601+0000 7fda2d200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda281f27c0 con 0x7fda280b1850 2024-03-12T17:18:51.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.601+0000 7fda1ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda280c8e90 0x7fda280b1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:51.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.601+0000 7fda1ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda280c8e90 0x7fda280b1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48138/0 (socket says 172.21.15.17:48138) 2024-03-12T17:18:51.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.601+0000 7fda1ea00640 1 -- 172.21.15.17:0/454326571 learned_addr learned my addr 172.21.15.17:0/454326571 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:51.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.601+0000 7fda27e00640 1 --2- 172.21.15.17:0/454326571 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fda280b1850 0x7fda280cbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:51.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.601+0000 7fda27400640 1 --2- 172.21.15.17:0/454326571 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda0c0047c0 0x7fda281f4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:51.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.601+0000 7fda1ea00640 1 -- 172.21.15.17:0/454326571 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fda280b1850 msgr2=0x7fda280cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:51.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.601+0000 7fda1ea00640 1 --2- 172.21.15.17:0/454326571 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fda280b1850 0x7fda280cbbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:51.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.601+0000 7fda1ea00640 1 -- 172.21.15.17:0/454326571 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda0c0047c0 msgr2=0x7fda281f4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:51.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.601+0000 7fda1ea00640 1 --2- 172.21.15.17:0/454326571 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda0c0047c0 0x7fda281f4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:51.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.601+0000 7fda1ea00640 1 -- 172.21.15.17:0/454326571 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda281f2aa0 con 0x7fda280c8e90 2024-03-12T17:18:51.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.601+0000 7fda27400640 1 --2- 172.21.15.17:0/454326571 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda0c0047c0 0x7fda281f4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:18:51.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.602+0000 7fda1ea00640 1 --2- 172.21.15.17:0/454326571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda280c8e90 0x7fda280b1310 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fda10001930 tx=0x7fda10000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:51.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.602+0000 7fda1fe00640 1 -- 172.21.15.17:0/454326571 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda1002cc20 con 0x7fda280c8e90 2024-03-12T17:18:51.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.602+0000 7fda1fe00640 1 -- 172.21.15.17:0/454326571 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda1002cd80 con 0x7fda280c8e90 2024-03-12T17:18:51.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.602+0000 7fda1fe00640 1 -- 172.21.15.17:0/454326571 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda10007270 con 0x7fda280c8e90 2024-03-12T17:18:51.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.602+0000 7fda2d200640 1 -- 172.21.15.17:0/454326571 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda281f2d80 con 0x7fda280c8e90 2024-03-12T17:18:51.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.602+0000 7fda2d200640 1 -- 172.21.15.17:0/454326571 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda280cc100 con 0x7fda280c8e90 2024-03-12T17:18:51.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.604+0000 7fda2d200640 1 -- 172.21.15.17:0/454326571 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda28072360 con 0x7fda280c8e90 2024-03-12T17:18:51.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.604+0000 7fda1fe00640 1 -- 172.21.15.17:0/454326571 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fda10032070 con 0x7fda280c8e90 2024-03-12T17:18:51.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.605+0000 7fda1fe00640 1 --2- 172.21.15.17:0/454326571 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fda0406ac00 0x7fda0406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:51.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.605+0000 7fda1fe00640 1 -- 172.21.15.17:0/454326571 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda100aa2c0 con 0x7fda280c8e90 2024-03-12T17:18:51.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.606+0000 7fda27400640 1 --2- 172.21.15.17:0/454326571 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fda0406ac00 0x7fda0406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:51.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.606+0000 7fda27400640 1 --2- 172.21.15.17:0/454326571 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fda0406ac00 0x7fda0406d0c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fda280cffb0 tx=0x7fda1800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:51.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.610+0000 7fda1fe00640 1 -- 172.21.15.17:0/454326571 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fda100755e0 con 0x7fda280c8e90 2024-03-12T17:18:51.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.859+0000 7fda2d200640 1 -- 172.21.15.17:0/454326571 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fda281f2900 con 0x7fda280c8e90 2024-03-12T17:18:51.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.867+0000 7fda1fe00640 1 -- 172.21.15.17:0/454326571 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170928 (secure 0 0 0) 0x7fda281f2900 con 0x7fda280c8e90 2024-03-12T17:18:51.865 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:18:51.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.872+0000 7fda2d200640 1 -- 172.21.15.17:0/454326571 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fda0406ac00 msgr2=0x7fda0406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:51.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.872+0000 7fda2d200640 1 --2- 172.21.15.17:0/454326571 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fda0406ac00 0x7fda0406d0c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fda280cffb0 tx=0x7fda1800b040 comp rx=0 tx=0).stop 2024-03-12T17:18:51.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.872+0000 7fda2d200640 1 -- 172.21.15.17:0/454326571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda280c8e90 msgr2=0x7fda280b1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:51.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.872+0000 7fda2d200640 1 --2- 172.21.15.17:0/454326571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda280c8e90 0x7fda280b1310 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fda10001930 tx=0x7fda10000fe0 comp rx=0 tx=0).stop 2024-03-12T17:18:51.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.872+0000 7fda2d200640 1 -- 172.21.15.17:0/454326571 shutdown_connections 2024-03-12T17:18:51.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.872+0000 7fda2d200640 1 --2- 172.21.15.17:0/454326571 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fda0406ac00 0x7fda0406d0c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:51.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.872+0000 7fda2d200640 1 --2- 172.21.15.17:0/454326571 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fda280b1850 0x7fda280cbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:51.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.872+0000 7fda2d200640 1 --2- 172.21.15.17:0/454326571 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fda280c8e90 0x7fda280b1310 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:51.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.872+0000 7fda2d200640 1 --2- 172.21.15.17:0/454326571 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fda0c0047c0 0x7fda281f4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:51.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.872+0000 7fda2d200640 1 -- 172.21.15.17:0/454326571 >> 172.21.15.17:0/454326571 conn(0x7fda2806b160 msgr2=0x7fda280cf330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:51.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.872+0000 7fda2d200640 1 -- 172.21.15.17:0/454326571 shutdown_connections 2024-03-12T17:18:51.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:51.872+0000 7fda2d200640 1 -- 172.21.15.17:0/454326571 wait complete. 2024-03-12T17:18:51.886 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":5,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6832","nonce":37052},{"type":"v1","addr":"172.21.15.17:6833","nonce":37052}]},"active_addr":"172.21.15.17:6833/37052","active_change":"2024-03-12T17:18:31.459452+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4106,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":270566625}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":2406973026}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":2089214564}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.17:0","nonce":3680461088}]}]} 2024-03-12T17:18:51.891 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-12T17:18:51.891 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-12T17:18:51.891 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T17:18:52.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.114+0000 7f3773c00640 1 Processor -- start 2024-03-12T17:18:52.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.114+0000 7f3773c00640 1 -- start start 2024-03-12T17:18:52.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.116+0000 7f3773c00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f376c144240 0x7f376c0ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:52.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.116+0000 7f3773c00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f376c0cecf0 0x7f376c0b2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:52.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.116+0000 7f3773c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f376c0b25b0 0x7f376c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:52.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.116+0000 7f3773c00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f376c0ce320 con 0x7f376c0cecf0 2024-03-12T17:18:52.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.116+0000 7f3773c00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f376c144620 con 0x7f376c144240 2024-03-12T17:18:52.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.116+0000 7f3773c00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f376c15f3d0 con 0x7f376c0b25b0 2024-03-12T17:18:52.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.116+0000 7f376be00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f376c0cecf0 0x7f376c0b2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:52.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.117+0000 7f376be00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f376c0cecf0 0x7f376c0b2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38504/0 (socket says 172.21.15.17:38504) 2024-03-12T17:18:52.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.117+0000 7f376be00640 1 -- 172.21.15.17:0/3365140853 learned_addr learned my addr 172.21.15.17:0/3365140853 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:52.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.117+0000 7f3771c00640 1 --2- 172.21.15.17:0/3365140853 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f376c0b25b0 0x7f376c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:52.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.117+0000 7f3771200640 1 --2- 172.21.15.17:0/3365140853 >> v2:172.21.15.94:3300/0 conn(0x7f376c144240 0x7f376c0ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:52.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.117+0000 7f376be00640 1 -- 172.21.15.17:0/3365140853 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f376c0b25b0 msgr2=0x7f376c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:52.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.117+0000 7f376be00640 1 --2- 172.21.15.17:0/3365140853 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f376c0b25b0 0x7f376c0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:52.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.117+0000 7f376be00640 1 -- 172.21.15.17:0/3365140853 >> v2:172.21.15.94:3300/0 conn(0x7f376c144240 msgr2=0x7f376c0ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:52.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.117+0000 7f376be00640 1 --2- 172.21.15.17:0/3365140853 >> v2:172.21.15.94:3300/0 conn(0x7f376c144240 0x7f376c0ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:52.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.117+0000 7f376be00640 1 -- 172.21.15.17:0/3365140853 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376c0cd9f0 con 0x7f376c0cecf0 2024-03-12T17:18:52.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.118+0000 7f376be00640 1 --2- 172.21.15.17:0/3365140853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f376c0cecf0 0x7f376c0b2070 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f376c0cf7a0 tx=0x7f375802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b80a15885bfad6a server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:52.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.119+0000 7f376b400640 1 -- 172.21.15.17:0/3365140853 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3758031870 con 0x7f376c0cecf0 2024-03-12T17:18:52.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.119+0000 7f376b400640 1 -- 172.21.15.17:0/3365140853 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37580319d0 con 0x7f376c0cecf0 2024-03-12T17:18:52.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.119+0000 7f376b400640 1 -- 172.21.15.17:0/3365140853 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3758031d60 con 0x7f376c0cecf0 2024-03-12T17:18:52.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.119+0000 7f3773c00640 1 -- 172.21.15.17:0/3365140853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f376c0cecf0 msgr2=0x7f376c0b2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:52.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.119+0000 7f3773c00640 1 --2- 172.21.15.17:0/3365140853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f376c0cecf0 0x7f376c0b2070 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f376c0cf7a0 tx=0x7f375802b910 comp rx=0 tx=0).stop 2024-03-12T17:18:52.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.120+0000 7f3773c00640 1 -- 172.21.15.17:0/3365140853 shutdown_connections 2024-03-12T17:18:52.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.120+0000 7f3773c00640 1 --2- 172.21.15.17:0/3365140853 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f376c0b25b0 0x7f376c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:52.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.120+0000 7f3773c00640 1 --2- 172.21.15.17:0/3365140853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f376c0cecf0 0x7f376c0b2070 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:52.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.120+0000 7f3773c00640 1 --2- 172.21.15.17:0/3365140853 >> v2:172.21.15.94:3300/0 conn(0x7f376c144240 0x7f376c0ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:52.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.120+0000 7f3773c00640 1 -- 172.21.15.17:0/3365140853 >> 172.21.15.17:0/3365140853 conn(0x7f376c069ce0 msgr2=0x7f376c06a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:52.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.120+0000 7f3773c00640 1 -- 172.21.15.17:0/3365140853 shutdown_connections 2024-03-12T17:18:52.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.120+0000 7f3773c00640 1 -- 172.21.15.17:0/3365140853 wait complete. 2024-03-12T17:18:52.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.121+0000 7f3773c00640 1 Processor -- start 2024-03-12T17:18:52.117 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.122+0000 7f3773c00640 1 -- start start 2024-03-12T17:18:52.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.122+0000 7f3773c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f376c0b25b0 0x7f376c1efa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:52.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.122+0000 7f3773c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f376c0cecf0 0x7f376c139db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:52.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.122+0000 7f3773c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f376c144240 0x7f376c13a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:52.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.123+0000 7f3773c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376c0af710 con 0x7f376c0b25b0 2024-03-12T17:18:52.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.123+0000 7f3773c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376c14cfb0 con 0x7f376c0cecf0 2024-03-12T17:18:52.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.123+0000 7f3773c00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f376c13f2e0 con 0x7f376c144240 2024-03-12T17:18:52.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.123+0000 7f3771200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f376c0b25b0 0x7f376c1efa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:52.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.123+0000 7f3771200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f376c0b25b0 0x7f376c1efa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38510/0 (socket says 172.21.15.17:38510) 2024-03-12T17:18:52.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.123+0000 7f3771200640 1 -- 172.21.15.17:0/800019436 learned_addr learned my addr 172.21.15.17:0/800019436 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:52.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.123+0000 7f3771c00640 1 --2- 172.21.15.17:0/800019436 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f376c144240 0x7f376c13a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:52.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.123+0000 7f376be00640 1 --2- 172.21.15.17:0/800019436 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f376c0cecf0 0x7f376c139db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:52.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.123+0000 7f3771200640 1 -- 172.21.15.17:0/800019436 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f376c144240 msgr2=0x7f376c13a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:52.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.123+0000 7f3771200640 1 --2- 172.21.15.17:0/800019436 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f376c144240 0x7f376c13a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:52.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.123+0000 7f3771200640 1 -- 172.21.15.17:0/800019436 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f376c0cecf0 msgr2=0x7f376c139db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:52.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.123+0000 7f3771200640 1 --2- 172.21.15.17:0/800019436 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f376c0cecf0 0x7f376c139db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:52.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.123+0000 7f3771200640 1 -- 172.21.15.17:0/800019436 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37580094d0 con 0x7f376c0b25b0 2024-03-12T17:18:52.120 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.124+0000 7f3771200640 1 --2- 172.21.15.17:0/800019436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f376c0b25b0 0x7f376c1efa90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f376000d5f0 tx=0x7f376000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:52.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.124+0000 7f3768c00640 1 -- 172.21.15.17:0/800019436 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37600125f0 con 0x7f376c0b25b0 2024-03-12T17:18:52.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.124+0000 7f3768c00640 1 -- 172.21.15.17:0/800019436 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3760012750 con 0x7f376c0b25b0 2024-03-12T17:18:52.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.124+0000 7f3768c00640 1 -- 172.21.15.17:0/800019436 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3760012b00 con 0x7f376c0b25b0 2024-03-12T17:18:52.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.124+0000 7f3773c00640 1 -- 172.21.15.17:0/800019436 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f376c0af9b0 con 0x7f376c0b25b0 2024-03-12T17:18:52.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.124+0000 7f3773c00640 1 -- 172.21.15.17:0/800019436 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f376c1effd0 con 0x7f376c0b25b0 2024-03-12T17:18:52.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.125+0000 7f3773c00640 1 -- 172.21.15.17:0/800019436 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f376c0af570 con 0x7f376c0b25b0 2024-03-12T17:18:52.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.126+0000 7f3768c00640 1 -- 172.21.15.17:0/800019436 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f3760012c60 con 0x7f376c0b25b0 2024-03-12T17:18:52.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.127+0000 7f3768c00640 1 --2- 172.21.15.17:0/800019436 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f374c06ac00 0x7f374c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:52.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.127+0000 7f3768c00640 1 -- 172.21.15.17:0/800019436 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3760089860 con 0x7f376c0b25b0 2024-03-12T17:18:52.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.128+0000 7f376be00640 1 --2- 172.21.15.17:0/800019436 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f374c06ac00 0x7f374c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:52.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.128+0000 7f376be00640 1 --2- 172.21.15.17:0/800019436 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f374c06ac00 0x7f374c06d0c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3758036000 tx=0x7f375803c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:52.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.132+0000 7f3768c00640 1 -- 172.21.15.17:0/800019436 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f376c0af570 con 0x7f376c0b25b0 2024-03-12T17:18:52.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.330+0000 7f3773c00640 1 -- 172.21.15.17:0/800019436 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f376c0af570 con 0x7f376c0b25b0 2024-03-12T17:18:52.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.333+0000 7f3768c00640 1 -- 172.21.15.17:0/800019436 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15989 (secure 0 0 0) 0x7f376c0af570 con 0x7f376c0b25b0 2024-03-12T17:18:52.330 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:18:52.330 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":21,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:18:46.845635+0000","last_up_change":"2024-03-12T17:18:38.144756+0000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-12T17:18:39.552910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-12T17:18:43.794908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-12T17:18:44.867006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":37305},{"type":"v1","addr":"172.21.15.17:6801","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":37305},{"type":"v1","addr":"172.21.15.17:6803","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":37305},{"type":"v1","addr":"172.21.15.17:6807","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":37305},{"type":"v1","addr":"172.21.15.17:6805","nonce":37305}]},"public_addr":"172.21.15.17:6801/37305","cluster_addr":"172.21.15.17:6803/37305","heartbeat_back_addr":"172.21.15.17:6807/37305","heartbeat_front_addr":"172.21.15.17:6805/37305","state":["exists","up"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":37307},{"type":"v1","addr":"172.21.15.17:6814","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":37307},{"type":"v1","addr":"172.21.15.17:6818","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":37307},{"type":"v1","addr":"172.21.15.17:6827","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":37307},{"type":"v1","addr":"172.21.15.17:6823","nonce":37307}]},"public_addr":"172.21.15.17:6814/37307","cluster_addr":"172.21.15.17:6818/37307","heartbeat_back_addr":"172.21.15.17:6827/37307","heartbeat_front_addr":"172.21.15.17:6823/37307","state":["exists","up"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":37303},{"type":"v1","addr":"172.21.15.17:6809","nonce":37303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":37303},{"type":"v1","addr":"172.21.15.17:6811","nonce":37303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":37303},{"type":"v1","addr":"172.21.15.17:6819","nonce":37303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":37303},{"type":"v1","addr":"172.21.15.17:6815","nonce":37303}]},"public_addr":"172.21.15.17:6809/37303","cluster_addr":"172.21.15.17:6811/37303","heartbeat_back_addr":"172.21.15.17:6819/37303","heartbeat_front_addr":"172.21.15.17:6815/37303","state":["exists","up"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":37308},{"type":"v1","addr":"172.21.15.17:6822","nonce":37308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":37308},{"type":"v1","addr":"172.21.15.17:6826","nonce":37308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":37308},{"type":"v1","addr":"172.21.15.17:6831","nonce":37308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":37308},{"type":"v1","addr":"172.21.15.17:6829","nonce":37308}]},"public_addr":"172.21.15.17:6822/37308","cluster_addr":"172.21.15.17:6826/37308","heartbeat_back_addr":"172.21.15.17:6831/37308","heartbeat_front_addr":"172.21.15.17:6829/37308","state":["exists","up"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":37465},{"type":"v1","addr":"172.21.15.94:6809","nonce":37465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6811","nonce":37465},{"type":"v1","addr":"172.21.15.94:6813","nonce":37465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6819","nonce":37465},{"type":"v1","addr":"172.21.15.94:6822","nonce":37465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6815","nonce":37465},{"type":"v1","addr":"172.21.15.94:6817","nonce":37465}]},"public_addr":"172.21.15.94:6809/37465","cluster_addr":"172.21.15.94:6813/37465","heartbeat_back_addr":"172.21.15.94:6822/37465","heartbeat_front_addr":"172.21.15.94:6817/37465","state":["exists","up"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":37464},{"type":"v1","addr":"172.21.15.94:6812","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":37464},{"type":"v1","addr":"172.21.15.94:6816","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":37464},{"type":"v1","addr":"172.21.15.94:6823","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":37464},{"type":"v1","addr":"172.21.15.94:6820","nonce":37464}]},"public_addr":"172.21.15.94:6812/37464","cluster_addr":"172.21.15.94:6816/37464","heartbeat_back_addr":"172.21.15.94:6823/37464","heartbeat_front_addr":"172.21.15.94:6820/37464","state":["exists","up"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":37467},{"type":"v1","addr":"172.21.15.94:6825","nonce":37467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":37467},{"type":"v1","addr":"172.21.15.94:6827","nonce":37467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":37467},{"type":"v1","addr":"172.21.15.94:6831","nonce":37467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":37467},{"type":"v1","addr":"172.21.15.94:6829","nonce":37467}]},"public_addr":"172.21.15.94:6825/37467","cluster_addr":"172.21.15.94:6827/37467","heartbeat_back_addr":"172.21.15.94:6831/37467","heartbeat_front_addr":"172.21.15.94:6829/37467","state":["exists","up"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":37466},{"type":"v1","addr":"172.21.15.94:6801","nonce":37466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":37466},{"type":"v1","addr":"172.21.15.94:6803","nonce":37466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":37466},{"type":"v1","addr":"172.21.15.94:6807","nonce":37466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":37466},{"type":"v1","addr":"172.21.15.94:6805","nonce":37466}]},"public_addr":"172.21.15.94:6801/37466","cluster_addr":"172.21.15.94:6803/37466","heartbeat_back_addr":"172.21.15.94:6807/37466","heartbeat_front_addr":"172.21.15.94:6805/37466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.327217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.186966+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.419986+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.150585+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.120621+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.121576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.181257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.293188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:18:52.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.336+0000 7f3773c00640 1 -- 172.21.15.17:0/800019436 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f374c06ac00 msgr2=0x7f374c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:52.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.336+0000 7f3773c00640 1 --2- 172.21.15.17:0/800019436 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f374c06ac00 0x7f374c06d0c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3758036000 tx=0x7f375803c040 comp rx=0 tx=0).stop 2024-03-12T17:18:52.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.336+0000 7f3773c00640 1 -- 172.21.15.17:0/800019436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f376c0b25b0 msgr2=0x7f376c1efa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:52.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.336+0000 7f3773c00640 1 --2- 172.21.15.17:0/800019436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f376c0b25b0 0x7f376c1efa90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f376000d5f0 tx=0x7f376000dab0 comp rx=0 tx=0).stop 2024-03-12T17:18:52.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.336+0000 7f3773c00640 1 -- 172.21.15.17:0/800019436 shutdown_connections 2024-03-12T17:18:52.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.336+0000 7f3773c00640 1 --2- 172.21.15.17:0/800019436 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f374c06ac00 0x7f374c06d0c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:52.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.336+0000 7f3773c00640 1 --2- 172.21.15.17:0/800019436 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f376c144240 0x7f376c13a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:52.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.336+0000 7f3773c00640 1 --2- 172.21.15.17:0/800019436 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f376c0cecf0 0x7f376c139db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:52.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.336+0000 7f3773c00640 1 --2- 172.21.15.17:0/800019436 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f376c0b25b0 0x7f376c1efa90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:52.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.336+0000 7f3773c00640 1 -- 172.21.15.17:0/800019436 >> 172.21.15.17:0/800019436 conn(0x7f376c069ce0 msgr2=0x7f376c15b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:52.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.336+0000 7f3773c00640 1 -- 172.21.15.17:0/800019436 shutdown_connections 2024-03-12T17:18:52.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.336+0000 7f3773c00640 1 -- 172.21.15.17:0/800019436 wait complete. 2024-03-12T17:18:52.350 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-12T17:18:52.350 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T17:18:52.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.570+0000 7f3051200640 1 Processor -- start 2024-03-12T17:18:52.565 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.570+0000 7f3051200640 1 -- start start 2024-03-12T17:18:52.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.572+0000 7f3051200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f304c145dc0 0x7f304c160ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:52.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.572+0000 7f3051200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f304c070240 0x7f304c0706d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:52.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.572+0000 7f3051200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f304c1461a0 con 0x7f304c0b1860 2024-03-12T17:18:52.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.572+0000 7f3051200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f304c0b2000 con 0x7f304c145dc0 2024-03-12T17:18:52.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.572+0000 7f3051200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304c070c10 con 0x7f304c070240 2024-03-12T17:18:52.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.572+0000 7f304b400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f304c145dc0 0x7f304c160ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:52.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.572+0000 7f304b400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f304c145dc0 0x7f304c160ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38526/0 (socket says 172.21.15.17:38526) 2024-03-12T17:18:52.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.572+0000 7f304b400640 1 -- 172.21.15.17:0/1624727176 learned_addr learned my addr 172.21.15.17:0/1624727176 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:52.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.572+0000 7f304b400640 1 -- 172.21.15.17:0/1624727176 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f304c070240 msgr2=0x7f304c0706d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:52.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.572+0000 7f304b400640 1 --2- 172.21.15.17:0/1624727176 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f304c070240 0x7f304c0706d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:52.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.572+0000 7f304b400640 1 -- 172.21.15.17:0/1624727176 >> v1:172.21.15.94:6789/0 conn(0x7f304c0b1860 legacy=0x7f304c0b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:52.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.572+0000 7f304b400640 1 -- 172.21.15.17:0/1624727176 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304c0b3db0 con 0x7f304c145dc0 2024-03-12T17:18:52.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.573+0000 7f304b400640 1 --2- 172.21.15.17:0/1624727176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f304c145dc0 0x7f304c160ff0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f303c0098a0 tx=0x7f303c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dccbe555a94ebfd5 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:52.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.574+0000 7f304aa00640 1 -- 172.21.15.17:0/1624727176 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c031640 con 0x7f304c145dc0 2024-03-12T17:18:52.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.574+0000 7f304aa00640 1 -- 172.21.15.17:0/1624727176 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303c0317a0 con 0x7f304c145dc0 2024-03-12T17:18:52.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.574+0000 7f304aa00640 1 -- 172.21.15.17:0/1624727176 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c031b30 con 0x7f304c145dc0 2024-03-12T17:18:52.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.574+0000 7f3051200640 1 -- 172.21.15.17:0/1624727176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f304c145dc0 msgr2=0x7f304c160ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:52.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.574+0000 7f3051200640 1 --2- 172.21.15.17:0/1624727176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f304c145dc0 0x7f304c160ff0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f303c0098a0 tx=0x7f303c02b8f0 comp rx=0 tx=0).stop 2024-03-12T17:18:52.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.574+0000 7f3051200640 1 -- 172.21.15.17:0/1624727176 shutdown_connections 2024-03-12T17:18:52.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.574+0000 7f3051200640 1 --2- 172.21.15.17:0/1624727176 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f304c070240 0x7f304c0706d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:52.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.574+0000 7f3051200640 1 --2- 172.21.15.17:0/1624727176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f304c145dc0 0x7f304c160ff0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:52.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.574+0000 7f3051200640 1 -- 172.21.15.17:0/1624727176 >> 172.21.15.17:0/1624727176 conn(0x7f304c069ce0 msgr2=0x7f304c06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:52.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.575+0000 7f3051200640 1 -- 172.21.15.17:0/1624727176 shutdown_connections 2024-03-12T17:18:52.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.575+0000 7f3051200640 1 -- 172.21.15.17:0/1624727176 wait complete. 2024-03-12T17:18:52.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.576+0000 7f3051200640 1 Processor -- start 2024-03-12T17:18:52.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.576+0000 7f3051200640 1 -- start start 2024-03-12T17:18:52.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.577+0000 7f3051200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f304c070240 0x7f304c1f5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:52.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.577+0000 7f3051200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f304c0b1860 0x7f304c1f1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:52.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.577+0000 7f3051200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f304c145dc0 0x7f304c15e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:52.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.577+0000 7f3051200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c1f6820 con 0x7f304c145dc0 2024-03-12T17:18:52.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.577+0000 7f3051200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c12deb0 con 0x7f304c070240 2024-03-12T17:18:52.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.577+0000 7f3051200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304c133f60 con 0x7f304c0b1860 2024-03-12T17:18:52.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.578+0000 7f304be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f304c145dc0 0x7f304c15e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:52.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.578+0000 7f304be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f304c145dc0 0x7f304c15e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38540/0 (socket says 172.21.15.17:38540) 2024-03-12T17:18:52.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.578+0000 7f304be00640 1 -- 172.21.15.17:0/3842483503 learned_addr learned my addr 172.21.15.17:0/3842483503 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:52.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.578+0000 7f304b400640 1 --2- 172.21.15.17:0/3842483503 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f304c070240 0x7f304c1f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:52.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.578+0000 7f3043e00640 1 --2- 172.21.15.17:0/3842483503 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f304c0b1860 0x7f304c1f1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:52.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.578+0000 7f304be00640 1 -- 172.21.15.17:0/3842483503 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f304c0b1860 msgr2=0x7f304c1f1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:52.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.578+0000 7f304be00640 1 --2- 172.21.15.17:0/3842483503 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f304c0b1860 0x7f304c1f1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:52.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.578+0000 7f304be00640 1 -- 172.21.15.17:0/3842483503 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f304c070240 msgr2=0x7f304c1f5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:52.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.578+0000 7f304be00640 1 --2- 172.21.15.17:0/3842483503 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f304c070240 0x7f304c1f5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:52.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.578+0000 7f304be00640 1 -- 172.21.15.17:0/3842483503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f303c0094d0 con 0x7f304c145dc0 2024-03-12T17:18:52.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.578+0000 7f3043e00640 1 --2- 172.21.15.17:0/3842483503 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f304c0b1860 0x7f304c1f1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:18:52.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.578+0000 7f304b400640 1 --2- 172.21.15.17:0/3842483503 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f304c070240 0x7f304c1f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:18:52.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.579+0000 7f304be00640 1 --2- 172.21.15.17:0/3842483503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f304c145dc0 0x7f304c15e220 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f304400b970 tx=0x7f304400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:52.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.579+0000 7f3043400640 1 -- 172.21.15.17:0/3842483503 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304400cb40 con 0x7f304c145dc0 2024-03-12T17:18:52.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.579+0000 7f3043400640 1 -- 172.21.15.17:0/3842483503 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304400ccc0 con 0x7f304c145dc0 2024-03-12T17:18:52.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.579+0000 7f3051200640 1 -- 172.21.15.17:0/3842483503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f304c1f2130 con 0x7f304c145dc0 2024-03-12T17:18:52.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.579+0000 7f3043400640 1 -- 172.21.15.17:0/3842483503 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3044014680 con 0x7f304c145dc0 2024-03-12T17:18:52.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.579+0000 7f3051200640 1 -- 172.21.15.17:0/3842483503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f304c1f6260 con 0x7f304c145dc0 2024-03-12T17:18:52.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.580+0000 7f3051200640 1 -- 172.21.15.17:0/3842483503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f304c12dc10 con 0x7f304c145dc0 2024-03-12T17:18:52.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.581+0000 7f3043400640 1 -- 172.21.15.17:0/3842483503 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f304401d3b0 con 0x7f304c145dc0 2024-03-12T17:18:52.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.582+0000 7f3043400640 1 --2- 172.21.15.17:0/3842483503 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f302806ac30 0x7f302806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:52.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.582+0000 7f3043400640 1 -- 172.21.15.17:0/3842483503 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f30440892b0 con 0x7f304c145dc0 2024-03-12T17:18:52.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.582+0000 7f304b400640 1 --2- 172.21.15.17:0/3842483503 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f302806ac30 0x7f302806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:52.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.583+0000 7f304b400640 1 --2- 172.21.15.17:0/3842483503 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f302806ac30 0x7f302806d0f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f303c036000 tx=0x7f303c03c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:52.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.586+0000 7f3043400640 1 -- 172.21.15.17:0/3842483503 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f304c12dc10 con 0x7f304c145dc0 2024-03-12T17:18:52.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.785+0000 7f3051200640 1 -- 172.21.15.17:0/3842483503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f304c12dff0 con 0x7f304c145dc0 2024-03-12T17:18:52.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.788+0000 7f3043400640 1 -- 172.21.15.17:0/3842483503 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15989 (secure 0 0 0) 0x7f304c12dff0 con 0x7f304c145dc0 2024-03-12T17:18:52.783 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:18:52.783 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":21,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:18:46.845635+0000","last_up_change":"2024-03-12T17:18:38.144756+0000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-12T17:18:39.552910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-12T17:18:43.794908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-12T17:18:44.867006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":37305},{"type":"v1","addr":"172.21.15.17:6801","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":37305},{"type":"v1","addr":"172.21.15.17:6803","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":37305},{"type":"v1","addr":"172.21.15.17:6807","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":37305},{"type":"v1","addr":"172.21.15.17:6805","nonce":37305}]},"public_addr":"172.21.15.17:6801/37305","cluster_addr":"172.21.15.17:6803/37305","heartbeat_back_addr":"172.21.15.17:6807/37305","heartbeat_front_addr":"172.21.15.17:6805/37305","state":["exists","up"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":37307},{"type":"v1","addr":"172.21.15.17:6814","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":37307},{"type":"v1","addr":"172.21.15.17:6818","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":37307},{"type":"v1","addr":"172.21.15.17:6827","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":37307},{"type":"v1","addr":"172.21.15.17:6823","nonce":37307}]},"public_addr":"172.21.15.17:6814/37307","cluster_addr":"172.21.15.17:6818/37307","heartbeat_back_addr":"172.21.15.17:6827/37307","heartbeat_front_addr":"172.21.15.17:6823/37307","state":["exists","up"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":37303},{"type":"v1","addr":"172.21.15.17:6809","nonce":37303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":37303},{"type":"v1","addr":"172.21.15.17:6811","nonce":37303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":37303},{"type":"v1","addr":"172.21.15.17:6819","nonce":37303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":37303},{"type":"v1","addr":"172.21.15.17:6815","nonce":37303}]},"public_addr":"172.21.15.17:6809/37303","cluster_addr":"172.21.15.17:6811/37303","heartbeat_back_addr":"172.21.15.17:6819/37303","heartbeat_front_addr":"172.21.15.17:6815/37303","state":["exists","up"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":37308},{"type":"v1","addr":"172.21.15.17:6822","nonce":37308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":37308},{"type":"v1","addr":"172.21.15.17:6826","nonce":37308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":37308},{"type":"v1","addr":"172.21.15.17:6831","nonce":37308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":37308},{"type":"v1","addr":"172.21.15.17:6829","nonce":37308}]},"public_addr":"172.21.15.17:6822/37308","cluster_addr":"172.21.15.17:6826/37308","heartbeat_back_addr":"172.21.15.17:6831/37308","heartbeat_front_addr":"172.21.15.17:6829/37308","state":["exists","up"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":37465},{"type":"v1","addr":"172.21.15.94:6809","nonce":37465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6811","nonce":37465},{"type":"v1","addr":"172.21.15.94:6813","nonce":37465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6819","nonce":37465},{"type":"v1","addr":"172.21.15.94:6822","nonce":37465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6815","nonce":37465},{"type":"v1","addr":"172.21.15.94:6817","nonce":37465}]},"public_addr":"172.21.15.94:6809/37465","cluster_addr":"172.21.15.94:6813/37465","heartbeat_back_addr":"172.21.15.94:6822/37465","heartbeat_front_addr":"172.21.15.94:6817/37465","state":["exists","up"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":37464},{"type":"v1","addr":"172.21.15.94:6812","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":37464},{"type":"v1","addr":"172.21.15.94:6816","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":37464},{"type":"v1","addr":"172.21.15.94:6823","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":37464},{"type":"v1","addr":"172.21.15.94:6820","nonce":37464}]},"public_addr":"172.21.15.94:6812/37464","cluster_addr":"172.21.15.94:6816/37464","heartbeat_back_addr":"172.21.15.94:6823/37464","heartbeat_front_addr":"172.21.15.94:6820/37464","state":["exists","up"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":37467},{"type":"v1","addr":"172.21.15.94:6825","nonce":37467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":37467},{"type":"v1","addr":"172.21.15.94:6827","nonce":37467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":37467},{"type":"v1","addr":"172.21.15.94:6831","nonce":37467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":37467},{"type":"v1","addr":"172.21.15.94:6829","nonce":37467}]},"public_addr":"172.21.15.94:6825/37467","cluster_addr":"172.21.15.94:6827/37467","heartbeat_back_addr":"172.21.15.94:6831/37467","heartbeat_front_addr":"172.21.15.94:6829/37467","state":["exists","up"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":37466},{"type":"v1","addr":"172.21.15.94:6801","nonce":37466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":37466},{"type":"v1","addr":"172.21.15.94:6803","nonce":37466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":37466},{"type":"v1","addr":"172.21.15.94:6807","nonce":37466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":37466},{"type":"v1","addr":"172.21.15.94:6805","nonce":37466}]},"public_addr":"172.21.15.94:6801/37466","cluster_addr":"172.21.15.94:6803/37466","heartbeat_back_addr":"172.21.15.94:6807/37466","heartbeat_front_addr":"172.21.15.94:6805/37466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.327217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.186966+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.419986+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.150585+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.120621+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.121576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.181257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.293188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:18:52.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.791+0000 7f3051200640 1 -- 172.21.15.17:0/3842483503 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f302806ac30 msgr2=0x7f302806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:52.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.791+0000 7f3051200640 1 --2- 172.21.15.17:0/3842483503 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f302806ac30 0x7f302806d0f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f303c036000 tx=0x7f303c03c040 comp rx=0 tx=0).stop 2024-03-12T17:18:52.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.791+0000 7f3051200640 1 -- 172.21.15.17:0/3842483503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f304c145dc0 msgr2=0x7f304c15e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:52.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.791+0000 7f3051200640 1 --2- 172.21.15.17:0/3842483503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f304c145dc0 0x7f304c15e220 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f304400b970 tx=0x7f304400be30 comp rx=0 tx=0).stop 2024-03-12T17:18:52.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.791+0000 7f3051200640 1 -- 172.21.15.17:0/3842483503 shutdown_connections 2024-03-12T17:18:52.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.791+0000 7f3051200640 1 --2- 172.21.15.17:0/3842483503 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f302806ac30 0x7f302806d0f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:52.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.791+0000 7f3051200640 1 --2- 172.21.15.17:0/3842483503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f304c145dc0 0x7f304c15e220 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:52.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.791+0000 7f3051200640 1 --2- 172.21.15.17:0/3842483503 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f304c0b1860 0x7f304c1f1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:52.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.791+0000 7f3051200640 1 --2- 172.21.15.17:0/3842483503 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f304c070240 0x7f304c1f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:52.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.791+0000 7f3051200640 1 -- 172.21.15.17:0/3842483503 >> 172.21.15.17:0/3842483503 conn(0x7f304c069ce0 msgr2=0x7f304c0abb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:52.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.791+0000 7f3051200640 1 -- 172.21.15.17:0/3842483503 shutdown_connections 2024-03-12T17:18:52.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:52.791+0000 7f3051200640 1 -- 172.21.15.17:0/3842483503 wait complete. 2024-03-12T17:18:52.805 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-12T17:18:52.806 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-12T17:18:52.806 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-12T17:18:52.807 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-12T17:18:52.807 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-03-12T17:18:52.807 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-03-12T17:18:52.808 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-03-12T17:18:52.808 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-03-12T17:18:53.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.114+0000 7f2d60a00640 1 Processor -- start 2024-03-12T17:18:53.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.114+0000 7f2d60a00640 1 -- start start 2024-03-12T17:18:53.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.116+0000 7f2d60a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2d54006d80 0x7f2d540edde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.116+0000 7f2d60a00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d540e36b0 con 0x7f2d540061c0 2024-03-12T17:18:53.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.116+0000 7f2d60a00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d54057b10 con 0x7f2d540e32d0 2024-03-12T17:18:53.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.116+0000 7f2d60a00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d54058790 con 0x7f2d54006d80 2024-03-12T17:18:53.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.116+0000 7f2d5b200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2d54006d80 0x7f2d540edde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.117+0000 7f2d5b200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2d54006d80 0x7f2d540edde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38542/0 (socket says 172.21.15.17:38542) 2024-03-12T17:18:53.112 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.117+0000 7f2d5b200640 1 -- 172.21.15.17:0/94532612 learned_addr learned my addr 172.21.15.17:0/94532612 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:53.113 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.118+0000 7f2d5b200640 1 -- 172.21.15.17:0/94532612 >> v1:172.21.15.94:6789/0 conn(0x7f2d540e32d0 legacy=0x7f2d540572c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.118+0000 7f2d5b200640 1 -- 172.21.15.17:0/94532612 >> v1:172.21.15.17:6789/0 conn(0x7f2d540061c0 legacy=0x7f2d54006670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.114 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.118+0000 7f2d5b200640 1 -- 172.21.15.17:0/94532612 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d54057df0 con 0x7f2d54006d80 2024-03-12T17:18:53.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.120+0000 7f2d5b200640 1 --2- 172.21.15.17:0/94532612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d54006d80 0x7f2d540edde0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2d48009870 tx=0x7f2d4802b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c98458e279c0f82b server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.121+0000 7f2d59400640 1 -- 172.21.15.17:0/94532612 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d48030850 con 0x7f2d54006d80 2024-03-12T17:18:53.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.121+0000 7f2d59400640 1 -- 172.21.15.17:0/94532612 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d480309b0 con 0x7f2d54006d80 2024-03-12T17:18:53.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.121+0000 7f2d59400640 1 -- 172.21.15.17:0/94532612 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d48030d40 con 0x7f2d54006d80 2024-03-12T17:18:53.118 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.123+0000 7f2d60a00640 1 -- 172.21.15.17:0/94532612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d54006d80 msgr2=0x7f2d540edde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.123+0000 7f2d60a00640 1 --2- 172.21.15.17:0/94532612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d54006d80 0x7f2d540edde0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2d48009870 tx=0x7f2d4802b990 comp rx=0 tx=0).stop 2024-03-12T17:18:53.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.123+0000 7f2d60a00640 1 -- 172.21.15.17:0/94532612 shutdown_connections 2024-03-12T17:18:53.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.123+0000 7f2d60a00640 1 --2- 172.21.15.17:0/94532612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d54006d80 0x7f2d540edde0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.123+0000 7f2d60a00640 1 -- 172.21.15.17:0/94532612 >> 172.21.15.17:0/94532612 conn(0x7f2d54058ec0 msgr2=0x7f2d540592d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:53.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.124+0000 7f2d60a00640 1 -- 172.21.15.17:0/94532612 shutdown_connections 2024-03-12T17:18:53.119 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.124+0000 7f2d60a00640 1 -- 172.21.15.17:0/94532612 wait complete. 2024-03-12T17:18:53.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.124+0000 7f28d2c00640 1 Processor -- start 2024-03-12T17:18:53.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.124+0000 7f28d2c00640 1 -- start start 2024-03-12T17:18:53.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.127+0000 7f2d60a00640 1 Processor -- start 2024-03-12T17:18:53.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.126+0000 7f28d2c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f28cc160e30 0x7f28cc1654c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.126+0000 7f28d2c00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f28cc161210 0x7f28cc161e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.126+0000 7f28d2c00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28cc0cd2e0 con 0x7f28cc0cf330 2024-03-12T17:18:53.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.126+0000 7f28d2c00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28cc165a00 con 0x7f28cc161210 2024-03-12T17:18:53.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.126+0000 7f28d2c00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc0cd5c0 con 0x7f28cc160e30 2024-03-12T17:18:53.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.127+0000 7f28d0e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f28cc161210 0x7f28cc161e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.126+0000 7f0588e00640 1 Processor -- start 2024-03-12T17:18:53.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.126+0000 7f0588e00640 1 -- start start 2024-03-12T17:18:53.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.127+0000 7f28d0e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f28cc161210 0x7f28cc161e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.17:53294/0 (socket says 172.21.15.17:53294) 2024-03-12T17:18:53.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.127+0000 7f0fad800640 1 Processor -- start 2024-03-12T17:18:53.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.127+0000 7f28d0e00640 1 -- 172.21.15.17:0/1093113700 learned_addr learned my addr 172.21.15.17:0/1093113700 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:53.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.127+0000 7f28d1800640 1 --2- 172.21.15.17:0/1093113700 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f28cc160e30 0x7f28cc1654c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.128+0000 7f28d1800640 1 -- 172.21.15.17:0/1093113700 >> v2:172.21.15.94:3300/0 conn(0x7f28cc161210 msgr2=0x7f28cc161e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:53.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.128+0000 7f28d1800640 1 --2- 172.21.15.17:0/1093113700 >> v2:172.21.15.94:3300/0 conn(0x7f28cc161210 0x7f28cc161e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.128+0000 7f28d1800640 1 -- 172.21.15.17:0/1093113700 >> v1:172.21.15.17:6789/0 conn(0x7f28cc0cf330 legacy=0x7f28cc0d04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.128+0000 7f0588e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f057c0069f0 0x7f057c006e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.128+0000 7f0588e00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f057c0542f0 con 0x7f057c0eacc0 2024-03-12T17:18:53.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.129+0000 7f0588e00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f057c0536e0 con 0x7f057c005ea0 2024-03-12T17:18:53.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.128+0000 7f28d1800640 1 -- 172.21.15.17:0/1093113700 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28cc161690 con 0x7f28cc160e30 2024-03-12T17:18:53.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.128+0000 7f0fad800640 1 -- start start 2024-03-12T17:18:53.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.129+0000 7f0588e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f057c0539c0 con 0x7f057c0069f0 2024-03-12T17:18:53.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.128+0000 7f2d60a00640 1 -- start start 2024-03-12T17:18:53.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.130+0000 7f2d60a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2d540061c0 0x7f2d5404c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.130+0000 7f2d60a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d54006d80 0x7f2d540df090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.130+0000 7f2d60a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2d540e32d0 0x7f2d54038f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.130+0000 7f2d60a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d54038900 con 0x7f2d54006d80 2024-03-12T17:18:53.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.130+0000 7f2d60a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d54038d90 con 0x7f2d540e32d0 2024-03-12T17:18:53.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.130+0000 7f2d60a00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d540394b0 con 0x7f2d540061c0 2024-03-12T17:18:53.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.129+0000 7f0582a00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f057c005ea0 0x7f057c0062e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.17:43900/0 (socket says 172.21.15.17:43900) 2024-03-12T17:18:53.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.129+0000 7f0583e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f057c0069f0 0x7f057c006e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.129+0000 7f0583400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f057c0eacc0 0x7f057c04fa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:36904/0 (socket says 172.21.15.17:36904) 2024-03-12T17:18:53.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.130+0000 7f0583e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f057c0069f0 0x7f057c006e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.17:35778/0 (socket says 172.21.15.17:35778) 2024-03-12T17:18:53.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.130+0000 7f0583400640 1 -- 172.21.15.17:0/1163365602 learned_addr learned my addr 172.21.15.17:0/1163365602 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:18:53.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.130+0000 7f0fad800640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0fa8160f90 0x7f0fa8165530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.130+0000 7f2d59e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d54006d80 0x7f2d540df090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.130+0000 7f2d59e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d54006d80 0x7f2d540df090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38548/0 (socket says 172.21.15.17:38548) 2024-03-12T17:18:53.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.130+0000 7f2d59e00640 1 -- 172.21.15.17:0/1882828400 learned_addr learned my addr 172.21.15.17:0/1882828400 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:53.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.131+0000 7f28d1800640 1 --2- 172.21.15.17:0/1093113700 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f28cc160e30 0x7f28cc1654c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f28b80097a0 tx=0x7f28b802b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dabf516a21fa7928 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.131+0000 7f0582000640 1 -- 172.21.15.17:0/1163365602 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3085353269 0 0) 0x7f057c0536e0 con 0x7f057c005ea0 2024-03-12T17:18:53.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.131+0000 7f0582000640 1 -- 172.21.15.17:0/1163365602 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f056c003520 con 0x7f057c005ea0 2024-03-12T17:18:53.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.131+0000 7f0582000640 1 -- 172.21.15.17:0/1163365602 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 622504185 0 0) 0x7f057c0542f0 con 0x7f057c0eacc0 2024-03-12T17:18:53.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.131+0000 7f0582000640 1 -- 172.21.15.17:0/1163365602 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f057c0536e0 con 0x7f057c0eacc0 2024-03-12T17:18:53.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.131+0000 7f0fad800640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fa80b50e0 con 0x7f0fa806be10 2024-03-12T17:18:53.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.131+0000 7f0fad800640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fa80b4b20 con 0x7f0fa806b9f0 2024-03-12T17:18:53.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.131+0000 7f0fad800640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa8165a70 con 0x7f0fa8160f90 2024-03-12T17:18:53.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.131+0000 7f0fa7400640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f0fa806b9f0 0x7f0fa80ccfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.17:43906/0 (socket says 172.21.15.17:43906) 2024-03-12T17:18:53.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.131+0000 7f0fa7400640 1 -- 172.21.15.17:0/2490725046 learned_addr learned my addr 172.21.15.17:0/2490725046 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:18:53.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.131+0000 7f0583e00640 1 -- 172.21.15.17:0/1163365602 >> v1:172.21.15.94:6789/0 conn(0x7f057c005ea0 legacy=0x7f057c0062e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.131+0000 7f0583e00640 1 -- 172.21.15.17:0/1163365602 >> v1:172.21.15.17:6789/0 conn(0x7f057c0eacc0 legacy=0x7f057c04fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.131+0000 7f0583e00640 1 -- 172.21.15.17:0/1163365602 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f057c053ca0 con 0x7f057c0069f0 2024-03-12T17:18:53.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.131+0000 7f2d59e00640 1 -- 172.21.15.17:0/1882828400 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2d540061c0 msgr2=0x7f2d5404c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.131+0000 7f2d59e00640 1 --2- 172.21.15.17:0/1882828400 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2d540061c0 0x7f2d5404c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.131+0000 7f2d59e00640 1 -- 172.21.15.17:0/1882828400 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2d540e32d0 msgr2=0x7f2d54038f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.131+0000 7f2d59e00640 1 --2- 172.21.15.17:0/1882828400 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2d540e32d0 0x7f2d54038f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.131+0000 7f2d59e00640 1 -- 172.21.15.17:0/1882828400 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d480094d0 con 0x7f2d54006d80 2024-03-12T17:18:53.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.132+0000 7f28cbe00640 1 -- 172.21.15.17:0/1093113700 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b802d040 con 0x7f28cc160e30 2024-03-12T17:18:53.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.132+0000 7f28cbe00640 1 -- 172.21.15.17:0/1093113700 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b8031810 con 0x7f28cc160e30 2024-03-12T17:18:53.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.132+0000 7f28cbe00640 1 -- 172.21.15.17:0/1093113700 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b8031ba0 con 0x7f28cc160e30 2024-03-12T17:18:53.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.132+0000 7f2d59e00640 1 --2- 172.21.15.17:0/1882828400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d54006d80 0x7f2d540df090 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c063b00 tx=0x7f2d5c0676e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.132+0000 7f0fa7e00640 1 --2- 172.21.15.17:0/2490725046 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0fa8160f90 0x7f0fa8165530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.133+0000 7f28d2c00640 1 -- 172.21.15.17:0/1093113700 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f28cc160e30 msgr2=0x7f28cc1654c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.133+0000 7f2d52a00640 1 -- 172.21.15.17:0/1882828400 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c08d070 con 0x7f2d54006d80 2024-03-12T17:18:53.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.133+0000 7f28d2c00640 1 --2- 172.21.15.17:0/1093113700 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f28cc160e30 0x7f28cc1654c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f28b80097a0 tx=0x7f28b802b8b0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.133+0000 7f2d52a00640 1 -- 172.21.15.17:0/1882828400 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5c073380 con 0x7f2d54006d80 2024-03-12T17:18:53.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.133+0000 7f2d52a00640 1 -- 172.21.15.17:0/1882828400 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c073770 con 0x7f2d54006d80 2024-03-12T17:18:53.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.133+0000 7f28d2c00640 1 -- 172.21.15.17:0/1093113700 shutdown_connections 2024-03-12T17:18:53.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.133+0000 7f0fa6a00640 1 -- 172.21.15.17:0/2490725046 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2719404962 0 0) 0x7f0fa80b50e0 con 0x7f0fa806be10 2024-03-12T17:18:53.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.133+0000 7f0fa6a00640 1 -- 172.21.15.17:0/2490725046 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f8c003520 con 0x7f0fa806be10 2024-03-12T17:18:53.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.133+0000 7f0fa6a00640 1 -- 172.21.15.17:0/2490725046 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2046240206 0 0) 0x7f0fa80b4b20 con 0x7f0fa806b9f0 2024-03-12T17:18:53.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.133+0000 7f0fa6a00640 1 -- 172.21.15.17:0/2490725046 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fa80b50e0 con 0x7f0fa806b9f0 2024-03-12T17:18:53.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.133+0000 7f0583e00640 1 --2- 172.21.15.17:0/1163365602 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f057c0069f0 0x7f057c006e80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f05700097d0 tx=0x7f057002b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dfd62fb94e653bb server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.133+0000 7f2d60a00640 1 -- 172.21.15.17:0/1882828400 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d5404d530 con 0x7f2d54006d80 2024-03-12T17:18:53.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.133+0000 7f0fa6a00640 1 -- 172.21.15.17:0/2490725046 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2821932856 0 0) 0x7f0f8c003520 con 0x7f0fa806be10 2024-03-12T17:18:53.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.134+0000 7f0fa6a00640 1 -- 172.21.15.17:0/2490725046 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0fa8160f90 msgr2=0x7f0fa8165530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:53.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.134+0000 7f0fa6a00640 1 --2- 172.21.15.17:0/2490725046 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0fa8160f90 0x7f0fa8165530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.134+0000 7f28d2c00640 1 --2- 172.21.15.17:0/1093113700 >> v2:172.21.15.94:3300/0 conn(0x7f28cc161210 0x7f28cc161e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.134+0000 7f28d2c00640 1 --2- 172.21.15.17:0/1093113700 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f28cc160e30 0x7f28cc1654c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.134+0000 7f28d2c00640 1 -- 172.21.15.17:0/1093113700 >> 172.21.15.17:0/1093113700 conn(0x7f28cc06b160 msgr2=0x7f28cc06b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:53.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.134+0000 7f0fa6a00640 1 -- 172.21.15.17:0/2490725046 >> v1:172.21.15.94:6789/0 conn(0x7f0fa806b9f0 legacy=0x7f0fa80ccfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.134+0000 7f0fa6a00640 1 -- 172.21.15.17:0/2490725046 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa80b4e00 con 0x7f0fa806be10 2024-03-12T17:18:53.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.134+0000 7f0fa6a00640 1 -- 172.21.15.17:0/2490725046 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7f0fa0001920 con 0x7f0fa806be10 2024-03-12T17:18:53.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.134+0000 7f0fa6a00640 1 -- 172.21.15.17:0/2490725046 >> v1:172.21.15.17:6789/0 conn(0x7f0fa806be10 legacy=0x7f0fa80d0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.134+0000 7f0fa6a00640 1 --2- 172.21.15.17:0/2490725046 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0f8c004be0 0x7f0f8c004fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.134+0000 7f0fa6a00640 1 --2- 172.21.15.17:0/2490725046 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0f8c003760 0x7f0f8c003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.134+0000 7f0fa6a00640 1 --2- 172.21.15.17:0/2490725046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f8c004120 0x7f0f8c00ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.134+0000 7f0fa6a00640 1 -- 172.21.15.17:0/2490725046 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa8165a70 con 0x7f0f8c004120 2024-03-12T17:18:53.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.134+0000 7f0fa6a00640 1 -- 172.21.15.17:0/2490725046 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8c00c070 con 0x7f0f8c003760 2024-03-12T17:18:53.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.134+0000 7f0fa6a00640 1 -- 172.21.15.17:0/2490725046 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f8c00c230 con 0x7f0f8c004be0 2024-03-12T17:18:53.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.134+0000 7f0fa7e00640 1 --2- 172.21.15.17:0/2490725046 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0fa8160f90 0x7f0fa8165530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-12T17:18:53.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.134+0000 7f0582000640 1 -- 172.21.15.17:0/1163365602 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0570030800 con 0x7f057c0069f0 2024-03-12T17:18:53.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.134+0000 7f0582000640 1 -- 172.21.15.17:0/1163365602 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0570030960 con 0x7f057c0069f0 2024-03-12T17:18:53.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.134+0000 7f0582000640 1 -- 172.21.15.17:0/1163365602 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0570030cf0 con 0x7f057c0069f0 2024-03-12T17:18:53.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.135+0000 7f28d2c00640 1 -- 172.21.15.17:0/1093113700 shutdown_connections 2024-03-12T17:18:53.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.135+0000 7f28d2c00640 1 -- 172.21.15.17:0/1093113700 wait complete. 2024-03-12T17:18:53.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.135+0000 7f0face00640 1 --2- 172.21.15.17:0/2490725046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f8c004120 0x7f0f8c00ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.135+0000 7f2d60a00640 1 -- 172.21.15.17:0/1882828400 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d5404daf0 con 0x7f2d54006d80 2024-03-12T17:18:53.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.135+0000 7f0fa7400640 1 --2- 172.21.15.17:0/2490725046 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0f8c003760 0x7f0f8c003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.135+0000 7f3e79600640 1 Processor -- start 2024-03-12T17:18:53.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.135+0000 7f3e79600640 1 -- start start 2024-03-12T17:18:53.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.135+0000 7f0fa7e00640 1 --2- 172.21.15.17:0/2490725046 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0f8c004be0 0x7f0f8c004fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.136+0000 7f0588e00640 1 -- 172.21.15.17:0/1163365602 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f057c0069f0 msgr2=0x7f057c006e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.136+0000 7f0588e00640 1 --2- 172.21.15.17:0/1163365602 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f057c0069f0 0x7f057c006e80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f05700097d0 tx=0x7f057002b940 comp rx=0 tx=0).stop 2024-03-12T17:18:53.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.136+0000 7f0588e00640 1 -- 172.21.15.17:0/1163365602 shutdown_connections 2024-03-12T17:18:53.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.136+0000 7f0588e00640 1 --2- 172.21.15.17:0/1163365602 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f057c0069f0 0x7f057c006e80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.136+0000 7f0588e00640 1 -- 172.21.15.17:0/1163365602 >> 172.21.15.17:0/1163365602 conn(0x7f057c009f70 msgr2=0x7f057c00a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:53.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.136+0000 7f0fa7400640 1 -- 172.21.15.17:0/2490725046 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0f8c004be0 msgr2=0x7f0f8c004fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:53.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.136+0000 7f0fa7400640 1 --2- 172.21.15.17:0/2490725046 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0f8c004be0 0x7f0f8c004fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.136+0000 7f0fa7400640 1 -- 172.21.15.17:0/2490725046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f8c004120 msgr2=0x7f0f8c00ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:53.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.136+0000 7f0fa7400640 1 --2- 172.21.15.17:0/2490725046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f8c004120 0x7f0f8c00ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.136+0000 7f0fa7400640 1 -- 172.21.15.17:0/2490725046 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f8c003520 con 0x7f0f8c003760 2024-03-12T17:18:53.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.136+0000 7f0face00640 1 --2- 172.21.15.17:0/2490725046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0f8c004120 0x7f0f8c00ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-12T17:18:53.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.136+0000 7f0588e00640 1 -- 172.21.15.17:0/1163365602 shutdown_connections 2024-03-12T17:18:53.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.137+0000 7f3e79600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3e7415caa0 0x7f3e7406b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.137+0000 7f3e79600640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3e740b83b0 0x7f3e740b4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.137+0000 7f3e79600640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e740b2160 con 0x7f3e740b4970 2024-03-12T17:18:53.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.137+0000 7f3e79600640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e740b4de0 con 0x7f3e740b83b0 2024-03-12T17:18:53.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.137+0000 7f3e79600640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7406ba30 con 0x7f3e7415caa0 2024-03-12T17:18:53.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.137+0000 7f3e73e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3e7415caa0 0x7f3e7406b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.137+0000 7f3e73400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3e740b83b0 0x7f3e740b4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.138+0000 7f3e73e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3e7415caa0 0x7f3e7406b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.17:35816/0 (socket says 172.21.15.17:35816) 2024-03-12T17:18:53.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.138+0000 7f3e73e00640 1 -- 172.21.15.17:0/2381092175 learned_addr learned my addr 172.21.15.17:0/2381092175 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:53.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.138+0000 7f0fa7400640 1 --2- 172.21.15.17:0/2490725046 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0f8c003760 0x7f0f8c003be0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0f98001940 tx=0x7f0f8c0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d43d93ef5c83bbed server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.138+0000 7f3e73400640 1 -- 172.21.15.17:0/2381092175 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3e7415caa0 msgr2=0x7f3e7406b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:53.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.138+0000 7f3e73400640 1 --2- 172.21.15.17:0/2381092175 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3e7415caa0 0x7f3e7406b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.138+0000 7f3e73400640 1 -- 172.21.15.17:0/2381092175 >> v1:172.21.15.17:6789/0 conn(0x7f3e740b4970 legacy=0x7f3e74160740 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-12T17:18:53.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.138+0000 7f3e73400640 1 -- 172.21.15.17:0/2381092175 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e7406bd10 con 0x7f3e740b83b0 2024-03-12T17:18:53.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.138+0000 7f0588e00640 1 -- 172.21.15.17:0/1163365602 wait complete. 2024-03-12T17:18:53.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.139+0000 7f0fa6a00640 1 -- 172.21.15.17:0/2490725046 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f98004aa0 con 0x7f0f8c003760 2024-03-12T17:18:53.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.138+0000 7f2d60a00640 1 -- 172.21.15.17:0/1882828400 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2d5403d100 con 0x7f2d54006d80 2024-03-12T17:18:53.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.139+0000 7f0fa6a00640 1 -- 172.21.15.17:0/2490725046 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9802d040 con 0x7f0f8c003760 2024-03-12T17:18:53.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.139+0000 7f0fa6a00640 1 -- 172.21.15.17:0/2490725046 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f98004e80 con 0x7f0f8c003760 2024-03-12T17:18:53.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.140+0000 7f28d2c00640 1 Processor -- start 2024-03-12T17:18:53.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.140+0000 7f1fe8e00640 1 Processor -- start 2024-03-12T17:18:53.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.140+0000 7f0fad800640 1 -- 172.21.15.17:0/2490725046 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0f8c003760 msgr2=0x7f0f8c003be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.140+0000 7f0fad800640 1 --2- 172.21.15.17:0/2490725046 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0f8c003760 0x7f0f8c003be0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0f98001940 tx=0x7f0f8c0057f0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.140+0000 7f0face00640 1 -- 172.21.15.17:0/2490725046 reap_dead start 2024-03-12T17:18:53.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.140+0000 7f0fad800640 1 -- 172.21.15.17:0/2490725046 shutdown_connections 2024-03-12T17:18:53.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.140+0000 7f0fad800640 1 -- 172.21.15.17:0/2490725046 >> 172.21.15.17:0/2490725046 conn(0x7f0fa80cf820 msgr2=0x7f0fa80cfc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:53.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.140+0000 7f2d52a00640 1 -- 172.21.15.17:0/1882828400 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f2d5c092420 con 0x7f2d54006d80 2024-03-12T17:18:53.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.140+0000 7f0588e00640 1 Processor -- start 2024-03-12T17:18:53.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.141+0000 7f0588e00640 1 -- start start 2024-03-12T17:18:53.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.141+0000 7f3e73400640 1 --2- 172.21.15.17:0/2381092175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e740b83b0 0x7f3e740b4430 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c009d90 tx=0x7f3e6c02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f99e1f7d91d624f5 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.140+0000 7f1fe8e00640 1 -- start start 2024-03-12T17:18:53.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.141+0000 7f28d2c00640 1 -- start start 2024-03-12T17:18:53.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.141+0000 7f0fad800640 1 -- 172.21.15.17:0/2490725046 shutdown_connections 2024-03-12T17:18:53.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.141+0000 7f3e72a00640 1 -- 172.21.15.17:0/2381092175 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c02cbd0 con 0x7f3e740b83b0 2024-03-12T17:18:53.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.141+0000 7f3e72a00640 1 -- 172.21.15.17:0/2381092175 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e6c02cd30 con 0x7f3e740b83b0 2024-03-12T17:18:53.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.141+0000 7f3e72a00640 1 -- 172.21.15.17:0/2381092175 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c02cea0 con 0x7f3e740b83b0 2024-03-12T17:18:53.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.142+0000 7f0588e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f057c005ea0 0x7f057c036830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.142+0000 7f0588e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f057c0069f0 0x7f057c047190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.142+0000 7f1fe8e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1fe415cbd0 0x7f1fe40d0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.142+0000 7f1fe8e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1fe40cfa70 0x7f1fe40cff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.142+0000 7f1fe8e00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fe40b6e00 con 0x7f1fe40b5aa0 2024-03-12T17:18:53.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.142+0000 7f0588e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f057c0eacc0 0x7f057c17f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.142+0000 7f0588e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057c036d70 con 0x7f057c0eacc0 2024-03-12T17:18:53.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.142+0000 7f0588e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057c0476d0 con 0x7f057c0069f0 2024-03-12T17:18:53.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.142+0000 7f1fe8e00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe40d0440 con 0x7f1fe40cfa70 2024-03-12T17:18:53.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.142+0000 7f1fe8e00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fe40b61f0 con 0x7f1fe415cbd0 2024-03-12T17:18:53.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.142+0000 7f2d52a00640 1 --2- 172.21.15.17:0/1882828400 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f2d3c06ac00 0x7f2d3c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.142+0000 7f0588e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f057c037560 con 0x7f057c005ea0 2024-03-12T17:18:53.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.141+0000 7f0fad800640 1 -- 172.21.15.17:0/2490725046 wait complete. 2024-03-12T17:18:53.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.142+0000 7f27e0000640 1 Processor -- start 2024-03-12T17:18:53.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.142+0000 7f717f800640 1 Processor -- start 2024-03-12T17:18:53.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.143+0000 7f0582a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f057c0069f0 0x7f057c047190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.143+0000 7f0583400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f057c005ea0 0x7f057c036830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.143+0000 7f0583400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f057c005ea0 0x7f057c036830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.17:35822/0 (socket says 172.21.15.17:35822) 2024-03-12T17:18:53.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.143+0000 7f0583400640 1 -- 172.21.15.17:0/4238650766 learned_addr learned my addr 172.21.15.17:0/4238650766 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:53.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.143+0000 7f0583e00640 1 --2- 172.21.15.17:0/4238650766 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f057c0eacc0 0x7f057c17f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.143+0000 7f2d52a00640 1 -- 172.21.15.17:0/1882828400 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2d5c1024d0 con 0x7f2d54006d80 2024-03-12T17:18:53.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.143+0000 7f2d52a00640 1 --2- 172.21.15.17:0/1882828400 >> [v2:172.21.15.17:6800/37305,v1:172.21.15.17:6801/37305] conn(0x7f2d3c072e20 0x7f2d3c075240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.143+0000 7f2d52a00640 1 -- 172.21.15.17:0/1882828400 --> [v2:172.21.15.17:6800/37305,v1:172.21.15.17:6801/37305] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2d3c0758f0 con 0x7f2d3c072e20 2024-03-12T17:18:53.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.143+0000 7f2d52a00640 1 -- 172.21.15.17:0/1882828400 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d5c104af0 con 0x7f2d54006d80 2024-03-12T17:18:53.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.143+0000 7f2d5a800640 1 --2- 172.21.15.17:0/1882828400 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f2d3c06ac00 0x7f2d3c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.143+0000 7f27e0000640 1 -- start start 2024-03-12T17:18:53.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.143+0000 7f717f800640 1 -- start start 2024-03-12T17:18:53.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.143+0000 7f1fe1e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1fe415cbd0 0x7f1fe40d0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.143+0000 7f1fe2800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1fe40cfa70 0x7f1fe40cff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.144+0000 7f3e79600640 1 -- 172.21.15.17:0/2381092175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e740b83b0 msgr2=0x7f3e740b4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.144+0000 7f3e79600640 1 --2- 172.21.15.17:0/2381092175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e740b83b0 0x7f3e740b4430 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c009d90 tx=0x7f3e6c02be20 comp rx=0 tx=0).stop 2024-03-12T17:18:53.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.143+0000 7f1fe1400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f1fe40b5aa0 0x7f1fe40b84b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:36920/0 (socket says 172.21.15.17:36920) 2024-03-12T17:18:53.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.143+0000 7f1fe1400640 1 -- 172.21.15.17:0/2899924982 learned_addr learned my addr 172.21.15.17:0/2899924982 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:18:53.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.144+0000 7f0583e00640 1 -- 172.21.15.17:0/4238650766 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f057c005ea0 msgr2=0x7f057c036830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.144+0000 7f0583e00640 1 --2- 172.21.15.17:0/4238650766 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f057c005ea0 0x7f057c036830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.144+0000 7f0583e00640 1 -- 172.21.15.17:0/4238650766 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f057c0069f0 msgr2=0x7f057c047190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.144+0000 7f0583e00640 1 --2- 172.21.15.17:0/4238650766 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f057c0069f0 0x7f057c047190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.144+0000 7f0583e00640 1 -- 172.21.15.17:0/4238650766 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0570009400 con 0x7f057c0eacc0 2024-03-12T17:18:53.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.144+0000 7f0583400640 1 --2- 172.21.15.17:0/4238650766 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f057c005ea0 0x7f057c036830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-12T17:18:53.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.144+0000 7f0582a00640 1 --2- 172.21.15.17:0/4238650766 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f057c0069f0 0x7f057c047190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-12T17:18:53.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.144+0000 7f1fe2800640 1 -- 172.21.15.17:0/2899924982 >> v2:172.21.15.94:3300/0 conn(0x7f1fe415cbd0 msgr2=0x7f1fe40d0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:53.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.145+0000 7f1fe0a00640 1 -- 172.21.15.17:0/2899924982 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2431680190 0 0) 0x7f1fe40b6e00 con 0x7f1fe40b5aa0 2024-03-12T17:18:53.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.144+0000 7f0fad800640 1 Processor -- start 2024-03-12T17:18:53.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.144+0000 7f0fad800640 1 -- start start 2024-03-12T17:18:53.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.145+0000 7f1fe2800640 1 --2- 172.21.15.17:0/2899924982 >> v2:172.21.15.94:3300/0 conn(0x7f1fe415cbd0 0x7f1fe40d0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.145+0000 7f0583e00640 1 --2- 172.21.15.17:0/4238650766 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f057c0eacc0 0x7f057c17f680 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0570033000 tx=0x7f0570004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.145+0000 7f2d5b200640 1 --2- 172.21.15.17:0/1882828400 >> [v2:172.21.15.17:6800/37305,v1:172.21.15.17:6801/37305] conn(0x7f2d3c072e20 0x7f2d3c075240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.145+0000 7f717f800640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f71780d2fa0 0x7f71780d3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.145+0000 7f717f800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f71780b5b50 0x7f71780b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.145+0000 7f717f800640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f71780cd840 0x7f71780cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.145+0000 7f717f800640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71780b59e0 con 0x7f71780b5b50 2024-03-12T17:18:53.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.145+0000 7f717f800640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71780d14e0 con 0x7f71780d2fa0 2024-03-12T17:18:53.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.145+0000 7f717f800640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71780d38c0 con 0x7f71780cd840 2024-03-12T17:18:53.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.145+0000 7f1fe2800640 1 -- 172.21.15.17:0/2899924982 >> v1:172.21.15.17:6789/0 conn(0x7f1fe40b5aa0 legacy=0x7f1fe40b84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.145+0000 7f1fe2800640 1 -- 172.21.15.17:0/2899924982 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fe40b64d0 con 0x7f1fe40cfa70 2024-03-12T17:18:53.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.145+0000 7f3e79600640 1 -- 172.21.15.17:0/2381092175 shutdown_connections 2024-03-12T17:18:53.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.145+0000 7f3e79600640 1 --2- 172.21.15.17:0/2381092175 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e740b83b0 0x7f3e740b4430 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.146+0000 7f28d2c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28cc0cf330 0x7f28cc0b7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.146+0000 7f28d2c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f28cc160e30 0x7f28cc1643f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.146+0000 7f28d2c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f28cc161210 0x7f28cc15de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.146+0000 7f7177e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f71780b5b50 0x7f71780b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.146+0000 7f7177e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f71780b5b50 0x7f71780b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38594/0 (socket says 172.21.15.17:38594) 2024-03-12T17:18:53.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.146+0000 7f7177e00640 1 -- 172.21.15.17:0/690168622 learned_addr learned my addr 172.21.15.17:0/690168622 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:53.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.146+0000 7f717d800640 1 --2- 172.21.15.17:0/690168622 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f71780cd840 0x7f71780cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.146+0000 7f717ce00640 1 --2- 172.21.15.17:0/690168622 >> v2:172.21.15.94:3300/0 conn(0x7f71780d2fa0 0x7f71780d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.145+0000 7f3e79600640 1 --2- 172.21.15.17:0/2381092175 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3e7415caa0 0x7f3e7406b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.145+0000 7f2d5a800640 1 --2- 172.21.15.17:0/1882828400 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f2d3c06ac00 0x7f2d3c06d0c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c000f60 tx=0x7f2d4c0079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.146+0000 7f2d5b200640 1 --2- 172.21.15.17:0/1882828400 >> [v2:172.21.15.17:6800/37305,v1:172.21.15.17:6801/37305] conn(0x7f2d3c072e20 0x7f2d3c075240 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.146+0000 7f0577400640 1 -- 172.21.15.17:0/4238650766 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057003e040 con 0x7f057c0eacc0 2024-03-12T17:18:53.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.146+0000 7f28d2c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc0b8660 con 0x7f28cc0cf330 2024-03-12T17:18:53.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.146+0000 7f28d2c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc1fa3a0 con 0x7f28cc161210 2024-03-12T17:18:53.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.146+0000 7f28d2c00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28cc06d760 con 0x7f28cc160e30 2024-03-12T17:18:53.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.146+0000 7f0fad800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0fa81f63b0 0x7f0fa80b8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.145+0000 7f3e79600640 1 -- 172.21.15.17:0/2381092175 >> 172.21.15.17:0/2381092175 conn(0x7f3e740cf610 msgr2=0x7f3e740cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:53.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.146+0000 7f0fad800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fa80c6160 0x7f0fa80c7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.146+0000 7f28d2200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f28cc161210 0x7f28cc15de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.146+0000 7f28d2200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f28cc161210 0x7f28cc15de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.17:53350/0 (socket says 172.21.15.17:53350) 2024-03-12T17:18:53.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.146+0000 7f28d2200640 1 -- 172.21.15.17:0/1420422361 learned_addr learned my addr 172.21.15.17:0/1420422361 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:53.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.146+0000 7f0fad800640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0fa80c7fc0 0x7f0fa81f9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.146+0000 7f0fad800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa80c8440 con 0x7f0fa80c6160 2024-03-12T17:18:53.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.146+0000 7f0fad800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa81508d0 con 0x7f0fa81f63b0 2024-03-12T17:18:53.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.146+0000 7f0fad800640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa80b5270 con 0x7f0fa80c7fc0 2024-03-12T17:18:53.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.146+0000 7f0588e00640 1 -- 172.21.15.17:0/4238650766 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f057c036fa0 con 0x7f057c0eacc0 2024-03-12T17:18:53.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.146+0000 7f0588e00640 1 -- 172.21.15.17:0/4238650766 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f057c17ffd0 con 0x7f057c0eacc0 2024-03-12T17:18:53.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.147+0000 7f28d0e00640 1 --2- 172.21.15.17:0/1420422361 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f28cc160e30 0x7f28cc1643f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.147+0000 7f0fa7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fa80c6160 0x7f0fa80c7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.147+0000 7f0fa7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fa80c6160 0x7f0fa80c7a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38610/0 (socket says 172.21.15.17:38610) 2024-03-12T17:18:53.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.147+0000 7f0fa7400640 1 -- 172.21.15.17:0/2536924317 learned_addr learned my addr 172.21.15.17:0/2536924317 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:53.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.147+0000 7f28d1800640 1 --2- 172.21.15.17:0/1420422361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28cc0cf330 0x7f28cc0b7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.147+0000 7f0fa7e00640 1 --2- 172.21.15.17:0/2536924317 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0fa81f63b0 0x7f0fa80b8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.146+0000 7f3e79600640 1 -- 172.21.15.17:0/2381092175 shutdown_connections 2024-03-12T17:18:53.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.146+0000 7f3e79600640 1 -- 172.21.15.17:0/2381092175 wait complete. 2024-03-12T17:18:53.167 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.146+0000 7f717ce00640 1 -- 172.21.15.17:0/690168622 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f71780cd840 msgr2=0x7f71780cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:53.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.146+0000 7f717ce00640 1 --2- 172.21.15.17:0/690168622 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f71780cd840 0x7f71780cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.146+0000 7f717ce00640 1 -- 172.21.15.17:0/690168622 >> v2:172.21.15.17:3300/0 conn(0x7f71780b5b50 msgr2=0x7f71780b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:53.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.146+0000 7f717ce00640 1 --2- 172.21.15.17:0/690168622 >> v2:172.21.15.17:3300/0 conn(0x7f71780b5b50 0x7f71780b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.147+0000 7f717ce00640 1 -- 172.21.15.17:0/690168622 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71780b85b0 con 0x7f71780d2fa0 2024-03-12T17:18:53.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.147+0000 7f2d52a00640 1 -- 172.21.15.17:0/1882828400 <== osd.0 v2:172.21.15.17:6800/37305 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f2d3c0758f0 con 0x7f2d3c072e20 2024-03-12T17:18:53.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.147+0000 7f0577400640 1 -- 172.21.15.17:0/4238650766 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0570039c50 con 0x7f057c0eacc0 2024-03-12T17:18:53.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.147+0000 7f0577400640 1 -- 172.21.15.17:0/4238650766 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057003e040 con 0x7f057c0eacc0 2024-03-12T17:18:53.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.147+0000 7f0face00640 1 --2- 172.21.15.17:0/2536924317 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0fa80c7fc0 0x7f0fa81f9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.148+0000 7f0fa7400640 1 -- 172.21.15.17:0/2536924317 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0fa80c7fc0 msgr2=0x7f0fa81f9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.148+0000 7f0fa7400640 1 --2- 172.21.15.17:0/2536924317 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0fa80c7fc0 0x7f0fa81f9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.148+0000 7f0fa7400640 1 -- 172.21.15.17:0/2536924317 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0fa81f63b0 msgr2=0x7f0fa80b8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.148+0000 7f0fa7400640 1 --2- 172.21.15.17:0/2536924317 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0fa81f63b0 0x7f0fa80b8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.148+0000 7f0fa7400640 1 -- 172.21.15.17:0/2536924317 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa81f6790 con 0x7f0fa80c6160 2024-03-12T17:18:53.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.148+0000 7f28d0e00640 1 -- 172.21.15.17:0/1420422361 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f28cc161210 msgr2=0x7f28cc15de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.148+0000 7f28d0e00640 1 --2- 172.21.15.17:0/1420422361 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f28cc161210 0x7f28cc15de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.148+0000 7f28d0e00640 1 -- 172.21.15.17:0/1420422361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28cc0cf330 msgr2=0x7f28cc0b7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.148+0000 7f28d0e00640 1 --2- 172.21.15.17:0/1420422361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28cc0cf330 0x7f28cc0b7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.148+0000 7f28d0e00640 1 -- 172.21.15.17:0/1420422361 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b8009400 con 0x7f28cc160e30 2024-03-12T17:18:53.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.148+0000 7f717ce00640 1 --2- 172.21.15.17:0/690168622 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71780d2fa0 0x7f71780d3380 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f71780b4dc0 tx=0x7f716c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f22c21d7161697b1 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.149+0000 7f7177400640 1 -- 172.21.15.17:0/690168622 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c02e070 con 0x7f71780d2fa0 2024-03-12T17:18:53.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.149+0000 7f7177400640 1 -- 172.21.15.17:0/690168622 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716c0315a0 con 0x7f71780d2fa0 2024-03-12T17:18:53.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.149+0000 7f7177400640 1 -- 172.21.15.17:0/690168622 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c031930 con 0x7f71780d2fa0 2024-03-12T17:18:53.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.149+0000 7f28d0e00640 1 --2- 172.21.15.17:0/1420422361 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f28cc160e30 0x7f28cc1643f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f28c000d600 tx=0x7f28c000dac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.149+0000 7f1fe2800640 1 --2- 172.21.15.17:0/2899924982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fe40cfa70 0x7f1fe40cff00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1fe406ac90 tx=0x7f1fd402bb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bb010d5b982ce53 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.147+0000 7f27e0000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f27d80b1780 0x7f27d80b2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.147+0000 7f27e0000640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f27d8162680 0x7f27d80b2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.147+0000 7f27e0000640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d806d040 con 0x7f27d8161a80 2024-03-12T17:18:53.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.147+0000 7f27e0000640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d806ce40 con 0x7f27d80b1780 2024-03-12T17:18:53.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.147+0000 7f27e0000640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d806d320 con 0x7f27d8162680 2024-03-12T17:18:53.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.148+0000 7f27dd600640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f27d8161a80 0x7f27d8161e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:36924/0 (socket says 172.21.15.17:36924) 2024-03-12T17:18:53.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.149+0000 7f27dd600640 1 -- 172.21.15.17:0/2721900295 learned_addr learned my addr 172.21.15.17:0/2721900295 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:18:53.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.149+0000 7f27dcc00640 1 --2- 172.21.15.17:0/2721900295 >> v2:172.21.15.17:3300/0 conn(0x7f27d80b1780 0x7f27d80b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.149+0000 7f28c9600640 1 -- 172.21.15.17:0/1420422361 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c0014620 con 0x7f28cc160e30 2024-03-12T17:18:53.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.150+0000 7f0fa7400640 1 --2- 172.21.15.17:0/2536924317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fa80c6160 0x7f0fa80c7a80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0f98001940 tx=0x7f0f98001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.150+0000 7f1fe0a00640 1 -- 172.21.15.17:0/2899924982 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd402d6e0 con 0x7f1fe40cfa70 2024-03-12T17:18:53.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.150+0000 7f1fe0a00640 1 -- 172.21.15.17:0/2899924982 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd402d840 con 0x7f1fe40cfa70 2024-03-12T17:18:53.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.148+0000 7f0588e00640 1 -- 172.21.15.17:0/4238650766 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f057c050160 con 0x7f057c0eacc0 2024-03-12T17:18:53.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.150+0000 7f1fe0a00640 1 -- 172.21.15.17:0/2899924982 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd402d6e0 con 0x7f1fe40cfa70 2024-03-12T17:18:53.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.150+0000 7f3e79600640 1 Processor -- start 2024-03-12T17:18:53.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.150+0000 7f27de000640 1 --2- 172.21.15.17:0/2721900295 >> v2:172.21.15.94:3300/0 conn(0x7f27d8162680 0x7f27d80b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.150+0000 7f717f800640 1 -- 172.21.15.17:0/690168622 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71780d2fa0 msgr2=0x7f71780d3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.150+0000 7f717f800640 1 --2- 172.21.15.17:0/690168622 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71780d2fa0 0x7f71780d3380 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f71780b4dc0 tx=0x7f716c02b840 comp rx=0 tx=0).stop 2024-03-12T17:18:53.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.150+0000 7f717f800640 1 -- 172.21.15.17:0/690168622 shutdown_connections 2024-03-12T17:18:53.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.150+0000 7f717f800640 1 --2- 172.21.15.17:0/690168622 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f71780cd840 0x7f71780cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.150+0000 7f717f800640 1 --2- 172.21.15.17:0/690168622 >> v2:172.21.15.17:3300/0 conn(0x7f71780b5b50 0x7f71780b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.150+0000 7f717f800640 1 --2- 172.21.15.17:0/690168622 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71780d2fa0 0x7f71780d3380 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f71780b4dc0 tx=0x7f716c02b840 comp rx=0 tx=0).stop 2024-03-12T17:18:53.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.150+0000 7f717f800640 1 -- 172.21.15.17:0/690168622 >> 172.21.15.17:0/690168622 conn(0x7f7178065df0 msgr2=0x7f7178066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:53.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.150+0000 7f717f800640 1 -- 172.21.15.17:0/690168622 shutdown_connections 2024-03-12T17:18:53.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.150+0000 7f27d7e00640 1 -- 172.21.15.17:0/2721900295 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4023781386 0 0) 0x7f27d806d040 con 0x7f27d8161a80 2024-03-12T17:18:53.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.151+0000 7f27dcc00640 1 -- 172.21.15.17:0/2721900295 >> v2:172.21.15.94:3300/0 conn(0x7f27d8162680 msgr2=0x7f27d80b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:53.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.151+0000 7f27dcc00640 1 --2- 172.21.15.17:0/2721900295 >> v2:172.21.15.94:3300/0 conn(0x7f27d8162680 0x7f27d80b2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.151+0000 7f27dcc00640 1 -- 172.21.15.17:0/2721900295 >> v1:172.21.15.17:6789/0 conn(0x7f27d8161a80 legacy=0x7f27d8161e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.151+0000 7f27dcc00640 1 -- 172.21.15.17:0/2721900295 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d806d600 con 0x7f27d80b1780 2024-03-12T17:18:53.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.151+0000 7f0f9fe00640 1 -- 172.21.15.17:0/2536924317 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f98031430 con 0x7f0fa80c6160 2024-03-12T17:18:53.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.151+0000 7f0f9fe00640 1 -- 172.21.15.17:0/2536924317 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f98031590 con 0x7f0fa80c6160 2024-03-12T17:18:53.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.151+0000 7f0f9fe00640 1 -- 172.21.15.17:0/2536924317 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f98031920 con 0x7f0fa80c6160 2024-03-12T17:18:53.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.151+0000 7f0577400640 1 -- 172.21.15.17:0/4238650766 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f0570043390 con 0x7f057c0eacc0 2024-03-12T17:18:53.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.151+0000 7f1fe8e00640 1 -- 172.21.15.17:0/2899924982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fe40cfa70 msgr2=0x7f1fe40cff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.151+0000 7f1fe8e00640 1 --2- 172.21.15.17:0/2899924982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fe40cfa70 0x7f1fe40cff00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1fe406ac90 tx=0x7f1fd402bb30 comp rx=0 tx=0).stop 2024-03-12T17:18:53.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.151+0000 7f0fad800640 1 -- 172.21.15.17:0/2536924317 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa80c6900 con 0x7f0fa80c6160 2024-03-12T17:18:53.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.151+0000 7f0fad800640 1 -- 172.21.15.17:0/2536924317 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa80c6ec0 con 0x7f0fa80c6160 2024-03-12T17:18:53.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.151+0000 7f28c9600640 1 -- 172.21.15.17:0/1420422361 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c0014780 con 0x7f28cc160e30 2024-03-12T17:18:53.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.151+0000 7f28c9600640 1 -- 172.21.15.17:0/1420422361 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c0014b10 con 0x7f28cc160e30 2024-03-12T17:18:53.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.151+0000 7f28d2c00640 1 -- 172.21.15.17:0/1420422361 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28cc06d1a0 con 0x7f28cc160e30 2024-03-12T17:18:53.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.151+0000 7f717f800640 1 -- 172.21.15.17:0/690168622 wait complete. 2024-03-12T17:18:53.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.150+0000 7f3e79600640 1 -- start start 2024-03-12T17:18:53.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.152+0000 7f28d2c00640 1 -- 172.21.15.17:0/1420422361 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28cc15e340 con 0x7f28cc160e30 2024-03-12T17:18:53.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.153+0000 7f1fe8e00640 1 -- 172.21.15.17:0/2899924982 shutdown_connections 2024-03-12T17:18:53.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.153+0000 7f1fe8e00640 1 --2- 172.21.15.17:0/2899924982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fe40cfa70 0x7f1fe40cff00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.153+0000 7f1fe8e00640 1 --2- 172.21.15.17:0/2899924982 >> v2:172.21.15.94:3300/0 conn(0x7f1fe415cbd0 0x7f1fe40d0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.153+0000 7f1fe8e00640 1 -- 172.21.15.17:0/2899924982 >> 172.21.15.17:0/2899924982 conn(0x7f1fe4065df0 msgr2=0x7f1fe4066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:53.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.152+0000 7f3e79600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e740b4970 0x7f3e740cc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.152+0000 7f3e79600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3e7415caa0 0x7f3e740c8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.153+0000 7f3e79600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e740c9a80 0x7f3e74159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.153+0000 7f3e79600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e740c8340 con 0x7f3e740b4970 2024-03-12T17:18:53.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.153+0000 7f3e79600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e740ca5e0 con 0x7f3e740c9a80 2024-03-12T17:18:53.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.153+0000 7f3e79600640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e740ca8c0 con 0x7f3e7415caa0 2024-03-12T17:18:53.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.153+0000 7f0577400640 1 --2- 172.21.15.17:0/4238650766 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f056406ac60 0x7f056406d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.153+0000 7f0577400640 1 -- 172.21.15.17:0/4238650766 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f05700ab230 con 0x7f057c0eacc0 2024-03-12T17:18:53.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.153+0000 7f0577400640 1 --2- 172.21.15.17:0/4238650766 >> [v2:172.21.15.17:6808/37303,v1:172.21.15.17:6809/37303] conn(0x7f0564072e00 0x7f0564075220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.153+0000 7f0577400640 1 -- 172.21.15.17:0/4238650766 --> [v2:172.21.15.17:6808/37303,v1:172.21.15.17:6809/37303] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f05640758d0 con 0x7f0564072e00 2024-03-12T17:18:53.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.153+0000 7f0577400640 1 -- 172.21.15.17:0/4238650766 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05700ad8f0 con 0x7f057c0eacc0 2024-03-12T17:18:53.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.154+0000 7f28d2c00640 1 -- 172.21.15.17:0/1420422361 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f28cc1623d0 con 0x7f28cc160e30 2024-03-12T17:18:53.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.154+0000 7f0583400640 1 --2- 172.21.15.17:0/4238650766 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f056406ac60 0x7f056406d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.154+0000 7f0582a00640 1 --2- 172.21.15.17:0/4238650766 >> [v2:172.21.15.17:6808/37303,v1:172.21.15.17:6809/37303] conn(0x7f0564072e00 0x7f0564075220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.154+0000 7f3e78c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e740c9a80 0x7f3e74159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.154+0000 7f3e78c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e740c9a80 0x7f3e74159bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.17:53372/0 (socket says 172.21.15.17:53372) 2024-03-12T17:18:53.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.154+0000 7f3e78c00640 1 -- 172.21.15.17:0/3244620630 learned_addr learned my addr 172.21.15.17:0/3244620630 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:53.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.155+0000 7f3e73400640 1 --2- 172.21.15.17:0/3244620630 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3e7415caa0 0x7f3e740c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.155+0000 7f717f800640 1 Processor -- start 2024-03-12T17:18:53.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.155+0000 7f1fe8e00640 1 -- 172.21.15.17:0/2899924982 shutdown_connections 2024-03-12T17:18:53.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.155+0000 7f1fe8e00640 1 -- 172.21.15.17:0/2899924982 wait complete. 2024-03-12T17:18:53.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.152+0000 7f0fad800640 1 -- 172.21.15.17:0/2536924317 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0f80000fc0 con 0x7f0fa80c6160 2024-03-12T17:18:53.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.155+0000 7f717f800640 1 -- start start 2024-03-12T17:18:53.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.155+0000 7f0582a00640 1 --2- 172.21.15.17:0/4238650766 >> [v2:172.21.15.17:6808/37303,v1:172.21.15.17:6809/37303] conn(0x7f0564072e00 0x7f0564075220 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.155+0000 7f0583400640 1 --2- 172.21.15.17:0/4238650766 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f056406ac60 0x7f056406d120 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0584063640 tx=0x7f0584074ce0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.155+0000 7f3e73e00640 1 --2- 172.21.15.17:0/3244620630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e740b4970 0x7f3e740cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.155+0000 7f3e78c00640 1 -- 172.21.15.17:0/3244620630 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3e7415caa0 msgr2=0x7f3e740c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.155+0000 7f3e78c00640 1 --2- 172.21.15.17:0/3244620630 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3e7415caa0 0x7f3e740c8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.155+0000 7f3e78c00640 1 -- 172.21.15.17:0/3244620630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e740b4970 msgr2=0x7f3e740cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.155+0000 7f3e78c00640 1 --2- 172.21.15.17:0/3244620630 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3e740b4970 0x7f3e740cc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.155+0000 7f3e78c00640 1 -- 172.21.15.17:0/3244620630 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e6c009a70 con 0x7f3e740c9a80 2024-03-12T17:18:53.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.156+0000 7f27dcc00640 1 --2- 172.21.15.17:0/2721900295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27d80b1780 0x7f27d80b2120 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f27d806c970 tx=0x7f27cc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e00a7fdfa27c0d0d server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.156+0000 7f28c9600640 1 -- 172.21.15.17:0/1420422361 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f28c0014c70 con 0x7f28cc160e30 2024-03-12T17:18:53.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.156+0000 7f3e78c00640 1 --2- 172.21.15.17:0/3244620630 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e740c9a80 0x7f3e74159bc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3e6000b3f0 tx=0x7f3e6000b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.157+0000 7f0577400640 1 -- 172.21.15.17:0/4238650766 <== osd.2 v2:172.21.15.17:6808/37303 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f05640758d0 con 0x7f0564072e00 2024-03-12T17:18:53.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.156+0000 7f717f800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71780b5b50 0x7f717815d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.156+0000 7f717f800640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f71780cd840 0x7f717815f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.156+0000 7f717f800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f717815de90 0x7f717815fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.156+0000 7f717f800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71780c6c80 con 0x7f717815de90 2024-03-12T17:18:53.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.156+0000 7f717f800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71781600b0 con 0x7f71780b5b50 2024-03-12T17:18:53.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.156+0000 7f717f800640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71781585f0 con 0x7f71780cd840 2024-03-12T17:18:53.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.157+0000 7f28c9600640 1 --2- 172.21.15.17:0/1420422361 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f28ac06acd0 0x7f28ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.157+0000 7f0f9fe00640 1 -- 172.21.15.17:0/2536924317 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f0f98039070 con 0x7f0fa80c6160 2024-03-12T17:18:53.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.157+0000 7f1fe8e00640 1 Processor -- start 2024-03-12T17:18:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.157+0000 7f27d7e00640 1 -- 172.21.15.17:0/2721900295 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc031830 con 0x7f27d80b1780 2024-03-12T17:18:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.157+0000 7f27d7e00640 1 -- 172.21.15.17:0/2721900295 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27cc031990 con 0x7f27d80b1780 2024-03-12T17:18:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.157+0000 7f27d7e00640 1 -- 172.21.15.17:0/2721900295 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc031d20 con 0x7f27d80b1780 2024-03-12T17:18:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.158+0000 7f3e6be00640 1 -- 172.21.15.17:0/3244620630 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e60011830 con 0x7f3e740c9a80 2024-03-12T17:18:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.158+0000 7f3e6be00640 1 -- 172.21.15.17:0/3244620630 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e60011990 con 0x7f3e740c9a80 2024-03-12T17:18:53.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.158+0000 7f3e6be00640 1 -- 172.21.15.17:0/3244620630 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e60011d40 con 0x7f3e740c9a80 2024-03-12T17:18:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.157+0000 7f717ce00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71780b5b50 0x7f717815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.157+0000 7f717ce00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71780b5b50 0x7f717815d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.17:53374/0 (socket says 172.21.15.17:53374) 2024-03-12T17:18:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.157+0000 7f717ce00640 1 -- 172.21.15.17:0/466402283 learned_addr learned my addr 172.21.15.17:0/466402283 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.157+0000 7f7177e00640 1 --2- 172.21.15.17:0/466402283 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f71780cd840 0x7f717815f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.158+0000 7f717ce00640 1 -- 172.21.15.17:0/466402283 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f71780cd840 msgr2=0x7f717815f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.158+0000 7f717ce00640 1 --2- 172.21.15.17:0/466402283 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f71780cd840 0x7f717815f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.158+0000 7f717ce00640 1 -- 172.21.15.17:0/466402283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f717815de90 msgr2=0x7f717815fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.158+0000 7f717ce00640 1 --2- 172.21.15.17:0/466402283 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f717815de90 0x7f717815fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.158+0000 7f717ce00640 1 -- 172.21.15.17:0/466402283 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716c009400 con 0x7f71780b5b50 2024-03-12T17:18:53.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.158+0000 7f7177e00640 1 --2- 172.21.15.17:0/466402283 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f71780cd840 0x7f717815f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:18:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.158+0000 7f28c9600640 1 -- 172.21.15.17:0/1420422361 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f28c0089840 con 0x7f28cc160e30 2024-03-12T17:18:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.158+0000 7f28c9600640 1 --2- 172.21.15.17:0/1420422361 >> [v2:172.21.15.17:6812/37307,v1:172.21.15.17:6814/37307] conn(0x7f28ac072e70 0x7f28ac075290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.158+0000 7f28c9600640 1 -- 172.21.15.17:0/1420422361 --> [v2:172.21.15.17:6812/37307,v1:172.21.15.17:6814/37307] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f28ac075940 con 0x7f28ac072e70 2024-03-12T17:18:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.158+0000 7f28c9600640 1 -- 172.21.15.17:0/1420422361 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f28c00548c0 con 0x7f28cc160e30 2024-03-12T17:18:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.158+0000 7f27e0000640 1 -- 172.21.15.17:0/2721900295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27d80b1780 msgr2=0x7f27d80b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.158+0000 7f27e0000640 1 --2- 172.21.15.17:0/2721900295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27d80b1780 0x7f27d80b2120 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f27d806c970 tx=0x7f27cc02b8d0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.158+0000 7f0f9fe00640 1 --2- 172.21.15.17:0/2536924317 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f0f8806acd0 0x7f0f8806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.158+0000 7f0f9fe00640 1 -- 172.21.15.17:0/2536924317 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f980ab700 con 0x7f0fa80c6160 2024-03-12T17:18:53.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.158+0000 7f717ce00640 1 --2- 172.21.15.17:0/466402283 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71780b5b50 0x7f717815d950 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f716c02bdd0 tx=0x7f716c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.159+0000 7f28d2200640 1 --2- 172.21.15.17:0/1420422361 >> [v2:172.21.15.17:6812/37307,v1:172.21.15.17:6814/37307] conn(0x7f28ac072e70 0x7f28ac075290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.159+0000 7f0f9fe00640 1 --2- 172.21.15.17:0/2536924317 >> [v2:172.21.15.17:6820/37308,v1:172.21.15.17:6822/37308] conn(0x7f0f88072ef0 0x7f0f88075310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.159+0000 7f0f9fe00640 1 -- 172.21.15.17:0/2536924317 --> [v2:172.21.15.17:6820/37308,v1:172.21.15.17:6822/37308] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0f880759c0 con 0x7f0f88072ef0 2024-03-12T17:18:53.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.159+0000 7f0f9fe00640 1 -- 172.21.15.17:0/2536924317 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f980abab0 con 0x7f0fa80c6160 2024-03-12T17:18:53.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.159+0000 7f0fa7e00640 1 --2- 172.21.15.17:0/2536924317 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f0f8806acd0 0x7f0f8806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.159+0000 7f28d1800640 1 --2- 172.21.15.17:0/1420422361 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f28ac06acd0 0x7f28ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.159+0000 7f3e79600640 1 -- 172.21.15.17:0/3244620630 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e740c7f60 con 0x7f3e740c9a80 2024-03-12T17:18:53.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.159+0000 7f3e79600640 1 -- 172.21.15.17:0/3244620630 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e740caba0 con 0x7f3e740c9a80 2024-03-12T17:18:53.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.159+0000 7f7174c00640 1 -- 172.21.15.17:0/466402283 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c031f10 con 0x7f71780b5b50 2024-03-12T17:18:53.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.159+0000 7f7174c00640 1 -- 172.21.15.17:0/466402283 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716c032860 con 0x7f71780b5b50 2024-03-12T17:18:53.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.159+0000 7f7174c00640 1 -- 172.21.15.17:0/466402283 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716c032c10 con 0x7f71780b5b50 2024-03-12T17:18:53.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.159+0000 7f717f800640 1 -- 172.21.15.17:0/466402283 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71781588d0 con 0x7f71780b5b50 2024-03-12T17:18:53.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.159+0000 7f717f800640 1 -- 172.21.15.17:0/466402283 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71780c6ed0 con 0x7f71780b5b50 2024-03-12T17:18:53.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.160+0000 7f27e0000640 1 -- 172.21.15.17:0/2721900295 shutdown_connections 2024-03-12T17:18:53.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.160+0000 7f27e0000640 1 --2- 172.21.15.17:0/2721900295 >> v2:172.21.15.94:3300/0 conn(0x7f27d8162680 0x7f27d80b2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.160+0000 7f27e0000640 1 --2- 172.21.15.17:0/2721900295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27d80b1780 0x7f27d80b2120 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.160+0000 7f27e0000640 1 -- 172.21.15.17:0/2721900295 >> 172.21.15.17:0/2721900295 conn(0x7f27d8069ce0 msgr2=0x7f27d806a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:53.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.160+0000 7f0face00640 1 --2- 172.21.15.17:0/2536924317 >> [v2:172.21.15.17:6820/37308,v1:172.21.15.17:6822/37308] conn(0x7f0f88072ef0 0x7f0f88075310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.161+0000 7f717f800640 1 -- 172.21.15.17:0/466402283 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7154000fc0 con 0x7f71780b5b50 2024-03-12T17:18:53.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.161+0000 7f0fa7e00640 1 --2- 172.21.15.17:0/2536924317 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f0f8806acd0 0x7f0f8806d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0fa80cf360 tx=0x7f0f94009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.161+0000 7f28d2200640 1 --2- 172.21.15.17:0/1420422361 >> [v2:172.21.15.17:6812/37307,v1:172.21.15.17:6814/37307] conn(0x7f28ac072e70 0x7f28ac075290 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.161+0000 7f0face00640 1 --2- 172.21.15.17:0/2536924317 >> [v2:172.21.15.17:6820/37308,v1:172.21.15.17:6822/37308] conn(0x7f0f88072ef0 0x7f0f88075310 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.162+0000 7f0f9fe00640 1 -- 172.21.15.17:0/2536924317 <== osd.3 v2:172.21.15.17:6820/37308 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f0f880759c0 con 0x7f0f88072ef0 2024-03-12T17:18:53.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.161+0000 7f3e79600640 1 -- 172.21.15.17:0/3244620630 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3e740d0c90 con 0x7f3e740c9a80 2024-03-12T17:18:53.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.161+0000 7f1fe8e00640 1 -- start start 2024-03-12T17:18:53.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.161+0000 7f27e0000640 1 -- 172.21.15.17:0/2721900295 shutdown_connections 2024-03-12T17:18:53.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.162+0000 7f1fe8e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1fe40b5aa0 0x7f1fe40c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.162+0000 7f1fe8e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1fe40cfa70 0x7f1fe414d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.162+0000 7f1fe8e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fe415cbd0 0x7f1fe40c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.163+0000 7f1fe8e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe414bc00 con 0x7f1fe415cbd0 2024-03-12T17:18:53.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.163+0000 7f1fe8e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe414c460 con 0x7f1fe40cfa70 2024-03-12T17:18:53.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.163+0000 7f1fe8e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fe414c740 con 0x7f1fe40b5aa0 2024-03-12T17:18:53.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.163+0000 7f28c9600640 1 -- 172.21.15.17:0/1420422361 <== osd.1 v2:172.21.15.17:6812/37307 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f28ac075940 con 0x7f28ac072e70 2024-03-12T17:18:53.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.162+0000 7f3e6be00640 1 -- 172.21.15.17:0/3244620630 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f3e6001a400 con 0x7f3e740c9a80 2024-03-12T17:18:53.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.163+0000 7f28d1800640 1 --2- 172.21.15.17:0/1420422361 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f28ac06acd0 0x7f28ac06d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f28b8036000 tx=0x7f28b803c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.163+0000 7f1fe1e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1fe40b5aa0 0x7f1fe40c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.163+0000 7f1fe1400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1fe40cfa70 0x7f1fe414d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.163+0000 7f1fe1e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1fe40b5aa0 0x7f1fe40c8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.17:35876/0 (socket says 172.21.15.17:35876) 2024-03-12T17:18:53.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.163+0000 7f1fe1e00640 1 -- 172.21.15.17:0/1690201546 learned_addr learned my addr 172.21.15.17:0/1690201546 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:53.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.163+0000 7f3e6be00640 1 --2- 172.21.15.17:0/3244620630 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f3e5406acd0 0x7f3e5406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.163+0000 7f3e6be00640 1 -- 172.21.15.17:0/3244620630 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3e600899e0 con 0x7f3e740c9a80 2024-03-12T17:18:53.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.164+0000 7f3e6be00640 1 --2- 172.21.15.17:0/3244620630 >> [v2:172.21.15.94:6808/37465,v1:172.21.15.94:6809/37465] conn(0x7f3e54072ef0 0x7f3e54075310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.164+0000 7f3e6be00640 1 -- 172.21.15.17:0/3244620630 --> [v2:172.21.15.94:6808/37465,v1:172.21.15.94:6809/37465] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3e540759c0 con 0x7f3e54072ef0 2024-03-12T17:18:53.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.164+0000 7f3e6be00640 1 -- 172.21.15.17:0/3244620630 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e60089d90 con 0x7f3e740c9a80 2024-03-12T17:18:53.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.164+0000 7f7174c00640 1 -- 172.21.15.17:0/466402283 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f716c04e440 con 0x7f71780b5b50 2024-03-12T17:18:53.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.161+0000 7f27e0000640 1 -- 172.21.15.17:0/2721900295 wait complete. 2024-03-12T17:18:53.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.164+0000 7f1fe1e00640 1 -- 172.21.15.17:0/1690201546 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1fe40cfa70 msgr2=0x7f1fe414d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.164+0000 7f1fe1e00640 1 --2- 172.21.15.17:0/1690201546 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1fe40cfa70 0x7f1fe414d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.165+0000 7f3e73e00640 1 --2- 172.21.15.17:0/3244620630 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f3e5406acd0 0x7f3e5406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.165+0000 7f3e73400640 1 --2- 172.21.15.17:0/3244620630 >> [v2:172.21.15.94:6808/37465,v1:172.21.15.94:6809/37465] conn(0x7f3e54072ef0 0x7f3e54075310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.164+0000 7f1fe1e00640 1 -- 172.21.15.17:0/1690201546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fe415cbd0 msgr2=0x7f1fe40c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.164+0000 7f1fe1e00640 1 --2- 172.21.15.17:0/1690201546 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1fe415cbd0 0x7f1fe40c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.164+0000 7f1fe1e00640 1 -- 172.21.15.17:0/1690201546 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd4009400 con 0x7f1fe40b5aa0 2024-03-12T17:18:53.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.165+0000 7f1fe1e00640 1 --2- 172.21.15.17:0/1690201546 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1fe40b5aa0 0x7f1fe40c8c20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc00efc0 tx=0x7f1fdc00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.165+0000 7f1fda000640 1 -- 172.21.15.17:0/1690201546 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc014480 con 0x7f1fe40b5aa0 2024-03-12T17:18:53.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.165+0000 7f7174c00640 1 --2- 172.21.15.17:0/466402283 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f715806acd0 0x7f715806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.165+0000 7f1fda000640 1 -- 172.21.15.17:0/1690201546 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fdc00f040 con 0x7f1fe40b5aa0 2024-03-12T17:18:53.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.166+0000 7f1fda000640 1 -- 172.21.15.17:0/1690201546 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc014820 con 0x7f1fe40b5aa0 2024-03-12T17:18:53.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.166+0000 7f7174c00640 1 -- 172.21.15.17:0/466402283 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f716c0ab690 con 0x7f71780b5b50 2024-03-12T17:18:53.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.166+0000 7f7174c00640 1 --2- 172.21.15.17:0/466402283 >> [v2:172.21.15.94:6824/37467,v1:172.21.15.94:6825/37467] conn(0x7f7158072ef0 0x7f7158075310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.165+0000 7f27e0000640 1 Processor -- start 2024-03-12T17:18:53.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.167+0000 7f27e0000640 1 -- start start 2024-03-12T17:18:53.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.166+0000 7f3e73400640 1 --2- 172.21.15.17:0/3244620630 >> [v2:172.21.15.94:6808/37465,v1:172.21.15.94:6809/37465] conn(0x7f3e54072ef0 0x7f3e54075310 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.167+0000 7f717d800640 1 --2- 172.21.15.17:0/466402283 >> [v2:172.21.15.94:6824/37467,v1:172.21.15.94:6825/37467] conn(0x7f7158072ef0 0x7f7158075310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.166+0000 7f7174c00640 1 -- 172.21.15.17:0/466402283 --> [v2:172.21.15.94:6824/37467,v1:172.21.15.94:6825/37467] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f71580759c0 con 0x7f7158072ef0 2024-03-12T17:18:53.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.167+0000 7f7174c00640 1 -- 172.21.15.17:0/466402283 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f716c0aba40 con 0x7f71780b5b50 2024-03-12T17:18:53.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.166+0000 7f1fe8e00640 1 -- 172.21.15.17:0/1690201546 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fe414ca20 con 0x7f1fe40b5aa0 2024-03-12T17:18:53.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.167+0000 7f3e73e00640 1 --2- 172.21.15.17:0/3244620630 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f3e5406acd0 0x7f3e5406d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3e741f9e80 tx=0x7f3e64008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.166+0000 7f1fe8e00640 1 -- 172.21.15.17:0/1690201546 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fe414cfe0 con 0x7f1fe40b5aa0 2024-03-12T17:18:53.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.167+0000 7f1fe8e00640 1 -- 172.21.15.17:0/1690201546 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1fe40b5ee0 con 0x7f1fe40b5aa0 2024-03-12T17:18:53.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.168+0000 7f7177e00640 1 --2- 172.21.15.17:0/466402283 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f715806acd0 0x7f715806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.168+0000 7f717d800640 1 --2- 172.21.15.17:0/466402283 >> [v2:172.21.15.94:6824/37467,v1:172.21.15.94:6825/37467] conn(0x7f7158072ef0 0x7f7158075310 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.168+0000 7f7177e00640 1 --2- 172.21.15.17:0/466402283 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f715806acd0 0x7f715806d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f71780ca820 tx=0x7f7164008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.169+0000 7f3e6be00640 1 -- 172.21.15.17:0/3244620630 <== osd.4 v2:172.21.15.94:6808/37465 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f3e540759c0 con 0x7f3e54072ef0 2024-03-12T17:18:53.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.169+0000 7f27e0000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27d80b1780 0x7f27d80acfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.170+0000 7f27e0000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27d8161a80 0x7f27d81f9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.170+0000 7f27e0000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f27d8162680 0x7f27d8152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.170+0000 7f7174c00640 1 -- 172.21.15.17:0/466402283 <== osd.6 v2:172.21.15.94:6824/37467 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f71580759c0 con 0x7f7158072ef0 2024-03-12T17:18:53.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.170+0000 7f27dd600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27d80b1780 0x7f27d80acfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.170+0000 7f27dcc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27d8161a80 0x7f27d81f9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.171+0000 7f27dd600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27d80b1780 0x7f27d80acfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.17:53392/0 (socket says 172.21.15.17:53392) 2024-03-12T17:18:53.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.171+0000 7f27dd600640 1 -- 172.21.15.17:0/3904294553 learned_addr learned my addr 172.21.15.17:0/3904294553 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:53.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.171+0000 7f27de000640 1 --2- 172.21.15.17:0/3904294553 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f27d8162680 0x7f27d8152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.171+0000 7f27e0000640 1 -- 172.21.15.17:0/3904294553 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d80b0250 con 0x7f27d8161a80 2024-03-12T17:18:53.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.171+0000 7f27e0000640 1 -- 172.21.15.17:0/3904294553 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d80ad4e0 con 0x7f27d80b1780 2024-03-12T17:18:53.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.171+0000 7f27e0000640 1 -- 172.21.15.17:0/3904294553 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d80a8930 con 0x7f27d8162680 2024-03-12T17:18:53.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.172+0000 7f27dd600640 1 -- 172.21.15.17:0/3904294553 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f27d8162680 msgr2=0x7f27d8152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.172+0000 7f27dd600640 1 --2- 172.21.15.17:0/3904294553 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f27d8162680 0x7f27d8152b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.172+0000 7f27dd600640 1 -- 172.21.15.17:0/3904294553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27d8161a80 msgr2=0x7f27d81f9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.172+0000 7f27dd600640 1 --2- 172.21.15.17:0/3904294553 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27d8161a80 0x7f27d81f9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.172+0000 7f27dd600640 1 -- 172.21.15.17:0/3904294553 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27cc009400 con 0x7f27d80b1780 2024-03-12T17:18:53.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.172+0000 7f27dd600640 1 --2- 172.21.15.17:0/3904294553 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27d80b1780 0x7f27d80acfa0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f27c400c4d0 tx=0x7f27c400c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.173+0000 7f27d5600640 1 -- 172.21.15.17:0/3904294553 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c40074e0 con 0x7f27d80b1780 2024-03-12T17:18:53.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.173+0000 7f27d5600640 1 -- 172.21.15.17:0/3904294553 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c4007640 con 0x7f27d80b1780 2024-03-12T17:18:53.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.173+0000 7f27d5600640 1 -- 172.21.15.17:0/3904294553 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c4004a00 con 0x7f27d80b1780 2024-03-12T17:18:53.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.173+0000 7f1fda000640 1 -- 172.21.15.17:0/1690201546 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f1fdc014980 con 0x7f1fe40b5aa0 2024-03-12T17:18:53.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.174+0000 7f27e0000640 1 -- 172.21.15.17:0/3904294553 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d80b04a0 con 0x7f27d80b1780 2024-03-12T17:18:53.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.174+0000 7f27e0000640 1 -- 172.21.15.17:0/3904294553 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d80b0a60 con 0x7f27d80b1780 2024-03-12T17:18:53.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.175+0000 7f1fda000640 1 --2- 172.21.15.17:0/1690201546 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f1fc406acd0 0x7f1fc406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.175+0000 7f27e0000640 1 -- 172.21.15.17:0/3904294553 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f27d806dbc0 con 0x7f27d80b1780 2024-03-12T17:18:53.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.175+0000 7f1fda000640 1 -- 172.21.15.17:0/1690201546 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1fdc08ab10 con 0x7f1fe40b5aa0 2024-03-12T17:18:53.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.175+0000 7f1fe1400640 1 --2- 172.21.15.17:0/1690201546 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f1fc406acd0 0x7f1fc406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.176+0000 7f1fda000640 1 --2- 172.21.15.17:0/1690201546 >> [v2:172.21.15.94:6810/37464,v1:172.21.15.94:6812/37464] conn(0x7f1fc4072ef0 0x7f1fc4075310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.177+0000 7f1fda000640 1 -- 172.21.15.17:0/1690201546 --> [v2:172.21.15.94:6810/37464,v1:172.21.15.94:6812/37464] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1fc40759c0 con 0x7f1fc4072ef0 2024-03-12T17:18:53.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.177+0000 7f1fda000640 1 -- 172.21.15.17:0/1690201546 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1fdc08aec0 con 0x7f1fe40b5aa0 2024-03-12T17:18:53.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.177+0000 7f1fe1400640 1 --2- 172.21.15.17:0/1690201546 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f1fc406acd0 0x7f1fc406d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1fe415bf60 tx=0x7f1fd0007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.178+0000 7f27d5600640 1 -- 172.21.15.17:0/3904294553 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f27c4004b60 con 0x7f27d80b1780 2024-03-12T17:18:53.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.178+0000 7f27d5600640 1 --2- 172.21.15.17:0/3904294553 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f27b806ac30 0x7f27b806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.179+0000 7f27d5600640 1 -- 172.21.15.17:0/3904294553 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27c4088b00 con 0x7f27d80b1780 2024-03-12T17:18:53.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.179+0000 7f27d5600640 1 --2- 172.21.15.17:0/3904294553 >> [v2:172.21.15.94:6800/37466,v1:172.21.15.94:6801/37466] conn(0x7f27b8072dd0 0x7f27b80751f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.179+0000 7f27dcc00640 1 --2- 172.21.15.17:0/3904294553 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f27b806ac30 0x7f27b806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.180+0000 7f1fe2800640 1 --2- 172.21.15.17:0/1690201546 >> [v2:172.21.15.94:6810/37464,v1:172.21.15.94:6812/37464] conn(0x7f1fc4072ef0 0x7f1fc4075310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.180+0000 7f27d5600640 1 -- 172.21.15.17:0/3904294553 --> [v2:172.21.15.94:6800/37466,v1:172.21.15.94:6801/37466] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f27b80758a0 con 0x7f27b8072dd0 2024-03-12T17:18:53.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.180+0000 7f27d5600640 1 -- 172.21.15.17:0/3904294553 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27c4088f50 con 0x7f27d80b1780 2024-03-12T17:18:53.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.180+0000 7f27dcc00640 1 --2- 172.21.15.17:0/3904294553 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f27b806ac30 0x7f27b806d0f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f27cc036000 tx=0x7f27cc03c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.181+0000 7f27de000640 1 --2- 172.21.15.17:0/3904294553 >> [v2:172.21.15.94:6800/37466,v1:172.21.15.94:6801/37466] conn(0x7f27b8072dd0 0x7f27b80751f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.181+0000 7f1fe2800640 1 --2- 172.21.15.17:0/1690201546 >> [v2:172.21.15.94:6810/37464,v1:172.21.15.94:6812/37464] conn(0x7f1fc4072ef0 0x7f1fc4075310 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.182+0000 7f27de000640 1 --2- 172.21.15.17:0/3904294553 >> [v2:172.21.15.94:6800/37466,v1:172.21.15.94:6801/37466] conn(0x7f27b8072dd0 0x7f27b80751f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.182+0000 7f2d60a00640 1 -- 172.21.15.17:0/1882828400 --> [v2:172.21.15.17:6800/37305,v1:172.21.15.17:6801/37305] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2d540583b0 con 0x7f2d3c072e20 2024-03-12T17:18:53.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.183+0000 7f2d52a00640 1 -- 172.21.15.17:0/1882828400 <== osd.0 v2:172.21.15.17:6800/37305 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2d3c0758f0 con 0x7f2d3c072e20 2024-03-12T17:18:53.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.184+0000 7f2d60a00640 1 -- 172.21.15.17:0/1882828400 >> [v2:172.21.15.17:6800/37305,v1:172.21.15.17:6801/37305] conn(0x7f2d3c072e20 msgr2=0x7f2d3c075240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.184+0000 7f2d60a00640 1 --2- 172.21.15.17:0/1882828400 >> [v2:172.21.15.17:6800/37305,v1:172.21.15.17:6801/37305] conn(0x7f2d3c072e20 0x7f2d3c075240 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.184+0000 7f2d60a00640 1 -- 172.21.15.17:0/1882828400 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f2d3c06ac00 msgr2=0x7f2d3c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.184+0000 7f2d60a00640 1 --2- 172.21.15.17:0/1882828400 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f2d3c06ac00 0x7f2d3c06d0c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c000f60 tx=0x7f2d4c0079b0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.184+0000 7f2d60a00640 1 -- 172.21.15.17:0/1882828400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d54006d80 msgr2=0x7f2d540df090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.184+0000 7f2d60a00640 1 --2- 172.21.15.17:0/1882828400 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2d54006d80 0x7f2d540df090 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c063b00 tx=0x7f2d5c0676e0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.184+0000 7f2d5b200640 1 -- 172.21.15.17:0/1882828400 reap_dead start 2024-03-12T17:18:53.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.184+0000 7f2d60a00640 1 -- 172.21.15.17:0/1882828400 shutdown_connections 2024-03-12T17:18:53.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.184+0000 7f2d60a00640 1 -- 172.21.15.17:0/1882828400 >> 172.21.15.17:0/1882828400 conn(0x7f2d54058ec0 msgr2=0x7f2d540592a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:53.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.184+0000 7f1fda000640 1 -- 172.21.15.17:0/1690201546 <== osd.5 v2:172.21.15.94:6810/37464 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f1fc40759c0 con 0x7f1fc4072ef0 2024-03-12T17:18:53.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.185+0000 7f27d5600640 1 -- 172.21.15.17:0/3904294553 <== osd.7 v2:172.21.15.94:6800/37466 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f27b80758a0 con 0x7f27b8072dd0 2024-03-12T17:18:53.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.186+0000 7f2d60a00640 1 -- 172.21.15.17:0/1882828400 shutdown_connections 2024-03-12T17:18:53.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.186+0000 7f2d60a00640 1 -- 172.21.15.17:0/1882828400 wait complete. 2024-03-12T17:18:53.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.187+0000 7f28d2c00640 1 -- 172.21.15.17:0/1420422361 --> [v2:172.21.15.17:6812/37307,v1:172.21.15.17:6814/37307] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f28cc0cd8a0 con 0x7f28ac072e70 2024-03-12T17:18:53.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.187+0000 7f28c9600640 1 -- 172.21.15.17:0/1420422361 <== osd.1 v2:172.21.15.17:6812/37307 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f28c4001b90 con 0x7f28ac072e70 2024-03-12T17:18:53.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.191+0000 7f0588e00640 1 -- 172.21.15.17:0/4238650766 --> [v2:172.21.15.17:6808/37303,v1:172.21.15.17:6809/37303] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f057c005280 con 0x7f0564072e00 2024-03-12T17:18:53.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.191+0000 7f28d2c00640 1 -- 172.21.15.17:0/1420422361 >> [v2:172.21.15.17:6812/37307,v1:172.21.15.17:6814/37307] conn(0x7f28ac072e70 msgr2=0x7f28ac075290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.191+0000 7f28d2c00640 1 --2- 172.21.15.17:0/1420422361 >> [v2:172.21.15.17:6812/37307,v1:172.21.15.17:6814/37307] conn(0x7f28ac072e70 0x7f28ac075290 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.192+0000 7f28d2c00640 1 -- 172.21.15.17:0/1420422361 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f28ac06acd0 msgr2=0x7f28ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.192+0000 7f28d2c00640 1 --2- 172.21.15.17:0/1420422361 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f28ac06acd0 0x7f28ac06d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f28b8036000 tx=0x7f28b803c040 comp rx=0 tx=0).stop 2024-03-12T17:18:53.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.192+0000 7f28d2c00640 1 -- 172.21.15.17:0/1420422361 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f28cc160e30 msgr2=0x7f28cc1643f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.192+0000 7f28d2c00640 1 --2- 172.21.15.17:0/1420422361 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f28cc160e30 0x7f28cc1643f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f28c000d600 tx=0x7f28c000dac0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.192+0000 7f28d2200640 1 -- 172.21.15.17:0/1420422361 reap_dead start 2024-03-12T17:18:53.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.192+0000 7f28d2c00640 1 -- 172.21.15.17:0/1420422361 shutdown_connections 2024-03-12T17:18:53.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.192+0000 7f28d2c00640 1 -- 172.21.15.17:0/1420422361 >> 172.21.15.17:0/1420422361 conn(0x7f28cc06b160 msgr2=0x7f28cc164a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:53.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.192+0000 7f28d2c00640 1 -- 172.21.15.17:0/1420422361 shutdown_connections 2024-03-12T17:18:53.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.192+0000 7f28d2c00640 1 -- 172.21.15.17:0/1420422361 wait complete. 2024-03-12T17:18:53.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.194+0000 7f0fad800640 1 -- 172.21.15.17:0/2536924317 --> [v2:172.21.15.17:6820/37308,v1:172.21.15.17:6822/37308] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0f80002cb0 con 0x7f0f88072ef0 2024-03-12T17:18:53.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.195+0000 7f0f9fe00640 1 -- 172.21.15.17:0/2536924317 <== osd.3 v2:172.21.15.17:6820/37308 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0f80002cb0 con 0x7f0f88072ef0 2024-03-12T17:18:53.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.196+0000 7f0577400640 1 -- 172.21.15.17:0/4238650766 <== osd.2 v2:172.21.15.17:6808/37303 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f057c005280 con 0x7f0564072e00 2024-03-12T17:18:53.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.196+0000 7f0588e00640 1 -- 172.21.15.17:0/4238650766 >> [v2:172.21.15.17:6808/37303,v1:172.21.15.17:6809/37303] conn(0x7f0564072e00 msgr2=0x7f0564075220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.196+0000 7f0588e00640 1 --2- 172.21.15.17:0/4238650766 >> [v2:172.21.15.17:6808/37303,v1:172.21.15.17:6809/37303] conn(0x7f0564072e00 0x7f0564075220 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.196+0000 7f0fad800640 1 -- 172.21.15.17:0/2536924317 >> [v2:172.21.15.17:6820/37308,v1:172.21.15.17:6822/37308] conn(0x7f0f88072ef0 msgr2=0x7f0f88075310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.196+0000 7f0fad800640 1 --2- 172.21.15.17:0/2536924317 >> [v2:172.21.15.17:6820/37308,v1:172.21.15.17:6822/37308] conn(0x7f0f88072ef0 0x7f0f88075310 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.196+0000 7f0fad800640 1 -- 172.21.15.17:0/2536924317 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f0f8806acd0 msgr2=0x7f0f8806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.196+0000 7f0fad800640 1 --2- 172.21.15.17:0/2536924317 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f0f8806acd0 0x7f0f8806d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0fa80cf360 tx=0x7f0f94009190 comp rx=0 tx=0).stop 2024-03-12T17:18:53.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.196+0000 7f0fad800640 1 -- 172.21.15.17:0/2536924317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fa80c6160 msgr2=0x7f0fa80c7a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.196+0000 7f0fad800640 1 --2- 172.21.15.17:0/2536924317 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fa80c6160 0x7f0fa80c7a80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0f98001940 tx=0x7f0f98001250 comp rx=0 tx=0).stop 2024-03-12T17:18:53.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.197+0000 7f0face00640 1 -- 172.21.15.17:0/2536924317 reap_dead start 2024-03-12T17:18:53.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.197+0000 7f0fad800640 1 -- 172.21.15.17:0/2536924317 shutdown_connections 2024-03-12T17:18:53.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.197+0000 7f0fad800640 1 -- 172.21.15.17:0/2536924317 >> 172.21.15.17:0/2536924317 conn(0x7f0fa80cf820 msgr2=0x7f0fa8162720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:53.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.197+0000 7f0fad800640 1 -- 172.21.15.17:0/2536924317 shutdown_connections 2024-03-12T17:18:53.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.197+0000 7f0fad800640 1 -- 172.21.15.17:0/2536924317 wait complete. 2024-03-12T17:18:53.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.198+0000 7f0588e00640 1 -- 172.21.15.17:0/4238650766 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f056406ac60 msgr2=0x7f056406d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.198+0000 7f0588e00640 1 --2- 172.21.15.17:0/4238650766 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f056406ac60 0x7f056406d120 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0584063640 tx=0x7f0584074ce0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.198+0000 7f0588e00640 1 -- 172.21.15.17:0/4238650766 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f057c0eacc0 msgr2=0x7f057c17f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.198+0000 7f0588e00640 1 --2- 172.21.15.17:0/4238650766 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f057c0eacc0 0x7f057c17f680 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0570033000 tx=0x7f0570004730 comp rx=0 tx=0).stop 2024-03-12T17:18:53.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.198+0000 7f0583e00640 1 -- 172.21.15.17:0/4238650766 reap_dead start 2024-03-12T17:18:53.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.198+0000 7f0588e00640 1 -- 172.21.15.17:0/4238650766 shutdown_connections 2024-03-12T17:18:53.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.198+0000 7f0588e00640 1 -- 172.21.15.17:0/4238650766 >> 172.21.15.17:0/4238650766 conn(0x7f057c009f70 msgr2=0x7f057c052e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:53.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.199+0000 7f3e79600640 1 -- 172.21.15.17:0/3244620630 --> [v2:172.21.15.94:6808/37465,v1:172.21.15.94:6809/37465] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3e740c8480 con 0x7f3e54072ef0 2024-03-12T17:18:53.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.200+0000 7f0588e00640 1 -- 172.21.15.17:0/4238650766 shutdown_connections 2024-03-12T17:18:53.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.200+0000 7f0588e00640 1 -- 172.21.15.17:0/4238650766 wait complete. 2024-03-12T17:18:53.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.200+0000 7f3e6be00640 1 -- 172.21.15.17:0/3244620630 <== osd.4 v2:172.21.15.94:6808/37465 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3e740c8480 con 0x7f3e54072ef0 2024-03-12T17:18:53.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.200+0000 7f3e79600640 1 -- 172.21.15.17:0/3244620630 >> [v2:172.21.15.94:6808/37465,v1:172.21.15.94:6809/37465] conn(0x7f3e54072ef0 msgr2=0x7f3e54075310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.200+0000 7f3e79600640 1 --2- 172.21.15.17:0/3244620630 >> [v2:172.21.15.94:6808/37465,v1:172.21.15.94:6809/37465] conn(0x7f3e54072ef0 0x7f3e54075310 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.201+0000 7f3e79600640 1 -- 172.21.15.17:0/3244620630 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f3e5406acd0 msgr2=0x7f3e5406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.201+0000 7f3e79600640 1 --2- 172.21.15.17:0/3244620630 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f3e5406acd0 0x7f3e5406d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3e741f9e80 tx=0x7f3e64008040 comp rx=0 tx=0).stop 2024-03-12T17:18:53.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.201+0000 7f3e79600640 1 -- 172.21.15.17:0/3244620630 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e740c9a80 msgr2=0x7f3e74159bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.201+0000 7f3e79600640 1 --2- 172.21.15.17:0/3244620630 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3e740c9a80 0x7f3e74159bc0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3e6000b3f0 tx=0x7f3e6000b8b0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.201+0000 7f3e78c00640 1 -- 172.21.15.17:0/3244620630 reap_dead start 2024-03-12T17:18:53.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.201+0000 7f3e79600640 1 -- 172.21.15.17:0/3244620630 shutdown_connections 2024-03-12T17:18:53.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.201+0000 7f3e79600640 1 -- 172.21.15.17:0/3244620630 >> 172.21.15.17:0/3244620630 conn(0x7f3e740cf610 msgr2=0x7f3e740cf9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:53.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.202+0000 7f3e79600640 1 -- 172.21.15.17:0/3244620630 shutdown_connections 2024-03-12T17:18:53.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.202+0000 7f3e79600640 1 -- 172.21.15.17:0/3244620630 wait complete. 2024-03-12T17:18:53.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.208+0000 7f717f800640 1 -- 172.21.15.17:0/466402283 --> [v2:172.21.15.94:6824/37467,v1:172.21.15.94:6825/37467] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7154002cb0 con 0x7f7158072ef0 2024-03-12T17:18:53.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.209+0000 7f7174c00640 1 -- 172.21.15.17:0/466402283 <== osd.6 v2:172.21.15.94:6824/37467 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7154002cb0 con 0x7f7158072ef0 2024-03-12T17:18:53.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.210+0000 7f717f800640 1 -- 172.21.15.17:0/466402283 >> [v2:172.21.15.94:6824/37467,v1:172.21.15.94:6825/37467] conn(0x7f7158072ef0 msgr2=0x7f7158075310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.210+0000 7f717f800640 1 --2- 172.21.15.17:0/466402283 >> [v2:172.21.15.94:6824/37467,v1:172.21.15.94:6825/37467] conn(0x7f7158072ef0 0x7f7158075310 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.210+0000 7f717f800640 1 -- 172.21.15.17:0/466402283 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f715806acd0 msgr2=0x7f715806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.210+0000 7f717f800640 1 --2- 172.21.15.17:0/466402283 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f715806acd0 0x7f715806d190 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f71780ca820 tx=0x7f7164008040 comp rx=0 tx=0).stop 2024-03-12T17:18:53.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.211+0000 7f717f800640 1 -- 172.21.15.17:0/466402283 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71780b5b50 msgr2=0x7f717815d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.211+0000 7f717f800640 1 --2- 172.21.15.17:0/466402283 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71780b5b50 0x7f717815d950 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f716c02bdd0 tx=0x7f716c0046c0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.211+0000 7f717d800640 1 -- 172.21.15.17:0/466402283 reap_dead start 2024-03-12T17:18:53.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.211+0000 7f717f800640 1 -- 172.21.15.17:0/466402283 shutdown_connections 2024-03-12T17:18:53.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.211+0000 7f717f800640 1 -- 172.21.15.17:0/466402283 >> 172.21.15.17:0/466402283 conn(0x7f7178065df0 msgr2=0x7f71780ccb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:53.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.211+0000 7f717f800640 1 -- 172.21.15.17:0/466402283 shutdown_connections 2024-03-12T17:18:53.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.213+0000 7f717f800640 1 -- 172.21.15.17:0/466402283 wait complete. 2024-03-12T17:18:53.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.215+0000 7f27e0000640 1 -- 172.21.15.17:0/3904294553 --> [v2:172.21.15.94:6800/37466,v1:172.21.15.94:6801/37466] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f27d806dbc0 con 0x7f27b8072dd0 2024-03-12T17:18:53.230 INFO:teuthology.orchestra.run.smithi017.stdout:55834574852 2024-03-12T17:18:53.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.216+0000 7f1fe8e00640 1 -- 172.21.15.17:0/1690201546 --> [v2:172.21.15.94:6810/37464,v1:172.21.15.94:6812/37464] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1fe40b6a90 con 0x7f1fc4072ef0 2024-03-12T17:18:53.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.217+0000 7f1fda000640 1 -- 172.21.15.17:0/1690201546 <== osd.5 v2:172.21.15.94:6810/37464 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1fd4006e10 con 0x7f1fc4072ef0 2024-03-12T17:18:53.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.216+0000 7f27d5600640 1 -- 172.21.15.17:0/3904294553 <== osd.7 v2:172.21.15.94:6800/37466 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f27d0009ad0 con 0x7f27b8072dd0 2024-03-12T17:18:53.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.217+0000 7f27e0000640 1 -- 172.21.15.17:0/3904294553 >> [v2:172.21.15.94:6800/37466,v1:172.21.15.94:6801/37466] conn(0x7f27b8072dd0 msgr2=0x7f27b80751f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.217+0000 7f27e0000640 1 --2- 172.21.15.17:0/3904294553 >> [v2:172.21.15.94:6800/37466,v1:172.21.15.94:6801/37466] conn(0x7f27b8072dd0 0x7f27b80751f0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.217+0000 7f27e0000640 1 -- 172.21.15.17:0/3904294553 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f27b806ac30 msgr2=0x7f27b806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.217+0000 7f27e0000640 1 --2- 172.21.15.17:0/3904294553 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f27b806ac30 0x7f27b806d0f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f27cc036000 tx=0x7f27cc03c040 comp rx=0 tx=0).stop 2024-03-12T17:18:53.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.217+0000 7f27e0000640 1 -- 172.21.15.17:0/3904294553 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27d80b1780 msgr2=0x7f27d80acfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.217+0000 7f27e0000640 1 --2- 172.21.15.17:0/3904294553 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27d80b1780 0x7f27d80acfa0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f27c400c4d0 tx=0x7f27c400c990 comp rx=0 tx=0).stop 2024-03-12T17:18:53.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.217+0000 7f27de000640 1 -- 172.21.15.17:0/3904294553 reap_dead start 2024-03-12T17:18:53.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.217+0000 7f27e0000640 1 -- 172.21.15.17:0/3904294553 shutdown_connections 2024-03-12T17:18:53.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.217+0000 7f27e0000640 1 -- 172.21.15.17:0/3904294553 >> 172.21.15.17:0/3904294553 conn(0x7f27d8069ce0 msgr2=0x7f27d8160d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:53.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.218+0000 7f27e0000640 1 -- 172.21.15.17:0/3904294553 shutdown_connections 2024-03-12T17:18:53.232 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-12T17:18:53.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.218+0000 7f1fe8e00640 1 -- 172.21.15.17:0/1690201546 >> [v2:172.21.15.94:6810/37464,v1:172.21.15.94:6812/37464] conn(0x7f1fc4072ef0 msgr2=0x7f1fc4075310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.218+0000 7f1fe8e00640 1 --2- 172.21.15.17:0/1690201546 >> [v2:172.21.15.94:6810/37464,v1:172.21.15.94:6812/37464] conn(0x7f1fc4072ef0 0x7f1fc4075310 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.218+0000 7f1fe8e00640 1 -- 172.21.15.17:0/1690201546 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f1fc406acd0 msgr2=0x7f1fc406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.218+0000 7f1fe8e00640 1 --2- 172.21.15.17:0/1690201546 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f1fc406acd0 0x7f1fc406d190 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1fe415bf60 tx=0x7f1fd0007d50 comp rx=0 tx=0).stop 2024-03-12T17:18:53.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.218+0000 7f1fe8e00640 1 -- 172.21.15.17:0/1690201546 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1fe40b5aa0 msgr2=0x7f1fe40c8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.218+0000 7f1fe8e00640 1 --2- 172.21.15.17:0/1690201546 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1fe40b5aa0 0x7f1fe40c8c20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc00efc0 tx=0x7f1fdc00c490 comp rx=0 tx=0).stop 2024-03-12T17:18:53.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.218+0000 7f1fe2800640 1 -- 172.21.15.17:0/1690201546 reap_dead start 2024-03-12T17:18:53.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.218+0000 7f27e0000640 1 -- 172.21.15.17:0/3904294553 wait complete. 2024-03-12T17:18:53.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.219+0000 7f1fe8e00640 1 -- 172.21.15.17:0/1690201546 shutdown_connections 2024-03-12T17:18:53.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.219+0000 7f1fe8e00640 1 -- 172.21.15.17:0/1690201546 >> 172.21.15.17:0/1690201546 conn(0x7f1fe4065df0 msgr2=0x7f1fe40b3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:53.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.219+0000 7f1fe8e00640 1 -- 172.21.15.17:0/1690201546 shutdown_connections 2024-03-12T17:18:53.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.219+0000 7f1fe8e00640 1 -- 172.21.15.17:0/1690201546 wait complete. 2024-03-12T17:18:53.235 INFO:teuthology.orchestra.run.smithi017.stdout:55834574853 2024-03-12T17:18:53.235 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-12T17:18:53.236 INFO:teuthology.orchestra.run.smithi017.stdout:55834574853 2024-03-12T17:18:53.236 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-12T17:18:53.237 INFO:teuthology.orchestra.run.smithi017.stdout:55834574853 2024-03-12T17:18:53.237 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-12T17:18:53.238 INFO:teuthology.orchestra.run.smithi017.stdout:55834574853 2024-03-12T17:18:53.238 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-12T17:18:53.239 INFO:teuthology.orchestra.run.smithi017.stdout:55834574852 2024-03-12T17:18:53.240 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-12T17:18:53.241 INFO:teuthology.orchestra.run.smithi017.stdout:55834574853 2024-03-12T17:18:53.241 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-12T17:18:53.242 INFO:teuthology.orchestra.run.smithi017.stdout:55834574853 2024-03-12T17:18:53.242 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-12T17:18:53.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.571+0000 7f460ea00640 1 Processor -- start 2024-03-12T17:18:53.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.572+0000 7f460ea00640 1 -- start start 2024-03-12T17:18:53.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.574+0000 7f460ea00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4608169350 0x7f460816c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.574+0000 7f460ea00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f460806d360 0x7f46080cc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.574+0000 7f460ea00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46080ccd80 con 0x7f46080b3b70 2024-03-12T17:18:53.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.574+0000 7f460ea00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f460816c560 con 0x7f460806d360 2024-03-12T17:18:53.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.574+0000 7f460ea00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46080a7660 con 0x7f4608169350 2024-03-12T17:18:53.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.575+0000 7f460d600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4608169350 0x7f460816c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.575+0000 7f460d600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4608169350 0x7f460816c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.17:35898/0 (socket says 172.21.15.17:35898) 2024-03-12T17:18:53.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.575+0000 7f460d600640 1 -- 172.21.15.17:0/4182304659 learned_addr learned my addr 172.21.15.17:0/4182304659 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:53.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.575+0000 7f460cc00640 1 --2- 172.21.15.17:0/4182304659 >> v2:172.21.15.94:3300/0 conn(0x7f460806d360 0x7f46080cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.575+0000 7fc8f1200640 1 Processor -- start 2024-03-12T17:18:53.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.576+0000 7f460d600640 1 -- 172.21.15.17:0/4182304659 >> v2:172.21.15.94:3300/0 conn(0x7f460806d360 msgr2=0x7f46080cc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:53.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.576+0000 7f460d600640 1 --2- 172.21.15.17:0/4182304659 >> v2:172.21.15.94:3300/0 conn(0x7f460806d360 0x7f46080cc840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.576+0000 7f460d600640 1 -- 172.21.15.17:0/4182304659 >> v1:172.21.15.94:6789/0 conn(0x7f46080b3b70 legacy=0x7f46080cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.576+0000 7f460d600640 1 -- 172.21.15.17:0/4182304659 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f460806d7a0 con 0x7f4608169350 2024-03-12T17:18:53.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.576+0000 7fc8f1200640 1 -- start start 2024-03-12T17:18:53.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.577+0000 7fc8f1200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc8e4037fb0 0x7fc8e40583f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.577+0000 7fc8f1200640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc8e403c7e0 0x7fc8e4053510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.577+0000 7fc8f1200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8e4038390 con 0x7fc8e4058930 2024-03-12T17:18:53.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.577+0000 7fc8f1200640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8e40e7960 con 0x7fc8e403c7e0 2024-03-12T17:18:53.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.577+0000 7fc8f1200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e4057070 con 0x7fc8e4037fb0 2024-03-12T17:18:53.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.578+0000 7f460d600640 1 --2- 172.21.15.17:0/4182304659 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4608169350 0x7f460816c980 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4600009e50 tx=0x7f460002c030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2b1111b62f31aff server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.578+0000 7fc8eb400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc8e4037fb0 0x7fc8e40583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.578+0000 7fc8eb400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc8e4037fb0 0x7fc8e40583f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.17:35900/0 (socket says 172.21.15.17:35900) 2024-03-12T17:18:53.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.578+0000 7fc8eb400640 1 -- 172.21.15.17:0/1322581508 learned_addr learned my addr 172.21.15.17:0/1322581508 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:53.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.578+0000 7f4607e00640 1 -- 172.21.15.17:0/4182304659 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460002cbd0 con 0x7f4608169350 2024-03-12T17:18:53.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.578+0000 7fc8ebe00640 1 --2- 172.21.15.17:0/1322581508 >> v2:172.21.15.94:3300/0 conn(0x7fc8e403c7e0 0x7fc8e4053510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.578+0000 7f4607e00640 1 -- 172.21.15.17:0/4182304659 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f460002cd30 con 0x7f4608169350 2024-03-12T17:18:53.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.579+0000 7fc8eb400640 1 -- 172.21.15.17:0/1322581508 >> v2:172.21.15.94:3300/0 conn(0x7fc8e403c7e0 msgr2=0x7fc8e4053510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:53.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.579+0000 7fc8eb400640 1 --2- 172.21.15.17:0/1322581508 >> v2:172.21.15.94:3300/0 conn(0x7fc8e403c7e0 0x7fc8e4053510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.579+0000 7fc8eb400640 1 -- 172.21.15.17:0/1322581508 >> v1:172.21.15.17:6789/0 conn(0x7fc8e4058930 legacy=0x7fc8e403c0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-12T17:18:53.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.579+0000 7f4607e00640 1 -- 172.21.15.17:0/4182304659 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460002cbd0 con 0x7f4608169350 2024-03-12T17:18:53.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.579+0000 7f460ea00640 1 -- 172.21.15.17:0/4182304659 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4608169350 msgr2=0x7f460816c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.579+0000 7f460ea00640 1 --2- 172.21.15.17:0/4182304659 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4608169350 0x7f460816c980 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4600009e50 tx=0x7f460002c030 comp rx=0 tx=0).stop 2024-03-12T17:18:53.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.580+0000 7f460ea00640 1 -- 172.21.15.17:0/4182304659 shutdown_connections 2024-03-12T17:18:53.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.580+0000 7f460ea00640 1 --2- 172.21.15.17:0/4182304659 >> v2:172.21.15.94:3300/0 conn(0x7f460806d360 0x7f46080cc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.580+0000 7f460ea00640 1 --2- 172.21.15.17:0/4182304659 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4608169350 0x7f460816c980 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.580+0000 7f460ea00640 1 -- 172.21.15.17:0/4182304659 >> 172.21.15.17:0/4182304659 conn(0x7f4608069ce0 msgr2=0x7f460806a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:53.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.580+0000 7f460ea00640 1 -- 172.21.15.17:0/4182304659 shutdown_connections 2024-03-12T17:18:53.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.581+0000 7fc8eb400640 1 -- 172.21.15.17:0/1322581508 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e4057350 con 0x7fc8e4037fb0 2024-03-12T17:18:53.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.581+0000 7fc8ebe00640 1 --2- 172.21.15.17:0/1322581508 >> v2:172.21.15.94:3300/0 conn(0x7fc8e403c7e0 0x7fc8e4053510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:18:53.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.580+0000 7f460ea00640 1 -- 172.21.15.17:0/4182304659 wait complete. 2024-03-12T17:18:53.578 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.582+0000 7fc8eb400640 1 --2- 172.21.15.17:0/1322581508 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc8e4037fb0 0x7fc8e40583f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0009870 tx=0x7fc8e002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a5a4cbd935fe66e server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.584+0000 7fc8ea000640 1 -- 172.21.15.17:0/1322581508 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e0030840 con 0x7fc8e4037fb0 2024-03-12T17:18:53.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.584+0000 7fc8ea000640 1 -- 172.21.15.17:0/1322581508 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e00309a0 con 0x7fc8e4037fb0 2024-03-12T17:18:53.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.584+0000 7fc8ea000640 1 -- 172.21.15.17:0/1322581508 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e0030d30 con 0x7fc8e4037fb0 2024-03-12T17:18:53.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.585+0000 7f460ea00640 1 Processor -- start 2024-03-12T17:18:53.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.585+0000 7fc8f1200640 1 -- 172.21.15.17:0/1322581508 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc8e4037fb0 msgr2=0x7fc8e40583f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.585+0000 7fc8f1200640 1 --2- 172.21.15.17:0/1322581508 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc8e4037fb0 0x7fc8e40583f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0009870 tx=0x7fc8e002b980 comp rx=0 tx=0).stop 2024-03-12T17:18:53.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.585+0000 7f460ea00640 1 -- start start 2024-03-12T17:18:53.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.586+0000 7fc8f1200640 1 -- 172.21.15.17:0/1322581508 shutdown_connections 2024-03-12T17:18:53.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.586+0000 7fc8f1200640 1 --2- 172.21.15.17:0/1322581508 >> v2:172.21.15.94:3300/0 conn(0x7fc8e403c7e0 0x7fc8e4053510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.586+0000 7fc8f1200640 1 --2- 172.21.15.17:0/1322581508 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc8e4037fb0 0x7fc8e40583f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.586+0000 7fc8f1200640 1 -- 172.21.15.17:0/1322581508 >> 172.21.15.17:0/1322581508 conn(0x7fc8e4058ec0 msgr2=0x7fc8e40592d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:53.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.587+0000 7f460ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f460806d360 0x7f46081597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.587+0000 7f460ea00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f46080b3b70 0x7f460816e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.587+0000 7f460ea00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4608169350 0x7f46080a88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.587+0000 7f460ea00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f460816f810 con 0x7f460806d360 2024-03-12T17:18:53.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.587+0000 7f460ea00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46080a8e30 con 0x7f4608169350 2024-03-12T17:18:53.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.587+0000 7f460ea00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f460816fca0 con 0x7f46080b3b70 2024-03-12T17:18:53.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.586+0000 7fc8f1200640 1 -- 172.21.15.17:0/1322581508 shutdown_connections 2024-03-12T17:18:53.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.586+0000 7fc8f1200640 1 -- 172.21.15.17:0/1322581508 wait complete. 2024-03-12T17:18:53.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.588+0000 7f460d600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f460806d360 0x7f46081597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.588+0000 7f460cc00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f46080b3b70 0x7f460816e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.588+0000 7f460e000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4608169350 0x7f46080a88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.588+0000 7f460e000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4608169350 0x7f46080a88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.17:53416/0 (socket says 172.21.15.17:53416) 2024-03-12T17:18:53.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.588+0000 7f460e000640 1 -- 172.21.15.17:0/101798765 learned_addr learned my addr 172.21.15.17:0/101798765 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:53.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.589+0000 7f460d600640 1 -- 172.21.15.17:0/101798765 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f46080b3b70 msgr2=0x7f460816e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.589+0000 7f460d600640 1 --2- 172.21.15.17:0/101798765 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f46080b3b70 0x7f460816e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.589+0000 7fc8f1200640 1 Processor -- start 2024-03-12T17:18:53.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.589+0000 7f460d600640 1 -- 172.21.15.17:0/101798765 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4608169350 msgr2=0x7f46080a88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.590+0000 7f460d600640 1 --2- 172.21.15.17:0/101798765 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4608169350 0x7f46080a88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.590+0000 7fc8f1200640 1 -- start start 2024-03-12T17:18:53.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.590+0000 7f460d600640 1 -- 172.21.15.17:0/101798765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4600009b30 con 0x7f460806d360 2024-03-12T17:18:53.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.590+0000 7f460cc00640 1 --2- 172.21.15.17:0/101798765 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f46080b3b70 0x7f460816e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:18:53.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.590+0000 7fa7d4a00640 1 Processor -- start 2024-03-12T17:18:53.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.591+0000 7f460d600640 1 --2- 172.21.15.17:0/101798765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f460806d360 0x7f46081597f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4600032000 tx=0x7f4600004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.591+0000 7fa7d4a00640 1 -- start start 2024-03-12T17:18:53.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.591+0000 7ff474000640 1 Processor -- start 2024-03-12T17:18:53.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.591+0000 7fc8f1200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8e4037fb0 0x7fc8e40d6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.591+0000 7fc8f1200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8e403c7e0 0x7fc8e40d68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.591+0000 7ff474000640 1 -- start start 2024-03-12T17:18:53.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.591+0000 7fc8f1200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc8e4058930 0x7fc8e40d6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.591+0000 7fc8f1200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e400bb60 con 0x7fc8e4037fb0 2024-03-12T17:18:53.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.591+0000 7fc8f1200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e4009c60 con 0x7fc8e403c7e0 2024-03-12T17:18:53.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.591+0000 7fc8f1200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e40d6540 con 0x7fc8e4058930 2024-03-12T17:18:53.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.592+0000 7f4605600640 1 -- 172.21.15.17:0/101798765 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460002cea0 con 0x7f460806d360 2024-03-12T17:18:53.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.592+0000 7fc8eb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8e4037fb0 0x7fc8e40d6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.592+0000 7fc8eb400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8e4037fb0 0x7fc8e40d6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38670/0 (socket says 172.21.15.17:38670) 2024-03-12T17:18:53.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.592+0000 7fc8eb400640 1 -- 172.21.15.17:0/4231234872 learned_addr learned my addr 172.21.15.17:0/4231234872 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:53.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.592+0000 7fc8eaa00640 1 --2- 172.21.15.17:0/4231234872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8e403c7e0 0x7fc8e40d68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.592+0000 7f4605600640 1 -- 172.21.15.17:0/101798765 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46000099b0 con 0x7f460806d360 2024-03-12T17:18:53.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.592+0000 7f4605600640 1 -- 172.21.15.17:0/101798765 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f460003e640 con 0x7f460806d360 2024-03-12T17:18:53.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.592+0000 7fc8ebe00640 1 --2- 172.21.15.17:0/4231234872 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc8e4058930 0x7fc8e40d6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.592+0000 7fc8eb400640 1 -- 172.21.15.17:0/4231234872 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc8e4058930 msgr2=0x7fc8e40d6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.592+0000 7fa7d4a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa7d015caa0 0x7fa7d006b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.593+0000 7fa7d4a00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa7d00b83b0 0x7fa7d00b4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.593+0000 7fa7d4a00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7d00b2160 con 0x7fa7d00b4970 2024-03-12T17:18:53.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.593+0000 7ff474000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff46c161230 0x7ff46c0cd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.593+0000 7ff474000640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff46c0d05d0 con 0x7ff46c160e50 2024-03-12T17:18:53.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.593+0000 7ff474000640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff46c0d0b90 con 0x7ff46c0d2eb0 2024-03-12T17:18:53.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.593+0000 7ff474000640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c0d3420 con 0x7ff46c161230 2024-03-12T17:18:53.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.593+0000 7f460ea00640 1 -- 172.21.15.17:0/101798765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f460816ec00 con 0x7f460806d360 2024-03-12T17:18:53.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.593+0000 7f4de1200640 1 Processor -- start 2024-03-12T17:18:53.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.593+0000 7ff471600640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7ff46c160e50 0x7ff46c0b58e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:36940/0 (socket says 172.21.15.17:36940) 2024-03-12T17:18:53.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.593+0000 7ff471600640 1 -- 172.21.15.17:0/1768535835 learned_addr learned my addr 172.21.15.17:0/1768535835 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:18:53.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.594+0000 7f460ea00640 1 -- 172.21.15.17:0/101798765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f460816f1c0 con 0x7f460806d360 2024-03-12T17:18:53.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.593+0000 7f4de1200640 1 -- start start 2024-03-12T17:18:53.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.595+0000 7f4de1200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4ddc15cbd0 0x7f4ddc0d0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.595+0000 7f4de1200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ddc0b6e00 con 0x7f4ddc0cfa70 2024-03-12T17:18:53.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.595+0000 7f4de1200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ddc0b61f0 con 0x7f4ddc0b5aa0 2024-03-12T17:18:53.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.595+0000 7f4de1200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ddc0b64d0 con 0x7f4ddc15cbd0 2024-03-12T17:18:53.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.596+0000 7f4dd9e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4ddc15cbd0 0x7f4ddc0d0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.596+0000 7f4dd9e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4ddc15cbd0 0x7f4ddc0d0de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38674/0 (socket says 172.21.15.17:38674) 2024-03-12T17:18:53.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.596+0000 7f4dd9e00640 1 -- 172.21.15.17:0/3239718387 learned_addr learned my addr 172.21.15.17:0/3239718387 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:53.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.597+0000 7f4dd9e00640 1 -- 172.21.15.17:0/3239718387 >> v1:172.21.15.94:6789/0 conn(0x7f4ddc0b5aa0 legacy=0x7f4ddc0b84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:53.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.597+0000 7f4dd9e00640 1 -- 172.21.15.17:0/3239718387 >> v1:172.21.15.17:6789/0 conn(0x7f4ddc0cfa70 legacy=0x7f4ddc0b7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:53.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.594+0000 7ff472000640 1 --2- 172.21.15.17:0/1768535835 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff46c161230 0x7ff46c0cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.595+0000 7ff46be00640 1 -- 172.21.15.17:0/1768535835 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1604638544 0 0) 0x7ff46c0d05d0 con 0x7ff46c160e50 2024-03-12T17:18:53.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.595+0000 7ff46be00640 1 -- 172.21.15.17:0/1768535835 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff450003520 con 0x7ff46c160e50 2024-03-12T17:18:53.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.595+0000 7ff46be00640 1 -- 172.21.15.17:0/1768535835 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 417049293 0 0) 0x7ff46c0d0b90 con 0x7ff46c0d2eb0 2024-03-12T17:18:53.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.595+0000 7ff46be00640 1 -- 172.21.15.17:0/1768535835 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff46c0d05d0 con 0x7ff46c0d2eb0 2024-03-12T17:18:53.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.596+0000 7ff46be00640 1 -- 172.21.15.17:0/1768535835 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4284220873 0 0) 0x7ff450003520 con 0x7ff46c160e50 2024-03-12T17:18:53.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.596+0000 7ff46be00640 1 -- 172.21.15.17:0/1768535835 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff46c161230 msgr2=0x7ff46c0cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:53.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.597+0000 7ff46be00640 1 --2- 172.21.15.17:0/1768535835 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff46c161230 0x7ff46c0cd050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.597+0000 7ff46be00640 1 -- 172.21.15.17:0/1768535835 >> v1:172.21.15.94:6789/0 conn(0x7ff46c0d2eb0 legacy=0x7ff46c0cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.597+0000 7ff46be00640 1 -- 172.21.15.17:0/1768535835 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff46c0d3700 con 0x7ff46c160e50 2024-03-12T17:18:53.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.593+0000 7fa7d4a00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d00b4de0 con 0x7fa7d00b83b0 2024-03-12T17:18:53.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.593+0000 7fa7d4a00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d006ba30 con 0x7fa7d015caa0 2024-03-12T17:18:53.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.593+0000 7fa7ce800640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa7d015caa0 0x7fa7d006b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.593+0000 7fa7cde00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa7d00b83b0 0x7fa7d00b4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.593+0000 7fa7cde00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa7d00b83b0 0x7fa7d00b4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.17:53440/0 (socket says 172.21.15.17:53440) 2024-03-12T17:18:53.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.593+0000 7fa7cde00640 1 -- 172.21.15.17:0/700471864 learned_addr learned my addr 172.21.15.17:0/700471864 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:53.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.594+0000 7fa7ce800640 1 -- 172.21.15.17:0/700471864 >> v2:172.21.15.94:3300/0 conn(0x7fa7d00b83b0 msgr2=0x7fa7d00b4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:53.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.594+0000 7fa7ce800640 1 --2- 172.21.15.17:0/700471864 >> v2:172.21.15.94:3300/0 conn(0x7fa7d00b83b0 0x7fa7d00b4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.594+0000 7fa7ce800640 1 -- 172.21.15.17:0/700471864 >> v1:172.21.15.17:6789/0 conn(0x7fa7d00b4970 legacy=0x7fa7d0160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:53.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.594+0000 7fa7ce800640 1 -- 172.21.15.17:0/700471864 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d006bd10 con 0x7fa7d015caa0 2024-03-12T17:18:53.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.596+0000 7fa7ce800640 1 --2- 172.21.15.17:0/700471864 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa7d015caa0 0x7fa7d006b130 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa7b80097a0 tx=0x7fa7b802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db6ecd0020f1f538 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.592+0000 7fc8eb400640 1 --2- 172.21.15.17:0/4231234872 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc8e4058930 0x7fc8e40d6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.592+0000 7fc8eb400640 1 -- 172.21.15.17:0/4231234872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8e403c7e0 msgr2=0x7fc8e40d68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.592+0000 7fc8eb400640 1 --2- 172.21.15.17:0/4231234872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8e403c7e0 0x7fc8e40d68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.592+0000 7fc8eb400640 1 -- 172.21.15.17:0/4231234872 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e00094d0 con 0x7fc8e4037fb0 2024-03-12T17:18:53.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.592+0000 7fc8eaa00640 1 --2- 172.21.15.17:0/4231234872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8e403c7e0 0x7fc8e40d68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:18:53.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.594+0000 7fc8eb400640 1 --2- 172.21.15.17:0/4231234872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8e4037fb0 0x7fc8e40d6000 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0000c00 tx=0x7fc8e0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.595+0000 7fc8df400640 1 -- 172.21.15.17:0/4231234872 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e0039c90 con 0x7fc8e4037fb0 2024-03-12T17:18:53.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.597+0000 7fa7cd400640 1 -- 172.21.15.17:0/700471864 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b802e070 con 0x7fa7d015caa0 2024-03-12T17:18:53.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.597+0000 7fa7cd400640 1 -- 172.21.15.17:0/700471864 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b80315a0 con 0x7fa7d015caa0 2024-03-12T17:18:53.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.595+0000 7fc8df400640 1 -- 172.21.15.17:0/4231234872 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e0039df0 con 0x7fc8e4037fb0 2024-03-12T17:18:53.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.595+0000 7fc8df400640 1 -- 172.21.15.17:0/4231234872 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e0039c90 con 0x7fc8e4037fb0 2024-03-12T17:18:53.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.596+0000 7fc8f1200640 1 -- 172.21.15.17:0/4231234872 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8e400ac70 con 0x7fc8e4037fb0 2024-03-12T17:18:53.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.597+0000 7fc8f1200640 1 -- 172.21.15.17:0/4231234872 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8e400a190 con 0x7fc8e4037fb0 2024-03-12T17:18:53.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.597+0000 7fa7cd400640 1 -- 172.21.15.17:0/700471864 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b8031970 con 0x7fa7d015caa0 2024-03-12T17:18:53.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.597+0000 7ff46be00640 1 -- 172.21.15.17:0/1768535835 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7ff464001670 con 0x7ff46c160e50 2024-03-12T17:18:53.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.597+0000 7ff46be00640 1 -- 172.21.15.17:0/1768535835 >> v1:172.21.15.17:6789/0 conn(0x7ff46c160e50 legacy=0x7ff46c0b58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.597+0000 7ff46be00640 1 --2- 172.21.15.17:0/1768535835 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff450004b90 0x7ff450004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.597+0000 7ff46be00640 1 --2- 172.21.15.17:0/1768535835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff450003760 0x7ff450003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.597+0000 7ff46be00640 1 --2- 172.21.15.17:0/1768535835 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff450004120 0x7ff45000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.597+0000 7ff46be00640 1 -- 172.21.15.17:0/1768535835 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c0d3420 con 0x7ff450003760 2024-03-12T17:18:53.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.597+0000 7f460ea00640 1 -- 172.21.15.17:0/101798765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f460804e030 con 0x7f460806d360 2024-03-12T17:18:53.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.597+0000 7ff46be00640 1 -- 172.21.15.17:0/1768535835 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff45000c050 con 0x7ff450004120 2024-03-12T17:18:53.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.597+0000 7ff46be00640 1 -- 172.21.15.17:0/1768535835 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff45000c210 con 0x7ff450004b90 2024-03-12T17:18:53.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.598+0000 7f4dd9e00640 1 -- 172.21.15.17:0/3239718387 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ddc0b67b0 con 0x7f4ddc15cbd0 2024-03-12T17:18:53.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.598+0000 7fc8f1200640 1 -- 172.21.15.17:0/4231234872 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8e40056e0 con 0x7fc8e4037fb0 2024-03-12T17:18:53.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.598+0000 7ff471600640 1 --2- 172.21.15.17:0/1768535835 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff450004b90 0x7ff450004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.598+0000 7ff470c00640 1 --2- 172.21.15.17:0/1768535835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff450003760 0x7ff450003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.599+0000 7ff472000640 1 --2- 172.21.15.17:0/1768535835 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff450004120 0x7ff45000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.598+0000 7fa7d4a00640 1 -- 172.21.15.17:0/700471864 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa7d015caa0 msgr2=0x7fa7d006b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.598+0000 7fa7d4a00640 1 --2- 172.21.15.17:0/700471864 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa7d015caa0 0x7fa7d006b130 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa7b80097a0 tx=0x7fa7b802b840 comp rx=0 tx=0).stop 2024-03-12T17:18:53.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.599+0000 7f4605600640 1 -- 172.21.15.17:0/101798765 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f460003e7a0 con 0x7f460806d360 2024-03-12T17:18:53.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.599+0000 7fa7d4a00640 1 -- 172.21.15.17:0/700471864 shutdown_connections 2024-03-12T17:18:53.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.599+0000 7fa7d4a00640 1 --2- 172.21.15.17:0/700471864 >> v2:172.21.15.94:3300/0 conn(0x7fa7d00b83b0 0x7fa7d00b4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.599+0000 7fa7d4a00640 1 --2- 172.21.15.17:0/700471864 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa7d015caa0 0x7fa7d006b130 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.599+0000 7fa7d4a00640 1 -- 172.21.15.17:0/700471864 >> 172.21.15.17:0/700471864 conn(0x7fa7d00cf610 msgr2=0x7fa7d00cfa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:53.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.600+0000 7ff472000640 1 -- 172.21.15.17:0/1768535835 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff450004b90 msgr2=0x7ff450004f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:53.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.600+0000 7ff472000640 1 --2- 172.21.15.17:0/1768535835 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff450004b90 0x7ff450004f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.600+0000 7ff472000640 1 -- 172.21.15.17:0/1768535835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff450003760 msgr2=0x7ff450003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:53.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.600+0000 7ff472000640 1 --2- 172.21.15.17:0/1768535835 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff450003760 0x7ff450003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.600+0000 7ff472000640 1 -- 172.21.15.17:0/1768535835 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff450003520 con 0x7ff450004120 2024-03-12T17:18:53.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.600+0000 7fa7d4a00640 1 -- 172.21.15.17:0/700471864 shutdown_connections 2024-03-12T17:18:53.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.600+0000 7f4605600640 1 --2- 172.21.15.17:0/101798765 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f45e806ac00 0x7f45e806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.600+0000 7f4dd9e00640 1 --2- 172.21.15.17:0/3239718387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ddc15cbd0 0x7f4ddc0d0de0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc009870 tx=0x7f4dcc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8bfb6dd6200eed0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.600+0000 7fc8df400640 1 -- 172.21.15.17:0/4231234872 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fc8e004d460 con 0x7fc8e4037fb0 2024-03-12T17:18:53.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.600+0000 7fa7d4a00640 1 -- 172.21.15.17:0/700471864 wait complete. 2024-03-12T17:18:53.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.600+0000 7f4605600640 1 -- 172.21.15.17:0/101798765 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f46000abf70 con 0x7f460806d360 2024-03-12T17:18:53.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.601+0000 7f460cc00640 1 --2- 172.21.15.17:0/101798765 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f45e806ac00 0x7f45e806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.601+0000 7ff472000640 1 --2- 172.21.15.17:0/1768535835 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff450004120 0x7ff45000b980 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff454009980 tx=0x7ff4500057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d19b1b18f5f287 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.601+0000 7fc4a4c00640 1 Processor -- start 2024-03-12T17:18:53.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.602+0000 7fc8df400640 1 --2- 172.21.15.17:0/4231234872 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc8cc06acc0 0x7fc8cc06d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.602+0000 7fc8df400640 1 -- 172.21.15.17:0/4231234872 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc8e003e070 con 0x7fc8e4037fb0 2024-03-12T17:18:53.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.602+0000 7ff46be00640 1 -- 172.21.15.17:0/1768535835 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45402c5a0 con 0x7ff450004120 2024-03-12T17:18:53.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.602+0000 7fc8eaa00640 1 --2- 172.21.15.17:0/4231234872 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc8cc06acc0 0x7fc8cc06d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.602+0000 7ff46be00640 1 -- 172.21.15.17:0/1768535835 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff45402c700 con 0x7ff450004120 2024-03-12T17:18:53.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.602+0000 7ff46be00640 1 -- 172.21.15.17:0/1768535835 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45402ca70 con 0x7ff450004120 2024-03-12T17:18:53.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.602+0000 7fc4a4c00640 1 -- start start 2024-03-12T17:18:53.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.603+0000 7fc8eaa00640 1 --2- 172.21.15.17:0/4231234872 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc8cc06acc0 0x7fc8cc06d180 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc8e403edc0 tx=0x7fc8d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.603+0000 7fa7d4a00640 1 Processor -- start 2024-03-12T17:18:53.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.603+0000 7ff474000640 1 -- 172.21.15.17:0/1768535835 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff450004120 msgr2=0x7ff45000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.603+0000 7ff474000640 1 --2- 172.21.15.17:0/1768535835 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff450004120 0x7ff45000b980 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff454009980 tx=0x7ff4500057f0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.603+0000 7ff472000640 1 -- 172.21.15.17:0/1768535835 reap_dead start 2024-03-12T17:18:53.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.603+0000 7f2e56800640 1 Processor -- start 2024-03-12T17:18:53.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.603+0000 7f460cc00640 1 --2- 172.21.15.17:0/101798765 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f45e806ac00 0x7f45e806d0c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4608204360 tx=0x7f45fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.604+0000 7f2e56800640 1 -- start start 2024-03-12T17:18:53.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.604+0000 7ff474000640 1 -- 172.21.15.17:0/1768535835 shutdown_connections 2024-03-12T17:18:53.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.604+0000 7ff474000640 1 -- 172.21.15.17:0/1768535835 >> 172.21.15.17:0/1768535835 conn(0x7ff46c065df0 msgr2=0x7ff46c066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:53.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.603+0000 7fa7d4a00640 1 -- start start 2024-03-12T17:18:53.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.604+0000 7ff474000640 1 -- 172.21.15.17:0/1768535835 shutdown_connections 2024-03-12T17:18:53.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.604+0000 7fc4a4c00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc4a00b1710 0x7fc4a00b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.604+0000 7fc4a4c00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc4a0070b00 0x7fc4a0158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.605+0000 7fc4a4c00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4a00ae030 con 0x7fc4a00ce660 2024-03-12T17:18:53.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.605+0000 7fc4a4c00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4a0159010 con 0x7fc4a0070b00 2024-03-12T17:18:53.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.605+0000 7fc4a4c00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4a00b1bf0 con 0x7fc4a00b1710 2024-03-12T17:18:53.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.605+0000 7fc49d400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fc4a00ce660 0x7fc4a00703f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:36972/0 (socket says 172.21.15.17:36972) 2024-03-12T17:18:53.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.605+0000 7fc49d400640 1 -- 172.21.15.17:0/1419908214 learned_addr learned my addr 172.21.15.17:0/1419908214 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:18:53.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.604+0000 7ff474000640 1 -- 172.21.15.17:0/1768535835 wait complete. 2024-03-12T17:18:53.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.605+0000 7fc49de00640 1 --2- 172.21.15.17:0/1419908214 >> v2:172.21.15.94:3300/0 conn(0x7fc4a00b1710 0x7fc4a00b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.605+0000 7fa7d4a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7d00b4970 0x7fa7d01fa110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.605+0000 7fa7d4a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7d00b83b0 0x7fa7d015ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.605+0000 7fa7d4a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa7d015caa0 0x7fa7d015d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.605+0000 7fa7d4a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d00c7df0 con 0x7fa7d00b83b0 2024-03-12T17:18:53.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.605+0000 7fa7d4a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d01fa650 con 0x7fa7d00b4970 2024-03-12T17:18:53.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.605+0000 7fa7d4a00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d00c71e0 con 0x7fa7d015caa0 2024-03-12T17:18:53.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.606+0000 7f2e56800640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e5015cbd0 0x7f2e500d0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.606+0000 7f2e56800640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2e500b5aa0 0x7f2e500b84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.606+0000 7fa7cde00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7d00b83b0 0x7fa7d015ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.606+0000 7fa7cde00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7d00b83b0 0x7fa7d015ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38702/0 (socket says 172.21.15.17:38702) 2024-03-12T17:18:53.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.606+0000 7f2e56800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2e500cfa70 0x7f2e500cff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.606+0000 7f2e56800640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e500d0440 con 0x7f2e500cfa70 2024-03-12T17:18:53.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.606+0000 7f2e56800640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e500b6e00 con 0x7f2e500b5aa0 2024-03-12T17:18:53.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.606+0000 7f2e56800640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e500b61f0 con 0x7f2e5015cbd0 2024-03-12T17:18:53.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.606+0000 7fa7cde00640 1 -- 172.21.15.17:0/2570620063 learned_addr learned my addr 172.21.15.17:0/2570620063 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:53.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.606+0000 7fa7ce800640 1 --2- 172.21.15.17:0/2570620063 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7d00b4970 0x7fa7d01fa110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.606+0000 7fc49de00640 1 -- 172.21.15.17:0/1419908214 >> v2:172.21.15.17:3300/0 conn(0x7fc4a0070b00 msgr2=0x7fc4a0158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:53.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.606+0000 7f2e4f400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e5015cbd0 0x7f2e500d0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.606+0000 7f2e4f400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e5015cbd0 0x7f2e500d0de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.17:35932/0 (socket says 172.21.15.17:35932) 2024-03-12T17:18:53.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.606+0000 7f2e4f400640 1 -- 172.21.15.17:0/550773106 learned_addr learned my addr 172.21.15.17:0/550773106 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:53.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.606+0000 7fa7cde00640 1 -- 172.21.15.17:0/2570620063 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa7d015caa0 msgr2=0x7fa7d015d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.606+0000 7fa7cde00640 1 --2- 172.21.15.17:0/2570620063 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa7d015caa0 0x7fa7d015d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.606+0000 7fa7cde00640 1 -- 172.21.15.17:0/2570620063 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7d00b4970 msgr2=0x7fa7d01fa110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.606+0000 7fa7cde00640 1 --2- 172.21.15.17:0/2570620063 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7d00b4970 0x7fa7d01fa110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.606+0000 7fa7cde00640 1 -- 172.21.15.17:0/2570620063 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b8009400 con 0x7fa7d00b83b0 2024-03-12T17:18:53.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.607+0000 7fa7ce800640 1 --2- 172.21.15.17:0/2570620063 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7d00b4970 0x7fa7d01fa110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:18:53.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.607+0000 7f2e4ea00640 1 --2- 172.21.15.17:0/550773106 >> v2:172.21.15.94:3300/0 conn(0x7f2e500b5aa0 0x7f2e500b84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.606+0000 7fc49de00640 1 --2- 172.21.15.17:0/1419908214 >> v2:172.21.15.17:3300/0 conn(0x7fc4a0070b00 0x7fc4a0158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.606+0000 7fc49de00640 1 -- 172.21.15.17:0/1419908214 >> v1:172.21.15.17:6789/0 conn(0x7fc4a00ce660 legacy=0x7fc4a00703f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.607+0000 7f2e4fe00640 1 --2- 172.21.15.17:0/550773106 >> v2:172.21.15.17:3300/0 conn(0x7f2e500cfa70 0x7f2e500cff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.607+0000 7fa7cde00640 1 --2- 172.21.15.17:0/2570620063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7d00b83b0 0x7fa7d015ce80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa7c000e900 tx=0x7fa7c000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.607+0000 7fc49de00640 1 -- 172.21.15.17:0/1419908214 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a00b1ed0 con 0x7fc4a00b1710 2024-03-12T17:18:53.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.607+0000 7f2e4f400640 1 -- 172.21.15.17:0/550773106 >> v2:172.21.15.94:3300/0 conn(0x7f2e500b5aa0 msgr2=0x7f2e500b84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:53.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.607+0000 7f2e4f400640 1 --2- 172.21.15.17:0/550773106 >> v2:172.21.15.94:3300/0 conn(0x7f2e500b5aa0 0x7f2e500b84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.607+0000 7f2e4f400640 1 -- 172.21.15.17:0/550773106 >> v2:172.21.15.17:3300/0 conn(0x7f2e500cfa70 msgr2=0x7f2e500cff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:53.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.607+0000 7f2e4f400640 1 --2- 172.21.15.17:0/550773106 >> v2:172.21.15.17:3300/0 conn(0x7f2e500cfa70 0x7f2e500cff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.608+0000 7ff474000640 1 Processor -- start 2024-03-12T17:18:53.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.607+0000 7f2e4f400640 1 -- 172.21.15.17:0/550773106 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e500b64d0 con 0x7f2e5015cbd0 2024-03-12T17:18:53.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.608+0000 7ff474000640 1 -- start start 2024-03-12T17:18:53.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.609+0000 7fae83e00640 1 Processor -- start 2024-03-12T17:18:53.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.609+0000 7fae83e00640 1 -- start start 2024-03-12T17:18:53.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.609+0000 7fc49de00640 1 --2- 172.21.15.17:0/1419908214 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4a00b1710 0x7fc4a00b2f20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc4a00cf0a0 tx=0x7fc49002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4240bb4cc68f942b server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.609+0000 7f2e4f400640 1 --2- 172.21.15.17:0/550773106 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e5015cbd0 0x7f2e500d0de0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2e500b56d0 tx=0x7f2e4002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=837232516ec61c6 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.610+0000 7fa7c6a00640 1 -- 172.21.15.17:0/2570620063 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c000c990 con 0x7fa7d00b83b0 2024-03-12T17:18:53.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.610+0000 7ff474000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff450004120 0x7ff46c151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.610+0000 7fa7d4a00640 1 -- 172.21.15.17:0/2570620063 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7d00c74c0 con 0x7fa7d00b83b0 2024-03-12T17:18:53.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.610+0000 7fa7d4a00640 1 -- 172.21.15.17:0/2570620063 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d00c7a80 con 0x7fa7d00b83b0 2024-03-12T17:18:53.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.610+0000 7ff474000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff46c0c8e60 0x7ff46c1fa330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.610+0000 7f4dd8a00640 1 -- 172.21.15.17:0/3239718387 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc031870 con 0x7f4ddc15cbd0 2024-03-12T17:18:53.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.610+0000 7f4605600640 1 -- 172.21.15.17:0/101798765 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f4600077160 con 0x7f460806d360 2024-03-12T17:18:53.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.610+0000 7f2e4e000640 1 -- 172.21.15.17:0/550773106 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e40031640 con 0x7f2e5015cbd0 2024-03-12T17:18:53.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.610+0000 7fae83e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fae7c15cbd0 0x7fae7c0d0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.610+0000 7fae83e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae7c0b5aa0 0x7fae7c0b84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.610+0000 7ff474000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff46c0b61c0 0x7ff46c15e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.610+0000 7fae83e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fae7c0cfa70 0x7fae7c0cff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.610+0000 7fae83e00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae7c0d0440 con 0x7fae7c0cfa70 2024-03-12T17:18:53.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.610+0000 7fae83e00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae7c0b6e00 con 0x7fae7c15cbd0 2024-03-12T17:18:53.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.610+0000 7fae83e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c0b61f0 con 0x7fae7c0b5aa0 2024-03-12T17:18:53.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.610+0000 7fc49ca00640 1 -- 172.21.15.17:0/1419908214 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49002e070 con 0x7fc4a00b1710 2024-03-12T17:18:53.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.611+0000 7f2e4e000640 1 -- 172.21.15.17:0/550773106 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e400317a0 con 0x7f2e5015cbd0 2024-03-12T17:18:53.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.611+0000 7f2e4e000640 1 -- 172.21.15.17:0/550773106 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e40031b30 con 0x7f2e5015cbd0 2024-03-12T17:18:53.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.611+0000 7ff470c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff46c0c8e60 0x7ff46c1fa330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.611+0000 7fc49ca00640 1 -- 172.21.15.17:0/1419908214 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4900315a0 con 0x7fc4a00b1710 2024-03-12T17:18:53.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.611+0000 7fae81e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fae7c0cfa70 0x7fae7c0cff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.611+0000 7fae80a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae7c0b5aa0 0x7fae7c0b84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.611+0000 7fae81400640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fae7c15cbd0 0x7fae7c0d0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.611+0000 7fae81e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fae7c0cfa70 0x7fae7c0cff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38740/0 (socket says 172.21.15.17:38740) 2024-03-12T17:18:53.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.611+0000 7fae81e00640 1 -- 172.21.15.17:0/3383028850 learned_addr learned my addr 172.21.15.17:0/3383028850 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:53.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.611+0000 7fc49ca00640 1 -- 172.21.15.17:0/1419908214 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc490031930 con 0x7fc4a00b1710 2024-03-12T17:18:53.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.611+0000 7ff470c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff46c0c8e60 0x7ff46c1fa330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38730/0 (socket says 172.21.15.17:38730) 2024-03-12T17:18:53.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.612+0000 7fae81e00640 1 -- 172.21.15.17:0/3383028850 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae7c0b5aa0 msgr2=0x7fae7c0b84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:53.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.612+0000 7fae81e00640 1 --2- 172.21.15.17:0/3383028850 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae7c0b5aa0 0x7fae7c0b84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.612+0000 7fae81e00640 1 -- 172.21.15.17:0/3383028850 >> v2:172.21.15.94:3300/0 conn(0x7fae7c15cbd0 msgr2=0x7fae7c0d0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:53.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.612+0000 7fae81e00640 1 --2- 172.21.15.17:0/3383028850 >> v2:172.21.15.94:3300/0 conn(0x7fae7c15cbd0 0x7fae7c0d0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.612+0000 7fae81e00640 1 -- 172.21.15.17:0/3383028850 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7c0b64d0 con 0x7fae7c0cfa70 2024-03-12T17:18:53.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.612+0000 7fae80a00640 1 --2- 172.21.15.17:0/3383028850 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae7c0b5aa0 0x7fae7c0b84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-12T17:18:53.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.611+0000 7ff470c00640 1 -- 172.21.15.17:0/3999868477 learned_addr learned my addr 172.21.15.17:0/3999868477 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:53.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.611+0000 7fa7d4a00640 1 -- 172.21.15.17:0/2570620063 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7d0067120 con 0x7fa7d00b83b0 2024-03-12T17:18:53.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.612+0000 7fc4a4c00640 1 -- 172.21.15.17:0/1419908214 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4a00b1710 msgr2=0x7fc4a00b2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.612+0000 7fc4a4c00640 1 --2- 172.21.15.17:0/1419908214 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4a00b1710 0x7fc4a00b2f20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc4a00cf0a0 tx=0x7fc49002b840 comp rx=0 tx=0).stop 2024-03-12T17:18:53.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.612+0000 7f2e56800640 1 -- 172.21.15.17:0/550773106 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e5015cbd0 msgr2=0x7f2e500d0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.612+0000 7ff471600640 1 --2- 172.21.15.17:0/3999868477 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff450004120 0x7ff46c151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.612+0000 7f2e56800640 1 --2- 172.21.15.17:0/550773106 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e5015cbd0 0x7f2e500d0de0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f2e500b56d0 tx=0x7f2e4002b8f0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.612+0000 7ff474000640 1 -- 172.21.15.17:0/3999868477 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c155da0 con 0x7ff46c0c8e60 2024-03-12T17:18:53.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.612+0000 7ff474000640 1 -- 172.21.15.17:0/3999868477 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c1fb240 con 0x7ff46c0b61c0 2024-03-12T17:18:53.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.612+0000 7ff474000640 1 -- 172.21.15.17:0/3999868477 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff46c1fac80 con 0x7ff450004120 2024-03-12T17:18:53.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.612+0000 7fc4a4c00640 1 -- 172.21.15.17:0/1419908214 shutdown_connections 2024-03-12T17:18:53.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.612+0000 7fc4a4c00640 1 --2- 172.21.15.17:0/1419908214 >> v2:172.21.15.17:3300/0 conn(0x7fc4a0070b00 0x7fc4a0158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.612+0000 7fc4a4c00640 1 --2- 172.21.15.17:0/1419908214 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4a00b1710 0x7fc4a00b2f20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.612+0000 7fc4a4c00640 1 -- 172.21.15.17:0/1419908214 >> 172.21.15.17:0/1419908214 conn(0x7fc4a006a100 msgr2=0x7fc4a006a510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:53.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.612+0000 7ff472000640 1 --2- 172.21.15.17:0/3999868477 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff46c0b61c0 0x7ff46c15e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.612+0000 7f2e56800640 1 -- 172.21.15.17:0/550773106 shutdown_connections 2024-03-12T17:18:53.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.612+0000 7f2e56800640 1 --2- 172.21.15.17:0/550773106 >> v2:172.21.15.17:3300/0 conn(0x7f2e500cfa70 0x7f2e500cff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.612+0000 7f2e56800640 1 --2- 172.21.15.17:0/550773106 >> v2:172.21.15.94:3300/0 conn(0x7f2e500b5aa0 0x7f2e500b84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.612+0000 7f2e56800640 1 --2- 172.21.15.17:0/550773106 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e5015cbd0 0x7f2e500d0de0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.612+0000 7f2e56800640 1 -- 172.21.15.17:0/550773106 >> 172.21.15.17:0/550773106 conn(0x7f2e50065df0 msgr2=0x7f2e50066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:53.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.613+0000 7fc4a4c00640 1 -- 172.21.15.17:0/1419908214 shutdown_connections 2024-03-12T17:18:53.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.613+0000 7fc4a4c00640 1 -- 172.21.15.17:0/1419908214 wait complete. 2024-03-12T17:18:53.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.613+0000 7ff470c00640 1 -- 172.21.15.17:0/3999868477 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff450004120 msgr2=0x7ff46c151880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.613+0000 7ff470c00640 1 --2- 172.21.15.17:0/3999868477 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff450004120 0x7ff46c151880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.613+0000 7ff470c00640 1 -- 172.21.15.17:0/3999868477 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff46c0b61c0 msgr2=0x7ff46c15e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.613+0000 7ff470c00640 1 --2- 172.21.15.17:0/3999868477 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff46c0b61c0 0x7ff46c15e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.613+0000 7ff470c00640 1 -- 172.21.15.17:0/3999868477 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff46c1faf60 con 0x7ff46c0c8e60 2024-03-12T17:18:53.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.613+0000 7ff470c00640 1 --2- 172.21.15.17:0/3999868477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff46c0c8e60 0x7ff46c1fa330 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff45c00fb10 tx=0x7ff45c00d150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.613+0000 7f2e56800640 1 -- 172.21.15.17:0/550773106 shutdown_connections 2024-03-12T17:18:53.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.613+0000 7f2e56800640 1 -- 172.21.15.17:0/550773106 wait complete. 2024-03-12T17:18:53.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.614+0000 7fae81e00640 1 --2- 172.21.15.17:0/3383028850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae7c0cfa70 0x7fae7c0cff00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fae7c06ac90 tx=0x7fae7402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e115a1f222235ef8 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.615+0000 7fc4a4c00640 1 Processor -- start 2024-03-12T17:18:53.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.615+0000 7fc4a4c00640 1 -- start start 2024-03-12T17:18:53.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.615+0000 7f2e56800640 1 Processor -- start 2024-03-12T17:18:53.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.616+0000 7f2e56800640 1 -- start start 2024-03-12T17:18:53.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.616+0000 7fc4a4c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4a0070b00 0x7fc4a014bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.616+0000 7fc4a4c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc4a00b1710 0x7fc4a0156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.616+0000 7fc4a4c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4a00ce660 0x7fc4a00ac920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.616+0000 7fc4a4c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a01f5c80 con 0x7fc4a0070b00 2024-03-12T17:18:53.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.616+0000 7fc4a4c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a01f24f0 con 0x7fc4a00ce660 2024-03-12T17:18:53.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.616+0000 7fc4a4c00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a01f5ef0 con 0x7fc4a00b1710 2024-03-12T17:18:53.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.616+0000 7fae7be00640 1 -- 172.21.15.17:0/3383028850 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7402ca70 con 0x7fae7c0cfa70 2024-03-12T17:18:53.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.616+0000 7f4dd8a00640 1 -- 172.21.15.17:0/3239718387 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dcc0319d0 con 0x7f4ddc15cbd0 2024-03-12T17:18:53.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.617+0000 7f4dd8a00640 1 -- 172.21.15.17:0/3239718387 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc031d60 con 0x7f4ddc15cbd0 2024-03-12T17:18:53.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.617+0000 7fc8df400640 1 -- 172.21.15.17:0/4231234872 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fc8e00771b0 con 0x7fc8e4037fb0 2024-03-12T17:18:53.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.617+0000 7fa7c6a00640 1 -- 172.21.15.17:0/2570620063 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c000caf0 con 0x7fa7d00b83b0 2024-03-12T17:18:53.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.617+0000 7fa7c6a00640 1 -- 172.21.15.17:0/2570620063 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c000ce80 con 0x7fa7d00b83b0 2024-03-12T17:18:53.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.616+0000 7fc49de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4a0070b00 0x7fc4a014bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.616+0000 7fc49de00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4a0070b00 0x7fc4a014bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38744/0 (socket says 172.21.15.17:38744) 2024-03-12T17:18:53.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.616+0000 7fc49de00640 1 -- 172.21.15.17:0/2181056435 learned_addr learned my addr 172.21.15.17:0/2181056435 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:53.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.617+0000 7f2e56800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e500b5aa0 0x7f2e50152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.618+0000 7fc49e800640 1 --2- 172.21.15.17:0/2181056435 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4a00ce660 0x7fc4a00ac920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.618+0000 7fc49d400640 1 --2- 172.21.15.17:0/2181056435 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc4a00b1710 0x7fc4a0156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.618+0000 7f4de1200640 1 -- 172.21.15.17:0/3239718387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ddc15cbd0 msgr2=0x7f4ddc0d0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.618+0000 7f4de1200640 1 --2- 172.21.15.17:0/3239718387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ddc15cbd0 0x7f4ddc0d0de0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc009870 tx=0x7f4dcc02b910 comp rx=0 tx=0).stop 2024-03-12T17:18:53.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.619+0000 7f4de1200640 1 -- 172.21.15.17:0/3239718387 shutdown_connections 2024-03-12T17:18:53.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.619+0000 7f4de1200640 1 --2- 172.21.15.17:0/3239718387 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ddc15cbd0 0x7f4ddc0d0de0 secure :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc009870 tx=0x7f4dcc02b910 comp rx=0 tx=0).stop 2024-03-12T17:18:53.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.619+0000 7f4de1200640 1 -- 172.21.15.17:0/3239718387 >> 172.21.15.17:0/3239718387 conn(0x7f4ddc065df0 msgr2=0x7f4ddc066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:53.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.618+0000 7ff469600640 1 -- 172.21.15.17:0/3999868477 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45c001b90 con 0x7ff46c0c8e60 2024-03-12T17:18:53.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.619+0000 7ff469600640 1 -- 172.21.15.17:0/3999868477 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff45c003b80 con 0x7ff46c0c8e60 2024-03-12T17:18:53.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.619+0000 7ff469600640 1 -- 172.21.15.17:0/3999868477 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff45c00d950 con 0x7ff46c0c8e60 2024-03-12T17:18:53.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.619+0000 7fc49de00640 1 -- 172.21.15.17:0/2181056435 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc4a00b1710 msgr2=0x7fc4a0156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.619+0000 7fc49de00640 1 --2- 172.21.15.17:0/2181056435 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc4a00b1710 0x7fc4a0156fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.619+0000 7fc49de00640 1 -- 172.21.15.17:0/2181056435 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4a00ce660 msgr2=0x7fc4a00ac920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.619+0000 7fc49de00640 1 --2- 172.21.15.17:0/2181056435 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4a00ce660 0x7fc4a00ac920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.619+0000 7fc49de00640 1 -- 172.21.15.17:0/2181056435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc490009400 con 0x7fc4a0070b00 2024-03-12T17:18:53.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.619+0000 7fc49de00640 1 --2- 172.21.15.17:0/2181056435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4a0070b00 0x7fc4a014bb20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc490009890 tx=0x7fc4900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.619+0000 7f2e56800640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e500cfa70 0x7f2e5015e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.619+0000 7f2e56800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e5015cbd0 0x7f2e500d14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.619+0000 7f2e56800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5015fc00 con 0x7f2e500b5aa0 2024-03-12T17:18:53.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.619+0000 7f2e56800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e501525b0 con 0x7f2e5015cbd0 2024-03-12T17:18:53.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.619+0000 7f2e56800640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e5015eff0 con 0x7f2e500cfa70 2024-03-12T17:18:53.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.619+0000 7f2e4f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e500b5aa0 0x7f2e50152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.619+0000 7f2e4f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e500b5aa0 0x7f2e50152070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38754/0 (socket says 172.21.15.17:38754) 2024-03-12T17:18:53.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.619+0000 7f2e4f400640 1 -- 172.21.15.17:0/939443746 learned_addr learned my addr 172.21.15.17:0/939443746 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:53.643 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.620+0000 7f2e4fe00640 1 --2- 172.21.15.17:0/939443746 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e5015cbd0 0x7f2e500d14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.620+0000 7ff474000640 1 -- 172.21.15.17:0/3999868477 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff46c155a30 con 0x7ff46c0c8e60 2024-03-12T17:18:53.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.620+0000 7ff474000640 1 -- 172.21.15.17:0/3999868477 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff46c1fa870 con 0x7ff46c0c8e60 2024-03-12T17:18:53.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.620+0000 7fae7be00640 1 -- 172.21.15.17:0/3383028850 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7402cbd0 con 0x7fae7c0cfa70 2024-03-12T17:18:53.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.620+0000 7f2e4ea00640 1 --2- 172.21.15.17:0/939443746 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e500cfa70 0x7f2e5015e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.620+0000 7fae7be00640 1 -- 172.21.15.17:0/3383028850 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae740343f0 con 0x7fae7c0cfa70 2024-03-12T17:18:53.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.621+0000 7fae83e00640 1 -- 172.21.15.17:0/3383028850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae7c0cfa70 msgr2=0x7fae7c0cff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.621+0000 7fae83e00640 1 --2- 172.21.15.17:0/3383028850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae7c0cfa70 0x7fae7c0cff00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fae7c06ac90 tx=0x7fae7402bed0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.621+0000 7fae83e00640 1 -- 172.21.15.17:0/3383028850 shutdown_connections 2024-03-12T17:18:53.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.621+0000 7fae83e00640 1 --2- 172.21.15.17:0/3383028850 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae7c0cfa70 0x7fae7c0cff00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.622+0000 7fae83e00640 1 --2- 172.21.15.17:0/3383028850 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae7c0b5aa0 0x7fae7c0b84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.622+0000 7fae83e00640 1 --2- 172.21.15.17:0/3383028850 >> v2:172.21.15.94:3300/0 conn(0x7fae7c15cbd0 0x7fae7c0d0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.621+0000 7f2e4f400640 1 -- 172.21.15.17:0/939443746 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e500cfa70 msgr2=0x7f2e5015e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.621+0000 7f2e4f400640 1 --2- 172.21.15.17:0/939443746 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e500cfa70 0x7f2e5015e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.621+0000 7f2e4f400640 1 -- 172.21.15.17:0/939443746 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e5015cbd0 msgr2=0x7f2e500d14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.621+0000 7f2e4f400640 1 --2- 172.21.15.17:0/939443746 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e5015cbd0 0x7f2e500d14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.621+0000 7f2e4f400640 1 -- 172.21.15.17:0/939443746 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e400094d0 con 0x7f2e500b5aa0 2024-03-12T17:18:53.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.622+0000 7fae83e00640 1 -- 172.21.15.17:0/3383028850 >> 172.21.15.17:0/3383028850 conn(0x7fae7c065df0 msgr2=0x7fae7c066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:53.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.622+0000 7ff462a00640 1 -- 172.21.15.17:0/3999868477 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff43c005250 con 0x7ff46c0c8e60 2024-03-12T17:18:53.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.622+0000 7f2e4f400640 1 --2- 172.21.15.17:0/939443746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e500b5aa0 0x7f2e50152070 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2e40000c00 tx=0x7f2e400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.620+0000 7f4de1200640 1 -- 172.21.15.17:0/3239718387 shutdown_connections 2024-03-12T17:18:53.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.622+0000 7f4de1200640 1 -- 172.21.15.17:0/3239718387 wait complete. 2024-03-12T17:18:53.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.622+0000 7fa7c6a00640 1 -- 172.21.15.17:0/2570620063 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fa7c0026480 con 0x7fa7d00b83b0 2024-03-12T17:18:53.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.624+0000 7fae83e00640 1 -- 172.21.15.17:0/3383028850 shutdown_connections 2024-03-12T17:18:53.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.624+0000 7fae83e00640 1 -- 172.21.15.17:0/3383028850 wait complete. 2024-03-12T17:18:53.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.624+0000 7fa7c6a00640 1 --2- 172.21.15.17:0/2570620063 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fa7ac06ac00 0x7fa7ac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.624+0000 7fa7c6a00640 1 -- 172.21.15.17:0/2570620063 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7c0089830 con 0x7fa7d00b83b0 2024-03-12T17:18:53.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.625+0000 7f4de1200640 1 Processor -- start 2024-03-12T17:18:53.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.624+0000 7fa7ce800640 1 --2- 172.21.15.17:0/2570620063 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fa7ac06ac00 0x7fa7ac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.625+0000 7f4de1200640 1 -- start start 2024-03-12T17:18:53.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.625+0000 7fa7ce800640 1 --2- 172.21.15.17:0/2570620063 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fa7ac06ac00 0x7fa7ac06d0c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa7b8036000 tx=0x7fa7b803d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.626+0000 7f2e47400640 1 -- 172.21.15.17:0/939443746 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4003ac60 con 0x7f2e500b5aa0 2024-03-12T17:18:53.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.627+0000 7fc496000640 1 -- 172.21.15.17:0/2181056435 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc490032980 con 0x7fc4a0070b00 2024-03-12T17:18:53.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.627+0000 7fae83e00640 1 Processor -- start 2024-03-12T17:18:53.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.627+0000 7f2e56800640 1 -- 172.21.15.17:0/939443746 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e5015f2d0 con 0x7f2e500b5aa0 2024-03-12T17:18:53.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.627+0000 7f2e56800640 1 -- 172.21.15.17:0/939443746 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e5015f890 con 0x7f2e500b5aa0 2024-03-12T17:18:53.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.627+0000 7fc4a4c00640 1 -- 172.21.15.17:0/2181056435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4a01f61d0 con 0x7fc4a0070b00 2024-03-12T17:18:53.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.627+0000 7fa7c6a00640 1 -- 172.21.15.17:0/2570620063 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fa7c0054a80 con 0x7fa7d00b83b0 2024-03-12T17:18:53.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.627+0000 7fc4a4c00640 1 -- 172.21.15.17:0/2181056435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a01f69d0 con 0x7fc4a0070b00 2024-03-12T17:18:53.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.628+0000 7fae83e00640 1 -- start start 2024-03-12T17:18:53.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.628+0000 7f2e56800640 1 -- 172.21.15.17:0/939443746 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e500736c0 con 0x7f2e500b5aa0 2024-03-12T17:18:53.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.628+0000 7f4de1200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4ddc0b5aa0 0x7f4ddc0c7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.628+0000 7f4de1200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ddc0cfa70 0x7f4ddc0cb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.628+0000 7f4de1200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4ddc0c8ef0 0x7f4ddc0c6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.629+0000 7f4de1200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc0c7e50 con 0x7f4ddc0cfa70 2024-03-12T17:18:53.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.629+0000 7f4de1200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc0c8130 con 0x7f4ddc0c8ef0 2024-03-12T17:18:53.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.629+0000 7f4de1200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc0c8410 con 0x7f4ddc0b5aa0 2024-03-12T17:18:53.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.628+0000 7fc496000640 1 -- 172.21.15.17:0/2181056435 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc490032ae0 con 0x7fc4a0070b00 2024-03-12T17:18:53.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.628+0000 7fc496000640 1 -- 172.21.15.17:0/2181056435 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc490032e50 con 0x7fc4a0070b00 2024-03-12T17:18:53.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.629+0000 7fc4a4c00640 1 -- 172.21.15.17:0/2181056435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4a01f66f0 con 0x7fc4a0070b00 2024-03-12T17:18:53.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.629+0000 7f4dd9e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4ddc0b5aa0 0x7f4ddc0c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.629+0000 7f4dd9e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4ddc0b5aa0 0x7f4ddc0c7620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.17:35986/0 (socket says 172.21.15.17:35986) 2024-03-12T17:18:53.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.629+0000 7f4dd9e00640 1 -- 172.21.15.17:0/780593943 learned_addr learned my addr 172.21.15.17:0/780593943 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:53.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.630+0000 7f4dda800640 1 --2- 172.21.15.17:0/780593943 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4ddc0c8ef0 0x7f4ddc0c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.629+0000 7ff469600640 1 -- 172.21.15.17:0/3999868477 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7ff45c00dab0 con 0x7ff46c0c8e60 2024-03-12T17:18:53.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.630+0000 7fae83e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae7c0b5aa0 0x7fae7c0c7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.630+0000 7fae83e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae7c0cfa70 0x7fae7c0c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.630+0000 7fae83e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae7c15cbd0 0x7fae7c151260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.630+0000 7fae83e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c06d350 con 0x7fae7c15cbd0 2024-03-12T17:18:53.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.630+0000 7f4dd9e00640 1 -- 172.21.15.17:0/780593943 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4ddc0c8ef0 msgr2=0x7f4ddc0c6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.630+0000 7f4dd9e00640 1 --2- 172.21.15.17:0/780593943 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4ddc0c8ef0 0x7f4ddc0c6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.630+0000 7f4dd9e00640 1 -- 172.21.15.17:0/780593943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ddc0cfa70 msgr2=0x7f4ddc0cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.630+0000 7f4dd9e00640 1 --2- 172.21.15.17:0/780593943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ddc0cfa70 0x7f4ddc0cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.630+0000 7f4dd9e00640 1 -- 172.21.15.17:0/780593943 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dcc0094d0 con 0x7f4ddc0b5aa0 2024-03-12T17:18:53.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.631+0000 7fae81400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae7c0b5aa0 0x7fae7c0c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.631+0000 7fae81400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae7c0b5aa0 0x7fae7c0c7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.17:53520/0 (socket says 172.21.15.17:53520) 2024-03-12T17:18:53.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.631+0000 7fae81400640 1 -- 172.21.15.17:0/1858137941 learned_addr learned my addr 172.21.15.17:0/1858137941 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:53.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.631+0000 7fae83e00640 1 -- 172.21.15.17:0/1858137941 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c0c8080 con 0x7fae7c0b5aa0 2024-03-12T17:18:53.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.631+0000 7fae80a00640 1 --2- 172.21.15.17:0/1858137941 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae7c0cfa70 0x7fae7c0c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.631+0000 7fae83e00640 1 -- 172.21.15.17:0/1858137941 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c0c8360 con 0x7fae7c0cfa70 2024-03-12T17:18:53.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.631+0000 7ff469600640 1 --2- 172.21.15.17:0/3999868477 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ff44806ac80 0x7ff44806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.631+0000 7ff471600640 1 --2- 172.21.15.17:0/3999868477 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ff44806ac80 0x7ff44806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.632+0000 7ff471600640 1 --2- 172.21.15.17:0/3999868477 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ff44806ac80 0x7ff44806d140 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff464001eb0 tx=0x7ff464000f80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.633+0000 7ff469600640 1 -- 172.21.15.17:0/3999868477 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff45c059000 con 0x7ff46c0c8e60 2024-03-12T17:18:53.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.633+0000 7f2e47400640 1 -- 172.21.15.17:0/939443746 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4003adc0 con 0x7f2e500b5aa0 2024-03-12T17:18:53.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.633+0000 7f2e47400640 1 -- 172.21.15.17:0/939443746 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4004c640 con 0x7f2e500b5aa0 2024-03-12T17:18:53.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.632+0000 7fae81e00640 1 --2- 172.21.15.17:0/1858137941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae7c15cbd0 0x7fae7c151260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.633+0000 7f4dd9e00640 1 --2- 172.21.15.17:0/780593943 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4ddc0b5aa0 0x7f4ddc0c7620 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc02bea0 tx=0x7f4dcc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.636+0000 7f4dd2000640 1 -- 172.21.15.17:0/780593943 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc031860 con 0x7f4ddc0b5aa0 2024-03-12T17:18:53.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.636+0000 7f4dd2000640 1 -- 172.21.15.17:0/780593943 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dcc0443f0 con 0x7f4ddc0b5aa0 2024-03-12T17:18:53.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.636+0000 7f4dd2000640 1 -- 172.21.15.17:0/780593943 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dcc0447a0 con 0x7f4ddc0b5aa0 2024-03-12T17:18:53.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.636+0000 7f4de1200640 1 -- 172.21.15.17:0/780593943 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ddc0c86f0 con 0x7f4ddc0b5aa0 2024-03-12T17:18:53.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.636+0000 7f4de1200640 1 -- 172.21.15.17:0/780593943 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ddc0c7b60 con 0x7f4ddc0b5aa0 2024-03-12T17:18:53.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.633+0000 7fc496000640 1 -- 172.21.15.17:0/2181056435 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fc4900453f0 con 0x7fc4a0070b00 2024-03-12T17:18:53.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.635+0000 7fc496000640 1 --2- 172.21.15.17:0/2181056435 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc48006ac00 0x7fc48006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.636+0000 7fc49d400640 1 --2- 172.21.15.17:0/2181056435 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc48006ac00 0x7fc48006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.635+0000 7fae81e00640 1 -- 172.21.15.17:0/1858137941 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae7c0cfa70 msgr2=0x7fae7c0c79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.635+0000 7fae81e00640 1 --2- 172.21.15.17:0/1858137941 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae7c0cfa70 0x7fae7c0c79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.635+0000 7fae81e00640 1 -- 172.21.15.17:0/1858137941 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae7c0b5aa0 msgr2=0x7fae7c0c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:53.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.635+0000 7fae81e00640 1 --2- 172.21.15.17:0/1858137941 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae7c0b5aa0 0x7fae7c0c7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:53.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.635+0000 7fae81e00640 1 -- 172.21.15.17:0/1858137941 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae70009400 con 0x7fae7c15cbd0 2024-03-12T17:18:53.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.636+0000 7fae80a00640 1 --2- 172.21.15.17:0/1858137941 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae7c0cfa70 0x7fae7c0c79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:18:53.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.636+0000 7fae81400640 1 --2- 172.21.15.17:0/1858137941 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae7c0b5aa0 0x7fae7c0c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:18:53.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.636+0000 7fae81e00640 1 --2- 172.21.15.17:0/1858137941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae7c15cbd0 0x7fae7c151260 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fae74032000 tx=0x7fae74004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.635+0000 7f2e47400640 1 -- 172.21.15.17:0/939443746 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f2e4002f050 con 0x7f2e500b5aa0 2024-03-12T17:18:53.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.636+0000 7f2e47400640 1 --2- 172.21.15.17:0/939443746 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f2e3006ac30 0x7f2e3006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.637+0000 7f2e4ea00640 1 --2- 172.21.15.17:0/939443746 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f2e3006ac30 0x7f2e3006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.638+0000 7fc49d400640 1 --2- 172.21.15.17:0/2181056435 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc48006ac00 0x7fc48006d0c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc4a00cb150 tx=0x7fc48c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.638+0000 7f2e4ea00640 1 --2- 172.21.15.17:0/939443746 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f2e3006ac30 0x7f2e3006d0f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2e500c5570 tx=0x7f2e3c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.638+0000 7f4de1200640 1 -- 172.21.15.17:0/780593943 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ddc0b5ec0 con 0x7f4ddc0b5aa0 2024-03-12T17:18:53.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.640+0000 7f4dd2000640 1 -- 172.21.15.17:0/780593943 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f4dcc04d450 con 0x7f4ddc0b5aa0 2024-03-12T17:18:53.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.641+0000 7fae79600640 1 -- 172.21.15.17:0/1858137941 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae74009510 con 0x7fae7c15cbd0 2024-03-12T17:18:53.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.641+0000 7fc496000640 1 -- 172.21.15.17:0/2181056435 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc49007a730 con 0x7fc4a0070b00 2024-03-12T17:18:53.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.641+0000 7fae83e00640 1 -- 172.21.15.17:0/1858137941 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae74009b30 con 0x7fae7c15cbd0 2024-03-12T17:18:53.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.641+0000 7fae83e00640 1 -- 172.21.15.17:0/1858137941 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae7c0c8920 con 0x7fae7c15cbd0 2024-03-12T17:18:53.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.641+0000 7f4dd2000640 1 --2- 172.21.15.17:0/780593943 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f4dbc06acd0 0x7f4dbc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.642+0000 7f4dd2000640 1 -- 172.21.15.17:0/780593943 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4dcc02d040 con 0x7f4ddc0b5aa0 2024-03-12T17:18:53.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.642+0000 7f4dd9400640 1 --2- 172.21.15.17:0/780593943 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f4dbc06acd0 0x7f4dbc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.642+0000 7ff469600640 1 -- 172.21.15.17:0/3999868477 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7ff45c055340 con 0x7ff46c0c8e60 2024-03-12T17:18:53.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.642+0000 7fae83e00640 1 -- 172.21.15.17:0/1858137941 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae7c0736c0 con 0x7fae7c15cbd0 2024-03-12T17:18:53.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.642+0000 7f2e47400640 1 -- 172.21.15.17:0/939443746 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e4004b3b0 con 0x7f2e500b5aa0 2024-03-12T17:18:53.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.643+0000 7f4dd9400640 1 --2- 172.21.15.17:0/780593943 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f4dbc06acd0 0x7f4dbc06d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc159490 tx=0x7f4dc80079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:53.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.650+0000 7fc496000640 1 -- 172.21.15.17:0/2181056435 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fc490076370 con 0x7fc4a0070b00 2024-03-12T17:18:53.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.657+0000 7f4dd2000640 1 -- 172.21.15.17:0/780593943 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f4ddc0b5ec0 con 0x7f4ddc0b5aa0 2024-03-12T17:18:53.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.661+0000 7fae79600640 1 -- 172.21.15.17:0/1858137941 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7403e450 con 0x7fae7c15cbd0 2024-03-12T17:18:53.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.661+0000 7fae79600640 1 -- 172.21.15.17:0/1858137941 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7403e7c0 con 0x7fae7c15cbd0 2024-03-12T17:18:53.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.663+0000 7f2e47400640 1 -- 172.21.15.17:0/939443746 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f2e400765a0 con 0x7f2e500b5aa0 2024-03-12T17:18:53.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.665+0000 7fae79600640 1 -- 172.21.15.17:0/1858137941 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fae7403e9a0 con 0x7fae7c15cbd0 2024-03-12T17:18:53.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.666+0000 7fae79600640 1 --2- 172.21.15.17:0/1858137941 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fae5c06ac00 0x7fae5c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:53.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.667+0000 7fae79600640 1 -- 172.21.15.17:0/1858137941 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fae740ac360 con 0x7fae7c15cbd0 2024-03-12T17:18:53.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.667+0000 7fae81400640 1 --2- 172.21.15.17:0/1858137941 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fae5c06ac00 0x7fae5c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:53.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.670+0000 7fae79600640 1 -- 172.21.15.17:0/1858137941 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fae74077550 con 0x7fae7c15cbd0 2024-03-12T17:18:53.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:53.672+0000 7fae81400640 1 --2- 172.21.15.17:0/1858137941 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fae5c06ac00 0x7fae5c06d0c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fae68009be0 tx=0x7fae68008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:54.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.038+0000 7f460ea00640 1 -- 172.21.15.17:0/101798765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f460806c990 con 0x7f460806d360 2024-03-12T17:18:54.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.038+0000 7fc8f1200640 1 -- 172.21.15.17:0/4231234872 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc8e403b7a0 con 0x7fc8e4037fb0 2024-03-12T17:18:54.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.039+0000 7f4605600640 1 -- 172.21.15.17:0/101798765 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f460007a780 con 0x7f460806d360 2024-03-12T17:18:54.035 INFO:teuthology.orchestra.run.smithi017.stdout:55834574851 2024-03-12T17:18:54.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.039+0000 7fc8df400640 1 -- 172.21.15.17:0/4231234872 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc8e007a7d0 con 0x7fc8e4037fb0 2024-03-12T17:18:54.037 INFO:teuthology.orchestra.run.smithi017.stdout:55834574852 2024-03-12T17:18:54.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.043+0000 7f460ea00640 1 -- 172.21.15.17:0/101798765 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f45e806ac00 msgr2=0x7f45e806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:54.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.043+0000 7f460ea00640 1 --2- 172.21.15.17:0/101798765 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f45e806ac00 0x7f45e806d0c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4608204360 tx=0x7f45fc008040 comp rx=0 tx=0).stop 2024-03-12T17:18:54.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.043+0000 7f460ea00640 1 -- 172.21.15.17:0/101798765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f460806d360 msgr2=0x7f46081597f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:54.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.043+0000 7f460ea00640 1 --2- 172.21.15.17:0/101798765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f460806d360 0x7f46081597f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4600032000 tx=0x7f4600004a40 comp rx=0 tx=0).stop 2024-03-12T17:18:54.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.043+0000 7fc8f1200640 1 -- 172.21.15.17:0/4231234872 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc8cc06acc0 msgr2=0x7fc8cc06d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:54.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.043+0000 7fc8f1200640 1 --2- 172.21.15.17:0/4231234872 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc8cc06acc0 0x7fc8cc06d180 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc8e403edc0 tx=0x7fc8d8009040 comp rx=0 tx=0).stop 2024-03-12T17:18:54.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.043+0000 7fc8f1200640 1 -- 172.21.15.17:0/4231234872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8e4037fb0 msgr2=0x7fc8e40d6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:54.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.043+0000 7f460ea00640 1 -- 172.21.15.17:0/101798765 shutdown_connections 2024-03-12T17:18:54.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.043+0000 7f460ea00640 1 --2- 172.21.15.17:0/101798765 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f45e806ac00 0x7f45e806d0c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:54.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.043+0000 7f460ea00640 1 --2- 172.21.15.17:0/101798765 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4608169350 0x7f46080a88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:54.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.043+0000 7f460ea00640 1 --2- 172.21.15.17:0/101798765 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f46080b3b70 0x7f460816e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:54.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.043+0000 7f460ea00640 1 --2- 172.21.15.17:0/101798765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f460806d360 0x7f46081597f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:54.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.043+0000 7f460ea00640 1 -- 172.21.15.17:0/101798765 >> 172.21.15.17:0/101798765 conn(0x7f4608069ce0 msgr2=0x7f460816b740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:54.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.044+0000 7f460ea00640 1 -- 172.21.15.17:0/101798765 shutdown_connections 2024-03-12T17:18:54.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.043+0000 7fc8f1200640 1 --2- 172.21.15.17:0/4231234872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8e4037fb0 0x7fc8e40d6000 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0000c00 tx=0x7fc8e0004730 comp rx=0 tx=0).stop 2024-03-12T17:18:54.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.044+0000 7f460ea00640 1 -- 172.21.15.17:0/101798765 wait complete. 2024-03-12T17:18:54.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.044+0000 7fc8f1200640 1 -- 172.21.15.17:0/4231234872 shutdown_connections 2024-03-12T17:18:54.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.044+0000 7fc8f1200640 1 --2- 172.21.15.17:0/4231234872 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc8cc06acc0 0x7fc8cc06d180 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:54.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.044+0000 7fc8f1200640 1 --2- 172.21.15.17:0/4231234872 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc8e4058930 0x7fc8e40d6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:54.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.044+0000 7fc8f1200640 1 --2- 172.21.15.17:0/4231234872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc8e403c7e0 0x7fc8e40d68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:54.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.044+0000 7fc8f1200640 1 --2- 172.21.15.17:0/4231234872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc8e4037fb0 0x7fc8e40d6000 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:54.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.044+0000 7fc8f1200640 1 -- 172.21.15.17:0/4231234872 >> 172.21.15.17:0/4231234872 conn(0x7fc8e4058ec0 msgr2=0x7fc8e404f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:54.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.045+0000 7fc8f1200640 1 -- 172.21.15.17:0/4231234872 shutdown_connections 2024-03-12T17:18:54.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.045+0000 7fc8f1200640 1 -- 172.21.15.17:0/4231234872 wait complete. 2024-03-12T17:18:54.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.066+0000 7fa7d4a00640 1 -- 172.21.15.17:0/2570620063 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fa7d0072360 con 0x7fa7d00b83b0 2024-03-12T17:18:54.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.067+0000 7fa7c6a00640 1 -- 172.21.15.17:0/2570620063 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa7c00580a0 con 0x7fa7d00b83b0 2024-03-12T17:18:54.063 INFO:teuthology.orchestra.run.smithi017.stdout:55834574851 2024-03-12T17:18:54.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.071+0000 7fa7d4a00640 1 -- 172.21.15.17:0/2570620063 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fa7ac06ac00 msgr2=0x7fa7ac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:54.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.071+0000 7fa7d4a00640 1 --2- 172.21.15.17:0/2570620063 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fa7ac06ac00 0x7fa7ac06d0c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa7b8036000 tx=0x7fa7b803d040 comp rx=0 tx=0).stop 2024-03-12T17:18:54.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.071+0000 7fa7d4a00640 1 -- 172.21.15.17:0/2570620063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7d00b83b0 msgr2=0x7fa7d015ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:54.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.071+0000 7fa7d4a00640 1 --2- 172.21.15.17:0/2570620063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7d00b83b0 0x7fa7d015ce80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa7c000e900 tx=0x7fa7c000edc0 comp rx=0 tx=0).stop 2024-03-12T17:18:54.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.071+0000 7fa7d4a00640 1 -- 172.21.15.17:0/2570620063 shutdown_connections 2024-03-12T17:18:54.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.071+0000 7fa7d4a00640 1 --2- 172.21.15.17:0/2570620063 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fa7ac06ac00 0x7fa7ac06d0c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:54.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.071+0000 7fa7d4a00640 1 --2- 172.21.15.17:0/2570620063 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa7d015caa0 0x7fa7d015d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:54.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.071+0000 7fa7d4a00640 1 --2- 172.21.15.17:0/2570620063 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7d00b83b0 0x7fa7d015ce80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:54.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.071+0000 7fa7d4a00640 1 --2- 172.21.15.17:0/2570620063 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7d00b4970 0x7fa7d01fa110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:54.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.071+0000 7fa7d4a00640 1 -- 172.21.15.17:0/2570620063 >> 172.21.15.17:0/2570620063 conn(0x7fa7d00cf610 msgr2=0x7fa7d015bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:54.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.071+0000 7fa7d4a00640 1 -- 172.21.15.17:0/2570620063 shutdown_connections 2024-03-12T17:18:54.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.071+0000 7fa7d4a00640 1 -- 172.21.15.17:0/2570620063 wait complete. 2024-03-12T17:18:54.068 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.0 2024-03-12T17:18:54.069 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2024-03-12T17:18:54.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.076+0000 7fc4a4c00640 1 -- 172.21.15.17:0/2181056435 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fc4a01f66f0 con 0x7fc4a0070b00 2024-03-12T17:18:54.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.076+0000 7fc496000640 1 -- 172.21.15.17:0/2181056435 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc4a01f66f0 con 0x7fc4a0070b00 2024-03-12T17:18:54.072 INFO:teuthology.orchestra.run.smithi017.stdout:55834574852 2024-03-12T17:18:54.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.079+0000 7fc4a4c00640 1 -- 172.21.15.17:0/2181056435 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc48006ac00 msgr2=0x7fc48006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:54.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.079+0000 7fc4a4c00640 1 --2- 172.21.15.17:0/2181056435 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc48006ac00 0x7fc48006d0c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc4a00cb150 tx=0x7fc48c009040 comp rx=0 tx=0).stop 2024-03-12T17:18:54.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.079+0000 7fc4a4c00640 1 -- 172.21.15.17:0/2181056435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4a0070b00 msgr2=0x7fc4a014bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:54.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.079+0000 7fc4a4c00640 1 --2- 172.21.15.17:0/2181056435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4a0070b00 0x7fc4a014bb20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc490009890 tx=0x7fc4900046c0 comp rx=0 tx=0).stop 2024-03-12T17:18:54.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.079+0000 7fc4a4c00640 1 -- 172.21.15.17:0/2181056435 shutdown_connections 2024-03-12T17:18:54.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.079+0000 7fc4a4c00640 1 --2- 172.21.15.17:0/2181056435 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc48006ac00 0x7fc48006d0c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:54.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.079+0000 7fc4a4c00640 1 --2- 172.21.15.17:0/2181056435 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4a00ce660 0x7fc4a00ac920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:54.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.079+0000 7fc4a4c00640 1 --2- 172.21.15.17:0/2181056435 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc4a00b1710 0x7fc4a0156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:54.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.079+0000 7fc4a4c00640 1 --2- 172.21.15.17:0/2181056435 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4a0070b00 0x7fc4a014bb20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:54.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.079+0000 7fc4a4c00640 1 -- 172.21.15.17:0/2181056435 >> 172.21.15.17:0/2181056435 conn(0x7fc4a006a100 msgr2=0x7fc4a0151fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:54.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.079+0000 7fc4a4c00640 1 -- 172.21.15.17:0/2181056435 shutdown_connections 2024-03-12T17:18:54.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.079+0000 7fc4a4c00640 1 -- 172.21.15.17:0/2181056435 wait complete. 2024-03-12T17:18:54.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.081+0000 7ff462a00640 1 -- 172.21.15.17:0/3999868477 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff43c0057d0 con 0x7ff46c0c8e60 2024-03-12T17:18:54.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.082+0000 7ff469600640 1 -- 172.21.15.17:0/3999868477 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff45c058960 con 0x7ff46c0c8e60 2024-03-12T17:18:54.077 INFO:teuthology.orchestra.run.smithi017.stdout:55834574852 2024-03-12T17:18:54.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.085+0000 7ff462a00640 1 -- 172.21.15.17:0/3999868477 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ff44806ac80 msgr2=0x7ff44806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:54.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.085+0000 7ff462a00640 1 --2- 172.21.15.17:0/3999868477 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ff44806ac80 0x7ff44806d140 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff464001eb0 tx=0x7ff464000f80 comp rx=0 tx=0).stop 2024-03-12T17:18:54.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.086+0000 7ff462a00640 1 -- 172.21.15.17:0/3999868477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff46c0c8e60 msgr2=0x7ff46c1fa330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:54.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.086+0000 7ff462a00640 1 --2- 172.21.15.17:0/3999868477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff46c0c8e60 0x7ff46c1fa330 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff45c00fb10 tx=0x7ff45c00d150 comp rx=0 tx=0).stop 2024-03-12T17:18:54.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.086+0000 7ff462a00640 1 -- 172.21.15.17:0/3999868477 shutdown_connections 2024-03-12T17:18:54.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.086+0000 7ff462a00640 1 --2- 172.21.15.17:0/3999868477 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ff44806ac80 0x7ff44806d140 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:54.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.086+0000 7ff462a00640 1 --2- 172.21.15.17:0/3999868477 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff46c0b61c0 0x7ff46c15e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:54.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.086+0000 7ff462a00640 1 --2- 172.21.15.17:0/3999868477 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff46c0c8e60 0x7ff46c1fa330 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:54.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.086+0000 7ff462a00640 1 --2- 172.21.15.17:0/3999868477 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff450004120 0x7ff46c151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:54.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.086+0000 7ff462a00640 1 -- 172.21.15.17:0/3999868477 >> 172.21.15.17:0/3999868477 conn(0x7ff46c065df0 msgr2=0x7ff46c0cfa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:54.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.087+0000 7ff462a00640 1 -- 172.21.15.17:0/3999868477 shutdown_connections 2024-03-12T17:18:54.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.087+0000 7ff462a00640 1 -- 172.21.15.17:0/3999868477 wait complete. 2024-03-12T17:18:54.085 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.6 2024-03-12T17:18:54.093 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2024-03-12T17:18:54.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.103+0000 7f4de1200640 1 -- 172.21.15.17:0/780593943 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f4ddc0b5ec0 con 0x7f4ddc0b5aa0 2024-03-12T17:18:54.099 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.104+0000 7f4dd2000640 1 -- 172.21.15.17:0/780593943 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4ddc0b5ec0 con 0x7f4ddc0b5aa0 2024-03-12T17:18:54.099 INFO:teuthology.orchestra.run.smithi017.stdout:55834574852 2024-03-12T17:18:54.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.107+0000 7f4de1200640 1 -- 172.21.15.17:0/780593943 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f4dbc06acd0 msgr2=0x7f4dbc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:54.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.107+0000 7f4de1200640 1 --2- 172.21.15.17:0/780593943 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f4dbc06acd0 0x7f4dbc06d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc159490 tx=0x7f4dc80079b0 comp rx=0 tx=0).stop 2024-03-12T17:18:54.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.107+0000 7f4de1200640 1 -- 172.21.15.17:0/780593943 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4ddc0b5aa0 msgr2=0x7f4ddc0c7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:54.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.107+0000 7f4de1200640 1 --2- 172.21.15.17:0/780593943 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4ddc0b5aa0 0x7f4ddc0c7620 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc02bea0 tx=0x7f4dcc0046c0 comp rx=0 tx=0).stop 2024-03-12T17:18:54.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.107+0000 7f4de1200640 1 -- 172.21.15.17:0/780593943 shutdown_connections 2024-03-12T17:18:54.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.107+0000 7f4de1200640 1 --2- 172.21.15.17:0/780593943 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f4dbc06acd0 0x7f4dbc06d190 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:54.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.107+0000 7f4de1200640 1 --2- 172.21.15.17:0/780593943 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4ddc0c8ef0 0x7f4ddc0c6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:54.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.107+0000 7f4de1200640 1 --2- 172.21.15.17:0/780593943 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ddc0cfa70 0x7f4ddc0cb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:54.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.107+0000 7f4de1200640 1 --2- 172.21.15.17:0/780593943 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4ddc0b5aa0 0x7f4ddc0c7620 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:54.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.107+0000 7f4de1200640 1 -- 172.21.15.17:0/780593943 >> 172.21.15.17:0/780593943 conn(0x7f4ddc065df0 msgr2=0x7f4ddc0b22a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:54.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.108+0000 7f4de1200640 1 -- 172.21.15.17:0/780593943 shutdown_connections 2024-03-12T17:18:54.103 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.108+0000 7f4de1200640 1 -- 172.21.15.17:0/780593943 wait complete. 2024-03-12T17:18:54.106 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.111+0000 7fae83e00640 1 -- 172.21.15.17:0/1858137941 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fae7c0c84a0 con 0x7fae7c15cbd0 2024-03-12T17:18:54.107 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2024-03-12T17:18:54.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.111+0000 7fae79600640 1 -- 172.21.15.17:0/1858137941 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fae7c0c84a0 con 0x7fae7c15cbd0 2024-03-12T17:18:54.107 INFO:teuthology.orchestra.run.smithi017.stdout:55834574852 2024-03-12T17:18:54.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.113+0000 7fae83e00640 1 -- 172.21.15.17:0/1858137941 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fae5c06ac00 msgr2=0x7fae5c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:54.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.113+0000 7fae83e00640 1 --2- 172.21.15.17:0/1858137941 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fae5c06ac00 0x7fae5c06d0c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fae68009be0 tx=0x7fae68008040 comp rx=0 tx=0).stop 2024-03-12T17:18:54.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.113+0000 7fae83e00640 1 -- 172.21.15.17:0/1858137941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae7c15cbd0 msgr2=0x7fae7c151260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:54.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.113+0000 7fae83e00640 1 --2- 172.21.15.17:0/1858137941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae7c15cbd0 0x7fae7c151260 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fae74032000 tx=0x7fae74004a40 comp rx=0 tx=0).stop 2024-03-12T17:18:54.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.114+0000 7fae83e00640 1 -- 172.21.15.17:0/1858137941 shutdown_connections 2024-03-12T17:18:54.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.114+0000 7fae83e00640 1 --2- 172.21.15.17:0/1858137941 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fae5c06ac00 0x7fae5c06d0c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:54.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.114+0000 7fae83e00640 1 --2- 172.21.15.17:0/1858137941 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae7c15cbd0 0x7fae7c151260 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:54.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.114+0000 7fae83e00640 1 --2- 172.21.15.17:0/1858137941 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae7c0cfa70 0x7fae7c0c79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:54.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.114+0000 7fae83e00640 1 --2- 172.21.15.17:0/1858137941 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae7c0b5aa0 0x7fae7c0c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:54.109 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.114+0000 7fae83e00640 1 -- 172.21.15.17:0/1858137941 >> 172.21.15.17:0/1858137941 conn(0x7fae7c065df0 msgr2=0x7fae7c0d3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:54.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.114+0000 7fae83e00640 1 -- 172.21.15.17:0/1858137941 shutdown_connections 2024-03-12T17:18:54.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.114+0000 7fae83e00640 1 -- 172.21.15.17:0/1858137941 wait complete. 2024-03-12T17:18:54.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.116+0000 7f2e56800640 1 -- 172.21.15.17:0/939443746 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f2e50066550 con 0x7f2e500b5aa0 2024-03-12T17:18:54.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.116+0000 7f2e47400640 1 -- 172.21.15.17:0/939443746 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2e40035020 con 0x7f2e500b5aa0 2024-03-12T17:18:54.112 INFO:teuthology.orchestra.run.smithi017.stdout:55834574852 2024-03-12T17:18:54.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.120+0000 7f2e56800640 1 -- 172.21.15.17:0/939443746 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f2e3006ac30 msgr2=0x7f2e3006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:54.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.120+0000 7f2e56800640 1 --2- 172.21.15.17:0/939443746 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f2e3006ac30 0x7f2e3006d0f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2e500c5570 tx=0x7f2e3c008040 comp rx=0 tx=0).stop 2024-03-12T17:18:54.115 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.120+0000 7f2e56800640 1 -- 172.21.15.17:0/939443746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e500b5aa0 msgr2=0x7f2e50152070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:54.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.120+0000 7f2e56800640 1 --2- 172.21.15.17:0/939443746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e500b5aa0 0x7f2e50152070 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2e40000c00 tx=0x7f2e400046c0 comp rx=0 tx=0).stop 2024-03-12T17:18:54.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.120+0000 7f2e56800640 1 -- 172.21.15.17:0/939443746 shutdown_connections 2024-03-12T17:18:54.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.120+0000 7f2e56800640 1 --2- 172.21.15.17:0/939443746 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f2e3006ac30 0x7f2e3006d0f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:54.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.120+0000 7f2e56800640 1 --2- 172.21.15.17:0/939443746 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e5015cbd0 0x7f2e500d14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:54.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.120+0000 7f2e56800640 1 --2- 172.21.15.17:0/939443746 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e500cfa70 0x7f2e5015e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:54.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.120+0000 7f2e56800640 1 --2- 172.21.15.17:0/939443746 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e500b5aa0 0x7f2e50152070 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:54.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.120+0000 7f2e56800640 1 -- 172.21.15.17:0/939443746 >> 172.21.15.17:0/939443746 conn(0x7f2e50065df0 msgr2=0x7f2e500cd460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:54.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.120+0000 7f2e56800640 1 -- 172.21.15.17:0/939443746 shutdown_connections 2024-03-12T17:18:54.116 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:54.120+0000 7f2e56800640 1 -- 172.21.15.17:0/939443746 wait complete. 2024-03-12T17:18:54.123 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2024-03-12T17:18:54.125 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2024-03-12T17:18:54.132 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2024-03-12T17:18:55.070 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-12T17:18:55.070 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-12T17:18:55.087 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-12T17:18:55.094 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-12T17:18:55.108 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-12T17:18:55.124 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-12T17:18:55.126 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-12T17:18:55.133 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-12T17:18:55.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.355+0000 7fe3a5e00640 1 Processor -- start 2024-03-12T17:18:55.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.355+0000 7fe3a5e00640 1 -- start start 2024-03-12T17:18:55.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.358+0000 7fe3a5e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe39804fce0 0x7fe398055aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.358+0000 7fe3a5e00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3980eb060 con 0x7fe398047cd0 2024-03-12T17:18:55.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.358+0000 7fe3a5e00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe398048500 con 0x7fe3980eac80 2024-03-12T17:18:55.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.358+0000 7fe3a5e00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe398054cc0 con 0x7fe39804fce0 2024-03-12T17:18:55.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.359+0000 7fe39f400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fe398047cd0 0x7fe398048a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:36988/0 (socket says 172.21.15.17:36988) 2024-03-12T17:18:55.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.359+0000 7fe39e000640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe39804fce0 0x7fe398055aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.359+0000 7fe39f400640 1 -- 172.21.15.17:0/1192731469 learned_addr learned my addr 172.21.15.17:0/1192731469 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:18:55.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.359+0000 7fe39d600640 1 -- 172.21.15.17:0/1192731469 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3323894561 0 0) 0x7fe3980eb060 con 0x7fe398047cd0 2024-03-12T17:18:55.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.360+0000 7fe39d600640 1 -- 172.21.15.17:0/1192731469 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe384003520 con 0x7fe398047cd0 2024-03-12T17:18:55.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.360+0000 7fe39d600640 1 -- 172.21.15.17:0/1192731469 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3261534122 0 0) 0x7fe384003520 con 0x7fe398047cd0 2024-03-12T17:18:55.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.360+0000 7fe39d600640 1 -- 172.21.15.17:0/1192731469 >> v2:172.21.15.94:3300/0 conn(0x7fe39804fce0 msgr2=0x7fe398055aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:55.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.360+0000 7fe39d600640 1 --2- 172.21.15.17:0/1192731469 >> v2:172.21.15.94:3300/0 conn(0x7fe39804fce0 0x7fe398055aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.360+0000 7fe39d600640 1 -- 172.21.15.17:0/1192731469 >> v1:172.21.15.94:6789/0 conn(0x7fe3980eac80 legacy=0x7fe39804f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:55.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.360+0000 7fe39d600640 1 -- 172.21.15.17:0/1192731469 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3980549e0 con 0x7fe398047cd0 2024-03-12T17:18:55.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.360+0000 7fe39d600640 1 -- 172.21.15.17:0/1192731469 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7fe390001670 con 0x7fe398047cd0 2024-03-12T17:18:55.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.360+0000 7fe39d600640 1 -- 172.21.15.17:0/1192731469 >> v1:172.21.15.17:6789/0 conn(0x7fe398047cd0 legacy=0x7fe398048a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.360+0000 7fe39d600640 1 --2- 172.21.15.17:0/1192731469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe384003970 0x7fe384003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.360+0000 7fe39d600640 1 --2- 172.21.15.17:0/1192731469 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3840047c0 0x7fe384004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.360+0000 7fe39d600640 1 --2- 172.21.15.17:0/1192731469 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe3840052a0 0x7fe38400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.360+0000 7fe39d600640 1 -- 172.21.15.17:0/1192731469 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe398054cc0 con 0x7fe384003970 2024-03-12T17:18:55.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.360+0000 7fe39d600640 1 -- 172.21.15.17:0/1192731469 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe38400c170 con 0x7fe3840047c0 2024-03-12T17:18:55.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.360+0000 7fe39d600640 1 -- 172.21.15.17:0/1192731469 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe38400c330 con 0x7fe3840052a0 2024-03-12T17:18:55.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.362+0000 7fe39ea00640 1 --2- 172.21.15.17:0/1192731469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe384003970 0x7fe384003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.363+0000 7fe39e000640 1 --2- 172.21.15.17:0/1192731469 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3840047c0 0x7fe384004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.363+0000 7fcb6dc00640 1 Processor -- start 2024-03-12T17:18:55.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.364+0000 7fe39e000640 1 -- 172.21.15.17:0/1192731469 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe3840052a0 msgr2=0x7fe38400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:55.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.364+0000 7fe39f400640 1 --2- 172.21.15.17:0/1192731469 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe3840052a0 0x7fe38400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.364+0000 7fcb6dc00640 1 -- start start 2024-03-12T17:18:55.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.364+0000 7fe39e000640 1 --2- 172.21.15.17:0/1192731469 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe3840052a0 0x7fe38400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.364+0000 7fe39e000640 1 -- 172.21.15.17:0/1192731469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe384003970 msgr2=0x7fe384003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:55.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.364+0000 7fe39e000640 1 --2- 172.21.15.17:0/1192731469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe384003970 0x7fe384003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.364+0000 7fe39e000640 1 -- 172.21.15.17:0/1192731469 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3980549e0 con 0x7fe3840047c0 2024-03-12T17:18:55.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.366+0000 7fe39f400640 1 -- 172.21.15.17:0/1192731469 reap_dead start 2024-03-12T17:18:55.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.366+0000 7fe39ea00640 1 --2- 172.21.15.17:0/1192731469 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe384003970 0x7fe384003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-12T17:18:55.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.366+0000 7fcb6dc00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcb68160070 0x7fcb680b8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.366+0000 7fcb6dc00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fcb68160450 0x7fcb680b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.366+0000 7fcb6dc00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb681613d0 con 0x7fcb680b47d0 2024-03-12T17:18:55.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.366+0000 7fcb6dc00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb681608b0 con 0x7fcb68160450 2024-03-12T17:18:55.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.366+0000 7fcb6dc00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb68160aa0 con 0x7fcb68160070 2024-03-12T17:18:55.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.367+0000 7fe39e000640 1 --2- 172.21.15.17:0/1192731469 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3840047c0 0x7fe384004c40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0069410 tx=0x7fe3840057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c687706e31b225ed server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:55.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.367+0000 7fe39d600640 1 -- 172.21.15.17:0/1192731469 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a00ac700 con 0x7fe3840047c0 2024-03-12T17:18:55.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.367+0000 7fe39d600640 1 -- 172.21.15.17:0/1192731469 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a00ac860 con 0x7fe3840047c0 2024-03-12T17:18:55.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.367+0000 7fe39d600640 1 -- 172.21.15.17:0/1192731469 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a00acc10 con 0x7fe3840047c0 2024-03-12T17:18:55.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.367+0000 7fcb66a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcb68160070 0x7fcb680b8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.368+0000 7fcb66000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fcb68160450 0x7fcb680b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.368+0000 7fcb67400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fcb680b47d0 0x7fcb6806b130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:36992/0 (socket says 172.21.15.17:36992) 2024-03-12T17:18:55.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.368+0000 7fcb67400640 1 -- 172.21.15.17:0/2541908900 learned_addr learned my addr 172.21.15.17:0/2541908900 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:18:55.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.369+0000 7fe3a5e00640 1 -- 172.21.15.17:0/1192731469 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3840047c0 msgr2=0x7fe384004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.369+0000 7fe3a5e00640 1 --2- 172.21.15.17:0/1192731469 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3840047c0 0x7fe384004c40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0069410 tx=0x7fe3840057f0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.369+0000 7fcb66a00640 1 -- 172.21.15.17:0/2541908900 >> v2:172.21.15.17:3300/0 conn(0x7fcb68160450 msgr2=0x7fcb680b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:55.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.369+0000 7fcb66a00640 1 --2- 172.21.15.17:0/2541908900 >> v2:172.21.15.17:3300/0 conn(0x7fcb68160450 0x7fcb680b1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.369+0000 7fcb66a00640 1 -- 172.21.15.17:0/2541908900 >> v1:172.21.15.17:6789/0 conn(0x7fcb680b47d0 legacy=0x7fcb6806b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.369+0000 7fcb66a00640 1 -- 172.21.15.17:0/2541908900 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb68160d80 con 0x7fcb68160070 2024-03-12T17:18:55.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.369+0000 7fe3a5e00640 1 -- 172.21.15.17:0/1192731469 shutdown_connections 2024-03-12T17:18:55.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.369+0000 7fe3a5e00640 1 --2- 172.21.15.17:0/1192731469 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3840047c0 0x7fe384004c40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.369+0000 7fe3a5e00640 1 -- 172.21.15.17:0/1192731469 >> 172.21.15.17:0/1192731469 conn(0x7fe398054ed0 msgr2=0x7fe3980552e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:55.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.370+0000 7fe3a5e00640 1 -- 172.21.15.17:0/1192731469 shutdown_connections 2024-03-12T17:18:55.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.370+0000 7fe3a5e00640 1 -- 172.21.15.17:0/1192731469 wait complete. 2024-03-12T17:18:55.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.372+0000 7fcb66a00640 1 --2- 172.21.15.17:0/2541908900 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcb68160070 0x7fcb680b8300 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcb580097a0 tx=0x7fcb5802b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bea6c6a874041c2 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:55.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.373+0000 7fcb65600640 1 -- 172.21.15.17:0/2541908900 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb580316f0 con 0x7fcb68160070 2024-03-12T17:18:55.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.373+0000 7fcb65600640 1 -- 172.21.15.17:0/2541908900 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb58031850 con 0x7fcb68160070 2024-03-12T17:18:55.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.373+0000 7fcb65600640 1 -- 172.21.15.17:0/2541908900 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb58031be0 con 0x7fcb68160070 2024-03-12T17:18:55.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.373+0000 7fe3a5e00640 1 Processor -- start 2024-03-12T17:18:55.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.373+0000 7fe3a5e00640 1 -- start start 2024-03-12T17:18:55.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.374+0000 7fcb6dc00640 1 -- 172.21.15.17:0/2541908900 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcb68160070 msgr2=0x7fcb680b8300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.374+0000 7fcb6dc00640 1 --2- 172.21.15.17:0/2541908900 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcb68160070 0x7fcb680b8300 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fcb580097a0 tx=0x7fcb5802b790 comp rx=0 tx=0).stop 2024-03-12T17:18:55.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.375+0000 7fcb6dc00640 1 -- 172.21.15.17:0/2541908900 shutdown_connections 2024-03-12T17:18:55.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.375+0000 7fcb6dc00640 1 --2- 172.21.15.17:0/2541908900 >> v2:172.21.15.17:3300/0 conn(0x7fcb68160450 0x7fcb680b1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.375+0000 7fcb6dc00640 1 --2- 172.21.15.17:0/2541908900 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcb68160070 0x7fcb680b8300 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.375+0000 7fcb6dc00640 1 -- 172.21.15.17:0/2541908900 >> 172.21.15.17:0/2541908900 conn(0x7fcb680cf810 msgr2=0x7fcb680cfc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:55.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.376+0000 7fe3a5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3840047c0 0x7fe3980dd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.376+0000 7fcb6dc00640 1 -- 172.21.15.17:0/2541908900 shutdown_connections 2024-03-12T17:18:55.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.377+0000 7fe3a5e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe3980e80b0 0x7fe3980e8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.377+0000 7fe39ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3840047c0 0x7fe3980dd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.376+0000 7fcb6dc00640 1 -- 172.21.15.17:0/2541908900 wait complete. 2024-03-12T17:18:55.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.377+0000 7fe39ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3840047c0 0x7fe3980dd7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38806/0 (socket says 172.21.15.17:38806) 2024-03-12T17:18:55.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.377+0000 7fe39ea00640 1 -- 172.21.15.17:0/2368741246 learned_addr learned my addr 172.21.15.17:0/2368741246 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:55.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.377+0000 7fe3a5e00640 1 --2- 172.21.15.17:0/2368741246 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe398043d50 0x7fe3980441d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.377+0000 7fe3a5e00640 1 -- 172.21.15.17:0/2368741246 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3980ddce0 con 0x7fe3840047c0 2024-03-12T17:18:55.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.378+0000 7fe39e000640 1 --2- 172.21.15.17:0/2368741246 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe3980e80b0 0x7fe3980e8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.378+0000 7fe3a5e00640 1 -- 172.21.15.17:0/2368741246 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3980e8a70 con 0x7fe398043d50 2024-03-12T17:18:55.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.378+0000 7fe3a5e00640 1 -- 172.21.15.17:0/2368741246 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39804c040 con 0x7fe3980e80b0 2024-03-12T17:18:55.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.378+0000 7fe39f400640 1 --2- 172.21.15.17:0/2368741246 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe398043d50 0x7fe3980441d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.379+0000 7fe39e000640 1 -- 172.21.15.17:0/2368741246 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe398043d50 msgr2=0x7fe3980441d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.379+0000 7fe39e000640 1 --2- 172.21.15.17:0/2368741246 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe398043d50 0x7fe3980441d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.380+0000 7fe39e000640 1 -- 172.21.15.17:0/2368741246 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3840047c0 msgr2=0x7fe3980dd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.380+0000 7fe39e000640 1 --2- 172.21.15.17:0/2368741246 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3840047c0 0x7fe3980dd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.380+0000 7fe39e000640 1 -- 172.21.15.17:0/2368741246 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39804c2b0 con 0x7fe3980e80b0 2024-03-12T17:18:55.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.380+0000 7fcb6dc00640 1 Processor -- start 2024-03-12T17:18:55.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.380+0000 7fe39ea00640 1 --2- 172.21.15.17:0/2368741246 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3840047c0 0x7fe3980dd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-12T17:18:55.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.381+0000 7fcb6dc00640 1 -- start start 2024-03-12T17:18:55.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.381+0000 7fe39f400640 1 --2- 172.21.15.17:0/2368741246 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe398043d50 0x7fe3980441d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:18:55.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.381+0000 7fe39e000640 1 --2- 172.21.15.17:0/2368741246 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe3980e80b0 0x7fe3980e8530 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0073d10 tx=0x7fe3a0069ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:55.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.382+0000 7fe397400640 1 -- 172.21.15.17:0/2368741246 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a00b5a50 con 0x7fe3980e80b0 2024-03-12T17:18:55.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.382+0000 7fe3a5e00640 1 -- 172.21.15.17:0/2368741246 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe39804c590 con 0x7fe3980e80b0 2024-03-12T17:18:55.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.382+0000 7fe3a5e00640 1 -- 172.21.15.17:0/2368741246 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe39804cb50 con 0x7fe3980e80b0 2024-03-12T17:18:55.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.383+0000 7fcb6dc00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcb680b47d0 0x7fcb6814c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.383+0000 7fcb6dc00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcb68160070 0x7fcb680c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.383+0000 7fcb6dc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb68160450 0x7fcb6814f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.384+0000 7fcb6dc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb680b68c0 con 0x7fcb68160450 2024-03-12T17:18:55.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.384+0000 7fe397400640 1 -- 172.21.15.17:0/2368741246 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3a00b5bb0 con 0x7fe3980e80b0 2024-03-12T17:18:55.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.384+0000 7fe397400640 1 -- 172.21.15.17:0/2368741246 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3a00b5a50 con 0x7fe3980e80b0 2024-03-12T17:18:55.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.384+0000 7fcb6dc00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6814f300 con 0x7fcb68160070 2024-03-12T17:18:55.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.384+0000 7fcb67400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb68160450 0x7fcb6814f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.384+0000 7fcb67400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb68160450 0x7fcb6814f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38812/0 (socket says 172.21.15.17:38812) 2024-03-12T17:18:55.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.384+0000 7fcb67400640 1 -- 172.21.15.17:0/4002290736 learned_addr learned my addr 172.21.15.17:0/4002290736 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:55.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.384+0000 7fcb66a00640 1 --2- 172.21.15.17:0/4002290736 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcb680b47d0 0x7fcb6814c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.384+0000 7fcb6dc00640 1 -- 172.21.15.17:0/4002290736 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6814ea30 con 0x7fcb680b47d0 2024-03-12T17:18:55.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.384+0000 7fcb66000640 1 --2- 172.21.15.17:0/4002290736 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcb68160070 0x7fcb680c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.385+0000 7fcb67400640 1 -- 172.21.15.17:0/4002290736 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcb680b47d0 msgr2=0x7fcb6814c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.385+0000 7fcb67400640 1 --2- 172.21.15.17:0/4002290736 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcb680b47d0 0x7fcb6814c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.385+0000 7fcb67400640 1 -- 172.21.15.17:0/4002290736 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcb68160070 msgr2=0x7fcb680c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.385+0000 7fcb67400640 1 --2- 172.21.15.17:0/4002290736 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcb68160070 0x7fcb680c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.385+0000 7fcb67400640 1 -- 172.21.15.17:0/4002290736 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb58009400 con 0x7fcb68160450 2024-03-12T17:18:55.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.385+0000 7fcb67400640 1 --2- 172.21.15.17:0/4002290736 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb68160450 0x7fcb6814f790 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcb6000cb70 tx=0x7fcb6000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:55.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.386+0000 7fcb5ea00640 1 -- 172.21.15.17:0/4002290736 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6000ad40 con 0x7fcb68160450 2024-03-12T17:18:55.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.386+0000 7fcb5ea00640 1 -- 172.21.15.17:0/4002290736 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb60012400 con 0x7fcb68160450 2024-03-12T17:18:55.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.386+0000 7fcb5ea00640 1 -- 172.21.15.17:0/4002290736 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6000aea0 con 0x7fcb68160450 2024-03-12T17:18:55.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.386+0000 7fcb6dc00640 1 -- 172.21.15.17:0/4002290736 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb680c91b0 con 0x7fcb68160450 2024-03-12T17:18:55.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.387+0000 7fcb6dc00640 1 -- 172.21.15.17:0/4002290736 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb6814ef90 con 0x7fcb68160450 2024-03-12T17:18:55.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.388+0000 7fe397400640 1 -- 172.21.15.17:0/2368741246 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fe3a00bd070 con 0x7fe3980e80b0 2024-03-12T17:18:55.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.390+0000 7fe397400640 1 --2- 172.21.15.17:0/2368741246 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe37c06acf0 0x7fe37c06d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.391+0000 7fe39ea00640 1 --2- 172.21.15.17:0/2368741246 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe37c06acf0 0x7fe37c06d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.391+0000 7fe397400640 1 -- 172.21.15.17:0/2368741246 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe3a00f4600 con 0x7fe3980e80b0 2024-03-12T17:18:55.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.389+0000 7fcb6dc00640 1 -- 172.21.15.17:0/4002290736 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb6814f490 con 0x7fcb68160450 2024-03-12T17:18:55.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.392+0000 7fcb5ea00640 1 -- 172.21.15.17:0/4002290736 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fcb60012770 con 0x7fcb68160450 2024-03-12T17:18:55.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.393+0000 7fcb5ea00640 1 --2- 172.21.15.17:0/4002290736 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fcb4806ac00 0x7fcb4806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.394+0000 7fcb66a00640 1 --2- 172.21.15.17:0/4002290736 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fcb4806ac00 0x7fcb4806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.393+0000 7fe394c00640 1 -- 172.21.15.17:0/2368741246 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe378005250 con 0x7fe3980e80b0 2024-03-12T17:18:55.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.396+0000 7fe39ea00640 1 --2- 172.21.15.17:0/2368741246 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe37c06acf0 0x7fe37c06d1b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe3880055f0 tx=0x7fe388007cc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:55.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.396+0000 7fcb5ea00640 1 -- 172.21.15.17:0/4002290736 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcb60058590 con 0x7fcb68160450 2024-03-12T17:18:55.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.397+0000 7fcb66a00640 1 --2- 172.21.15.17:0/4002290736 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fcb4806ac00 0x7fcb4806d0c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcb58036000 tx=0x7fcb58008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:55.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.402+0000 7fcb5ea00640 1 -- 172.21.15.17:0/4002290736 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fcb6008e060 con 0x7fcb68160450 2024-03-12T17:18:55.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.412+0000 7f86db200640 1 Processor -- start 2024-03-12T17:18:55.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.412+0000 7f86db200640 1 -- start start 2024-03-12T17:18:55.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.412+0000 7fe397400640 1 -- 172.21.15.17:0/2368741246 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fe3a00f09d0 con 0x7fe3980e80b0 2024-03-12T17:18:55.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.414+0000 7f86db200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f86d40d2fa0 0x7f86d40d3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.414+0000 7f86db200640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f86d40b5f70 0x7f86d40d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.414+0000 7f86db200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86d40d14e0 con 0x7f86d40b5b50 2024-03-12T17:18:55.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.414+0000 7f86db200640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86d40b59e0 con 0x7f86d40b5f70 2024-03-12T17:18:55.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.414+0000 7f86db200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d40d38c0 con 0x7f86d40d2fa0 2024-03-12T17:18:55.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.415+0000 7f86d3e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f86d40d2fa0 0x7f86d40d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.415+0000 7f86d3400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f86d40b5b50 0x7f86d40cd840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37000/0 (socket says 172.21.15.17:37000) 2024-03-12T17:18:55.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.415+0000 7f86d3400640 1 -- 172.21.15.17:0/329691100 learned_addr learned my addr 172.21.15.17:0/329691100 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:18:55.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.416+0000 7f86d9200640 1 --2- 172.21.15.17:0/329691100 >> v2:172.21.15.94:3300/0 conn(0x7f86d40b5f70 0x7f86d40d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.417+0000 7f86d9200640 1 -- 172.21.15.17:0/329691100 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f86d40d2fa0 msgr2=0x7f86d40d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:55.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.417+0000 7f86d9200640 1 --2- 172.21.15.17:0/329691100 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f86d40d2fa0 0x7f86d40d3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.417+0000 7f86d9200640 1 -- 172.21.15.17:0/329691100 >> v1:172.21.15.17:6789/0 conn(0x7f86d40b5b50 legacy=0x7f86d40cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.417+0000 7f86d9200640 1 -- 172.21.15.17:0/329691100 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d40b85b0 con 0x7f86d40b5f70 2024-03-12T17:18:55.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.419+0000 7f86d9200640 1 --2- 172.21.15.17:0/329691100 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86d40b5f70 0x7f86d40d1f30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f86cc009d90 tx=0x7f86cc02bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c090207b6a4baa90 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:55.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.419+0000 7faf37200640 1 Processor -- start 2024-03-12T17:18:55.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.419+0000 7faf37200640 1 -- start start 2024-03-12T17:18:55.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.420+0000 7f86d2a00640 1 -- 172.21.15.17:0/329691100 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86cc02cc50 con 0x7f86d40b5f70 2024-03-12T17:18:55.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.420+0000 7f86d2a00640 1 -- 172.21.15.17:0/329691100 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86cc02cdb0 con 0x7f86d40b5f70 2024-03-12T17:18:55.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.421+0000 7f86d2a00640 1 -- 172.21.15.17:0/329691100 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86cc02cc50 con 0x7f86d40b5f70 2024-03-12T17:18:55.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.422+0000 7f236e000640 1 Processor -- start 2024-03-12T17:18:55.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.422+0000 7f86db200640 1 -- 172.21.15.17:0/329691100 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86d40b5f70 msgr2=0x7f86d40d1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.422+0000 7f86db200640 1 --2- 172.21.15.17:0/329691100 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86d40b5f70 0x7f86d40d1f30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f86cc009d90 tx=0x7f86cc02bea0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.422+0000 7f86db200640 1 -- 172.21.15.17:0/329691100 shutdown_connections 2024-03-12T17:18:55.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.422+0000 7faf37200640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7faf300e2020 0x7faf30008900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.422+0000 7faf37200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf300e5680 con 0x7faf30008e40 2024-03-12T17:18:55.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.422+0000 7f86db200640 1 --2- 172.21.15.17:0/329691100 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86d40b5f70 0x7f86d40d1f30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.422+0000 7f86db200640 1 --2- 172.21.15.17:0/329691100 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f86d40d2fa0 0x7f86d40d3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.422+0000 7f86db200640 1 -- 172.21.15.17:0/329691100 >> 172.21.15.17:0/329691100 conn(0x7f86d4065df0 msgr2=0x7f86d4066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:55.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.422+0000 7faf37200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf300092b0 con 0x7faf300dea10 2024-03-12T17:18:55.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.422+0000 7faf37200640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf300dedf0 con 0x7faf300e2020 2024-03-12T17:18:55.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.422+0000 7f236e000640 1 -- start start 2024-03-12T17:18:55.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.423+0000 7faf35e00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7faf300dea10 0x7faf300080b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.17:43962/0 (socket says 172.21.15.17:43962) 2024-03-12T17:18:55.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.423+0000 7faf35e00640 1 -- 172.21.15.17:0/4058118924 learned_addr learned my addr 172.21.15.17:0/4058118924 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:18:55.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.423+0000 7faf35400640 1 --2- 172.21.15.17:0/4058118924 >> v2:172.21.15.94:3300/0 conn(0x7faf300e2020 0x7faf30008900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.423+0000 7f86db200640 1 -- 172.21.15.17:0/329691100 shutdown_connections 2024-03-12T17:18:55.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.423+0000 7f86db200640 1 -- 172.21.15.17:0/329691100 wait complete. 2024-03-12T17:18:55.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.424+0000 7faf34a00640 1 -- 172.21.15.17:0/4058118924 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1844932439 0 0) 0x7faf300092b0 con 0x7faf300dea10 2024-03-12T17:18:55.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.424+0000 7faf34a00640 1 -- 172.21.15.17:0/4058118924 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf1c007930 con 0x7faf300dea10 2024-03-12T17:18:55.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.424+0000 7faf35400640 1 -- 172.21.15.17:0/4058118924 >> v1:172.21.15.94:6789/0 conn(0x7faf300dea10 legacy=0x7faf300080b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.424+0000 7faf35400640 1 -- 172.21.15.17:0/4058118924 >> v1:172.21.15.17:6789/0 conn(0x7faf30008e40 legacy=0x7faf30051200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.424+0000 7faf35400640 1 -- 172.21.15.17:0/4058118924 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf300e4a70 con 0x7faf300e2020 2024-03-12T17:18:55.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.425+0000 7f236e000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f236815cbd0 0x7f23680d0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.425+0000 7f86db200640 1 Processor -- start 2024-03-12T17:18:55.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.425+0000 7f236e000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23680cfa70 0x7f23680cff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.426+0000 7f236e000640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23680b6e00 con 0x7f23680b5aa0 2024-03-12T17:18:55.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.425+0000 7f86db200640 1 -- start start 2024-03-12T17:18:55.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.426+0000 7f2367400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f236815cbd0 0x7f23680d0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.426+0000 7f2367400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f236815cbd0 0x7f23680d0de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38816/0 (socket says 172.21.15.17:38816) 2024-03-12T17:18:55.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.426+0000 7f2367400640 1 -- 172.21.15.17:0/955684998 learned_addr learned my addr 172.21.15.17:0/955684998 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:55.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.426+0000 7f236e000640 1 -- 172.21.15.17:0/955684998 --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23680d0440 con 0x7f236815cbd0 2024-03-12T17:18:55.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.426+0000 7faf35400640 1 --2- 172.21.15.17:0/4058118924 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf300e2020 0x7faf30008900 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7faf280097d0 tx=0x7faf2802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7e700a49e1dcb00 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:55.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.426+0000 7f2367e00640 1 --2- 172.21.15.17:0/955684998 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23680cfa70 0x7f23680cff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.423 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.426+0000 7f236e000640 1 -- 172.21.15.17:0/955684998 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23680b61f0 con 0x7f23680cfa70 2024-03-12T17:18:55.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.426+0000 7f2366a00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f23680b5aa0 0x7f23680b84b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.17:43974/0 (socket says 172.21.15.17:43974) 2024-03-12T17:18:55.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.427+0000 7f2366000640 1 -- 172.21.15.17:0/955684998 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3237674073 0 0) 0x7f23680b6e00 con 0x7f23680b5aa0 2024-03-12T17:18:55.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.427+0000 7f2366000640 1 -- 172.21.15.17:0/955684998 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f234c003520 con 0x7f23680b5aa0 2024-03-12T17:18:55.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.427+0000 7f2367400640 1 -- 172.21.15.17:0/955684998 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23680cfa70 msgr2=0x7f23680cff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:55.424 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.427+0000 7f2367400640 1 --2- 172.21.15.17:0/955684998 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23680cfa70 0x7f23680cff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.427+0000 7f2367400640 1 -- 172.21.15.17:0/955684998 >> v1:172.21.15.94:6789/0 conn(0x7f23680b5aa0 legacy=0x7f23680b84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.427+0000 7f2367400640 1 -- 172.21.15.17:0/955684998 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23680b64d0 con 0x7f236815cbd0 2024-03-12T17:18:55.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.429+0000 7faf34a00640 1 -- 172.21.15.17:0/4058118924 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf28030610 con 0x7faf300e2020 2024-03-12T17:18:55.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.429+0000 7faf34a00640 1 -- 172.21.15.17:0/4058118924 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf28030770 con 0x7faf300e2020 2024-03-12T17:18:55.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.429+0000 7faf34a00640 1 -- 172.21.15.17:0/4058118924 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf28030b00 con 0x7faf300e2020 2024-03-12T17:18:55.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.427+0000 7f86db200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86d40b5b50 0x7f86d4153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.427+0000 7f86db200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f86d40b5f70 0x7f86d41f6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.427+0000 7f86db200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86d40d2fa0 0x7f86d40ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.427+0000 7f86db200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d415e4f0 con 0x7f86d40d2fa0 2024-03-12T17:18:55.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.427+0000 7f86db200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d40c9e40 con 0x7f86d40b5b50 2024-03-12T17:18:55.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.427+0000 7f86db200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d4154480 con 0x7f86d40b5f70 2024-03-12T17:18:55.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.428+0000 7f86d3400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f86d40b5f70 0x7f86d41f6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.428+0000 7f86d3e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86d40b5b50 0x7f86d4153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.428+0000 7f86d3e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86d40b5b50 0x7f86d4153f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.17:53554/0 (socket says 172.21.15.17:53554) 2024-03-12T17:18:55.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.428+0000 7f86d3e00640 1 -- 172.21.15.17:0/706789008 learned_addr learned my addr 172.21.15.17:0/706789008 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:55.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.428+0000 7f86d9200640 1 --2- 172.21.15.17:0/706789008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86d40d2fa0 0x7f86d40ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.427+0000 7f2bc3200640 1 Processor -- start 2024-03-12T17:18:55.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.429+0000 7f2367e00640 1 --2- 172.21.15.17:0/955684998 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23680cfa70 0x7f23680cff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-12T17:18:55.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.427+0000 7f2bc3200640 1 -- start start 2024-03-12T17:18:55.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.429+0000 7f86d3e00640 1 -- 172.21.15.17:0/706789008 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f86d40b5f70 msgr2=0x7f86d41f6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.429+0000 7f86d3e00640 1 --2- 172.21.15.17:0/706789008 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f86d40b5f70 0x7f86d41f6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.429+0000 7f86d3e00640 1 -- 172.21.15.17:0/706789008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86d40d2fa0 msgr2=0x7f86d40ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.429+0000 7f2bc3200640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2bb4059e00 0x7f2bb40e4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.429+0000 7f2bc3200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2bb4000e20 0x7f2bb4001280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.429+0000 7f2bc3200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2bb40e6d10 0x7f2bb40e71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.430+0000 7faf37200640 1 -- 172.21.15.17:0/4058118924 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf300e2020 msgr2=0x7faf30008900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.430+0000 7faf37200640 1 --2- 172.21.15.17:0/4058118924 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf300e2020 0x7faf30008900 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7faf280097d0 tx=0x7faf2802b960 comp rx=0 tx=0).stop 2024-03-12T17:18:55.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.429+0000 7f2bc3200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bb40017c0 con 0x7f2bb4000e20 2024-03-12T17:18:55.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.430+0000 7faf37200640 1 -- 172.21.15.17:0/4058118924 shutdown_connections 2024-03-12T17:18:55.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.430+0000 7faf37200640 1 --2- 172.21.15.17:0/4058118924 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf300e2020 0x7faf30008900 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.430+0000 7faf37200640 1 -- 172.21.15.17:0/4058118924 >> 172.21.15.17:0/4058118924 conn(0x7faf30055ba0 msgr2=0x7faf30055fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:55.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.430+0000 7f86d3e00640 1 --2- 172.21.15.17:0/706789008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86d40d2fa0 0x7f86d40ca2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.430+0000 7f86d3e00640 1 -- 172.21.15.17:0/706789008 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86cc009a70 con 0x7f86d40b5b50 2024-03-12T17:18:55.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.430+0000 7f86d9200640 1 --2- 172.21.15.17:0/706789008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86d40d2fa0 0x7f86d40ca2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-12T17:18:55.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.429+0000 7f2bc3200640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bb40e4760 con 0x7f2bb4059e00 2024-03-12T17:18:55.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.430+0000 7f2367400640 1 --2- 172.21.15.17:0/955684998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f236815cbd0 0x7f23680d0de0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2360009e50 tx=0x7f236002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a11885941d8fbd4 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:55.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.430+0000 7faf37200640 1 -- 172.21.15.17:0/4058118924 shutdown_connections 2024-03-12T17:18:55.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.429+0000 7f2bc3200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb4055f70 con 0x7f2bb40e6d10 2024-03-12T17:18:55.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.429+0000 7f2bbbe00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2bb4059e00 0x7f2bb40e4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.431+0000 7f86d3e00640 1 --2- 172.21.15.17:0/706789008 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86d40b5b50 0x7f86d4153f40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f86c400e870 tx=0x7f86c400ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:55.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.431+0000 7f2366000640 1 -- 172.21.15.17:0/955684998 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236002cb20 con 0x7f236815cbd0 2024-03-12T17:18:55.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.431+0000 7f2366000640 1 -- 172.21.15.17:0/955684998 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236002cc80 con 0x7f236815cbd0 2024-03-12T17:18:55.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.431+0000 7f2366000640 1 -- 172.21.15.17:0/955684998 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23600343f0 con 0x7f236815cbd0 2024-03-12T17:18:55.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.430+0000 7f2bbbe00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2bb4059e00 0x7f2bb40e4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.17:53570/0 (socket says 172.21.15.17:53570) 2024-03-12T17:18:55.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.430+0000 7f2bbbe00640 1 -- 172.21.15.17:0/1026243872 learned_addr learned my addr 172.21.15.17:0/1026243872 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:55.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.430+0000 7f2bbbe00640 1 -- 172.21.15.17:0/1026243872 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2bb40e6d10 msgr2=0x7f2bb40e71a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-12T17:18:55.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.430+0000 7f2bbbe00640 1 --2- 172.21.15.17:0/1026243872 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2bb40e6d10 0x7f2bb40e71a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.430+0000 7f2bbbe00640 1 -- 172.21.15.17:0/1026243872 >> v2:172.21.15.17:3300/0 conn(0x7f2bb4000e20 msgr2=0x7f2bb4001280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:55.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.430+0000 7f2bbbe00640 1 --2- 172.21.15.17:0/1026243872 >> v2:172.21.15.17:3300/0 conn(0x7f2bb4000e20 0x7f2bb4001280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.431+0000 7f86cbe00640 1 -- 172.21.15.17:0/706789008 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c40094f0 con 0x7f86d40b5b50 2024-03-12T17:18:55.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.430+0000 7f2bbbe00640 1 -- 172.21.15.17:0/1026243872 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb4056250 con 0x7f2bb4059e00 2024-03-12T17:18:55.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.432+0000 7f86cbe00640 1 -- 172.21.15.17:0/706789008 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c400c940 con 0x7f86d40b5b50 2024-03-12T17:18:55.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.432+0000 7f86cbe00640 1 -- 172.21.15.17:0/706789008 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c400ccf0 con 0x7f86d40b5b50 2024-03-12T17:18:55.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.432+0000 7f86db200640 1 -- 172.21.15.17:0/706789008 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86d41f6e60 con 0x7f86d40b5b50 2024-03-12T17:18:55.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.432+0000 7f86db200640 1 -- 172.21.15.17:0/706789008 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86d41f7420 con 0x7f86d40b5b50 2024-03-12T17:18:55.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.432+0000 7f236e000640 1 -- 172.21.15.17:0/955684998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f236815cbd0 msgr2=0x7f23680d0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.432+0000 7f236e000640 1 --2- 172.21.15.17:0/955684998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f236815cbd0 0x7f23680d0de0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2360009e50 tx=0x7f236002bf80 comp rx=0 tx=0).stop 2024-03-12T17:18:55.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.430+0000 7faf37200640 1 -- 172.21.15.17:0/4058118924 wait complete. 2024-03-12T17:18:55.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.433+0000 7faf37200640 1 Processor -- start 2024-03-12T17:18:55.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.433+0000 7f236e000640 1 -- 172.21.15.17:0/955684998 shutdown_connections 2024-03-12T17:18:55.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.433+0000 7f236e000640 1 --2- 172.21.15.17:0/955684998 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23680cfa70 0x7f23680cff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.433+0000 7f236e000640 1 --2- 172.21.15.17:0/955684998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f236815cbd0 0x7f23680d0de0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.433+0000 7f236e000640 1 -- 172.21.15.17:0/955684998 >> 172.21.15.17:0/955684998 conn(0x7f2368065df0 msgr2=0x7f2368066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:55.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.433+0000 7f2bbbe00640 1 --2- 172.21.15.17:0/1026243872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bb4059e00 0x7f2bb40e4220 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc02c880 tx=0x7f2bbc074330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=612c966067d843ab server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:55.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.433+0000 7faf37200640 1 -- start start 2024-03-12T17:18:55.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.434+0000 7f2bbaa00640 1 -- 172.21.15.17:0/1026243872 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc0aed90 con 0x7f2bb4059e00 2024-03-12T17:18:55.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.434+0000 7f2bbaa00640 1 -- 172.21.15.17:0/1026243872 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bbc0b6440 con 0x7f2bb4059e00 2024-03-12T17:18:55.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.434+0000 7f2bbaa00640 1 -- 172.21.15.17:0/1026243872 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc0b6870 con 0x7f2bb4059e00 2024-03-12T17:18:55.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.435+0000 7f2bc3200640 1 -- 172.21.15.17:0/1026243872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bb4059e00 msgr2=0x7f2bb40e4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.438 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.435+0000 7f2bc3200640 1 --2- 172.21.15.17:0/1026243872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bb4059e00 0x7f2bb40e4220 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc02c880 tx=0x7f2bbc074330 comp rx=0 tx=0).stop 2024-03-12T17:18:55.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.433+0000 7f236e000640 1 -- 172.21.15.17:0/955684998 shutdown_connections 2024-03-12T17:18:55.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.433+0000 7f236e000640 1 -- 172.21.15.17:0/955684998 wait complete. 2024-03-12T17:18:55.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.436+0000 7faf37200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf30008e40 0x7faf300e38f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.435+0000 7f86db200640 1 -- 172.21.15.17:0/706789008 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86d40736c0 con 0x7f86d40b5b50 2024-03-12T17:18:55.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.436+0000 7f236e000640 1 Processor -- start 2024-03-12T17:18:55.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.436+0000 7f86cbe00640 1 -- 172.21.15.17:0/706789008 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f86c4013470 con 0x7f86d40b5b50 2024-03-12T17:18:55.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.436+0000 7faf37200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf300dea10 0x7faf30177b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.436+0000 7f236e000640 1 -- start start 2024-03-12T17:18:55.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.437+0000 7faf37200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf300e2020 0x7faf30178080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.441 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.437+0000 7f2bc3200640 1 -- 172.21.15.17:0/1026243872 shutdown_connections 2024-03-12T17:18:55.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.437+0000 7f2bc3200640 1 --2- 172.21.15.17:0/1026243872 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2bb40e6d10 0x7f2bb40e71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.437+0000 7f2bc3200640 1 --2- 172.21.15.17:0/1026243872 >> v2:172.21.15.17:3300/0 conn(0x7f2bb4000e20 0x7f2bb4001280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.437+0000 7faf35e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf30008e40 0x7faf300e38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.437+0000 7faf35e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf30008e40 0x7faf300e38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.17:36060/0 (socket says 172.21.15.17:36060) 2024-03-12T17:18:55.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.437+0000 7f2bc3200640 1 --2- 172.21.15.17:0/1026243872 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bb4059e00 0x7f2bb40e4220 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.437+0000 7f2bc3200640 1 -- 172.21.15.17:0/1026243872 >> 172.21.15.17:0/1026243872 conn(0x7f2bb405a7e0 msgr2=0x7f2bb405abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:55.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.437+0000 7faf35400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf300dea10 0x7faf30177b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.437+0000 7f2bc3200640 1 -- 172.21.15.17:0/1026243872 shutdown_connections 2024-03-12T17:18:55.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.437+0000 7faf35400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf300dea10 0x7faf30177b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.17:53578/0 (socket says 172.21.15.17:53578) 2024-03-12T17:18:55.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.437+0000 7f2bc3200640 1 -- 172.21.15.17:0/1026243872 wait complete. 2024-03-12T17:18:55.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.438+0000 7f236e000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23680b5aa0 0x7f236815d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.438+0000 7f236e000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23680cfa70 0x7f23680c80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.438+0000 7f236e000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f236815cbd0 0x7f23681f5560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.438+0000 7f236e000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236815d760 con 0x7f236815cbd0 2024-03-12T17:18:55.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.438+0000 7f236e000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236815d990 con 0x7f23680cfa70 2024-03-12T17:18:55.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.438+0000 7f236e000640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23680b7e40 con 0x7f23680b5aa0 2024-03-12T17:18:55.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.438+0000 7faf35e00640 1 -- 172.21.15.17:0/1686943554 learned_addr learned my addr 172.21.15.17:0/1686943554 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:55.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.438+0000 7faf37200640 1 -- 172.21.15.17:0/1686943554 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf300e3e30 con 0x7faf300e2020 2024-03-12T17:18:55.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.438+0000 7faf37200640 1 -- 172.21.15.17:0/1686943554 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf300e2850 con 0x7faf300dea10 2024-03-12T17:18:55.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.438+0000 7faf36800640 1 --2- 172.21.15.17:0/1686943554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf300e2020 0x7faf30178080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.438+0000 7faf37200640 1 -- 172.21.15.17:0/1686943554 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf300e2b30 con 0x7faf30008e40 2024-03-12T17:18:55.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.437+0000 7f86cbe00640 1 --2- 172.21.15.17:0/706789008 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f86b406ac00 0x7f86b406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.438+0000 7f86cbe00640 1 -- 172.21.15.17:0/706789008 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f86c4089430 con 0x7f86d40b5b50 2024-03-12T17:18:55.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.439+0000 7f86d3400640 1 --2- 172.21.15.17:0/706789008 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f86b406ac00 0x7f86b406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.439+0000 7f2367400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23680b5aa0 0x7f236815d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.439+0000 7f2367400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23680b5aa0 0x7f236815d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.17:36068/0 (socket says 172.21.15.17:36068) 2024-03-12T17:18:55.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.439+0000 7f2367400640 1 -- 172.21.15.17:0/638055520 learned_addr learned my addr 172.21.15.17:0/638055520 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:55.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.439+0000 7f2367e00640 1 --2- 172.21.15.17:0/638055520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f236815cbd0 0x7f23681f5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.440+0000 7f2366a00640 1 --2- 172.21.15.17:0/638055520 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23680cfa70 0x7f23680c80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.446 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.440+0000 7f2367400640 1 -- 172.21.15.17:0/638055520 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23680cfa70 msgr2=0x7f23680c80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.440+0000 7f2367400640 1 --2- 172.21.15.17:0/638055520 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23680cfa70 0x7f23680c80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.440+0000 7f2367400640 1 -- 172.21.15.17:0/638055520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f236815cbd0 msgr2=0x7f23681f5560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.440+0000 7f2367400640 1 --2- 172.21.15.17:0/638055520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f236815cbd0 0x7f23681f5560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.440+0000 7f2367400640 1 -- 172.21.15.17:0/638055520 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2354009400 con 0x7f23680b5aa0 2024-03-12T17:18:55.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.440+0000 7faf35400640 1 -- 172.21.15.17:0/1686943554 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf30008e40 msgr2=0x7faf300e38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.440+0000 7faf35400640 1 --2- 172.21.15.17:0/1686943554 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf30008e40 0x7faf300e38f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.440+0000 7faf35400640 1 -- 172.21.15.17:0/1686943554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf300e2020 msgr2=0x7faf30178080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.440+0000 7faf35400640 1 --2- 172.21.15.17:0/1686943554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf300e2020 0x7faf30178080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.440+0000 7f86d3400640 1 --2- 172.21.15.17:0/706789008 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f86b406ac00 0x7f86b406d0c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f86d40663d0 tx=0x7f86c0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:55.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.440+0000 7faf35400640 1 -- 172.21.15.17:0/1686943554 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf28009400 con 0x7faf300dea10 2024-03-12T17:18:55.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.441+0000 7faf35e00640 1 --2- 172.21.15.17:0/1686943554 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf30008e40 0x7faf300e38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-12T17:18:55.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.441+0000 7f2367400640 1 --2- 172.21.15.17:0/638055520 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23680b5aa0 0x7f236815d220 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2360036040 tx=0x7f2360004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:55.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.441+0000 7faf35400640 1 --2- 172.21.15.17:0/1686943554 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf300dea10 0x7faf30177b40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7faf28033000 tx=0x7faf280046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:55.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.442+0000 7f235f400640 1 -- 172.21.15.17:0/638055520 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2360004040 con 0x7f23680b5aa0 2024-03-12T17:18:55.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.442+0000 7f235f400640 1 -- 172.21.15.17:0/638055520 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23600041a0 con 0x7f23680b5aa0 2024-03-12T17:18:55.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.442+0000 7f235f400640 1 -- 172.21.15.17:0/638055520 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2360004510 con 0x7f23680b5aa0 2024-03-12T17:18:55.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.442+0000 7f2bc3200640 1 Processor -- start 2024-03-12T17:18:55.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.442+0000 7f2bc3200640 1 -- start start 2024-03-12T17:18:55.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.442+0000 7f236e000640 1 -- 172.21.15.17:0/638055520 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2360009b30 con 0x7f23680b5aa0 2024-03-12T17:18:55.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.442+0000 7f236e000640 1 -- 172.21.15.17:0/638055520 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23680b8400 con 0x7f23680b5aa0 2024-03-12T17:18:55.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.444+0000 7f2bc3200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bb4000e20 0x7f2bb40d3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.444+0000 7f2bc3200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2bb4059e00 0x7f2bb40d8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.444+0000 7f2bc3200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bb40e6d10 0x7f2bb404eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.444+0000 7f2bc3200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb403e5c0 con 0x7f2bb40e6d10 2024-03-12T17:18:55.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.444+0000 7f2bc3200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb40d4470 con 0x7f2bb4000e20 2024-03-12T17:18:55.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.444+0000 7f2bc3200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb40d91a0 con 0x7f2bb4059e00 2024-03-12T17:18:55.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.444+0000 7f236e000640 1 -- 172.21.15.17:0/638055520 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23680b7f80 con 0x7f23680b5aa0 2024-03-12T17:18:55.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.444+0000 7f2bc1c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bb40e6d10 0x7f2bb404eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.445+0000 7f2bc1c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bb40e6d10 0x7f2bb404eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38858/0 (socket says 172.21.15.17:38858) 2024-03-12T17:18:55.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.445+0000 7f2bbbe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bb4000e20 0x7f2bb40d3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.445+0000 7f2bc1c00640 1 -- 172.21.15.17:0/3446924384 learned_addr learned my addr 172.21.15.17:0/3446924384 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:55.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.445+0000 7f2bbb400640 1 --2- 172.21.15.17:0/3446924384 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2bb4059e00 0x7f2bb40d8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.445+0000 7f2bc1c00640 1 -- 172.21.15.17:0/3446924384 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2bb4059e00 msgr2=0x7f2bb40d8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.445+0000 7f2bc1c00640 1 --2- 172.21.15.17:0/3446924384 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2bb4059e00 0x7f2bb40d8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.446+0000 7f2bc1c00640 1 -- 172.21.15.17:0/3446924384 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bb4000e20 msgr2=0x7f2bb40d3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.446+0000 7f2bc1c00640 1 --2- 172.21.15.17:0/3446924384 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bb4000e20 0x7f2bb40d3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.446+0000 7f2bc1c00640 1 -- 172.21.15.17:0/3446924384 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bbc06be70 con 0x7f2bb40e6d10 2024-03-12T17:18:55.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.446+0000 7f2bbbe00640 1 --2- 172.21.15.17:0/3446924384 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bb4000e20 0x7f2bb40d3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:18:55.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.446+0000 7f2bc1c00640 1 --2- 172.21.15.17:0/3446924384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bb40e6d10 0x7f2bb404eb70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2ba800b3f0 tx=0x7f2ba800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:55.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.446+0000 7f2bafe00640 1 -- 172.21.15.17:0/3446924384 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba8011830 con 0x7f2bb40e6d10 2024-03-12T17:18:55.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.447+0000 7f2bafe00640 1 -- 172.21.15.17:0/3446924384 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba8011990 con 0x7f2bb40e6d10 2024-03-12T17:18:55.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.447+0000 7f2bafe00640 1 -- 172.21.15.17:0/3446924384 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba8011d40 con 0x7f2bb40e6d10 2024-03-12T17:18:55.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.447+0000 7f2bc3200640 1 -- 172.21.15.17:0/3446924384 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bb40d9480 con 0x7f2bb40e6d10 2024-03-12T17:18:55.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.447+0000 7f2bc3200640 1 -- 172.21.15.17:0/3446924384 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb403e7d0 con 0x7f2bb40e6d10 2024-03-12T17:18:55.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.446+0000 7f235f400640 1 -- 172.21.15.17:0/638055520 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f2360004670 con 0x7f23680b5aa0 2024-03-12T17:18:55.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.448+0000 7f235f400640 1 --2- 172.21.15.17:0/638055520 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f234806ac00 0x7f234806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.449+0000 7f235f400640 1 -- 172.21.15.17:0/638055520 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f23600ab980 con 0x7f23680b5aa0 2024-03-12T17:18:55.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.449+0000 7f2366a00640 1 --2- 172.21.15.17:0/638055520 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f234806ac00 0x7f234806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.450+0000 7f2bc3200640 1 -- 172.21.15.17:0/3446924384 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b98005250 con 0x7f2bb40e6d10 2024-03-12T17:18:55.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.451+0000 7f2366a00640 1 --2- 172.21.15.17:0/638055520 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f234806ac00 0x7f234806d0c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f23681f54c0 tx=0x7f2358007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:55.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.451+0000 7f2bafe00640 1 -- 172.21.15.17:0/3446924384 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f2ba801a400 con 0x7f2bb40e6d10 2024-03-12T17:18:55.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.453+0000 7f2bafe00640 1 --2- 172.21.15.17:0/3446924384 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f2b9c06ac50 0x7f2b9c06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.453+0000 7f2bafe00640 1 -- 172.21.15.17:0/3446924384 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ba8089540 con 0x7f2bb40e6d10 2024-03-12T17:18:55.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.454+0000 7f2bbbe00640 1 --2- 172.21.15.17:0/3446924384 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f2b9c06ac50 0x7f2b9c06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.455+0000 7f2bbbe00640 1 --2- 172.21.15.17:0/3446924384 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f2b9c06ac50 0x7f2b9c06d110 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2bb40e48a0 tx=0x7f2bbc06d030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:55.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.461+0000 7f2bafe00640 1 -- 172.21.15.17:0/3446924384 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f2ba8054670 con 0x7f2bb40e6d10 2024-03-12T17:18:55.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.462+0000 7faf2e000640 1 -- 172.21.15.17:0/1686943554 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf28047070 con 0x7faf300dea10 2024-03-12T17:18:55.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.462+0000 7faf2e000640 1 -- 172.21.15.17:0/1686943554 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2803f040 con 0x7faf300dea10 2024-03-12T17:18:55.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.462+0000 7faf2e000640 1 -- 172.21.15.17:0/1686943554 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf28039bd0 con 0x7faf300dea10 2024-03-12T17:18:55.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.463+0000 7faf37200640 1 -- 172.21.15.17:0/1686943554 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf300e2e10 con 0x7faf300dea10 2024-03-12T17:18:55.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.463+0000 7faf37200640 1 -- 172.21.15.17:0/1686943554 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf300e33d0 con 0x7faf300dea10 2024-03-12T17:18:55.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.463+0000 7f86cbe00640 1 -- 172.21.15.17:0/706789008 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f86c4054620 con 0x7f86d40b5b50 2024-03-12T17:18:55.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.465+0000 7faf37200640 1 -- 172.21.15.17:0/1686943554 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf300e35c0 con 0x7faf300dea10 2024-03-12T17:18:55.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.467+0000 7faf2e000640 1 -- 172.21.15.17:0/1686943554 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7faf28039d30 con 0x7faf300dea10 2024-03-12T17:18:55.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.468+0000 7faf2e000640 1 --2- 172.21.15.17:0/1686943554 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faf1806acd0 0x7faf1806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.469+0000 7faf2e000640 1 -- 172.21.15.17:0/1686943554 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf280ab590 con 0x7faf300dea10 2024-03-12T17:18:55.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.469+0000 7faf35e00640 1 --2- 172.21.15.17:0/1686943554 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faf1806acd0 0x7faf1806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.470+0000 7faf35e00640 1 --2- 172.21.15.17:0/1686943554 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faf1806acd0 0x7faf1806d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faf24005880 tx=0x7faf24009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:55.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.477+0000 7f235f400640 1 -- 172.21.15.17:0/638055520 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f23680b7f80 con 0x7f23680b5aa0 2024-03-12T17:18:55.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.478+0000 7fa7cf400640 1 Processor -- start 2024-03-12T17:18:55.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.478+0000 7fa7cf400640 1 -- start start 2024-03-12T17:18:55.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.479+0000 7f05ecc00640 1 Processor -- start 2024-03-12T17:18:55.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.479+0000 7f05ecc00640 1 -- start start 2024-03-12T17:18:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.480+0000 7fa7cf400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa7c80d2fa0 0x7fa7c80d3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.480+0000 7fa7cf400640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7c80d14e0 con 0x7fa7c80b5f70 2024-03-12T17:18:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.480+0000 7fa7cf400640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7c80d38c0 con 0x7fa7c80b5b50 2024-03-12T17:18:55.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.480+0000 7fa7cf400640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c80b59e0 con 0x7fa7c80d2fa0 2024-03-12T17:18:55.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.481+0000 7fa7cd400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fa7c80b5f70 0x7fa7c80d1f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37008/0 (socket says 172.21.15.17:37008) 2024-03-12T17:18:55.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.481+0000 7fa7cca00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa7c80d2fa0 0x7fa7c80d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.481+0000 7fa7cd400640 1 -- 172.21.15.17:0/3262983238 learned_addr learned my addr 172.21.15.17:0/3262983238 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:18:55.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.482+0000 7fa7c7400640 1 -- 172.21.15.17:0/3262983238 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2090471178 0 0) 0x7fa7c80d14e0 con 0x7fa7c80b5f70 2024-03-12T17:18:55.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.482+0000 7fa7c7400640 1 -- 172.21.15.17:0/3262983238 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7ac003520 con 0x7fa7c80b5f70 2024-03-12T17:18:55.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.482+0000 7fa7cca00640 1 -- 172.21.15.17:0/3262983238 >> v1:172.21.15.94:6789/0 conn(0x7fa7c80b5b50 legacy=0x7fa7c80cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.482+0000 7fa7cca00640 1 -- 172.21.15.17:0/3262983238 >> v1:172.21.15.17:6789/0 conn(0x7fa7c80b5f70 legacy=0x7fa7c80d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.482+0000 7fa7cca00640 1 -- 172.21.15.17:0/3262983238 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c80b85b0 con 0x7fa7c80d2fa0 2024-03-12T17:18:55.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.482+0000 7f05ecc00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f05e80b1780 0x7f05e80b2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.482+0000 7f05ecc00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f05e8162680 0x7f05e80b2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.482+0000 7f05ecc00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05e806d040 con 0x7f05e8161a80 2024-03-12T17:18:55.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.482+0000 7f05ecc00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e806ce40 con 0x7f05e8162680 2024-03-12T17:18:55.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.482+0000 7f05ecc00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e806d320 con 0x7f05e80b1780 2024-03-12T17:18:55.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.482+0000 7f05e5e00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f05e8161a80 0x7f05e8161e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.17:44002/0 (socket says 172.21.15.17:44002) 2024-03-12T17:18:55.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.482+0000 7f05e5e00640 1 -- 172.21.15.17:0/430116347 learned_addr learned my addr 172.21.15.17:0/430116347 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:18:55.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.483+0000 7f05e6800640 1 --2- 172.21.15.17:0/430116347 >> v2:172.21.15.17:3300/0 conn(0x7f05e8162680 0x7f05e80b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.483+0000 7f05e5400640 1 --2- 172.21.15.17:0/430116347 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f05e80b1780 0x7f05e80b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.483+0000 7fa7cca00640 1 --2- 172.21.15.17:0/3262983238 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa7c80d2fa0 0x7fa7c80d3380 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0009dc0 tx=0x7fa7c002bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4f619e2de65bd7e server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:55.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.484+0000 7fa7c7400640 1 -- 172.21.15.17:0/3262983238 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c002cc50 con 0x7fa7c80d2fa0 2024-03-12T17:18:55.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.484+0000 7fa7c7400640 1 -- 172.21.15.17:0/3262983238 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c002cdb0 con 0x7fa7c80d2fa0 2024-03-12T17:18:55.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.484+0000 7fa7c7400640 1 -- 172.21.15.17:0/3262983238 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c0034640 con 0x7fa7c80d2fa0 2024-03-12T17:18:55.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.484+0000 7fa7cf400640 1 -- 172.21.15.17:0/3262983238 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa7c80d2fa0 msgr2=0x7fa7c80d3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.484+0000 7fa7cf400640 1 --2- 172.21.15.17:0/3262983238 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa7c80d2fa0 0x7fa7c80d3380 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0009dc0 tx=0x7fa7c002bea0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.485+0000 7fa7cf400640 1 -- 172.21.15.17:0/3262983238 shutdown_connections 2024-03-12T17:18:55.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.485+0000 7fa7cf400640 1 --2- 172.21.15.17:0/3262983238 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa7c80d2fa0 0x7fa7c80d3380 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.485+0000 7fa7cf400640 1 -- 172.21.15.17:0/3262983238 >> 172.21.15.17:0/3262983238 conn(0x7fa7c8065df0 msgr2=0x7fa7c8066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:55.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.484+0000 7f05e5400640 1 -- 172.21.15.17:0/430116347 >> v2:172.21.15.17:3300/0 conn(0x7f05e8162680 msgr2=0x7f05e80b2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:55.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.484+0000 7f05e5400640 1 --2- 172.21.15.17:0/430116347 >> v2:172.21.15.17:3300/0 conn(0x7f05e8162680 0x7f05e80b2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.484+0000 7f05e5400640 1 -- 172.21.15.17:0/430116347 >> v1:172.21.15.94:6789/0 conn(0x7f05e8161a80 legacy=0x7f05e8161e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.484+0000 7f05e5400640 1 -- 172.21.15.17:0/430116347 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e806d600 con 0x7f05e80b1780 2024-03-12T17:18:55.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.485+0000 7fa7cf400640 1 -- 172.21.15.17:0/3262983238 shutdown_connections 2024-03-12T17:18:55.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.485+0000 7fa7cf400640 1 -- 172.21.15.17:0/3262983238 wait complete. 2024-03-12T17:18:55.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.486+0000 7faf2e000640 1 -- 172.21.15.17:0/1686943554 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7faf28076890 con 0x7faf300dea10 2024-03-12T17:18:55.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.486+0000 7f05e6800640 1 --2- 172.21.15.17:0/430116347 >> v2:172.21.15.17:3300/0 conn(0x7f05e8162680 0x7f05e80b2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-12T17:18:55.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.487+0000 7f05e5400640 1 --2- 172.21.15.17:0/430116347 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f05e80b1780 0x7f05e80b2120 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f05d40097a0 tx=0x7f05d402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efe89dc7e1febc09 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:55.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.487+0000 7f05e4a00640 1 -- 172.21.15.17:0/430116347 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d4031640 con 0x7f05e80b1780 2024-03-12T17:18:55.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.487+0000 7fa7cf400640 1 Processor -- start 2024-03-12T17:18:55.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.487+0000 7f05e4a00640 1 -- 172.21.15.17:0/430116347 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d40317a0 con 0x7f05e80b1780 2024-03-12T17:18:55.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.487+0000 7f05e4a00640 1 -- 172.21.15.17:0/430116347 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d4031640 con 0x7f05e80b1780 2024-03-12T17:18:55.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.488+0000 7fa7cf400640 1 -- start start 2024-03-12T17:18:55.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.489+0000 7f05ecc00640 1 -- 172.21.15.17:0/430116347 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f05e80b1780 msgr2=0x7f05e80b2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.489+0000 7fa7cf400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7c80b5b50 0x7fa7c815fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.489+0000 7fa7cf400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7c80b5f70 0x7fa7c81f25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.489+0000 7f05ecc00640 1 --2- 172.21.15.17:0/430116347 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f05e80b1780 0x7f05e80b2120 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f05d40097a0 tx=0x7f05d402b8f0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.489+0000 7f05ecc00640 1 -- 172.21.15.17:0/430116347 shutdown_connections 2024-03-12T17:18:55.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.489+0000 7f05ecc00640 1 --2- 172.21.15.17:0/430116347 >> v2:172.21.15.17:3300/0 conn(0x7f05e8162680 0x7f05e80b2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.489+0000 7fa7cf400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa7c80d2fa0 0x7fa7c8158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.489+0000 7fa7cf400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c81f3a00 con 0x7fa7c80b5f70 2024-03-12T17:18:55.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.489+0000 7fa7cf400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c81f2b30 con 0x7fa7c80b5b50 2024-03-12T17:18:55.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.489+0000 7fa7cf400640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7c81f2dd0 con 0x7fa7c80d2fa0 2024-03-12T17:18:55.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.489+0000 7fa7cca00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7c80b5b50 0x7fa7c815fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.490+0000 7f05ecc00640 1 --2- 172.21.15.17:0/430116347 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f05e80b1780 0x7f05e80b2120 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.490+0000 7f05ecc00640 1 -- 172.21.15.17:0/430116347 >> 172.21.15.17:0/430116347 conn(0x7f05e8069ce0 msgr2=0x7f05e806a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:55.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.490+0000 7fa7cca00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7c80b5b50 0x7fa7c815fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.17:53598/0 (socket says 172.21.15.17:53598) 2024-03-12T17:18:55.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.490+0000 7fa7cca00640 1 -- 172.21.15.17:0/3434184607 learned_addr learned my addr 172.21.15.17:0/3434184607 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:55.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.490+0000 7fa7cd400640 1 --2- 172.21.15.17:0/3434184607 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa7c80d2fa0 0x7fa7c8158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.490+0000 7f05ecc00640 1 -- 172.21.15.17:0/430116347 shutdown_connections 2024-03-12T17:18:55.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.490+0000 7f05ecc00640 1 -- 172.21.15.17:0/430116347 wait complete. 2024-03-12T17:18:55.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.490+0000 7fa7c7e00640 1 --2- 172.21.15.17:0/3434184607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7c80b5f70 0x7fa7c81f25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.490+0000 7fa7cca00640 1 -- 172.21.15.17:0/3434184607 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa7c80d2fa0 msgr2=0x7fa7c8158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.490+0000 7fa7cca00640 1 --2- 172.21.15.17:0/3434184607 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa7c80d2fa0 0x7fa7c8158f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.490+0000 7fa7cca00640 1 -- 172.21.15.17:0/3434184607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7c80b5f70 msgr2=0x7fa7c81f25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.491+0000 7fa7cca00640 1 --2- 172.21.15.17:0/3434184607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7c80b5f70 0x7fa7c81f25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.491+0000 7fa7cca00640 1 -- 172.21.15.17:0/3434184607 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c0009a70 con 0x7fa7c80b5b50 2024-03-12T17:18:55.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.491+0000 7fa7c7e00640 1 --2- 172.21.15.17:0/3434184607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7c80b5f70 0x7fa7c81f25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:18:55.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.492+0000 7fa7cca00640 1 --2- 172.21.15.17:0/3434184607 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7c80b5b50 0x7fa7c815fd60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0037040 tx=0x7fa7c0004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:55.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.493+0000 7f05ecc00640 1 Processor -- start 2024-03-12T17:18:55.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.492+0000 7fa7c4c00640 1 -- 172.21.15.17:0/3434184607 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c0004800 con 0x7fa7c80b5b50 2024-03-12T17:18:55.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.492+0000 7fa7c4c00640 1 -- 172.21.15.17:0/3434184607 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c0003e10 con 0x7fa7c80b5b50 2024-03-12T17:18:55.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.492+0000 7fa7c4c00640 1 -- 172.21.15.17:0/3434184607 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c0034640 con 0x7fa7c80b5b50 2024-03-12T17:18:55.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.493+0000 7f05ecc00640 1 -- start start 2024-03-12T17:18:55.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.493+0000 7fa7cf400640 1 -- 172.21.15.17:0/3434184607 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7c81f30b0 con 0x7fa7c80b5b50 2024-03-12T17:18:55.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.494+0000 7fa7cf400640 1 -- 172.21.15.17:0/3434184607 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7c8159440 con 0x7fa7c80b5b50 2024-03-12T17:18:55.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.495+0000 7f05ecc00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f05e80b1780 0x7f05e81fa6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.495+0000 7f05ecc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05e8161a80 0x7f05e80aa200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.495+0000 7fa7cf400640 1 -- 172.21.15.17:0/3434184607 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7c81f35d0 con 0x7fa7c80b5b50 2024-03-12T17:18:55.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.496+0000 7f05ecc00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f05e8162680 0x7f05e81f5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.496+0000 7f05e5e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f05e80b1780 0x7f05e81fa6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.496+0000 7f05e5e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f05e80b1780 0x7f05e81fa6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.17:36100/0 (socket says 172.21.15.17:36100) 2024-03-12T17:18:55.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.496+0000 7f05e5e00640 1 -- 172.21.15.17:0/907642082 learned_addr learned my addr 172.21.15.17:0/907642082 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:55.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.496+0000 7f05ecc00640 1 -- 172.21.15.17:0/907642082 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e81fac20 con 0x7f05e8161a80 2024-03-12T17:18:55.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.496+0000 7f05ecc00640 1 -- 172.21.15.17:0/907642082 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e80ad570 con 0x7f05e8162680 2024-03-12T17:18:55.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.496+0000 7f05ecc00640 1 -- 172.21.15.17:0/907642082 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e80ac4d0 con 0x7f05e80b1780 2024-03-12T17:18:55.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.496+0000 7f05e6800640 1 --2- 172.21.15.17:0/907642082 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f05e8162680 0x7f05e81f5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.497+0000 7f05e5e00640 1 -- 172.21.15.17:0/907642082 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f05e8162680 msgr2=0x7f05e81f5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.497+0000 7f05e5e00640 1 --2- 172.21.15.17:0/907642082 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f05e8162680 0x7f05e81f5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.497+0000 7f05e5e00640 1 -- 172.21.15.17:0/907642082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05e8161a80 msgr2=0x7f05e80aa200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.497+0000 7f05e5e00640 1 --2- 172.21.15.17:0/907642082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05e8161a80 0x7f05e80aa200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.497+0000 7f05e5e00640 1 -- 172.21.15.17:0/907642082 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e0009a70 con 0x7f05e80b1780 2024-03-12T17:18:55.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.498+0000 7f05e6800640 1 --2- 172.21.15.17:0/907642082 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f05e8162680 0x7f05e81f5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-12T17:18:55.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.498+0000 7f05e5e00640 1 --2- 172.21.15.17:0/907642082 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f05e80b1780 0x7f05e81fa6e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f05d800c4a0 tx=0x7f05d800c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:55.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.498+0000 7f05de000640 1 -- 172.21.15.17:0/907642082 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d8005ce0 con 0x7f05e80b1780 2024-03-12T17:18:55.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.499+0000 7f05de000640 1 -- 172.21.15.17:0/907642082 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d8005e40 con 0x7f05e80b1780 2024-03-12T17:18:55.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.499+0000 7f05de000640 1 -- 172.21.15.17:0/907642082 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d80072d0 con 0x7f05e80b1780 2024-03-12T17:18:55.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.499+0000 7f05ecc00640 1 -- 172.21.15.17:0/907642082 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d4009400 con 0x7f05e80b1780 2024-03-12T17:18:55.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.499+0000 7f05ecc00640 1 -- 172.21.15.17:0/907642082 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e80aca90 con 0x7f05e80b1780 2024-03-12T17:18:55.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.501+0000 7fa7c4c00640 1 -- 172.21.15.17:0/3434184607 <== mon.1 v2:172.21.15.94:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fa7c00347a0 con 0x7fa7c80b5b50 2024-03-12T17:18:55.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.501+0000 7f05ecc00640 1 -- 172.21.15.17:0/907642082 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05e80736c0 con 0x7f05e80b1780 2024-03-12T17:18:55.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.503+0000 7f05de000640 1 -- 172.21.15.17:0/907642082 <== mon.2 v2:172.21.15.94:3301/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f05d80074f0 con 0x7f05e80b1780 2024-03-12T17:18:55.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.502+0000 7fa7c4c00640 1 --2- 172.21.15.17:0/3434184607 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fa7a806ac00 0x7fa7a806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.503+0000 7fa7c4c00640 1 -- 172.21.15.17:0/3434184607 <== mon.1 v2:172.21.15.94:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7c00abfe0 con 0x7fa7c80b5b50 2024-03-12T17:18:55.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.505+0000 7f05de000640 1 --2- 172.21.15.17:0/907642082 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f05c806ac00 0x7f05c806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:55.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.505+0000 7f05de000640 1 -- 172.21.15.17:0/907642082 <== mon.2 v2:172.21.15.94:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f05d8088890 con 0x7f05e80b1780 2024-03-12T17:18:55.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.505+0000 7f05e5400640 1 --2- 172.21.15.17:0/907642082 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f05c806ac00 0x7f05c806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.506+0000 7f05e5400640 1 --2- 172.21.15.17:0/907642082 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f05c806ac00 0x7f05c806d0c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f05d4036000 tx=0x7f05d4030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:55.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.507+0000 7fa7c7e00640 1 --2- 172.21.15.17:0/3434184607 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fa7a806ac00 0x7fa7a806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:55.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.510+0000 7fa7c7e00640 1 --2- 172.21.15.17:0/3434184607 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fa7a806ac00 0x7fa7a806d0c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa7c815d420 tx=0x7fa7b4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:55.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.516+0000 7fa7c4c00640 1 -- 172.21.15.17:0/3434184607 <== mon.1 v2:172.21.15.94:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fa7c0077390 con 0x7fa7c80b5b50 2024-03-12T17:18:55.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.517+0000 7f05de000640 1 -- 172.21.15.17:0/907642082 <== mon.2 v2:172.21.15.94:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f05d8053a80 con 0x7f05e80b1780 2024-03-12T17:18:55.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.787+0000 7fcb6dc00640 1 -- 172.21.15.17:0/4002290736 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcb6804e030 con 0x7fcb68160450 2024-03-12T17:18:55.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.788+0000 7fcb5ea00640 1 -- 172.21.15.17:0/4002290736 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcb600541d0 con 0x7fcb68160450 2024-03-12T17:18:55.784 INFO:teuthology.orchestra.run.smithi017.stdout:55834574853 2024-03-12T17:18:55.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.792+0000 7fcb6dc00640 1 -- 172.21.15.17:0/4002290736 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fcb4806ac00 msgr2=0x7fcb4806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.793+0000 7fcb6dc00640 1 --2- 172.21.15.17:0/4002290736 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fcb4806ac00 0x7fcb4806d0c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcb58036000 tx=0x7fcb58008030 comp rx=0 tx=0).stop 2024-03-12T17:18:55.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.793+0000 7fcb6dc00640 1 -- 172.21.15.17:0/4002290736 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb68160450 msgr2=0x7fcb6814f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.793+0000 7fcb6dc00640 1 --2- 172.21.15.17:0/4002290736 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb68160450 0x7fcb6814f790 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcb6000cb70 tx=0x7fcb6000a430 comp rx=0 tx=0).stop 2024-03-12T17:18:55.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.794+0000 7fcb6dc00640 1 -- 172.21.15.17:0/4002290736 shutdown_connections 2024-03-12T17:18:55.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.794+0000 7fcb6dc00640 1 --2- 172.21.15.17:0/4002290736 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fcb4806ac00 0x7fcb4806d0c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.794+0000 7fcb6dc00640 1 --2- 172.21.15.17:0/4002290736 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcb68160450 0x7fcb6814f790 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.794+0000 7fcb6dc00640 1 --2- 172.21.15.17:0/4002290736 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcb68160070 0x7fcb680c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.794+0000 7fcb6dc00640 1 --2- 172.21.15.17:0/4002290736 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcb680b47d0 0x7fcb6814c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.794+0000 7fcb6dc00640 1 -- 172.21.15.17:0/4002290736 >> 172.21.15.17:0/4002290736 conn(0x7fcb680cf810 msgr2=0x7fcb680d1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:55.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.794+0000 7fcb6dc00640 1 -- 172.21.15.17:0/4002290736 shutdown_connections 2024-03-12T17:18:55.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.795+0000 7fcb6dc00640 1 -- 172.21.15.17:0/4002290736 wait complete. 2024-03-12T17:18:55.815 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2024-03-12T17:18:55.815 DEBUG:teuthology.parallel:result is None 2024-03-12T17:18:55.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.831+0000 7fe394c00640 1 -- 172.21.15.17:0/2368741246 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe3780057d0 con 0x7fe3980e80b0 2024-03-12T17:18:55.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.832+0000 7fe397400640 1 -- 172.21.15.17:0/2368741246 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe3a00b0020 con 0x7fe3980e80b0 2024-03-12T17:18:55.828 INFO:teuthology.orchestra.run.smithi017.stdout:55834574852 2024-03-12T17:18:55.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.835+0000 7fe394c00640 1 -- 172.21.15.17:0/2368741246 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe37c06acf0 msgr2=0x7fe37c06d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.835+0000 7fe394c00640 1 --2- 172.21.15.17:0/2368741246 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe37c06acf0 0x7fe37c06d1b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe3880055f0 tx=0x7fe388007cc0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.835+0000 7fe394c00640 1 -- 172.21.15.17:0/2368741246 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe3980e80b0 msgr2=0x7fe3980e8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.835+0000 7fe394c00640 1 --2- 172.21.15.17:0/2368741246 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe3980e80b0 0x7fe3980e8530 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0073d10 tx=0x7fe3a0069ae0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.835+0000 7fe394c00640 1 -- 172.21.15.17:0/2368741246 shutdown_connections 2024-03-12T17:18:55.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.836+0000 7fe394c00640 1 --2- 172.21.15.17:0/2368741246 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe37c06acf0 0x7fe37c06d1b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.836+0000 7fe394c00640 1 --2- 172.21.15.17:0/2368741246 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe398043d50 0x7fe3980441d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.836+0000 7fe394c00640 1 --2- 172.21.15.17:0/2368741246 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe3980e80b0 0x7fe3980e8530 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.836+0000 7fe394c00640 1 --2- 172.21.15.17:0/2368741246 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3840047c0 0x7fe3980dd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.836+0000 7fe394c00640 1 -- 172.21.15.17:0/2368741246 >> 172.21.15.17:0/2368741246 conn(0x7fe398054ed0 msgr2=0x7fe398005af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:55.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.836+0000 7fe394c00640 1 -- 172.21.15.17:0/2368741246 shutdown_connections 2024-03-12T17:18:55.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.836+0000 7fe394c00640 1 -- 172.21.15.17:0/2368741246 wait complete. 2024-03-12T17:18:55.856 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.0 2024-03-12T17:18:55.856 DEBUG:teuthology.parallel:result is None 2024-03-12T17:18:55.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.875+0000 7fa7cf400640 1 -- 172.21.15.17:0/3434184607 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fa7c81f37b0 con 0x7fa7c80b5b50 2024-03-12T17:18:55.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.875+0000 7fa7c4c00640 1 -- 172.21.15.17:0/3434184607 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa7c007a9b0 con 0x7fa7c80b5b50 2024-03-12T17:18:55.871 INFO:teuthology.orchestra.run.smithi017.stdout:55834574853 2024-03-12T17:18:55.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.878+0000 7fa7cf400640 1 -- 172.21.15.17:0/3434184607 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fa7a806ac00 msgr2=0x7fa7a806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.878+0000 7fa7cf400640 1 --2- 172.21.15.17:0/3434184607 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fa7a806ac00 0x7fa7a806d0c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa7c815d420 tx=0x7fa7b4009040 comp rx=0 tx=0).stop 2024-03-12T17:18:55.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.879+0000 7fa7cf400640 1 -- 172.21.15.17:0/3434184607 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7c80b5b50 msgr2=0x7fa7c815fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.879+0000 7fa7cf400640 1 --2- 172.21.15.17:0/3434184607 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7c80b5b50 0x7fa7c815fd60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0037040 tx=0x7fa7c0004a40 comp rx=0 tx=0).stop 2024-03-12T17:18:55.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.879+0000 7fa7cf400640 1 -- 172.21.15.17:0/3434184607 shutdown_connections 2024-03-12T17:18:55.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.879+0000 7fa7cf400640 1 --2- 172.21.15.17:0/3434184607 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fa7a806ac00 0x7fa7a806d0c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.879+0000 7fa7cf400640 1 --2- 172.21.15.17:0/3434184607 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa7c80d2fa0 0x7fa7c8158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.879+0000 7fa7cf400640 1 --2- 172.21.15.17:0/3434184607 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa7c80b5f70 0x7fa7c81f25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.879+0000 7fa7cf400640 1 --2- 172.21.15.17:0/3434184607 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa7c80b5b50 0x7fa7c815fd60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.879+0000 7fa7cf400640 1 -- 172.21.15.17:0/3434184607 >> 172.21.15.17:0/3434184607 conn(0x7fa7c8065df0 msgr2=0x7fa7c80b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:55.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.879+0000 7fa7cf400640 1 -- 172.21.15.17:0/3434184607 shutdown_connections 2024-03-12T17:18:55.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.879+0000 7fa7cf400640 1 -- 172.21.15.17:0/3434184607 wait complete. 2024-03-12T17:18:55.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.895+0000 7f2bc3200640 1 -- 172.21.15.17:0/3446924384 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2b980050c0 con 0x7f2bb40e6d10 2024-03-12T17:18:55.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.895+0000 7f2bafe00640 1 -- 172.21.15.17:0/3446924384 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2ba8015090 con 0x7f2bb40e6d10 2024-03-12T17:18:55.891 INFO:teuthology.orchestra.run.smithi017.stdout:55834574853 2024-03-12T17:18:55.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.896+0000 7f86db200640 1 -- 172.21.15.17:0/706789008 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f86d4066c00 con 0x7f86d40b5b50 2024-03-12T17:18:55.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.897+0000 7f86cbe00640 1 -- 172.21.15.17:0/706789008 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f86c4057c40 con 0x7f86d40b5b50 2024-03-12T17:18:55.892 INFO:teuthology.orchestra.run.smithi017.stdout:55834574853 2024-03-12T17:18:55.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.899+0000 7f2bc3200640 1 -- 172.21.15.17:0/3446924384 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f2b9c06ac50 msgr2=0x7f2b9c06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.899+0000 7f2bc3200640 1 --2- 172.21.15.17:0/3446924384 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f2b9c06ac50 0x7f2b9c06d110 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2bb40e48a0 tx=0x7f2bbc06d030 comp rx=0 tx=0).stop 2024-03-12T17:18:55.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.899+0000 7f2bc3200640 1 -- 172.21.15.17:0/3446924384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bb40e6d10 msgr2=0x7f2bb404eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.899+0000 7f2bc3200640 1 --2- 172.21.15.17:0/3446924384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bb40e6d10 0x7f2bb404eb70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2ba800b3f0 tx=0x7f2ba800b8b0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.899+0000 7f2bc3200640 1 -- 172.21.15.17:0/3446924384 shutdown_connections 2024-03-12T17:18:55.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.899+0000 7f2bc3200640 1 --2- 172.21.15.17:0/3446924384 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f2b9c06ac50 0x7f2b9c06d110 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.899+0000 7f2bc3200640 1 --2- 172.21.15.17:0/3446924384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2bb40e6d10 0x7f2bb404eb70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.899+0000 7f2bc3200640 1 --2- 172.21.15.17:0/3446924384 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2bb4059e00 0x7f2bb40d8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.899+0000 7f2bc3200640 1 --2- 172.21.15.17:0/3446924384 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2bb4000e20 0x7f2bb40d3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.899+0000 7f2bc3200640 1 -- 172.21.15.17:0/3446924384 >> 172.21.15.17:0/3446924384 conn(0x7f2bb405a7e0 msgr2=0x7f2bb403c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:55.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.899+0000 7f2bc3200640 1 -- 172.21.15.17:0/3446924384 shutdown_connections 2024-03-12T17:18:55.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.899+0000 7f2bc3200640 1 -- 172.21.15.17:0/3446924384 wait complete. 2024-03-12T17:18:55.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.901+0000 7f86db200640 1 -- 172.21.15.17:0/706789008 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f86b406ac00 msgr2=0x7f86b406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.901+0000 7f86db200640 1 --2- 172.21.15.17:0/706789008 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f86b406ac00 0x7f86b406d0c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f86d40663d0 tx=0x7f86c0009040 comp rx=0 tx=0).stop 2024-03-12T17:18:55.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.901+0000 7f86db200640 1 -- 172.21.15.17:0/706789008 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86d40b5b50 msgr2=0x7f86d4153f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.901+0000 7f86db200640 1 --2- 172.21.15.17:0/706789008 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86d40b5b50 0x7f86d4153f40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f86c400e870 tx=0x7f86c400ed30 comp rx=0 tx=0).stop 2024-03-12T17:18:55.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.901+0000 7f86db200640 1 -- 172.21.15.17:0/706789008 shutdown_connections 2024-03-12T17:18:55.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.901+0000 7f86db200640 1 --2- 172.21.15.17:0/706789008 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f86b406ac00 0x7f86b406d0c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.901+0000 7f86db200640 1 --2- 172.21.15.17:0/706789008 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86d40d2fa0 0x7f86d40ca2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.901+0000 7f86db200640 1 --2- 172.21.15.17:0/706789008 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f86d40b5f70 0x7f86d41f6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.901+0000 7f86db200640 1 --2- 172.21.15.17:0/706789008 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f86d40b5b50 0x7f86d4153f40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.901+0000 7f86db200640 1 -- 172.21.15.17:0/706789008 >> 172.21.15.17:0/706789008 conn(0x7f86d4065df0 msgr2=0x7f86d415c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:55.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.901+0000 7f86db200640 1 -- 172.21.15.17:0/706789008 shutdown_connections 2024-03-12T17:18:55.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.901+0000 7f86db200640 1 -- 172.21.15.17:0/706789008 wait complete. 2024-03-12T17:18:55.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.903+0000 7faf37200640 1 -- 172.21.15.17:0/1686943554 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7faf300056e0 con 0x7faf300dea10 2024-03-12T17:18:55.899 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2024-03-12T17:18:55.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.904+0000 7faf2e000640 1 -- 172.21.15.17:0/1686943554 <== mon.1 v2:172.21.15.94:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faf28079eb0 con 0x7faf300dea10 2024-03-12T17:18:55.900 INFO:teuthology.orchestra.run.smithi017.stdout:55834574853 2024-03-12T17:18:55.900 DEBUG:teuthology.parallel:result is None 2024-03-12T17:18:55.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.907+0000 7faf37200640 1 -- 172.21.15.17:0/1686943554 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faf1806acd0 msgr2=0x7faf1806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.907+0000 7faf37200640 1 --2- 172.21.15.17:0/1686943554 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faf1806acd0 0x7faf1806d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faf24005880 tx=0x7faf24009040 comp rx=0 tx=0).stop 2024-03-12T17:18:55.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.907+0000 7faf37200640 1 -- 172.21.15.17:0/1686943554 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf300dea10 msgr2=0x7faf30177b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.907+0000 7faf37200640 1 --2- 172.21.15.17:0/1686943554 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf300dea10 0x7faf30177b40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7faf28033000 tx=0x7faf280046c0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.907+0000 7faf37200640 1 -- 172.21.15.17:0/1686943554 shutdown_connections 2024-03-12T17:18:55.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.907+0000 7faf37200640 1 --2- 172.21.15.17:0/1686943554 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faf1806acd0 0x7faf1806d190 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7faf24005880 tx=0x7faf24009040 comp rx=0 tx=0).stop 2024-03-12T17:18:55.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.907+0000 7faf37200640 1 --2- 172.21.15.17:0/1686943554 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf300e2020 0x7faf30178080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.907+0000 7faf37200640 1 --2- 172.21.15.17:0/1686943554 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf300dea10 0x7faf30177b40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.907+0000 7faf37200640 1 --2- 172.21.15.17:0/1686943554 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf30008e40 0x7faf300e38f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.907+0000 7faf37200640 1 -- 172.21.15.17:0/1686943554 >> 172.21.15.17:0/1686943554 conn(0x7faf30055ba0 msgr2=0x7faf300e0680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:55.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.907+0000 7faf37200640 1 -- 172.21.15.17:0/1686943554 shutdown_connections 2024-03-12T17:18:55.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.907+0000 7faf37200640 1 -- 172.21.15.17:0/1686943554 wait complete. 2024-03-12T17:18:55.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.911+0000 7f236e000640 1 -- 172.21.15.17:0/638055520 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f23680b7f80 con 0x7f23680b5aa0 2024-03-12T17:18:55.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.912+0000 7f235f400640 1 -- 172.21.15.17:0/638055520 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2360042020 con 0x7f23680b5aa0 2024-03-12T17:18:55.907 INFO:teuthology.orchestra.run.smithi017.stdout:55834574852 2024-03-12T17:18:55.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.914+0000 7f236e000640 1 -- 172.21.15.17:0/638055520 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f234806ac00 msgr2=0x7f234806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.914+0000 7f236e000640 1 --2- 172.21.15.17:0/638055520 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f234806ac00 0x7f234806d0c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f23681f54c0 tx=0x7f2358007d30 comp rx=0 tx=0).stop 2024-03-12T17:18:55.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.914+0000 7f236e000640 1 -- 172.21.15.17:0/638055520 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23680b5aa0 msgr2=0x7f236815d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.914+0000 7f236e000640 1 --2- 172.21.15.17:0/638055520 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23680b5aa0 0x7f236815d220 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f2360036040 tx=0x7f2360004a40 comp rx=0 tx=0).stop 2024-03-12T17:18:55.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.915+0000 7f236e000640 1 -- 172.21.15.17:0/638055520 shutdown_connections 2024-03-12T17:18:55.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.915+0000 7f236e000640 1 --2- 172.21.15.17:0/638055520 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f234806ac00 0x7f234806d0c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.915+0000 7f236e000640 1 --2- 172.21.15.17:0/638055520 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f236815cbd0 0x7f23681f5560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.915+0000 7f236e000640 1 --2- 172.21.15.17:0/638055520 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23680cfa70 0x7f23680c80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.915+0000 7f236e000640 1 --2- 172.21.15.17:0/638055520 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23680b5aa0 0x7f236815d220 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.915+0000 7f236e000640 1 -- 172.21.15.17:0/638055520 >> 172.21.15.17:0/638055520 conn(0x7f2368065df0 msgr2=0x7f23680b3920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:55.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.915+0000 7f236e000640 1 -- 172.21.15.17:0/638055520 shutdown_connections 2024-03-12T17:18:55.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.915+0000 7f236e000640 1 -- 172.21.15.17:0/638055520 wait complete. 2024-03-12T17:18:55.920 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2024-03-12T17:18:55.921 DEBUG:teuthology.parallel:result is None 2024-03-12T17:18:55.921 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2024-03-12T17:18:55.921 DEBUG:teuthology.parallel:result is None 2024-03-12T17:18:55.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2024-03-12T17:18:55.923 DEBUG:teuthology.parallel:result is None 2024-03-12T17:18:55.928 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.6 2024-03-12T17:18:55.928 DEBUG:teuthology.parallel:result is None 2024-03-12T17:18:55.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.938+0000 7f05ecc00640 1 -- 172.21.15.17:0/907642082 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f05e80ad900 con 0x7f05e80b1780 2024-03-12T17:18:55.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.940+0000 7f05de000640 1 -- 172.21.15.17:0/907642082 <== mon.2 v2:172.21.15.94:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f05d8017090 con 0x7f05e80b1780 2024-03-12T17:18:55.935 INFO:teuthology.orchestra.run.smithi017.stdout:55834574853 2024-03-12T17:18:55.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.942+0000 7f05ecc00640 1 -- 172.21.15.17:0/907642082 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f05c806ac00 msgr2=0x7f05c806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.942+0000 7f05ecc00640 1 --2- 172.21.15.17:0/907642082 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f05c806ac00 0x7f05c806d0c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f05d4036000 tx=0x7f05d4030000 comp rx=0 tx=0).stop 2024-03-12T17:18:55.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.942+0000 7f05ecc00640 1 -- 172.21.15.17:0/907642082 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f05e80b1780 msgr2=0x7f05e81fa6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:55.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.942+0000 7f05ecc00640 1 --2- 172.21.15.17:0/907642082 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f05e80b1780 0x7f05e81fa6e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f05d800c4a0 tx=0x7f05d800c8a0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.942+0000 7f05ecc00640 1 -- 172.21.15.17:0/907642082 shutdown_connections 2024-03-12T17:18:55.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.942+0000 7f05ecc00640 1 --2- 172.21.15.17:0/907642082 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f05c806ac00 0x7f05c806d0c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.942+0000 7f05ecc00640 1 --2- 172.21.15.17:0/907642082 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f05e8162680 0x7f05e81f5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.942+0000 7f05ecc00640 1 --2- 172.21.15.17:0/907642082 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05e8161a80 0x7f05e80aa200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.942+0000 7f05ecc00640 1 --2- 172.21.15.17:0/907642082 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f05e80b1780 0x7f05e81fa6e0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:55.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.942+0000 7f05ecc00640 1 -- 172.21.15.17:0/907642082 >> 172.21.15.17:0/907642082 conn(0x7f05e8069ce0 msgr2=0x7f05e8160db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:55.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.942+0000 7f05ecc00640 1 -- 172.21.15.17:0/907642082 shutdown_connections 2024-03-12T17:18:55.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:55.942+0000 7f05ecc00640 1 -- 172.21.15.17:0/907642082 wait complete. 2024-03-12T17:18:55.953 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2024-03-12T17:18:55.954 DEBUG:teuthology.parallel:result is None 2024-03-12T17:18:55.954 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-12T17:18:55.954 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-12T17:18:56.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.209+0000 7ff3d1800640 1 Processor -- start 2024-03-12T17:18:56.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.210+0000 7ff3d1800640 1 -- start start 2024-03-12T17:18:56.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.211+0000 7ff3d1800640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff3cc0d2fa0 0x7ff3cc0d3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:56.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.211+0000 7ff3d1800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff3cc0b5b50 0x7ff3cc0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:56.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.211+0000 7ff3d1800640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3cc0d14e0 con 0x7ff3cc0cd840 2024-03-12T17:18:56.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.211+0000 7ff3d1800640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3cc0b59e0 con 0x7ff3cc0b5b50 2024-03-12T17:18:56.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.211+0000 7ff3d1800640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3cc0d38c0 con 0x7ff3cc0d2fa0 2024-03-12T17:18:56.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.211+0000 7ff3ca000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff3cc0b5b50 0x7ff3cc0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:56.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.212+0000 7ff3ca000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff3cc0b5b50 0x7ff3cc0b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38910/0 (socket says 172.21.15.17:38910) 2024-03-12T17:18:56.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.212+0000 7ff3ca000640 1 -- 172.21.15.17:0/3436960418 learned_addr learned my addr 172.21.15.17:0/3436960418 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:56.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.212+0000 7ff3caa00640 1 --2- 172.21.15.17:0/3436960418 >> v2:172.21.15.94:3300/0 conn(0x7ff3cc0d2fa0 0x7ff3cc0d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:56.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.212+0000 7ff3ca000640 1 -- 172.21.15.17:0/3436960418 >> v2:172.21.15.94:3300/0 conn(0x7ff3cc0d2fa0 msgr2=0x7ff3cc0d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:56.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.212+0000 7ff3ca000640 1 --2- 172.21.15.17:0/3436960418 >> v2:172.21.15.94:3300/0 conn(0x7ff3cc0d2fa0 0x7ff3cc0d3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:56.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.212+0000 7ff3ca000640 1 -- 172.21.15.17:0/3436960418 >> v1:172.21.15.17:6789/0 conn(0x7ff3cc0cd840 legacy=0x7ff3cc0d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:56.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.212+0000 7ff3c9600640 1 -- 172.21.15.17:0/3436960418 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2400330967 0 0) 0x7ff3cc0d14e0 con 0x7ff3cc0cd840 2024-03-12T17:18:56.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.212+0000 7ff3ca000640 1 -- 172.21.15.17:0/3436960418 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3cc0b85b0 con 0x7ff3cc0b5b50 2024-03-12T17:18:56.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.213+0000 7ff3ca000640 1 --2- 172.21.15.17:0/3436960418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3cc0b5b50 0x7ff3cc0b5f70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc0b4dc0 tx=0x7ff3b802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3b413b3f8258324 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:56.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.213+0000 7ff3c9600640 1 -- 172.21.15.17:0/3436960418 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b802cb20 con 0x7ff3cc0b5b50 2024-03-12T17:18:56.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.213+0000 7ff3c9600640 1 -- 172.21.15.17:0/3436960418 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3b802cc80 con 0x7ff3cc0b5b50 2024-03-12T17:18:56.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.213+0000 7ff3c9600640 1 -- 172.21.15.17:0/3436960418 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b80343f0 con 0x7ff3cc0b5b50 2024-03-12T17:18:56.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.214+0000 7ff3d1800640 1 -- 172.21.15.17:0/3436960418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3cc0b5b50 msgr2=0x7ff3cc0b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:56.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.214+0000 7ff3d1800640 1 --2- 172.21.15.17:0/3436960418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3cc0b5b50 0x7ff3cc0b5f70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc0b4dc0 tx=0x7ff3b802bf80 comp rx=0 tx=0).stop 2024-03-12T17:18:56.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.214+0000 7ff3d1800640 1 -- 172.21.15.17:0/3436960418 shutdown_connections 2024-03-12T17:18:56.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.214+0000 7ff3d1800640 1 --2- 172.21.15.17:0/3436960418 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3cc0b5b50 0x7ff3cc0b5f70 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:56.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.214+0000 7ff3d1800640 1 --2- 172.21.15.17:0/3436960418 >> v2:172.21.15.94:3300/0 conn(0x7ff3cc0d2fa0 0x7ff3cc0d3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:56.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.214+0000 7ff3d1800640 1 -- 172.21.15.17:0/3436960418 >> 172.21.15.17:0/3436960418 conn(0x7ff3cc065df0 msgr2=0x7ff3cc066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:56.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.214+0000 7ff3d1800640 1 -- 172.21.15.17:0/3436960418 shutdown_connections 2024-03-12T17:18:56.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.214+0000 7ff3d1800640 1 -- 172.21.15.17:0/3436960418 wait complete. 2024-03-12T17:18:56.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.216+0000 7ff3d1800640 1 Processor -- start 2024-03-12T17:18:56.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.216+0000 7ff3d1800640 1 -- start start 2024-03-12T17:18:56.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.217+0000 7ff3d1800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3cc0b5b50 0x7ff3cc0ca970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:56.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.217+0000 7ff3d1800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3cc0cd840 0x7ff3cc0caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:56.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.217+0000 7ff3d1800640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff3cc0d2fa0 0x7ff3cc1f2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:56.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.217+0000 7ff3d1800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc15b8c0 con 0x7ff3cc0b5b50 2024-03-12T17:18:56.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.217+0000 7ff3d1800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc0cb9b0 con 0x7ff3cc0cd840 2024-03-12T17:18:56.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.217+0000 7ff3d1800640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc0cb6d0 con 0x7ff3cc0d2fa0 2024-03-12T17:18:56.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.217+0000 7ff3caa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3cc0b5b50 0x7ff3cc0ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:56.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.217+0000 7ff3caa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3cc0b5b50 0x7ff3cc0ca970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38912/0 (socket says 172.21.15.17:38912) 2024-03-12T17:18:56.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.217+0000 7ff3caa00640 1 -- 172.21.15.17:0/1509267700 learned_addr learned my addr 172.21.15.17:0/1509267700 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:56.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.217+0000 7ff3caa00640 1 -- 172.21.15.17:0/1509267700 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff3cc0d2fa0 msgr2=0x7ff3cc1f2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:56.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.217+0000 7ff3caa00640 1 --2- 172.21.15.17:0/1509267700 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff3cc0d2fa0 0x7ff3cc1f2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:56.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.217+0000 7ff3caa00640 1 -- 172.21.15.17:0/1509267700 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3cc0cd840 msgr2=0x7ff3cc0caeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:56.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.217+0000 7ff3caa00640 1 --2- 172.21.15.17:0/1509267700 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3cc0cd840 0x7ff3cc0caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:56.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.217+0000 7ff3caa00640 1 -- 172.21.15.17:0/1509267700 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b8009b30 con 0x7ff3cc0b5b50 2024-03-12T17:18:56.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.218+0000 7ff3caa00640 1 --2- 172.21.15.17:0/1509267700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3cc0b5b50 0x7ff3cc0ca970 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc00e9b0 tx=0x7ff3bc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:56.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.218+0000 7ff3c2a00640 1 -- 172.21.15.17:0/1509267700 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc009670 con 0x7ff3cc0b5b50 2024-03-12T17:18:56.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.218+0000 7ff3c2a00640 1 -- 172.21.15.17:0/1509267700 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3bc00c9a0 con 0x7ff3cc0b5b50 2024-03-12T17:18:56.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.218+0000 7ff3c2a00640 1 -- 172.21.15.17:0/1509267700 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc00cd50 con 0x7ff3cc0b5b50 2024-03-12T17:18:56.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.218+0000 7ff3d1800640 1 -- 172.21.15.17:0/1509267700 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3cc1f3330 con 0x7ff3cc0b5b50 2024-03-12T17:18:56.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.218+0000 7ff3d1800640 1 -- 172.21.15.17:0/1509267700 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3cc1f38f0 con 0x7ff3cc0b5b50 2024-03-12T17:18:56.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.219+0000 7ff3d1800640 1 -- 172.21.15.17:0/1509267700 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3cc0736c0 con 0x7ff3cc0b5b50 2024-03-12T17:18:56.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.220+0000 7ff3c2a00640 1 -- 172.21.15.17:0/1509267700 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7ff3bc013470 con 0x7ff3cc0b5b50 2024-03-12T17:18:56.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.221+0000 7ff3c2a00640 1 --2- 172.21.15.17:0/1509267700 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ff3ac06ac00 0x7ff3ac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:56.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.221+0000 7ff3c2a00640 1 -- 172.21.15.17:0/1509267700 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff3bc0895c0 con 0x7ff3cc0b5b50 2024-03-12T17:18:56.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.221+0000 7ff3ca000640 1 --2- 172.21.15.17:0/1509267700 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ff3ac06ac00 0x7ff3ac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:56.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.222+0000 7ff3ca000640 1 --2- 172.21.15.17:0/1509267700 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ff3ac06ac00 0x7ff3ac06d0c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8035000 tx=0x7ff3b802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:56.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.225+0000 7ff3c2a00640 1 -- 172.21.15.17:0/1509267700 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7ff3bc054830 con 0x7ff3cc0b5b50 2024-03-12T17:18:56.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.415+0000 7ff3d1800640 1 -- 172.21.15.17:0/1509267700 --> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff3cc0d1a10 con 0x7ff3ac06ac00 2024-03-12T17:18:56.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.426+0000 7ff3c2a00640 1 -- 172.21.15.17:0/1509267700 <== mgr.4104 v2:172.21.15.17:6832/37052 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264315 (secure 0 0 0) 0x7ff3b802ca20 con 0x7ff3ac06ac00 2024-03-12T17:18:56.423 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:18:56.427 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-03-12T17:18:56.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.432+0000 7ff3d1800640 1 -- 172.21.15.17:0/1509267700 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ff3ac06ac00 msgr2=0x7ff3ac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:56.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.432+0000 7ff3d1800640 1 --2- 172.21.15.17:0/1509267700 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ff3ac06ac00 0x7ff3ac06d0c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8035000 tx=0x7ff3b802e000 comp rx=0 tx=0).stop 2024-03-12T17:18:56.428 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.432+0000 7ff3d1800640 1 -- 172.21.15.17:0/1509267700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3cc0b5b50 msgr2=0x7ff3cc0ca970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:56.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.432+0000 7ff3d1800640 1 --2- 172.21.15.17:0/1509267700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3cc0b5b50 0x7ff3cc0ca970 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc00e9b0 tx=0x7ff3bc00ee70 comp rx=0 tx=0).stop 2024-03-12T17:18:56.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.433+0000 7ff3d1800640 1 -- 172.21.15.17:0/1509267700 shutdown_connections 2024-03-12T17:18:56.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.433+0000 7ff3d1800640 1 --2- 172.21.15.17:0/1509267700 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ff3ac06ac00 0x7ff3ac06d0c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:56.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.433+0000 7ff3d1800640 1 --2- 172.21.15.17:0/1509267700 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff3cc0d2fa0 0x7ff3cc1f2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:56.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.433+0000 7ff3d1800640 1 --2- 172.21.15.17:0/1509267700 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff3cc0cd840 0x7ff3cc0caeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:56.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.433+0000 7ff3d1800640 1 --2- 172.21.15.17:0/1509267700 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff3cc0b5b50 0x7ff3cc0ca970 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:56.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.433+0000 7ff3d1800640 1 -- 172.21.15.17:0/1509267700 >> 172.21.15.17:0/1509267700 conn(0x7ff3cc065df0 msgr2=0x7ff3cc15c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:56.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.433+0000 7ff3d1800640 1 -- 172.21.15.17:0/1509267700 shutdown_connections 2024-03-12T17:18:56.429 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.433+0000 7ff3d1800640 1 -- 172.21.15.17:0/1509267700 wait complete. 2024-03-12T17:18:56.444 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-03-12T17:18:55.478802+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252284,"kb_used_data":2920,"kb_used_omap":13,"kb_used_meta":248818,"kb_avail":754722436,"statfs":{"total":773094113280,"available":772835774464,"internally_reserved":0,"allocated":2990080,"data_stored":1790012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":254789720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":59,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.629890"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858955+0000","last_change":"2024-03-12T17:18:45.899195+0000","last_active":"2024-03-12T17:18:46.858955+0000","last_peered":"2024-03-12T17:18:46.858955+0000","last_clean":"2024-03-12T17:18:46.858955+0000","last_became_active":"2024-03-12T17:18:45.898885+0000","last_became_peered":"2024-03-12T17:18:45.898885+0000","last_unstale":"2024-03-12T17:18:46.858955+0000","last_undegraded":"2024-03-12T17:18:46.858955+0000","last_fullsized":"2024-03-12T17:18:46.858955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:36:07.517436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944636+0000","last_change":"2024-03-12T17:18:45.863461+0000","last_active":"2024-03-12T17:18:46.944636+0000","last_peered":"2024-03-12T17:18:46.944636+0000","last_clean":"2024-03-12T17:18:46.944636+0000","last_became_active":"2024-03-12T17:18:45.861872+0000","last_became_peered":"2024-03-12T17:18:45.861872+0000","last_unstale":"2024-03-12T17:18:46.944636+0000","last_undegraded":"2024-03-12T17:18:46.944636+0000","last_fullsized":"2024-03-12T17:18:46.944636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:17:33.168888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947273+0000","last_change":"2024-03-12T17:18:45.862114+0000","last_active":"2024-03-12T17:18:46.947273+0000","last_peered":"2024-03-12T17:18:46.947273+0000","last_clean":"2024-03-12T17:18:46.947273+0000","last_became_active":"2024-03-12T17:18:45.861875+0000","last_became_peered":"2024-03-12T17:18:45.861875+0000","last_unstale":"2024-03-12T17:18:46.947273+0000","last_undegraded":"2024-03-12T17:18:46.947273+0000","last_fullsized":"2024-03-12T17:18:46.947273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:56:38.943678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858269+0000","last_change":"2024-03-12T17:18:45.878850+0000","last_active":"2024-03-12T17:18:46.858269+0000","last_peered":"2024-03-12T17:18:46.858269+0000","last_clean":"2024-03-12T17:18:46.858269+0000","last_became_active":"2024-03-12T17:18:45.878507+0000","last_became_peered":"2024-03-12T17:18:45.878507+0000","last_unstale":"2024-03-12T17:18:46.858269+0000","last_undegraded":"2024-03-12T17:18:46.858269+0000","last_fullsized":"2024-03-12T17:18:46.858269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:05:09.374271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857739+0000","last_change":"2024-03-12T17:18:45.894717+0000","last_active":"2024-03-12T17:18:46.857739+0000","last_peered":"2024-03-12T17:18:46.857739+0000","last_clean":"2024-03-12T17:18:46.857739+0000","last_became_active":"2024-03-12T17:18:45.894426+0000","last_became_peered":"2024-03-12T17:18:45.894426+0000","last_unstale":"2024-03-12T17:18:46.857739+0000","last_undegraded":"2024-03-12T17:18:46.857739+0000","last_fullsized":"2024-03-12T17:18:46.857739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:09:10.961008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857512+0000","last_change":"2024-03-12T17:18:45.870293+0000","last_active":"2024-03-12T17:18:46.857512+0000","last_peered":"2024-03-12T17:18:46.857512+0000","last_clean":"2024-03-12T17:18:46.857512+0000","last_became_active":"2024-03-12T17:18:45.869629+0000","last_became_peered":"2024-03-12T17:18:45.869629+0000","last_unstale":"2024-03-12T17:18:46.857512+0000","last_undegraded":"2024-03-12T17:18:46.857512+0000","last_fullsized":"2024-03-12T17:18:46.857512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:24:13.883507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857215+0000","last_change":"2024-03-12T17:18:45.894712+0000","last_active":"2024-03-12T17:18:46.857215+0000","last_peered":"2024-03-12T17:18:46.857215+0000","last_clean":"2024-03-12T17:18:46.857215+0000","last_became_active":"2024-03-12T17:18:45.894385+0000","last_became_peered":"2024-03-12T17:18:45.894385+0000","last_unstale":"2024-03-12T17:18:46.857215+0000","last_undegraded":"2024-03-12T17:18:46.857215+0000","last_fullsized":"2024-03-12T17:18:46.857215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:21:11.051648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.946712+0000","last_change":"2024-03-12T17:18:45.878221+0000","last_active":"2024-03-12T17:18:46.946712+0000","last_peered":"2024-03-12T17:18:46.946712+0000","last_clean":"2024-03-12T17:18:46.946712+0000","last_became_active":"2024-03-12T17:18:45.877953+0000","last_became_peered":"2024-03-12T17:18:45.877953+0000","last_unstale":"2024-03-12T17:18:46.946712+0000","last_undegraded":"2024-03-12T17:18:46.946712+0000","last_fullsized":"2024-03-12T17:18:46.946712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:45:08.333283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.859164+0000","last_change":"2024-03-12T17:18:45.900699+0000","last_active":"2024-03-12T17:18:46.859164+0000","last_peered":"2024-03-12T17:18:46.859164+0000","last_clean":"2024-03-12T17:18:46.859164+0000","last_became_active":"2024-03-12T17:18:45.900360+0000","last_became_peered":"2024-03-12T17:18:45.900360+0000","last_unstale":"2024-03-12T17:18:46.859164+0000","last_undegraded":"2024-03-12T17:18:46.859164+0000","last_fullsized":"2024-03-12T17:18:46.859164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:03:15.594609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.945139+0000","last_change":"2024-03-12T17:18:45.888417+0000","last_active":"2024-03-12T17:18:46.945139+0000","last_peered":"2024-03-12T17:18:46.945139+0000","last_clean":"2024-03-12T17:18:46.945139+0000","last_became_active":"2024-03-12T17:18:45.888207+0000","last_became_peered":"2024-03-12T17:18:45.888207+0000","last_unstale":"2024-03-12T17:18:46.945139+0000","last_undegraded":"2024-03-12T17:18:46.945139+0000","last_fullsized":"2024-03-12T17:18:46.945139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:42:22.352573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944829+0000","last_change":"2024-03-12T17:18:45.887868+0000","last_active":"2024-03-12T17:18:46.944829+0000","last_peered":"2024-03-12T17:18:46.944829+0000","last_clean":"2024-03-12T17:18:46.944829+0000","last_became_active":"2024-03-12T17:18:45.887591+0000","last_became_peered":"2024-03-12T17:18:45.887591+0000","last_unstale":"2024-03-12T17:18:46.944829+0000","last_undegraded":"2024-03-12T17:18:46.944829+0000","last_fullsized":"2024-03-12T17:18:46.944829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:54:36.712407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.946540+0000","last_change":"2024-03-12T17:18:45.891669+0000","last_active":"2024-03-12T17:18:46.946540+0000","last_peered":"2024-03-12T17:18:46.946540+0000","last_clean":"2024-03-12T17:18:46.946540+0000","last_became_active":"2024-03-12T17:18:45.891084+0000","last_became_peered":"2024-03-12T17:18:45.891084+0000","last_unstale":"2024-03-12T17:18:46.946540+0000","last_undegraded":"2024-03-12T17:18:46.946540+0000","last_fullsized":"2024-03-12T17:18:46.946540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:35:29.274137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947674+0000","last_change":"2024-03-12T17:18:45.885085+0000","last_active":"2024-03-12T17:18:46.947674+0000","last_peered":"2024-03-12T17:18:46.947674+0000","last_clean":"2024-03-12T17:18:46.947674+0000","last_became_active":"2024-03-12T17:18:45.884827+0000","last_became_peered":"2024-03-12T17:18:45.884827+0000","last_unstale":"2024-03-12T17:18:46.947674+0000","last_undegraded":"2024-03-12T17:18:46.947674+0000","last_fullsized":"2024-03-12T17:18:46.947674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:42:22.754824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.948191+0000","last_change":"2024-03-12T17:18:45.863039+0000","last_active":"2024-03-12T17:18:46.948191+0000","last_peered":"2024-03-12T17:18:46.948191+0000","last_clean":"2024-03-12T17:18:46.948191+0000","last_became_active":"2024-03-12T17:18:45.862844+0000","last_became_peered":"2024-03-12T17:18:45.862844+0000","last_unstale":"2024-03-12T17:18:46.948191+0000","last_undegraded":"2024-03-12T17:18:46.948191+0000","last_fullsized":"2024-03-12T17:18:46.948191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:23:06.063091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944953+0000","last_change":"2024-03-12T17:18:45.885881+0000","last_active":"2024-03-12T17:18:46.944953+0000","last_peered":"2024-03-12T17:18:46.944953+0000","last_clean":"2024-03-12T17:18:46.944953+0000","last_became_active":"2024-03-12T17:18:45.885609+0000","last_became_peered":"2024-03-12T17:18:45.885609+0000","last_unstale":"2024-03-12T17:18:46.944953+0000","last_undegraded":"2024-03-12T17:18:46.944953+0000","last_fullsized":"2024-03-12T17:18:46.944953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:45:08.333283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857415+0000","last_change":"2024-03-12T17:18:45.871970+0000","last_active":"2024-03-12T17:18:46.857415+0000","last_peered":"2024-03-12T17:18:46.857415+0000","last_clean":"2024-03-12T17:18:46.857415+0000","last_became_active":"2024-03-12T17:18:45.868988+0000","last_became_peered":"2024-03-12T17:18:45.868988+0000","last_unstale":"2024-03-12T17:18:46.857415+0000","last_undegraded":"2024-03-12T17:18:46.857415+0000","last_fullsized":"2024-03-12T17:18:46.857415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:10:29.099400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.859788+0000","last_change":"2024-03-12T17:18:45.899893+0000","last_active":"2024-03-12T17:18:46.859788+0000","last_peered":"2024-03-12T17:18:46.859788+0000","last_clean":"2024-03-12T17:18:46.859788+0000","last_became_active":"2024-03-12T17:18:45.899578+0000","last_became_peered":"2024-03-12T17:18:45.899578+0000","last_unstale":"2024-03-12T17:18:46.859788+0000","last_undegraded":"2024-03-12T17:18:46.859788+0000","last_fullsized":"2024-03-12T17:18:46.859788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:36:07.517436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.854019+0000","last_change":"2024-03-12T17:18:45.890825+0000","last_active":"2024-03-12T17:18:46.854019+0000","last_peered":"2024-03-12T17:18:46.854019+0000","last_clean":"2024-03-12T17:18:46.854019+0000","last_became_active":"2024-03-12T17:18:45.890508+0000","last_became_peered":"2024-03-12T17:18:45.890508+0000","last_unstale":"2024-03-12T17:18:46.854019+0000","last_undegraded":"2024-03-12T17:18:46.854019+0000","last_fullsized":"2024-03-12T17:18:46.854019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:54:36.712407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858619+0000","last_change":"2024-03-12T17:18:45.896948+0000","last_active":"2024-03-12T17:18:46.858619+0000","last_peered":"2024-03-12T17:18:46.858619+0000","last_clean":"2024-03-12T17:18:46.858619+0000","last_became_active":"2024-03-12T17:18:45.896617+0000","last_became_peered":"2024-03-12T17:18:45.896617+0000","last_unstale":"2024-03-12T17:18:46.858619+0000","last_undegraded":"2024-03-12T17:18:46.858619+0000","last_fullsized":"2024-03-12T17:18:46.858619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:34:35.638243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944492+0000","last_change":"2024-03-12T17:18:45.892628+0000","last_active":"2024-03-12T17:18:46.944492+0000","last_peered":"2024-03-12T17:18:46.944492+0000","last_clean":"2024-03-12T17:18:46.944492+0000","last_became_active":"2024-03-12T17:18:45.892322+0000","last_became_peered":"2024-03-12T17:18:45.892322+0000","last_unstale":"2024-03-12T17:18:46.944492+0000","last_undegraded":"2024-03-12T17:18:46.944492+0000","last_fullsized":"2024-03-12T17:18:46.944492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:48:29.172720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.946982+0000","last_change":"2024-03-12T17:18:45.891015+0000","last_active":"2024-03-12T17:18:46.946982+0000","last_peered":"2024-03-12T17:18:46.946982+0000","last_clean":"2024-03-12T17:18:46.946982+0000","last_became_active":"2024-03-12T17:18:45.890711+0000","last_became_peered":"2024-03-12T17:18:45.890711+0000","last_unstale":"2024-03-12T17:18:46.946982+0000","last_undegraded":"2024-03-12T17:18:46.946982+0000","last_fullsized":"2024-03-12T17:18:46.946982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:45:08.333283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857744+0000","last_change":"2024-03-12T17:18:45.893500+0000","last_active":"2024-03-12T17:18:46.857744+0000","last_peered":"2024-03-12T17:18:46.857744+0000","last_clean":"2024-03-12T17:18:46.857744+0000","last_became_active":"2024-03-12T17:18:45.893188+0000","last_became_peered":"2024-03-12T17:18:45.893188+0000","last_unstale":"2024-03-12T17:18:46.857744+0000","last_undegraded":"2024-03-12T17:18:46.857744+0000","last_fullsized":"2024-03-12T17:18:46.857744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:34:35.638243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947702+0000","last_change":"2024-03-12T17:18:45.890189+0000","last_active":"2024-03-12T17:18:46.947702+0000","last_peered":"2024-03-12T17:18:46.947702+0000","last_clean":"2024-03-12T17:18:46.947702+0000","last_became_active":"2024-03-12T17:18:45.889243+0000","last_became_peered":"2024-03-12T17:18:45.889243+0000","last_unstale":"2024-03-12T17:18:46.947702+0000","last_undegraded":"2024-03-12T17:18:46.947702+0000","last_fullsized":"2024-03-12T17:18:46.947702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:23:06.063091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.856808+0000","last_change":"2024-03-12T17:18:45.879908+0000","last_active":"2024-03-12T17:18:46.856808+0000","last_peered":"2024-03-12T17:18:46.856808+0000","last_clean":"2024-03-12T17:18:46.856808+0000","last_became_active":"2024-03-12T17:18:45.879061+0000","last_became_peered":"2024-03-12T17:18:45.879061+0000","last_unstale":"2024-03-12T17:18:46.856808+0000","last_undegraded":"2024-03-12T17:18:46.856808+0000","last_fullsized":"2024-03-12T17:18:46.856808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:21:11.051648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947866+0000","last_change":"2024-03-12T17:18:45.876848+0000","last_active":"2024-03-12T17:18:46.947866+0000","last_peered":"2024-03-12T17:18:46.947866+0000","last_clean":"2024-03-12T17:18:46.947866+0000","last_became_active":"2024-03-12T17:18:45.876658+0000","last_became_peered":"2024-03-12T17:18:45.876658+0000","last_unstale":"2024-03-12T17:18:46.947866+0000","last_undegraded":"2024-03-12T17:18:46.947866+0000","last_fullsized":"2024-03-12T17:18:46.947866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:15:10.118237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.945388+0000","last_change":"2024-03-12T17:18:45.897934+0000","last_active":"2024-03-12T17:18:46.945388+0000","last_peered":"2024-03-12T17:18:46.945388+0000","last_clean":"2024-03-12T17:18:46.945388+0000","last_became_active":"2024-03-12T17:18:45.897632+0000","last_became_peered":"2024-03-12T17:18:45.897632+0000","last_unstale":"2024-03-12T17:18:46.945388+0000","last_undegraded":"2024-03-12T17:18:46.945388+0000","last_fullsized":"2024-03-12T17:18:46.945388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:23:06.063091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.945707+0000","last_change":"2024-03-12T17:18:45.882068+0000","last_active":"2024-03-12T17:18:46.945707+0000","last_peered":"2024-03-12T17:18:46.945707+0000","last_clean":"2024-03-12T17:18:46.945707+0000","last_became_active":"2024-03-12T17:18:45.881609+0000","last_became_peered":"2024-03-12T17:18:45.881609+0000","last_unstale":"2024-03-12T17:18:46.945707+0000","last_undegraded":"2024-03-12T17:18:46.945707+0000","last_fullsized":"2024-03-12T17:18:46.945707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:42:22.754824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947829+0000","last_change":"2024-03-12T17:18:45.875604+0000","last_active":"2024-03-12T17:18:46.947829+0000","last_peered":"2024-03-12T17:18:46.947829+0000","last_clean":"2024-03-12T17:18:46.947829+0000","last_became_active":"2024-03-12T17:18:45.875300+0000","last_became_peered":"2024-03-12T17:18:45.875300+0000","last_unstale":"2024-03-12T17:18:46.947829+0000","last_undegraded":"2024-03-12T17:18:46.947829+0000","last_fullsized":"2024-03-12T17:18:46.947829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:24:13.883507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947088+0000","last_change":"2024-03-12T17:18:45.879642+0000","last_active":"2024-03-12T17:18:46.947088+0000","last_peered":"2024-03-12T17:18:46.947088+0000","last_clean":"2024-03-12T17:18:46.947088+0000","last_became_active":"2024-03-12T17:18:45.879390+0000","last_became_peered":"2024-03-12T17:18:45.879390+0000","last_unstale":"2024-03-12T17:18:46.947088+0000","last_undegraded":"2024-03-12T17:18:46.947088+0000","last_fullsized":"2024-03-12T17:18:46.947088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:25:10.176932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857915+0000","last_change":"2024-03-12T17:18:45.878596+0000","last_active":"2024-03-12T17:18:46.857915+0000","last_peered":"2024-03-12T17:18:46.857915+0000","last_clean":"2024-03-12T17:18:46.857915+0000","last_became_active":"2024-03-12T17:18:45.878223+0000","last_became_peered":"2024-03-12T17:18:45.878223+0000","last_unstale":"2024-03-12T17:18:46.857915+0000","last_undegraded":"2024-03-12T17:18:46.857915+0000","last_fullsized":"2024-03-12T17:18:46.857915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:42:22.754824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.853503+0000","last_change":"2024-03-12T17:18:45.869021+0000","last_active":"2024-03-12T17:18:46.853503+0000","last_peered":"2024-03-12T17:18:46.853503+0000","last_clean":"2024-03-12T17:18:46.853503+0000","last_became_active":"2024-03-12T17:18:45.868790+0000","last_became_peered":"2024-03-12T17:18:45.868790+0000","last_unstale":"2024-03-12T17:18:46.853503+0000","last_undegraded":"2024-03-12T17:18:46.853503+0000","last_fullsized":"2024-03-12T17:18:46.853503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:20:31.313923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944482+0000","last_change":"2024-03-12T17:18:45.886248+0000","last_active":"2024-03-12T17:18:46.944482+0000","last_peered":"2024-03-12T17:18:46.944482+0000","last_clean":"2024-03-12T17:18:46.944482+0000","last_became_active":"2024-03-12T17:18:45.885636+0000","last_became_peered":"2024-03-12T17:18:45.885636+0000","last_unstale":"2024-03-12T17:18:46.944482+0000","last_undegraded":"2024-03-12T17:18:46.944482+0000","last_fullsized":"2024-03-12T17:18:46.944482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:10:25.044042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.945966+0000","last_change":"2024-03-12T17:18:45.878245+0000","last_active":"2024-03-12T17:18:46.945966+0000","last_peered":"2024-03-12T17:18:46.945966+0000","last_clean":"2024-03-12T17:18:46.945966+0000","last_became_active":"2024-03-12T17:18:45.874458+0000","last_became_peered":"2024-03-12T17:18:45.874458+0000","last_unstale":"2024-03-12T17:18:46.945966+0000","last_undegraded":"2024-03-12T17:18:46.945966+0000","last_fullsized":"2024-03-12T17:18:46.945966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:32:01.111631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947680+0000","last_change":"2024-03-12T17:18:45.375951+0000","last_active":"2024-03-12T17:18:46.947680+0000","last_peered":"2024-03-12T17:18:46.947680+0000","last_clean":"2024-03-12T17:18:46.947680+0000","last_became_active":"2024-03-12T17:18:45.375616+0000","last_became_peered":"2024-03-12T17:18:45.375616+0000","last_unstale":"2024-03-12T17:18:46.947680+0000","last_undegraded":"2024-03-12T17:18:46.947680+0000","last_fullsized":"2024-03-12T17:18:46.947680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:07:53.768009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947190+0000","last_change":"2024-03-12T17:18:45.883654+0000","last_active":"2024-03-12T17:18:46.947190+0000","last_peered":"2024-03-12T17:18:46.947190+0000","last_clean":"2024-03-12T17:18:46.947190+0000","last_became_active":"2024-03-12T17:18:45.883247+0000","last_became_peered":"2024-03-12T17:18:45.883247+0000","last_unstale":"2024-03-12T17:18:46.947190+0000","last_undegraded":"2024-03-12T17:18:46.947190+0000","last_fullsized":"2024-03-12T17:18:46.947190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:24:13.883507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944269+0000","last_change":"2024-03-12T17:18:45.377143+0000","last_active":"2024-03-12T17:18:46.944269+0000","last_peered":"2024-03-12T17:18:46.944269+0000","last_clean":"2024-03-12T17:18:46.944269+0000","last_became_active":"2024-03-12T17:18:45.376587+0000","last_became_peered":"2024-03-12T17:18:45.376587+0000","last_unstale":"2024-03-12T17:18:46.944269+0000","last_undegraded":"2024-03-12T17:18:46.944269+0000","last_fullsized":"2024-03-12T17:18:46.944269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:12:48.811874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947685+0000","last_change":"2024-03-12T17:18:45.368141+0000","last_active":"2024-03-12T17:18:46.947685+0000","last_peered":"2024-03-12T17:18:46.947685+0000","last_clean":"2024-03-12T17:18:46.947685+0000","last_became_active":"2024-03-12T17:18:45.367922+0000","last_became_peered":"2024-03-12T17:18:45.367922+0000","last_unstale":"2024-03-12T17:18:46.947685+0000","last_undegraded":"2024-03-12T17:18:46.947685+0000","last_fullsized":"2024-03-12T17:18:46.947685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:23:50.392288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.946810+0000","last_change":"2024-03-12T17:18:45.864983+0000","last_active":"2024-03-12T17:18:46.946810+0000","last_peered":"2024-03-12T17:18:46.946810+0000","last_clean":"2024-03-12T17:18:46.946810+0000","last_became_active":"2024-03-12T17:18:45.864648+0000","last_became_peered":"2024-03-12T17:18:45.864648+0000","last_unstale":"2024-03-12T17:18:46.946810+0000","last_undegraded":"2024-03-12T17:18:46.946810+0000","last_fullsized":"2024-03-12T17:18:46.946810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:25:10.176932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857020+0000","last_change":"2024-03-12T17:18:45.365029+0000","last_active":"2024-03-12T17:18:46.857020+0000","last_peered":"2024-03-12T17:18:46.857020+0000","last_clean":"2024-03-12T17:18:46.857020+0000","last_became_active":"2024-03-12T17:18:45.364621+0000","last_became_peered":"2024-03-12T17:18:45.364621+0000","last_unstale":"2024-03-12T17:18:46.857020+0000","last_undegraded":"2024-03-12T17:18:46.857020+0000","last_fullsized":"2024-03-12T17:18:46.857020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:01:22.087219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944672+0000","last_change":"2024-03-12T17:18:45.879492+0000","last_active":"2024-03-12T17:18:46.944672+0000","last_peered":"2024-03-12T17:18:46.944672+0000","last_clean":"2024-03-12T17:18:46.944672+0000","last_became_active":"2024-03-12T17:18:45.879232+0000","last_became_peered":"2024-03-12T17:18:45.879232+0000","last_unstale":"2024-03-12T17:18:46.944672+0000","last_undegraded":"2024-03-12T17:18:46.944672+0000","last_fullsized":"2024-03-12T17:18:46.944672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:10:29.099400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.945211+0000","last_change":"2024-03-12T17:18:45.382641+0000","last_active":"2024-03-12T17:18:46.945211+0000","last_peered":"2024-03-12T17:18:46.945211+0000","last_clean":"2024-03-12T17:18:46.945211+0000","last_became_active":"2024-03-12T17:18:45.381871+0000","last_became_peered":"2024-03-12T17:18:45.381871+0000","last_unstale":"2024-03-12T17:18:46.945211+0000","last_undegraded":"2024-03-12T17:18:46.945211+0000","last_fullsized":"2024-03-12T17:18:46.945211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:07:53.768009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.859233+0000","last_change":"2024-03-12T17:18:45.893641+0000","last_active":"2024-03-12T17:18:46.859233+0000","last_peered":"2024-03-12T17:18:46.859233+0000","last_clean":"2024-03-12T17:18:46.859233+0000","last_became_active":"2024-03-12T17:18:45.893285+0000","last_became_peered":"2024-03-12T17:18:45.893285+0000","last_unstale":"2024-03-12T17:18:46.859233+0000","last_undegraded":"2024-03-12T17:18:46.859233+0000","last_fullsized":"2024-03-12T17:18:46.859233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:15:10.118237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.859238+0000","last_change":"2024-03-12T17:18:45.376164+0000","last_active":"2024-03-12T17:18:46.859238+0000","last_peered":"2024-03-12T17:18:46.859238+0000","last_clean":"2024-03-12T17:18:46.859238+0000","last_became_active":"2024-03-12T17:18:45.374280+0000","last_became_peered":"2024-03-12T17:18:45.374280+0000","last_unstale":"2024-03-12T17:18:46.859238+0000","last_undegraded":"2024-03-12T17:18:46.859238+0000","last_fullsized":"2024-03-12T17:18:46.859238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:23:50.392288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.949144+0000","last_change":"2024-03-12T17:18:45.878892+0000","last_active":"2024-03-12T17:18:46.949144+0000","last_peered":"2024-03-12T17:18:46.949144+0000","last_clean":"2024-03-12T17:18:46.949144+0000","last_became_active":"2024-03-12T17:18:45.878651+0000","last_became_peered":"2024-03-12T17:18:45.878651+0000","last_unstale":"2024-03-12T17:18:46.949144+0000","last_undegraded":"2024-03-12T17:18:46.949144+0000","last_fullsized":"2024-03-12T17:18:46.949144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:10:25.044042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.945945+0000","last_change":"2024-03-12T17:18:45.382325+0000","last_active":"2024-03-12T17:18:46.945945+0000","last_peered":"2024-03-12T17:18:46.945945+0000","last_clean":"2024-03-12T17:18:46.945945+0000","last_became_active":"2024-03-12T17:18:45.382056+0000","last_became_peered":"2024-03-12T17:18:45.382056+0000","last_unstale":"2024-03-12T17:18:46.945945+0000","last_undegraded":"2024-03-12T17:18:46.945945+0000","last_fullsized":"2024-03-12T17:18:46.945945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:35:28.129493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.946639+0000","last_change":"2024-03-12T17:18:45.895888+0000","last_active":"2024-03-12T17:18:46.946639+0000","last_peered":"2024-03-12T17:18:46.946639+0000","last_clean":"2024-03-12T17:18:46.946639+0000","last_became_active":"2024-03-12T17:18:45.895314+0000","last_became_peered":"2024-03-12T17:18:45.895314+0000","last_unstale":"2024-03-12T17:18:46.946639+0000","last_undegraded":"2024-03-12T17:18:46.946639+0000","last_fullsized":"2024-03-12T17:18:46.946639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:28:48.535350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944549+0000","last_change":"2024-03-12T17:18:45.381040+0000","last_active":"2024-03-12T17:18:46.944549+0000","last_peered":"2024-03-12T17:18:46.944549+0000","last_clean":"2024-03-12T17:18:46.944549+0000","last_became_active":"2024-03-12T17:18:45.380400+0000","last_became_peered":"2024-03-12T17:18:45.380400+0000","last_unstale":"2024-03-12T17:18:46.944549+0000","last_undegraded":"2024-03-12T17:18:46.944549+0000","last_fullsized":"2024-03-12T17:18:46.944549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:48:10.442245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857838+0000","last_change":"2024-03-12T17:18:45.896661+0000","last_active":"2024-03-12T17:18:46.857838+0000","last_peered":"2024-03-12T17:18:46.857838+0000","last_clean":"2024-03-12T17:18:46.857838+0000","last_became_active":"2024-03-12T17:18:45.896381+0000","last_became_peered":"2024-03-12T17:18:45.896381+0000","last_unstale":"2024-03-12T17:18:46.857838+0000","last_undegraded":"2024-03-12T17:18:46.857838+0000","last_fullsized":"2024-03-12T17:18:46.857838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:17:13.547169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947292+0000","last_change":"2024-03-12T17:18:45.365459+0000","last_active":"2024-03-12T17:18:46.947292+0000","last_peered":"2024-03-12T17:18:46.947292+0000","last_clean":"2024-03-12T17:18:46.947292+0000","last_became_active":"2024-03-12T17:18:45.365123+0000","last_became_peered":"2024-03-12T17:18:45.365123+0000","last_unstale":"2024-03-12T17:18:46.947292+0000","last_undegraded":"2024-03-12T17:18:46.947292+0000","last_fullsized":"2024-03-12T17:18:46.947292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:12:45.021044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.948430+0000","last_change":"2024-03-12T17:18:45.888078+0000","last_active":"2024-03-12T17:18:46.948430+0000","last_peered":"2024-03-12T17:18:46.948430+0000","last_clean":"2024-03-12T17:18:46.948430+0000","last_became_active":"2024-03-12T17:18:45.887793+0000","last_became_peered":"2024-03-12T17:18:45.887793+0000","last_unstale":"2024-03-12T17:18:46.948430+0000","last_undegraded":"2024-03-12T17:18:46.948430+0000","last_fullsized":"2024-03-12T17:18:46.948430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:17:33.168888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858044+0000","last_change":"2024-03-12T17:18:45.378988+0000","last_active":"2024-03-12T17:18:46.858044+0000","last_peered":"2024-03-12T17:18:46.858044+0000","last_clean":"2024-03-12T17:18:46.858044+0000","last_became_active":"2024-03-12T17:18:45.378697+0000","last_became_peered":"2024-03-12T17:18:45.378697+0000","last_unstale":"2024-03-12T17:18:46.858044+0000","last_undegraded":"2024-03-12T17:18:46.858044+0000","last_fullsized":"2024-03-12T17:18:46.858044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:07:53.768009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857986+0000","last_change":"2024-03-12T17:18:45.899356+0000","last_active":"2024-03-12T17:18:46.857986+0000","last_peered":"2024-03-12T17:18:46.857986+0000","last_clean":"2024-03-12T17:18:46.857986+0000","last_became_active":"2024-03-12T17:18:45.899010+0000","last_became_peered":"2024-03-12T17:18:45.899010+0000","last_unstale":"2024-03-12T17:18:46.857986+0000","last_undegraded":"2024-03-12T17:18:46.857986+0000","last_fullsized":"2024-03-12T17:18:46.857986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:05:09.374271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944237+0000","last_change":"2024-03-12T17:18:45.376515+0000","last_active":"2024-03-12T17:18:46.944237+0000","last_peered":"2024-03-12T17:18:46.944237+0000","last_clean":"2024-03-12T17:18:46.944237+0000","last_became_active":"2024-03-12T17:18:45.376229+0000","last_became_peered":"2024-03-12T17:18:45.376229+0000","last_unstale":"2024-03-12T17:18:46.944237+0000","last_undegraded":"2024-03-12T17:18:46.944237+0000","last_fullsized":"2024-03-12T17:18:46.944237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:33:40.644061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944239+0000","last_change":"2024-03-12T17:18:45.885557+0000","last_active":"2024-03-12T17:18:46.944239+0000","last_peered":"2024-03-12T17:18:46.944239+0000","last_clean":"2024-03-12T17:18:46.944239+0000","last_became_active":"2024-03-12T17:18:45.885214+0000","last_became_peered":"2024-03-12T17:18:45.885214+0000","last_unstale":"2024-03-12T17:18:46.944239+0000","last_undegraded":"2024-03-12T17:18:46.944239+0000","last_fullsized":"2024-03-12T17:18:46.944239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:56:38.943678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.853537+0000","last_change":"2024-03-12T17:18:45.368912+0000","last_active":"2024-03-12T17:18:46.853537+0000","last_peered":"2024-03-12T17:18:46.853537+0000","last_clean":"2024-03-12T17:18:46.853537+0000","last_became_active":"2024-03-12T17:18:45.368576+0000","last_became_peered":"2024-03-12T17:18:45.368576+0000","last_unstale":"2024-03-12T17:18:46.853537+0000","last_undegraded":"2024-03-12T17:18:46.853537+0000","last_fullsized":"2024-03-12T17:18:46.853537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:23:50.392288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857414+0000","last_change":"2024-03-12T17:18:45.898975+0000","last_active":"2024-03-12T17:18:46.857414+0000","last_peered":"2024-03-12T17:18:46.857414+0000","last_clean":"2024-03-12T17:18:46.857414+0000","last_became_active":"2024-03-12T17:18:45.898704+0000","last_became_peered":"2024-03-12T17:18:45.898704+0000","last_unstale":"2024-03-12T17:18:46.857414+0000","last_undegraded":"2024-03-12T17:18:46.857414+0000","last_fullsized":"2024-03-12T17:18:46.857414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:42:22.754824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.946552+0000","last_change":"2024-03-12T17:18:45.366523+0000","last_active":"2024-03-12T17:18:46.946552+0000","last_peered":"2024-03-12T17:18:46.946552+0000","last_clean":"2024-03-12T17:18:46.946552+0000","last_became_active":"2024-03-12T17:18:45.366135+0000","last_became_peered":"2024-03-12T17:18:45.366135+0000","last_unstale":"2024-03-12T17:18:46.946552+0000","last_undegraded":"2024-03-12T17:18:46.946552+0000","last_fullsized":"2024-03-12T17:18:46.946552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T00:52:36.901043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858186+0000","last_change":"2024-03-12T17:18:45.898571+0000","last_active":"2024-03-12T17:18:46.858186+0000","last_peered":"2024-03-12T17:18:46.858186+0000","last_clean":"2024-03-12T17:18:46.858186+0000","last_became_active":"2024-03-12T17:18:45.898306+0000","last_became_peered":"2024-03-12T17:18:45.898306+0000","last_unstale":"2024-03-12T17:18:46.858186+0000","last_undegraded":"2024-03-12T17:18:46.858186+0000","last_fullsized":"2024-03-12T17:18:46.858186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:15:10.118237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.854032+0000","last_change":"2024-03-12T17:18:45.373982+0000","last_active":"2024-03-12T17:18:46.854032+0000","last_peered":"2024-03-12T17:18:46.854032+0000","last_clean":"2024-03-12T17:18:46.854032+0000","last_became_active":"2024-03-12T17:18:45.373647+0000","last_became_peered":"2024-03-12T17:18:45.373647+0000","last_unstale":"2024-03-12T17:18:46.854032+0000","last_undegraded":"2024-03-12T17:18:46.854032+0000","last_fullsized":"2024-03-12T17:18:46.854032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:07:53.768009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.859231+0000","last_change":"2024-03-12T17:18:45.903054+0000","last_active":"2024-03-12T17:18:46.859231+0000","last_peered":"2024-03-12T17:18:46.859231+0000","last_clean":"2024-03-12T17:18:46.859231+0000","last_became_active":"2024-03-12T17:18:45.902762+0000","last_became_peered":"2024-03-12T17:18:45.902762+0000","last_unstale":"2024-03-12T17:18:46.859231+0000","last_undegraded":"2024-03-12T17:18:46.859231+0000","last_fullsized":"2024-03-12T17:18:46.859231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:41:17.395467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.946192+0000","last_change":"2024-03-12T17:18:45.377581+0000","last_active":"2024-03-12T17:18:46.946192+0000","last_peered":"2024-03-12T17:18:46.946192+0000","last_clean":"2024-03-12T17:18:46.946192+0000","last_became_active":"2024-03-12T17:18:45.373688+0000","last_became_peered":"2024-03-12T17:18:45.373688+0000","last_unstale":"2024-03-12T17:18:46.946192+0000","last_undegraded":"2024-03-12T17:18:46.946192+0000","last_fullsized":"2024-03-12T17:18:46.946192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:31:59.966986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858775+0000","last_change":"2024-03-12T17:18:45.879835+0000","last_active":"2024-03-12T17:18:46.858775+0000","last_peered":"2024-03-12T17:18:46.858775+0000","last_clean":"2024-03-12T17:18:46.858775+0000","last_became_active":"2024-03-12T17:18:45.879498+0000","last_became_peered":"2024-03-12T17:18:45.879498+0000","last_unstale":"2024-03-12T17:18:46.858775+0000","last_undegraded":"2024-03-12T17:18:46.858775+0000","last_fullsized":"2024-03-12T17:18:46.858775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:41:17.395467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.853981+0000","last_change":"2024-03-12T17:18:45.376596+0000","last_active":"2024-03-12T17:18:46.853981+0000","last_peered":"2024-03-12T17:18:46.853981+0000","last_clean":"2024-03-12T17:18:46.853981+0000","last_became_active":"2024-03-12T17:18:45.376256+0000","last_became_peered":"2024-03-12T17:18:45.376256+0000","last_unstale":"2024-03-12T17:18:46.853981+0000","last_undegraded":"2024-03-12T17:18:46.853981+0000","last_fullsized":"2024-03-12T17:18:46.853981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:29:41.118150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858115+0000","last_change":"2024-03-12T17:18:45.900428+0000","last_active":"2024-03-12T17:18:46.858115+0000","last_peered":"2024-03-12T17:18:46.858115+0000","last_clean":"2024-03-12T17:18:46.858115+0000","last_became_active":"2024-03-12T17:18:45.900179+0000","last_became_peered":"2024-03-12T17:18:45.900179+0000","last_unstale":"2024-03-12T17:18:46.858115+0000","last_undegraded":"2024-03-12T17:18:46.858115+0000","last_fullsized":"2024-03-12T17:18:46.858115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:38:05.092463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-12T17:18:45.881910+0000","last_change":"2024-03-12T17:18:41.331756+0000","last_active":"2024-03-12T17:18:45.881910+0000","last_peered":"2024-03-12T17:18:45.881910+0000","last_clean":"2024-03-12T17:18:45.881910+0000","last_became_active":"2024-03-12T17:18:41.329237+0000","last_became_peered":"2024-03-12T17:18:41.329237+0000","last_unstale":"2024-03-12T17:18:45.881910+0000","last_undegraded":"2024-03-12T17:18:45.881910+0000","last_fullsized":"2024-03-12T17:18:45.881910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:40.152422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:40.152422+0000","last_clean_scrub_stamp":"2024-03-12T17:18:40.152422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:35:43.664403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857578+0000","last_change":"2024-03-12T17:18:45.367331+0000","last_active":"2024-03-12T17:18:46.857578+0000","last_peered":"2024-03-12T17:18:46.857578+0000","last_clean":"2024-03-12T17:18:46.857578+0000","last_became_active":"2024-03-12T17:18:45.367018+0000","last_became_peered":"2024-03-12T17:18:45.367018+0000","last_unstale":"2024-03-12T17:18:46.857578+0000","last_undegraded":"2024-03-12T17:18:46.857578+0000","last_fullsized":"2024-03-12T17:18:46.857578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:12:48.811874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947416+0000","last_change":"2024-03-12T17:18:45.870828+0000","last_active":"2024-03-12T17:18:46.947416+0000","last_peered":"2024-03-12T17:18:46.947416+0000","last_clean":"2024-03-12T17:18:46.947416+0000","last_became_active":"2024-03-12T17:18:45.870373+0000","last_became_peered":"2024-03-12T17:18:45.870373+0000","last_unstale":"2024-03-12T17:18:46.947416+0000","last_undegraded":"2024-03-12T17:18:46.947416+0000","last_fullsized":"2024-03-12T17:18:46.947416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:17:33.168888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.856696+0000","last_change":"2024-03-12T17:18:45.379833+0000","last_active":"2024-03-12T17:18:46.856696+0000","last_peered":"2024-03-12T17:18:46.856696+0000","last_clean":"2024-03-12T17:18:46.856696+0000","last_became_active":"2024-03-12T17:18:45.379554+0000","last_became_peered":"2024-03-12T17:18:45.379554+0000","last_unstale":"2024-03-12T17:18:46.856696+0000","last_undegraded":"2024-03-12T17:18:46.856696+0000","last_fullsized":"2024-03-12T17:18:46.856696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:23:50.392288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.949504+0000","last_change":"2024-03-12T17:18:45.885222+0000","last_active":"2024-03-12T17:18:46.949504+0000","last_peered":"2024-03-12T17:18:46.949504+0000","last_clean":"2024-03-12T17:18:46.949504+0000","last_became_active":"2024-03-12T17:18:45.883636+0000","last_became_peered":"2024-03-12T17:18:45.883636+0000","last_unstale":"2024-03-12T17:18:46.949504+0000","last_undegraded":"2024-03-12T17:18:46.949504+0000","last_fullsized":"2024-03-12T17:18:46.949504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:54:36.712407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.853528+0000","last_change":"2024-03-12T17:18:45.364610+0000","last_active":"2024-03-12T17:18:46.853528+0000","last_peered":"2024-03-12T17:18:46.853528+0000","last_clean":"2024-03-12T17:18:46.853528+0000","last_became_active":"2024-03-12T17:18:45.364255+0000","last_became_peered":"2024-03-12T17:18:45.364255+0000","last_unstale":"2024-03-12T17:18:46.853528+0000","last_undegraded":"2024-03-12T17:18:46.853528+0000","last_fullsized":"2024-03-12T17:18:46.853528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:12:48.811874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944834+0000","last_change":"2024-03-12T17:18:45.857097+0000","last_active":"2024-03-12T17:18:46.944834+0000","last_peered":"2024-03-12T17:18:46.944834+0000","last_clean":"2024-03-12T17:18:46.944834+0000","last_became_active":"2024-03-12T17:18:45.856205+0000","last_became_peered":"2024-03-12T17:18:45.856205+0000","last_unstale":"2024-03-12T17:18:46.944834+0000","last_undegraded":"2024-03-12T17:18:46.944834+0000","last_fullsized":"2024-03-12T17:18:46.944834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:24:13.883507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858257+0000","last_change":"2024-03-12T17:18:45.371153+0000","last_active":"2024-03-12T17:18:46.858257+0000","last_peered":"2024-03-12T17:18:46.858257+0000","last_clean":"2024-03-12T17:18:46.858257+0000","last_became_active":"2024-03-12T17:18:45.369025+0000","last_became_peered":"2024-03-12T17:18:45.369025+0000","last_unstale":"2024-03-12T17:18:46.858257+0000","last_undegraded":"2024-03-12T17:18:46.858257+0000","last_fullsized":"2024-03-12T17:18:46.858257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:20:41.753321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.946051+0000","last_change":"2024-03-12T17:18:45.888296+0000","last_active":"2024-03-12T17:18:46.946051+0000","last_peered":"2024-03-12T17:18:46.946051+0000","last_clean":"2024-03-12T17:18:46.946051+0000","last_became_active":"2024-03-12T17:18:45.886034+0000","last_became_peered":"2024-03-12T17:18:45.886034+0000","last_unstale":"2024-03-12T17:18:46.946051+0000","last_undegraded":"2024-03-12T17:18:46.946051+0000","last_fullsized":"2024-03-12T17:18:46.946051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:35:49.382412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944808+0000","last_change":"2024-03-12T17:18:45.373944+0000","last_active":"2024-03-12T17:18:46.944808+0000","last_peered":"2024-03-12T17:18:46.944808+0000","last_clean":"2024-03-12T17:18:46.944808+0000","last_became_active":"2024-03-12T17:18:45.372641+0000","last_became_peered":"2024-03-12T17:18:45.372641+0000","last_unstale":"2024-03-12T17:18:46.944808+0000","last_undegraded":"2024-03-12T17:18:46.944808+0000","last_fullsized":"2024-03-12T17:18:46.944808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:29:41.118150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858537+0000","last_change":"2024-03-12T17:18:45.881154+0000","last_active":"2024-03-12T17:18:46.858537+0000","last_peered":"2024-03-12T17:18:46.858537+0000","last_clean":"2024-03-12T17:18:46.858537+0000","last_became_active":"2024-03-12T17:18:45.880178+0000","last_became_peered":"2024-03-12T17:18:45.880178+0000","last_unstale":"2024-03-12T17:18:46.858537+0000","last_undegraded":"2024-03-12T17:18:46.858537+0000","last_fullsized":"2024-03-12T17:18:46.858537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:17:33.168888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858695+0000","last_change":"2024-03-12T17:18:45.384960+0000","last_active":"2024-03-12T17:18:46.858695+0000","last_peered":"2024-03-12T17:18:46.858695+0000","last_clean":"2024-03-12T17:18:46.858695+0000","last_became_active":"2024-03-12T17:18:45.384751+0000","last_became_peered":"2024-03-12T17:18:45.384751+0000","last_unstale":"2024-03-12T17:18:46.858695+0000","last_undegraded":"2024-03-12T17:18:46.858695+0000","last_fullsized":"2024-03-12T17:18:46.858695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:35:48.237768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944647+0000","last_change":"2024-03-12T17:18:45.856343+0000","last_active":"2024-03-12T17:18:46.944647+0000","last_peered":"2024-03-12T17:18:46.944647+0000","last_clean":"2024-03-12T17:18:46.944647+0000","last_became_active":"2024-03-12T17:18:45.856040+0000","last_became_peered":"2024-03-12T17:18:45.856040+0000","last_unstale":"2024-03-12T17:18:46.944647+0000","last_undegraded":"2024-03-12T17:18:46.944647+0000","last_fullsized":"2024-03-12T17:18:46.944647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:23:06.063091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:48.520105+0000","last_change":"2024-03-12T17:18:45.378083+0000","last_active":"2024-03-12T17:18:48.520105+0000","last_peered":"2024-03-12T17:18:48.520105+0000","last_clean":"2024-03-12T17:18:48.520105+0000","last_became_active":"2024-03-12T17:18:45.377137+0000","last_became_peered":"2024-03-12T17:18:45.377137+0000","last_unstale":"2024-03-12T17:18:48.520105+0000","last_undegraded":"2024-03-12T17:18:48.520105+0000","last_fullsized":"2024-03-12T17:18:48.520105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:28:47.390706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.948100+0000","last_change":"2024-03-12T17:18:45.889958+0000","last_active":"2024-03-12T17:18:46.948100+0000","last_peered":"2024-03-12T17:18:46.948100+0000","last_clean":"2024-03-12T17:18:46.948100+0000","last_became_active":"2024-03-12T17:18:45.889667+0000","last_became_peered":"2024-03-12T17:18:45.889667+0000","last_unstale":"2024-03-12T17:18:46.948100+0000","last_undegraded":"2024-03-12T17:18:46.948100+0000","last_fullsized":"2024-03-12T17:18:46.948100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:21:11.051648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.945277+0000","last_change":"2024-03-12T17:18:45.382531+0000","last_active":"2024-03-12T17:18:46.945277+0000","last_peered":"2024-03-12T17:18:46.945277+0000","last_clean":"2024-03-12T17:18:46.945277+0000","last_became_active":"2024-03-12T17:18:45.381932+0000","last_became_peered":"2024-03-12T17:18:45.381932+0000","last_unstale":"2024-03-12T17:18:46.945277+0000","last_undegraded":"2024-03-12T17:18:46.945277+0000","last_fullsized":"2024-03-12T17:18:46.945277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:20:41.753321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.948605+0000","last_change":"2024-03-12T17:18:45.861290+0000","last_active":"2024-03-12T17:18:46.948605+0000","last_peered":"2024-03-12T17:18:46.948605+0000","last_clean":"2024-03-12T17:18:46.948605+0000","last_became_active":"2024-03-12T17:18:45.860724+0000","last_became_peered":"2024-03-12T17:18:45.860724+0000","last_unstale":"2024-03-12T17:18:46.948605+0000","last_undegraded":"2024-03-12T17:18:46.948605+0000","last_fullsized":"2024-03-12T17:18:46.948605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:48:29.172720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.856696+0000","last_change":"2024-03-12T17:18:45.384765+0000","last_active":"2024-03-12T17:18:46.856696+0000","last_peered":"2024-03-12T17:18:46.856696+0000","last_clean":"2024-03-12T17:18:46.856696+0000","last_became_active":"2024-03-12T17:18:45.384463+0000","last_became_peered":"2024-03-12T17:18:45.384463+0000","last_unstale":"2024-03-12T17:18:46.856696+0000","last_undegraded":"2024-03-12T17:18:46.856696+0000","last_fullsized":"2024-03-12T17:18:46.856696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:29:41.118150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.946022+0000","last_change":"2024-03-12T17:18:45.883260+0000","last_active":"2024-03-12T17:18:46.946022+0000","last_peered":"2024-03-12T17:18:46.946022+0000","last_clean":"2024-03-12T17:18:46.946022+0000","last_became_active":"2024-03-12T17:18:45.882864+0000","last_became_peered":"2024-03-12T17:18:45.882864+0000","last_unstale":"2024-03-12T17:18:46.946022+0000","last_undegraded":"2024-03-12T17:18:46.946022+0000","last_fullsized":"2024-03-12T17:18:46.946022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:07:54.912653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.945167+0000","last_change":"2024-03-12T17:18:45.380347+0000","last_active":"2024-03-12T17:18:46.945167+0000","last_peered":"2024-03-12T17:18:46.945167+0000","last_clean":"2024-03-12T17:18:46.945167+0000","last_became_active":"2024-03-12T17:18:45.378500+0000","last_became_peered":"2024-03-12T17:18:45.378500+0000","last_unstale":"2024-03-12T17:18:46.945167+0000","last_undegraded":"2024-03-12T17:18:46.945167+0000","last_fullsized":"2024-03-12T17:18:46.945167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:52:30.297945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.946901+0000","last_change":"2024-03-12T17:18:45.876651+0000","last_active":"2024-03-12T17:18:46.946901+0000","last_peered":"2024-03-12T17:18:46.946901+0000","last_clean":"2024-03-12T17:18:46.946901+0000","last_became_active":"2024-03-12T17:18:45.875075+0000","last_became_peered":"2024-03-12T17:18:45.875075+0000","last_unstale":"2024-03-12T17:18:46.946901+0000","last_undegraded":"2024-03-12T17:18:46.946901+0000","last_fullsized":"2024-03-12T17:18:46.946901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:41:17.395467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944618+0000","last_change":"2024-03-12T17:18:45.380761+0000","last_active":"2024-03-12T17:18:46.944618+0000","last_peered":"2024-03-12T17:18:46.944618+0000","last_clean":"2024-03-12T17:18:46.944618+0000","last_became_active":"2024-03-12T17:18:45.379967+0000","last_became_peered":"2024-03-12T17:18:45.379967+0000","last_unstale":"2024-03-12T17:18:46.944618+0000","last_undegraded":"2024-03-12T17:18:46.944618+0000","last_fullsized":"2024-03-12T17:18:46.944618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:35:48.237768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947573+0000","last_change":"2024-03-12T17:18:45.874583+0000","last_active":"2024-03-12T17:18:46.947573+0000","last_peered":"2024-03-12T17:18:46.947573+0000","last_clean":"2024-03-12T17:18:46.947573+0000","last_became_active":"2024-03-12T17:18:45.873218+0000","last_became_peered":"2024-03-12T17:18:45.873218+0000","last_unstale":"2024-03-12T17:18:46.947573+0000","last_undegraded":"2024-03-12T17:18:46.947573+0000","last_fullsized":"2024-03-12T17:18:46.947573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:10:29.099400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858419+0000","last_change":"2024-03-12T17:18:45.380027+0000","last_active":"2024-03-12T17:18:46.858419+0000","last_peered":"2024-03-12T17:18:46.858419+0000","last_clean":"2024-03-12T17:18:46.858419+0000","last_became_active":"2024-03-12T17:18:45.379670+0000","last_became_peered":"2024-03-12T17:18:45.379670+0000","last_unstale":"2024-03-12T17:18:46.858419+0000","last_undegraded":"2024-03-12T17:18:46.858419+0000","last_fullsized":"2024-03-12T17:18:46.858419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:31:59.966986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944190+0000","last_change":"2024-03-12T17:18:45.892768+0000","last_active":"2024-03-12T17:18:46.944190+0000","last_peered":"2024-03-12T17:18:46.944190+0000","last_clean":"2024-03-12T17:18:46.944190+0000","last_became_active":"2024-03-12T17:18:45.890848+0000","last_became_peered":"2024-03-12T17:18:45.890848+0000","last_unstale":"2024-03-12T17:18:46.944190+0000","last_undegraded":"2024-03-12T17:18:46.944190+0000","last_fullsized":"2024-03-12T17:18:46.944190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:17:33.168888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858274+0000","last_change":"2024-03-12T17:18:45.885223+0000","last_active":"2024-03-12T17:18:46.858274+0000","last_peered":"2024-03-12T17:18:46.858274+0000","last_clean":"2024-03-12T17:18:46.858274+0000","last_became_active":"2024-03-12T17:18:45.884899+0000","last_became_peered":"2024-03-12T17:18:45.884899+0000","last_unstale":"2024-03-12T17:18:46.858274+0000","last_undegraded":"2024-03-12T17:18:46.858274+0000","last_fullsized":"2024-03-12T17:18:46.858274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:45:08.333283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857514+0000","last_change":"2024-03-12T17:18:45.386513+0000","last_active":"2024-03-12T17:18:46.857514+0000","last_peered":"2024-03-12T17:18:46.857514+0000","last_clean":"2024-03-12T17:18:46.857514+0000","last_became_active":"2024-03-12T17:18:45.386189+0000","last_became_peered":"2024-03-12T17:18:45.386189+0000","last_unstale":"2024-03-12T17:18:46.857514+0000","last_undegraded":"2024-03-12T17:18:46.857514+0000","last_fullsized":"2024-03-12T17:18:46.857514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:35:28.129493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858523+0000","last_change":"2024-03-12T17:18:45.894835+0000","last_active":"2024-03-12T17:18:46.858523+0000","last_peered":"2024-03-12T17:18:46.858523+0000","last_clean":"2024-03-12T17:18:46.858523+0000","last_became_active":"2024-03-12T17:18:45.894485+0000","last_became_peered":"2024-03-12T17:18:45.894485+0000","last_unstale":"2024-03-12T17:18:46.858523+0000","last_undegraded":"2024-03-12T17:18:46.858523+0000","last_fullsized":"2024-03-12T17:18:46.858523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:48:29.172720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858357+0000","last_change":"2024-03-12T17:18:45.384828+0000","last_active":"2024-03-12T17:18:46.858357+0000","last_peered":"2024-03-12T17:18:46.858357+0000","last_clean":"2024-03-12T17:18:46.858357+0000","last_became_active":"2024-03-12T17:18:45.384524+0000","last_became_peered":"2024-03-12T17:18:45.384524+0000","last_unstale":"2024-03-12T17:18:46.858357+0000","last_undegraded":"2024-03-12T17:18:46.858357+0000","last_fullsized":"2024-03-12T17:18:46.858357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:28:47.390706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.948954+0000","last_change":"2024-03-12T17:18:45.874183+0000","last_active":"2024-03-12T17:18:46.948954+0000","last_peered":"2024-03-12T17:18:46.948954+0000","last_clean":"2024-03-12T17:18:46.948954+0000","last_became_active":"2024-03-12T17:18:45.873893+0000","last_became_peered":"2024-03-12T17:18:45.873893+0000","last_unstale":"2024-03-12T17:18:46.948954+0000","last_undegraded":"2024-03-12T17:18:46.948954+0000","last_fullsized":"2024-03-12T17:18:46.948954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:42:22.352573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.948036+0000","last_change":"2024-03-12T17:18:45.377991+0000","last_active":"2024-03-12T17:18:46.948036+0000","last_peered":"2024-03-12T17:18:46.948036+0000","last_clean":"2024-03-12T17:18:46.948036+0000","last_became_active":"2024-03-12T17:18:45.375429+0000","last_became_peered":"2024-03-12T17:18:45.375429+0000","last_unstale":"2024-03-12T17:18:46.948036+0000","last_undegraded":"2024-03-12T17:18:46.948036+0000","last_fullsized":"2024-03-12T17:18:46.948036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:12:48.811874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.948053+0000","last_change":"2024-03-12T17:18:45.890541+0000","last_active":"2024-03-12T17:18:46.948053+0000","last_peered":"2024-03-12T17:18:46.948053+0000","last_clean":"2024-03-12T17:18:46.948053+0000","last_became_active":"2024-03-12T17:18:45.890352+0000","last_became_peered":"2024-03-12T17:18:45.890352+0000","last_unstale":"2024-03-12T17:18:46.948053+0000","last_undegraded":"2024-03-12T17:18:46.948053+0000","last_fullsized":"2024-03-12T17:18:46.948053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:05:09.374271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.949344+0000","last_change":"2024-03-12T17:18:45.374531+0000","last_active":"2024-03-12T17:18:46.949344+0000","last_peered":"2024-03-12T17:18:46.949344+0000","last_clean":"2024-03-12T17:18:46.949344+0000","last_became_active":"2024-03-12T17:18:45.373202+0000","last_became_peered":"2024-03-12T17:18:45.373202+0000","last_unstale":"2024-03-12T17:18:46.949344+0000","last_undegraded":"2024-03-12T17:18:46.949344+0000","last_fullsized":"2024-03-12T17:18:46.949344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:01:22.087219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":815104,"data_stored":666519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2969999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.534}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6539999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":229376,"data_stored":77133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5390000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.631}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7749999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.278}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5840000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31340,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340500,"statfs":{"total":96636764160,"available":96604672000,"internally_reserved":0,"allocated":221184,"data_stored":75659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2749999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.478}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":229376,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2869999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6879999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5680000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.474}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7649999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":229376,"data_stored":77133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9580000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.476}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8860000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.843}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":217088,"data_stored":75569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1910000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2809999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.385}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.427}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.518}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.643}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31344,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340496,"statfs":{"total":96636764160,"available":96604667904,"internally_reserved":0,"allocated":225280,"data_stored":75729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.403}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.429}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.28}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":823296,"data_stored":666575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.732}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.99}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.601}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9410000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5760000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.431}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-12T17:18:56.449 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-12T17:18:56.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.708+0000 7f4862600640 1 Processor -- start 2024-03-12T17:18:56.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.708+0000 7f4862600640 1 -- start start 2024-03-12T17:18:56.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.709+0000 7f4862600640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f485c0d2fa0 0x7f485c0d3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:56.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.709+0000 7f4862600640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f485c0b5b50 0x7f485c0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:56.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.710+0000 7f4862600640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f485c0d14e0 con 0x7f485c0cd840 2024-03-12T17:18:56.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.710+0000 7f4862600640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f485c0b59e0 con 0x7f485c0d2fa0 2024-03-12T17:18:56.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.710+0000 7f4862600640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f485c0d38c0 con 0x7f485c0b5b50 2024-03-12T17:18:56.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.710+0000 7f485b400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f485c0d2fa0 0x7f485c0d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:56.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.710+0000 7f485b400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f485c0d2fa0 0x7f485c0d3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38924/0 (socket says 172.21.15.17:38924) 2024-03-12T17:18:56.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.710+0000 7f485b400640 1 -- 172.21.15.17:0/215173291 learned_addr learned my addr 172.21.15.17:0/215173291 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:56.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.710+0000 7f485aa00640 1 --2- 172.21.15.17:0/215173291 >> v2:172.21.15.94:3300/0 conn(0x7f485c0b5b50 0x7f485c0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:56.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.710+0000 7f485b400640 1 -- 172.21.15.17:0/215173291 >> v2:172.21.15.94:3300/0 conn(0x7f485c0b5b50 msgr2=0x7f485c0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:56.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.710+0000 7f485b400640 1 --2- 172.21.15.17:0/215173291 >> v2:172.21.15.94:3300/0 conn(0x7f485c0b5b50 0x7f485c0b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:56.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.710+0000 7f485b400640 1 -- 172.21.15.17:0/215173291 >> v1:172.21.15.94:6789/0 conn(0x7f485c0cd840 legacy=0x7f485c0d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:56.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.710+0000 7f485b400640 1 -- 172.21.15.17:0/215173291 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f485c0b85b0 con 0x7f485c0d2fa0 2024-03-12T17:18:56.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.710+0000 7f485aa00640 1 --2- 172.21.15.17:0/215173291 >> v2:172.21.15.94:3300/0 conn(0x7f485c0b5b50 0x7f485c0b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:18:56.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.711+0000 7f485b400640 1 --2- 172.21.15.17:0/215173291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f485c0d2fa0 0x7f485c0d3380 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f485c067500 tx=0x7f484c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bc5501e5f0b1f3b server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:56.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.712+0000 7f485a000640 1 -- 172.21.15.17:0/215173291 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484c031870 con 0x7f485c0d2fa0 2024-03-12T17:18:56.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.712+0000 7f485a000640 1 -- 172.21.15.17:0/215173291 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484c0319d0 con 0x7f485c0d2fa0 2024-03-12T17:18:56.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.712+0000 7f485a000640 1 -- 172.21.15.17:0/215173291 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484c031d60 con 0x7f485c0d2fa0 2024-03-12T17:18:56.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.712+0000 7f4862600640 1 -- 172.21.15.17:0/215173291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f485c0d2fa0 msgr2=0x7f485c0d3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:56.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.712+0000 7f4862600640 1 --2- 172.21.15.17:0/215173291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f485c0d2fa0 0x7f485c0d3380 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f485c067500 tx=0x7f484c02b910 comp rx=0 tx=0).stop 2024-03-12T17:18:56.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.712+0000 7f4862600640 1 -- 172.21.15.17:0/215173291 shutdown_connections 2024-03-12T17:18:56.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.712+0000 7f4862600640 1 --2- 172.21.15.17:0/215173291 >> v2:172.21.15.94:3300/0 conn(0x7f485c0b5b50 0x7f485c0b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:56.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.712+0000 7f4862600640 1 --2- 172.21.15.17:0/215173291 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f485c0d2fa0 0x7f485c0d3380 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:56.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.713+0000 7f4862600640 1 -- 172.21.15.17:0/215173291 >> 172.21.15.17:0/215173291 conn(0x7f485c065df0 msgr2=0x7f485c066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:56.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.713+0000 7f4862600640 1 -- 172.21.15.17:0/215173291 shutdown_connections 2024-03-12T17:18:56.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.713+0000 7f4862600640 1 -- 172.21.15.17:0/215173291 wait complete. 2024-03-12T17:18:56.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.714+0000 7f4862600640 1 Processor -- start 2024-03-12T17:18:56.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.714+0000 7f4862600640 1 -- start start 2024-03-12T17:18:56.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.715+0000 7f4862600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f485c0b5b50 0x7f485c15cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:56.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.715+0000 7f4862600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f485c0cd840 0x7f485c15f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:56.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.715+0000 7f4862600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f485c0d2fa0 0x7f485c150f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:56.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.715+0000 7f4862600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c1514a0 con 0x7f485c0b5b50 2024-03-12T17:18:56.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.715+0000 7f4862600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c0cc1d0 con 0x7f485c0d2fa0 2024-03-12T17:18:56.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.715+0000 7f4862600640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f485c15d5d0 con 0x7f485c0cd840 2024-03-12T17:18:56.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.716+0000 7f485b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f485c0b5b50 0x7f485c15cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:56.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.716+0000 7f485b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f485c0b5b50 0x7f485c15cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38934/0 (socket says 172.21.15.17:38934) 2024-03-12T17:18:56.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.716+0000 7f485b400640 1 -- 172.21.15.17:0/253865471 learned_addr learned my addr 172.21.15.17:0/253865471 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:56.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.716+0000 7f485aa00640 1 --2- 172.21.15.17:0/253865471 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f485c0cd840 0x7f485c15f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:56.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.716+0000 7f485be00640 1 --2- 172.21.15.17:0/253865471 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f485c0d2fa0 0x7f485c150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:56.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.716+0000 7f485b400640 1 -- 172.21.15.17:0/253865471 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f485c0cd840 msgr2=0x7f485c15f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:56.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.716+0000 7f485b400640 1 --2- 172.21.15.17:0/253865471 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f485c0cd840 0x7f485c15f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:56.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.716+0000 7f485b400640 1 -- 172.21.15.17:0/253865471 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f485c0d2fa0 msgr2=0x7f485c150f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:56.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.716+0000 7f485b400640 1 --2- 172.21.15.17:0/253865471 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f485c0d2fa0 0x7f485c150f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:56.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.716+0000 7f485b400640 1 -- 172.21.15.17:0/253865471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f484c0094d0 con 0x7f485c0b5b50 2024-03-12T17:18:56.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.716+0000 7f485b400640 1 --2- 172.21.15.17:0/253865471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f485c0b5b50 0x7f485c15cf40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f484c000c00 tx=0x7f484c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:56.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.717+0000 7f4853400640 1 -- 172.21.15.17:0/253865471 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484c03ad10 con 0x7f485c0b5b50 2024-03-12T17:18:56.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.717+0000 7f4853400640 1 -- 172.21.15.17:0/253865471 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484c03ae70 con 0x7f485c0b5b50 2024-03-12T17:18:56.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.717+0000 7f4862600640 1 -- 172.21.15.17:0/253865471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f485c15d8b0 con 0x7f485c0b5b50 2024-03-12T17:18:56.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.717+0000 7f4853400640 1 -- 172.21.15.17:0/253865471 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484c044610 con 0x7f485c0b5b50 2024-03-12T17:18:56.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.717+0000 7f4862600640 1 -- 172.21.15.17:0/253865471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f485c15de70 con 0x7f485c0b5b50 2024-03-12T17:18:56.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.718+0000 7f4862600640 1 -- 172.21.15.17:0/253865471 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f485c0a9f60 con 0x7f485c0b5b50 2024-03-12T17:18:56.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.719+0000 7f4853400640 1 -- 172.21.15.17:0/253865471 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f484c04d450 con 0x7f485c0b5b50 2024-03-12T17:18:56.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.719+0000 7f4853400640 1 --2- 172.21.15.17:0/253865471 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f483806ac30 0x7f483806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:56.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.720+0000 7f4853400640 1 -- 172.21.15.17:0/253865471 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f484c02d040 con 0x7f485c0b5b50 2024-03-12T17:18:56.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.720+0000 7f485aa00640 1 --2- 172.21.15.17:0/253865471 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f483806ac30 0x7f483806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:56.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.720+0000 7f485aa00640 1 --2- 172.21.15.17:0/253865471 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f483806ac30 0x7f483806d0f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f485c0b43f0 tx=0x7f4844008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:56.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.724+0000 7f4853400640 1 -- 172.21.15.17:0/253865471 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f484c076bd0 con 0x7f485c0b5b50 2024-03-12T17:18:56.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.911+0000 7f4862600640 1 -- 172.21.15.17:0/253865471 --> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f485c0d1a10 con 0x7f483806ac30 2024-03-12T17:18:56.918 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.922+0000 7f4853400640 1 -- 172.21.15.17:0/253865471 <== mgr.4104 v2:172.21.15.17:6832/37052 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264315 (secure 0 0 0) 0x7f484400c050 con 0x7f483806ac30 2024-03-12T17:18:56.921 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:18:56.922 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-03-12T17:18:56.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.928+0000 7f4862600640 1 -- 172.21.15.17:0/253865471 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f483806ac30 msgr2=0x7f483806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:56.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.928+0000 7f4862600640 1 --2- 172.21.15.17:0/253865471 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f483806ac30 0x7f483806d0f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f485c0b43f0 tx=0x7f4844008040 comp rx=0 tx=0).stop 2024-03-12T17:18:56.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.928+0000 7f4862600640 1 -- 172.21.15.17:0/253865471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f485c0b5b50 msgr2=0x7f485c15cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:56.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.928+0000 7f4862600640 1 --2- 172.21.15.17:0/253865471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f485c0b5b50 0x7f485c15cf40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f484c000c00 tx=0x7f484c0046c0 comp rx=0 tx=0).stop 2024-03-12T17:18:56.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.928+0000 7f4862600640 1 -- 172.21.15.17:0/253865471 shutdown_connections 2024-03-12T17:18:56.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.928+0000 7f4862600640 1 --2- 172.21.15.17:0/253865471 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f483806ac30 0x7f483806d0f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:56.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.928+0000 7f4862600640 1 --2- 172.21.15.17:0/253865471 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f485c0d2fa0 0x7f485c150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:56.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.928+0000 7f4862600640 1 --2- 172.21.15.17:0/253865471 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f485c0cd840 0x7f485c15f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:56.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.928+0000 7f4862600640 1 --2- 172.21.15.17:0/253865471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f485c0b5b50 0x7f485c15cf40 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:56.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.928+0000 7f4862600640 1 -- 172.21.15.17:0/253865471 >> 172.21.15.17:0/253865471 conn(0x7f485c065df0 msgr2=0x7f485c0b60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:56.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.928+0000 7f4862600640 1 -- 172.21.15.17:0/253865471 shutdown_connections 2024-03-12T17:18:56.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:56.928+0000 7f4862600640 1 -- 172.21.15.17:0/253865471 wait complete. 2024-03-12T17:18:56.940 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-03-12T17:18:55.478802+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":252284,"kb_used_data":2920,"kb_used_omap":13,"kb_used_meta":248818,"kb_avail":754722436,"statfs":{"total":773094113280,"available":772835774464,"internally_reserved":0,"allocated":2990080,"data_stored":1790012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":254789720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":59,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.629890"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858955+0000","last_change":"2024-03-12T17:18:45.899195+0000","last_active":"2024-03-12T17:18:46.858955+0000","last_peered":"2024-03-12T17:18:46.858955+0000","last_clean":"2024-03-12T17:18:46.858955+0000","last_became_active":"2024-03-12T17:18:45.898885+0000","last_became_peered":"2024-03-12T17:18:45.898885+0000","last_unstale":"2024-03-12T17:18:46.858955+0000","last_undegraded":"2024-03-12T17:18:46.858955+0000","last_fullsized":"2024-03-12T17:18:46.858955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:36:07.517436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944636+0000","last_change":"2024-03-12T17:18:45.863461+0000","last_active":"2024-03-12T17:18:46.944636+0000","last_peered":"2024-03-12T17:18:46.944636+0000","last_clean":"2024-03-12T17:18:46.944636+0000","last_became_active":"2024-03-12T17:18:45.861872+0000","last_became_peered":"2024-03-12T17:18:45.861872+0000","last_unstale":"2024-03-12T17:18:46.944636+0000","last_undegraded":"2024-03-12T17:18:46.944636+0000","last_fullsized":"2024-03-12T17:18:46.944636+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:17:33.168888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947273+0000","last_change":"2024-03-12T17:18:45.862114+0000","last_active":"2024-03-12T17:18:46.947273+0000","last_peered":"2024-03-12T17:18:46.947273+0000","last_clean":"2024-03-12T17:18:46.947273+0000","last_became_active":"2024-03-12T17:18:45.861875+0000","last_became_peered":"2024-03-12T17:18:45.861875+0000","last_unstale":"2024-03-12T17:18:46.947273+0000","last_undegraded":"2024-03-12T17:18:46.947273+0000","last_fullsized":"2024-03-12T17:18:46.947273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:56:38.943678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858269+0000","last_change":"2024-03-12T17:18:45.878850+0000","last_active":"2024-03-12T17:18:46.858269+0000","last_peered":"2024-03-12T17:18:46.858269+0000","last_clean":"2024-03-12T17:18:46.858269+0000","last_became_active":"2024-03-12T17:18:45.878507+0000","last_became_peered":"2024-03-12T17:18:45.878507+0000","last_unstale":"2024-03-12T17:18:46.858269+0000","last_undegraded":"2024-03-12T17:18:46.858269+0000","last_fullsized":"2024-03-12T17:18:46.858269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:05:09.374271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857739+0000","last_change":"2024-03-12T17:18:45.894717+0000","last_active":"2024-03-12T17:18:46.857739+0000","last_peered":"2024-03-12T17:18:46.857739+0000","last_clean":"2024-03-12T17:18:46.857739+0000","last_became_active":"2024-03-12T17:18:45.894426+0000","last_became_peered":"2024-03-12T17:18:45.894426+0000","last_unstale":"2024-03-12T17:18:46.857739+0000","last_undegraded":"2024-03-12T17:18:46.857739+0000","last_fullsized":"2024-03-12T17:18:46.857739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:09:10.961008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857512+0000","last_change":"2024-03-12T17:18:45.870293+0000","last_active":"2024-03-12T17:18:46.857512+0000","last_peered":"2024-03-12T17:18:46.857512+0000","last_clean":"2024-03-12T17:18:46.857512+0000","last_became_active":"2024-03-12T17:18:45.869629+0000","last_became_peered":"2024-03-12T17:18:45.869629+0000","last_unstale":"2024-03-12T17:18:46.857512+0000","last_undegraded":"2024-03-12T17:18:46.857512+0000","last_fullsized":"2024-03-12T17:18:46.857512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:24:13.883507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857215+0000","last_change":"2024-03-12T17:18:45.894712+0000","last_active":"2024-03-12T17:18:46.857215+0000","last_peered":"2024-03-12T17:18:46.857215+0000","last_clean":"2024-03-12T17:18:46.857215+0000","last_became_active":"2024-03-12T17:18:45.894385+0000","last_became_peered":"2024-03-12T17:18:45.894385+0000","last_unstale":"2024-03-12T17:18:46.857215+0000","last_undegraded":"2024-03-12T17:18:46.857215+0000","last_fullsized":"2024-03-12T17:18:46.857215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:21:11.051648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.946712+0000","last_change":"2024-03-12T17:18:45.878221+0000","last_active":"2024-03-12T17:18:46.946712+0000","last_peered":"2024-03-12T17:18:46.946712+0000","last_clean":"2024-03-12T17:18:46.946712+0000","last_became_active":"2024-03-12T17:18:45.877953+0000","last_became_peered":"2024-03-12T17:18:45.877953+0000","last_unstale":"2024-03-12T17:18:46.946712+0000","last_undegraded":"2024-03-12T17:18:46.946712+0000","last_fullsized":"2024-03-12T17:18:46.946712+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:45:08.333283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.859164+0000","last_change":"2024-03-12T17:18:45.900699+0000","last_active":"2024-03-12T17:18:46.859164+0000","last_peered":"2024-03-12T17:18:46.859164+0000","last_clean":"2024-03-12T17:18:46.859164+0000","last_became_active":"2024-03-12T17:18:45.900360+0000","last_became_peered":"2024-03-12T17:18:45.900360+0000","last_unstale":"2024-03-12T17:18:46.859164+0000","last_undegraded":"2024-03-12T17:18:46.859164+0000","last_fullsized":"2024-03-12T17:18:46.859164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:03:15.594609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.945139+0000","last_change":"2024-03-12T17:18:45.888417+0000","last_active":"2024-03-12T17:18:46.945139+0000","last_peered":"2024-03-12T17:18:46.945139+0000","last_clean":"2024-03-12T17:18:46.945139+0000","last_became_active":"2024-03-12T17:18:45.888207+0000","last_became_peered":"2024-03-12T17:18:45.888207+0000","last_unstale":"2024-03-12T17:18:46.945139+0000","last_undegraded":"2024-03-12T17:18:46.945139+0000","last_fullsized":"2024-03-12T17:18:46.945139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:42:22.352573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944829+0000","last_change":"2024-03-12T17:18:45.887868+0000","last_active":"2024-03-12T17:18:46.944829+0000","last_peered":"2024-03-12T17:18:46.944829+0000","last_clean":"2024-03-12T17:18:46.944829+0000","last_became_active":"2024-03-12T17:18:45.887591+0000","last_became_peered":"2024-03-12T17:18:45.887591+0000","last_unstale":"2024-03-12T17:18:46.944829+0000","last_undegraded":"2024-03-12T17:18:46.944829+0000","last_fullsized":"2024-03-12T17:18:46.944829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:54:36.712407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.946540+0000","last_change":"2024-03-12T17:18:45.891669+0000","last_active":"2024-03-12T17:18:46.946540+0000","last_peered":"2024-03-12T17:18:46.946540+0000","last_clean":"2024-03-12T17:18:46.946540+0000","last_became_active":"2024-03-12T17:18:45.891084+0000","last_became_peered":"2024-03-12T17:18:45.891084+0000","last_unstale":"2024-03-12T17:18:46.946540+0000","last_undegraded":"2024-03-12T17:18:46.946540+0000","last_fullsized":"2024-03-12T17:18:46.946540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:35:29.274137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947674+0000","last_change":"2024-03-12T17:18:45.885085+0000","last_active":"2024-03-12T17:18:46.947674+0000","last_peered":"2024-03-12T17:18:46.947674+0000","last_clean":"2024-03-12T17:18:46.947674+0000","last_became_active":"2024-03-12T17:18:45.884827+0000","last_became_peered":"2024-03-12T17:18:45.884827+0000","last_unstale":"2024-03-12T17:18:46.947674+0000","last_undegraded":"2024-03-12T17:18:46.947674+0000","last_fullsized":"2024-03-12T17:18:46.947674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:42:22.754824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.948191+0000","last_change":"2024-03-12T17:18:45.863039+0000","last_active":"2024-03-12T17:18:46.948191+0000","last_peered":"2024-03-12T17:18:46.948191+0000","last_clean":"2024-03-12T17:18:46.948191+0000","last_became_active":"2024-03-12T17:18:45.862844+0000","last_became_peered":"2024-03-12T17:18:45.862844+0000","last_unstale":"2024-03-12T17:18:46.948191+0000","last_undegraded":"2024-03-12T17:18:46.948191+0000","last_fullsized":"2024-03-12T17:18:46.948191+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:23:06.063091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944953+0000","last_change":"2024-03-12T17:18:45.885881+0000","last_active":"2024-03-12T17:18:46.944953+0000","last_peered":"2024-03-12T17:18:46.944953+0000","last_clean":"2024-03-12T17:18:46.944953+0000","last_became_active":"2024-03-12T17:18:45.885609+0000","last_became_peered":"2024-03-12T17:18:45.885609+0000","last_unstale":"2024-03-12T17:18:46.944953+0000","last_undegraded":"2024-03-12T17:18:46.944953+0000","last_fullsized":"2024-03-12T17:18:46.944953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:45:08.333283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857415+0000","last_change":"2024-03-12T17:18:45.871970+0000","last_active":"2024-03-12T17:18:46.857415+0000","last_peered":"2024-03-12T17:18:46.857415+0000","last_clean":"2024-03-12T17:18:46.857415+0000","last_became_active":"2024-03-12T17:18:45.868988+0000","last_became_peered":"2024-03-12T17:18:45.868988+0000","last_unstale":"2024-03-12T17:18:46.857415+0000","last_undegraded":"2024-03-12T17:18:46.857415+0000","last_fullsized":"2024-03-12T17:18:46.857415+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:10:29.099400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.859788+0000","last_change":"2024-03-12T17:18:45.899893+0000","last_active":"2024-03-12T17:18:46.859788+0000","last_peered":"2024-03-12T17:18:46.859788+0000","last_clean":"2024-03-12T17:18:46.859788+0000","last_became_active":"2024-03-12T17:18:45.899578+0000","last_became_peered":"2024-03-12T17:18:45.899578+0000","last_unstale":"2024-03-12T17:18:46.859788+0000","last_undegraded":"2024-03-12T17:18:46.859788+0000","last_fullsized":"2024-03-12T17:18:46.859788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:36:07.517436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.854019+0000","last_change":"2024-03-12T17:18:45.890825+0000","last_active":"2024-03-12T17:18:46.854019+0000","last_peered":"2024-03-12T17:18:46.854019+0000","last_clean":"2024-03-12T17:18:46.854019+0000","last_became_active":"2024-03-12T17:18:45.890508+0000","last_became_peered":"2024-03-12T17:18:45.890508+0000","last_unstale":"2024-03-12T17:18:46.854019+0000","last_undegraded":"2024-03-12T17:18:46.854019+0000","last_fullsized":"2024-03-12T17:18:46.854019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:54:36.712407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858619+0000","last_change":"2024-03-12T17:18:45.896948+0000","last_active":"2024-03-12T17:18:46.858619+0000","last_peered":"2024-03-12T17:18:46.858619+0000","last_clean":"2024-03-12T17:18:46.858619+0000","last_became_active":"2024-03-12T17:18:45.896617+0000","last_became_peered":"2024-03-12T17:18:45.896617+0000","last_unstale":"2024-03-12T17:18:46.858619+0000","last_undegraded":"2024-03-12T17:18:46.858619+0000","last_fullsized":"2024-03-12T17:18:46.858619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:34:35.638243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944492+0000","last_change":"2024-03-12T17:18:45.892628+0000","last_active":"2024-03-12T17:18:46.944492+0000","last_peered":"2024-03-12T17:18:46.944492+0000","last_clean":"2024-03-12T17:18:46.944492+0000","last_became_active":"2024-03-12T17:18:45.892322+0000","last_became_peered":"2024-03-12T17:18:45.892322+0000","last_unstale":"2024-03-12T17:18:46.944492+0000","last_undegraded":"2024-03-12T17:18:46.944492+0000","last_fullsized":"2024-03-12T17:18:46.944492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:48:29.172720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.946982+0000","last_change":"2024-03-12T17:18:45.891015+0000","last_active":"2024-03-12T17:18:46.946982+0000","last_peered":"2024-03-12T17:18:46.946982+0000","last_clean":"2024-03-12T17:18:46.946982+0000","last_became_active":"2024-03-12T17:18:45.890711+0000","last_became_peered":"2024-03-12T17:18:45.890711+0000","last_unstale":"2024-03-12T17:18:46.946982+0000","last_undegraded":"2024-03-12T17:18:46.946982+0000","last_fullsized":"2024-03-12T17:18:46.946982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:45:08.333283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857744+0000","last_change":"2024-03-12T17:18:45.893500+0000","last_active":"2024-03-12T17:18:46.857744+0000","last_peered":"2024-03-12T17:18:46.857744+0000","last_clean":"2024-03-12T17:18:46.857744+0000","last_became_active":"2024-03-12T17:18:45.893188+0000","last_became_peered":"2024-03-12T17:18:45.893188+0000","last_unstale":"2024-03-12T17:18:46.857744+0000","last_undegraded":"2024-03-12T17:18:46.857744+0000","last_fullsized":"2024-03-12T17:18:46.857744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:34:35.638243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947702+0000","last_change":"2024-03-12T17:18:45.890189+0000","last_active":"2024-03-12T17:18:46.947702+0000","last_peered":"2024-03-12T17:18:46.947702+0000","last_clean":"2024-03-12T17:18:46.947702+0000","last_became_active":"2024-03-12T17:18:45.889243+0000","last_became_peered":"2024-03-12T17:18:45.889243+0000","last_unstale":"2024-03-12T17:18:46.947702+0000","last_undegraded":"2024-03-12T17:18:46.947702+0000","last_fullsized":"2024-03-12T17:18:46.947702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:23:06.063091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.856808+0000","last_change":"2024-03-12T17:18:45.879908+0000","last_active":"2024-03-12T17:18:46.856808+0000","last_peered":"2024-03-12T17:18:46.856808+0000","last_clean":"2024-03-12T17:18:46.856808+0000","last_became_active":"2024-03-12T17:18:45.879061+0000","last_became_peered":"2024-03-12T17:18:45.879061+0000","last_unstale":"2024-03-12T17:18:46.856808+0000","last_undegraded":"2024-03-12T17:18:46.856808+0000","last_fullsized":"2024-03-12T17:18:46.856808+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:21:11.051648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947866+0000","last_change":"2024-03-12T17:18:45.876848+0000","last_active":"2024-03-12T17:18:46.947866+0000","last_peered":"2024-03-12T17:18:46.947866+0000","last_clean":"2024-03-12T17:18:46.947866+0000","last_became_active":"2024-03-12T17:18:45.876658+0000","last_became_peered":"2024-03-12T17:18:45.876658+0000","last_unstale":"2024-03-12T17:18:46.947866+0000","last_undegraded":"2024-03-12T17:18:46.947866+0000","last_fullsized":"2024-03-12T17:18:46.947866+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:15:10.118237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.945388+0000","last_change":"2024-03-12T17:18:45.897934+0000","last_active":"2024-03-12T17:18:46.945388+0000","last_peered":"2024-03-12T17:18:46.945388+0000","last_clean":"2024-03-12T17:18:46.945388+0000","last_became_active":"2024-03-12T17:18:45.897632+0000","last_became_peered":"2024-03-12T17:18:45.897632+0000","last_unstale":"2024-03-12T17:18:46.945388+0000","last_undegraded":"2024-03-12T17:18:46.945388+0000","last_fullsized":"2024-03-12T17:18:46.945388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:23:06.063091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.945707+0000","last_change":"2024-03-12T17:18:45.882068+0000","last_active":"2024-03-12T17:18:46.945707+0000","last_peered":"2024-03-12T17:18:46.945707+0000","last_clean":"2024-03-12T17:18:46.945707+0000","last_became_active":"2024-03-12T17:18:45.881609+0000","last_became_peered":"2024-03-12T17:18:45.881609+0000","last_unstale":"2024-03-12T17:18:46.945707+0000","last_undegraded":"2024-03-12T17:18:46.945707+0000","last_fullsized":"2024-03-12T17:18:46.945707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:42:22.754824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947829+0000","last_change":"2024-03-12T17:18:45.875604+0000","last_active":"2024-03-12T17:18:46.947829+0000","last_peered":"2024-03-12T17:18:46.947829+0000","last_clean":"2024-03-12T17:18:46.947829+0000","last_became_active":"2024-03-12T17:18:45.875300+0000","last_became_peered":"2024-03-12T17:18:45.875300+0000","last_unstale":"2024-03-12T17:18:46.947829+0000","last_undegraded":"2024-03-12T17:18:46.947829+0000","last_fullsized":"2024-03-12T17:18:46.947829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:24:13.883507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947088+0000","last_change":"2024-03-12T17:18:45.879642+0000","last_active":"2024-03-12T17:18:46.947088+0000","last_peered":"2024-03-12T17:18:46.947088+0000","last_clean":"2024-03-12T17:18:46.947088+0000","last_became_active":"2024-03-12T17:18:45.879390+0000","last_became_peered":"2024-03-12T17:18:45.879390+0000","last_unstale":"2024-03-12T17:18:46.947088+0000","last_undegraded":"2024-03-12T17:18:46.947088+0000","last_fullsized":"2024-03-12T17:18:46.947088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:25:10.176932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857915+0000","last_change":"2024-03-12T17:18:45.878596+0000","last_active":"2024-03-12T17:18:46.857915+0000","last_peered":"2024-03-12T17:18:46.857915+0000","last_clean":"2024-03-12T17:18:46.857915+0000","last_became_active":"2024-03-12T17:18:45.878223+0000","last_became_peered":"2024-03-12T17:18:45.878223+0000","last_unstale":"2024-03-12T17:18:46.857915+0000","last_undegraded":"2024-03-12T17:18:46.857915+0000","last_fullsized":"2024-03-12T17:18:46.857915+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:42:22.754824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.853503+0000","last_change":"2024-03-12T17:18:45.869021+0000","last_active":"2024-03-12T17:18:46.853503+0000","last_peered":"2024-03-12T17:18:46.853503+0000","last_clean":"2024-03-12T17:18:46.853503+0000","last_became_active":"2024-03-12T17:18:45.868790+0000","last_became_peered":"2024-03-12T17:18:45.868790+0000","last_unstale":"2024-03-12T17:18:46.853503+0000","last_undegraded":"2024-03-12T17:18:46.853503+0000","last_fullsized":"2024-03-12T17:18:46.853503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:20:31.313923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944482+0000","last_change":"2024-03-12T17:18:45.886248+0000","last_active":"2024-03-12T17:18:46.944482+0000","last_peered":"2024-03-12T17:18:46.944482+0000","last_clean":"2024-03-12T17:18:46.944482+0000","last_became_active":"2024-03-12T17:18:45.885636+0000","last_became_peered":"2024-03-12T17:18:45.885636+0000","last_unstale":"2024-03-12T17:18:46.944482+0000","last_undegraded":"2024-03-12T17:18:46.944482+0000","last_fullsized":"2024-03-12T17:18:46.944482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:10:25.044042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.945966+0000","last_change":"2024-03-12T17:18:45.878245+0000","last_active":"2024-03-12T17:18:46.945966+0000","last_peered":"2024-03-12T17:18:46.945966+0000","last_clean":"2024-03-12T17:18:46.945966+0000","last_became_active":"2024-03-12T17:18:45.874458+0000","last_became_peered":"2024-03-12T17:18:45.874458+0000","last_unstale":"2024-03-12T17:18:46.945966+0000","last_undegraded":"2024-03-12T17:18:46.945966+0000","last_fullsized":"2024-03-12T17:18:46.945966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:32:01.111631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947680+0000","last_change":"2024-03-12T17:18:45.375951+0000","last_active":"2024-03-12T17:18:46.947680+0000","last_peered":"2024-03-12T17:18:46.947680+0000","last_clean":"2024-03-12T17:18:46.947680+0000","last_became_active":"2024-03-12T17:18:45.375616+0000","last_became_peered":"2024-03-12T17:18:45.375616+0000","last_unstale":"2024-03-12T17:18:46.947680+0000","last_undegraded":"2024-03-12T17:18:46.947680+0000","last_fullsized":"2024-03-12T17:18:46.947680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:07:53.768009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947190+0000","last_change":"2024-03-12T17:18:45.883654+0000","last_active":"2024-03-12T17:18:46.947190+0000","last_peered":"2024-03-12T17:18:46.947190+0000","last_clean":"2024-03-12T17:18:46.947190+0000","last_became_active":"2024-03-12T17:18:45.883247+0000","last_became_peered":"2024-03-12T17:18:45.883247+0000","last_unstale":"2024-03-12T17:18:46.947190+0000","last_undegraded":"2024-03-12T17:18:46.947190+0000","last_fullsized":"2024-03-12T17:18:46.947190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:24:13.883507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944269+0000","last_change":"2024-03-12T17:18:45.377143+0000","last_active":"2024-03-12T17:18:46.944269+0000","last_peered":"2024-03-12T17:18:46.944269+0000","last_clean":"2024-03-12T17:18:46.944269+0000","last_became_active":"2024-03-12T17:18:45.376587+0000","last_became_peered":"2024-03-12T17:18:45.376587+0000","last_unstale":"2024-03-12T17:18:46.944269+0000","last_undegraded":"2024-03-12T17:18:46.944269+0000","last_fullsized":"2024-03-12T17:18:46.944269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:12:48.811874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947685+0000","last_change":"2024-03-12T17:18:45.368141+0000","last_active":"2024-03-12T17:18:46.947685+0000","last_peered":"2024-03-12T17:18:46.947685+0000","last_clean":"2024-03-12T17:18:46.947685+0000","last_became_active":"2024-03-12T17:18:45.367922+0000","last_became_peered":"2024-03-12T17:18:45.367922+0000","last_unstale":"2024-03-12T17:18:46.947685+0000","last_undegraded":"2024-03-12T17:18:46.947685+0000","last_fullsized":"2024-03-12T17:18:46.947685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:23:50.392288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.946810+0000","last_change":"2024-03-12T17:18:45.864983+0000","last_active":"2024-03-12T17:18:46.946810+0000","last_peered":"2024-03-12T17:18:46.946810+0000","last_clean":"2024-03-12T17:18:46.946810+0000","last_became_active":"2024-03-12T17:18:45.864648+0000","last_became_peered":"2024-03-12T17:18:45.864648+0000","last_unstale":"2024-03-12T17:18:46.946810+0000","last_undegraded":"2024-03-12T17:18:46.946810+0000","last_fullsized":"2024-03-12T17:18:46.946810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:25:10.176932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857020+0000","last_change":"2024-03-12T17:18:45.365029+0000","last_active":"2024-03-12T17:18:46.857020+0000","last_peered":"2024-03-12T17:18:46.857020+0000","last_clean":"2024-03-12T17:18:46.857020+0000","last_became_active":"2024-03-12T17:18:45.364621+0000","last_became_peered":"2024-03-12T17:18:45.364621+0000","last_unstale":"2024-03-12T17:18:46.857020+0000","last_undegraded":"2024-03-12T17:18:46.857020+0000","last_fullsized":"2024-03-12T17:18:46.857020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:01:22.087219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944672+0000","last_change":"2024-03-12T17:18:45.879492+0000","last_active":"2024-03-12T17:18:46.944672+0000","last_peered":"2024-03-12T17:18:46.944672+0000","last_clean":"2024-03-12T17:18:46.944672+0000","last_became_active":"2024-03-12T17:18:45.879232+0000","last_became_peered":"2024-03-12T17:18:45.879232+0000","last_unstale":"2024-03-12T17:18:46.944672+0000","last_undegraded":"2024-03-12T17:18:46.944672+0000","last_fullsized":"2024-03-12T17:18:46.944672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:10:29.099400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.945211+0000","last_change":"2024-03-12T17:18:45.382641+0000","last_active":"2024-03-12T17:18:46.945211+0000","last_peered":"2024-03-12T17:18:46.945211+0000","last_clean":"2024-03-12T17:18:46.945211+0000","last_became_active":"2024-03-12T17:18:45.381871+0000","last_became_peered":"2024-03-12T17:18:45.381871+0000","last_unstale":"2024-03-12T17:18:46.945211+0000","last_undegraded":"2024-03-12T17:18:46.945211+0000","last_fullsized":"2024-03-12T17:18:46.945211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:07:53.768009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.859233+0000","last_change":"2024-03-12T17:18:45.893641+0000","last_active":"2024-03-12T17:18:46.859233+0000","last_peered":"2024-03-12T17:18:46.859233+0000","last_clean":"2024-03-12T17:18:46.859233+0000","last_became_active":"2024-03-12T17:18:45.893285+0000","last_became_peered":"2024-03-12T17:18:45.893285+0000","last_unstale":"2024-03-12T17:18:46.859233+0000","last_undegraded":"2024-03-12T17:18:46.859233+0000","last_fullsized":"2024-03-12T17:18:46.859233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:15:10.118237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.859238+0000","last_change":"2024-03-12T17:18:45.376164+0000","last_active":"2024-03-12T17:18:46.859238+0000","last_peered":"2024-03-12T17:18:46.859238+0000","last_clean":"2024-03-12T17:18:46.859238+0000","last_became_active":"2024-03-12T17:18:45.374280+0000","last_became_peered":"2024-03-12T17:18:45.374280+0000","last_unstale":"2024-03-12T17:18:46.859238+0000","last_undegraded":"2024-03-12T17:18:46.859238+0000","last_fullsized":"2024-03-12T17:18:46.859238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:23:50.392288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.949144+0000","last_change":"2024-03-12T17:18:45.878892+0000","last_active":"2024-03-12T17:18:46.949144+0000","last_peered":"2024-03-12T17:18:46.949144+0000","last_clean":"2024-03-12T17:18:46.949144+0000","last_became_active":"2024-03-12T17:18:45.878651+0000","last_became_peered":"2024-03-12T17:18:45.878651+0000","last_unstale":"2024-03-12T17:18:46.949144+0000","last_undegraded":"2024-03-12T17:18:46.949144+0000","last_fullsized":"2024-03-12T17:18:46.949144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:10:25.044042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.945945+0000","last_change":"2024-03-12T17:18:45.382325+0000","last_active":"2024-03-12T17:18:46.945945+0000","last_peered":"2024-03-12T17:18:46.945945+0000","last_clean":"2024-03-12T17:18:46.945945+0000","last_became_active":"2024-03-12T17:18:45.382056+0000","last_became_peered":"2024-03-12T17:18:45.382056+0000","last_unstale":"2024-03-12T17:18:46.945945+0000","last_undegraded":"2024-03-12T17:18:46.945945+0000","last_fullsized":"2024-03-12T17:18:46.945945+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:35:28.129493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.946639+0000","last_change":"2024-03-12T17:18:45.895888+0000","last_active":"2024-03-12T17:18:46.946639+0000","last_peered":"2024-03-12T17:18:46.946639+0000","last_clean":"2024-03-12T17:18:46.946639+0000","last_became_active":"2024-03-12T17:18:45.895314+0000","last_became_peered":"2024-03-12T17:18:45.895314+0000","last_unstale":"2024-03-12T17:18:46.946639+0000","last_undegraded":"2024-03-12T17:18:46.946639+0000","last_fullsized":"2024-03-12T17:18:46.946639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:28:48.535350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944549+0000","last_change":"2024-03-12T17:18:45.381040+0000","last_active":"2024-03-12T17:18:46.944549+0000","last_peered":"2024-03-12T17:18:46.944549+0000","last_clean":"2024-03-12T17:18:46.944549+0000","last_became_active":"2024-03-12T17:18:45.380400+0000","last_became_peered":"2024-03-12T17:18:45.380400+0000","last_unstale":"2024-03-12T17:18:46.944549+0000","last_undegraded":"2024-03-12T17:18:46.944549+0000","last_fullsized":"2024-03-12T17:18:46.944549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:48:10.442245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857838+0000","last_change":"2024-03-12T17:18:45.896661+0000","last_active":"2024-03-12T17:18:46.857838+0000","last_peered":"2024-03-12T17:18:46.857838+0000","last_clean":"2024-03-12T17:18:46.857838+0000","last_became_active":"2024-03-12T17:18:45.896381+0000","last_became_peered":"2024-03-12T17:18:45.896381+0000","last_unstale":"2024-03-12T17:18:46.857838+0000","last_undegraded":"2024-03-12T17:18:46.857838+0000","last_fullsized":"2024-03-12T17:18:46.857838+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:17:13.547169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947292+0000","last_change":"2024-03-12T17:18:45.365459+0000","last_active":"2024-03-12T17:18:46.947292+0000","last_peered":"2024-03-12T17:18:46.947292+0000","last_clean":"2024-03-12T17:18:46.947292+0000","last_became_active":"2024-03-12T17:18:45.365123+0000","last_became_peered":"2024-03-12T17:18:45.365123+0000","last_unstale":"2024-03-12T17:18:46.947292+0000","last_undegraded":"2024-03-12T17:18:46.947292+0000","last_fullsized":"2024-03-12T17:18:46.947292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:12:45.021044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.948430+0000","last_change":"2024-03-12T17:18:45.888078+0000","last_active":"2024-03-12T17:18:46.948430+0000","last_peered":"2024-03-12T17:18:46.948430+0000","last_clean":"2024-03-12T17:18:46.948430+0000","last_became_active":"2024-03-12T17:18:45.887793+0000","last_became_peered":"2024-03-12T17:18:45.887793+0000","last_unstale":"2024-03-12T17:18:46.948430+0000","last_undegraded":"2024-03-12T17:18:46.948430+0000","last_fullsized":"2024-03-12T17:18:46.948430+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:17:33.168888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858044+0000","last_change":"2024-03-12T17:18:45.378988+0000","last_active":"2024-03-12T17:18:46.858044+0000","last_peered":"2024-03-12T17:18:46.858044+0000","last_clean":"2024-03-12T17:18:46.858044+0000","last_became_active":"2024-03-12T17:18:45.378697+0000","last_became_peered":"2024-03-12T17:18:45.378697+0000","last_unstale":"2024-03-12T17:18:46.858044+0000","last_undegraded":"2024-03-12T17:18:46.858044+0000","last_fullsized":"2024-03-12T17:18:46.858044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:07:53.768009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857986+0000","last_change":"2024-03-12T17:18:45.899356+0000","last_active":"2024-03-12T17:18:46.857986+0000","last_peered":"2024-03-12T17:18:46.857986+0000","last_clean":"2024-03-12T17:18:46.857986+0000","last_became_active":"2024-03-12T17:18:45.899010+0000","last_became_peered":"2024-03-12T17:18:45.899010+0000","last_unstale":"2024-03-12T17:18:46.857986+0000","last_undegraded":"2024-03-12T17:18:46.857986+0000","last_fullsized":"2024-03-12T17:18:46.857986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:05:09.374271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944237+0000","last_change":"2024-03-12T17:18:45.376515+0000","last_active":"2024-03-12T17:18:46.944237+0000","last_peered":"2024-03-12T17:18:46.944237+0000","last_clean":"2024-03-12T17:18:46.944237+0000","last_became_active":"2024-03-12T17:18:45.376229+0000","last_became_peered":"2024-03-12T17:18:45.376229+0000","last_unstale":"2024-03-12T17:18:46.944237+0000","last_undegraded":"2024-03-12T17:18:46.944237+0000","last_fullsized":"2024-03-12T17:18:46.944237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:33:40.644061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944239+0000","last_change":"2024-03-12T17:18:45.885557+0000","last_active":"2024-03-12T17:18:46.944239+0000","last_peered":"2024-03-12T17:18:46.944239+0000","last_clean":"2024-03-12T17:18:46.944239+0000","last_became_active":"2024-03-12T17:18:45.885214+0000","last_became_peered":"2024-03-12T17:18:45.885214+0000","last_unstale":"2024-03-12T17:18:46.944239+0000","last_undegraded":"2024-03-12T17:18:46.944239+0000","last_fullsized":"2024-03-12T17:18:46.944239+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:56:38.943678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.853537+0000","last_change":"2024-03-12T17:18:45.368912+0000","last_active":"2024-03-12T17:18:46.853537+0000","last_peered":"2024-03-12T17:18:46.853537+0000","last_clean":"2024-03-12T17:18:46.853537+0000","last_became_active":"2024-03-12T17:18:45.368576+0000","last_became_peered":"2024-03-12T17:18:45.368576+0000","last_unstale":"2024-03-12T17:18:46.853537+0000","last_undegraded":"2024-03-12T17:18:46.853537+0000","last_fullsized":"2024-03-12T17:18:46.853537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:23:50.392288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857414+0000","last_change":"2024-03-12T17:18:45.898975+0000","last_active":"2024-03-12T17:18:46.857414+0000","last_peered":"2024-03-12T17:18:46.857414+0000","last_clean":"2024-03-12T17:18:46.857414+0000","last_became_active":"2024-03-12T17:18:45.898704+0000","last_became_peered":"2024-03-12T17:18:45.898704+0000","last_unstale":"2024-03-12T17:18:46.857414+0000","last_undegraded":"2024-03-12T17:18:46.857414+0000","last_fullsized":"2024-03-12T17:18:46.857414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:42:22.754824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.946552+0000","last_change":"2024-03-12T17:18:45.366523+0000","last_active":"2024-03-12T17:18:46.946552+0000","last_peered":"2024-03-12T17:18:46.946552+0000","last_clean":"2024-03-12T17:18:46.946552+0000","last_became_active":"2024-03-12T17:18:45.366135+0000","last_became_peered":"2024-03-12T17:18:45.366135+0000","last_unstale":"2024-03-12T17:18:46.946552+0000","last_undegraded":"2024-03-12T17:18:46.946552+0000","last_fullsized":"2024-03-12T17:18:46.946552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T00:52:36.901043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858186+0000","last_change":"2024-03-12T17:18:45.898571+0000","last_active":"2024-03-12T17:18:46.858186+0000","last_peered":"2024-03-12T17:18:46.858186+0000","last_clean":"2024-03-12T17:18:46.858186+0000","last_became_active":"2024-03-12T17:18:45.898306+0000","last_became_peered":"2024-03-12T17:18:45.898306+0000","last_unstale":"2024-03-12T17:18:46.858186+0000","last_undegraded":"2024-03-12T17:18:46.858186+0000","last_fullsized":"2024-03-12T17:18:46.858186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:15:10.118237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.854032+0000","last_change":"2024-03-12T17:18:45.373982+0000","last_active":"2024-03-12T17:18:46.854032+0000","last_peered":"2024-03-12T17:18:46.854032+0000","last_clean":"2024-03-12T17:18:46.854032+0000","last_became_active":"2024-03-12T17:18:45.373647+0000","last_became_peered":"2024-03-12T17:18:45.373647+0000","last_unstale":"2024-03-12T17:18:46.854032+0000","last_undegraded":"2024-03-12T17:18:46.854032+0000","last_fullsized":"2024-03-12T17:18:46.854032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:07:53.768009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.859231+0000","last_change":"2024-03-12T17:18:45.903054+0000","last_active":"2024-03-12T17:18:46.859231+0000","last_peered":"2024-03-12T17:18:46.859231+0000","last_clean":"2024-03-12T17:18:46.859231+0000","last_became_active":"2024-03-12T17:18:45.902762+0000","last_became_peered":"2024-03-12T17:18:45.902762+0000","last_unstale":"2024-03-12T17:18:46.859231+0000","last_undegraded":"2024-03-12T17:18:46.859231+0000","last_fullsized":"2024-03-12T17:18:46.859231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:41:17.395467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.946192+0000","last_change":"2024-03-12T17:18:45.377581+0000","last_active":"2024-03-12T17:18:46.946192+0000","last_peered":"2024-03-12T17:18:46.946192+0000","last_clean":"2024-03-12T17:18:46.946192+0000","last_became_active":"2024-03-12T17:18:45.373688+0000","last_became_peered":"2024-03-12T17:18:45.373688+0000","last_unstale":"2024-03-12T17:18:46.946192+0000","last_undegraded":"2024-03-12T17:18:46.946192+0000","last_fullsized":"2024-03-12T17:18:46.946192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:31:59.966986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858775+0000","last_change":"2024-03-12T17:18:45.879835+0000","last_active":"2024-03-12T17:18:46.858775+0000","last_peered":"2024-03-12T17:18:46.858775+0000","last_clean":"2024-03-12T17:18:46.858775+0000","last_became_active":"2024-03-12T17:18:45.879498+0000","last_became_peered":"2024-03-12T17:18:45.879498+0000","last_unstale":"2024-03-12T17:18:46.858775+0000","last_undegraded":"2024-03-12T17:18:46.858775+0000","last_fullsized":"2024-03-12T17:18:46.858775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:41:17.395467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.853981+0000","last_change":"2024-03-12T17:18:45.376596+0000","last_active":"2024-03-12T17:18:46.853981+0000","last_peered":"2024-03-12T17:18:46.853981+0000","last_clean":"2024-03-12T17:18:46.853981+0000","last_became_active":"2024-03-12T17:18:45.376256+0000","last_became_peered":"2024-03-12T17:18:45.376256+0000","last_unstale":"2024-03-12T17:18:46.853981+0000","last_undegraded":"2024-03-12T17:18:46.853981+0000","last_fullsized":"2024-03-12T17:18:46.853981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:29:41.118150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858115+0000","last_change":"2024-03-12T17:18:45.900428+0000","last_active":"2024-03-12T17:18:46.858115+0000","last_peered":"2024-03-12T17:18:46.858115+0000","last_clean":"2024-03-12T17:18:46.858115+0000","last_became_active":"2024-03-12T17:18:45.900179+0000","last_became_peered":"2024-03-12T17:18:45.900179+0000","last_unstale":"2024-03-12T17:18:46.858115+0000","last_undegraded":"2024-03-12T17:18:46.858115+0000","last_fullsized":"2024-03-12T17:18:46.858115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:38:05.092463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":164,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-12T17:18:45.881910+0000","last_change":"2024-03-12T17:18:41.331756+0000","last_active":"2024-03-12T17:18:45.881910+0000","last_peered":"2024-03-12T17:18:45.881910+0000","last_clean":"2024-03-12T17:18:45.881910+0000","last_became_active":"2024-03-12T17:18:41.329237+0000","last_became_peered":"2024-03-12T17:18:41.329237+0000","last_unstale":"2024-03-12T17:18:45.881910+0000","last_undegraded":"2024-03-12T17:18:45.881910+0000","last_fullsized":"2024-03-12T17:18:45.881910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:40.152422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:40.152422+0000","last_clean_scrub_stamp":"2024-03-12T17:18:40.152422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:35:43.664403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857578+0000","last_change":"2024-03-12T17:18:45.367331+0000","last_active":"2024-03-12T17:18:46.857578+0000","last_peered":"2024-03-12T17:18:46.857578+0000","last_clean":"2024-03-12T17:18:46.857578+0000","last_became_active":"2024-03-12T17:18:45.367018+0000","last_became_peered":"2024-03-12T17:18:45.367018+0000","last_unstale":"2024-03-12T17:18:46.857578+0000","last_undegraded":"2024-03-12T17:18:46.857578+0000","last_fullsized":"2024-03-12T17:18:46.857578+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:12:48.811874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947416+0000","last_change":"2024-03-12T17:18:45.870828+0000","last_active":"2024-03-12T17:18:46.947416+0000","last_peered":"2024-03-12T17:18:46.947416+0000","last_clean":"2024-03-12T17:18:46.947416+0000","last_became_active":"2024-03-12T17:18:45.870373+0000","last_became_peered":"2024-03-12T17:18:45.870373+0000","last_unstale":"2024-03-12T17:18:46.947416+0000","last_undegraded":"2024-03-12T17:18:46.947416+0000","last_fullsized":"2024-03-12T17:18:46.947416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:17:33.168888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.856696+0000","last_change":"2024-03-12T17:18:45.379833+0000","last_active":"2024-03-12T17:18:46.856696+0000","last_peered":"2024-03-12T17:18:46.856696+0000","last_clean":"2024-03-12T17:18:46.856696+0000","last_became_active":"2024-03-12T17:18:45.379554+0000","last_became_peered":"2024-03-12T17:18:45.379554+0000","last_unstale":"2024-03-12T17:18:46.856696+0000","last_undegraded":"2024-03-12T17:18:46.856696+0000","last_fullsized":"2024-03-12T17:18:46.856696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:23:50.392288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.949504+0000","last_change":"2024-03-12T17:18:45.885222+0000","last_active":"2024-03-12T17:18:46.949504+0000","last_peered":"2024-03-12T17:18:46.949504+0000","last_clean":"2024-03-12T17:18:46.949504+0000","last_became_active":"2024-03-12T17:18:45.883636+0000","last_became_peered":"2024-03-12T17:18:45.883636+0000","last_unstale":"2024-03-12T17:18:46.949504+0000","last_undegraded":"2024-03-12T17:18:46.949504+0000","last_fullsized":"2024-03-12T17:18:46.949504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:54:36.712407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.853528+0000","last_change":"2024-03-12T17:18:45.364610+0000","last_active":"2024-03-12T17:18:46.853528+0000","last_peered":"2024-03-12T17:18:46.853528+0000","last_clean":"2024-03-12T17:18:46.853528+0000","last_became_active":"2024-03-12T17:18:45.364255+0000","last_became_peered":"2024-03-12T17:18:45.364255+0000","last_unstale":"2024-03-12T17:18:46.853528+0000","last_undegraded":"2024-03-12T17:18:46.853528+0000","last_fullsized":"2024-03-12T17:18:46.853528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:12:48.811874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944834+0000","last_change":"2024-03-12T17:18:45.857097+0000","last_active":"2024-03-12T17:18:46.944834+0000","last_peered":"2024-03-12T17:18:46.944834+0000","last_clean":"2024-03-12T17:18:46.944834+0000","last_became_active":"2024-03-12T17:18:45.856205+0000","last_became_peered":"2024-03-12T17:18:45.856205+0000","last_unstale":"2024-03-12T17:18:46.944834+0000","last_undegraded":"2024-03-12T17:18:46.944834+0000","last_fullsized":"2024-03-12T17:18:46.944834+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:24:13.883507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858257+0000","last_change":"2024-03-12T17:18:45.371153+0000","last_active":"2024-03-12T17:18:46.858257+0000","last_peered":"2024-03-12T17:18:46.858257+0000","last_clean":"2024-03-12T17:18:46.858257+0000","last_became_active":"2024-03-12T17:18:45.369025+0000","last_became_peered":"2024-03-12T17:18:45.369025+0000","last_unstale":"2024-03-12T17:18:46.858257+0000","last_undegraded":"2024-03-12T17:18:46.858257+0000","last_fullsized":"2024-03-12T17:18:46.858257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:20:41.753321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.946051+0000","last_change":"2024-03-12T17:18:45.888296+0000","last_active":"2024-03-12T17:18:46.946051+0000","last_peered":"2024-03-12T17:18:46.946051+0000","last_clean":"2024-03-12T17:18:46.946051+0000","last_became_active":"2024-03-12T17:18:45.886034+0000","last_became_peered":"2024-03-12T17:18:45.886034+0000","last_unstale":"2024-03-12T17:18:46.946051+0000","last_undegraded":"2024-03-12T17:18:46.946051+0000","last_fullsized":"2024-03-12T17:18:46.946051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:35:49.382412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944808+0000","last_change":"2024-03-12T17:18:45.373944+0000","last_active":"2024-03-12T17:18:46.944808+0000","last_peered":"2024-03-12T17:18:46.944808+0000","last_clean":"2024-03-12T17:18:46.944808+0000","last_became_active":"2024-03-12T17:18:45.372641+0000","last_became_peered":"2024-03-12T17:18:45.372641+0000","last_unstale":"2024-03-12T17:18:46.944808+0000","last_undegraded":"2024-03-12T17:18:46.944808+0000","last_fullsized":"2024-03-12T17:18:46.944808+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:29:41.118150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858537+0000","last_change":"2024-03-12T17:18:45.881154+0000","last_active":"2024-03-12T17:18:46.858537+0000","last_peered":"2024-03-12T17:18:46.858537+0000","last_clean":"2024-03-12T17:18:46.858537+0000","last_became_active":"2024-03-12T17:18:45.880178+0000","last_became_peered":"2024-03-12T17:18:45.880178+0000","last_unstale":"2024-03-12T17:18:46.858537+0000","last_undegraded":"2024-03-12T17:18:46.858537+0000","last_fullsized":"2024-03-12T17:18:46.858537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:17:33.168888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858695+0000","last_change":"2024-03-12T17:18:45.384960+0000","last_active":"2024-03-12T17:18:46.858695+0000","last_peered":"2024-03-12T17:18:46.858695+0000","last_clean":"2024-03-12T17:18:46.858695+0000","last_became_active":"2024-03-12T17:18:45.384751+0000","last_became_peered":"2024-03-12T17:18:45.384751+0000","last_unstale":"2024-03-12T17:18:46.858695+0000","last_undegraded":"2024-03-12T17:18:46.858695+0000","last_fullsized":"2024-03-12T17:18:46.858695+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:35:48.237768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944647+0000","last_change":"2024-03-12T17:18:45.856343+0000","last_active":"2024-03-12T17:18:46.944647+0000","last_peered":"2024-03-12T17:18:46.944647+0000","last_clean":"2024-03-12T17:18:46.944647+0000","last_became_active":"2024-03-12T17:18:45.856040+0000","last_became_peered":"2024-03-12T17:18:45.856040+0000","last_unstale":"2024-03-12T17:18:46.944647+0000","last_undegraded":"2024-03-12T17:18:46.944647+0000","last_fullsized":"2024-03-12T17:18:46.944647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:23:06.063091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:48.520105+0000","last_change":"2024-03-12T17:18:45.378083+0000","last_active":"2024-03-12T17:18:48.520105+0000","last_peered":"2024-03-12T17:18:48.520105+0000","last_clean":"2024-03-12T17:18:48.520105+0000","last_became_active":"2024-03-12T17:18:45.377137+0000","last_became_peered":"2024-03-12T17:18:45.377137+0000","last_unstale":"2024-03-12T17:18:48.520105+0000","last_undegraded":"2024-03-12T17:18:48.520105+0000","last_fullsized":"2024-03-12T17:18:48.520105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:28:47.390706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.948100+0000","last_change":"2024-03-12T17:18:45.889958+0000","last_active":"2024-03-12T17:18:46.948100+0000","last_peered":"2024-03-12T17:18:46.948100+0000","last_clean":"2024-03-12T17:18:46.948100+0000","last_became_active":"2024-03-12T17:18:45.889667+0000","last_became_peered":"2024-03-12T17:18:45.889667+0000","last_unstale":"2024-03-12T17:18:46.948100+0000","last_undegraded":"2024-03-12T17:18:46.948100+0000","last_fullsized":"2024-03-12T17:18:46.948100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:21:11.051648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.945277+0000","last_change":"2024-03-12T17:18:45.382531+0000","last_active":"2024-03-12T17:18:46.945277+0000","last_peered":"2024-03-12T17:18:46.945277+0000","last_clean":"2024-03-12T17:18:46.945277+0000","last_became_active":"2024-03-12T17:18:45.381932+0000","last_became_peered":"2024-03-12T17:18:45.381932+0000","last_unstale":"2024-03-12T17:18:46.945277+0000","last_undegraded":"2024-03-12T17:18:46.945277+0000","last_fullsized":"2024-03-12T17:18:46.945277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:20:41.753321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.948605+0000","last_change":"2024-03-12T17:18:45.861290+0000","last_active":"2024-03-12T17:18:46.948605+0000","last_peered":"2024-03-12T17:18:46.948605+0000","last_clean":"2024-03-12T17:18:46.948605+0000","last_became_active":"2024-03-12T17:18:45.860724+0000","last_became_peered":"2024-03-12T17:18:45.860724+0000","last_unstale":"2024-03-12T17:18:46.948605+0000","last_undegraded":"2024-03-12T17:18:46.948605+0000","last_fullsized":"2024-03-12T17:18:46.948605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:48:29.172720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.856696+0000","last_change":"2024-03-12T17:18:45.384765+0000","last_active":"2024-03-12T17:18:46.856696+0000","last_peered":"2024-03-12T17:18:46.856696+0000","last_clean":"2024-03-12T17:18:46.856696+0000","last_became_active":"2024-03-12T17:18:45.384463+0000","last_became_peered":"2024-03-12T17:18:45.384463+0000","last_unstale":"2024-03-12T17:18:46.856696+0000","last_undegraded":"2024-03-12T17:18:46.856696+0000","last_fullsized":"2024-03-12T17:18:46.856696+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:29:41.118150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.946022+0000","last_change":"2024-03-12T17:18:45.883260+0000","last_active":"2024-03-12T17:18:46.946022+0000","last_peered":"2024-03-12T17:18:46.946022+0000","last_clean":"2024-03-12T17:18:46.946022+0000","last_became_active":"2024-03-12T17:18:45.882864+0000","last_became_peered":"2024-03-12T17:18:45.882864+0000","last_unstale":"2024-03-12T17:18:46.946022+0000","last_undegraded":"2024-03-12T17:18:46.946022+0000","last_fullsized":"2024-03-12T17:18:46.946022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:07:54.912653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.945167+0000","last_change":"2024-03-12T17:18:45.380347+0000","last_active":"2024-03-12T17:18:46.945167+0000","last_peered":"2024-03-12T17:18:46.945167+0000","last_clean":"2024-03-12T17:18:46.945167+0000","last_became_active":"2024-03-12T17:18:45.378500+0000","last_became_peered":"2024-03-12T17:18:45.378500+0000","last_unstale":"2024-03-12T17:18:46.945167+0000","last_undegraded":"2024-03-12T17:18:46.945167+0000","last_fullsized":"2024-03-12T17:18:46.945167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:52:30.297945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.946901+0000","last_change":"2024-03-12T17:18:45.876651+0000","last_active":"2024-03-12T17:18:46.946901+0000","last_peered":"2024-03-12T17:18:46.946901+0000","last_clean":"2024-03-12T17:18:46.946901+0000","last_became_active":"2024-03-12T17:18:45.875075+0000","last_became_peered":"2024-03-12T17:18:45.875075+0000","last_unstale":"2024-03-12T17:18:46.946901+0000","last_undegraded":"2024-03-12T17:18:46.946901+0000","last_fullsized":"2024-03-12T17:18:46.946901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:41:17.395467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944618+0000","last_change":"2024-03-12T17:18:45.380761+0000","last_active":"2024-03-12T17:18:46.944618+0000","last_peered":"2024-03-12T17:18:46.944618+0000","last_clean":"2024-03-12T17:18:46.944618+0000","last_became_active":"2024-03-12T17:18:45.379967+0000","last_became_peered":"2024-03-12T17:18:45.379967+0000","last_unstale":"2024-03-12T17:18:46.944618+0000","last_undegraded":"2024-03-12T17:18:46.944618+0000","last_fullsized":"2024-03-12T17:18:46.944618+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:35:48.237768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.947573+0000","last_change":"2024-03-12T17:18:45.874583+0000","last_active":"2024-03-12T17:18:46.947573+0000","last_peered":"2024-03-12T17:18:46.947573+0000","last_clean":"2024-03-12T17:18:46.947573+0000","last_became_active":"2024-03-12T17:18:45.873218+0000","last_became_peered":"2024-03-12T17:18:45.873218+0000","last_unstale":"2024-03-12T17:18:46.947573+0000","last_undegraded":"2024-03-12T17:18:46.947573+0000","last_fullsized":"2024-03-12T17:18:46.947573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:10:29.099400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858419+0000","last_change":"2024-03-12T17:18:45.380027+0000","last_active":"2024-03-12T17:18:46.858419+0000","last_peered":"2024-03-12T17:18:46.858419+0000","last_clean":"2024-03-12T17:18:46.858419+0000","last_became_active":"2024-03-12T17:18:45.379670+0000","last_became_peered":"2024-03-12T17:18:45.379670+0000","last_unstale":"2024-03-12T17:18:46.858419+0000","last_undegraded":"2024-03-12T17:18:46.858419+0000","last_fullsized":"2024-03-12T17:18:46.858419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:31:59.966986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.944190+0000","last_change":"2024-03-12T17:18:45.892768+0000","last_active":"2024-03-12T17:18:46.944190+0000","last_peered":"2024-03-12T17:18:46.944190+0000","last_clean":"2024-03-12T17:18:46.944190+0000","last_became_active":"2024-03-12T17:18:45.890848+0000","last_became_peered":"2024-03-12T17:18:45.890848+0000","last_unstale":"2024-03-12T17:18:46.944190+0000","last_undegraded":"2024-03-12T17:18:46.944190+0000","last_fullsized":"2024-03-12T17:18:46.944190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:17:33.168888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858274+0000","last_change":"2024-03-12T17:18:45.885223+0000","last_active":"2024-03-12T17:18:46.858274+0000","last_peered":"2024-03-12T17:18:46.858274+0000","last_clean":"2024-03-12T17:18:46.858274+0000","last_became_active":"2024-03-12T17:18:45.884899+0000","last_became_peered":"2024-03-12T17:18:45.884899+0000","last_unstale":"2024-03-12T17:18:46.858274+0000","last_undegraded":"2024-03-12T17:18:46.858274+0000","last_fullsized":"2024-03-12T17:18:46.858274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:45:08.333283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.857514+0000","last_change":"2024-03-12T17:18:45.386513+0000","last_active":"2024-03-12T17:18:46.857514+0000","last_peered":"2024-03-12T17:18:46.857514+0000","last_clean":"2024-03-12T17:18:46.857514+0000","last_became_active":"2024-03-12T17:18:45.386189+0000","last_became_peered":"2024-03-12T17:18:45.386189+0000","last_unstale":"2024-03-12T17:18:46.857514+0000","last_undegraded":"2024-03-12T17:18:46.857514+0000","last_fullsized":"2024-03-12T17:18:46.857514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:35:28.129493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858523+0000","last_change":"2024-03-12T17:18:45.894835+0000","last_active":"2024-03-12T17:18:46.858523+0000","last_peered":"2024-03-12T17:18:46.858523+0000","last_clean":"2024-03-12T17:18:46.858523+0000","last_became_active":"2024-03-12T17:18:45.894485+0000","last_became_peered":"2024-03-12T17:18:45.894485+0000","last_unstale":"2024-03-12T17:18:46.858523+0000","last_undegraded":"2024-03-12T17:18:46.858523+0000","last_fullsized":"2024-03-12T17:18:46.858523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:48:29.172720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.858357+0000","last_change":"2024-03-12T17:18:45.384828+0000","last_active":"2024-03-12T17:18:46.858357+0000","last_peered":"2024-03-12T17:18:46.858357+0000","last_clean":"2024-03-12T17:18:46.858357+0000","last_became_active":"2024-03-12T17:18:45.384524+0000","last_became_peered":"2024-03-12T17:18:45.384524+0000","last_unstale":"2024-03-12T17:18:46.858357+0000","last_undegraded":"2024-03-12T17:18:46.858357+0000","last_fullsized":"2024-03-12T17:18:46.858357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:28:47.390706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.948954+0000","last_change":"2024-03-12T17:18:45.874183+0000","last_active":"2024-03-12T17:18:46.948954+0000","last_peered":"2024-03-12T17:18:46.948954+0000","last_clean":"2024-03-12T17:18:46.948954+0000","last_became_active":"2024-03-12T17:18:45.873893+0000","last_became_peered":"2024-03-12T17:18:45.873893+0000","last_unstale":"2024-03-12T17:18:46.948954+0000","last_undegraded":"2024-03-12T17:18:46.948954+0000","last_fullsized":"2024-03-12T17:18:46.948954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:42:22.352573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.948036+0000","last_change":"2024-03-12T17:18:45.377991+0000","last_active":"2024-03-12T17:18:46.948036+0000","last_peered":"2024-03-12T17:18:46.948036+0000","last_clean":"2024-03-12T17:18:46.948036+0000","last_became_active":"2024-03-12T17:18:45.375429+0000","last_became_peered":"2024-03-12T17:18:45.375429+0000","last_unstale":"2024-03-12T17:18:46.948036+0000","last_undegraded":"2024-03-12T17:18:46.948036+0000","last_fullsized":"2024-03-12T17:18:46.948036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:12:48.811874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.948053+0000","last_change":"2024-03-12T17:18:45.890541+0000","last_active":"2024-03-12T17:18:46.948053+0000","last_peered":"2024-03-12T17:18:46.948053+0000","last_clean":"2024-03-12T17:18:46.948053+0000","last_became_active":"2024-03-12T17:18:45.890352+0000","last_became_peered":"2024-03-12T17:18:45.890352+0000","last_unstale":"2024-03-12T17:18:46.948053+0000","last_undegraded":"2024-03-12T17:18:46.948053+0000","last_fullsized":"2024-03-12T17:18:46.948053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:45.322917+0000","last_clean_scrub_stamp":"2024-03-12T17:18:45.322917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:05:09.374271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-12T17:18:46.949344+0000","last_change":"2024-03-12T17:18:45.374531+0000","last_active":"2024-03-12T17:18:46.949344+0000","last_peered":"2024-03-12T17:18:46.949344+0000","last_clean":"2024-03-12T17:18:46.949344+0000","last_became_active":"2024-03-12T17:18:45.373202+0000","last_became_peered":"2024-03-12T17:18:45.373202+0000","last_unstale":"2024-03-12T17:18:46.949344+0000","last_undegraded":"2024-03-12T17:18:46.949344+0000","last_fullsized":"2024-03-12T17:18:46.949344+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:44.178273+0000","last_clean_scrub_stamp":"2024-03-12T17:18:44.178273+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:01:22.087219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":815104,"data_stored":666519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0629999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2969999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.534}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0960000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6539999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":229376,"data_stored":77133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.5390000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.631}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7749999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.198}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.278}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5840000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31340,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340500,"statfs":{"total":96636764160,"available":96604672000,"internally_reserved":0,"allocated":221184,"data_stored":75659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2749999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.478}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":229376,"data_stored":75695,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2869999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6879999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5680000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.474}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7649999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31348,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340492,"statfs":{"total":96636764160,"available":96604663808,"internally_reserved":0,"allocated":229376,"data_stored":77133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9580000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.476}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8860000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.843}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":217088,"data_stored":75569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1910000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2809999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.385}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.427}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.518}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.643}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31344,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340496,"statfs":{"total":96636764160,"available":96604667904,"internally_reserved":0,"allocated":225280,"data_stored":75729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.403}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.429}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.28}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.302}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32116,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339724,"statfs":{"total":96636764160,"available":96603877376,"internally_reserved":0,"allocated":823296,"data_stored":666575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.732}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.99}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.601}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9410000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5760000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.431}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-12T17:18:56.944 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-12T17:18:56.944 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-12T17:18:56.944 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-12T17:18:56.944 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-12T17:18:57.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.197+0000 7fb657e00640 1 Processor -- start 2024-03-12T17:18:57.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.197+0000 7fb657e00640 1 -- start start 2024-03-12T17:18:57.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.199+0000 7fb657e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb6581441f0 0x7fb658070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:57.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.199+0000 7fb657e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb65815ae20 0x7fb65806d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:57.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.199+0000 7fb657e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb6580b3b70 0x7fb6580b4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:57.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.199+0000 7fb657e00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6580b4540 con 0x7fb6581441f0 2024-03-12T17:18:57.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.199+0000 7fb657e00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb65815e460 con 0x7fb6580b3b70 2024-03-12T17:18:57.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.199+0000 7fb657e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6580a7660 con 0x7fb65815ae20 2024-03-12T17:18:57.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.199+0000 7fb656a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb6581441f0 0x7fb658070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:57.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.199+0000 7fb656a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb6581441f0 0x7fb658070240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38936/0 (socket says 172.21.15.17:38936) 2024-03-12T17:18:57.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.199+0000 7fb656a00640 1 -- 172.21.15.17:0/219398868 learned_addr learned my addr 172.21.15.17:0/219398868 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:57.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.199+0000 7fb657400640 1 --2- 172.21.15.17:0/219398868 >> v2:172.21.15.94:3300/0 conn(0x7fb6580b3b70 0x7fb6580b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:57.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.199+0000 7fb64fe00640 1 --2- 172.21.15.17:0/219398868 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb65815ae20 0x7fb65806d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:57.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.199+0000 7fb656a00640 1 -- 172.21.15.17:0/219398868 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb65815ae20 msgr2=0x7fb65806d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:57.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.199+0000 7fb656a00640 1 --2- 172.21.15.17:0/219398868 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb65815ae20 0x7fb65806d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:57.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.199+0000 7fb656a00640 1 -- 172.21.15.17:0/219398868 >> v2:172.21.15.94:3300/0 conn(0x7fb6580b3b70 msgr2=0x7fb6580b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:57.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.199+0000 7fb656a00640 1 --2- 172.21.15.17:0/219398868 >> v2:172.21.15.94:3300/0 conn(0x7fb6580b3b70 0x7fb6580b4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:57.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.199+0000 7fb656a00640 1 -- 172.21.15.17:0/219398868 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6581445d0 con 0x7fb6581441f0 2024-03-12T17:18:57.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.199+0000 7fb657400640 1 --2- 172.21.15.17:0/219398868 >> v2:172.21.15.94:3300/0 conn(0x7fb6580b3b70 0x7fb6580b4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:18:57.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.201+0000 7fb656a00640 1 --2- 172.21.15.17:0/219398868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6581441f0 0x7fb658070240 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb6580b4b00 tx=0x7fb64802b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14d21e328a30e91b server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:57.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.201+0000 7fb656000640 1 -- 172.21.15.17:0/219398868 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb648030850 con 0x7fb6581441f0 2024-03-12T17:18:57.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.201+0000 7fb656000640 1 -- 172.21.15.17:0/219398868 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6480309b0 con 0x7fb6581441f0 2024-03-12T17:18:57.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.201+0000 7fb656000640 1 -- 172.21.15.17:0/219398868 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb648030d40 con 0x7fb6581441f0 2024-03-12T17:18:57.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.201+0000 7fb657e00640 1 -- 172.21.15.17:0/219398868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6581441f0 msgr2=0x7fb658070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:57.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.201+0000 7fb657e00640 1 --2- 172.21.15.17:0/219398868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6581441f0 0x7fb658070240 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb6580b4b00 tx=0x7fb64802b990 comp rx=0 tx=0).stop 2024-03-12T17:18:57.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.202+0000 7fb657e00640 1 -- 172.21.15.17:0/219398868 shutdown_connections 2024-03-12T17:18:57.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.202+0000 7fb657e00640 1 --2- 172.21.15.17:0/219398868 >> v2:172.21.15.94:3300/0 conn(0x7fb6580b3b70 0x7fb6580b4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:57.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.202+0000 7fb657e00640 1 --2- 172.21.15.17:0/219398868 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb65815ae20 0x7fb65806d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:57.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.202+0000 7fb657e00640 1 --2- 172.21.15.17:0/219398868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb6581441f0 0x7fb658070240 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:57.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.202+0000 7fb657e00640 1 -- 172.21.15.17:0/219398868 >> 172.21.15.17:0/219398868 conn(0x7fb658069ce0 msgr2=0x7fb65806a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:57.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.202+0000 7fb657e00640 1 -- 172.21.15.17:0/219398868 shutdown_connections 2024-03-12T17:18:57.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.202+0000 7fb657e00640 1 -- 172.21.15.17:0/219398868 wait complete. 2024-03-12T17:18:57.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.204+0000 7fb657e00640 1 Processor -- start 2024-03-12T17:18:57.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.204+0000 7fb657e00640 1 -- start start 2024-03-12T17:18:57.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.205+0000 7fb657e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6580b3b70 0x7fb658141e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:57.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.205+0000 7fb657e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6581441f0 0x7fb6580b3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:57.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.205+0000 7fb657e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb65815ae20 0x7fb658159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:57.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.205+0000 7fb657e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6581f6540 con 0x7fb65815ae20 2024-03-12T17:18:57.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.205+0000 7fb657e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6581f58c0 con 0x7fb6581441f0 2024-03-12T17:18:57.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.205+0000 7fb657e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6581f5ba0 con 0x7fb6580b3b70 2024-03-12T17:18:57.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.205+0000 7fb657400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb65815ae20 0x7fb658159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:57.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.205+0000 7fb657400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb65815ae20 0x7fb658159e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38946/0 (socket says 172.21.15.17:38946) 2024-03-12T17:18:57.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.205+0000 7fb657400640 1 -- 172.21.15.17:0/3840371517 learned_addr learned my addr 172.21.15.17:0/3840371517 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:57.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.205+0000 7fb64fe00640 1 --2- 172.21.15.17:0/3840371517 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6581441f0 0x7fb6580b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:57.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.205+0000 7fb656a00640 1 --2- 172.21.15.17:0/3840371517 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6580b3b70 0x7fb658141e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:57.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.205+0000 7fb657400640 1 -- 172.21.15.17:0/3840371517 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6580b3b70 msgr2=0x7fb658141e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:57.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.205+0000 7fb657400640 1 --2- 172.21.15.17:0/3840371517 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6580b3b70 0x7fb658141e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:57.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.205+0000 7fb657400640 1 -- 172.21.15.17:0/3840371517 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6581441f0 msgr2=0x7fb6580b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:57.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.205+0000 7fb657400640 1 --2- 172.21.15.17:0/3840371517 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6581441f0 0x7fb6580b3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:57.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.205+0000 7fb657400640 1 -- 172.21.15.17:0/3840371517 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6480094d0 con 0x7fb65815ae20 2024-03-12T17:18:57.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.205+0000 7fb64fe00640 1 --2- 172.21.15.17:0/3840371517 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6581441f0 0x7fb6580b3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:18:57.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.206+0000 7fb657400640 1 --2- 172.21.15.17:0/3840371517 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb65815ae20 0x7fb658159e20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb65000cef0 tx=0x7fb65000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:57.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.206+0000 7fb64ea00640 1 -- 172.21.15.17:0/3840371517 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65000d840 con 0x7fb65815ae20 2024-03-12T17:18:57.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.206+0000 7fb64ea00640 1 -- 172.21.15.17:0/3840371517 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb65000d9a0 con 0x7fb65815ae20 2024-03-12T17:18:57.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.206+0000 7fb64ea00640 1 -- 172.21.15.17:0/3840371517 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65000dd50 con 0x7fb65815ae20 2024-03-12T17:18:57.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.206+0000 7fb657e00640 1 -- 172.21.15.17:0/3840371517 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6581f5e80 con 0x7fb65815ae20 2024-03-12T17:18:57.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.206+0000 7fb657e00640 1 -- 172.21.15.17:0/3840371517 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6580b2dd0 con 0x7fb65815ae20 2024-03-12T17:18:57.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.207+0000 7fb657e00640 1 -- 172.21.15.17:0/3840371517 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb65806d9d0 con 0x7fb65815ae20 2024-03-12T17:18:57.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.208+0000 7fb64ea00640 1 -- 172.21.15.17:0/3840371517 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fb65001e3b0 con 0x7fb65815ae20 2024-03-12T17:18:57.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.209+0000 7fb64ea00640 1 --2- 172.21.15.17:0/3840371517 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb63406ac00 0x7fb63406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:57.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.209+0000 7fb64ea00640 1 -- 172.21.15.17:0/3840371517 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb650089e70 con 0x7fb65815ae20 2024-03-12T17:18:57.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.209+0000 7fb656a00640 1 --2- 172.21.15.17:0/3840371517 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb63406ac00 0x7fb63406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:57.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.210+0000 7fb656a00640 1 --2- 172.21.15.17:0/3840371517 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb63406ac00 0x7fb63406d0c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb648036000 tx=0x7fb64803b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:57.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.213+0000 7fb64ea00640 1 -- 172.21.15.17:0/3840371517 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fb650054fb0 con 0x7fb65815ae20 2024-03-12T17:18:57.439 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.444+0000 7fb657e00640 1 -- 172.21.15.17:0/3840371517 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb6581f6680 con 0x7fb65815ae20 2024-03-12T17:18:57.440 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.445+0000 7fb64ea00640 1 -- 172.21.15.17:0/3840371517 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fb6581f6680 con 0x7fb65815ae20 2024-03-12T17:18:57.440 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:18:57.440 INFO:teuthology.orchestra.run.smithi017.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-12T17:18:57.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.447+0000 7fb657e00640 1 -- 172.21.15.17:0/3840371517 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb63406ac00 msgr2=0x7fb63406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:57.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.447+0000 7fb657e00640 1 --2- 172.21.15.17:0/3840371517 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb63406ac00 0x7fb63406d0c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb648036000 tx=0x7fb64803b040 comp rx=0 tx=0).stop 2024-03-12T17:18:57.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.447+0000 7fb657e00640 1 -- 172.21.15.17:0/3840371517 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb65815ae20 msgr2=0x7fb658159e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:57.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.447+0000 7fb657e00640 1 --2- 172.21.15.17:0/3840371517 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb65815ae20 0x7fb658159e20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb65000cef0 tx=0x7fb65000a710 comp rx=0 tx=0).stop 2024-03-12T17:18:57.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.448+0000 7fb657e00640 1 -- 172.21.15.17:0/3840371517 shutdown_connections 2024-03-12T17:18:57.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.448+0000 7fb657e00640 1 --2- 172.21.15.17:0/3840371517 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb63406ac00 0x7fb63406d0c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:57.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.448+0000 7fb657e00640 1 --2- 172.21.15.17:0/3840371517 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb65815ae20 0x7fb658159e20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:57.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.448+0000 7fb657e00640 1 --2- 172.21.15.17:0/3840371517 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb6581441f0 0x7fb6580b3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:57.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.448+0000 7fb657e00640 1 --2- 172.21.15.17:0/3840371517 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb6580b3b70 0x7fb658141e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:57.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.448+0000 7fb657e00640 1 -- 172.21.15.17:0/3840371517 >> 172.21.15.17:0/3840371517 conn(0x7fb658069ce0 msgr2=0x7fb6580ae540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:57.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.448+0000 7fb657e00640 1 -- 172.21.15.17:0/3840371517 shutdown_connections 2024-03-12T17:18:57.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.448+0000 7fb657e00640 1 -- 172.21.15.17:0/3840371517 wait complete. 2024-03-12T17:18:57.461 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-12T17:18:57.461 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T17:18:57.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.681+0000 7f3f4f200640 1 Processor -- start 2024-03-12T17:18:57.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.682+0000 7f3f4f200640 1 -- start start 2024-03-12T17:18:57.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.683+0000 7f3f4f200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3f50098eb0 0x7f3f500b1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:57.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.683+0000 7f3f4f200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f5006adf0 con 0x7f3f5015ca50 2024-03-12T17:18:57.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.683+0000 7f3f4f200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f500ccca0 con 0x7f3f50098a60 2024-03-12T17:18:57.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.683+0000 7f3f4f200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f5006b0b0 con 0x7f3f50098eb0 2024-03-12T17:18:57.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.683+0000 7f3f4de00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f3f5015ca50 0x7f3f500cc220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37014/0 (socket says 172.21.15.17:37014) 2024-03-12T17:18:57.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.683+0000 7f3f4de00640 1 -- 172.21.15.17:0/1149759794 learned_addr learned my addr 172.21.15.17:0/1149759794 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:18:57.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.683+0000 7f3f4e800640 1 --2- 172.21.15.17:0/1149759794 >> v2:172.21.15.17:3300/0 conn(0x7f3f50098eb0 0x7f3f500b1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:57.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.684+0000 7f3f4e800640 1 -- 172.21.15.17:0/1149759794 >> v1:172.21.15.94:6789/0 conn(0x7f3f50098a60 legacy=0x7f3f500b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:57.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.684+0000 7f3f4e800640 1 -- 172.21.15.17:0/1149759794 >> v1:172.21.15.17:6789/0 conn(0x7f3f5015ca50 legacy=0x7f3f500cc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:57.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.684+0000 7f3f4e800640 1 -- 172.21.15.17:0/1149759794 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5006b390 con 0x7f3f50098eb0 2024-03-12T17:18:57.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.684+0000 7f3f4d400640 1 -- 172.21.15.17:0/1149759794 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3186127812 0 0) 0x7f3f5006adf0 con 0x7f3f5015ca50 2024-03-12T17:18:57.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.685+0000 7f3f4e800640 1 --2- 172.21.15.17:0/1149759794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f50098eb0 0x7f3f500b1960 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3f48009d90 tx=0x7f3f4802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a4546fc2b5b2e18 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:57.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.685+0000 7f3f4d400640 1 -- 172.21.15.17:0/1149759794 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4802cd00 con 0x7f3f50098eb0 2024-03-12T17:18:57.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.685+0000 7f3f4d400640 1 -- 172.21.15.17:0/1149759794 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4802ce60 con 0x7f3f50098eb0 2024-03-12T17:18:57.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.685+0000 7f3f4d400640 1 -- 172.21.15.17:0/1149759794 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f48034660 con 0x7f3f50098eb0 2024-03-12T17:18:57.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.685+0000 7f3f4f200640 1 -- 172.21.15.17:0/1149759794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f50098eb0 msgr2=0x7f3f500b1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:57.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.685+0000 7f3f4f200640 1 --2- 172.21.15.17:0/1149759794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f50098eb0 0x7f3f500b1960 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3f48009d90 tx=0x7f3f4802bf50 comp rx=0 tx=0).stop 2024-03-12T17:18:57.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.686+0000 7f3f4f200640 1 -- 172.21.15.17:0/1149759794 shutdown_connections 2024-03-12T17:18:57.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.686+0000 7f3f4f200640 1 --2- 172.21.15.17:0/1149759794 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f50098eb0 0x7f3f500b1960 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:57.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.686+0000 7f3f4f200640 1 -- 172.21.15.17:0/1149759794 >> 172.21.15.17:0/1149759794 conn(0x7f3f500b2180 msgr2=0x7f3f500b2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:57.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.686+0000 7f3f4f200640 1 -- 172.21.15.17:0/1149759794 shutdown_connections 2024-03-12T17:18:57.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.686+0000 7f3f4f200640 1 -- 172.21.15.17:0/1149759794 wait complete. 2024-03-12T17:18:57.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.687+0000 7f3f4f200640 1 Processor -- start 2024-03-12T17:18:57.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.688+0000 7f3f4f200640 1 -- start start 2024-03-12T17:18:57.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.688+0000 7f3f4f200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f50098a60 0x7f3f5015f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:57.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.689+0000 7f3f4f200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3f50098eb0 0x7f3f5015af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:57.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.689+0000 7f3f4f200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f5015ca50 0x7f3f500b4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:57.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.689+0000 7f3f4f200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5015cee0 con 0x7f3f5015ca50 2024-03-12T17:18:57.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.689+0000 7f3f4f200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5015fd70 con 0x7f3f50098a60 2024-03-12T17:18:57.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.689+0000 7f3f4f200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f500ca320 con 0x7f3f50098eb0 2024-03-12T17:18:57.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.689+0000 7f3f4e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f5015ca50 0x7f3f500b4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:57.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.689+0000 7f3f4e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f5015ca50 0x7f3f500b4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38966/0 (socket says 172.21.15.17:38966) 2024-03-12T17:18:57.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.689+0000 7f3f4e800640 1 -- 172.21.15.17:0/153395413 learned_addr learned my addr 172.21.15.17:0/153395413 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:57.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.689+0000 7f3f4de00640 1 --2- 172.21.15.17:0/153395413 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f50098a60 0x7f3f5015f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:57.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.689+0000 7f3f4e800640 1 -- 172.21.15.17:0/153395413 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3f50098eb0 msgr2=0x7f3f5015af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:57.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.689+0000 7f3f45400640 1 --2- 172.21.15.17:0/153395413 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3f50098eb0 0x7f3f5015af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:57.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.689+0000 7f3f4e800640 1 --2- 172.21.15.17:0/153395413 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3f50098eb0 0x7f3f5015af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:57.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.689+0000 7f3f4e800640 1 -- 172.21.15.17:0/153395413 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f50098a60 msgr2=0x7f3f5015f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:57.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.689+0000 7f3f4e800640 1 --2- 172.21.15.17:0/153395413 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f50098a60 0x7f3f5015f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:57.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.689+0000 7f3f4e800640 1 -- 172.21.15.17:0/153395413 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f48009a70 con 0x7f3f5015ca50 2024-03-12T17:18:57.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.689+0000 7f3f4de00640 1 --2- 172.21.15.17:0/153395413 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f50098a60 0x7f3f5015f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:18:57.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.690+0000 7f3f4e800640 1 --2- 172.21.15.17:0/153395413 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f5015ca50 0x7f3f500b4430 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3f48009d90 tx=0x7f3f48004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:57.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.690+0000 7f3f46a00640 1 -- 172.21.15.17:0/153395413 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4803e670 con 0x7f3f5015ca50 2024-03-12T17:18:57.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.690+0000 7f3f46a00640 1 -- 172.21.15.17:0/153395413 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4803e7f0 con 0x7f3f5015ca50 2024-03-12T17:18:57.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.690+0000 7f3f4f200640 1 -- 172.21.15.17:0/153395413 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f500ca600 con 0x7f3f5015ca50 2024-03-12T17:18:57.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.690+0000 7f3f46a00640 1 -- 172.21.15.17:0/153395413 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4803eba0 con 0x7f3f5015ca50 2024-03-12T17:18:57.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.690+0000 7f3f4f200640 1 -- 172.21.15.17:0/153395413 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f5015d0f0 con 0x7f3f5015ca50 2024-03-12T17:18:57.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.691+0000 7f3f4f200640 1 -- 172.21.15.17:0/153395413 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f5015d2e0 con 0x7f3f5015ca50 2024-03-12T17:18:57.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.692+0000 7f3f46a00640 1 -- 172.21.15.17:0/153395413 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f3f4803b040 con 0x7f3f5015ca50 2024-03-12T17:18:57.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.693+0000 7f3f46a00640 1 --2- 172.21.15.17:0/153395413 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f3f2c06ac30 0x7f3f2c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:57.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.693+0000 7f3f46a00640 1 -- 172.21.15.17:0/153395413 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f480abb90 con 0x7f3f5015ca50 2024-03-12T17:18:57.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.693+0000 7f3f4de00640 1 --2- 172.21.15.17:0/153395413 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f3f2c06ac30 0x7f3f2c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:57.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.694+0000 7f3f4de00640 1 --2- 172.21.15.17:0/153395413 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f3f2c06ac30 0x7f3f2c06d0f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3f40000f60 tx=0x7f3f40009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:57.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.697+0000 7f3f46a00640 1 -- 172.21.15.17:0/153395413 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f3f48076d70 con 0x7f3f5015ca50 2024-03-12T17:18:57.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.899+0000 7f3f4f200640 1 -- 172.21.15.17:0/153395413 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f500aff70 con 0x7f3f5015ca50 2024-03-12T17:18:57.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.901+0000 7f3f46a00640 1 -- 172.21.15.17:0/153395413 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15989 (secure 0 0 0) 0x7f3f48039090 con 0x7f3f5015ca50 2024-03-12T17:18:57.897 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:18:57.897 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":21,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:18:46.845635+0000","last_up_change":"2024-03-12T17:18:38.144756+0000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-12T17:18:39.552910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-12T17:18:43.794908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-12T17:18:44.867006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":37305},{"type":"v1","addr":"172.21.15.17:6801","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":37305},{"type":"v1","addr":"172.21.15.17:6803","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":37305},{"type":"v1","addr":"172.21.15.17:6807","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":37305},{"type":"v1","addr":"172.21.15.17:6805","nonce":37305}]},"public_addr":"172.21.15.17:6801/37305","cluster_addr":"172.21.15.17:6803/37305","heartbeat_back_addr":"172.21.15.17:6807/37305","heartbeat_front_addr":"172.21.15.17:6805/37305","state":["exists","up"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":37307},{"type":"v1","addr":"172.21.15.17:6814","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":37307},{"type":"v1","addr":"172.21.15.17:6818","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":37307},{"type":"v1","addr":"172.21.15.17:6827","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":37307},{"type":"v1","addr":"172.21.15.17:6823","nonce":37307}]},"public_addr":"172.21.15.17:6814/37307","cluster_addr":"172.21.15.17:6818/37307","heartbeat_back_addr":"172.21.15.17:6827/37307","heartbeat_front_addr":"172.21.15.17:6823/37307","state":["exists","up"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":37303},{"type":"v1","addr":"172.21.15.17:6809","nonce":37303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":37303},{"type":"v1","addr":"172.21.15.17:6811","nonce":37303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":37303},{"type":"v1","addr":"172.21.15.17:6819","nonce":37303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":37303},{"type":"v1","addr":"172.21.15.17:6815","nonce":37303}]},"public_addr":"172.21.15.17:6809/37303","cluster_addr":"172.21.15.17:6811/37303","heartbeat_back_addr":"172.21.15.17:6819/37303","heartbeat_front_addr":"172.21.15.17:6815/37303","state":["exists","up"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":37308},{"type":"v1","addr":"172.21.15.17:6822","nonce":37308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":37308},{"type":"v1","addr":"172.21.15.17:6826","nonce":37308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":37308},{"type":"v1","addr":"172.21.15.17:6831","nonce":37308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":37308},{"type":"v1","addr":"172.21.15.17:6829","nonce":37308}]},"public_addr":"172.21.15.17:6822/37308","cluster_addr":"172.21.15.17:6826/37308","heartbeat_back_addr":"172.21.15.17:6831/37308","heartbeat_front_addr":"172.21.15.17:6829/37308","state":["exists","up"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":37465},{"type":"v1","addr":"172.21.15.94:6809","nonce":37465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6811","nonce":37465},{"type":"v1","addr":"172.21.15.94:6813","nonce":37465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6819","nonce":37465},{"type":"v1","addr":"172.21.15.94:6822","nonce":37465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6815","nonce":37465},{"type":"v1","addr":"172.21.15.94:6817","nonce":37465}]},"public_addr":"172.21.15.94:6809/37465","cluster_addr":"172.21.15.94:6813/37465","heartbeat_back_addr":"172.21.15.94:6822/37465","heartbeat_front_addr":"172.21.15.94:6817/37465","state":["exists","up"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":37464},{"type":"v1","addr":"172.21.15.94:6812","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":37464},{"type":"v1","addr":"172.21.15.94:6816","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":37464},{"type":"v1","addr":"172.21.15.94:6823","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":37464},{"type":"v1","addr":"172.21.15.94:6820","nonce":37464}]},"public_addr":"172.21.15.94:6812/37464","cluster_addr":"172.21.15.94:6816/37464","heartbeat_back_addr":"172.21.15.94:6823/37464","heartbeat_front_addr":"172.21.15.94:6820/37464","state":["exists","up"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":37467},{"type":"v1","addr":"172.21.15.94:6825","nonce":37467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":37467},{"type":"v1","addr":"172.21.15.94:6827","nonce":37467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":37467},{"type":"v1","addr":"172.21.15.94:6831","nonce":37467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":37467},{"type":"v1","addr":"172.21.15.94:6829","nonce":37467}]},"public_addr":"172.21.15.94:6825/37467","cluster_addr":"172.21.15.94:6827/37467","heartbeat_back_addr":"172.21.15.94:6831/37467","heartbeat_front_addr":"172.21.15.94:6829/37467","state":["exists","up"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":37466},{"type":"v1","addr":"172.21.15.94:6801","nonce":37466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":37466},{"type":"v1","addr":"172.21.15.94:6803","nonce":37466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":37466},{"type":"v1","addr":"172.21.15.94:6807","nonce":37466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":37466},{"type":"v1","addr":"172.21.15.94:6805","nonce":37466}]},"public_addr":"172.21.15.94:6801/37466","cluster_addr":"172.21.15.94:6803/37466","heartbeat_back_addr":"172.21.15.94:6807/37466","heartbeat_front_addr":"172.21.15.94:6805/37466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.327217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.186966+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.419986+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.150585+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.120621+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.121576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.181257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.293188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:18:57.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.904+0000 7f3f4f200640 1 -- 172.21.15.17:0/153395413 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f3f2c06ac30 msgr2=0x7f3f2c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:57.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.904+0000 7f3f4f200640 1 --2- 172.21.15.17:0/153395413 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f3f2c06ac30 0x7f3f2c06d0f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3f40000f60 tx=0x7f3f40009040 comp rx=0 tx=0).stop 2024-03-12T17:18:57.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.904+0000 7f3f4f200640 1 -- 172.21.15.17:0/153395413 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f5015ca50 msgr2=0x7f3f500b4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:57.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.904+0000 7f3f4f200640 1 --2- 172.21.15.17:0/153395413 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f5015ca50 0x7f3f500b4430 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3f48009d90 tx=0x7f3f48004a40 comp rx=0 tx=0).stop 2024-03-12T17:18:57.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.904+0000 7f3f4f200640 1 -- 172.21.15.17:0/153395413 shutdown_connections 2024-03-12T17:18:57.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.904+0000 7f3f4f200640 1 --2- 172.21.15.17:0/153395413 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f3f2c06ac30 0x7f3f2c06d0f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:57.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.904+0000 7f3f4f200640 1 --2- 172.21.15.17:0/153395413 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3f5015ca50 0x7f3f500b4430 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:57.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.904+0000 7f3f4f200640 1 --2- 172.21.15.17:0/153395413 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3f50098eb0 0x7f3f5015af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:57.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.904+0000 7f3f4f200640 1 --2- 172.21.15.17:0/153395413 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3f50098a60 0x7f3f5015f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:57.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.904+0000 7f3f4f200640 1 -- 172.21.15.17:0/153395413 >> 172.21.15.17:0/153395413 conn(0x7f3f500b2180 msgr2=0x7f3f500cc010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:57.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.905+0000 7f3f4f200640 1 -- 172.21.15.17:0/153395413 shutdown_connections 2024-03-12T17:18:57.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:57.905+0000 7f3f4f200640 1 -- 172.21.15.17:0/153395413 wait complete. 2024-03-12T17:18:57.917 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-12T17:18:39.552910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-12T17:18:43.794908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-12T17:18:44.867006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-12T17:18:57.917 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-12T17:18:58.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.127+0000 7ff523e00640 1 Processor -- start 2024-03-12T17:18:58.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.128+0000 7ff523e00640 1 -- start start 2024-03-12T17:18:58.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.129+0000 7ff523e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff5241441f0 0x7ff524070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:58.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.129+0000 7ff523e00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5240a7660 con 0x7ff5240b3b70 2024-03-12T17:18:58.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.129+0000 7ff523e00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5241445d0 con 0x7ff52415ae20 2024-03-12T17:18:58.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.129+0000 7ff523e00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff52415e460 con 0x7ff5241441f0 2024-03-12T17:18:58.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.130+0000 7ff523400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7ff5240b3b70 0x7ff5240b3f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37020/0 (socket says 172.21.15.17:37020) 2024-03-12T17:18:58.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.130+0000 7ff523400640 1 -- 172.21.15.17:0/2020807428 learned_addr learned my addr 172.21.15.17:0/2020807428 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:18:58.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.130+0000 7ff522a00640 1 --2- 172.21.15.17:0/2020807428 >> v2:172.21.15.94:3300/0 conn(0x7ff5241441f0 0x7ff524070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:58.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.130+0000 7ff521600640 1 -- 172.21.15.17:0/2020807428 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3128808929 0 0) 0x7ff5240a7660 con 0x7ff5240b3b70 2024-03-12T17:18:58.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.130+0000 7ff521600640 1 -- 172.21.15.17:0/2020807428 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff508003520 con 0x7ff5240b3b70 2024-03-12T17:18:58.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.131+0000 7ff521600640 1 -- 172.21.15.17:0/2020807428 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4183742013 0 0) 0x7ff508003520 con 0x7ff5240b3b70 2024-03-12T17:18:58.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.131+0000 7ff521600640 1 -- 172.21.15.17:0/2020807428 >> v2:172.21.15.94:3300/0 conn(0x7ff5241441f0 msgr2=0x7ff524070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:58.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.131+0000 7ff521600640 1 --2- 172.21.15.17:0/2020807428 >> v2:172.21.15.94:3300/0 conn(0x7ff5241441f0 0x7ff524070240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:58.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.131+0000 7ff521600640 1 -- 172.21.15.17:0/2020807428 >> v1:172.21.15.94:6789/0 conn(0x7ff52415ae20 legacy=0x7ff52406d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:58.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.131+0000 7ff521600640 1 -- 172.21.15.17:0/2020807428 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff52415b3e0 con 0x7ff5240b3b70 2024-03-12T17:18:58.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.131+0000 7ff521600640 1 -- 172.21.15.17:0/2020807428 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7ff51c0019f0 con 0x7ff5240b3b70 2024-03-12T17:18:58.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.131+0000 7ff522a00640 1 --2- 172.21.15.17:0/2020807428 >> v2:172.21.15.94:3300/0 conn(0x7ff5241441f0 0x7ff524070240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-12T17:18:58.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.131+0000 7ff521600640 1 -- 172.21.15.17:0/2020807428 >> v1:172.21.15.17:6789/0 conn(0x7ff5240b3b70 legacy=0x7ff5240b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:58.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.131+0000 7ff521600640 1 --2- 172.21.15.17:0/2020807428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5080039c0 0x7ff508003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:58.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.131+0000 7ff521600640 1 --2- 172.21.15.17:0/2020807428 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff5080047c0 0x7ff508004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:58.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.131+0000 7ff521600640 1 --2- 172.21.15.17:0/2020807428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff508005180 0x7ff50800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:58.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.131+0000 7ff521600640 1 -- 172.21.15.17:0/2020807428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52415e460 con 0x7ff508005180 2024-03-12T17:18:58.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.131+0000 7ff521600640 1 -- 172.21.15.17:0/2020807428 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50800c060 con 0x7ff5080039c0 2024-03-12T17:18:58.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.131+0000 7ff521600640 1 -- 172.21.15.17:0/2020807428 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50800c220 con 0x7ff5080047c0 2024-03-12T17:18:58.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.131+0000 7ff523400640 1 --2- 172.21.15.17:0/2020807428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff508005180 0x7ff50800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:58.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.131+0000 7ff522a00640 1 --2- 172.21.15.17:0/2020807428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5080039c0 0x7ff508003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:58.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.131+0000 7ff522000640 1 --2- 172.21.15.17:0/2020807428 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff5080047c0 0x7ff508004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:58.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.132+0000 7ff523400640 1 -- 172.21.15.17:0/2020807428 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff5080047c0 msgr2=0x7ff508004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:58.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.132+0000 7ff523400640 1 --2- 172.21.15.17:0/2020807428 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff5080047c0 0x7ff508004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:58.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.132+0000 7ff523400640 1 -- 172.21.15.17:0/2020807428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5080039c0 msgr2=0x7ff508003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:58.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.132+0000 7ff523400640 1 --2- 172.21.15.17:0/2020807428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5080039c0 0x7ff508003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:58.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.132+0000 7ff523400640 1 -- 172.21.15.17:0/2020807428 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff508003520 con 0x7ff508005180 2024-03-12T17:18:58.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.132+0000 7ff522a00640 1 --2- 172.21.15.17:0/2020807428 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff5080039c0 0x7ff508003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:18:58.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.133+0000 7ff523400640 1 -- 172.21.15.17:0/2020807428 reap_dead start 2024-03-12T17:18:58.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.133+0000 7ff523400640 1 --2- 172.21.15.17:0/2020807428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff508005180 0x7ff50800b980 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff51c00a760 tx=0x7ff5080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8682cc9a50844808 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:58.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.133+0000 7ff521600640 1 -- 172.21.15.17:0/2020807428 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51c034630 con 0x7ff508005180 2024-03-12T17:18:58.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.133+0000 7ff521600640 1 -- 172.21.15.17:0/2020807428 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51c02f070 con 0x7ff508005180 2024-03-12T17:18:58.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.133+0000 7ff521600640 1 -- 172.21.15.17:0/2020807428 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51c034a10 con 0x7ff508005180 2024-03-12T17:18:58.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.134+0000 7ff523e00640 1 -- 172.21.15.17:0/2020807428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff508005180 msgr2=0x7ff50800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:58.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.134+0000 7ff523e00640 1 --2- 172.21.15.17:0/2020807428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff508005180 0x7ff50800b980 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff51c00a760 tx=0x7ff5080057f0 comp rx=0 tx=0).stop 2024-03-12T17:18:58.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.134+0000 7ff523e00640 1 -- 172.21.15.17:0/2020807428 shutdown_connections 2024-03-12T17:18:58.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.134+0000 7ff523e00640 1 --2- 172.21.15.17:0/2020807428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff508005180 0x7ff50800b980 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:58.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.134+0000 7ff523e00640 1 -- 172.21.15.17:0/2020807428 >> 172.21.15.17:0/2020807428 conn(0x7ff524069ce0 msgr2=0x7ff52406a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:58.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.134+0000 7ff523e00640 1 -- 172.21.15.17:0/2020807428 shutdown_connections 2024-03-12T17:18:58.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.134+0000 7ff523e00640 1 -- 172.21.15.17:0/2020807428 wait complete. 2024-03-12T17:18:58.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.136+0000 7ff523e00640 1 Processor -- start 2024-03-12T17:18:58.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.136+0000 7ff523e00640 1 -- start start 2024-03-12T17:18:58.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.137+0000 7ff523e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff508005180 0x7ff524141470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:58.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.137+0000 7ff523e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff52413b410 0x7ff52413eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:58.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.137+0000 7ff523e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff52413c210 0x7ff52413c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:58.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.137+0000 7ff523e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff524141a50 con 0x7ff52413c210 2024-03-12T17:18:58.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.137+0000 7ff523e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff524141d30 con 0x7ff52413b410 2024-03-12T17:18:58.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.137+0000 7ff523e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff524142010 con 0x7ff508005180 2024-03-12T17:18:58.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.137+0000 7ff523400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff52413c210 0x7ff52413c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:58.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.137+0000 7ff523400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff52413c210 0x7ff52413c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38986/0 (socket says 172.21.15.17:38986) 2024-03-12T17:18:58.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.137+0000 7ff523400640 1 -- 172.21.15.17:0/3089840612 learned_addr learned my addr 172.21.15.17:0/3089840612 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:58.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.137+0000 7ff522000640 1 --2- 172.21.15.17:0/3089840612 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff52413b410 0x7ff52413eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:58.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.137+0000 7ff522a00640 1 --2- 172.21.15.17:0/3089840612 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff508005180 0x7ff524141470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:58.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.138+0000 7ff523400640 1 -- 172.21.15.17:0/3089840612 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff508005180 msgr2=0x7ff524141470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:58.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.138+0000 7ff523400640 1 --2- 172.21.15.17:0/3089840612 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff508005180 0x7ff524141470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:58.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.138+0000 7ff523400640 1 -- 172.21.15.17:0/3089840612 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff52413b410 msgr2=0x7ff52413eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:58.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.138+0000 7ff523400640 1 --2- 172.21.15.17:0/3089840612 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff52413b410 0x7ff52413eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:58.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.138+0000 7ff523400640 1 -- 172.21.15.17:0/3089840612 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5241422f0 con 0x7ff52413c210 2024-03-12T17:18:58.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.138+0000 7ff522000640 1 --2- 172.21.15.17:0/3089840612 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff52413b410 0x7ff52413eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:18:58.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.138+0000 7ff523400640 1 --2- 172.21.15.17:0/3089840612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff52413c210 0x7ff52413c690 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff51c002230 tx=0x7ff51c001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:58.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.138+0000 7ff51aa00640 1 -- 172.21.15.17:0/3089840612 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51c001930 con 0x7ff52413c210 2024-03-12T17:18:58.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.138+0000 7ff51aa00640 1 -- 172.21.15.17:0/3089840612 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51c004b60 con 0x7ff52413c210 2024-03-12T17:18:58.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.138+0000 7ff51aa00640 1 -- 172.21.15.17:0/3089840612 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51c0347b0 con 0x7ff52413c210 2024-03-12T17:18:58.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.138+0000 7ff523e00640 1 -- 172.21.15.17:0/3089840612 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5241425d0 con 0x7ff52413c210 2024-03-12T17:18:58.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.138+0000 7ff523e00640 1 -- 172.21.15.17:0/3089840612 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff52413f020 con 0x7ff52413c210 2024-03-12T17:18:58.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.139+0000 7ff523e00640 1 -- 172.21.15.17:0/3089840612 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff52404e030 con 0x7ff52413c210 2024-03-12T17:18:58.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.140+0000 7ff51aa00640 1 -- 172.21.15.17:0/3089840612 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7ff51c031030 con 0x7ff52413c210 2024-03-12T17:18:58.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.141+0000 7ff51aa00640 1 --2- 172.21.15.17:0/3089840612 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ff50406ac00 0x7ff50406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:58.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.141+0000 7ff51aa00640 1 -- 172.21.15.17:0/3089840612 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff51c0aa910 con 0x7ff52413c210 2024-03-12T17:18:58.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.141+0000 7ff522a00640 1 --2- 172.21.15.17:0/3089840612 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ff50406ac00 0x7ff50406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:58.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.142+0000 7ff522a00640 1 --2- 172.21.15.17:0/3089840612 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ff50406ac00 0x7ff50406d0c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff514009a40 tx=0x7ff514008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:58.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.146+0000 7ff51aa00640 1 -- 172.21.15.17:0/3089840612 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7ff51c0759c0 con 0x7ff52413c210 2024-03-12T17:18:58.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.341+0000 7ff523e00640 1 -- 172.21.15.17:0/3089840612 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff52404e030 con 0x7ff52413c210 2024-03-12T17:18:58.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.342+0000 7ff51aa00640 1 -- 172.21.15.17:0/3089840612 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff51c078fe0 con 0x7ff52413c210 2024-03-12T17:18:58.337 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-03-12T17:18:58.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.344+0000 7ff523e00640 1 -- 172.21.15.17:0/3089840612 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ff50406ac00 msgr2=0x7ff50406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:58.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.344+0000 7ff523e00640 1 --2- 172.21.15.17:0/3089840612 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ff50406ac00 0x7ff50406d0c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff514009a40 tx=0x7ff514008040 comp rx=0 tx=0).stop 2024-03-12T17:18:58.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.344+0000 7ff523e00640 1 -- 172.21.15.17:0/3089840612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff52413c210 msgr2=0x7ff52413c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:58.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.344+0000 7ff523e00640 1 --2- 172.21.15.17:0/3089840612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff52413c210 0x7ff52413c690 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff51c002230 tx=0x7ff51c001cb0 comp rx=0 tx=0).stop 2024-03-12T17:18:58.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.344+0000 7ff523e00640 1 -- 172.21.15.17:0/3089840612 shutdown_connections 2024-03-12T17:18:58.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.344+0000 7ff523e00640 1 --2- 172.21.15.17:0/3089840612 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ff50406ac00 0x7ff50406d0c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:58.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.344+0000 7ff523e00640 1 --2- 172.21.15.17:0/3089840612 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff52413c210 0x7ff52413c690 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:58.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.344+0000 7ff523e00640 1 --2- 172.21.15.17:0/3089840612 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff52413b410 0x7ff52413eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:58.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.344+0000 7ff523e00640 1 --2- 172.21.15.17:0/3089840612 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff508005180 0x7ff524141470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:58.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.344+0000 7ff523e00640 1 -- 172.21.15.17:0/3089840612 >> 172.21.15.17:0/3089840612 conn(0x7ff524069ce0 msgr2=0x7ff5240b1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:58.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.345+0000 7ff523e00640 1 -- 172.21.15.17:0/3089840612 shutdown_connections 2024-03-12T17:18:58.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.345+0000 7ff523e00640 1 -- 172.21.15.17:0/3089840612 wait complete. 2024-03-12T17:18:58.359 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-12T17:18:58.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.594+0000 7fde45200640 1 Processor -- start 2024-03-12T17:18:58.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.594+0000 7fde45200640 1 -- start start 2024-03-12T17:18:58.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.595+0000 7fde45200640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fde400702d0 0x7fde400706b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:58.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.596+0000 7fde45200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fde400cd210 0x7fde40143930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:58.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.596+0000 7fde45200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fde4015ace0 0x7fde400cb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:58.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.596+0000 7fde45200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde400af0c0 con 0x7fde400cd210 2024-03-12T17:18:58.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.596+0000 7fde45200640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde40070bf0 con 0x7fde400702d0 2024-03-12T17:18:58.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.596+0000 7fde45200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde400ae440 con 0x7fde4015ace0 2024-03-12T17:18:58.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.596+0000 7fde37e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fde400cd210 0x7fde40143930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:58.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.596+0000 7fde37e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fde400cd210 0x7fde40143930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38996/0 (socket says 172.21.15.17:38996) 2024-03-12T17:18:58.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.596+0000 7fde37e00640 1 -- 172.21.15.17:0/758859586 learned_addr learned my addr 172.21.15.17:0/758859586 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:58.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.596+0000 7fde3fe00640 1 --2- 172.21.15.17:0/758859586 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fde4015ace0 0x7fde400cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:58.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.596+0000 7fde3f400640 1 --2- 172.21.15.17:0/758859586 >> v2:172.21.15.94:3300/0 conn(0x7fde400702d0 0x7fde400706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:58.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.597+0000 7fde37e00640 1 -- 172.21.15.17:0/758859586 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fde4015ace0 msgr2=0x7fde400cb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:58.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.597+0000 7fde37e00640 1 --2- 172.21.15.17:0/758859586 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fde4015ace0 0x7fde400cb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:58.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.597+0000 7fde37e00640 1 -- 172.21.15.17:0/758859586 >> v2:172.21.15.94:3300/0 conn(0x7fde400702d0 msgr2=0x7fde400706b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:58.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.597+0000 7fde37e00640 1 --2- 172.21.15.17:0/758859586 >> v2:172.21.15.94:3300/0 conn(0x7fde400702d0 0x7fde400706b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:58.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.597+0000 7fde37e00640 1 -- 172.21.15.17:0/758859586 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde400ae720 con 0x7fde400cd210 2024-03-12T17:18:58.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.597+0000 7fde3fe00640 1 --2- 172.21.15.17:0/758859586 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fde4015ace0 0x7fde400cb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:18:58.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.597+0000 7fde3f400640 1 --2- 172.21.15.17:0/758859586 >> v2:172.21.15.94:3300/0 conn(0x7fde400702d0 0x7fde400706b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:18:58.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.598+0000 7fde37e00640 1 --2- 172.21.15.17:0/758859586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde400cd210 0x7fde40143930 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fde400b3cf0 tx=0x7fde2802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3579229a71b9ca4f server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:58.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.598+0000 7fde3ea00640 1 -- 172.21.15.17:0/758859586 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde28031870 con 0x7fde400cd210 2024-03-12T17:18:58.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.598+0000 7fde3ea00640 1 -- 172.21.15.17:0/758859586 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde280319d0 con 0x7fde400cd210 2024-03-12T17:18:58.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.598+0000 7fde3ea00640 1 -- 172.21.15.17:0/758859586 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde28031d60 con 0x7fde400cd210 2024-03-12T17:18:58.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.599+0000 7fde45200640 1 -- 172.21.15.17:0/758859586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde400cd210 msgr2=0x7fde40143930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:58.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.599+0000 7fde45200640 1 --2- 172.21.15.17:0/758859586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde400cd210 0x7fde40143930 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fde400b3cf0 tx=0x7fde2802b910 comp rx=0 tx=0).stop 2024-03-12T17:18:58.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.599+0000 7fde45200640 1 -- 172.21.15.17:0/758859586 shutdown_connections 2024-03-12T17:18:58.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.599+0000 7fde45200640 1 --2- 172.21.15.17:0/758859586 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fde4015ace0 0x7fde400cb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:58.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.599+0000 7fde45200640 1 --2- 172.21.15.17:0/758859586 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde400cd210 0x7fde40143930 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:58.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.599+0000 7fde45200640 1 --2- 172.21.15.17:0/758859586 >> v2:172.21.15.94:3300/0 conn(0x7fde400702d0 0x7fde400706b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:58.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.599+0000 7fde45200640 1 -- 172.21.15.17:0/758859586 >> 172.21.15.17:0/758859586 conn(0x7fde40066000 msgr2=0x7fde40069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:58.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.599+0000 7fde45200640 1 -- 172.21.15.17:0/758859586 shutdown_connections 2024-03-12T17:18:58.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.599+0000 7fde45200640 1 -- 172.21.15.17:0/758859586 wait complete. 2024-03-12T17:18:58.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.601+0000 7fde45200640 1 Processor -- start 2024-03-12T17:18:58.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.601+0000 7fde45200640 1 -- start start 2024-03-12T17:18:58.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.602+0000 7fde45200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde400702d0 0x7fde4013bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:58.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.602+0000 7fde45200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fde400cd210 0x7fde401f22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:58.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.602+0000 7fde45200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde4015ace0 0x7fde40141230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:58.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.602+0000 7fde45200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde400c43f0 con 0x7fde400702d0 2024-03-12T17:18:58.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.602+0000 7fde45200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde400c3840 con 0x7fde4015ace0 2024-03-12T17:18:58.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.602+0000 7fde45200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde4013c0b0 con 0x7fde400cd210 2024-03-12T17:18:58.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.602+0000 7fde3f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde400702d0 0x7fde4013bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:58.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.602+0000 7fde3f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde400702d0 0x7fde4013bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39010/0 (socket says 172.21.15.17:39010) 2024-03-12T17:18:58.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.602+0000 7fde3f400640 1 -- 172.21.15.17:0/2581904376 learned_addr learned my addr 172.21.15.17:0/2581904376 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:58.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.602+0000 7fde37e00640 1 --2- 172.21.15.17:0/2581904376 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fde400cd210 0x7fde401f22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:58.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.602+0000 7fde3fe00640 1 --2- 172.21.15.17:0/2581904376 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde4015ace0 0x7fde40141230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:58.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.602+0000 7fde3f400640 1 -- 172.21.15.17:0/2581904376 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fde400cd210 msgr2=0x7fde401f22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:58.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.602+0000 7fde3f400640 1 --2- 172.21.15.17:0/2581904376 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fde400cd210 0x7fde401f22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:58.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.602+0000 7fde3f400640 1 -- 172.21.15.17:0/2581904376 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde4015ace0 msgr2=0x7fde40141230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:58.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.603+0000 7fde3f400640 1 --2- 172.21.15.17:0/2581904376 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde4015ace0 0x7fde40141230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:58.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.603+0000 7fde3f400640 1 -- 172.21.15.17:0/2581904376 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde280094d0 con 0x7fde400702d0 2024-03-12T17:18:58.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.603+0000 7fde3f400640 1 --2- 172.21.15.17:0/2581904376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde400702d0 0x7fde4013bb70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fde3000e810 tx=0x7fde3000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:58.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.603+0000 7fde37400640 1 -- 172.21.15.17:0/2581904376 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde30004030 con 0x7fde400702d0 2024-03-12T17:18:58.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.603+0000 7fde37400640 1 -- 172.21.15.17:0/2581904376 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde30004190 con 0x7fde400702d0 2024-03-12T17:18:58.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.603+0000 7fde45200640 1 -- 172.21.15.17:0/2581904376 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde400c3a50 con 0x7fde400702d0 2024-03-12T17:18:58.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.603+0000 7fde37400640 1 -- 172.21.15.17:0/2581904376 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde30004520 con 0x7fde400702d0 2024-03-12T17:18:58.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.603+0000 7fde45200640 1 -- 172.21.15.17:0/2581904376 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde400c4010 con 0x7fde400702d0 2024-03-12T17:18:58.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.604+0000 7fde45200640 1 -- 172.21.15.17:0/2581904376 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde4004e030 con 0x7fde400702d0 2024-03-12T17:18:58.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.606+0000 7fde37400640 1 -- 172.21.15.17:0/2581904376 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fde3000c6d0 con 0x7fde400702d0 2024-03-12T17:18:58.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.606+0000 7fde37400640 1 --2- 172.21.15.17:0/2581904376 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fde1c06ac00 0x7fde1c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:58.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.606+0000 7fde37400640 1 -- 172.21.15.17:0/2581904376 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde30088ed0 con 0x7fde400702d0 2024-03-12T17:18:58.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.607+0000 7fde37e00640 1 --2- 172.21.15.17:0/2581904376 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fde1c06ac00 0x7fde1c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:58.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.607+0000 7fde37e00640 1 --2- 172.21.15.17:0/2581904376 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fde1c06ac00 0x7fde1c06d0c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fde28036000 tx=0x7fde2803c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:58.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.611+0000 7fde37400640 1 -- 172.21.15.17:0/2581904376 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fde300540a0 con 0x7fde400702d0 2024-03-12T17:18:58.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.812+0000 7fde45200640 1 -- 172.21.15.17:0/2581904376 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fde4015a450 con 0x7fde400702d0 2024-03-12T17:18:58.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.813+0000 7fde37400640 1 -- 172.21.15.17:0/2581904376 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fde30020020 con 0x7fde400702d0 2024-03-12T17:18:58.809 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-03-12T17:18:58.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.816+0000 7fde45200640 1 -- 172.21.15.17:0/2581904376 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fde1c06ac00 msgr2=0x7fde1c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:58.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.816+0000 7fde45200640 1 --2- 172.21.15.17:0/2581904376 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fde1c06ac00 0x7fde1c06d0c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fde28036000 tx=0x7fde2803c040 comp rx=0 tx=0).stop 2024-03-12T17:18:58.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.816+0000 7fde45200640 1 -- 172.21.15.17:0/2581904376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde400702d0 msgr2=0x7fde4013bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:58.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.816+0000 7fde45200640 1 --2- 172.21.15.17:0/2581904376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde400702d0 0x7fde4013bb70 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fde3000e810 tx=0x7fde3000ecd0 comp rx=0 tx=0).stop 2024-03-12T17:18:58.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.816+0000 7fde45200640 1 -- 172.21.15.17:0/2581904376 shutdown_connections 2024-03-12T17:18:58.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.816+0000 7fde45200640 1 --2- 172.21.15.17:0/2581904376 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fde1c06ac00 0x7fde1c06d0c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:58.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.816+0000 7fde45200640 1 --2- 172.21.15.17:0/2581904376 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fde4015ace0 0x7fde40141230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:58.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.816+0000 7fde45200640 1 --2- 172.21.15.17:0/2581904376 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fde400cd210 0x7fde401f22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:58.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.816+0000 7fde45200640 1 --2- 172.21.15.17:0/2581904376 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fde400702d0 0x7fde4013bb70 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:58.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.816+0000 7fde45200640 1 -- 172.21.15.17:0/2581904376 >> 172.21.15.17:0/2581904376 conn(0x7fde40066000 msgr2=0x7fde400cbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:58.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.816+0000 7fde45200640 1 -- 172.21.15.17:0/2581904376 shutdown_connections 2024-03-12T17:18:58.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:58.817+0000 7fde45200640 1 -- 172.21.15.17:0/2581904376 wait complete. 2024-03-12T17:18:58.831 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-12T17:18:59.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.067+0000 7f6cf0600640 1 Processor -- start 2024-03-12T17:18:59.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.067+0000 7f6cf0600640 1 -- start start 2024-03-12T17:18:59.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.068+0000 7f6cf0600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6ce80b5b50 0x7f6ce80b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:59.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.069+0000 7f6cf0600640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ce80d14e0 con 0x7f6ce80d2fa0 2024-03-12T17:18:59.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.069+0000 7f6cf0600640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ce80b85b0 con 0x7f6ce80cd840 2024-03-12T17:18:59.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.069+0000 7f6cf0600640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce80b59e0 con 0x7f6ce80b5b50 2024-03-12T17:18:59.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.069+0000 7f6cedc00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f6ce80d2fa0 0x7f6ce80d3380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37026/0 (socket says 172.21.15.17:37026) 2024-03-12T17:18:59.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.069+0000 7f6cedc00640 1 -- 172.21.15.17:0/2599728148 learned_addr learned my addr 172.21.15.17:0/2599728148 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:18:59.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.069+0000 7f6ced200640 1 --2- 172.21.15.17:0/2599728148 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6ce80b5b50 0x7f6ce80b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:59.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.070+0000 7f6ce7e00640 1 -- 172.21.15.17:0/2599728148 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2272458036 0 0) 0x7f6ce80d14e0 con 0x7f6ce80d2fa0 2024-03-12T17:18:59.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.070+0000 7f6ce7e00640 1 -- 172.21.15.17:0/2599728148 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cd0003520 con 0x7f6ce80d2fa0 2024-03-12T17:18:59.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.070+0000 7f6ce7e00640 1 -- 172.21.15.17:0/2599728148 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2965815436 0 0) 0x7f6cd0003520 con 0x7f6ce80d2fa0 2024-03-12T17:18:59.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.070+0000 7f6ce7e00640 1 -- 172.21.15.17:0/2599728148 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6ce80b5b50 msgr2=0x7f6ce80b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:59.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.070+0000 7f6ce7e00640 1 --2- 172.21.15.17:0/2599728148 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6ce80b5b50 0x7f6ce80b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:59.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.070+0000 7f6ce7e00640 1 -- 172.21.15.17:0/2599728148 >> v1:172.21.15.94:6789/0 conn(0x7f6ce80cd840 legacy=0x7f6ce80d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:59.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.070+0000 7f6ce7e00640 1 -- 172.21.15.17:0/2599728148 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce80b8890 con 0x7f6ce80d2fa0 2024-03-12T17:18:59.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.070+0000 7f6ce7e00640 1 -- 172.21.15.17:0/2599728148 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7f6cd8001670 con 0x7f6ce80d2fa0 2024-03-12T17:18:59.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.070+0000 7f6ce7e00640 1 -- 172.21.15.17:0/2599728148 >> v1:172.21.15.17:6789/0 conn(0x7f6ce80d2fa0 legacy=0x7f6ce80d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:59.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.070+0000 7f6ce7e00640 1 --2- 172.21.15.17:0/2599728148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cd00039a0 0x7f6cd0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:59.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.070+0000 7f6ce7e00640 1 --2- 172.21.15.17:0/2599728148 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6cd00047c0 0x7f6cd0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:59.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.070+0000 7f6ce7e00640 1 --2- 172.21.15.17:0/2599728148 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6ce80b5b50 0x7f6cd0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:59.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.070+0000 7f6ce7e00640 1 -- 172.21.15.17:0/2599728148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd000ba30 con 0x7f6cd00039a0 2024-03-12T17:18:59.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.070+0000 7f6ce7e00640 1 -- 172.21.15.17:0/2599728148 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd000bb70 con 0x7f6cd00047c0 2024-03-12T17:18:59.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.070+0000 7f6ce7e00640 1 -- 172.21.15.17:0/2599728148 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd000bd30 con 0x7f6ce80b5b50 2024-03-12T17:18:59.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.070+0000 7f6cedc00640 1 --2- 172.21.15.17:0/2599728148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cd00039a0 0x7f6cd0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:59.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.071+0000 7f6ced200640 1 --2- 172.21.15.17:0/2599728148 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6cd00047c0 0x7f6cd0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:59.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.071+0000 7f6cee600640 1 --2- 172.21.15.17:0/2599728148 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6ce80b5b50 0x7f6cd0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:59.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.071+0000 7f6cedc00640 1 -- 172.21.15.17:0/2599728148 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6ce80b5b50 msgr2=0x7f6cd0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:59.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.071+0000 7f6cedc00640 1 --2- 172.21.15.17:0/2599728148 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6ce80b5b50 0x7f6cd0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:59.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.071+0000 7f6cedc00640 1 -- 172.21.15.17:0/2599728148 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6cd00047c0 msgr2=0x7f6cd0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:59.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.071+0000 7f6cedc00640 1 --2- 172.21.15.17:0/2599728148 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6cd00047c0 0x7f6cd0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:59.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.071+0000 7f6cedc00640 1 -- 172.21.15.17:0/2599728148 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd0003520 con 0x7f6cd00039a0 2024-03-12T17:18:59.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.072+0000 7f6cedc00640 1 --2- 172.21.15.17:0/2599728148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cd00039a0 0x7f6cd0003dc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6cd800c210 tx=0x7f6cd00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce2c3741b911e167 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:59.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.072+0000 7f6ce7e00640 1 -- 172.21.15.17:0/2599728148 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd8005ad0 con 0x7f6cd00039a0 2024-03-12T17:18:59.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.072+0000 7f6ce7e00640 1 -- 172.21.15.17:0/2599728148 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd8005c30 con 0x7f6cd00039a0 2024-03-12T17:18:59.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.072+0000 7f6ce7e00640 1 -- 172.21.15.17:0/2599728148 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd802c870 con 0x7f6cd00039a0 2024-03-12T17:18:59.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.073+0000 7f6cf0600640 1 -- 172.21.15.17:0/2599728148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cd00039a0 msgr2=0x7f6cd0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:59.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.073+0000 7f6cf0600640 1 --2- 172.21.15.17:0/2599728148 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6cd00039a0 0x7f6cd0003dc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6cd800c210 tx=0x7f6cd00057f0 comp rx=0 tx=0).stop 2024-03-12T17:18:59.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.073+0000 7f6cee600640 1 -- 172.21.15.17:0/2599728148 reap_dead start 2024-03-12T17:18:59.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.073+0000 7f6cf0600640 1 -- 172.21.15.17:0/2599728148 shutdown_connections 2024-03-12T17:18:59.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.073+0000 7f6cf0600640 1 -- 172.21.15.17:0/2599728148 >> 172.21.15.17:0/2599728148 conn(0x7f6ce8065df0 msgr2=0x7f6ce8066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:59.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.073+0000 7f6cf0600640 1 -- 172.21.15.17:0/2599728148 shutdown_connections 2024-03-12T17:18:59.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.073+0000 7f6cf0600640 1 -- 172.21.15.17:0/2599728148 wait complete. 2024-03-12T17:18:59.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.075+0000 7f6cf0600640 1 Processor -- start 2024-03-12T17:18:59.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.075+0000 7f6cf0600640 1 -- start start 2024-03-12T17:18:59.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.076+0000 7f6cf0600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6cd00039a0 0x7f6ce815b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:59.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.076+0000 7f6cf0600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ce81f32f0 0x7f6ce80cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:59.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.076+0000 7f6cf0600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6ce81f3770 0x7f6ce80ce190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:59.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.076+0000 7f6cf0600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce815b9b0 con 0x7f6ce81f32f0 2024-03-12T17:18:59.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.076+0000 7f6cf0600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce80c9ad0 con 0x7f6cd00039a0 2024-03-12T17:18:59.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.076+0000 7f6cf0600640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce815f270 con 0x7f6ce81f3770 2024-03-12T17:18:59.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.077+0000 7f6ced200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ce81f32f0 0x7f6ce80cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:59.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.077+0000 7f6ced200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ce81f32f0 0x7f6ce80cdc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39022/0 (socket says 172.21.15.17:39022) 2024-03-12T17:18:59.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.077+0000 7f6ced200640 1 -- 172.21.15.17:0/2910710279 learned_addr learned my addr 172.21.15.17:0/2910710279 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:59.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.077+0000 7f6cedc00640 1 --2- 172.21.15.17:0/2910710279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6cd00039a0 0x7f6ce815b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:59.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.077+0000 7f6cee600640 1 --2- 172.21.15.17:0/2910710279 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6ce81f3770 0x7f6ce80ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:59.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.077+0000 7f6ced200640 1 -- 172.21.15.17:0/2910710279 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6ce81f3770 msgr2=0x7f6ce80ce190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:59.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.077+0000 7f6ced200640 1 --2- 172.21.15.17:0/2910710279 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6ce81f3770 0x7f6ce80ce190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:59.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.077+0000 7f6ced200640 1 -- 172.21.15.17:0/2910710279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6cd00039a0 msgr2=0x7f6ce815b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:59.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.077+0000 7f6ced200640 1 --2- 172.21.15.17:0/2910710279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6cd00039a0 0x7f6ce815b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:59.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.077+0000 7f6ced200640 1 -- 172.21.15.17:0/2910710279 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce80c9d20 con 0x7f6ce81f32f0 2024-03-12T17:18:59.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.077+0000 7f6cee600640 1 --2- 172.21.15.17:0/2910710279 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6ce81f3770 0x7f6ce80ce190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:18:59.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.077+0000 7f6ced200640 1 --2- 172.21.15.17:0/2910710279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ce81f32f0 0x7f6ce80cdc50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc007f30 tx=0x7f6cdc011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:59.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.078+0000 7f6ce5600640 1 -- 172.21.15.17:0/2910710279 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc00e030 con 0x7f6ce81f32f0 2024-03-12T17:18:59.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.078+0000 7f6ce5600640 1 -- 172.21.15.17:0/2910710279 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cdc016470 con 0x7f6ce81f32f0 2024-03-12T17:18:59.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.078+0000 7f6cf0600640 1 -- 172.21.15.17:0/2910710279 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce80ca000 con 0x7f6ce81f32f0 2024-03-12T17:18:59.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.078+0000 7f6ce5600640 1 -- 172.21.15.17:0/2910710279 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc016820 con 0x7f6ce81f32f0 2024-03-12T17:18:59.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.078+0000 7f6cf0600640 1 -- 172.21.15.17:0/2910710279 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce80ca800 con 0x7f6ce81f32f0 2024-03-12T17:18:59.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.079+0000 7f6cf0600640 1 -- 172.21.15.17:0/2910710279 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce80736c0 con 0x7f6ce81f32f0 2024-03-12T17:18:59.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.080+0000 7f6ce5600640 1 -- 172.21.15.17:0/2910710279 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f6cdc016980 con 0x7f6ce81f32f0 2024-03-12T17:18:59.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.081+0000 7f6ce5600640 1 --2- 172.21.15.17:0/2910710279 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f6ccc06ac00 0x7f6ccc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:59.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.081+0000 7f6ce5600640 1 -- 172.21.15.17:0/2910710279 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6cdc00f070 con 0x7f6ce81f32f0 2024-03-12T17:18:59.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.082+0000 7f6cedc00640 1 --2- 172.21.15.17:0/2910710279 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f6ccc06ac00 0x7f6ccc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:59.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.082+0000 7f6cedc00640 1 --2- 172.21.15.17:0/2910710279 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f6ccc06ac00 0x7f6ccc06d0c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8034000 tx=0x7f6cd8009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:59.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.086+0000 7f6ce5600640 1 -- 172.21.15.17:0/2910710279 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f6cdc0552f0 con 0x7f6ce81f32f0 2024-03-12T17:18:59.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.283+0000 7f6cf0600640 1 -- 172.21.15.17:0/2910710279 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6ce80b1730 con 0x7f6ce81f32f0 2024-03-12T17:18:59.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.284+0000 7f6ce5600640 1 -- 172.21.15.17:0/2910710279 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6cdc058910 con 0x7f6ce81f32f0 2024-03-12T17:18:59.280 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-03-12T17:18:59.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.287+0000 7f6cf0600640 1 -- 172.21.15.17:0/2910710279 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f6ccc06ac00 msgr2=0x7f6ccc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:59.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.287+0000 7f6cf0600640 1 --2- 172.21.15.17:0/2910710279 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f6ccc06ac00 0x7f6ccc06d0c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6cd8034000 tx=0x7f6cd8009030 comp rx=0 tx=0).stop 2024-03-12T17:18:59.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.287+0000 7f6cf0600640 1 -- 172.21.15.17:0/2910710279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ce81f32f0 msgr2=0x7f6ce80cdc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:59.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.287+0000 7f6cf0600640 1 --2- 172.21.15.17:0/2910710279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ce81f32f0 0x7f6ce80cdc50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6cdc007f30 tx=0x7f6cdc011660 comp rx=0 tx=0).stop 2024-03-12T17:18:59.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.287+0000 7f6cf0600640 1 -- 172.21.15.17:0/2910710279 shutdown_connections 2024-03-12T17:18:59.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.287+0000 7f6cf0600640 1 --2- 172.21.15.17:0/2910710279 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f6ccc06ac00 0x7f6ccc06d0c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:59.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.287+0000 7f6cf0600640 1 --2- 172.21.15.17:0/2910710279 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6ce81f3770 0x7f6ce80ce190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:59.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.287+0000 7f6cf0600640 1 --2- 172.21.15.17:0/2910710279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ce81f32f0 0x7f6ce80cdc50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:59.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.287+0000 7f6cf0600640 1 --2- 172.21.15.17:0/2910710279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6cd00039a0 0x7f6ce815b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:59.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.287+0000 7f6cf0600640 1 -- 172.21.15.17:0/2910710279 >> 172.21.15.17:0/2910710279 conn(0x7f6ce8065df0 msgr2=0x7f6ce80b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:59.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.287+0000 7f6cf0600640 1 -- 172.21.15.17:0/2910710279 shutdown_connections 2024-03-12T17:18:59.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.287+0000 7f6cf0600640 1 -- 172.21.15.17:0/2910710279 wait complete. 2024-03-12T17:18:59.301 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-12T17:18:59.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.527+0000 7fd91aa00640 1 Processor -- start 2024-03-12T17:18:59.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.527+0000 7fd91aa00640 1 -- start start 2024-03-12T17:18:59.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.528+0000 7fd91aa00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd9140ced90 0x7fd9140b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:59.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.528+0000 7fd91aa00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd9140b3950 0x7fd9140ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:59.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.528+0000 7fd91aa00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9140cb340 con 0x7fd91406c3f0 2024-03-12T17:18:59.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.528+0000 7fd91aa00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd914159d50 con 0x7fd9140ced90 2024-03-12T17:18:59.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.528+0000 7fd91aa00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9140b1c50 con 0x7fd9140b3950 2024-03-12T17:18:59.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.529+0000 7fd913e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd9140ced90 0x7fd9140b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:59.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.529+0000 7fd913e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd9140ced90 0x7fd9140b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39026/0 (socket says 172.21.15.17:39026) 2024-03-12T17:18:59.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.529+0000 7fd913e00640 1 -- 172.21.15.17:0/871286142 learned_addr learned my addr 172.21.15.17:0/871286142 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:59.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.529+0000 7fd918a00640 1 --2- 172.21.15.17:0/871286142 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd9140b3950 0x7fd9140ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:59.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.529+0000 7fd913e00640 1 -- 172.21.15.17:0/871286142 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd9140b3950 msgr2=0x7fd9140ccd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:18:59.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.529+0000 7fd913e00640 1 --2- 172.21.15.17:0/871286142 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd9140b3950 0x7fd9140ccd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:59.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.529+0000 7fd913e00640 1 -- 172.21.15.17:0/871286142 >> v1:172.21.15.94:6789/0 conn(0x7fd91406c3f0 legacy=0x7fd9140b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:59.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.529+0000 7fd913e00640 1 -- 172.21.15.17:0/871286142 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9140b1ef0 con 0x7fd9140ced90 2024-03-12T17:18:59.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.531+0000 7fd913e00640 1 --2- 172.21.15.17:0/871286142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9140ced90 0x7fd9140b1710 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd90400bb10 tx=0x7fd90402e150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f81e22bd2480d3ec server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:59.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.531+0000 7fd913400640 1 -- 172.21.15.17:0/871286142 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd904036440 con 0x7fd9140ced90 2024-03-12T17:18:59.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.531+0000 7fd913400640 1 -- 172.21.15.17:0/871286142 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9040365a0 con 0x7fd9140ced90 2024-03-12T17:18:59.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.531+0000 7fd913400640 1 -- 172.21.15.17:0/871286142 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd904036930 con 0x7fd9140ced90 2024-03-12T17:18:59.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.531+0000 7fd91aa00640 1 -- 172.21.15.17:0/871286142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9140ced90 msgr2=0x7fd9140b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:59.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.531+0000 7fd91aa00640 1 --2- 172.21.15.17:0/871286142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9140ced90 0x7fd9140b1710 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd90400bb10 tx=0x7fd90402e150 comp rx=0 tx=0).stop 2024-03-12T17:18:59.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.532+0000 7fd91aa00640 1 -- 172.21.15.17:0/871286142 shutdown_connections 2024-03-12T17:18:59.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.532+0000 7fd91aa00640 1 --2- 172.21.15.17:0/871286142 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd9140b3950 0x7fd9140ccd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:59.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.532+0000 7fd91aa00640 1 --2- 172.21.15.17:0/871286142 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9140ced90 0x7fd9140b1710 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:59.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.532+0000 7fd91aa00640 1 -- 172.21.15.17:0/871286142 >> 172.21.15.17:0/871286142 conn(0x7fd914069ce0 msgr2=0x7fd91406a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:59.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.532+0000 7fd91aa00640 1 -- 172.21.15.17:0/871286142 shutdown_connections 2024-03-12T17:18:59.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.532+0000 7fd91aa00640 1 -- 172.21.15.17:0/871286142 wait complete. 2024-03-12T17:18:59.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.533+0000 7fd91aa00640 1 Processor -- start 2024-03-12T17:18:59.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.534+0000 7fd91aa00640 1 -- start start 2024-03-12T17:18:59.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.534+0000 7fd91aa00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd91406c3f0 0x7fd9140c4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:59.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.534+0000 7fd91aa00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd9140b3950 0x7fd91415c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:59.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.534+0000 7fd91aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9140ced90 0x7fd91414e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:59.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.535+0000 7fd91aa00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91415c710 con 0x7fd9140ced90 2024-03-12T17:18:59.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.535+0000 7fd91aa00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9140afaf0 con 0x7fd91406c3f0 2024-03-12T17:18:59.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.535+0000 7fd91aa00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9140aeee0 con 0x7fd9140b3950 2024-03-12T17:18:59.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.535+0000 7fd918a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9140ced90 0x7fd91414e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:59.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.535+0000 7fd918a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9140ced90 0x7fd91414e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39038/0 (socket says 172.21.15.17:39038) 2024-03-12T17:18:59.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.535+0000 7fd918a00640 1 -- 172.21.15.17:0/1060694265 learned_addr learned my addr 172.21.15.17:0/1060694265 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:18:59.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.535+0000 7fd913e00640 1 --2- 172.21.15.17:0/1060694265 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd91406c3f0 0x7fd9140c4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:59.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.535+0000 7fd90b400640 1 --2- 172.21.15.17:0/1060694265 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd9140b3950 0x7fd91415c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:59.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.535+0000 7fd918a00640 1 -- 172.21.15.17:0/1060694265 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd9140b3950 msgr2=0x7fd91415c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:59.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.535+0000 7fd918a00640 1 --2- 172.21.15.17:0/1060694265 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd9140b3950 0x7fd91415c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:59.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.535+0000 7fd918a00640 1 -- 172.21.15.17:0/1060694265 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd91406c3f0 msgr2=0x7fd9140c4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:59.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.535+0000 7fd918a00640 1 --2- 172.21.15.17:0/1060694265 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd91406c3f0 0x7fd9140c4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:59.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.535+0000 7fd918a00640 1 -- 172.21.15.17:0/1060694265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd90400b770 con 0x7fd9140ced90 2024-03-12T17:18:59.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.536+0000 7fd918a00640 1 --2- 172.21.15.17:0/1060694265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9140ced90 0x7fd91414e150 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd90c007de0 tx=0x7fd90c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:59.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.536+0000 7fd910c00640 1 -- 172.21.15.17:0/1060694265 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c014620 con 0x7fd9140ced90 2024-03-12T17:18:59.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.536+0000 7fd910c00640 1 -- 172.21.15.17:0/1060694265 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90c00ee90 con 0x7fd9140ced90 2024-03-12T17:18:59.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.536+0000 7fd910c00640 1 -- 172.21.15.17:0/1060694265 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c0149e0 con 0x7fd9140ced90 2024-03-12T17:18:59.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.536+0000 7fd91aa00640 1 -- 172.21.15.17:0/1060694265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9140af1c0 con 0x7fd9140ced90 2024-03-12T17:18:59.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.536+0000 7fd91aa00640 1 -- 172.21.15.17:0/1060694265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9140af780 con 0x7fd9140ced90 2024-03-12T17:18:59.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.537+0000 7fd91aa00640 1 -- 172.21.15.17:0/1060694265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9140af940 con 0x7fd9140ced90 2024-03-12T17:18:59.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.538+0000 7fd910c00640 1 -- 172.21.15.17:0/1060694265 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fd90c014b40 con 0x7fd9140ced90 2024-03-12T17:18:59.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.539+0000 7fd910c00640 1 --2- 172.21.15.17:0/1060694265 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd8f006ac30 0x7fd8f006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:18:59.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.539+0000 7fd910c00640 1 -- 172.21.15.17:0/1060694265 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd90c089db0 con 0x7fd9140ced90 2024-03-12T17:18:59.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.539+0000 7fd913e00640 1 --2- 172.21.15.17:0/1060694265 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd8f006ac30 0x7fd8f006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:18:59.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.540+0000 7fd913e00640 1 --2- 172.21.15.17:0/1060694265 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd8f006ac30 0x7fd8f006d0f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd904038000 tx=0x7fd904008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:18:59.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.544+0000 7fd910c00640 1 -- 172.21.15.17:0/1060694265 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fd90c08e070 con 0x7fd9140ced90 2024-03-12T17:18:59.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.784+0000 7fd91aa00640 1 -- 172.21.15.17:0/1060694265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd9140afc60 con 0x7fd9140ced90 2024-03-12T17:18:59.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.784+0000 7fd910c00640 1 -- 172.21.15.17:0/1060694265 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4725 (secure 0 0 0) 0x7fd90c054e60 con 0x7fd9140ced90 2024-03-12T17:18:59.780 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:18:59.780 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/4055209511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":4055209511},{"type":"v1","addr":"172.21.15.94:6833","nonce":4055209511}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4220,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/2079001512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2079001512},{"type":"v1","addr":"172.21.15.94:6835","nonce":2079001512}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6836/3710914262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3710914262},{"type":"v1","addr":"172.21.15.17:6836","nonce":3710914262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T17:18:45.842660+0000","modified":"2024-03-12T17:18:49.354081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6837/749237500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6835","nonce":749237500},{"type":"v1","addr":"172.21.15.17:6837","nonce":749237500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-12T17:18:59.780 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 7 2024-03-12T17:18:59.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.787+0000 7fd91aa00640 1 -- 172.21.15.17:0/1060694265 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd8f006ac30 msgr2=0x7fd8f006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:59.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.787+0000 7fd91aa00640 1 --2- 172.21.15.17:0/1060694265 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd8f006ac30 0x7fd8f006d0f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd904038000 tx=0x7fd904008040 comp rx=0 tx=0).stop 2024-03-12T17:18:59.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.787+0000 7fd91aa00640 1 -- 172.21.15.17:0/1060694265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9140ced90 msgr2=0x7fd91414e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:18:59.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.787+0000 7fd91aa00640 1 --2- 172.21.15.17:0/1060694265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9140ced90 0x7fd91414e150 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd90c007de0 tx=0x7fd90c00e4b0 comp rx=0 tx=0).stop 2024-03-12T17:18:59.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.787+0000 7fd91aa00640 1 -- 172.21.15.17:0/1060694265 shutdown_connections 2024-03-12T17:18:59.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.787+0000 7fd91aa00640 1 --2- 172.21.15.17:0/1060694265 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd8f006ac30 0x7fd8f006d0f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:59.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.787+0000 7fd91aa00640 1 --2- 172.21.15.17:0/1060694265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd9140ced90 0x7fd91414e150 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:59.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.787+0000 7fd91aa00640 1 --2- 172.21.15.17:0/1060694265 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd9140b3950 0x7fd91415c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:59.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.787+0000 7fd91aa00640 1 --2- 172.21.15.17:0/1060694265 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd91406c3f0 0x7fd9140c4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:18:59.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.787+0000 7fd91aa00640 1 -- 172.21.15.17:0/1060694265 >> 172.21.15.17:0/1060694265 conn(0x7fd914069ce0 msgr2=0x7fd9140ccb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:18:59.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.787+0000 7fd91aa00640 1 -- 172.21.15.17:0/1060694265 shutdown_connections 2024-03-12T17:18:59.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:18:59.788+0000 7fd91aa00640 1 -- 172.21.15.17:0/1060694265 wait complete. 2024-03-12T17:18:59.803 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T17:19:00.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.025+0000 7fa833200640 1 Processor -- start 2024-03-12T17:19:00.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.025+0000 7fa833200640 1 -- start start 2024-03-12T17:19:00.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.026+0000 7fa833200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa83415ce80 0x7fa8340cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:00.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.026+0000 7fa833200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa834161650 con 0x7fa83415caa0 2024-03-12T17:19:00.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.026+0000 7fa833200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa834161090 con 0x7fa8340b85f0 2024-03-12T17:19:00.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.026+0000 7fa833200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa834160ea0 con 0x7fa83415ce80 2024-03-12T17:19:00.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.027+0000 7fa831e00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fa83415caa0 0x7fa834160790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37042/0 (socket says 172.21.15.17:37042) 2024-03-12T17:19:00.022 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.027+0000 7fa831e00640 1 -- 172.21.15.17:0/561292281 learned_addr learned my addr 172.21.15.17:0/561292281 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:00.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.027+0000 7fa831400640 1 --2- 172.21.15.17:0/561292281 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa83415ce80 0x7fa8340cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:00.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.027+0000 7fa830a00640 1 -- 172.21.15.17:0/561292281 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2698055336 0 0) 0x7fa834161650 con 0x7fa83415caa0 2024-03-12T17:19:00.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.027+0000 7fa830a00640 1 -- 172.21.15.17:0/561292281 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa814003520 con 0x7fa83415caa0 2024-03-12T17:19:00.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.028+0000 7fa830a00640 1 -- 172.21.15.17:0/561292281 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1779344841 0 0) 0x7fa834161090 con 0x7fa8340b85f0 2024-03-12T17:19:00.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.028+0000 7fa831400640 1 -- 172.21.15.17:0/561292281 >> v1:172.21.15.94:6789/0 conn(0x7fa8340b85f0 legacy=0x7fa8340d12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:00.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.028+0000 7fa831400640 1 -- 172.21.15.17:0/561292281 >> v1:172.21.15.17:6789/0 conn(0x7fa83415caa0 legacy=0x7fa834160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:00.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.028+0000 7fa831400640 1 -- 172.21.15.17:0/561292281 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa834161370 con 0x7fa83415ce80 2024-03-12T17:19:00.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.029+0000 7fa831400640 1 --2- 172.21.15.17:0/561292281 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa83415ce80 0x7fa8340cf330 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa81c009dc0 tx=0x7fa81c02bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa37c8703fb3fc2a server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:00.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.029+0000 7fa830a00640 1 -- 172.21.15.17:0/561292281 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c02ccc0 con 0x7fa83415ce80 2024-03-12T17:19:00.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.030+0000 7fa830a00640 1 -- 172.21.15.17:0/561292281 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81c02ce20 con 0x7fa83415ce80 2024-03-12T17:19:00.025 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.030+0000 7fa830a00640 1 -- 172.21.15.17:0/561292281 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c034640 con 0x7fa83415ce80 2024-03-12T17:19:00.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.030+0000 7fa833200640 1 -- 172.21.15.17:0/561292281 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa83415ce80 msgr2=0x7fa8340cf330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:00.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.030+0000 7fa833200640 1 --2- 172.21.15.17:0/561292281 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa83415ce80 0x7fa8340cf330 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fa81c009dc0 tx=0x7fa81c02bf10 comp rx=0 tx=0).stop 2024-03-12T17:19:00.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.030+0000 7fa833200640 1 -- 172.21.15.17:0/561292281 shutdown_connections 2024-03-12T17:19:00.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.030+0000 7fa833200640 1 --2- 172.21.15.17:0/561292281 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa83415ce80 0x7fa8340cf330 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:00.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.030+0000 7fa833200640 1 -- 172.21.15.17:0/561292281 >> 172.21.15.17:0/561292281 conn(0x7fa83406b160 msgr2=0x7fa83406b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:00.026 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.030+0000 7fa833200640 1 -- 172.21.15.17:0/561292281 shutdown_connections 2024-03-12T17:19:00.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.030+0000 7fa833200640 1 -- 172.21.15.17:0/561292281 wait complete. 2024-03-12T17:19:00.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.032+0000 7fa833200640 1 Processor -- start 2024-03-12T17:19:00.027 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.032+0000 7fa833200640 1 -- start start 2024-03-12T17:19:00.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.033+0000 7fa833200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa8340b85f0 0x7fa8340c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:00.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.033+0000 7fa833200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa83415caa0 0x7fa83415a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:00.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.033+0000 7fa833200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa83415ce80 0x7fa8340ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:00.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.033+0000 7fa833200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8340c7e80 con 0x7fa83415caa0 2024-03-12T17:19:00.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.033+0000 7fa833200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8340cac00 con 0x7fa83415ce80 2024-03-12T17:19:00.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.033+0000 7fa833200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8340cadf0 con 0x7fa8340b85f0 2024-03-12T17:19:00.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.033+0000 7fa831400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa83415caa0 0x7fa83415a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:00.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.033+0000 7fa831400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa83415caa0 0x7fa83415a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39054/0 (socket says 172.21.15.17:39054) 2024-03-12T17:19:00.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.033+0000 7fa831400640 1 -- 172.21.15.17:0/541414178 learned_addr learned my addr 172.21.15.17:0/541414178 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:00.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.034+0000 7fa831e00640 1 --2- 172.21.15.17:0/541414178 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa8340b85f0 0x7fa8340c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:00.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.034+0000 7fa832800640 1 --2- 172.21.15.17:0/541414178 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa83415ce80 0x7fa8340ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:00.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.034+0000 7fa831400640 1 -- 172.21.15.17:0/541414178 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa8340b85f0 msgr2=0x7fa8340c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:00.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.034+0000 7fa831400640 1 --2- 172.21.15.17:0/541414178 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa8340b85f0 0x7fa8340c9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:00.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.034+0000 7fa831400640 1 -- 172.21.15.17:0/541414178 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa83415ce80 msgr2=0x7fa8340ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:00.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.034+0000 7fa831400640 1 --2- 172.21.15.17:0/541414178 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa83415ce80 0x7fa8340ca6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:00.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.034+0000 7fa831400640 1 -- 172.21.15.17:0/541414178 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81c009a70 con 0x7fa83415caa0 2024-03-12T17:19:00.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.034+0000 7fa832800640 1 --2- 172.21.15.17:0/541414178 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa83415ce80 0x7fa8340ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:19:00.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.034+0000 7fa831400640 1 --2- 172.21.15.17:0/541414178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa83415caa0 0x7fa83415a380 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa81c000f80 tx=0x7fa81c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:00.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.035+0000 7fa82a000640 1 -- 172.21.15.17:0/541414178 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c03e610 con 0x7fa83415caa0 2024-03-12T17:19:00.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.035+0000 7fa82a000640 1 -- 172.21.15.17:0/541414178 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa81c03e770 con 0x7fa83415caa0 2024-03-12T17:19:00.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.035+0000 7fa82a000640 1 -- 172.21.15.17:0/541414178 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c03eae0 con 0x7fa83415caa0 2024-03-12T17:19:00.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.035+0000 7fa833200640 1 -- 172.21.15.17:0/541414178 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8340cb0d0 con 0x7fa83415caa0 2024-03-12T17:19:00.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.035+0000 7fa833200640 1 -- 172.21.15.17:0/541414178 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8340cb3b0 con 0x7fa83415caa0 2024-03-12T17:19:00.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.036+0000 7fa833200640 1 -- 172.21.15.17:0/541414178 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa834072360 con 0x7fa83415caa0 2024-03-12T17:19:00.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.037+0000 7fa82a000640 1 -- 172.21.15.17:0/541414178 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fa81c03b050 con 0x7fa83415caa0 2024-03-12T17:19:00.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.038+0000 7fa82a000640 1 --2- 172.21.15.17:0/541414178 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fa81006ac00 0x7fa81006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:00.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.038+0000 7fa82a000640 1 -- 172.21.15.17:0/541414178 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa81c0ab900 con 0x7fa83415caa0 2024-03-12T17:19:00.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.038+0000 7fa831e00640 1 --2- 172.21.15.17:0/541414178 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fa81006ac00 0x7fa81006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:00.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.039+0000 7fa831e00640 1 --2- 172.21.15.17:0/541414178 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fa81006ac00 0x7fa81006d0c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa824005880 tx=0x7fa824009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:00.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.043+0000 7fa82a000640 1 -- 172.21.15.17:0/541414178 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fa81c076bf0 con 0x7fa83415caa0 2024-03-12T17:19:00.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.240+0000 7fa833200640 1 -- 172.21.15.17:0/541414178 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa83404e030 con 0x7fa83415caa0 2024-03-12T17:19:00.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.241+0000 7fa82a000640 1 -- 172.21.15.17:0/541414178 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15989 (secure 0 0 0) 0x7fa81c039090 con 0x7fa83415caa0 2024-03-12T17:19:00.237 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:19:00.237 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":21,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:18:46.845635+0000","last_up_change":"2024-03-12T17:18:38.144756+0000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-12T17:18:39.552910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-12T17:18:43.794908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-12T17:18:44.867006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":37305},{"type":"v1","addr":"172.21.15.17:6801","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":37305},{"type":"v1","addr":"172.21.15.17:6803","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":37305},{"type":"v1","addr":"172.21.15.17:6807","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":37305},{"type":"v1","addr":"172.21.15.17:6805","nonce":37305}]},"public_addr":"172.21.15.17:6801/37305","cluster_addr":"172.21.15.17:6803/37305","heartbeat_back_addr":"172.21.15.17:6807/37305","heartbeat_front_addr":"172.21.15.17:6805/37305","state":["exists","up"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":37307},{"type":"v1","addr":"172.21.15.17:6814","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":37307},{"type":"v1","addr":"172.21.15.17:6818","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":37307},{"type":"v1","addr":"172.21.15.17:6827","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":37307},{"type":"v1","addr":"172.21.15.17:6823","nonce":37307}]},"public_addr":"172.21.15.17:6814/37307","cluster_addr":"172.21.15.17:6818/37307","heartbeat_back_addr":"172.21.15.17:6827/37307","heartbeat_front_addr":"172.21.15.17:6823/37307","state":["exists","up"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":37303},{"type":"v1","addr":"172.21.15.17:6809","nonce":37303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":37303},{"type":"v1","addr":"172.21.15.17:6811","nonce":37303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":37303},{"type":"v1","addr":"172.21.15.17:6819","nonce":37303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":37303},{"type":"v1","addr":"172.21.15.17:6815","nonce":37303}]},"public_addr":"172.21.15.17:6809/37303","cluster_addr":"172.21.15.17:6811/37303","heartbeat_back_addr":"172.21.15.17:6819/37303","heartbeat_front_addr":"172.21.15.17:6815/37303","state":["exists","up"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":37308},{"type":"v1","addr":"172.21.15.17:6822","nonce":37308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":37308},{"type":"v1","addr":"172.21.15.17:6826","nonce":37308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":37308},{"type":"v1","addr":"172.21.15.17:6831","nonce":37308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":37308},{"type":"v1","addr":"172.21.15.17:6829","nonce":37308}]},"public_addr":"172.21.15.17:6822/37308","cluster_addr":"172.21.15.17:6826/37308","heartbeat_back_addr":"172.21.15.17:6831/37308","heartbeat_front_addr":"172.21.15.17:6829/37308","state":["exists","up"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":37465},{"type":"v1","addr":"172.21.15.94:6809","nonce":37465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6811","nonce":37465},{"type":"v1","addr":"172.21.15.94:6813","nonce":37465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6819","nonce":37465},{"type":"v1","addr":"172.21.15.94:6822","nonce":37465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6815","nonce":37465},{"type":"v1","addr":"172.21.15.94:6817","nonce":37465}]},"public_addr":"172.21.15.94:6809/37465","cluster_addr":"172.21.15.94:6813/37465","heartbeat_back_addr":"172.21.15.94:6822/37465","heartbeat_front_addr":"172.21.15.94:6817/37465","state":["exists","up"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":37464},{"type":"v1","addr":"172.21.15.94:6812","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":37464},{"type":"v1","addr":"172.21.15.94:6816","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":37464},{"type":"v1","addr":"172.21.15.94:6823","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":37464},{"type":"v1","addr":"172.21.15.94:6820","nonce":37464}]},"public_addr":"172.21.15.94:6812/37464","cluster_addr":"172.21.15.94:6816/37464","heartbeat_back_addr":"172.21.15.94:6823/37464","heartbeat_front_addr":"172.21.15.94:6820/37464","state":["exists","up"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":37467},{"type":"v1","addr":"172.21.15.94:6825","nonce":37467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":37467},{"type":"v1","addr":"172.21.15.94:6827","nonce":37467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":37467},{"type":"v1","addr":"172.21.15.94:6831","nonce":37467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":37467},{"type":"v1","addr":"172.21.15.94:6829","nonce":37467}]},"public_addr":"172.21.15.94:6825/37467","cluster_addr":"172.21.15.94:6827/37467","heartbeat_back_addr":"172.21.15.94:6831/37467","heartbeat_front_addr":"172.21.15.94:6829/37467","state":["exists","up"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":37466},{"type":"v1","addr":"172.21.15.94:6801","nonce":37466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":37466},{"type":"v1","addr":"172.21.15.94:6803","nonce":37466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":37466},{"type":"v1","addr":"172.21.15.94:6807","nonce":37466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":37466},{"type":"v1","addr":"172.21.15.94:6805","nonce":37466}]},"public_addr":"172.21.15.94:6801/37466","cluster_addr":"172.21.15.94:6803/37466","heartbeat_back_addr":"172.21.15.94:6807/37466","heartbeat_front_addr":"172.21.15.94:6805/37466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.327217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.186966+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.419986+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.150585+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.120621+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.121576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.181257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.293188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:19:00.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.244+0000 7fa833200640 1 -- 172.21.15.17:0/541414178 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fa81006ac00 msgr2=0x7fa81006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:00.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.244+0000 7fa833200640 1 --2- 172.21.15.17:0/541414178 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fa81006ac00 0x7fa81006d0c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa824005880 tx=0x7fa824009040 comp rx=0 tx=0).stop 2024-03-12T17:19:00.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.244+0000 7fa833200640 1 -- 172.21.15.17:0/541414178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa83415caa0 msgr2=0x7fa83415a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:00.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.244+0000 7fa833200640 1 --2- 172.21.15.17:0/541414178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa83415caa0 0x7fa83415a380 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa81c000f80 tx=0x7fa81c004ab0 comp rx=0 tx=0).stop 2024-03-12T17:19:00.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.244+0000 7fa833200640 1 -- 172.21.15.17:0/541414178 shutdown_connections 2024-03-12T17:19:00.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.244+0000 7fa833200640 1 --2- 172.21.15.17:0/541414178 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fa81006ac00 0x7fa81006d0c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:00.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.244+0000 7fa833200640 1 --2- 172.21.15.17:0/541414178 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa83415ce80 0x7fa8340ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:00.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.244+0000 7fa833200640 1 --2- 172.21.15.17:0/541414178 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa83415caa0 0x7fa83415a380 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:00.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.244+0000 7fa833200640 1 --2- 172.21.15.17:0/541414178 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa8340b85f0 0x7fa8340c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:00.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.244+0000 7fa833200640 1 -- 172.21.15.17:0/541414178 >> 172.21.15.17:0/541414178 conn(0x7fa83406b160 msgr2=0x7fa8340b73c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:00.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.244+0000 7fa833200640 1 -- 172.21.15.17:0/541414178 shutdown_connections 2024-03-12T17:19:00.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.244+0000 7fa833200640 1 -- 172.21.15.17:0/541414178 wait complete. 2024-03-12T17:19:00.259 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-12T17:18:39.552910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-12T17:18:43.794908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-12T17:18:44.867006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-12T17:19:00.260 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-12T17:19:00.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.489+0000 7f00d6e00640 1 Processor -- start 2024-03-12T17:19:00.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.489+0000 7f00d6e00640 1 -- start start 2024-03-12T17:19:00.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.490+0000 7f00d6e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f00d0145dc0 0x7f00d0160ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:00.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.491+0000 7f00d6e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f00d00b1860 0x7f00d00b4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:00.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.491+0000 7f00d6e00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00d01461a0 con 0x7f00d0070240 2024-03-12T17:19:00.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.491+0000 7f00d6e00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00d00b2000 con 0x7f00d0145dc0 2024-03-12T17:19:00.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.491+0000 7f00d6e00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00d00b3db0 con 0x7f00d00b1860 2024-03-12T17:19:00.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.491+0000 7f00d5a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f00d0145dc0 0x7f00d0160ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:00.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.491+0000 7f00d5a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f00d0145dc0 0x7f00d0160ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39066/0 (socket says 172.21.15.17:39066) 2024-03-12T17:19:00.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.491+0000 7f00d5a00640 1 -- 172.21.15.17:0/2144003434 learned_addr learned my addr 172.21.15.17:0/2144003434 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:00.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.491+0000 7f00d5a00640 1 -- 172.21.15.17:0/2144003434 >> v2:172.21.15.94:3300/0 conn(0x7f00d00b1860 msgr2=0x7f00d00b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:00.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.491+0000 7f00d5000640 1 --2- 172.21.15.17:0/2144003434 >> v2:172.21.15.94:3300/0 conn(0x7f00d00b1860 0x7f00d00b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:00.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.491+0000 7f00d5a00640 1 --2- 172.21.15.17:0/2144003434 >> v2:172.21.15.94:3300/0 conn(0x7f00d00b1860 0x7f00d00b4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:00.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.491+0000 7f00d5a00640 1 -- 172.21.15.17:0/2144003434 >> v1:172.21.15.94:6789/0 conn(0x7f00d0070240 legacy=0x7f00d00abb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:00.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.491+0000 7f00d5a00640 1 -- 172.21.15.17:0/2144003434 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d0146680 con 0x7f00d0145dc0 2024-03-12T17:19:00.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.492+0000 7f00d5a00640 1 --2- 172.21.15.17:0/2144003434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00d0145dc0 0x7f00d0160ff0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f00d00b4b20 tx=0x7f00c402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21012a562300e403 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:00.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.493+0000 7f00cfe00640 1 -- 172.21.15.17:0/2144003434 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c4031870 con 0x7f00d0145dc0 2024-03-12T17:19:00.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.493+0000 7f00cfe00640 1 -- 172.21.15.17:0/2144003434 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c40319d0 con 0x7f00d0145dc0 2024-03-12T17:19:00.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.493+0000 7f00cfe00640 1 -- 172.21.15.17:0/2144003434 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c4031d60 con 0x7f00d0145dc0 2024-03-12T17:19:00.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.493+0000 7f00d6e00640 1 -- 172.21.15.17:0/2144003434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00d0145dc0 msgr2=0x7f00d0160ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:00.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.493+0000 7f00d6e00640 1 --2- 172.21.15.17:0/2144003434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00d0145dc0 0x7f00d0160ff0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f00d00b4b20 tx=0x7f00c402b910 comp rx=0 tx=0).stop 2024-03-12T17:19:00.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.494+0000 7f00d6e00640 1 -- 172.21.15.17:0/2144003434 shutdown_connections 2024-03-12T17:19:00.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.494+0000 7f00d6e00640 1 --2- 172.21.15.17:0/2144003434 >> v2:172.21.15.94:3300/0 conn(0x7f00d00b1860 0x7f00d00b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:00.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.494+0000 7f00d6e00640 1 --2- 172.21.15.17:0/2144003434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00d0145dc0 0x7f00d0160ff0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:00.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.494+0000 7f00d6e00640 1 -- 172.21.15.17:0/2144003434 >> 172.21.15.17:0/2144003434 conn(0x7f00d0069ce0 msgr2=0x7f00d006a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:00.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.494+0000 7f00d6e00640 1 -- 172.21.15.17:0/2144003434 shutdown_connections 2024-03-12T17:19:00.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.494+0000 7f00d6e00640 1 -- 172.21.15.17:0/2144003434 wait complete. 2024-03-12T17:19:00.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.495+0000 7f00d6e00640 1 Processor -- start 2024-03-12T17:19:00.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.496+0000 7f00d6e00640 1 -- start start 2024-03-12T17:19:00.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.497+0000 7f00d6e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f00d0070240 0x7f00d01407d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:00.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.497+0000 7f00d6e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00d00b1860 0x7f00d01f1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:00.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.497+0000 7f00d6e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f00d0145dc0 0x7f00d00c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:00.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.497+0000 7f00d6e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d01435c0 con 0x7f00d00b1860 2024-03-12T17:19:00.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.497+0000 7f00d6e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00d01429f0 con 0x7f00d0070240 2024-03-12T17:19:00.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.497+0000 7f00d6e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00d0142c90 con 0x7f00d0145dc0 2024-03-12T17:19:00.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.497+0000 7f00d5000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00d00b1860 0x7f00d01f1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:00.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.497+0000 7f00d5000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00d00b1860 0x7f00d01f1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39078/0 (socket says 172.21.15.17:39078) 2024-03-12T17:19:00.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.497+0000 7f00d5000640 1 -- 172.21.15.17:0/2674885024 learned_addr learned my addr 172.21.15.17:0/2674885024 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:00.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.497+0000 7f00d6400640 1 --2- 172.21.15.17:0/2674885024 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f00d0145dc0 0x7f00d00c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:00.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.497+0000 7f00d5a00640 1 --2- 172.21.15.17:0/2674885024 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f00d0070240 0x7f00d01407d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:00.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.497+0000 7f00d5000640 1 -- 172.21.15.17:0/2674885024 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f00d0145dc0 msgr2=0x7f00d00c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:00.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.497+0000 7f00d5000640 1 --2- 172.21.15.17:0/2674885024 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f00d0145dc0 0x7f00d00c41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:00.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.497+0000 7f00d5000640 1 -- 172.21.15.17:0/2674885024 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f00d0070240 msgr2=0x7f00d01407d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:00.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.497+0000 7f00d5000640 1 --2- 172.21.15.17:0/2674885024 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f00d0070240 0x7f00d01407d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:00.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.497+0000 7f00d5000640 1 -- 172.21.15.17:0/2674885024 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c40094d0 con 0x7f00d00b1860 2024-03-12T17:19:00.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.497+0000 7f00d6400640 1 --2- 172.21.15.17:0/2674885024 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f00d0145dc0 0x7f00d00c41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:00.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.498+0000 7f00d5000640 1 --2- 172.21.15.17:0/2674885024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00d00b1860 0x7f00d01f1e40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f00bc00c7f0 tx=0x7f00bc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:00.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.498+0000 7f00cd600640 1 -- 172.21.15.17:0/2674885024 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00bc004220 con 0x7f00d00b1860 2024-03-12T17:19:00.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.498+0000 7f00cd600640 1 -- 172.21.15.17:0/2674885024 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00bc0043a0 con 0x7f00d00b1860 2024-03-12T17:19:00.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.498+0000 7f00cd600640 1 -- 172.21.15.17:0/2674885024 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00bc007860 con 0x7f00d00b1860 2024-03-12T17:19:00.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.498+0000 7f00d6e00640 1 -- 172.21.15.17:0/2674885024 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00d0142f70 con 0x7f00d00b1860 2024-03-12T17:19:00.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.498+0000 7f00d6e00640 1 -- 172.21.15.17:0/2674885024 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00d0145210 con 0x7f00d00b1860 2024-03-12T17:19:00.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.499+0000 7f00d6e00640 1 -- 172.21.15.17:0/2674885024 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00d004e030 con 0x7f00d00b1860 2024-03-12T17:19:00.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.500+0000 7f00cd600640 1 -- 172.21.15.17:0/2674885024 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f00bc007bd0 con 0x7f00d00b1860 2024-03-12T17:19:00.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.501+0000 7f00cd600640 1 --2- 172.21.15.17:0/2674885024 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f00b006ac30 0x7f00b006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:00.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.501+0000 7f00cd600640 1 -- 172.21.15.17:0/2674885024 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f00bc089350 con 0x7f00d00b1860 2024-03-12T17:19:00.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.501+0000 7f00d5a00640 1 --2- 172.21.15.17:0/2674885024 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f00b006ac30 0x7f00b006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:00.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.502+0000 7f00d5a00640 1 --2- 172.21.15.17:0/2674885024 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f00b006ac30 0x7f00b006d0f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f00c4036000 tx=0x7f00c403c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:00.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.506+0000 7f00cd600640 1 -- 172.21.15.17:0/2674885024 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f00bc054490 con 0x7f00d00b1860 2024-03-12T17:19:00.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.697+0000 7f00d6e00640 1 -- 172.21.15.17:0/2674885024 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f00d015fe20 con 0x7f00d00b1860 2024-03-12T17:19:00.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.698+0000 7f00cd600640 1 -- 172.21.15.17:0/2674885024 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f00bc057ab0 con 0x7f00d00b1860 2024-03-12T17:19:00.694 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-03-12T17:19:00.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.701+0000 7f00d6e00640 1 -- 172.21.15.17:0/2674885024 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f00b006ac30 msgr2=0x7f00b006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:00.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.701+0000 7f00d6e00640 1 --2- 172.21.15.17:0/2674885024 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f00b006ac30 0x7f00b006d0f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f00c4036000 tx=0x7f00c403c040 comp rx=0 tx=0).stop 2024-03-12T17:19:00.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.701+0000 7f00d6e00640 1 -- 172.21.15.17:0/2674885024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00d00b1860 msgr2=0x7f00d01f1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:00.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.701+0000 7f00d6e00640 1 --2- 172.21.15.17:0/2674885024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00d00b1860 0x7f00d01f1e40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f00bc00c7f0 tx=0x7f00bc00ccb0 comp rx=0 tx=0).stop 2024-03-12T17:19:00.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.701+0000 7f00d6e00640 1 -- 172.21.15.17:0/2674885024 shutdown_connections 2024-03-12T17:19:00.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.701+0000 7f00d6e00640 1 --2- 172.21.15.17:0/2674885024 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f00b006ac30 0x7f00b006d0f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:00.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.701+0000 7f00d6e00640 1 --2- 172.21.15.17:0/2674885024 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f00d0145dc0 0x7f00d00c41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:00.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.701+0000 7f00d6e00640 1 --2- 172.21.15.17:0/2674885024 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f00d00b1860 0x7f00d01f1e40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:00.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.701+0000 7f00d6e00640 1 --2- 172.21.15.17:0/2674885024 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f00d0070240 0x7f00d01407d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:00.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.701+0000 7f00d6e00640 1 -- 172.21.15.17:0/2674885024 >> 172.21.15.17:0/2674885024 conn(0x7f00d0069ce0 msgr2=0x7f00d00b07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:00.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.701+0000 7f00d6e00640 1 -- 172.21.15.17:0/2674885024 shutdown_connections 2024-03-12T17:19:00.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.701+0000 7f00d6e00640 1 -- 172.21.15.17:0/2674885024 wait complete. 2024-03-12T17:19:00.715 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-12T17:19:00.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.937+0000 7f3dab200640 1 Processor -- start 2024-03-12T17:19:00.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.937+0000 7f3dab200640 1 -- start start 2024-03-12T17:19:00.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.938+0000 7f3dab200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3dac0ccea0 0x7f3dac13fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:00.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.938+0000 7f3dab200640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3dac1403a0 0x7f3dac140850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:00.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.938+0000 7f3dab200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dac15bd70 con 0x7f3dac070ba0 2024-03-12T17:19:00.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.938+0000 7f3dab200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dac140e80 con 0x7f3dac0ccea0 2024-03-12T17:19:00.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.938+0000 7f3dab200640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dac15adc0 con 0x7f3dac1403a0 2024-03-12T17:19:00.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.938+0000 7f3da9e00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f3dac070ba0 0x7f3dac0cc790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37052/0 (socket says 172.21.15.17:37052) 2024-03-12T17:19:00.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.939+0000 7f3da9e00640 1 -- 172.21.15.17:0/2330243196 learned_addr learned my addr 172.21.15.17:0/2330243196 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:00.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.939+0000 7f3da3e00640 1 --2- 172.21.15.17:0/2330243196 >> v2:172.21.15.17:3300/0 conn(0x7f3dac0ccea0 0x7f3dac13fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:00.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.939+0000 7f3daa800640 1 --2- 172.21.15.17:0/2330243196 >> v2:172.21.15.94:3300/0 conn(0x7f3dac1403a0 0x7f3dac140850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:00.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.939+0000 7f3da9400640 1 -- 172.21.15.17:0/2330243196 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 663051353 0 0) 0x7f3d9c001110 con 0x7f3dac070ba0 2024-03-12T17:19:00.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.939+0000 7f3da9400640 1 -- 172.21.15.17:0/2330243196 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d90003520 con 0x7f3dac070ba0 2024-03-12T17:19:00.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.939+0000 7f3da3e00640 1 -- 172.21.15.17:0/2330243196 >> v2:172.21.15.94:3300/0 conn(0x7f3dac1403a0 msgr2=0x7f3dac140850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:00.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.939+0000 7f3da3e00640 1 --2- 172.21.15.17:0/2330243196 >> v2:172.21.15.94:3300/0 conn(0x7f3dac1403a0 0x7f3dac140850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:00.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.939+0000 7f3da3e00640 1 -- 172.21.15.17:0/2330243196 >> v1:172.21.15.17:6789/0 conn(0x7f3dac070ba0 legacy=0x7f3dac0cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:00.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.939+0000 7f3da3e00640 1 -- 172.21.15.17:0/2330243196 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dac070f80 con 0x7f3dac0ccea0 2024-03-12T17:19:00.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.940+0000 7f3da3e00640 1 --2- 172.21.15.17:0/2330243196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3dac0ccea0 0x7f3dac13fe60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0cdba0 tx=0x7f3d9402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=950800e42cc793f7 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:00.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.940+0000 7f3da9400640 1 -- 172.21.15.17:0/2330243196 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d94031830 con 0x7f3dac0ccea0 2024-03-12T17:19:00.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.941+0000 7f3da9400640 1 -- 172.21.15.17:0/2330243196 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d94031990 con 0x7f3dac0ccea0 2024-03-12T17:19:00.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.941+0000 7f3da9400640 1 -- 172.21.15.17:0/2330243196 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d94031d20 con 0x7f3dac0ccea0 2024-03-12T17:19:00.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.941+0000 7f3dab200640 1 -- 172.21.15.17:0/2330243196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3dac0ccea0 msgr2=0x7f3dac13fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:00.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.941+0000 7f3dab200640 1 --2- 172.21.15.17:0/2330243196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3dac0ccea0 0x7f3dac13fe60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0cdba0 tx=0x7f3d9402b8d0 comp rx=0 tx=0).stop 2024-03-12T17:19:00.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.941+0000 7f3dab200640 1 -- 172.21.15.17:0/2330243196 shutdown_connections 2024-03-12T17:19:00.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.941+0000 7f3dab200640 1 --2- 172.21.15.17:0/2330243196 >> v2:172.21.15.94:3300/0 conn(0x7f3dac1403a0 0x7f3dac140850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:00.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.941+0000 7f3dab200640 1 --2- 172.21.15.17:0/2330243196 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3dac0ccea0 0x7f3dac13fe60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:00.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.941+0000 7f3dab200640 1 -- 172.21.15.17:0/2330243196 >> 172.21.15.17:0/2330243196 conn(0x7f3dac066000 msgr2=0x7f3dac069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:00.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.941+0000 7f3dab200640 1 -- 172.21.15.17:0/2330243196 shutdown_connections 2024-03-12T17:19:00.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.941+0000 7f3dab200640 1 -- 172.21.15.17:0/2330243196 wait complete. 2024-03-12T17:19:00.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.943+0000 7f3dab200640 1 Processor -- start 2024-03-12T17:19:00.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.943+0000 7f3dab200640 1 -- start start 2024-03-12T17:19:00.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.944+0000 7f3dab200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3dac070ba0 0x7f3dac153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:00.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.944+0000 7f3dab200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3dac0ccea0 0x7f3dac152350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:00.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.944+0000 7f3dab200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3dac1403a0 0x7f3dac136250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:00.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.944+0000 7f3dab200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dac13b1f0 con 0x7f3dac1403a0 2024-03-12T17:19:00.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.944+0000 7f3dab200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dac153bf0 con 0x7f3dac070ba0 2024-03-12T17:19:00.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.944+0000 7f3dab200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dac152890 con 0x7f3dac0ccea0 2024-03-12T17:19:00.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.945+0000 7f3daa800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3dac1403a0 0x7f3dac136250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:00.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.945+0000 7f3daa800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3dac1403a0 0x7f3dac136250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39096/0 (socket says 172.21.15.17:39096) 2024-03-12T17:19:00.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.945+0000 7f3daa800640 1 -- 172.21.15.17:0/800435952 learned_addr learned my addr 172.21.15.17:0/800435952 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:00.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.945+0000 7f3da9e00640 1 --2- 172.21.15.17:0/800435952 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3dac070ba0 0x7f3dac153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:00.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.945+0000 7f3da3e00640 1 --2- 172.21.15.17:0/800435952 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3dac0ccea0 0x7f3dac152350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:00.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.945+0000 7f3daa800640 1 -- 172.21.15.17:0/800435952 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3dac0ccea0 msgr2=0x7f3dac152350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:00.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.945+0000 7f3daa800640 1 --2- 172.21.15.17:0/800435952 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3dac0ccea0 0x7f3dac152350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:00.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.945+0000 7f3daa800640 1 -- 172.21.15.17:0/800435952 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3dac070ba0 msgr2=0x7f3dac153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:00.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.945+0000 7f3daa800640 1 --2- 172.21.15.17:0/800435952 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3dac070ba0 0x7f3dac153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:00.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.945+0000 7f3daa800640 1 -- 172.21.15.17:0/800435952 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d94009400 con 0x7f3dac1403a0 2024-03-12T17:19:00.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.945+0000 7f3da9e00640 1 --2- 172.21.15.17:0/800435952 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3dac070ba0 0x7f3dac153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:19:00.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.945+0000 7f3daa800640 1 --2- 172.21.15.17:0/800435952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3dac1403a0 0x7f3dac136250 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3da4007e60 tx=0x7f3da400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:00.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.946+0000 7f3da2000640 1 -- 172.21.15.17:0/800435952 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da4014420 con 0x7f3dac1403a0 2024-03-12T17:19:00.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.946+0000 7f3da2000640 1 -- 172.21.15.17:0/800435952 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da40145a0 con 0x7f3dac1403a0 2024-03-12T17:19:00.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.946+0000 7f3da2000640 1 -- 172.21.15.17:0/800435952 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da4014950 con 0x7f3dac1403a0 2024-03-12T17:19:00.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.946+0000 7f3dab200640 1 -- 172.21.15.17:0/800435952 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dac152fe0 con 0x7f3dac1403a0 2024-03-12T17:19:00.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.946+0000 7f3dab200640 1 -- 172.21.15.17:0/800435952 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dac1535a0 con 0x7f3dac1403a0 2024-03-12T17:19:00.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.947+0000 7f3dab200640 1 -- 172.21.15.17:0/800435952 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dac153d80 con 0x7f3dac1403a0 2024-03-12T17:19:00.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.948+0000 7f3da2000640 1 -- 172.21.15.17:0/800435952 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f3da4014ab0 con 0x7f3dac1403a0 2024-03-12T17:19:00.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.949+0000 7f3da2000640 1 --2- 172.21.15.17:0/800435952 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f3d8806ac00 0x7f3d8806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:00.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.949+0000 7f3da2000640 1 -- 172.21.15.17:0/800435952 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3da4089c60 con 0x7f3dac1403a0 2024-03-12T17:19:00.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.949+0000 7f3da9e00640 1 --2- 172.21.15.17:0/800435952 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f3d8806ac00 0x7f3d8806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:00.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.950+0000 7f3da9e00640 1 --2- 172.21.15.17:0/800435952 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f3d8806ac00 0x7f3d8806d0c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c001270 tx=0x7f3d9c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:00.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:00.953+0000 7f3da2000640 1 -- 172.21.15.17:0/800435952 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f3da4054e30 con 0x7f3dac1403a0 2024-03-12T17:19:01.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.142+0000 7f3dab200640 1 -- 172.21.15.17:0/800435952 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3dac15b060 con 0x7f3dac1403a0 2024-03-12T17:19:01.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.143+0000 7f3da2000640 1 -- 172.21.15.17:0/800435952 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3da4058450 con 0x7f3dac1403a0 2024-03-12T17:19:01.139 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-03-12T17:19:01.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.146+0000 7f3dab200640 1 -- 172.21.15.17:0/800435952 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f3d8806ac00 msgr2=0x7f3d8806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:01.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.146+0000 7f3dab200640 1 --2- 172.21.15.17:0/800435952 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f3d8806ac00 0x7f3d8806d0c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c001270 tx=0x7f3d9c009040 comp rx=0 tx=0).stop 2024-03-12T17:19:01.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.146+0000 7f3dab200640 1 -- 172.21.15.17:0/800435952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3dac1403a0 msgr2=0x7f3dac136250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:01.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.146+0000 7f3dab200640 1 --2- 172.21.15.17:0/800435952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3dac1403a0 0x7f3dac136250 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3da4007e60 tx=0x7f3da400e4b0 comp rx=0 tx=0).stop 2024-03-12T17:19:01.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.146+0000 7f3dab200640 1 -- 172.21.15.17:0/800435952 shutdown_connections 2024-03-12T17:19:01.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.146+0000 7f3dab200640 1 --2- 172.21.15.17:0/800435952 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f3d8806ac00 0x7f3d8806d0c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:01.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.146+0000 7f3dab200640 1 --2- 172.21.15.17:0/800435952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3dac1403a0 0x7f3dac136250 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:01.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.146+0000 7f3dab200640 1 --2- 172.21.15.17:0/800435952 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3dac0ccea0 0x7f3dac152350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:01.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.146+0000 7f3dab200640 1 --2- 172.21.15.17:0/800435952 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3dac070ba0 0x7f3dac153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:01.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.146+0000 7f3dab200640 1 -- 172.21.15.17:0/800435952 >> 172.21.15.17:0/800435952 conn(0x7f3dac066000 msgr2=0x7f3dac15d120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:01.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.146+0000 7f3dab200640 1 -- 172.21.15.17:0/800435952 shutdown_connections 2024-03-12T17:19:01.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.146+0000 7f3dab200640 1 -- 172.21.15.17:0/800435952 wait complete. 2024-03-12T17:19:01.158 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-12T17:19:01.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.381+0000 7f1889600640 1 Processor -- start 2024-03-12T17:19:01.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.381+0000 7f1889600640 1 -- start start 2024-03-12T17:19:01.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.383+0000 7f1889600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18840b3b70 0x7f18840b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:01.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.383+0000 7f1889600640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18840a7660 con 0x7f18841441f0 2024-03-12T17:19:01.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.383+0000 7f1889600640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18840b44e0 con 0x7f188415ae20 2024-03-12T17:19:01.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.383+0000 7f1889600640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f188415e460 con 0x7f18840b3b70 2024-03-12T17:19:01.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.383+0000 7f1883e00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f18841441f0 0x7f1884070240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37062/0 (socket says 172.21.15.17:37062) 2024-03-12T17:19:01.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.383+0000 7f1883e00640 1 -- 172.21.15.17:0/1771855057 learned_addr learned my addr 172.21.15.17:0/1771855057 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:01.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.383+0000 7f1882a00640 1 -- 172.21.15.17:0/1771855057 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2377242552 0 0) 0x7f18840a7660 con 0x7f18841441f0 2024-03-12T17:19:01.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.383+0000 7f1882a00640 1 -- 172.21.15.17:0/1771855057 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1868003520 con 0x7f18841441f0 2024-03-12T17:19:01.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.384+0000 7f1888c00640 1 --2- 172.21.15.17:0/1771855057 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18840b3b70 0x7f18840b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:01.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.384+0000 7f1882a00640 1 -- 172.21.15.17:0/1771855057 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2001829088 0 0) 0x7f1868003520 con 0x7f18841441f0 2024-03-12T17:19:01.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.384+0000 7f1882a00640 1 -- 172.21.15.17:0/1771855057 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18840b3b70 msgr2=0x7f18840b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:01.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.384+0000 7f1882a00640 1 --2- 172.21.15.17:0/1771855057 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18840b3b70 0x7f18840b3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:01.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.384+0000 7f1882a00640 1 -- 172.21.15.17:0/1771855057 >> v1:172.21.15.94:6789/0 conn(0x7f188415ae20 legacy=0x7f188406d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:01.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.384+0000 7f1882a00640 1 -- 172.21.15.17:0/1771855057 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18841445d0 con 0x7f18841441f0 2024-03-12T17:19:01.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.384+0000 7f1882a00640 1 -- 172.21.15.17:0/1771855057 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7f18740019f0 con 0x7f18841441f0 2024-03-12T17:19:01.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.384+0000 7f1882a00640 1 -- 172.21.15.17:0/1771855057 >> v1:172.21.15.17:6789/0 conn(0x7f18841441f0 legacy=0x7f1884070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:01.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.384+0000 7f1882a00640 1 --2- 172.21.15.17:0/1771855057 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18840b3b70 0x7f18680039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:01.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.384+0000 7f1882a00640 1 --2- 172.21.15.17:0/1771855057 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1868004120 0x7f18680047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:01.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.384+0000 7f1882a00640 1 --2- 172.21.15.17:0/1771855057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1868004e20 0x7f186800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:01.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.384+0000 7f1882a00640 1 -- 172.21.15.17:0/1771855057 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188415e460 con 0x7f1868004e20 2024-03-12T17:19:01.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.384+0000 7f1882a00640 1 -- 172.21.15.17:0/1771855057 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1868005610 con 0x7f1868004120 2024-03-12T17:19:01.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.384+0000 7f1882a00640 1 -- 172.21.15.17:0/1771855057 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f186800bec0 con 0x7f18840b3b70 2024-03-12T17:19:01.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.384+0000 7f1888c00640 1 --2- 172.21.15.17:0/1771855057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1868004e20 0x7f186800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:01.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.384+0000 7f1883e00640 1 --2- 172.21.15.17:0/1771855057 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18840b3b70 0x7f18680039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:01.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.385+0000 7f1883400640 1 --2- 172.21.15.17:0/1771855057 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1868004120 0x7f18680047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:01.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.385+0000 7f1888c00640 1 -- 172.21.15.17:0/1771855057 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18840b3b70 msgr2=0x7f18680039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:01.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.385+0000 7f1888c00640 1 --2- 172.21.15.17:0/1771855057 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18840b3b70 0x7f18680039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:01.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.385+0000 7f1888c00640 1 -- 172.21.15.17:0/1771855057 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1868004120 msgr2=0x7f18680047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:01.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.385+0000 7f1888c00640 1 --2- 172.21.15.17:0/1771855057 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1868004120 0x7f18680047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:01.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.385+0000 7f1888c00640 1 -- 172.21.15.17:0/1771855057 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1868003520 con 0x7f1868004e20 2024-03-12T17:19:01.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.386+0000 7f1888c00640 1 --2- 172.21.15.17:0/1771855057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1868004e20 0x7f186800b980 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f187c00a9a0 tx=0x7f18680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c63d611ab671fcfe server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:01.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.386+0000 7f1882a00640 1 -- 172.21.15.17:0/1771855057 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c030400 con 0x7f1868004e20 2024-03-12T17:19:01.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.386+0000 7f1882a00640 1 -- 172.21.15.17:0/1771855057 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187c030560 con 0x7f1868004e20 2024-03-12T17:19:01.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.386+0000 7f1882a00640 1 -- 172.21.15.17:0/1771855057 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c030950 con 0x7f1868004e20 2024-03-12T17:19:01.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.387+0000 7f1889600640 1 -- 172.21.15.17:0/1771855057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1868004e20 msgr2=0x7f186800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:01.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.387+0000 7f1889600640 1 --2- 172.21.15.17:0/1771855057 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1868004e20 0x7f186800b980 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f187c00a9a0 tx=0x7f18680057f0 comp rx=0 tx=0).stop 2024-03-12T17:19:01.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.387+0000 7f1888c00640 1 -- 172.21.15.17:0/1771855057 reap_dead start 2024-03-12T17:19:01.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.387+0000 7f1889600640 1 -- 172.21.15.17:0/1771855057 shutdown_connections 2024-03-12T17:19:01.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.387+0000 7f1889600640 1 -- 172.21.15.17:0/1771855057 >> 172.21.15.17:0/1771855057 conn(0x7f1884069ce0 msgr2=0x7f188406a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:01.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.387+0000 7f1889600640 1 -- 172.21.15.17:0/1771855057 shutdown_connections 2024-03-12T17:19:01.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.387+0000 7f1889600640 1 -- 172.21.15.17:0/1771855057 wait complete. 2024-03-12T17:19:01.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.389+0000 7f1889600640 1 Processor -- start 2024-03-12T17:19:01.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.389+0000 7f1889600640 1 -- start start 2024-03-12T17:19:01.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.390+0000 7f1889600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1868004e20 0x7f18841f0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:01.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.390+0000 7f1889600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18841efdc0 0x7f1884137a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:01.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.390+0000 7f1889600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1884137fa0 0x7f188414c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:01.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.390+0000 7f1889600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18841f0ae0 con 0x7f1884137fa0 2024-03-12T17:19:01.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.390+0000 7f1889600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18841f0240 con 0x7f1868004e20 2024-03-12T17:19:01.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.390+0000 7f1889600640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1884138420 con 0x7f18841efdc0 2024-03-12T17:19:01.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.390+0000 7f1888c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1884137fa0 0x7f188414c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:01.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.390+0000 7f1888c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1884137fa0 0x7f188414c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39120/0 (socket says 172.21.15.17:39120) 2024-03-12T17:19:01.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.390+0000 7f1888c00640 1 -- 172.21.15.17:0/1918356023 learned_addr learned my addr 172.21.15.17:0/1918356023 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:01.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.391+0000 7f1883400640 1 --2- 172.21.15.17:0/1918356023 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18841efdc0 0x7f1884137a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:01.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.391+0000 7f1883e00640 1 --2- 172.21.15.17:0/1918356023 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1868004e20 0x7f18841f0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:01.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.391+0000 7f1888c00640 1 -- 172.21.15.17:0/1918356023 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18841efdc0 msgr2=0x7f1884137a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:01.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.391+0000 7f1888c00640 1 --2- 172.21.15.17:0/1918356023 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18841efdc0 0x7f1884137a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:01.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.391+0000 7f1888c00640 1 -- 172.21.15.17:0/1918356023 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1868004e20 msgr2=0x7f18841f0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:01.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.391+0000 7f1888c00640 1 --2- 172.21.15.17:0/1918356023 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1868004e20 0x7f18841f0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:01.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.391+0000 7f1888c00640 1 -- 172.21.15.17:0/1918356023 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18841f3c00 con 0x7f1884137fa0 2024-03-12T17:19:01.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.391+0000 7f1888c00640 1 --2- 172.21.15.17:0/1918356023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1884137fa0 0x7f188414c900 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f187c00aac0 tx=0x7f187c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:01.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.391+0000 7f187be00640 1 -- 172.21.15.17:0/1918356023 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c039860 con 0x7f1884137fa0 2024-03-12T17:19:01.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.391+0000 7f187be00640 1 -- 172.21.15.17:0/1918356023 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187c0399c0 con 0x7f1884137fa0 2024-03-12T17:19:01.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.391+0000 7f187be00640 1 -- 172.21.15.17:0/1918356023 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c039d30 con 0x7f1884137fa0 2024-03-12T17:19:01.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.391+0000 7f1889600640 1 -- 172.21.15.17:0/1918356023 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f188414d4e0 con 0x7f1884137fa0 2024-03-12T17:19:01.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.392+0000 7f1889600640 1 -- 172.21.15.17:0/1918356023 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18841f0420 con 0x7f1884137fa0 2024-03-12T17:19:01.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.393+0000 7f1889600640 1 -- 172.21.15.17:0/1918356023 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f188404e030 con 0x7f1884137fa0 2024-03-12T17:19:01.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.393+0000 7f187be00640 1 -- 172.21.15.17:0/1918356023 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f187c044430 con 0x7f1884137fa0 2024-03-12T17:19:01.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.394+0000 7f187be00640 1 --2- 172.21.15.17:0/1918356023 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f186406ac00 0x7f186406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:01.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.394+0000 7f187be00640 1 -- 172.21.15.17:0/1918356023 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f187c000e40 con 0x7f1884137fa0 2024-03-12T17:19:01.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.395+0000 7f1883e00640 1 --2- 172.21.15.17:0/1918356023 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f186406ac00 0x7f186406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:01.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.395+0000 7f1883e00640 1 --2- 172.21.15.17:0/1918356023 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f186406ac00 0x7f186406d0c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f18740013d0 tx=0x7f1874009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:01.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.399+0000 7f187be00640 1 -- 172.21.15.17:0/1918356023 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f187c0769d0 con 0x7f1884137fa0 2024-03-12T17:19:01.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.602+0000 7f1889600640 1 -- 172.21.15.17:0/1918356023 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f18840ae6c0 con 0x7f1884137fa0 2024-03-12T17:19:01.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.603+0000 7f187be00640 1 -- 172.21.15.17:0/1918356023 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f187c02d030 con 0x7f1884137fa0 2024-03-12T17:19:01.598 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-03-12T17:19:01.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.605+0000 7f1889600640 1 -- 172.21.15.17:0/1918356023 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f186406ac00 msgr2=0x7f186406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:01.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.605+0000 7f1889600640 1 --2- 172.21.15.17:0/1918356023 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f186406ac00 0x7f186406d0c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f18740013d0 tx=0x7f1874009040 comp rx=0 tx=0).stop 2024-03-12T17:19:01.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.605+0000 7f1889600640 1 -- 172.21.15.17:0/1918356023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1884137fa0 msgr2=0x7f188414c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:01.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.605+0000 7f1889600640 1 --2- 172.21.15.17:0/1918356023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1884137fa0 0x7f188414c900 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f187c00aac0 tx=0x7f187c0046c0 comp rx=0 tx=0).stop 2024-03-12T17:19:01.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.605+0000 7f1889600640 1 -- 172.21.15.17:0/1918356023 shutdown_connections 2024-03-12T17:19:01.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.605+0000 7f1889600640 1 --2- 172.21.15.17:0/1918356023 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f186406ac00 0x7f186406d0c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:01.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.605+0000 7f1889600640 1 --2- 172.21.15.17:0/1918356023 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1884137fa0 0x7f188414c900 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:01.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.605+0000 7f1889600640 1 --2- 172.21.15.17:0/1918356023 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18841efdc0 0x7f1884137a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:01.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.605+0000 7f1889600640 1 --2- 172.21.15.17:0/1918356023 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1868004e20 0x7f18841f0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:01.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.605+0000 7f1889600640 1 -- 172.21.15.17:0/1918356023 >> 172.21.15.17:0/1918356023 conn(0x7f1884069ce0 msgr2=0x7f1884142030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:01.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.605+0000 7f1889600640 1 -- 172.21.15.17:0/1918356023 shutdown_connections 2024-03-12T17:19:01.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.605+0000 7f1889600640 1 -- 172.21.15.17:0/1918356023 wait complete. 2024-03-12T17:19:01.621 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-12T17:19:01.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.839+0000 7fc128400640 1 Processor -- start 2024-03-12T17:19:01.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.839+0000 7fc128400640 1 -- start start 2024-03-12T17:19:01.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.841+0000 7fc128400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc120144240 0x7fc1200ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:01.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.841+0000 7fc128400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc1200cb970 0x7fc1200cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:01.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.841+0000 7fc128400640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1200ce320 con 0x7fc1200cecf0 2024-03-12T17:19:01.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.841+0000 7fc128400640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1200cc340 con 0x7fc120144240 2024-03-12T17:19:01.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.841+0000 7fc128400640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc120144620 con 0x7fc1200cb970 2024-03-12T17:19:01.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.841+0000 7fc125a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc120144240 0x7fc1200ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:01.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.841+0000 7fc125000640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fc1200cecf0 0x7fc1200b2070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37070/0 (socket says 172.21.15.17:37070) 2024-03-12T17:19:01.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.841+0000 7fc125000640 1 -- 172.21.15.17:0/4078645176 learned_addr learned my addr 172.21.15.17:0/4078645176 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:01.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.841+0000 7fc125a00640 1 -- 172.21.15.17:0/4078645176 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc1200cb970 msgr2=0x7fc1200cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:01.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.841+0000 7fc125a00640 1 --2- 172.21.15.17:0/4078645176 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc1200cb970 0x7fc1200cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:01.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.841+0000 7fc125a00640 1 -- 172.21.15.17:0/4078645176 >> v1:172.21.15.17:6789/0 conn(0x7fc1200cecf0 legacy=0x7fc1200b2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:01.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.841+0000 7fc125a00640 1 -- 172.21.15.17:0/4078645176 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc12015f3d0 con 0x7fc120144240 2024-03-12T17:19:01.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.843+0000 7fc125a00640 1 --2- 172.21.15.17:0/4078645176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc120144240 0x7fc1200ce7b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc110009d90 tx=0x7fc11002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5b316d00a73bf48 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:01.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.843+0000 7fc11fe00640 1 -- 172.21.15.17:0/4078645176 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11002cc60 con 0x7fc120144240 2024-03-12T17:19:01.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.843+0000 7fc11fe00640 1 -- 172.21.15.17:0/4078645176 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11002cdc0 con 0x7fc120144240 2024-03-12T17:19:01.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.843+0000 7fc11fe00640 1 -- 172.21.15.17:0/4078645176 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc110034660 con 0x7fc120144240 2024-03-12T17:19:01.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.843+0000 7fc128400640 1 -- 172.21.15.17:0/4078645176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc120144240 msgr2=0x7fc1200ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:01.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.843+0000 7fc128400640 1 --2- 172.21.15.17:0/4078645176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc120144240 0x7fc1200ce7b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc110009d90 tx=0x7fc11002beb0 comp rx=0 tx=0).stop 2024-03-12T17:19:01.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.844+0000 7fc128400640 1 -- 172.21.15.17:0/4078645176 shutdown_connections 2024-03-12T17:19:01.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.844+0000 7fc128400640 1 --2- 172.21.15.17:0/4078645176 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc1200cb970 0x7fc1200cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:01.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.844+0000 7fc128400640 1 --2- 172.21.15.17:0/4078645176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc120144240 0x7fc1200ce7b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:01.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.844+0000 7fc128400640 1 -- 172.21.15.17:0/4078645176 >> 172.21.15.17:0/4078645176 conn(0x7fc120069ce0 msgr2=0x7fc12006a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:01.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.844+0000 7fc128400640 1 -- 172.21.15.17:0/4078645176 shutdown_connections 2024-03-12T17:19:01.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.844+0000 7fc128400640 1 -- 172.21.15.17:0/4078645176 wait complete. 2024-03-12T17:19:01.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.845+0000 7fc128400640 1 Processor -- start 2024-03-12T17:19:01.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.846+0000 7fc128400640 1 -- start start 2024-03-12T17:19:01.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.846+0000 7fc128400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1200cb970 0x7fc120151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:01.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.847+0000 7fc128400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1200cecf0 0x7fc1201f1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:01.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.847+0000 7fc128400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc120144240 0x7fc12013faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:01.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.847+0000 7fc128400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12014f690 con 0x7fc1200cb970 2024-03-12T17:19:01.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.847+0000 7fc128400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1201f2270 con 0x7fc1200cecf0 2024-03-12T17:19:01.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.847+0000 7fc128400640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc12014f060 con 0x7fc120144240 2024-03-12T17:19:01.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.847+0000 7fc125a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1200cb970 0x7fc120151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:01.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.847+0000 7fc125a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1200cb970 0x7fc120151ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39128/0 (socket says 172.21.15.17:39128) 2024-03-12T17:19:01.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.847+0000 7fc125a00640 1 -- 172.21.15.17:0/2140221238 learned_addr learned my addr 172.21.15.17:0/2140221238 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:01.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.847+0000 7fc125000640 1 --2- 172.21.15.17:0/2140221238 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1200cecf0 0x7fc1201f1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:01.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.847+0000 7fc126400640 1 --2- 172.21.15.17:0/2140221238 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc120144240 0x7fc12013faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:01.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.847+0000 7fc125a00640 1 -- 172.21.15.17:0/2140221238 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc120144240 msgr2=0x7fc12013faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:01.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.847+0000 7fc125a00640 1 --2- 172.21.15.17:0/2140221238 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc120144240 0x7fc12013faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:01.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.847+0000 7fc125a00640 1 -- 172.21.15.17:0/2140221238 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1200cecf0 msgr2=0x7fc1201f1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:01.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.847+0000 7fc125a00640 1 --2- 172.21.15.17:0/2140221238 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1200cecf0 0x7fc1201f1d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:01.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.847+0000 7fc125a00640 1 -- 172.21.15.17:0/2140221238 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc110009a70 con 0x7fc1200cb970 2024-03-12T17:19:01.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.847+0000 7fc126400640 1 --2- 172.21.15.17:0/2140221238 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc120144240 0x7fc12013faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:01.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.847+0000 7fc125000640 1 --2- 172.21.15.17:0/2140221238 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1200cecf0 0x7fc1201f1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:01.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.848+0000 7fc125a00640 1 --2- 172.21.15.17:0/2140221238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1200cb970 0x7fc120151ca0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc110009d90 tx=0x7fc110004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:01.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.848+0000 7fc11d600640 1 -- 172.21.15.17:0/2140221238 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc110040650 con 0x7fc1200cb970 2024-03-12T17:19:01.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.848+0000 7fc11d600640 1 -- 172.21.15.17:0/2140221238 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1100407b0 con 0x7fc1200cb970 2024-03-12T17:19:01.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.848+0000 7fc11d600640 1 -- 172.21.15.17:0/2140221238 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc110040b60 con 0x7fc1200cb970 2024-03-12T17:19:01.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.848+0000 7fc128400640 1 -- 172.21.15.17:0/2140221238 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1200b0b10 con 0x7fc1200cb970 2024-03-12T17:19:01.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.848+0000 7fc128400640 1 -- 172.21.15.17:0/2140221238 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc12014f2b0 con 0x7fc1200cb970 2024-03-12T17:19:01.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.849+0000 7fc128400640 1 -- 172.21.15.17:0/2140221238 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1200736c0 con 0x7fc1200cb970 2024-03-12T17:19:01.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.850+0000 7fc11d600640 1 -- 172.21.15.17:0/2140221238 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fc110040cc0 con 0x7fc1200cb970 2024-03-12T17:19:01.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.851+0000 7fc11d600640 1 --2- 172.21.15.17:0/2140221238 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc10006ac00 0x7fc10006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:01.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.851+0000 7fc11d600640 1 -- 172.21.15.17:0/2140221238 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1100ac2f0 con 0x7fc1200cb970 2024-03-12T17:19:01.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.852+0000 7fc125000640 1 --2- 172.21.15.17:0/2140221238 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc10006ac00 0x7fc10006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:01.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.852+0000 7fc125000640 1 --2- 172.21.15.17:0/2140221238 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc10006ac00 0x7fc10006d0c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc120142ee0 tx=0x7fc10c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:01.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:01.856+0000 7fc11d600640 1 -- 172.21.15.17:0/2140221238 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fc1100774c0 con 0x7fc1200cb970 2024-03-12T17:19:02.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.096+0000 7fc128400640 1 -- 172.21.15.17:0/2140221238 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1200b1270 con 0x7fc1200cb970 2024-03-12T17:19:02.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.097+0000 7fc11d600640 1 -- 172.21.15.17:0/2140221238 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4725 (secure 0 0 0) 0x7fc11007aae0 con 0x7fc1200cb970 2024-03-12T17:19:02.093 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:19:02.093 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/4055209511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":4055209511},{"type":"v1","addr":"172.21.15.94:6833","nonce":4055209511}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4220,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/2079001512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2079001512},{"type":"v1","addr":"172.21.15.94:6835","nonce":2079001512}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6836/3710914262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3710914262},{"type":"v1","addr":"172.21.15.17:6836","nonce":3710914262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T17:18:45.842660+0000","modified":"2024-03-12T17:18:49.354081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6837/749237500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6835","nonce":749237500},{"type":"v1","addr":"172.21.15.17:6837","nonce":749237500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-12T17:19:02.093 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 7 2024-03-12T17:19:02.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.100+0000 7fc128400640 1 -- 172.21.15.17:0/2140221238 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc10006ac00 msgr2=0x7fc10006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:02.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.100+0000 7fc128400640 1 --2- 172.21.15.17:0/2140221238 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc10006ac00 0x7fc10006d0c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc120142ee0 tx=0x7fc10c009040 comp rx=0 tx=0).stop 2024-03-12T17:19:02.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.100+0000 7fc128400640 1 -- 172.21.15.17:0/2140221238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1200cb970 msgr2=0x7fc120151ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:02.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.100+0000 7fc128400640 1 --2- 172.21.15.17:0/2140221238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1200cb970 0x7fc120151ca0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc110009d90 tx=0x7fc110004a40 comp rx=0 tx=0).stop 2024-03-12T17:19:02.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.100+0000 7fc128400640 1 -- 172.21.15.17:0/2140221238 shutdown_connections 2024-03-12T17:19:02.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.100+0000 7fc128400640 1 --2- 172.21.15.17:0/2140221238 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc10006ac00 0x7fc10006d0c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:02.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.100+0000 7fc128400640 1 --2- 172.21.15.17:0/2140221238 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc120144240 0x7fc12013faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:02.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.100+0000 7fc128400640 1 --2- 172.21.15.17:0/2140221238 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc1200cecf0 0x7fc1201f1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:02.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.100+0000 7fc128400640 1 --2- 172.21.15.17:0/2140221238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc1200cb970 0x7fc120151ca0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:02.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.100+0000 7fc128400640 1 -- 172.21.15.17:0/2140221238 >> 172.21.15.17:0/2140221238 conn(0x7fc120069ce0 msgr2=0x7fc12015afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:02.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.100+0000 7fc128400640 1 -- 172.21.15.17:0/2140221238 shutdown_connections 2024-03-12T17:19:02.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.100+0000 7fc128400640 1 -- 172.21.15.17:0/2140221238 wait complete. 2024-03-12T17:19:02.116 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T17:19:02.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.336+0000 7f7e31000640 1 Processor -- start 2024-03-12T17:19:02.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.336+0000 7f7e31000640 1 -- start start 2024-03-12T17:19:02.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.338+0000 7f7e31000640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7e2c0cb930 0x7f7e2c0b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:02.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.338+0000 7f7e31000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7e2c0b23e0 0x7f7e2c0cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:02.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.338+0000 7f7e31000640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e2c0cc250 con 0x7f7e2c0cd850 2024-03-12T17:19:02.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.338+0000 7f7e31000640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e2c0ce1a0 con 0x7f7e2c0b23e0 2024-03-12T17:19:02.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.338+0000 7f7e31000640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e2c0b1900 con 0x7f7e2c0cb930 2024-03-12T17:19:02.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.338+0000 7f7e2aa00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7e2c0b23e0 0x7f7e2c0cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:02.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.338+0000 7f7e2aa00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7e2c0b23e0 0x7f7e2c0cbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39456/0 (socket says 172.21.15.17:39456) 2024-03-12T17:19:02.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.338+0000 7f7e2aa00640 1 -- 172.21.15.17:0/1858477090 learned_addr learned my addr 172.21.15.17:0/1858477090 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:02.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.338+0000 7f7e2b400640 1 --2- 172.21.15.17:0/1858477090 >> v2:172.21.15.94:3300/0 conn(0x7f7e2c0cb930 0x7f7e2c0b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:02.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.339+0000 7f7e2aa00640 1 -- 172.21.15.17:0/1858477090 >> v2:172.21.15.94:3300/0 conn(0x7f7e2c0cb930 msgr2=0x7f7e2c0b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:02.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.339+0000 7f7e2aa00640 1 --2- 172.21.15.17:0/1858477090 >> v2:172.21.15.94:3300/0 conn(0x7f7e2c0cb930 0x7f7e2c0b45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:02.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.339+0000 7f7e2aa00640 1 -- 172.21.15.17:0/1858477090 >> v1:172.21.15.94:6789/0 conn(0x7f7e2c0cd850 legacy=0x7f7e2c0b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:02.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.339+0000 7f7e2aa00640 1 -- 172.21.15.17:0/1858477090 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e2c0b1be0 con 0x7f7e2c0b23e0 2024-03-12T17:19:02.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.340+0000 7f7e2aa00640 1 --2- 172.21.15.17:0/1858477090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e2c0b23e0 0x7f7e2c0cbd10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c06da00 tx=0x7f7e1802db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=244aa6bab0e649ef server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:02.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.340+0000 7f7e2a000640 1 -- 172.21.15.17:0/1858477090 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1802f8e0 con 0x7f7e2c0b23e0 2024-03-12T17:19:02.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.340+0000 7f7e2a000640 1 -- 172.21.15.17:0/1858477090 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1802fa40 con 0x7f7e2c0b23e0 2024-03-12T17:19:02.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.340+0000 7f7e2a000640 1 -- 172.21.15.17:0/1858477090 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1802fdd0 con 0x7f7e2c0b23e0 2024-03-12T17:19:02.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.341+0000 7f7e31000640 1 -- 172.21.15.17:0/1858477090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e2c0b23e0 msgr2=0x7f7e2c0cbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:02.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.341+0000 7f7e31000640 1 --2- 172.21.15.17:0/1858477090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e2c0b23e0 0x7f7e2c0cbd10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c06da00 tx=0x7f7e1802db20 comp rx=0 tx=0).stop 2024-03-12T17:19:02.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.341+0000 7f7e31000640 1 -- 172.21.15.17:0/1858477090 shutdown_connections 2024-03-12T17:19:02.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.341+0000 7f7e31000640 1 --2- 172.21.15.17:0/1858477090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e2c0b23e0 0x7f7e2c0cbd10 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:02.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.341+0000 7f7e31000640 1 --2- 172.21.15.17:0/1858477090 >> v2:172.21.15.94:3300/0 conn(0x7f7e2c0cb930 0x7f7e2c0b45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:02.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.341+0000 7f7e31000640 1 -- 172.21.15.17:0/1858477090 >> 172.21.15.17:0/1858477090 conn(0x7f7e2c069ce0 msgr2=0x7f7e2c06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:02.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.341+0000 7f7e31000640 1 -- 172.21.15.17:0/1858477090 shutdown_connections 2024-03-12T17:19:02.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.341+0000 7f7e31000640 1 -- 172.21.15.17:0/1858477090 wait complete. 2024-03-12T17:19:02.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.343+0000 7f7e31000640 1 Processor -- start 2024-03-12T17:19:02.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.343+0000 7f7e31000640 1 -- start start 2024-03-12T17:19:02.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.344+0000 7f7e31000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e2c0b23e0 0x7f7e2c15cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:02.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.344+0000 7f7e31000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7e2c0cb930 0x7f7e2c137f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:02.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.344+0000 7f7e31000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7e2c0cd850 0x7f7e2c159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:02.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.344+0000 7f7e31000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c1384d0 con 0x7f7e2c0b23e0 2024-03-12T17:19:02.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.344+0000 7f7e31000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c15b110 con 0x7f7e2c0cb930 2024-03-12T17:19:02.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.344+0000 7f7e31000640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c15a260 con 0x7f7e2c0cd850 2024-03-12T17:19:02.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.344+0000 7f7e2b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e2c0b23e0 0x7f7e2c15cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:02.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.344+0000 7f7e2b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e2c0b23e0 0x7f7e2c15cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39470/0 (socket says 172.21.15.17:39470) 2024-03-12T17:19:02.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.344+0000 7f7e2b400640 1 -- 172.21.15.17:0/101915147 learned_addr learned my addr 172.21.15.17:0/101915147 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:02.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.344+0000 7f7e2aa00640 1 --2- 172.21.15.17:0/101915147 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7e2c0cb930 0x7f7e2c137f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:02.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.344+0000 7f7e2be00640 1 --2- 172.21.15.17:0/101915147 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7e2c0cd850 0x7f7e2c159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:02.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.345+0000 7f7e2b400640 1 -- 172.21.15.17:0/101915147 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7e2c0cd850 msgr2=0x7f7e2c159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:02.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.345+0000 7f7e2b400640 1 --2- 172.21.15.17:0/101915147 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7e2c0cd850 0x7f7e2c159d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:02.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.345+0000 7f7e2b400640 1 -- 172.21.15.17:0/101915147 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7e2c0cb930 msgr2=0x7f7e2c137f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:02.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.345+0000 7f7e2b400640 1 --2- 172.21.15.17:0/101915147 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7e2c0cb930 0x7f7e2c137f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:02.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.345+0000 7f7e2b400640 1 -- 172.21.15.17:0/101915147 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e180094d0 con 0x7f7e2c0b23e0 2024-03-12T17:19:02.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.345+0000 7f7e2b400640 1 --2- 172.21.15.17:0/101915147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e2c0b23e0 0x7f7e2c15cbb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00d800 tx=0x7f7e1c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:02.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.345+0000 7f7e23400640 1 -- 172.21.15.17:0/101915147 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c00b6c0 con 0x7f7e2c0b23e0 2024-03-12T17:19:02.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.345+0000 7f7e23400640 1 -- 172.21.15.17:0/101915147 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1c00b820 con 0x7f7e2c0b23e0 2024-03-12T17:19:02.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.345+0000 7f7e23400640 1 -- 172.21.15.17:0/101915147 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c00bbb0 con 0x7f7e2c0b23e0 2024-03-12T17:19:02.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.345+0000 7f7e31000640 1 -- 172.21.15.17:0/101915147 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e2c0ce600 con 0x7f7e2c0b23e0 2024-03-12T17:19:02.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.345+0000 7f7e31000640 1 -- 172.21.15.17:0/101915147 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e2c15a7e0 con 0x7f7e2c0b23e0 2024-03-12T17:19:02.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.347+0000 7f7e31000640 1 -- 172.21.15.17:0/101915147 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e2c04e030 con 0x7f7e2c0b23e0 2024-03-12T17:19:02.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.347+0000 7f7e23400640 1 -- 172.21.15.17:0/101915147 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f7e1c00bd10 con 0x7f7e2c0b23e0 2024-03-12T17:19:02.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.349+0000 7f7e23400640 1 --2- 172.21.15.17:0/101915147 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f7e0c06ac30 0x7f7e0c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:02.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.349+0000 7f7e23400640 1 -- 172.21.15.17:0/101915147 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e1c0898d0 con 0x7f7e2c0b23e0 2024-03-12T17:19:02.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.350+0000 7f7e2aa00640 1 --2- 172.21.15.17:0/101915147 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f7e0c06ac30 0x7f7e0c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:02.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.350+0000 7f7e2aa00640 1 --2- 172.21.15.17:0/101915147 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f7e0c06ac30 0x7f7e0c06d0f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7e18038000 tx=0x7f7e18008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:02.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.354+0000 7f7e23400640 1 -- 172.21.15.17:0/101915147 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f7e1c054aa0 con 0x7f7e2c0b23e0 2024-03-12T17:19:02.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.549+0000 7f7e31000640 1 -- 172.21.15.17:0/101915147 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e2c066d20 con 0x7f7e2c0b23e0 2024-03-12T17:19:02.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.552+0000 7f7e23400640 1 -- 172.21.15.17:0/101915147 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15989 (secure 0 0 0) 0x7f7e1c0580c0 con 0x7f7e2c0b23e0 2024-03-12T17:19:02.548 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:19:02.548 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":21,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:18:46.845635+0000","last_up_change":"2024-03-12T17:18:38.144756+0000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-12T17:18:39.552910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-12T17:18:43.794908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-12T17:18:44.867006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":37305},{"type":"v1","addr":"172.21.15.17:6801","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":37305},{"type":"v1","addr":"172.21.15.17:6803","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":37305},{"type":"v1","addr":"172.21.15.17:6807","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":37305},{"type":"v1","addr":"172.21.15.17:6805","nonce":37305}]},"public_addr":"172.21.15.17:6801/37305","cluster_addr":"172.21.15.17:6803/37305","heartbeat_back_addr":"172.21.15.17:6807/37305","heartbeat_front_addr":"172.21.15.17:6805/37305","state":["exists","up"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":37307},{"type":"v1","addr":"172.21.15.17:6814","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":37307},{"type":"v1","addr":"172.21.15.17:6818","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":37307},{"type":"v1","addr":"172.21.15.17:6827","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":37307},{"type":"v1","addr":"172.21.15.17:6823","nonce":37307}]},"public_addr":"172.21.15.17:6814/37307","cluster_addr":"172.21.15.17:6818/37307","heartbeat_back_addr":"172.21.15.17:6827/37307","heartbeat_front_addr":"172.21.15.17:6823/37307","state":["exists","up"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":37303},{"type":"v1","addr":"172.21.15.17:6809","nonce":37303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":37303},{"type":"v1","addr":"172.21.15.17:6811","nonce":37303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":37303},{"type":"v1","addr":"172.21.15.17:6819","nonce":37303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":37303},{"type":"v1","addr":"172.21.15.17:6815","nonce":37303}]},"public_addr":"172.21.15.17:6809/37303","cluster_addr":"172.21.15.17:6811/37303","heartbeat_back_addr":"172.21.15.17:6819/37303","heartbeat_front_addr":"172.21.15.17:6815/37303","state":["exists","up"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":37308},{"type":"v1","addr":"172.21.15.17:6822","nonce":37308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":37308},{"type":"v1","addr":"172.21.15.17:6826","nonce":37308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":37308},{"type":"v1","addr":"172.21.15.17:6831","nonce":37308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":37308},{"type":"v1","addr":"172.21.15.17:6829","nonce":37308}]},"public_addr":"172.21.15.17:6822/37308","cluster_addr":"172.21.15.17:6826/37308","heartbeat_back_addr":"172.21.15.17:6831/37308","heartbeat_front_addr":"172.21.15.17:6829/37308","state":["exists","up"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":37465},{"type":"v1","addr":"172.21.15.94:6809","nonce":37465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6811","nonce":37465},{"type":"v1","addr":"172.21.15.94:6813","nonce":37465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6819","nonce":37465},{"type":"v1","addr":"172.21.15.94:6822","nonce":37465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6815","nonce":37465},{"type":"v1","addr":"172.21.15.94:6817","nonce":37465}]},"public_addr":"172.21.15.94:6809/37465","cluster_addr":"172.21.15.94:6813/37465","heartbeat_back_addr":"172.21.15.94:6822/37465","heartbeat_front_addr":"172.21.15.94:6817/37465","state":["exists","up"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":37464},{"type":"v1","addr":"172.21.15.94:6812","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":37464},{"type":"v1","addr":"172.21.15.94:6816","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":37464},{"type":"v1","addr":"172.21.15.94:6823","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":37464},{"type":"v1","addr":"172.21.15.94:6820","nonce":37464}]},"public_addr":"172.21.15.94:6812/37464","cluster_addr":"172.21.15.94:6816/37464","heartbeat_back_addr":"172.21.15.94:6823/37464","heartbeat_front_addr":"172.21.15.94:6820/37464","state":["exists","up"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":37467},{"type":"v1","addr":"172.21.15.94:6825","nonce":37467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":37467},{"type":"v1","addr":"172.21.15.94:6827","nonce":37467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":37467},{"type":"v1","addr":"172.21.15.94:6831","nonce":37467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":37467},{"type":"v1","addr":"172.21.15.94:6829","nonce":37467}]},"public_addr":"172.21.15.94:6825/37467","cluster_addr":"172.21.15.94:6827/37467","heartbeat_back_addr":"172.21.15.94:6831/37467","heartbeat_front_addr":"172.21.15.94:6829/37467","state":["exists","up"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":37466},{"type":"v1","addr":"172.21.15.94:6801","nonce":37466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":37466},{"type":"v1","addr":"172.21.15.94:6803","nonce":37466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":37466},{"type":"v1","addr":"172.21.15.94:6807","nonce":37466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":37466},{"type":"v1","addr":"172.21.15.94:6805","nonce":37466}]},"public_addr":"172.21.15.94:6801/37466","cluster_addr":"172.21.15.94:6803/37466","heartbeat_back_addr":"172.21.15.94:6807/37466","heartbeat_front_addr":"172.21.15.94:6805/37466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.327217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.186966+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.419986+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.150585+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.120621+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.121576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.181257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.293188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:19:02.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.555+0000 7f7e31000640 1 -- 172.21.15.17:0/101915147 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f7e0c06ac30 msgr2=0x7f7e0c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:02.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.555+0000 7f7e31000640 1 --2- 172.21.15.17:0/101915147 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f7e0c06ac30 0x7f7e0c06d0f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7e18038000 tx=0x7f7e18008030 comp rx=0 tx=0).stop 2024-03-12T17:19:02.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.555+0000 7f7e31000640 1 -- 172.21.15.17:0/101915147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e2c0b23e0 msgr2=0x7f7e2c15cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:02.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.555+0000 7f7e31000640 1 --2- 172.21.15.17:0/101915147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e2c0b23e0 0x7f7e2c15cbb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c00d800 tx=0x7f7e1c00dcc0 comp rx=0 tx=0).stop 2024-03-12T17:19:02.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.555+0000 7f7e31000640 1 -- 172.21.15.17:0/101915147 shutdown_connections 2024-03-12T17:19:02.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.555+0000 7f7e31000640 1 --2- 172.21.15.17:0/101915147 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f7e0c06ac30 0x7f7e0c06d0f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:02.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.555+0000 7f7e31000640 1 --2- 172.21.15.17:0/101915147 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7e2c0cd850 0x7f7e2c159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:02.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.555+0000 7f7e31000640 1 --2- 172.21.15.17:0/101915147 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7e2c0cb930 0x7f7e2c137f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:02.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.555+0000 7f7e31000640 1 --2- 172.21.15.17:0/101915147 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7e2c0b23e0 0x7f7e2c15cbb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:02.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.555+0000 7f7e31000640 1 -- 172.21.15.17:0/101915147 >> 172.21.15.17:0/101915147 conn(0x7f7e2c069ce0 msgr2=0x7f7e2c0b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:02.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.555+0000 7f7e31000640 1 -- 172.21.15.17:0/101915147 shutdown_connections 2024-03-12T17:19:02.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.555+0000 7f7e31000640 1 -- 172.21.15.17:0/101915147 wait complete. 2024-03-12T17:19:02.569 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-12T17:19:02.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.783+0000 7f9283200640 1 Processor -- start 2024-03-12T17:19:02.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.784+0000 7f9283200640 1 -- start start 2024-03-12T17:19:02.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.785+0000 7f9283200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f927c144240 0x7f927c0ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:02.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.785+0000 7f9283200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f927c0ce320 con 0x7f927c0cb970 2024-03-12T17:19:02.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.785+0000 7f9283200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f927c144620 con 0x7f927c0cecf0 2024-03-12T17:19:02.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.786+0000 7f9283200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f927c15f3d0 con 0x7f927c144240 2024-03-12T17:19:02.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.786+0000 7f927be00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f927c144240 0x7f927c0ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:02.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.786+0000 7f9281200640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f927c0cb970 0x7f927c15e670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:52382/0 (socket says 172.21.15.17:52382) 2024-03-12T17:19:02.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.786+0000 7f9281200640 1 -- 172.21.15.17:0/229727409 learned_addr learned my addr 172.21.15.17:0/229727409 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:02.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.786+0000 7f927be00640 1 -- 172.21.15.17:0/229727409 >> v1:172.21.15.94:6789/0 conn(0x7f927c0cecf0 legacy=0x7f927c0b2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:02.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.786+0000 7f927be00640 1 -- 172.21.15.17:0/229727409 >> v1:172.21.15.17:6789/0 conn(0x7f927c0cb970 legacy=0x7f927c15e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:02.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.786+0000 7f927be00640 1 -- 172.21.15.17:0/229727409 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927c0cd9f0 con 0x7f927c144240 2024-03-12T17:19:02.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.786+0000 7f927b400640 1 -- 172.21.15.17:0/229727409 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 641202189 0 0) 0x7f927c0ce320 con 0x7f927c0cb970 2024-03-12T17:19:02.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.787+0000 7f927be00640 1 --2- 172.21.15.17:0/229727409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f927c144240 0x7f927c0ce7b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f926c0097a0 tx=0x7f926c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9d51b2ca4845bc2 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:02.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.788+0000 7f927b400640 1 -- 172.21.15.17:0/229727409 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926c031830 con 0x7f927c144240 2024-03-12T17:19:02.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.788+0000 7f927b400640 1 -- 172.21.15.17:0/229727409 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926c031990 con 0x7f927c144240 2024-03-12T17:19:02.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.788+0000 7f927b400640 1 -- 172.21.15.17:0/229727409 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926c031d20 con 0x7f927c144240 2024-03-12T17:19:02.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.788+0000 7f9283200640 1 -- 172.21.15.17:0/229727409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f927c144240 msgr2=0x7f927c0ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:02.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.788+0000 7f9283200640 1 --2- 172.21.15.17:0/229727409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f927c144240 0x7f927c0ce7b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f926c0097a0 tx=0x7f926c02b8d0 comp rx=0 tx=0).stop 2024-03-12T17:19:02.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.788+0000 7f9283200640 1 -- 172.21.15.17:0/229727409 shutdown_connections 2024-03-12T17:19:02.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.788+0000 7f9283200640 1 --2- 172.21.15.17:0/229727409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f927c144240 0x7f927c0ce7b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:02.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.788+0000 7f9283200640 1 -- 172.21.15.17:0/229727409 >> 172.21.15.17:0/229727409 conn(0x7f927c069ce0 msgr2=0x7f927c06a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:02.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.788+0000 7f9283200640 1 -- 172.21.15.17:0/229727409 shutdown_connections 2024-03-12T17:19:02.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.788+0000 7f9283200640 1 -- 172.21.15.17:0/229727409 wait complete. 2024-03-12T17:19:02.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.790+0000 7f9283200640 1 Processor -- start 2024-03-12T17:19:02.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.790+0000 7f9283200640 1 -- start start 2024-03-12T17:19:02.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.791+0000 7f9283200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f927c0cb970 0x7f927c1f64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:02.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.791+0000 7f9283200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f927c0cecf0 0x7f927c136040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:02.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.791+0000 7f9283200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f927c144240 0x7f927c15a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:02.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.791+0000 7f9283200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927c136580 con 0x7f927c0cecf0 2024-03-12T17:19:02.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.791+0000 7f9283200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927c1367b0 con 0x7f927c144240 2024-03-12T17:19:02.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.791+0000 7f9283200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f927c136a90 con 0x7f927c0cb970 2024-03-12T17:19:02.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.791+0000 7f9273e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f927c0cecf0 0x7f927c136040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:02.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.791+0000 7f9273e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f927c0cecf0 0x7f927c136040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39490/0 (socket says 172.21.15.17:39490) 2024-03-12T17:19:02.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.791+0000 7f9273e00640 1 -- 172.21.15.17:0/823054327 learned_addr learned my addr 172.21.15.17:0/823054327 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:02.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.792+0000 7f927be00640 1 --2- 172.21.15.17:0/823054327 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f927c0cb970 0x7f927c1f64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:02.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.792+0000 7f9281200640 1 --2- 172.21.15.17:0/823054327 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f927c144240 0x7f927c15a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:02.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.792+0000 7f9273e00640 1 -- 172.21.15.17:0/823054327 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f927c0cb970 msgr2=0x7f927c1f64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:02.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.792+0000 7f9273e00640 1 --2- 172.21.15.17:0/823054327 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f927c0cb970 0x7f927c1f64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:02.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.792+0000 7f9273e00640 1 -- 172.21.15.17:0/823054327 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f927c144240 msgr2=0x7f927c15a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:02.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.792+0000 7f9273e00640 1 --2- 172.21.15.17:0/823054327 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f927c144240 0x7f927c15a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:02.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.792+0000 7f9273e00640 1 -- 172.21.15.17:0/823054327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f926c009400 con 0x7f927c0cecf0 2024-03-12T17:19:02.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.792+0000 7f9273e00640 1 --2- 172.21.15.17:0/823054327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f927c0cecf0 0x7f927c136040 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f926400c430 tx=0x7f926400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:02.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.792+0000 7f9278c00640 1 -- 172.21.15.17:0/823054327 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9264011790 con 0x7f927c0cecf0 2024-03-12T17:19:02.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.792+0000 7f9278c00640 1 -- 172.21.15.17:0/823054327 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92640118f0 con 0x7f927c0cecf0 2024-03-12T17:19:02.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.792+0000 7f9278c00640 1 -- 172.21.15.17:0/823054327 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9264011ce0 con 0x7f927c0cecf0 2024-03-12T17:19:02.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.792+0000 7f9283200640 1 -- 172.21.15.17:0/823054327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f927c136d70 con 0x7f927c0cecf0 2024-03-12T17:19:02.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.792+0000 7f9283200640 1 -- 172.21.15.17:0/823054327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f927c15a7a0 con 0x7f927c0cecf0 2024-03-12T17:19:02.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.793+0000 7f9283200640 1 -- 172.21.15.17:0/823054327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f927c15c490 con 0x7f927c0cecf0 2024-03-12T17:19:02.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.794+0000 7f9278c00640 1 -- 172.21.15.17:0/823054327 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f926401c460 con 0x7f927c0cecf0 2024-03-12T17:19:02.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.795+0000 7f9278c00640 1 --2- 172.21.15.17:0/823054327 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f925806ac00 0x7f925806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:02.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.795+0000 7f9278c00640 1 -- 172.21.15.17:0/823054327 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9264089280 con 0x7f927c0cecf0 2024-03-12T17:19:02.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.795+0000 7f927be00640 1 --2- 172.21.15.17:0/823054327 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f925806ac00 0x7f925806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:02.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.796+0000 7f927be00640 1 --2- 172.21.15.17:0/823054327 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f925806ac00 0x7f925806d0c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f926c036000 tx=0x7f926c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:02.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:02.800+0000 7f9278c00640 1 -- 172.21.15.17:0/823054327 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f927c15c490 con 0x7f927c0cecf0 2024-03-12T17:19:03.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.040+0000 7f9283200640 1 -- 172.21.15.17:0/823054327 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f927c15c490 con 0x7f927c0cecf0 2024-03-12T17:19:03.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.041+0000 7f9278c00640 1 -- 172.21.15.17:0/823054327 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4725 (secure 0 0 0) 0x7f927c15c490 con 0x7f927c0cecf0 2024-03-12T17:19:03.037 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:19:03.037 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/4055209511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":4055209511},{"type":"v1","addr":"172.21.15.94:6833","nonce":4055209511}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4220,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/2079001512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2079001512},{"type":"v1","addr":"172.21.15.94:6835","nonce":2079001512}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6836/3710914262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3710914262},{"type":"v1","addr":"172.21.15.17:6836","nonce":3710914262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T17:18:45.842660+0000","modified":"2024-03-12T17:18:49.354081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6837/749237500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6835","nonce":749237500},{"type":"v1","addr":"172.21.15.17:6837","nonce":749237500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-12T17:19:03.038 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 7 2024-03-12T17:19:03.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.044+0000 7f9283200640 1 -- 172.21.15.17:0/823054327 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f925806ac00 msgr2=0x7f925806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:03.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.044+0000 7f9283200640 1 --2- 172.21.15.17:0/823054327 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f925806ac00 0x7f925806d0c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f926c036000 tx=0x7f926c008030 comp rx=0 tx=0).stop 2024-03-12T17:19:03.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.044+0000 7f9283200640 1 -- 172.21.15.17:0/823054327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f927c0cecf0 msgr2=0x7f927c136040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:03.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.044+0000 7f9283200640 1 --2- 172.21.15.17:0/823054327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f927c0cecf0 0x7f927c136040 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f926400c430 tx=0x7f926400c8f0 comp rx=0 tx=0).stop 2024-03-12T17:19:03.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.045+0000 7f9283200640 1 -- 172.21.15.17:0/823054327 shutdown_connections 2024-03-12T17:19:03.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.045+0000 7f9283200640 1 --2- 172.21.15.17:0/823054327 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f925806ac00 0x7f925806d0c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:03.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.045+0000 7f9283200640 1 --2- 172.21.15.17:0/823054327 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f927c144240 0x7f927c15a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:03.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.045+0000 7f9283200640 1 --2- 172.21.15.17:0/823054327 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f927c0cecf0 0x7f927c136040 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:03.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.045+0000 7f9283200640 1 --2- 172.21.15.17:0/823054327 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f927c0cb970 0x7f927c1f64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:03.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.045+0000 7f9283200640 1 -- 172.21.15.17:0/823054327 >> 172.21.15.17:0/823054327 conn(0x7f927c069ce0 msgr2=0x7f927c06c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:03.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.045+0000 7f9283200640 1 -- 172.21.15.17:0/823054327 shutdown_connections 2024-03-12T17:19:03.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.045+0000 7f9283200640 1 -- 172.21.15.17:0/823054327 wait complete. 2024-03-12T17:19:03.463 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-12T17:18:45.842660+0000', 'modified': '2024-03-12T17:18:49.354081+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4245}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4245': {'gid': 4245, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.17:6837/749237500', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6835', 'nonce': 749237500}, {'type': 'v1', 'addr': '172.21.15.17:6837', 'nonce': 749237500}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-03-12T17:19:03.463 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-12T17:19:03.463 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-03-12T17:19:03.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.700+0000 7f9a04a00640 1 Processor -- start 2024-03-12T17:19:03.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.701+0000 7f9a04a00640 1 -- start start 2024-03-12T17:19:03.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.702+0000 7f9a04a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a000b86c0 0x7f9a000b4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:03.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.702+0000 7f9a04a00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a000b4da0 con 0x7f9a000b4950 2024-03-12T17:19:03.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.703+0000 7f9a04a00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a00160470 con 0x7f9a00160090 2024-03-12T17:19:03.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.703+0000 7f9a04a00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a000d0e40 con 0x7f9a000b86c0 2024-03-12T17:19:03.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.703+0000 7f99ffe00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f9a000b4950 0x7f9a000d1260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:52384/0 (socket says 172.21.15.17:52384) 2024-03-12T17:19:03.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.703+0000 7f99ffe00640 1 -- 172.21.15.17:0/1319697445 learned_addr learned my addr 172.21.15.17:0/1319697445 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:03.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.703+0000 7f99f7e00640 1 --2- 172.21.15.17:0/1319697445 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a000b86c0 0x7f9a000b4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:03.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.703+0000 7f99fea00640 1 -- 172.21.15.17:0/1319697445 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 9342580 0 0) 0x7f99f8001490 con 0x7f9a000b4950 2024-03-12T17:19:03.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.703+0000 7f99fea00640 1 -- 172.21.15.17:0/1319697445 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99e4003520 con 0x7f9a000b4950 2024-03-12T17:19:03.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.704+0000 7f99fea00640 1 -- 172.21.15.17:0/1319697445 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3769380633 0 0) 0x7f99e4003520 con 0x7f9a000b4950 2024-03-12T17:19:03.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.704+0000 7f99fea00640 1 -- 172.21.15.17:0/1319697445 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a000b86c0 msgr2=0x7f9a000b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:03.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.704+0000 7f99fea00640 1 --2- 172.21.15.17:0/1319697445 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a000b86c0 0x7f9a000b4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:03.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.704+0000 7f99fea00640 1 -- 172.21.15.17:0/1319697445 >> v1:172.21.15.94:6789/0 conn(0x7f9a00160090 legacy=0x7f9a0006b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:03.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.704+0000 7f99fea00640 1 -- 172.21.15.17:0/1319697445 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0006b840 con 0x7f9a000b4950 2024-03-12T17:19:03.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.704+0000 7f99fea00640 1 -- 172.21.15.17:0/1319697445 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7f99f8001b80 con 0x7f9a000b4950 2024-03-12T17:19:03.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.704+0000 7f99fea00640 1 -- 172.21.15.17:0/1319697445 >> v1:172.21.15.17:6789/0 conn(0x7f9a000b4950 legacy=0x7f9a000d1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:03.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.704+0000 7f99fea00640 1 --2- 172.21.15.17:0/1319697445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99e40039a0 0x7f99e4003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:03.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.704+0000 7f99fea00640 1 --2- 172.21.15.17:0/1319697445 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a000b86c0 0x7f99e40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:03.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.704+0000 7f99fea00640 1 --2- 172.21.15.17:0/1319697445 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99e4004d00 0x7f99e4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:03.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.704+0000 7f99fea00640 1 -- 172.21.15.17:0/1319697445 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a000d0e40 con 0x7f99e40039a0 2024-03-12T17:19:03.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.704+0000 7f99fea00640 1 -- 172.21.15.17:0/1319697445 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e400ba90 con 0x7f99e4004d00 2024-03-12T17:19:03.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.704+0000 7f99fea00640 1 -- 172.21.15.17:0/1319697445 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e400bc50 con 0x7f9a000b86c0 2024-03-12T17:19:03.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.704+0000 7f99ff400640 1 --2- 172.21.15.17:0/1319697445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99e40039a0 0x7f99e4003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:03.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.704+0000 7f99f7e00640 1 --2- 172.21.15.17:0/1319697445 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a000b86c0 0x7f99e40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:03.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.704+0000 7f99ffe00640 1 --2- 172.21.15.17:0/1319697445 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99e4004d00 0x7f99e4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:03.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.705+0000 7f99ff400640 1 -- 172.21.15.17:0/1319697445 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a000b86c0 msgr2=0x7f99e40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:03.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.705+0000 7f99ff400640 1 --2- 172.21.15.17:0/1319697445 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a000b86c0 0x7f99e40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:03.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.705+0000 7f99ff400640 1 -- 172.21.15.17:0/1319697445 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99e4004d00 msgr2=0x7f99e4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:03.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.705+0000 7f99ff400640 1 --2- 172.21.15.17:0/1319697445 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99e4004d00 0x7f99e4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:03.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.705+0000 7f99ff400640 1 -- 172.21.15.17:0/1319697445 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e4003520 con 0x7f99e40039a0 2024-03-12T17:19:03.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.706+0000 7f99ff400640 1 --2- 172.21.15.17:0/1319697445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99e40039a0 0x7f99e4003d80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f99f0001860 tx=0x7f99e40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd66288d064aaf39 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:03.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.706+0000 7f99fea00640 1 -- 172.21.15.17:0/1319697445 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f0033630 con 0x7f99e40039a0 2024-03-12T17:19:03.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.706+0000 7f99fea00640 1 -- 172.21.15.17:0/1319697445 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f00337b0 con 0x7f99e40039a0 2024-03-12T17:19:03.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.706+0000 7f99fea00640 1 -- 172.21.15.17:0/1319697445 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f0033b60 con 0x7f99e40039a0 2024-03-12T17:19:03.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.707+0000 7f9a04a00640 1 -- 172.21.15.17:0/1319697445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99e40039a0 msgr2=0x7f99e4003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:03.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.707+0000 7f9a04a00640 1 --2- 172.21.15.17:0/1319697445 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99e40039a0 0x7f99e4003d80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f99f0001860 tx=0x7f99e40057f0 comp rx=0 tx=0).stop 2024-03-12T17:19:03.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.707+0000 7f99ffe00640 1 -- 172.21.15.17:0/1319697445 reap_dead start 2024-03-12T17:19:03.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.707+0000 7f9a04a00640 1 -- 172.21.15.17:0/1319697445 shutdown_connections 2024-03-12T17:19:03.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.707+0000 7f9a04a00640 1 -- 172.21.15.17:0/1319697445 >> 172.21.15.17:0/1319697445 conn(0x7f9a000cf5f0 msgr2=0x7f9a000cfa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:03.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.707+0000 7f9a04a00640 1 -- 172.21.15.17:0/1319697445 shutdown_connections 2024-03-12T17:19:03.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.707+0000 7f9a04a00640 1 -- 172.21.15.17:0/1319697445 wait complete. 2024-03-12T17:19:03.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.709+0000 7f9a04a00640 1 Processor -- start 2024-03-12T17:19:03.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.709+0000 7f9a04a00640 1 -- start start 2024-03-12T17:19:03.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.710+0000 7f9a04a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99e40039a0 0x7f9a000b1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:03.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.710+0000 7f9a04a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a000ab0e0 0x7f9a000aa5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:03.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.710+0000 7f9a04a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a000aab10 0x7f9a000adad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:03.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.710+0000 7f9a04a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a000ae730 con 0x7f99e40039a0 2024-03-12T17:19:03.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.710+0000 7f9a04a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a000aa1b0 con 0x7f9a000aab10 2024-03-12T17:19:03.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.710+0000 7f9a04a00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a000a9530 con 0x7f9a000ab0e0 2024-03-12T17:19:03.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.710+0000 7f99ff400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99e40039a0 0x7f9a000b1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:03.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.710+0000 7f99ff400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99e40039a0 0x7f9a000b1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39508/0 (socket says 172.21.15.17:39508) 2024-03-12T17:19:03.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.710+0000 7f99ff400640 1 -- 172.21.15.17:0/283700890 learned_addr learned my addr 172.21.15.17:0/283700890 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:03.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.711+0000 7f99f7e00640 1 --2- 172.21.15.17:0/283700890 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a000ab0e0 0x7f9a000aa5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:03.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.711+0000 7f99ffe00640 1 --2- 172.21.15.17:0/283700890 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a000aab10 0x7f9a000adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:03.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.711+0000 7f99ff400640 1 -- 172.21.15.17:0/283700890 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a000ab0e0 msgr2=0x7f9a000aa5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:03.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.711+0000 7f99ff400640 1 --2- 172.21.15.17:0/283700890 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a000ab0e0 0x7f9a000aa5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:03.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.711+0000 7f99ff400640 1 -- 172.21.15.17:0/283700890 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a000aab10 msgr2=0x7f9a000adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:03.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.711+0000 7f99ff400640 1 --2- 172.21.15.17:0/283700890 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a000aab10 0x7f9a000adad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:03.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.711+0000 7f99ff400640 1 -- 172.21.15.17:0/283700890 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a000a9810 con 0x7f99e40039a0 2024-03-12T17:19:03.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.711+0000 7f99ff400640 1 --2- 172.21.15.17:0/283700890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99e40039a0 0x7f9a000b1140 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f99f0008fd0 tx=0x7f99f0001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:03.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.712+0000 7f99f7400640 1 -- 172.21.15.17:0/283700890 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f0007050 con 0x7f99e40039a0 2024-03-12T17:19:03.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.712+0000 7f99f7400640 1 -- 172.21.15.17:0/283700890 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f00071b0 con 0x7f99e40039a0 2024-03-12T17:19:03.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.712+0000 7f99f7400640 1 -- 172.21.15.17:0/283700890 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f0007540 con 0x7f99e40039a0 2024-03-12T17:19:03.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.712+0000 7f9a04a00640 1 -- 172.21.15.17:0/283700890 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a000a9af0 con 0x7f99e40039a0 2024-03-12T17:19:03.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.712+0000 7f9a04a00640 1 -- 172.21.15.17:0/283700890 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a000ab560 con 0x7f99e40039a0 2024-03-12T17:19:03.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.714+0000 7f99f7400640 1 -- 172.21.15.17:0/283700890 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f99f00067d0 con 0x7f99e40039a0 2024-03-12T17:19:03.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.716+0000 7f99f7400640 1 --2- 172.21.15.17:0/283700890 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f99dc06ac00 0x7f99dc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:03.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.716+0000 7f99f7400640 1 -- 172.21.15.17:0/283700890 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99f00ab4a0 con 0x7f99e40039a0 2024-03-12T17:19:03.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.716+0000 7f99f7e00640 1 --2- 172.21.15.17:0/283700890 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f99dc06ac00 0x7f99dc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:03.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.716+0000 7f9a08d63740 1 Processor -- start 2024-03-12T17:19:03.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.717+0000 7f9a08d63740 1 -- start start 2024-03-12T17:19:03.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.717+0000 7f99f7e00640 1 --2- 172.21.15.17:0/283700890 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f99dc06ac00 0x7f99dc06d0c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9a00153e30 tx=0x7f99e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:03.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.717+0000 7f9a08d63740 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55cb64bf5200 0x55cb64bac830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:03.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.717+0000 7f9a08d63740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cb64bab280 0x55cb64bacd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:03.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.717+0000 7f9a08d63740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64ba7720 0x55cb64bd7510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:03.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.717+0000 7f9a08d63740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb64b82e40 con 0x55cb64ba7720 2024-03-12T17:19:03.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.717+0000 7f9a08d63740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb64b18090 con 0x55cb64bab280 2024-03-12T17:19:03.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.717+0000 7f9a08d63740 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cb64b15820 con 0x55cb64bf5200 2024-03-12T17:19:03.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.718+0000 7f99ffe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64ba7720 0x55cb64bd7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:03.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.718+0000 7f99ffe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64ba7720 0x55cb64bd7510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39514/0 (socket says 172.21.15.17:39514) 2024-03-12T17:19:03.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.718+0000 7f99ffe00640 1 -- 172.21.15.17:0/4044058286 learned_addr learned my addr 172.21.15.17:0/4044058286 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:03.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.718+0000 7f99ff400640 1 --2- 172.21.15.17:0/4044058286 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55cb64bf5200 0x55cb64bac830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:03.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.718+0000 7f99f7e00640 1 --2- 172.21.15.17:0/4044058286 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cb64bab280 0x55cb64bacd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:03.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.718+0000 7f99ffe00640 1 -- 172.21.15.17:0/4044058286 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55cb64bf5200 msgr2=0x55cb64bac830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:03.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.718+0000 7f99ffe00640 1 --2- 172.21.15.17:0/4044058286 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55cb64bf5200 0x55cb64bac830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:03.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.718+0000 7f99ffe00640 1 -- 172.21.15.17:0/4044058286 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cb64bab280 msgr2=0x55cb64bacd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:03.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.718+0000 7f99ffe00640 1 --2- 172.21.15.17:0/4044058286 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cb64bab280 0x55cb64bacd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:03.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.718+0000 7f99ffe00640 1 -- 172.21.15.17:0/4044058286 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb64ad8780 con 0x55cb64ba7720 2024-03-12T17:19:03.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.719+0000 7f99ffe00640 1 --2- 172.21.15.17:0/4044058286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64ba7720 0x55cb64bd7510 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9a000b5580 tx=0x7f99f8005f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e0b3b802eb2b796 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:03.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.719+0000 7f99efe00640 1 -- 172.21.15.17:0/4044058286 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f80076c0 con 0x55cb64ba7720 2024-03-12T17:19:03.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.719+0000 7f99efe00640 1 -- 172.21.15.17:0/4044058286 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f8007820 con 0x55cb64ba7720 2024-03-12T17:19:03.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.719+0000 7f99efe00640 1 -- 172.21.15.17:0/4044058286 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f8014400 con 0x55cb64ba7720 2024-03-12T17:19:03.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.719+0000 7f9a08d63740 1 -- 172.21.15.17:0/4044058286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64ba7720 msgr2=0x55cb64bd7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:03.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.719+0000 7f9a08d63740 1 --2- 172.21.15.17:0/4044058286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64ba7720 0x55cb64bd7510 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9a000b5580 tx=0x7f99f8005f40 comp rx=0 tx=0).stop 2024-03-12T17:19:03.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.720+0000 7f9a08d63740 1 -- 172.21.15.17:0/4044058286 shutdown_connections 2024-03-12T17:19:03.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.720+0000 7f9a08d63740 1 --2- 172.21.15.17:0/4044058286 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64ba7720 0x55cb64bd7510 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:03.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.720+0000 7f9a08d63740 1 --2- 172.21.15.17:0/4044058286 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cb64bab280 0x55cb64bacd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:03.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.720+0000 7f9a08d63740 1 --2- 172.21.15.17:0/4044058286 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55cb64bf5200 0x55cb64bac830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:03.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.720+0000 7f9a08d63740 1 -- 172.21.15.17:0/4044058286 >> 172.21.15.17:0/4044058286 conn(0x55cb64ba9990 msgr2=0x55cb64bf2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:03.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.720+0000 7f9a08d63740 1 -- 172.21.15.17:0/4044058286 shutdown_connections 2024-03-12T17:19:03.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.720+0000 7f9a08d63740 1 -- 172.21.15.17:0/4044058286 wait complete. 2024-03-12T17:19:03.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.720+0000 7f9a08d63740 1 -- start start 2024-03-12T17:19:03.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.721+0000 7f9a08d63740 1 Processor -- start 2024-03-12T17:19:03.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.722+0000 7f9a08d63740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64bab280 0x55cb64bce210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:03.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.722+0000 7f9a08d63740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cb64bf5200 0x55cb64bd53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:03.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.722+0000 7f9a08d63740 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55cb64bcf8c0 0x55cb64bd2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:03.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.722+0000 7f9a08d63740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb64b11110 con 0x55cb64bab280 2024-03-12T17:19:03.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.722+0000 7f9a08d63740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb64ab28c0 con 0x55cb64bf5200 2024-03-12T17:19:03.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.722+0000 7f9a08d63740 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cb64ab2560 con 0x55cb64bcf8c0 2024-03-12T17:19:03.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.722+0000 7f9a08d63740 10 client.0 _ll_register_callbacks cb 0x55cb64b0a8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-12T17:19:03.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.722+0000 7f99ff400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64bab280 0x55cb64bce210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:03.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.722+0000 7f99ff400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64bab280 0x55cb64bce210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39520/0 (socket says 172.21.15.17:39520) 2024-03-12T17:19:03.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.722+0000 7f99ff400640 1 -- 172.21.15.17:0/1791954849 learned_addr learned my addr 172.21.15.17:0/1791954849 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:03.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.722+0000 7f99ffe00640 1 --2- 172.21.15.17:0/1791954849 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55cb64bcf8c0 0x55cb64bd2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:03.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.722+0000 7f99f7e00640 1 --2- 172.21.15.17:0/1791954849 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cb64bf5200 0x55cb64bd53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:03.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.722+0000 7f99ff400640 1 -- 172.21.15.17:0/1791954849 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55cb64bcf8c0 msgr2=0x55cb64bd2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:03.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.722+0000 7f99ff400640 1 --2- 172.21.15.17:0/1791954849 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55cb64bcf8c0 0x55cb64bd2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:03.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.722+0000 7f99ff400640 1 -- 172.21.15.17:0/1791954849 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cb64bf5200 msgr2=0x55cb64bd53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:03.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.722+0000 7f99ff400640 1 --2- 172.21.15.17:0/1791954849 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cb64bf5200 0x55cb64bd53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:03.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.722+0000 7f99ff400640 1 -- 172.21.15.17:0/1791954849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99f800f040 con 0x55cb64bab280 2024-03-12T17:19:03.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.722+0000 7f99ffe00640 1 --2- 172.21.15.17:0/1791954849 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55cb64bcf8c0 0x55cb64bd2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:03.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.723+0000 7f99ff400640 1 --2- 172.21.15.17:0/1791954849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64bab280 0x55cb64bce210 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f99f00767a0 tx=0x7f99f0007cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf09f547d1678ff6 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:03.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.723+0000 7f99ecc00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-12T17:19:03.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.723+0000 7f99ecc00640 1 -- 172.21.15.17:0/1791954849 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f007e0d0 con 0x55cb64bab280 2024-03-12T17:19:03.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.723+0000 7f99ecc00640 1 -- 172.21.15.17:0/1791954849 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99f0082690 con 0x55cb64bab280 2024-03-12T17:19:03.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.723+0000 7f9a08d63740 1 -- 172.21.15.17:0/1791954849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cb64b3b660 con 0x55cb64bab280 2024-03-12T17:19:03.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.723+0000 7f99ecc00640 1 -- 172.21.15.17:0/1791954849 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99f007a500 con 0x55cb64bab280 2024-03-12T17:19:03.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.723+0000 7f9a08d63740 10 client.4650 fetch_fsmap learned FSMap version 7 2024-03-12T17:19:03.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.723+0000 7f9a08d63740 1 -- 172.21.15.17:0/1791954849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55cb64b0f790 con 0x55cb64bab280 2024-03-12T17:19:03.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.723+0000 7f99ecc00640 1 -- 172.21.15.17:0/1791954849 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cb64b3b660 con 0x55cb64bab280 2024-03-12T17:19:03.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.724+0000 7f99ecc00640 1 -- 172.21.15.17:0/1791954849 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 7) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f99f007c030 con 0x55cb64bab280 2024-03-12T17:19:03.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.724+0000 7f9a08d63740 10 client.4650 fetch_fsmap finished waiting for FSMap version 7 2024-03-12T17:19:03.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.724+0000 7f9a08d63740 10 client.4650 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-12T17:19:03.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.724+0000 7f9a08d63740 20 client.4650 populate_metadata read hostname 'smithi017' 2024-03-12T17:19:03.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.724+0000 7f9a08d63740 1 --2- 172.21.15.17:0/1791954849 >> [v2:172.21.15.17:6835/749237500,v1:172.21.15.17:6837/749237500] conn(0x55cb64bcf130 0x55cb64c0f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:03.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.724+0000 7f9a08d63740 4 client.4650 mds_command: new command op to 4245 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-12T17:19:03.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.724+0000 7f9a08d63740 1 -- 172.21.15.17:0/1791954849 --> [v2:172.21.15.17:6835/749237500,v1:172.21.15.17:6837/749237500] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cb64b03e50 con 0x55cb64bcf130 2024-03-12T17:19:03.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.724+0000 7f99f7e00640 1 --2- 172.21.15.17:0/1791954849 >> [v2:172.21.15.17:6835/749237500,v1:172.21.15.17:6837/749237500] conn(0x55cb64bcf130 0x55cb64c0f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:03.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.725+0000 7f99f7e00640 1 --2- 172.21.15.17:0/1791954849 >> [v2:172.21.15.17:6835/749237500,v1:172.21.15.17:6837/749237500] conn(0x55cb64bcf130 0x55cb64c0f8d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b57d1a98fac8c294 server_cookie=ab385044cf5cfe1e in_seq=0 out_seq=0 2024-03-12T17:19:03.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.725+0000 7f99ecc00640 10 client.4650 ms_handle_connect on v2:172.21.15.17:6835/749237500 2024-03-12T17:19:03.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.725+0000 7f99ecc00640 1 -- 172.21.15.17:0/1791954849 <== mds.0 v2:172.21.15.17:6835/749237500 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55cb64b03e50 con 0x55cb64bcf130 2024-03-12T17:19:03.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.725+0000 7f99ecc00640 10 client.4650 handle_command_reply: tid=0 2024-03-12T17:19:03.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.726+0000 7f9a08d63740 1 client.4650 shutdown 2024-03-12T17:19:03.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.726+0000 7f9a08d63740 1 -- 172.21.15.17:0/1791954849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64bab280 msgr2=0x55cb64bce210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:03.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.726+0000 7f9a08d63740 1 --2- 172.21.15.17:0/1791954849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64bab280 0x55cb64bce210 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f99f00767a0 tx=0x7f99f0007cc0 comp rx=0 tx=0).stop 2024-03-12T17:19:03.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.726+0000 7f9a08d63740 1 -- 172.21.15.17:0/1791954849 shutdown_connections 2024-03-12T17:19:03.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.726+0000 7f9a08d63740 1 --2- 172.21.15.17:0/1791954849 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55cb64bcf8c0 0x55cb64bd2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:03.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.726+0000 7f9a08d63740 1 --2- 172.21.15.17:0/1791954849 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cb64bf5200 0x55cb64bd53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:03.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.726+0000 7f9a08d63740 1 --2- 172.21.15.17:0/1791954849 >> [v2:172.21.15.17:6835/749237500,v1:172.21.15.17:6837/749237500] conn(0x55cb64bcf130 0x55cb64c0f8d0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:03.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.726+0000 7f9a08d63740 1 --2- 172.21.15.17:0/1791954849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64bab280 0x55cb64bce210 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:03.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.726+0000 7f9a08d63740 1 -- 172.21.15.17:0/1791954849 >> 172.21.15.17:0/1791954849 conn(0x55cb64ba7720 msgr2=0x55cb64bab9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:03.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.726+0000 7f99ecc00640 0 client.4650 ms_handle_reset on v2:172.21.15.17:6835/749237500 2024-03-12T17:19:03.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.726+0000 7f9a08d63740 1 -- 172.21.15.17:0/1791954849 shutdown_connections 2024-03-12T17:19:03.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.726+0000 7f9a08d63740 1 -- 172.21.15.17:0/1791954849 wait complete. 2024-03-12T17:19:03.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.726+0000 7f9a08d63740 20 client.4650 trim_cache size 0 max 16384 2024-03-12T17:19:03.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.743+0000 7f9a08d63740 1 Processor -- start 2024-03-12T17:19:03.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.743+0000 7f9a08d63740 1 -- start start 2024-03-12T17:19:03.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.744+0000 7f9a08d63740 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55cb64bab280 0x55cb64bcd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:03.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.744+0000 7f9a08d63740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64bcf8c0 0x55cb64bab6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:03.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.744+0000 7f9a08d63740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cb64bf5200 0x55cb64bac3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:03.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.744+0000 7f9a08d63740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb64878f20 con 0x55cb64bcf8c0 2024-03-12T17:19:03.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.744+0000 7f9a08d63740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb64bd5040 con 0x55cb64bf5200 2024-03-12T17:19:03.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.744+0000 7f9a08d63740 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cb64bae260 con 0x55cb64bab280 2024-03-12T17:19:03.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.744+0000 7f99f7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64bcf8c0 0x55cb64bab6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:03.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.744+0000 7f99f7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64bcf8c0 0x55cb64bab6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39522/0 (socket says 172.21.15.17:39522) 2024-03-12T17:19:03.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.744+0000 7f99f7e00640 1 -- 172.21.15.17:0/1448362354 learned_addr learned my addr 172.21.15.17:0/1448362354 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:03.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.745+0000 7f99ff400640 1 --2- 172.21.15.17:0/1448362354 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55cb64bab280 0x55cb64bcd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:03.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.745+0000 7f99ffe00640 1 --2- 172.21.15.17:0/1448362354 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cb64bf5200 0x55cb64bac3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:03.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.745+0000 7f99f7e00640 1 -- 172.21.15.17:0/1448362354 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55cb64bab280 msgr2=0x55cb64bcd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:03.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.745+0000 7f99f7e00640 1 --2- 172.21.15.17:0/1448362354 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55cb64bab280 0x55cb64bcd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:03.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.745+0000 7f99f7e00640 1 -- 172.21.15.17:0/1448362354 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cb64bf5200 msgr2=0x55cb64bac3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:03.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.745+0000 7f99f7e00640 1 --2- 172.21.15.17:0/1448362354 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cb64bf5200 0x55cb64bac3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:03.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.745+0000 7f99f7e00640 1 -- 172.21.15.17:0/1448362354 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb64ab1ad0 con 0x55cb64bcf8c0 2024-03-12T17:19:03.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.745+0000 7f99f7e00640 1 --2- 172.21.15.17:0/1448362354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64bcf8c0 0x55cb64bab6f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f99e80136b0 tx=0x7f99e8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d1928bec924817 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:03.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.745+0000 7f99f4c00640 1 -- 172.21.15.17:0/1448362354 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e802a0b0 con 0x55cb64bcf8c0 2024-03-12T17:19:03.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.745+0000 7f99f4c00640 1 -- 172.21.15.17:0/1448362354 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e802a210 con 0x55cb64bcf8c0 2024-03-12T17:19:03.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.745+0000 7f99f4c00640 1 -- 172.21.15.17:0/1448362354 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e802a580 con 0x55cb64bcf8c0 2024-03-12T17:19:03.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.746+0000 7f9a08d63740 1 -- 172.21.15.17:0/1448362354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64bcf8c0 msgr2=0x55cb64bab6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:03.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.746+0000 7f9a08d63740 1 --2- 172.21.15.17:0/1448362354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64bcf8c0 0x55cb64bab6f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f99e80136b0 tx=0x7f99e8016000 comp rx=0 tx=0).stop 2024-03-12T17:19:03.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.746+0000 7f9a08d63740 1 -- 172.21.15.17:0/1448362354 shutdown_connections 2024-03-12T17:19:03.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.746+0000 7f9a08d63740 1 --2- 172.21.15.17:0/1448362354 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cb64bf5200 0x55cb64bac3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:03.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.746+0000 7f9a08d63740 1 --2- 172.21.15.17:0/1448362354 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64bcf8c0 0x55cb64bab6f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:03.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.746+0000 7f9a08d63740 1 --2- 172.21.15.17:0/1448362354 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55cb64bab280 0x55cb64bcd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:03.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.746+0000 7f9a08d63740 1 -- 172.21.15.17:0/1448362354 >> 172.21.15.17:0/1448362354 conn(0x55cb64ba7720 msgr2=0x55cb64bce020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:03.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.746+0000 7f9a08d63740 1 -- 172.21.15.17:0/1448362354 shutdown_connections 2024-03-12T17:19:03.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.746+0000 7f9a08d63740 1 -- 172.21.15.17:0/1448362354 wait complete. 2024-03-12T17:19:03.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.747+0000 7f9a08d63740 1 -- start start 2024-03-12T17:19:03.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.747+0000 7f9a08d63740 1 Processor -- start 2024-03-12T17:19:03.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.748+0000 7f9a08d63740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64bab280 0x55cb64bf36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:03.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.748+0000 7f9a08d63740 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55cb64bcf8c0 0x55cb64c57b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:03.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.748+0000 7f9a08d63740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cb64bf5200 0x55cb64c5aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:03.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.748+0000 7f9a08d63740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb64c5a880 con 0x55cb64bab280 2024-03-12T17:19:03.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.748+0000 7f9a08d63740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb64c5a570 con 0x55cb64bf5200 2024-03-12T17:19:03.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.748+0000 7f9a08d63740 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cb64bf3fb0 con 0x55cb64bcf8c0 2024-03-12T17:19:03.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.748+0000 7f9a08d63740 10 client.0 _ll_register_callbacks cb 0x7f99f0079e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-12T17:19:03.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.748+0000 7f99ff400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64bab280 0x55cb64bf36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:03.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.748+0000 7f99ff400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64bab280 0x55cb64bf36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39524/0 (socket says 172.21.15.17:39524) 2024-03-12T17:19:03.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.748+0000 7f99ff400640 1 -- 172.21.15.17:0/3994511826 learned_addr learned my addr 172.21.15.17:0/3994511826 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:03.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.749+0000 7f99ffe00640 1 --2- 172.21.15.17:0/3994511826 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cb64bf5200 0x55cb64c5aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:03.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.749+0000 7f99ff400640 1 -- 172.21.15.17:0/3994511826 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55cb64bcf8c0 msgr2=0x55cb64c57b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:03.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.749+0000 7f99f7e00640 1 --2- 172.21.15.17:0/3994511826 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55cb64bcf8c0 0x55cb64c57b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:03.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.749+0000 7f99ff400640 1 --2- 172.21.15.17:0/3994511826 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55cb64bcf8c0 0x55cb64c57b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:03.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.749+0000 7f99ff400640 1 -- 172.21.15.17:0/3994511826 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cb64bf5200 msgr2=0x55cb64c5aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:03.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.749+0000 7f99ff400640 1 --2- 172.21.15.17:0/3994511826 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cb64bf5200 0x55cb64c5aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:03.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.749+0000 7f99ff400640 1 -- 172.21.15.17:0/3994511826 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e801d040 con 0x55cb64bab280 2024-03-12T17:19:03.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.749+0000 7f99ffe00640 1 --2- 172.21.15.17:0/3994511826 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cb64bf5200 0x55cb64c5aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:03.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.749+0000 7f99ff400640 1 --2- 172.21.15.17:0/3994511826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64bab280 0x55cb64bf36b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f99f002bd20 tx=0x7f99f00a9800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f446c40052c4b659 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:03.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.749+0000 7f99ecc00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-12T17:19:03.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.749+0000 7f99ecc00640 1 -- 172.21.15.17:0/3994511826 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f009c030 con 0x55cb64bab280 2024-03-12T17:19:03.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.749+0000 7f99ecc00640 1 -- 172.21.15.17:0/3994511826 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99f009d070 con 0x55cb64bab280 2024-03-12T17:19:03.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.749+0000 7f9a08d63740 1 -- 172.21.15.17:0/3994511826 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f99f8007820 con 0x55cb64bab280 2024-03-12T17:19:03.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.749+0000 7f99ecc00640 1 -- 172.21.15.17:0/3994511826 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99f0079c00 con 0x55cb64bab280 2024-03-12T17:19:03.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.749+0000 7f9a08d63740 10 client.4656 fetch_fsmap learned FSMap version 7 2024-03-12T17:19:03.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.750+0000 7f9a08d63740 1 -- 172.21.15.17:0/3994511826 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55cb64ad6fe0 con 0x55cb64bab280 2024-03-12T17:19:03.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.750+0000 7f99ecc00640 1 -- 172.21.15.17:0/3994511826 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f8007820 con 0x55cb64bab280 2024-03-12T17:19:03.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.750+0000 7f99ecc00640 1 -- 172.21.15.17:0/3994511826 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 7) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f99f007c040 con 0x55cb64bab280 2024-03-12T17:19:03.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.750+0000 7f9a08d63740 10 client.4656 fetch_fsmap finished waiting for FSMap version 7 2024-03-12T17:19:03.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.750+0000 7f9a08d63740 10 client.4656 resolve_mds: resolved name 'a' to daemon mds.a 2024-03-12T17:19:03.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.750+0000 7f9a08d63740 20 client.4656 populate_metadata read hostname 'smithi017' 2024-03-12T17:19:03.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.750+0000 7f9a08d63740 1 --2- 172.21.15.17:0/3994511826 >> [v2:172.21.15.17:6835/749237500,v1:172.21.15.17:6837/749237500] conn(0x55cb64c5b1e0 0x55cb64bf6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:03.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.750+0000 7f9a08d63740 4 client.4656 mds_command: new command op to 4245 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-12T17:19:03.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.750+0000 7f9a08d63740 1 -- 172.21.15.17:0/3994511826 --> [v2:172.21.15.17:6835/749237500,v1:172.21.15.17:6837/749237500] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55cb648053c0 con 0x55cb64c5b1e0 2024-03-12T17:19:03.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.750+0000 7f99f7e00640 1 --2- 172.21.15.17:0/3994511826 >> [v2:172.21.15.17:6835/749237500,v1:172.21.15.17:6837/749237500] conn(0x55cb64c5b1e0 0x55cb64bf6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:03.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.751+0000 7f99f7e00640 1 --2- 172.21.15.17:0/3994511826 >> [v2:172.21.15.17:6835/749237500,v1:172.21.15.17:6837/749237500] conn(0x55cb64c5b1e0 0x55cb64bf6540 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5022291624e77b27 server_cookie=cde0315e3c14c2d6 in_seq=0 out_seq=0 2024-03-12T17:19:03.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.751+0000 7f99ecc00640 10 client.4656 ms_handle_connect on v2:172.21.15.17:6835/749237500 2024-03-12T17:19:03.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.751+0000 7f99ecc00640 1 -- 172.21.15.17:0/3994511826 <== mds.0 v2:172.21.15.17:6835/749237500 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55cb648053c0 con 0x55cb64c5b1e0 2024-03-12T17:19:03.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.751+0000 7f99ecc00640 10 client.4656 handle_command_reply: tid=0 2024-03-12T17:19:03.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.751+0000 7f9a08d63740 1 client.4656 shutdown 2024-03-12T17:19:03.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.751+0000 7f9a08d63740 1 -- 172.21.15.17:0/3994511826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64bab280 msgr2=0x55cb64bf36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:03.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.751+0000 7f9a08d63740 1 --2- 172.21.15.17:0/3994511826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64bab280 0x55cb64bf36b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f99f002bd20 tx=0x7f99f00a9800 comp rx=0 tx=0).stop 2024-03-12T17:19:03.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.751+0000 7f9a08d63740 1 -- 172.21.15.17:0/3994511826 shutdown_connections 2024-03-12T17:19:03.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.751+0000 7f9a08d63740 1 --2- 172.21.15.17:0/3994511826 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55cb64bf5200 0x55cb64c5aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:03.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.751+0000 7f9a08d63740 1 --2- 172.21.15.17:0/3994511826 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55cb64bcf8c0 0x55cb64c57b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:03.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.751+0000 7f9a08d63740 1 --2- 172.21.15.17:0/3994511826 >> [v2:172.21.15.17:6835/749237500,v1:172.21.15.17:6837/749237500] conn(0x55cb64c5b1e0 0x55cb64bf6540 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:03.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.751+0000 7f9a08d63740 1 --2- 172.21.15.17:0/3994511826 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55cb64bab280 0x55cb64bf36b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:03.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.751+0000 7f9a08d63740 1 -- 172.21.15.17:0/3994511826 >> 172.21.15.17:0/3994511826 conn(0x55cb64ba7720 msgr2=0x55cb64bac3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:03.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.751+0000 7f99ecc00640 0 client.4656 ms_handle_reset on v2:172.21.15.17:6835/749237500 2024-03-12T17:19:03.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.751+0000 7f9a08d63740 1 -- 172.21.15.17:0/3994511826 shutdown_connections 2024-03-12T17:19:03.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.751+0000 7f9a08d63740 1 -- 172.21.15.17:0/3994511826 wait complete. 2024-03-12T17:19:03.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.752+0000 7f9a08d63740 20 client.4656 trim_cache size 0 max 16384 2024-03-12T17:19:03.751 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-12T17:19:03.751 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "73425bc1-630f-4bd2-8abb-716ed5d8ca29", 2024-03-12T17:19:03.751 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-03-12T17:19:03.751 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 4245, 2024-03-12T17:19:03.751 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-03-12T17:19:03.751 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-03-12T17:19:03.751 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-03-12T17:19:03.751 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 17.905867796999999, 2024-03-12T17:19:03.751 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 7, 2024-03-12T17:19:03.752 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 21, 2024-03-12T17:19:03.752 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 21, 2024-03-12T17:19:03.752 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 25.092061275999999 2024-03-12T17:19:03.752 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-12T17:19:03.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.752+0000 7f9a04a00640 1 -- 172.21.15.17:0/283700890 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f99dc06ac00 msgr2=0x7f99dc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:03.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.752+0000 7f9a04a00640 1 --2- 172.21.15.17:0/283700890 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f99dc06ac00 0x7f99dc06d0c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9a00153e30 tx=0x7f99e8008040 comp rx=0 tx=0).stop 2024-03-12T17:19:03.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.752+0000 7f9a04a00640 1 -- 172.21.15.17:0/283700890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99e40039a0 msgr2=0x7f9a000b1140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:03.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.752+0000 7f9a04a00640 1 --2- 172.21.15.17:0/283700890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99e40039a0 0x7f9a000b1140 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f99f0008fd0 tx=0x7f99f0001230 comp rx=0 tx=0).stop 2024-03-12T17:19:03.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.752+0000 7f9a04a00640 1 -- 172.21.15.17:0/283700890 shutdown_connections 2024-03-12T17:19:03.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.752+0000 7f9a04a00640 1 --2- 172.21.15.17:0/283700890 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f99dc06ac00 0x7f99dc06d0c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:03.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.752+0000 7f9a04a00640 1 --2- 172.21.15.17:0/283700890 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9a000aab10 0x7f9a000adad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:03.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.752+0000 7f9a04a00640 1 --2- 172.21.15.17:0/283700890 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9a000ab0e0 0x7f9a000aa5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:03.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.752+0000 7f9a04a00640 1 --2- 172.21.15.17:0/283700890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99e40039a0 0x7f9a000b1140 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:03.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.752+0000 7f9a04a00640 1 -- 172.21.15.17:0/283700890 >> 172.21.15.17:0/283700890 conn(0x7f9a000cf5f0 msgr2=0x7f9a000cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:03.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.752+0000 7f9a04a00640 1 -- 172.21.15.17:0/283700890 shutdown_connections 2024-03-12T17:19:03.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:03.752+0000 7f9a04a00640 1 -- 172.21.15.17:0/283700890 wait complete. 2024-03-12T17:19:03.765 INFO:teuthology.run_tasks:Running task kclient... 2024-03-12T17:19:03.792 INFO:tasks.kclient:Mounting kernel clients... 2024-03-12T17:19:03.792 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-03-12T17:19:03.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:03.792 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-03-12T17:19:03.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:03.848 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link delete ceph-brx 2024-03-12T17:19:03.950 INFO:teuthology.orchestra.run.smithi017.stderr:Cannot find device "ceph-brx" 2024-03-12T17:19:03.953 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-12T17:19:03.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:03.954 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-03-12T17:19:04.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:04.008 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link delete ceph-brx 2024-03-12T17:19:04.112 INFO:teuthology.orchestra.run.smithi017.stderr:Cannot find device "ceph-brx" 2024-03-12T17:19:04.115 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-12T17:19:04.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:04.116 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list 2024-03-12T17:19:04.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:04.174 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link delete ceph-brx 2024-03-12T17:19:04.275 INFO:teuthology.orchestra.run.smithi094.stderr:Cannot find device "ceph-brx" 2024-03-12T17:19:04.278 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-12T17:19:04.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:04.279 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list 2024-03-12T17:19:04.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:04.328 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link delete ceph-brx 2024-03-12T17:19:04.422 INFO:teuthology.orchestra.run.smithi094.stderr:Cannot find device "ceph-brx" 2024-03-12T17:19:04.427 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-12T17:19:04.427 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-03-12T17:19:04.427 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-12T17:19:04.427 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-12T17:19:04.428 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-12T17:19:04.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.659+0000 7feb77200640 1 Processor -- start 2024-03-12T17:19:04.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.660+0000 7feb77200640 1 -- start start 2024-03-12T17:19:04.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.661+0000 7feb77200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7feb7015ce80 0x7feb700cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:04.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.661+0000 7feb77200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb70161650 con 0x7feb7015caa0 2024-03-12T17:19:04.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.661+0000 7feb77200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb70161090 con 0x7feb700b85f0 2024-03-12T17:19:04.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.661+0000 7feb77200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb70160ea0 con 0x7feb7015ce80 2024-03-12T17:19:04.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.661+0000 7feb75e00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7feb7015caa0 0x7feb70160790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:52396/0 (socket says 172.21.15.17:52396) 2024-03-12T17:19:04.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.661+0000 7feb75e00640 1 -- 172.21.15.17:0/4005871501 learned_addr learned my addr 172.21.15.17:0/4005871501 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:04.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.662+0000 7feb75400640 1 --2- 172.21.15.17:0/4005871501 >> v2:172.21.15.17:3300/0 conn(0x7feb7015ce80 0x7feb700cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:04.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.662+0000 7feb74a00640 1 -- 172.21.15.17:0/4005871501 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4287941933 0 0) 0x7feb70161650 con 0x7feb7015caa0 2024-03-12T17:19:04.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.662+0000 7feb74a00640 1 -- 172.21.15.17:0/4005871501 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb5c003520 con 0x7feb7015caa0 2024-03-12T17:19:04.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.662+0000 7feb75400640 1 -- 172.21.15.17:0/4005871501 >> v1:172.21.15.94:6789/0 conn(0x7feb700b85f0 legacy=0x7feb700d12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:04.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.662+0000 7feb75400640 1 -- 172.21.15.17:0/4005871501 >> v1:172.21.15.17:6789/0 conn(0x7feb7015caa0 legacy=0x7feb70160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:04.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.662+0000 7feb75400640 1 -- 172.21.15.17:0/4005871501 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb70161370 con 0x7feb7015ce80 2024-03-12T17:19:04.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.663+0000 7feb75400640 1 --2- 172.21.15.17:0/4005871501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb7015ce80 0x7feb700cf330 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7feb600097a0 tx=0x7feb6002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e452176a01dff4a server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:04.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.664+0000 7feb74a00640 1 -- 172.21.15.17:0/4005871501 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb60031830 con 0x7feb7015ce80 2024-03-12T17:19:04.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.664+0000 7feb74a00640 1 -- 172.21.15.17:0/4005871501 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb60031990 con 0x7feb7015ce80 2024-03-12T17:19:04.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.664+0000 7feb74a00640 1 -- 172.21.15.17:0/4005871501 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb60031d00 con 0x7feb7015ce80 2024-03-12T17:19:04.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.664+0000 7feb77200640 1 -- 172.21.15.17:0/4005871501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb7015ce80 msgr2=0x7feb700cf330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:04.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.664+0000 7feb77200640 1 --2- 172.21.15.17:0/4005871501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb7015ce80 0x7feb700cf330 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7feb600097a0 tx=0x7feb6002b8d0 comp rx=0 tx=0).stop 2024-03-12T17:19:04.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.664+0000 7feb77200640 1 -- 172.21.15.17:0/4005871501 shutdown_connections 2024-03-12T17:19:04.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.664+0000 7feb77200640 1 --2- 172.21.15.17:0/4005871501 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb7015ce80 0x7feb700cf330 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:04.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.664+0000 7feb77200640 1 -- 172.21.15.17:0/4005871501 >> 172.21.15.17:0/4005871501 conn(0x7feb7006b160 msgr2=0x7feb7006b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:04.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.664+0000 7feb77200640 1 -- 172.21.15.17:0/4005871501 shutdown_connections 2024-03-12T17:19:04.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.664+0000 7feb77200640 1 -- 172.21.15.17:0/4005871501 wait complete. 2024-03-12T17:19:04.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.666+0000 7feb77200640 1 Processor -- start 2024-03-12T17:19:04.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.666+0000 7feb77200640 1 -- start start 2024-03-12T17:19:04.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.667+0000 7feb77200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb700b85f0 0x7feb70156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:04.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.667+0000 7feb77200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feb7015caa0 0x7feb700ca200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:04.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.667+0000 7feb77200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb7015ce80 0x7feb70158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:04.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.667+0000 7feb77200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb700c7580 con 0x7feb700b85f0 2024-03-12T17:19:04.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.667+0000 7feb77200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb700cacc0 con 0x7feb7015ce80 2024-03-12T17:19:04.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.667+0000 7feb77200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb700c77d0 con 0x7feb7015caa0 2024-03-12T17:19:04.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.667+0000 7feb75e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb700b85f0 0x7feb70156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:04.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.667+0000 7feb75e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb700b85f0 0x7feb70156f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39540/0 (socket says 172.21.15.17:39540) 2024-03-12T17:19:04.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.667+0000 7feb75e00640 1 -- 172.21.15.17:0/3203259356 learned_addr learned my addr 172.21.15.17:0/3203259356 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:04.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.668+0000 7feb75400640 1 --2- 172.21.15.17:0/3203259356 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feb7015caa0 0x7feb700ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:04.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.668+0000 7feb76800640 1 --2- 172.21.15.17:0/3203259356 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb7015ce80 0x7feb70158dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:04.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.668+0000 7feb75e00640 1 -- 172.21.15.17:0/3203259356 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feb7015caa0 msgr2=0x7feb700ca200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:04.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.668+0000 7feb75e00640 1 --2- 172.21.15.17:0/3203259356 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feb7015caa0 0x7feb700ca200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:04.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.668+0000 7feb75e00640 1 -- 172.21.15.17:0/3203259356 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb7015ce80 msgr2=0x7feb70158dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:04.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.668+0000 7feb75e00640 1 --2- 172.21.15.17:0/3203259356 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb7015ce80 0x7feb70158dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:04.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.668+0000 7feb75e00640 1 -- 172.21.15.17:0/3203259356 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb60009400 con 0x7feb700b85f0 2024-03-12T17:19:04.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.668+0000 7feb75400640 1 --2- 172.21.15.17:0/3203259356 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feb7015caa0 0x7feb700ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:04.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.668+0000 7feb76800640 1 --2- 172.21.15.17:0/3203259356 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb7015ce80 0x7feb70158dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:04.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.668+0000 7feb75e00640 1 --2- 172.21.15.17:0/3203259356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb700b85f0 0x7feb70156f90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7feb6800cb40 tx=0x7feb6800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:04.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.668+0000 7feb66000640 1 -- 172.21.15.17:0/3203259356 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6800aca0 con 0x7feb700b85f0 2024-03-12T17:19:04.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.668+0000 7feb66000640 1 -- 172.21.15.17:0/3203259356 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb6800ae00 con 0x7feb700b85f0 2024-03-12T17:19:04.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.668+0000 7feb66000640 1 -- 172.21.15.17:0/3203259356 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb68012620 con 0x7feb700b85f0 2024-03-12T17:19:04.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.669+0000 7feb77200640 1 -- 172.21.15.17:0/3203259356 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb700c7ab0 con 0x7feb700b85f0 2024-03-12T17:19:04.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.669+0000 7feb77200640 1 -- 172.21.15.17:0/3203259356 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb700b1d10 con 0x7feb700b85f0 2024-03-12T17:19:04.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.670+0000 7feb77200640 1 -- 172.21.15.17:0/3203259356 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb70072360 con 0x7feb700b85f0 2024-03-12T17:19:04.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.671+0000 7feb66000640 1 -- 172.21.15.17:0/3203259356 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7feb68007070 con 0x7feb700b85f0 2024-03-12T17:19:04.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.672+0000 7feb66000640 1 --2- 172.21.15.17:0/3203259356 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7feb5406ac30 0x7feb5406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:04.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.672+0000 7feb66000640 1 -- 172.21.15.17:0/3203259356 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb68089400 con 0x7feb700b85f0 2024-03-12T17:19:04.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.672+0000 7feb75400640 1 --2- 172.21.15.17:0/3203259356 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7feb5406ac30 0x7feb5406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:04.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.672+0000 7feb75400640 1 --2- 172.21.15.17:0/3203259356 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7feb5406ac30 0x7feb5406d0f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7feb60036000 tx=0x7feb6003c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:04.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.676+0000 7feb66000640 1 -- 172.21.15.17:0/3203259356 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7feb68054540 con 0x7feb700b85f0 2024-03-12T17:19:04.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.911+0000 7feb77200640 1 -- 172.21.15.17:0/3203259356 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7feb700c7fd0 con 0x7feb700b85f0 2024-03-12T17:19:04.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.912+0000 7feb66000640 1 -- 172.21.15.17:0/3203259356 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7feb700c7fd0 con 0x7feb700b85f0 2024-03-12T17:19:04.908 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-12T17:19:04.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.915+0000 7feb77200640 1 -- 172.21.15.17:0/3203259356 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7feb5406ac30 msgr2=0x7feb5406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:04.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.915+0000 7feb77200640 1 --2- 172.21.15.17:0/3203259356 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7feb5406ac30 0x7feb5406d0f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7feb60036000 tx=0x7feb6003c040 comp rx=0 tx=0).stop 2024-03-12T17:19:04.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.915+0000 7feb77200640 1 -- 172.21.15.17:0/3203259356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb700b85f0 msgr2=0x7feb70156f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:04.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.915+0000 7feb77200640 1 --2- 172.21.15.17:0/3203259356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb700b85f0 0x7feb70156f90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7feb6800cb40 tx=0x7feb6800a060 comp rx=0 tx=0).stop 2024-03-12T17:19:04.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.915+0000 7feb77200640 1 -- 172.21.15.17:0/3203259356 shutdown_connections 2024-03-12T17:19:04.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.915+0000 7feb77200640 1 --2- 172.21.15.17:0/3203259356 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7feb5406ac30 0x7feb5406d0f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:04.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.915+0000 7feb77200640 1 --2- 172.21.15.17:0/3203259356 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb7015ce80 0x7feb70158dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:04.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.915+0000 7feb77200640 1 --2- 172.21.15.17:0/3203259356 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feb7015caa0 0x7feb700ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:04.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.915+0000 7feb77200640 1 --2- 172.21.15.17:0/3203259356 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb700b85f0 0x7feb70156f90 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:04.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.915+0000 7feb77200640 1 -- 172.21.15.17:0/3203259356 >> 172.21.15.17:0/3203259356 conn(0x7feb7006b160 msgr2=0x7feb7015be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:04.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.915+0000 7feb77200640 1 -- 172.21.15.17:0/3203259356 shutdown_connections 2024-03-12T17:19:04.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:04.915+0000 7feb77200640 1 -- 172.21.15.17:0/3203259356 wait complete. 2024-03-12T17:19:04.932 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-12T17:19:04.932 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-12T17:19:04.932 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2024-03-12T17:19:04.932 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-12T17:19:04.932 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-12T17:19:04.932 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-12T17:19:04.932 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-12T17:19:04.932 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-12T17:19:04.932 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-12T17:19:04.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:04.933 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2024-03-12T17:19:04.988 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-12T17:19:04.988 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-12T17:19:04.989 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2024-03-12T17:19:04.989 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:19:04.989 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2024-03-12T17:19:04.989 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:19:04.989 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-12T17:19:04.989 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2024-03-12T17:19:04.989 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2024-03-12T17:19:04.989 INFO:teuthology.orchestra.run.smithi017.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-12T17:19:04.989 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2024-03-12T17:19:04.989 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2024-03-12T17:19:04.989 INFO:teuthology.orchestra.run.smithi017.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-12T17:19:04.989 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2024-03-12T17:19:04.989 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2024-03-12T17:19:04.989 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-12T17:19:04.989 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 42566sec preferred_lft 42566sec 2024-03-12T17:19:04.990 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link noprefixroute 2024-03-12T17:19:04.990 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:19:04.990 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-12T17:19:04.990 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2024-03-12T17:19:04.990 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2024-03-12T17:19:04.990 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-12T17:19:04.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:04.991 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2024-03-12T17:19:04.991 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-03-12T17:19:04.991 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add name ceph-brx type bridge 2024-03-12T17:19:04.991 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr flush dev ceph-brx 2024-03-12T17:19:04.991 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set ceph-brx up 2024-03-12T17:19:04.991 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-12T17:19:04.991 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-03-12T17:19:05.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:05.448 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-12T17:19:05.535 INFO:teuthology.orchestra.run.smithi017.stdout:1 2024-03-12T17:19:05.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:05.539 DEBUG:teuthology.orchestra.run.smithi017:> route 2024-03-12T17:19:05.594 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2024-03-12T17:19:05.594 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-12T17:19:05.595 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-12T17:19:05.595 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-12T17:19:05.595 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-12T17:19:05.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:05.596 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2024-03-12T17:19:05.596 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-03-12T17:19:05.596 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-12T17:19:05.596 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-12T17:19:05.596 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-12T17:19:05.596 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-03-12T17:19:06.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:06.339 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-03-12T17:19:06.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:06.398 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list-id 2024-03-12T17:19:06.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:06.453 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2024-03-12T17:19:06.453 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-03-12T17:19:06.453 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-12T17:19:06.453 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-12T17:19:06.453 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-03-12T17:19:06.605 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-12T17:19:06.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:06.605 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2024-03-12T17:19:06.605 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-03-12T17:19:06.605 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-12T17:19:06.606 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-12T17:19:06.606 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-12T17:19:06.606 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-12T17:19:06.606 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-12T17:19:06.606 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-03-12T17:19:06.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:06.904 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2024-03-12T17:19:06.904 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-03-12T17:19:06.904 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2024-03-12T17:19:06.904 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set dev brx.0 master ceph-brx 2024-03-12T17:19:06.904 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-03-12T17:19:07.067 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-12T17:19:07.068 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-12T17:19:07.116 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-12T17:19:07.116 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-12T17:19:07.116 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-12T17:19:07.213 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-03-12T17:19:07.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:07.213 DEBUG:teuthology.orchestra.run.smithi017:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-12T17:19:07.358 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-12T17:19:07.358 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-12T17:19:08.026 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-12T17:19:08.026 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-12T17:19:08.026 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.94:3300,172.21.15.94:3301" 2024-03-12T17:19:08.026 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: trying mount with new device syntax: 0@73425bc1-630f-4bd2-8abb-716ed5d8ca29.cephfs=/ 2024-03-12T17:19:08.026 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.17:3300/172.21.15.94:3300/172.21.15.94:3301" will pass to kernel 2024-03-12T17:19:08.028 INFO:teuthology.orchestra.run.smithi017.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-03-12T17:19:08.028 INFO:teuthology.orchestra.run.smithi017.stdout: You just mounted a file system that supports labels which does not 2024-03-12T17:19:08.029 INFO:teuthology.orchestra.run.smithi017.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-12T17:19:08.029 INFO:teuthology.orchestra.run.smithi017.stdout: applications will generate AVC messages and not be allowed access to 2024-03-12T17:19:08.029 INFO:teuthology.orchestra.run.smithi017.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-12T17:19:08.035 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-12T17:19:08.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:08.035 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-12T17:19:08.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:08.137 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-12T17:19:08.216 INFO:teuthology.orchestra.run.smithi017.stdout:client4531 2024-03-12T17:19:08.216 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:19:08.216 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-12T17:19:08.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:08.275 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-12T17:19:08.351 INFO:teuthology.orchestra.run.smithi017.stdout:client4531 2024-03-12T17:19:08.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:08.351 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-12T17:19:08.428 INFO:teuthology.orchestra.run.smithi017.stdout:client4531 2024-03-12T17:19:08.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:08.428 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/73425bc1-630f-4bd2-8abb-716ed5d8ca29.client4531/status') 2024-03-12T17:19:08.530 INFO:teuthology.orchestra.run.smithi017.stdout:instance: client.4531 (3)172.21.15.17:0/1553678164 2024-03-12T17:19:08.531 INFO:teuthology.orchestra.run.smithi017.stdout:blocklisted: false 2024-03-12T17:19:08.531 INFO:teuthology.orchestra.run.smithi017.stderr:0+1 records in 2024-03-12T17:19:08.531 INFO:teuthology.orchestra.run.smithi017.stderr:0+1 records out 2024-03-12T17:19:08.531 INFO:teuthology.orchestra.run.smithi017.stderr:70 bytes copied, 9.1555e-05 s, 765 kB/s 2024-03-12T17:19:08.535 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-03-12T17:19:08.535 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-12T17:19:08.536 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-03-12T17:19:08.536 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-12T17:19:08.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.757+0000 7f7af1600640 1 Processor -- start 2024-03-12T17:19:08.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.757+0000 7f7af1600640 1 -- start start 2024-03-12T17:19:08.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.758+0000 7f7af1600640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f7aec1441f0 0x7f7aec070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:08.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.759+0000 7f7af1600640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7aec0b3b70 0x7f7aec0b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:08.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.759+0000 7f7af1600640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aec0a7660 con 0x7f7aec15ae20 2024-03-12T17:19:08.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.759+0000 7f7af1600640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aec15e460 con 0x7f7aec1441f0 2024-03-12T17:19:08.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.759+0000 7f7af1600640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aec06d840 con 0x7f7aec0b3b70 2024-03-12T17:19:08.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.759+0000 7f7aeb400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f7aec15ae20 0x7f7aec06d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:52406/0 (socket says 172.21.15.17:52406) 2024-03-12T17:19:08.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.759+0000 7f7aeb400640 1 -- 172.21.15.17:0/1959942674 learned_addr learned my addr 172.21.15.17:0/1959942674 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:08.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.759+0000 7f7aebe00640 1 --2- 172.21.15.17:0/1959942674 >> v2:172.21.15.17:3300/0 conn(0x7f7aec1441f0 0x7f7aec070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:08.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.759+0000 7f7af0c00640 1 --2- 172.21.15.17:0/1959942674 >> v2:172.21.15.94:3300/0 conn(0x7f7aec0b3b70 0x7f7aec0b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:08.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.760+0000 7f7aeaa00640 1 -- 172.21.15.17:0/1959942674 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4036190077 0 0) 0x7f7aec0a7660 con 0x7f7aec15ae20 2024-03-12T17:19:08.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.760+0000 7f7aeaa00640 1 -- 172.21.15.17:0/1959942674 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ad0003520 con 0x7f7aec15ae20 2024-03-12T17:19:08.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.760+0000 7f7aebe00640 1 -- 172.21.15.17:0/1959942674 >> v2:172.21.15.94:3300/0 conn(0x7f7aec0b3b70 msgr2=0x7f7aec0b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:08.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.760+0000 7f7aebe00640 1 --2- 172.21.15.17:0/1959942674 >> v2:172.21.15.94:3300/0 conn(0x7f7aec0b3b70 0x7f7aec0b3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:08.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.760+0000 7f7aebe00640 1 -- 172.21.15.17:0/1959942674 >> v1:172.21.15.17:6789/0 conn(0x7f7aec15ae20 legacy=0x7f7aec06d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:08.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.760+0000 7f7aebe00640 1 -- 172.21.15.17:0/1959942674 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aec0b44c0 con 0x7f7aec1441f0 2024-03-12T17:19:08.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.760+0000 7f7af0c00640 1 --2- 172.21.15.17:0/1959942674 >> v2:172.21.15.94:3300/0 conn(0x7f7aec0b3b70 0x7f7aec0b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:19:08.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.761+0000 7f7aebe00640 1 --2- 172.21.15.17:0/1959942674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7aec1441f0 0x7f7aec070240 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7aec15e3a0 tx=0x7f7adc02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2300bef57fef7aab server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:08.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.761+0000 7f7aeaa00640 1 -- 172.21.15.17:0/1959942674 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7adc030610 con 0x7f7aec1441f0 2024-03-12T17:19:08.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.761+0000 7f7aeaa00640 1 -- 172.21.15.17:0/1959942674 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7adc030770 con 0x7f7aec1441f0 2024-03-12T17:19:08.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.761+0000 7f7aeaa00640 1 -- 172.21.15.17:0/1959942674 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7adc030b00 con 0x7f7aec1441f0 2024-03-12T17:19:08.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.762+0000 7f7af1600640 1 -- 172.21.15.17:0/1959942674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7aec1441f0 msgr2=0x7f7aec070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:08.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.762+0000 7f7af1600640 1 --2- 172.21.15.17:0/1959942674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7aec1441f0 0x7f7aec070240 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7aec15e3a0 tx=0x7f7adc02b960 comp rx=0 tx=0).stop 2024-03-12T17:19:08.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.762+0000 7f7af1600640 1 -- 172.21.15.17:0/1959942674 shutdown_connections 2024-03-12T17:19:08.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.762+0000 7f7af1600640 1 --2- 172.21.15.17:0/1959942674 >> v2:172.21.15.94:3300/0 conn(0x7f7aec0b3b70 0x7f7aec0b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:08.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.762+0000 7f7af1600640 1 --2- 172.21.15.17:0/1959942674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7aec1441f0 0x7f7aec070240 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:08.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.762+0000 7f7af1600640 1 -- 172.21.15.17:0/1959942674 >> 172.21.15.17:0/1959942674 conn(0x7f7aec069ce0 msgr2=0x7f7aec06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:08.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.762+0000 7f7af1600640 1 -- 172.21.15.17:0/1959942674 shutdown_connections 2024-03-12T17:19:08.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.762+0000 7f7af1600640 1 -- 172.21.15.17:0/1959942674 wait complete. 2024-03-12T17:19:08.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.764+0000 7f7af1600640 1 Processor -- start 2024-03-12T17:19:08.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.764+0000 7f7af1600640 1 -- start start 2024-03-12T17:19:08.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.765+0000 7f7af1600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7aec0b3b70 0x7f7aec0cb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:08.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.765+0000 7f7af1600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7aec1441f0 0x7f7aec0b2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:08.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.765+0000 7f7af1600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7aec15ae20 0x7f7aec1f1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:08.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.765+0000 7f7af1600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec0b2e70 con 0x7f7aec0b3b70 2024-03-12T17:19:08.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.765+0000 7f7af1600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec0b3150 con 0x7f7aec15ae20 2024-03-12T17:19:08.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.765+0000 7f7af1600640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec0b3430 con 0x7f7aec1441f0 2024-03-12T17:19:08.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.765+0000 7f7aebe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7aec0b3b70 0x7f7aec0cb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:08.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.765+0000 7f7aebe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7aec0b3b70 0x7f7aec0cb1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39554/0 (socket says 172.21.15.17:39554) 2024-03-12T17:19:08.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.765+0000 7f7aebe00640 1 -- 172.21.15.17:0/772893183 learned_addr learned my addr 172.21.15.17:0/772893183 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:08.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.766+0000 7f7aeb400640 1 --2- 172.21.15.17:0/772893183 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7aec1441f0 0x7f7aec0b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:08.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.766+0000 7f7af0c00640 1 --2- 172.21.15.17:0/772893183 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7aec15ae20 0x7f7aec1f1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:08.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.766+0000 7f7aebe00640 1 -- 172.21.15.17:0/772893183 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7aec1441f0 msgr2=0x7f7aec0b2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:08.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.766+0000 7f7aebe00640 1 --2- 172.21.15.17:0/772893183 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7aec1441f0 0x7f7aec0b2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:08.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.766+0000 7f7aebe00640 1 -- 172.21.15.17:0/772893183 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7aec15ae20 msgr2=0x7f7aec1f1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:08.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.766+0000 7f7aebe00640 1 --2- 172.21.15.17:0/772893183 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7aec15ae20 0x7f7aec1f1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:08.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.766+0000 7f7aebe00640 1 -- 172.21.15.17:0/772893183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7adc009400 con 0x7f7aec0b3b70 2024-03-12T17:19:08.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.766+0000 7f7af0c00640 1 --2- 172.21.15.17:0/772893183 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7aec15ae20 0x7f7aec1f1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:08.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.766+0000 7f7aebe00640 1 --2- 172.21.15.17:0/772893183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7aec0b3b70 0x7f7aec0cb1f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7adc009890 tx=0x7f7adc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:08.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.766+0000 7f7ae3e00640 1 -- 172.21.15.17:0/772893183 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7adc03e040 con 0x7f7aec0b3b70 2024-03-12T17:19:08.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.767+0000 7f7ae3e00640 1 -- 172.21.15.17:0/772893183 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7adc039cb0 con 0x7f7aec0b3b70 2024-03-12T17:19:08.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.767+0000 7f7af1600640 1 -- 172.21.15.17:0/772893183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aec0b3710 con 0x7f7aec0b3b70 2024-03-12T17:19:08.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.767+0000 7f7ae3e00640 1 -- 172.21.15.17:0/772893183 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7adc044630 con 0x7f7aec0b3b70 2024-03-12T17:19:08.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.767+0000 7f7af1600640 1 -- 172.21.15.17:0/772893183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aec1f1ff0 con 0x7f7aec0b3b70 2024-03-12T17:19:08.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.768+0000 7f7af1600640 1 -- 172.21.15.17:0/772893183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aec04e030 con 0x7f7aec0b3b70 2024-03-12T17:19:08.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.769+0000 7f7ae3e00640 1 -- 172.21.15.17:0/772893183 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f7adc044790 con 0x7f7aec0b3b70 2024-03-12T17:19:08.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.770+0000 7f7ae3e00640 1 --2- 172.21.15.17:0/772893183 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f7acc06ac00 0x7f7acc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:08.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.770+0000 7f7ae3e00640 1 -- 172.21.15.17:0/772893183 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7adc0ab700 con 0x7f7aec0b3b70 2024-03-12T17:19:08.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.770+0000 7f7aeb400640 1 --2- 172.21.15.17:0/772893183 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f7acc06ac00 0x7f7acc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:08.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.771+0000 7f7aeb400640 1 --2- 172.21.15.17:0/772893183 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f7acc06ac00 0x7f7acc06d0c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7aec143c00 tx=0x7f7ad8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:08.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:08.775+0000 7f7ae3e00640 1 -- 172.21.15.17:0/772893183 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f7adc0768d0 con 0x7f7aec0b3b70 2024-03-12T17:19:09.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:09.014+0000 7f7af1600640 1 -- 172.21.15.17:0/772893183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7aec15d7c0 con 0x7f7aec0b3b70 2024-03-12T17:19:09.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:09.015+0000 7f7ae3e00640 1 -- 172.21.15.17:0/772893183 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7adc079ef0 con 0x7f7aec0b3b70 2024-03-12T17:19:09.010 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-12T17:19:09.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:09.017+0000 7f7af1600640 1 -- 172.21.15.17:0/772893183 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f7acc06ac00 msgr2=0x7f7acc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:09.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:09.017+0000 7f7af1600640 1 --2- 172.21.15.17:0/772893183 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f7acc06ac00 0x7f7acc06d0c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7aec143c00 tx=0x7f7ad8009040 comp rx=0 tx=0).stop 2024-03-12T17:19:09.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:09.017+0000 7f7af1600640 1 -- 172.21.15.17:0/772893183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7aec0b3b70 msgr2=0x7f7aec0cb1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:09.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:09.018+0000 7f7af1600640 1 --2- 172.21.15.17:0/772893183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7aec0b3b70 0x7f7aec0cb1f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7adc009890 tx=0x7f7adc004730 comp rx=0 tx=0).stop 2024-03-12T17:19:09.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:09.018+0000 7f7af1600640 1 -- 172.21.15.17:0/772893183 shutdown_connections 2024-03-12T17:19:09.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:09.018+0000 7f7af1600640 1 --2- 172.21.15.17:0/772893183 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f7acc06ac00 0x7f7acc06d0c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:09.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:09.018+0000 7f7af1600640 1 --2- 172.21.15.17:0/772893183 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7aec15ae20 0x7f7aec1f1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:09.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:09.018+0000 7f7af1600640 1 --2- 172.21.15.17:0/772893183 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7aec1441f0 0x7f7aec0b2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:09.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:09.018+0000 7f7af1600640 1 --2- 172.21.15.17:0/772893183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7aec0b3b70 0x7f7aec0cb1f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:09.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:09.018+0000 7f7af1600640 1 -- 172.21.15.17:0/772893183 >> 172.21.15.17:0/772893183 conn(0x7f7aec069ce0 msgr2=0x7f7aec06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:09.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:09.018+0000 7f7af1600640 1 -- 172.21.15.17:0/772893183 shutdown_connections 2024-03-12T17:19:09.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:09.018+0000 7f7af1600640 1 -- 172.21.15.17:0/772893183 wait complete. 2024-03-12T17:19:09.032 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-12T17:19:09.032 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-12T17:19:09.032 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2024-03-12T17:19:09.032 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-03-12T17:19:09.032 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-03-12T17:19:09.032 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-12T17:19:09.032 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-12T17:19:09.032 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-12T17:19:09.032 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-03-12T17:19:09.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:09.033 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2024-03-12T17:19:09.088 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-12T17:19:09.088 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-12T17:19:09.088 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2024-03-12T17:19:09.088 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:19:09.088 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2024-03-12T17:19:09.088 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:19:09.088 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-12T17:19:09.088 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2024-03-12T17:19:09.088 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2024-03-12T17:19:09.088 INFO:teuthology.orchestra.run.smithi017.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-12T17:19:09.088 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2024-03-12T17:19:09.088 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2024-03-12T17:19:09.089 INFO:teuthology.orchestra.run.smithi017.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-12T17:19:09.089 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2024-03-12T17:19:09.089 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2024-03-12T17:19:09.089 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-12T17:19:09.089 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 42562sec preferred_lft 42562sec 2024-03-12T17:19:09.089 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link noprefixroute 2024-03-12T17:19:09.089 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:19:09.089 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-12T17:19:09.089 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2024-03-12T17:19:09.089 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2024-03-12T17:19:09.089 INFO:teuthology.orchestra.run.smithi017.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-12T17:19:09.089 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether ea:df:37:d7:69:8a brd ff:ff:ff:ff:ff:ff 2024-03-12T17:19:09.089 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-12T17:19:09.089 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:19:09.089 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::2494:13ff:fe8b:62c9/64 scope link 2024-03-12T17:19:09.090 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:19:09.090 INFO:teuthology.orchestra.run.smithi017.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-12T17:19:09.090 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether ea:df:37:d7:69:8a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-12T17:19:09.090 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::e8df:37ff:fed7:698a/64 scope link 2024-03-12T17:19:09.090 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:19:09.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:09.091 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-12T17:19:09.185 INFO:teuthology.orchestra.run.smithi017.stdout:1 2024-03-12T17:19:09.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:09.189 DEBUG:teuthology.orchestra.run.smithi017:> route 2024-03-12T17:19:09.249 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2024-03-12T17:19:09.249 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-12T17:19:09.249 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-12T17:19:09.249 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-12T17:19:09.249 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-12T17:19:09.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:09.249 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2024-03-12T17:19:09.249 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-03-12T17:19:09.250 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-12T17:19:09.250 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-12T17:19:09.250 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-12T17:19:09.250 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-03-12T17:19:09.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:09.447 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-03-12T17:19:09.499 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-12T17:19:09.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:09.500 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list-id 2024-03-12T17:19:09.556 INFO:teuthology.orchestra.run.smithi017.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-03-12T17:19:09.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:09.558 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2024-03-12T17:19:09.558 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-03-12T17:19:09.558 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-12T17:19:09.558 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-03-12T17:19:09.558 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-03-12T17:19:09.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:09.706 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-03-12T17:19:09.802 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-12T17:19:09.803 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-12T17:19:09.803 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2024-03-12T17:19:09.803 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:19:09.803 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2024-03-12T17:19:09.803 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:19:09.803 INFO:teuthology.orchestra.run.smithi017.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-12T17:19:09.803 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 96:53:ea:69:39:5f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-12T17:19:09.803 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-12T17:19:09.803 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:19:09.803 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::9453:eaff:fe69:395f/64 scope link 2024-03-12T17:19:09.803 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:19:09.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:09.808 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-03-12T17:19:09.914 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-12T17:19:09.914 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-12T17:19:09.914 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2024-03-12T17:19:09.914 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:19:09.914 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2024-03-12T17:19:09.914 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:19:09.914 INFO:teuthology.orchestra.run.smithi017.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-12T17:19:09.915 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 96:53:ea:69:39:5f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-12T17:19:09.915 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-12T17:19:09.915 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:19:09.915 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::9453:eaff:fe69:395f/64 scope link 2024-03-12T17:19:09.915 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:19:09.919 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-03-12T17:19:09.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:09.920 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2024-03-12T17:19:09.920 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-03-12T17:19:09.920 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-03-12T17:19:09.920 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-03-12T17:19:09.920 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-03-12T17:19:09.920 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-03-12T17:19:09.920 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-03-12T17:19:09.921 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-03-12T17:19:10.059 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:19:10.064 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:19:10.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:10.206 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2024-03-12T17:19:10.206 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-03-12T17:19:10.206 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.1 up 2024-03-12T17:19:10.206 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set dev brx.1 master ceph-brx 2024-03-12T17:19:10.206 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-03-12T17:19:10.430 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-12T17:19:10.430 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-03-12T17:19:10.480 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-03-12T17:19:10.480 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-12T17:19:10.481 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-03-12T17:19:10.529 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-03-12T17:19:10.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:10.530 DEBUG:teuthology.orchestra.run.smithi017:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-12T17:19:10.676 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-12T17:19:10.676 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-12T17:19:10.714 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-12T17:19:10.714 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-12T17:19:10.714 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.94:3300,172.21.15.94:3301" 2024-03-12T17:19:10.714 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: trying mount with new device syntax: 2@73425bc1-630f-4bd2-8abb-716ed5d8ca29.cephfs=/ 2024-03-12T17:19:10.714 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.17:3300/172.21.15.94:3300/172.21.15.94:3301" will pass to kernel 2024-03-12T17:19:10.716 INFO:teuthology.orchestra.run.smithi017.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-03-12T17:19:10.716 INFO:teuthology.orchestra.run.smithi017.stdout: You just mounted a file system that supports labels which does not 2024-03-12T17:19:10.716 INFO:teuthology.orchestra.run.smithi017.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-12T17:19:10.717 INFO:teuthology.orchestra.run.smithi017.stdout: applications will generate AVC messages and not be allowed access to 2024-03-12T17:19:10.717 INFO:teuthology.orchestra.run.smithi017.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-12T17:19:10.724 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-12T17:19:10.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:10.725 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-03-12T17:19:10.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:10.816 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-12T17:19:10.876 INFO:teuthology.orchestra.run.smithi017.stdout:client4439 2024-03-12T17:19:10.876 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:19:10.876 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-12T17:19:10.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:10.930 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-12T17:19:10.989 INFO:teuthology.orchestra.run.smithi017.stdout:client4439 2024-03-12T17:19:10.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:10.989 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-12T17:19:11.046 INFO:teuthology.orchestra.run.smithi017.stdout:client4439 2024-03-12T17:19:11.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:11.047 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/73425bc1-630f-4bd2-8abb-716ed5d8ca29.client4439/status') 2024-03-12T17:19:11.137 INFO:teuthology.orchestra.run.smithi017.stdout:instance: client.4439 (3)172.21.15.17:0/1755991505 2024-03-12T17:19:11.137 INFO:teuthology.orchestra.run.smithi017.stdout:blocklisted: false 2024-03-12T17:19:11.137 INFO:teuthology.orchestra.run.smithi017.stderr:0+1 records in 2024-03-12T17:19:11.137 INFO:teuthology.orchestra.run.smithi017.stderr:0+1 records out 2024-03-12T17:19:11.137 INFO:teuthology.orchestra.run.smithi017.stderr:70 bytes copied, 6.7356e-05 s, 1.0 MB/s 2024-03-12T17:19:11.141 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-03-12T17:19:11.141 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-12T17:19:11.141 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-12T17:19:11.142 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-12T17:19:11.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.365+0000 7f8b7be00640 1 Processor -- start 2024-03-12T17:19:11.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.366+0000 7f8b7be00640 1 -- start start 2024-03-12T17:19:11.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.367+0000 7f8b7be00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8b7c15ce80 0x7f8b7c0cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:11.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.367+0000 7f8b7be00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8b7c0b85f0 0x7f8b7c0cf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:11.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.367+0000 7f8b7be00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b7c161650 con 0x7f8b7c15caa0 2024-03-12T17:19:11.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.367+0000 7f8b7be00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b7c160ea0 con 0x7f8b7c0b85f0 2024-03-12T17:19:11.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.367+0000 7f8b7be00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7c161090 con 0x7f8b7c15ce80 2024-03-12T17:19:11.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.367+0000 7f8b7aa00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f8b7c15caa0 0x7f8b7c160790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:52416/0 (socket says 172.21.15.17:52416) 2024-03-12T17:19:11.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.367+0000 7f8b7aa00640 1 -- 172.21.15.17:0/2844793604 learned_addr learned my addr 172.21.15.17:0/2844793604 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:11.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.368+0000 7f8b73e00640 1 --2- 172.21.15.17:0/2844793604 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8b7c15ce80 0x7f8b7c0cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:11.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.368+0000 7f8b7b400640 1 --2- 172.21.15.17:0/2844793604 >> v2:172.21.15.94:3300/0 conn(0x7f8b7c0b85f0 0x7f8b7c0cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:11.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.368+0000 7f8b7a000640 1 -- 172.21.15.17:0/2844793604 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1105756572 0 0) 0x7f8b7c161650 con 0x7f8b7c15caa0 2024-03-12T17:19:11.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.368+0000 7f8b7a000640 1 -- 172.21.15.17:0/2844793604 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b60003520 con 0x7f8b7c15caa0 2024-03-12T17:19:11.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.368+0000 7f8b73e00640 1 -- 172.21.15.17:0/2844793604 >> v2:172.21.15.94:3300/0 conn(0x7f8b7c0b85f0 msgr2=0x7f8b7c0cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:11.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.368+0000 7f8b73e00640 1 --2- 172.21.15.17:0/2844793604 >> v2:172.21.15.94:3300/0 conn(0x7f8b7c0b85f0 0x7f8b7c0cf870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:11.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.368+0000 7f8b73e00640 1 -- 172.21.15.17:0/2844793604 >> v1:172.21.15.17:6789/0 conn(0x7f8b7c15caa0 legacy=0x7f8b7c160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:11.364 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.368+0000 7f8b73e00640 1 -- 172.21.15.17:0/2844793604 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b7c161370 con 0x7f8b7c15ce80 2024-03-12T17:19:11.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.370+0000 7f8b73e00640 1 --2- 172.21.15.17:0/2844793604 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8b7c15ce80 0x7f8b7c0cf330 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8b640097a0 tx=0x7f8b6402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a415d9dd1ccfc662 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:11.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.374+0000 7f8b7a000640 1 -- 172.21.15.17:0/2844793604 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6402d040 con 0x7f8b7c15ce80 2024-03-12T17:19:11.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.374+0000 7f8b7a000640 1 -- 172.21.15.17:0/2844793604 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b64031810 con 0x7f8b7c15ce80 2024-03-12T17:19:11.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.374+0000 7f8b7a000640 1 -- 172.21.15.17:0/2844793604 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b64031ba0 con 0x7f8b7c15ce80 2024-03-12T17:19:11.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.375+0000 7f8b7be00640 1 -- 172.21.15.17:0/2844793604 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8b7c15ce80 msgr2=0x7f8b7c0cf330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:11.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.375+0000 7f8b7be00640 1 --2- 172.21.15.17:0/2844793604 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8b7c15ce80 0x7f8b7c0cf330 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8b640097a0 tx=0x7f8b6402b8b0 comp rx=0 tx=0).stop 2024-03-12T17:19:11.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.375+0000 7f8b7be00640 1 -- 172.21.15.17:0/2844793604 shutdown_connections 2024-03-12T17:19:11.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.375+0000 7f8b7be00640 1 --2- 172.21.15.17:0/2844793604 >> v2:172.21.15.94:3300/0 conn(0x7f8b7c0b85f0 0x7f8b7c0cf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:11.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.375+0000 7f8b7be00640 1 --2- 172.21.15.17:0/2844793604 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8b7c15ce80 0x7f8b7c0cf330 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:11.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.375+0000 7f8b7be00640 1 -- 172.21.15.17:0/2844793604 >> 172.21.15.17:0/2844793604 conn(0x7f8b7c06b160 msgr2=0x7f8b7c06b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:11.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.375+0000 7f8b7be00640 1 -- 172.21.15.17:0/2844793604 shutdown_connections 2024-03-12T17:19:11.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.375+0000 7f8b7be00640 1 -- 172.21.15.17:0/2844793604 wait complete. 2024-03-12T17:19:11.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.377+0000 7f8b7be00640 1 Processor -- start 2024-03-12T17:19:11.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.377+0000 7f8b7be00640 1 -- start start 2024-03-12T17:19:11.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.378+0000 7f8b7be00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8b7c0b85f0 0x7f8b7c15fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:11.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.378+0000 7f8b7be00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8b7c15caa0 0x7f8b7c0cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:11.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.378+0000 7f8b7be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b7c15ce80 0x7f8b7c0c99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:11.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.378+0000 7f8b7be00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7c14c350 con 0x7f8b7c15ce80 2024-03-12T17:19:11.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.378+0000 7f8b7be00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7c160060 con 0x7f8b7c15caa0 2024-03-12T17:19:11.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.378+0000 7f8b7be00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7c0cc220 con 0x7f8b7c0b85f0 2024-03-12T17:19:11.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.378+0000 7f8b7b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b7c15ce80 0x7f8b7c0c99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:11.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.378+0000 7f8b7b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b7c15ce80 0x7f8b7c0c99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39564/0 (socket says 172.21.15.17:39564) 2024-03-12T17:19:11.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.378+0000 7f8b7b400640 1 -- 172.21.15.17:0/2518432552 learned_addr learned my addr 172.21.15.17:0/2518432552 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:11.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.379+0000 7f8b73e00640 1 --2- 172.21.15.17:0/2518432552 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8b7c15caa0 0x7f8b7c0cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:11.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.379+0000 7f8b7aa00640 1 --2- 172.21.15.17:0/2518432552 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8b7c0b85f0 0x7f8b7c15fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:11.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.379+0000 7f8b7b400640 1 -- 172.21.15.17:0/2518432552 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8b7c0b85f0 msgr2=0x7f8b7c15fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:11.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.379+0000 7f8b7b400640 1 --2- 172.21.15.17:0/2518432552 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8b7c0b85f0 0x7f8b7c15fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:11.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.379+0000 7f8b7b400640 1 -- 172.21.15.17:0/2518432552 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8b7c15caa0 msgr2=0x7f8b7c0cbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:11.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.379+0000 7f8b7b400640 1 --2- 172.21.15.17:0/2518432552 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8b7c15caa0 0x7f8b7c0cbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:11.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.379+0000 7f8b7b400640 1 -- 172.21.15.17:0/2518432552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b64009400 con 0x7f8b7c15ce80 2024-03-12T17:19:11.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.379+0000 7f8b7b400640 1 --2- 172.21.15.17:0/2518432552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b7c15ce80 0x7f8b7c0c99f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8b74009dd0 tx=0x7f8b7400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:11.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.380+0000 7f8b72a00640 1 -- 172.21.15.17:0/2518432552 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b74014480 con 0x7f8b7c15ce80 2024-03-12T17:19:11.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.380+0000 7f8b72a00640 1 -- 172.21.15.17:0/2518432552 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b7400f040 con 0x7f8b7c15ce80 2024-03-12T17:19:11.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.380+0000 7f8b7be00640 1 -- 172.21.15.17:0/2518432552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b7c0c6450 con 0x7f8b7c15ce80 2024-03-12T17:19:11.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.380+0000 7f8b72a00640 1 -- 172.21.15.17:0/2518432552 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b74014840 con 0x7f8b7c15ce80 2024-03-12T17:19:11.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.380+0000 7f8b7be00640 1 -- 172.21.15.17:0/2518432552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b7c0c67c0 con 0x7f8b7c15ce80 2024-03-12T17:19:11.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.381+0000 7f8b7be00640 1 -- 172.21.15.17:0/2518432552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b7c072360 con 0x7f8b7c15ce80 2024-03-12T17:19:11.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.382+0000 7f8b72a00640 1 -- 172.21.15.17:0/2518432552 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f8b740149a0 con 0x7f8b7c15ce80 2024-03-12T17:19:11.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.383+0000 7f8b72a00640 1 --2- 172.21.15.17:0/2518432552 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f8b5806ac00 0x7f8b5806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:11.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.383+0000 7f8b72a00640 1 -- 172.21.15.17:0/2518432552 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b74089fb0 con 0x7f8b7c15ce80 2024-03-12T17:19:11.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.383+0000 7f8b7aa00640 1 --2- 172.21.15.17:0/2518432552 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f8b5806ac00 0x7f8b5806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:11.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.384+0000 7f8b7aa00640 1 --2- 172.21.15.17:0/2518432552 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f8b5806ac00 0x7f8b5806d0c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c0011e0 tx=0x7f8b6c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:11.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.389+0000 7f8b72a00640 1 -- 172.21.15.17:0/2518432552 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f8b740550f0 con 0x7f8b7c15ce80 2024-03-12T17:19:11.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.627+0000 7f8b7be00640 1 -- 172.21.15.17:0/2518432552 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8b7c04e030 con 0x7f8b7c15ce80 2024-03-12T17:19:11.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.628+0000 7f8b72a00640 1 -- 172.21.15.17:0/2518432552 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8b74018070 con 0x7f8b7c15ce80 2024-03-12T17:19:11.624 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-12T17:19:11.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.631+0000 7f8b7be00640 1 -- 172.21.15.17:0/2518432552 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f8b5806ac00 msgr2=0x7f8b5806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:11.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.631+0000 7f8b7be00640 1 --2- 172.21.15.17:0/2518432552 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f8b5806ac00 0x7f8b5806d0c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8b6c0011e0 tx=0x7f8b6c009040 comp rx=0 tx=0).stop 2024-03-12T17:19:11.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.631+0000 7f8b7be00640 1 -- 172.21.15.17:0/2518432552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b7c15ce80 msgr2=0x7f8b7c0c99f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:11.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.631+0000 7f8b7be00640 1 --2- 172.21.15.17:0/2518432552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b7c15ce80 0x7f8b7c0c99f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8b74009dd0 tx=0x7f8b7400c490 comp rx=0 tx=0).stop 2024-03-12T17:19:11.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.631+0000 7f8b7be00640 1 -- 172.21.15.17:0/2518432552 shutdown_connections 2024-03-12T17:19:11.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.631+0000 7f8b7be00640 1 --2- 172.21.15.17:0/2518432552 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f8b5806ac00 0x7f8b5806d0c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:11.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.631+0000 7f8b7be00640 1 --2- 172.21.15.17:0/2518432552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8b7c15ce80 0x7f8b7c0c99f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:11.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.631+0000 7f8b7be00640 1 --2- 172.21.15.17:0/2518432552 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8b7c15caa0 0x7f8b7c0cbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:11.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.631+0000 7f8b7be00640 1 --2- 172.21.15.17:0/2518432552 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8b7c0b85f0 0x7f8b7c15fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:11.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.631+0000 7f8b7be00640 1 -- 172.21.15.17:0/2518432552 >> 172.21.15.17:0/2518432552 conn(0x7f8b7c06b160 msgr2=0x7f8b7c1604d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:11.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.631+0000 7f8b7be00640 1 -- 172.21.15.17:0/2518432552 shutdown_connections 2024-03-12T17:19:11.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:11.631+0000 7f8b7be00640 1 -- 172.21.15.17:0/2518432552 wait complete. 2024-03-12T17:19:11.646 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-12T17:19:11.646 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-12T17:19:11.646 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi094.front.sepia.ceph.com 2024-03-12T17:19:11.646 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-03-12T17:19:11.646 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-12T17:19:11.646 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-12T17:19:11.646 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-12T17:19:11.646 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-12T17:19:11.646 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-12T17:19:11.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:11.647 DEBUG:teuthology.orchestra.run.smithi094:> ip addr 2024-03-12T17:19:11.703 INFO:teuthology.orchestra.run.smithi094.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-12T17:19:11.704 INFO:teuthology.orchestra.run.smithi094.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-12T17:19:11.704 INFO:teuthology.orchestra.run.smithi094.stdout: inet 127.0.0.1/8 scope host lo 2024-03-12T17:19:11.704 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:19:11.704 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 ::1/128 scope host 2024-03-12T17:19:11.704 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:19:11.704 INFO:teuthology.orchestra.run.smithi094.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-12T17:19:11.704 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4c brd ff:ff:ff:ff:ff:ff 2024-03-12T17:19:11.704 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f0 2024-03-12T17:19:11.704 INFO:teuthology.orchestra.run.smithi094.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-12T17:19:11.704 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4d brd ff:ff:ff:ff:ff:ff 2024-03-12T17:19:11.704 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f1 2024-03-12T17:19:11.704 INFO:teuthology.orchestra.run.smithi094.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-12T17:19:11.704 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:62 brd ff:ff:ff:ff:ff:ff 2024-03-12T17:19:11.705 INFO:teuthology.orchestra.run.smithi094.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-12T17:19:11.705 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:63 brd ff:ff:ff:ff:ff:ff 2024-03-12T17:19:11.705 INFO:teuthology.orchestra.run.smithi094.stdout: inet 172.21.15.94/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-12T17:19:11.705 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft 42532sec preferred_lft 42532sec 2024-03-12T17:19:11.705 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::ec4:7aff:fe8f:d763/64 scope link 2024-03-12T17:19:11.705 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:19:11.706 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-12T17:19:11.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:11.706 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec bash -c ' 2024-03-12T17:19:11.706 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-03-12T17:19:11.706 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link add name ceph-brx type bridge 2024-03-12T17:19:11.706 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip addr flush dev ceph-brx 2024-03-12T17:19:11.707 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set ceph-brx up 2024-03-12T17:19:11.707 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-12T17:19:11.707 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-03-12T17:19:12.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:12.132 DEBUG:teuthology.orchestra.run.smithi094:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-12T17:19:12.209 INFO:teuthology.orchestra.run.smithi094.stdout:1 2024-03-12T17:19:12.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:12.213 DEBUG:teuthology.orchestra.run.smithi094:> route 2024-03-12T17:19:12.273 INFO:teuthology.orchestra.run.smithi094.stdout:Kernel IP routing table 2024-03-12T17:19:12.273 INFO:teuthology.orchestra.run.smithi094.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-12T17:19:12.273 INFO:teuthology.orchestra.run.smithi094.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-12T17:19:12.273 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-12T17:19:12.273 INFO:teuthology.orchestra.run.smithi094.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-12T17:19:12.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:12.274 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec bash -c ' 2024-03-12T17:19:12.274 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-03-12T17:19:12.274 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-12T17:19:12.274 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-12T17:19:12.274 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-12T17:19:12.274 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-03-12T17:19:12.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:12.991 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list 2024-03-12T17:19:13.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:13.047 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list-id 2024-03-12T17:19:13.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:13.100 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec bash -c ' 2024-03-12T17:19:13.100 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-03-12T17:19:13.100 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-12T17:19:13.100 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-03-12T17:19:13.101 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-03-12T17:19:13.243 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-03-12T17:19:13.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:13.243 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec bash -c ' 2024-03-12T17:19:13.243 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-03-12T17:19:13.243 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-03-12T17:19:13.243 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-12T17:19:13.243 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-03-12T17:19:13.243 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-03-12T17:19:13.243 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-03-12T17:19:13.243 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-03-12T17:19:13.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:13.528 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec bash -c ' 2024-03-12T17:19:13.528 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-03-12T17:19:13.529 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set brx.0 up 2024-03-12T17:19:13.529 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set dev brx.0 master ceph-brx 2024-03-12T17:19:13.529 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-03-12T17:19:13.687 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-12T17:19:13.687 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-03-12T17:19:13.731 INFO:teuthology.orchestra.run.smithi094.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-03-12T17:19:13.732 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-12T17:19:13.732 DEBUG:teuthology.orchestra.run.smithi094:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-03-12T17:19:13.824 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-03-12T17:19:13.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:13.824 DEBUG:teuthology.orchestra.run.smithi094:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-12T17:19:13.952 INFO:teuthology.orchestra.run.smithi094.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-12T17:19:13.953 INFO:teuthology.orchestra.run.smithi094.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-12T17:19:14.611 INFO:teuthology.orchestra.run.smithi094.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-12T17:19:14.611 INFO:teuthology.orchestra.run.smithi094.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-12T17:19:14.611 INFO:teuthology.orchestra.run.smithi094.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.94:3300,172.21.15.94:3301" 2024-03-12T17:19:14.611 INFO:teuthology.orchestra.run.smithi094.stdout:mount.ceph: trying mount with new device syntax: 1@73425bc1-630f-4bd2-8abb-716ed5d8ca29.cephfs=/ 2024-03-12T17:19:14.611 INFO:teuthology.orchestra.run.smithi094.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.17:3300/172.21.15.94:3300/172.21.15.94:3301" will pass to kernel 2024-03-12T17:19:14.616 INFO:teuthology.orchestra.run.smithi094.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-03-12T17:19:14.616 INFO:teuthology.orchestra.run.smithi094.stdout: You just mounted a file system that supports labels which does not 2024-03-12T17:19:14.616 INFO:teuthology.orchestra.run.smithi094.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-12T17:19:14.616 INFO:teuthology.orchestra.run.smithi094.stdout: applications will generate AVC messages and not be allowed access to 2024-03-12T17:19:14.616 INFO:teuthology.orchestra.run.smithi094.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-12T17:19:14.620 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-12T17:19:14.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:14.620 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-03-12T17:19:14.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:14.711 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-12T17:19:14.767 INFO:teuthology.orchestra.run.smithi094.stdout:client4683 2024-03-12T17:19:14.768 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-12T17:19:14.768 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-12T17:19:14.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:14.819 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-12T17:19:14.875 INFO:teuthology.orchestra.run.smithi094.stdout:client4683 2024-03-12T17:19:14.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:14.875 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-12T17:19:14.931 INFO:teuthology.orchestra.run.smithi094.stdout:client4683 2024-03-12T17:19:14.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:14.931 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/73425bc1-630f-4bd2-8abb-716ed5d8ca29.client4683/status') 2024-03-12T17:19:15.023 INFO:teuthology.orchestra.run.smithi094.stdout:instance: client.4683 (3)172.21.15.94:0/3976247608 2024-03-12T17:19:15.023 INFO:teuthology.orchestra.run.smithi094.stdout:blocklisted: false 2024-03-12T17:19:15.023 INFO:teuthology.orchestra.run.smithi094.stderr:0+1 records in 2024-03-12T17:19:15.023 INFO:teuthology.orchestra.run.smithi094.stderr:0+1 records out 2024-03-12T17:19:15.023 INFO:teuthology.orchestra.run.smithi094.stderr:70 bytes copied, 7.2884e-05 s, 960 kB/s 2024-03-12T17:19:15.026 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-03-12T17:19:15.027 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-12T17:19:15.027 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-03-12T17:19:15.027 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-12T17:19:15.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.260+0000 7f69e7200640 1 Processor -- start 2024-03-12T17:19:15.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.260+0000 7f69e7200640 1 -- start start 2024-03-12T17:19:15.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.262+0000 7f69e7200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f69e815ce80 0x7f69e80cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:15.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.262+0000 7f69e7200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e8161650 con 0x7f69e80b85f0 2024-03-12T17:19:15.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.262+0000 7f69e7200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e8161090 con 0x7f69e815caa0 2024-03-12T17:19:15.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.262+0000 7f69e7200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e8160ea0 con 0x7f69e815ce80 2024-03-12T17:19:15.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.262+0000 7f69e6800640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f69e80b85f0 0x7f69e80d12d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:47026/0 (socket says 172.21.15.17:47026) 2024-03-12T17:19:15.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.262+0000 7f69e6800640 1 -- 172.21.15.17:0/2636226868 learned_addr learned my addr 172.21.15.17:0/2636226868 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:15.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.263+0000 7f69dd400640 1 --2- 172.21.15.17:0/2636226868 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f69e815ce80 0x7f69e80cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:15.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.263+0000 7f69e5400640 1 -- 172.21.15.17:0/2636226868 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2162842657 0 0) 0x7f69e8161650 con 0x7f69e80b85f0 2024-03-12T17:19:15.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.263+0000 7f69e5400640 1 -- 172.21.15.17:0/2636226868 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69cc003520 con 0x7f69e80b85f0 2024-03-12T17:19:15.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.263+0000 7f69e5400640 1 -- 172.21.15.17:0/2636226868 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1150847078 0 0) 0x7f69cc003520 con 0x7f69e80b85f0 2024-03-12T17:19:15.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.263+0000 7f69e5400640 1 -- 172.21.15.17:0/2636226868 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f69e815ce80 msgr2=0x7f69e80cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:15.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.263+0000 7f69e5400640 1 --2- 172.21.15.17:0/2636226868 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f69e815ce80 0x7f69e80cf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:15.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.263+0000 7f69e5400640 1 -- 172.21.15.17:0/2636226868 >> v1:172.21.15.94:6789/0 conn(0x7f69e815caa0 legacy=0x7f69e8160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:15.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.263+0000 7f69e5400640 1 -- 172.21.15.17:0/2636226868 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e8161370 con 0x7f69e80b85f0 2024-03-12T17:19:15.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.263+0000 7f69e5400640 1 -- 172.21.15.17:0/2636226868 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7f69e0001670 con 0x7f69e80b85f0 2024-03-12T17:19:15.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.263+0000 7f69e5400640 1 -- 172.21.15.17:0/2636226868 >> v1:172.21.15.17:6789/0 conn(0x7f69e80b85f0 legacy=0x7f69e80d12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:15.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.263+0000 7f69e5400640 1 --2- 172.21.15.17:0/2636226868 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f69cc0039a0 0x7f69cc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:15.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.263+0000 7f69e5400640 1 --2- 172.21.15.17:0/2636226868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69cc0047c0 0x7f69cc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:15.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.263+0000 7f69e5400640 1 --2- 172.21.15.17:0/2636226868 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f69e815ce80 0x7f69cc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:15.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.263+0000 7f69e5400640 1 -- 172.21.15.17:0/2636226868 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69cc00ba30 con 0x7f69cc0047c0 2024-03-12T17:19:15.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.263+0000 7f69e5400640 1 -- 172.21.15.17:0/2636226868 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69cc00bb70 con 0x7f69cc0039a0 2024-03-12T17:19:15.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.263+0000 7f69e5400640 1 -- 172.21.15.17:0/2636226868 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69cc00bd30 con 0x7f69e815ce80 2024-03-12T17:19:15.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.264+0000 7f69dd400640 1 --2- 172.21.15.17:0/2636226868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69cc0047c0 0x7f69cc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:15.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.264+0000 7f69e5e00640 1 --2- 172.21.15.17:0/2636226868 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f69cc0039a0 0x7f69cc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:15.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.264+0000 7f69e6800640 1 --2- 172.21.15.17:0/2636226868 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f69e815ce80 0x7f69cc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:15.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.264+0000 7f69dd400640 1 -- 172.21.15.17:0/2636226868 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f69e815ce80 msgr2=0x7f69cc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:15.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.264+0000 7f69dd400640 1 --2- 172.21.15.17:0/2636226868 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f69e815ce80 0x7f69cc005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:15.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.264+0000 7f69dd400640 1 -- 172.21.15.17:0/2636226868 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f69cc0039a0 msgr2=0x7f69cc003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:15.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.264+0000 7f69dd400640 1 --2- 172.21.15.17:0/2636226868 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f69cc0039a0 0x7f69cc003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:15.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.264+0000 7f69dd400640 1 -- 172.21.15.17:0/2636226868 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69cc003520 con 0x7f69cc0047c0 2024-03-12T17:19:15.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.265+0000 7f69dd400640 1 --2- 172.21.15.17:0/2636226868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69cc0047c0 0x7f69cc004c40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f69e815d260 tx=0x7f69cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8242d89fdc63616 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:15.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.266+0000 7f69e5400640 1 -- 172.21.15.17:0/2636226868 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d002c630 con 0x7f69cc0047c0 2024-03-12T17:19:15.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.266+0000 7f69e5400640 1 -- 172.21.15.17:0/2636226868 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d002c790 con 0x7f69cc0047c0 2024-03-12T17:19:15.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.266+0000 7f69e5400640 1 -- 172.21.15.17:0/2636226868 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d002cb20 con 0x7f69cc0047c0 2024-03-12T17:19:15.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.266+0000 7f69e7200640 1 -- 172.21.15.17:0/2636226868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69cc0047c0 msgr2=0x7f69cc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:15.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.266+0000 7f69e7200640 1 --2- 172.21.15.17:0/2636226868 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69cc0047c0 0x7f69cc004c40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f69e815d260 tx=0x7f69cc0057f0 comp rx=0 tx=0).stop 2024-03-12T17:19:15.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.266+0000 7f69e6800640 1 -- 172.21.15.17:0/2636226868 reap_dead start 2024-03-12T17:19:15.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.266+0000 7f69e7200640 1 -- 172.21.15.17:0/2636226868 shutdown_connections 2024-03-12T17:19:15.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.266+0000 7f69e7200640 1 -- 172.21.15.17:0/2636226868 >> 172.21.15.17:0/2636226868 conn(0x7f69e806b160 msgr2=0x7f69e806b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:15.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.266+0000 7f69e7200640 1 -- 172.21.15.17:0/2636226868 shutdown_connections 2024-03-12T17:19:15.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.266+0000 7f69e7200640 1 -- 172.21.15.17:0/2636226868 wait complete. 2024-03-12T17:19:15.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.268+0000 7f69e7200640 1 Processor -- start 2024-03-12T17:19:15.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.268+0000 7f69e7200640 1 -- start start 2024-03-12T17:19:15.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.269+0000 7f69e7200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f69cc0047c0 0x7f69e81f1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:15.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.269+0000 7f69e7200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69e80c7210 0x7f69e80b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:15.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.269+0000 7f69e7200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f69e80b45e0 0x7f69e815ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:15.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.269+0000 7f69e7200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e80ca150 con 0x7f69e80c7210 2024-03-12T17:19:15.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.269+0000 7f69e7200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e80ca3a0 con 0x7f69cc0047c0 2024-03-12T17:19:15.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.269+0000 7f69e7200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e80ca680 con 0x7f69e80b45e0 2024-03-12T17:19:15.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.269+0000 7f69dd400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69e80c7210 0x7f69e80b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:15.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.269+0000 7f69dd400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69e80c7210 0x7f69e80b40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38442/0 (socket says 172.21.15.17:38442) 2024-03-12T17:19:15.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.269+0000 7f69dd400640 1 -- 172.21.15.17:0/3045754828 learned_addr learned my addr 172.21.15.17:0/3045754828 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:15.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.270+0000 7f69e5e00640 1 --2- 172.21.15.17:0/3045754828 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f69cc0047c0 0x7f69e81f1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:15.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.270+0000 7f69e6800640 1 --2- 172.21.15.17:0/3045754828 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f69e80b45e0 0x7f69e815ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:15.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.270+0000 7f69dd400640 1 -- 172.21.15.17:0/3045754828 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f69e80b45e0 msgr2=0x7f69e815ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:15.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.270+0000 7f69dd400640 1 --2- 172.21.15.17:0/3045754828 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f69e80b45e0 0x7f69e815ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:15.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.270+0000 7f69dd400640 1 -- 172.21.15.17:0/3045754828 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f69cc0047c0 msgr2=0x7f69e81f1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:15.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.270+0000 7f69dd400640 1 --2- 172.21.15.17:0/3045754828 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f69cc0047c0 0x7f69e81f1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:15.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.270+0000 7f69dd400640 1 -- 172.21.15.17:0/3045754828 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e80ca960 con 0x7f69e80c7210 2024-03-12T17:19:15.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.270+0000 7f69dd400640 1 --2- 172.21.15.17:0/3045754828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69e80c7210 0x7f69e80b40a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f69d0037040 tx=0x7f69d0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:15.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.271+0000 7f69dea00640 1 -- 172.21.15.17:0/3045754828 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d0003810 con 0x7f69e80c7210 2024-03-12T17:19:15.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.271+0000 7f69dea00640 1 -- 172.21.15.17:0/3045754828 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69d0003970 con 0x7f69e80c7210 2024-03-12T17:19:15.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.271+0000 7f69dea00640 1 -- 172.21.15.17:0/3045754828 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69d0003d00 con 0x7f69e80c7210 2024-03-12T17:19:15.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.271+0000 7f69e7200640 1 -- 172.21.15.17:0/3045754828 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e80cac40 con 0x7f69e80c7210 2024-03-12T17:19:15.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.271+0000 7f69e7200640 1 -- 172.21.15.17:0/3045754828 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e815f190 con 0x7f69e80c7210 2024-03-12T17:19:15.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.272+0000 7f69e7200640 1 -- 172.21.15.17:0/3045754828 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69e8072360 con 0x7f69e80c7210 2024-03-12T17:19:15.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.273+0000 7f69dea00640 1 -- 172.21.15.17:0/3045754828 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f69d0034440 con 0x7f69e80c7210 2024-03-12T17:19:15.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.274+0000 7f69dea00640 1 --2- 172.21.15.17:0/3045754828 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f69c406ac00 0x7f69c406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:15.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.274+0000 7f69dea00640 1 -- 172.21.15.17:0/3045754828 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f69d00ab2f0 con 0x7f69e80c7210 2024-03-12T17:19:15.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.274+0000 7f69e5e00640 1 --2- 172.21.15.17:0/3045754828 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f69c406ac00 0x7f69c406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:15.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.275+0000 7f69e5e00640 1 --2- 172.21.15.17:0/3045754828 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f69c406ac00 0x7f69c406d0c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f69d8007fd0 tx=0x7f69d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:15.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.279+0000 7f69dea00640 1 -- 172.21.15.17:0/3045754828 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f69d0076600 con 0x7f69e80c7210 2024-03-12T17:19:15.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.519+0000 7f69e7200640 1 -- 172.21.15.17:0/3045754828 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f69e80ca150 con 0x7f69e80c7210 2024-03-12T17:19:15.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.519+0000 7f69dea00640 1 -- 172.21.15.17:0/3045754828 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7f69d0003e60 con 0x7f69e80c7210 2024-03-12T17:19:15.515 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-12T17:19:15.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.522+0000 7f69e7200640 1 -- 172.21.15.17:0/3045754828 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f69c406ac00 msgr2=0x7f69c406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:15.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.522+0000 7f69e7200640 1 --2- 172.21.15.17:0/3045754828 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f69c406ac00 0x7f69c406d0c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f69d8007fd0 tx=0x7f69d8009040 comp rx=0 tx=0).stop 2024-03-12T17:19:15.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.522+0000 7f69e7200640 1 -- 172.21.15.17:0/3045754828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69e80c7210 msgr2=0x7f69e80b40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:15.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.522+0000 7f69e7200640 1 --2- 172.21.15.17:0/3045754828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69e80c7210 0x7f69e80b40a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f69d0037040 tx=0x7f69d0004730 comp rx=0 tx=0).stop 2024-03-12T17:19:15.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.522+0000 7f69e7200640 1 -- 172.21.15.17:0/3045754828 shutdown_connections 2024-03-12T17:19:15.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.522+0000 7f69e7200640 1 --2- 172.21.15.17:0/3045754828 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f69c406ac00 0x7f69c406d0c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:15.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.522+0000 7f69e7200640 1 --2- 172.21.15.17:0/3045754828 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f69e80b45e0 0x7f69e815ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:15.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.522+0000 7f69e7200640 1 --2- 172.21.15.17:0/3045754828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f69e80c7210 0x7f69e80b40a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:15.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.522+0000 7f69e7200640 1 --2- 172.21.15.17:0/3045754828 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f69cc0047c0 0x7f69e81f1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:15.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.522+0000 7f69e7200640 1 -- 172.21.15.17:0/3045754828 >> 172.21.15.17:0/3045754828 conn(0x7f69e806b160 msgr2=0x7f69e81604d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:15.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.523+0000 7f69e7200640 1 -- 172.21.15.17:0/3045754828 shutdown_connections 2024-03-12T17:19:15.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:15.523+0000 7f69e7200640 1 -- 172.21.15.17:0/3045754828 wait complete. 2024-03-12T17:19:15.537 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-12T17:19:15.537 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-12T17:19:15.537 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi094.front.sepia.ceph.com 2024-03-12T17:19:15.537 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-03-12T17:19:15.537 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-03-12T17:19:15.537 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-12T17:19:15.537 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-12T17:19:15.537 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-12T17:19:15.537 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-03-12T17:19:15.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:15.538 DEBUG:teuthology.orchestra.run.smithi094:> ip addr 2024-03-12T17:19:15.595 INFO:teuthology.orchestra.run.smithi094.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-12T17:19:15.595 INFO:teuthology.orchestra.run.smithi094.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-12T17:19:15.595 INFO:teuthology.orchestra.run.smithi094.stdout: inet 127.0.0.1/8 scope host lo 2024-03-12T17:19:15.595 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:19:15.595 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 ::1/128 scope host 2024-03-12T17:19:15.595 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:19:15.595 INFO:teuthology.orchestra.run.smithi094.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-12T17:19:15.595 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4c brd ff:ff:ff:ff:ff:ff 2024-03-12T17:19:15.595 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f0 2024-03-12T17:19:15.596 INFO:teuthology.orchestra.run.smithi094.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-12T17:19:15.596 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:d8:db:4d brd ff:ff:ff:ff:ff:ff 2024-03-12T17:19:15.596 INFO:teuthology.orchestra.run.smithi094.stdout: altname enp7s0f1 2024-03-12T17:19:15.596 INFO:teuthology.orchestra.run.smithi094.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-12T17:19:15.596 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:62 brd ff:ff:ff:ff:ff:ff 2024-03-12T17:19:15.596 INFO:teuthology.orchestra.run.smithi094.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-12T17:19:15.596 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 0c:c4:7a:8f:d7:63 brd ff:ff:ff:ff:ff:ff 2024-03-12T17:19:15.596 INFO:teuthology.orchestra.run.smithi094.stdout: inet 172.21.15.94/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-12T17:19:15.596 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft 42528sec preferred_lft 42528sec 2024-03-12T17:19:15.596 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::ec4:7aff:fe8f:d763/64 scope link 2024-03-12T17:19:15.596 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:19:15.596 INFO:teuthology.orchestra.run.smithi094.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-12T17:19:15.596 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether ba:78:ff:f9:c7:47 brd ff:ff:ff:ff:ff:ff 2024-03-12T17:19:15.596 INFO:teuthology.orchestra.run.smithi094.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-12T17:19:15.596 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:19:15.597 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::e0f9:bfff:fe12:1f71/64 scope link 2024-03-12T17:19:15.597 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:19:15.597 INFO:teuthology.orchestra.run.smithi094.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-12T17:19:15.597 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether ba:78:ff:f9:c7:47 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-12T17:19:15.597 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::b878:ffff:fef9:c747/64 scope link 2024-03-12T17:19:15.597 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:19:15.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:15.598 DEBUG:teuthology.orchestra.run.smithi094:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-12T17:19:15.688 INFO:teuthology.orchestra.run.smithi094.stdout:1 2024-03-12T17:19:15.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:15.693 DEBUG:teuthology.orchestra.run.smithi094:> route 2024-03-12T17:19:15.743 INFO:teuthology.orchestra.run.smithi094.stdout:Kernel IP routing table 2024-03-12T17:19:15.744 INFO:teuthology.orchestra.run.smithi094.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-12T17:19:15.744 INFO:teuthology.orchestra.run.smithi094.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-12T17:19:15.744 INFO:teuthology.orchestra.run.smithi094.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-12T17:19:15.744 INFO:teuthology.orchestra.run.smithi094.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-12T17:19:15.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:15.744 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec bash -c ' 2024-03-12T17:19:15.744 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-03-12T17:19:15.744 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-12T17:19:15.745 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-12T17:19:15.745 DEBUG:teuthology.orchestra.run.smithi094:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-12T17:19:15.745 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-03-12T17:19:15.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:15.921 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list 2024-03-12T17:19:15.969 INFO:teuthology.orchestra.run.smithi094.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-12T17:19:15.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:15.970 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list-id 2024-03-12T17:19:16.020 INFO:teuthology.orchestra.run.smithi094.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-03-12T17:19:16.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:16.021 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec bash -c ' 2024-03-12T17:19:16.021 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-03-12T17:19:16.021 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-12T17:19:16.022 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-03-12T17:19:16.022 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-03-12T17:19:16.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:16.159 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-03-12T17:19:16.249 INFO:teuthology.orchestra.run.smithi094.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-12T17:19:16.249 INFO:teuthology.orchestra.run.smithi094.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-12T17:19:16.249 INFO:teuthology.orchestra.run.smithi094.stdout: inet 127.0.0.1/8 scope host lo 2024-03-12T17:19:16.249 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:19:16.249 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 ::1/128 scope host 2024-03-12T17:19:16.250 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:19:16.250 INFO:teuthology.orchestra.run.smithi094.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-12T17:19:16.250 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 16:10:30:f3:88:c4 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-12T17:19:16.250 INFO:teuthology.orchestra.run.smithi094.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-12T17:19:16.250 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:19:16.250 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::1410:30ff:fef3:88c4/64 scope link 2024-03-12T17:19:16.250 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:19:16.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:16.254 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-03-12T17:19:16.346 INFO:teuthology.orchestra.run.smithi094.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-12T17:19:16.346 INFO:teuthology.orchestra.run.smithi094.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-12T17:19:16.346 INFO:teuthology.orchestra.run.smithi094.stdout: inet 127.0.0.1/8 scope host lo 2024-03-12T17:19:16.346 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:19:16.346 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 ::1/128 scope host 2024-03-12T17:19:16.346 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:19:16.346 INFO:teuthology.orchestra.run.smithi094.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-12T17:19:16.346 INFO:teuthology.orchestra.run.smithi094.stdout: link/ether 16:10:30:f3:88:c4 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-12T17:19:16.347 INFO:teuthology.orchestra.run.smithi094.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-12T17:19:16.347 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:19:16.347 INFO:teuthology.orchestra.run.smithi094.stdout: inet6 fe80::1410:30ff:fef3:88c4/64 scope link 2024-03-12T17:19:16.347 INFO:teuthology.orchestra.run.smithi094.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:19:16.350 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-03-12T17:19:16.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:16.351 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec bash -c ' 2024-03-12T17:19:16.351 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-03-12T17:19:16.351 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-03-12T17:19:16.351 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-03-12T17:19:16.351 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-03-12T17:19:16.351 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-03-12T17:19:16.351 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-03-12T17:19:16.351 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-03-12T17:19:16.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:16.603 DEBUG:teuthology.orchestra.run.smithi094:> (cd / && exec bash -c ' 2024-03-12T17:19:16.603 DEBUG:teuthology.orchestra.run.smithi094:> set -e 2024-03-12T17:19:16.603 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set brx.1 up 2024-03-12T17:19:16.603 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link set dev brx.1 master ceph-brx 2024-03-12T17:19:16.603 DEBUG:teuthology.orchestra.run.smithi094:> ') 2024-03-12T17:19:16.768 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-12T17:19:16.769 DEBUG:teuthology.orchestra.run.smithi094:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-03-12T17:19:16.812 INFO:teuthology.orchestra.run.smithi094.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-03-12T17:19:16.813 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-12T17:19:16.813 DEBUG:teuthology.orchestra.run.smithi094:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-03-12T17:19:16.902 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-03-12T17:19:16.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:16.903 DEBUG:teuthology.orchestra.run.smithi094:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-12T17:19:17.035 INFO:teuthology.orchestra.run.smithi094.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-12T17:19:17.035 INFO:teuthology.orchestra.run.smithi094.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-12T17:19:17.072 INFO:teuthology.orchestra.run.smithi094.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-12T17:19:17.072 INFO:teuthology.orchestra.run.smithi094.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-12T17:19:17.072 INFO:teuthology.orchestra.run.smithi094.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.94:3300,172.21.15.94:3301" 2024-03-12T17:19:17.072 INFO:teuthology.orchestra.run.smithi094.stdout:mount.ceph: trying mount with new device syntax: 3@73425bc1-630f-4bd2-8abb-716ed5d8ca29.cephfs=/ 2024-03-12T17:19:17.072 INFO:teuthology.orchestra.run.smithi094.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.17:3300/172.21.15.94:3300/172.21.15.94:3301" will pass to kernel 2024-03-12T17:19:17.074 INFO:teuthology.orchestra.run.smithi094.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-03-12T17:19:17.074 INFO:teuthology.orchestra.run.smithi094.stdout: You just mounted a file system that supports labels which does not 2024-03-12T17:19:17.074 INFO:teuthology.orchestra.run.smithi094.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-12T17:19:17.075 INFO:teuthology.orchestra.run.smithi094.stdout: applications will generate AVC messages and not be allowed access to 2024-03-12T17:19:17.075 INFO:teuthology.orchestra.run.smithi094.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-12T17:19:17.079 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-12T17:19:17.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:17.079 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-03-12T17:19:17.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:17.166 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-12T17:19:17.221 INFO:teuthology.orchestra.run.smithi094.stdout:client4549 2024-03-12T17:19:17.222 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-12T17:19:17.222 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-12T17:19:17.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:17.273 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-12T17:19:17.327 INFO:teuthology.orchestra.run.smithi094.stdout:client4549 2024-03-12T17:19:17.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:17.327 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-12T17:19:17.384 INFO:teuthology.orchestra.run.smithi094.stdout:client4549 2024-03-12T17:19:17.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:17.385 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/73425bc1-630f-4bd2-8abb-716ed5d8ca29.client4549/status') 2024-03-12T17:19:17.469 INFO:teuthology.orchestra.run.smithi094.stdout:instance: client.4549 (3)192.168.0.2:0/461373782 2024-03-12T17:19:17.469 INFO:teuthology.orchestra.run.smithi094.stdout:blocklisted: false 2024-03-12T17:19:17.470 INFO:teuthology.orchestra.run.smithi094.stderr:0+1 records in 2024-03-12T17:19:17.470 INFO:teuthology.orchestra.run.smithi094.stderr:0+1 records out 2024-03-12T17:19:17.470 INFO:teuthology.orchestra.run.smithi094.stderr:68 bytes copied, 6.5429e-05 s, 1.0 MB/s 2024-03-12T17:19:17.473 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-03-12T17:19:17.510 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T17:19:17.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.739+0000 7f52d4c00640 1 Processor -- start 2024-03-12T17:19:17.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.739+0000 7f52d4c00640 1 -- start start 2024-03-12T17:19:17.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.741+0000 7f52d4c00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f52d015caa0 0x7f52d0160790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:17.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.741+0000 7f52d4c00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f52d00cfa40 0x7f52d00d12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:17.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.741+0000 7f52d4c00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d0161650 con 0x7f52d015ce80 2024-03-12T17:19:17.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.741+0000 7f52d4c00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d0161090 con 0x7f52d015caa0 2024-03-12T17:19:17.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.741+0000 7f52d4c00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d0161370 con 0x7f52d00cfa40 2024-03-12T17:19:17.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.741+0000 7f52cf400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f52d015caa0 0x7f52d0160790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:17.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.741+0000 7f52cf400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f52d015caa0 0x7f52d0160790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38444/0 (socket says 172.21.15.17:38444) 2024-03-12T17:19:17.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.741+0000 7f52cf400640 1 -- 172.21.15.17:0/1453793872 learned_addr learned my addr 172.21.15.17:0/1453793872 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:17.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.741+0000 7f52cfe00640 1 --2- 172.21.15.17:0/1453793872 >> v2:172.21.15.94:3300/0 conn(0x7f52d00cfa40 0x7f52d00d12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:17.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.741+0000 7f52cf400640 1 -- 172.21.15.17:0/1453793872 >> v2:172.21.15.94:3300/0 conn(0x7f52d00cfa40 msgr2=0x7f52d00d12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:17.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.741+0000 7f52cf400640 1 --2- 172.21.15.17:0/1453793872 >> v2:172.21.15.94:3300/0 conn(0x7f52d00cfa40 0x7f52d00d12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:17.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.741+0000 7f52cf400640 1 -- 172.21.15.17:0/1453793872 >> v1:172.21.15.94:6789/0 conn(0x7f52d015ce80 legacy=0x7f52d00cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:17.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.742+0000 7f52cf400640 1 -- 172.21.15.17:0/1453793872 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d00d0ad0 con 0x7f52d015caa0 2024-03-12T17:19:17.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.743+0000 7f52cf400640 1 --2- 172.21.15.17:0/1453793872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52d015caa0 0x7f52d0160790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f52d00b59a0 tx=0x7f52c002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f42c2a3b2e89e50 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:17.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.743+0000 7f52cea00640 1 -- 172.21.15.17:0/1453793872 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c0031870 con 0x7f52d015caa0 2024-03-12T17:19:17.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.743+0000 7f52cea00640 1 -- 172.21.15.17:0/1453793872 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c00319d0 con 0x7f52d015caa0 2024-03-12T17:19:17.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.743+0000 7f52cea00640 1 -- 172.21.15.17:0/1453793872 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c0031d60 con 0x7f52d015caa0 2024-03-12T17:19:17.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.744+0000 7f52d4c00640 1 -- 172.21.15.17:0/1453793872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52d015caa0 msgr2=0x7f52d0160790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:17.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.744+0000 7f52d4c00640 1 --2- 172.21.15.17:0/1453793872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52d015caa0 0x7f52d0160790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f52d00b59a0 tx=0x7f52c002b910 comp rx=0 tx=0).stop 2024-03-12T17:19:17.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.744+0000 7f52d4c00640 1 -- 172.21.15.17:0/1453793872 shutdown_connections 2024-03-12T17:19:17.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.744+0000 7f52d4c00640 1 --2- 172.21.15.17:0/1453793872 >> v2:172.21.15.94:3300/0 conn(0x7f52d00cfa40 0x7f52d00d12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:17.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.744+0000 7f52d4c00640 1 --2- 172.21.15.17:0/1453793872 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52d015caa0 0x7f52d0160790 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:17.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.744+0000 7f52d4c00640 1 -- 172.21.15.17:0/1453793872 >> 172.21.15.17:0/1453793872 conn(0x7f52d006b160 msgr2=0x7f52d006b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:17.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.744+0000 7f52d4c00640 1 -- 172.21.15.17:0/1453793872 shutdown_connections 2024-03-12T17:19:17.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.744+0000 7f52d4c00640 1 -- 172.21.15.17:0/1453793872 wait complete. 2024-03-12T17:19:17.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.745+0000 7f52d4c00640 1 Processor -- start 2024-03-12T17:19:17.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.746+0000 7f52d4c00640 1 -- start start 2024-03-12T17:19:17.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.747+0000 7f52d4c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52d00cfa40 0x7f52d0148430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:17.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.747+0000 7f52d4c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f52d015caa0 0x7f52d014af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:17.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.747+0000 7f52d4c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f52d015ce80 0x7f52d014b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:17.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.747+0000 7f52d4c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d00c6af0 con 0x7f52d00cfa40 2024-03-12T17:19:17.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.747+0000 7f52d4c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d00b23e0 con 0x7f52d015caa0 2024-03-12T17:19:17.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.747+0000 7f52d4c00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d00b1e20 con 0x7f52d015ce80 2024-03-12T17:19:17.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.747+0000 7f52cf400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52d00cfa40 0x7f52d0148430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:17.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.747+0000 7f52cf400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52d00cfa40 0x7f52d0148430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38460/0 (socket says 172.21.15.17:38460) 2024-03-12T17:19:17.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.747+0000 7f52cf400640 1 -- 172.21.15.17:0/1125481070 learned_addr learned my addr 172.21.15.17:0/1125481070 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:17.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.747+0000 7f52c6a00640 1 --2- 172.21.15.17:0/1125481070 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f52d015caa0 0x7f52d014af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:17.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.747+0000 7f52cfe00640 1 --2- 172.21.15.17:0/1125481070 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f52d015ce80 0x7f52d014b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:17.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.747+0000 7f52cf400640 1 -- 172.21.15.17:0/1125481070 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f52d015ce80 msgr2=0x7f52d014b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:17.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.747+0000 7f52cf400640 1 --2- 172.21.15.17:0/1125481070 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f52d015ce80 0x7f52d014b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:17.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.747+0000 7f52cf400640 1 -- 172.21.15.17:0/1125481070 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f52d015caa0 msgr2=0x7f52d014af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:17.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.747+0000 7f52cf400640 1 --2- 172.21.15.17:0/1125481070 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f52d015caa0 0x7f52d014af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:17.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.747+0000 7f52cf400640 1 -- 172.21.15.17:0/1125481070 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c00094d0 con 0x7f52d00cfa40 2024-03-12T17:19:17.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.747+0000 7f52c6a00640 1 --2- 172.21.15.17:0/1125481070 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f52d015caa0 0x7f52d014af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:17.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.747+0000 7f52cfe00640 1 --2- 172.21.15.17:0/1125481070 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f52d015ce80 0x7f52d014b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:17.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.748+0000 7f52cf400640 1 --2- 172.21.15.17:0/1125481070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52d00cfa40 0x7f52d0148430 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f52c002b950 tx=0x7f52c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:17.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.748+0000 7f52c7e00640 1 -- 172.21.15.17:0/1125481070 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c0031840 con 0x7f52d00cfa40 2024-03-12T17:19:17.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.748+0000 7f52c7e00640 1 -- 172.21.15.17:0/1125481070 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c00443f0 con 0x7f52d00cfa40 2024-03-12T17:19:17.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.748+0000 7f52c7e00640 1 -- 172.21.15.17:0/1125481070 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c00447a0 con 0x7f52d00cfa40 2024-03-12T17:19:17.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.748+0000 7f52d4c00640 1 -- 172.21.15.17:0/1125481070 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d00b2100 con 0x7f52d00cfa40 2024-03-12T17:19:17.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.748+0000 7f52d4c00640 1 -- 172.21.15.17:0/1125481070 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d0148970 con 0x7f52d00cfa40 2024-03-12T17:19:17.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.750+0000 7f52d4c00640 1 -- 172.21.15.17:0/1125481070 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d0072360 con 0x7f52d00cfa40 2024-03-12T17:19:17.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.751+0000 7f52c7e00640 1 -- 172.21.15.17:0/1125481070 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f52c0044900 con 0x7f52d00cfa40 2024-03-12T17:19:17.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.752+0000 7f52c7e00640 1 --2- 172.21.15.17:0/1125481070 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f52ac06ac00 0x7f52ac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:17.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.752+0000 7f52c7e00640 1 -- 172.21.15.17:0/1125481070 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f52c002d040 con 0x7f52d00cfa40 2024-03-12T17:19:17.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.752+0000 7f52c6a00640 1 --2- 172.21.15.17:0/1125481070 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f52ac06ac00 0x7f52ac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:17.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.753+0000 7f52c6a00640 1 --2- 172.21.15.17:0/1125481070 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f52ac06ac00 0x7f52ac06d0c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f52d00cb420 tx=0x7f52b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:17.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.759+0000 7f52c7e00640 1 -- 172.21.15.17:0/1125481070 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f52c0077060 con 0x7f52d00cfa40 2024-03-12T17:19:17.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.964+0000 7f52d4c00640 1 -- 172.21.15.17:0/1125481070 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52d00c6570 con 0x7f52d00cfa40 2024-03-12T17:19:17.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.967+0000 7f52c7e00640 1 -- 172.21.15.17:0/1125481070 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15989 (secure 0 0 0) 0x7f52d00c6570 con 0x7f52d00cfa40 2024-03-12T17:19:17.962 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:19:17.963 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":21,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:18:46.845635+0000","last_up_change":"2024-03-12T17:18:38.144756+0000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-12T17:18:39.552910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-12T17:18:43.794908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-12T17:18:44.867006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":37305},{"type":"v1","addr":"172.21.15.17:6801","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":37305},{"type":"v1","addr":"172.21.15.17:6803","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":37305},{"type":"v1","addr":"172.21.15.17:6807","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":37305},{"type":"v1","addr":"172.21.15.17:6805","nonce":37305}]},"public_addr":"172.21.15.17:6801/37305","cluster_addr":"172.21.15.17:6803/37305","heartbeat_back_addr":"172.21.15.17:6807/37305","heartbeat_front_addr":"172.21.15.17:6805/37305","state":["exists","up"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":37307},{"type":"v1","addr":"172.21.15.17:6814","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":37307},{"type":"v1","addr":"172.21.15.17:6818","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":37307},{"type":"v1","addr":"172.21.15.17:6827","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":37307},{"type":"v1","addr":"172.21.15.17:6823","nonce":37307}]},"public_addr":"172.21.15.17:6814/37307","cluster_addr":"172.21.15.17:6818/37307","heartbeat_back_addr":"172.21.15.17:6827/37307","heartbeat_front_addr":"172.21.15.17:6823/37307","state":["exists","up"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":37303},{"type":"v1","addr":"172.21.15.17:6809","nonce":37303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":37303},{"type":"v1","addr":"172.21.15.17:6811","nonce":37303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":37303},{"type":"v1","addr":"172.21.15.17:6819","nonce":37303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":37303},{"type":"v1","addr":"172.21.15.17:6815","nonce":37303}]},"public_addr":"172.21.15.17:6809/37303","cluster_addr":"172.21.15.17:6811/37303","heartbeat_back_addr":"172.21.15.17:6819/37303","heartbeat_front_addr":"172.21.15.17:6815/37303","state":["exists","up"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":37308},{"type":"v1","addr":"172.21.15.17:6822","nonce":37308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":37308},{"type":"v1","addr":"172.21.15.17:6826","nonce":37308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":37308},{"type":"v1","addr":"172.21.15.17:6831","nonce":37308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":37308},{"type":"v1","addr":"172.21.15.17:6829","nonce":37308}]},"public_addr":"172.21.15.17:6822/37308","cluster_addr":"172.21.15.17:6826/37308","heartbeat_back_addr":"172.21.15.17:6831/37308","heartbeat_front_addr":"172.21.15.17:6829/37308","state":["exists","up"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":37465},{"type":"v1","addr":"172.21.15.94:6809","nonce":37465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6811","nonce":37465},{"type":"v1","addr":"172.21.15.94:6813","nonce":37465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6819","nonce":37465},{"type":"v1","addr":"172.21.15.94:6822","nonce":37465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6815","nonce":37465},{"type":"v1","addr":"172.21.15.94:6817","nonce":37465}]},"public_addr":"172.21.15.94:6809/37465","cluster_addr":"172.21.15.94:6813/37465","heartbeat_back_addr":"172.21.15.94:6822/37465","heartbeat_front_addr":"172.21.15.94:6817/37465","state":["exists","up"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":37464},{"type":"v1","addr":"172.21.15.94:6812","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":37464},{"type":"v1","addr":"172.21.15.94:6816","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":37464},{"type":"v1","addr":"172.21.15.94:6823","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":37464},{"type":"v1","addr":"172.21.15.94:6820","nonce":37464}]},"public_addr":"172.21.15.94:6812/37464","cluster_addr":"172.21.15.94:6816/37464","heartbeat_back_addr":"172.21.15.94:6823/37464","heartbeat_front_addr":"172.21.15.94:6820/37464","state":["exists","up"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":37467},{"type":"v1","addr":"172.21.15.94:6825","nonce":37467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":37467},{"type":"v1","addr":"172.21.15.94:6827","nonce":37467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":37467},{"type":"v1","addr":"172.21.15.94:6831","nonce":37467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":37467},{"type":"v1","addr":"172.21.15.94:6829","nonce":37467}]},"public_addr":"172.21.15.94:6825/37467","cluster_addr":"172.21.15.94:6827/37467","heartbeat_back_addr":"172.21.15.94:6831/37467","heartbeat_front_addr":"172.21.15.94:6829/37467","state":["exists","up"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":37466},{"type":"v1","addr":"172.21.15.94:6801","nonce":37466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":37466},{"type":"v1","addr":"172.21.15.94:6803","nonce":37466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":37466},{"type":"v1","addr":"172.21.15.94:6807","nonce":37466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":37466},{"type":"v1","addr":"172.21.15.94:6805","nonce":37466}]},"public_addr":"172.21.15.94:6801/37466","cluster_addr":"172.21.15.94:6803/37466","heartbeat_back_addr":"172.21.15.94:6807/37466","heartbeat_front_addr":"172.21.15.94:6805/37466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.327217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.186966+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.419986+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.150585+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.120621+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.121576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.181257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.293188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:19:17.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.970+0000 7f52d4c00640 1 -- 172.21.15.17:0/1125481070 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f52ac06ac00 msgr2=0x7f52ac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:17.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.970+0000 7f52d4c00640 1 --2- 172.21.15.17:0/1125481070 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f52ac06ac00 0x7f52ac06d0c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f52d00cb420 tx=0x7f52b8008040 comp rx=0 tx=0).stop 2024-03-12T17:19:17.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.970+0000 7f52d4c00640 1 -- 172.21.15.17:0/1125481070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52d00cfa40 msgr2=0x7f52d0148430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:17.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.970+0000 7f52d4c00640 1 --2- 172.21.15.17:0/1125481070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52d00cfa40 0x7f52d0148430 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f52c002b950 tx=0x7f52c00046c0 comp rx=0 tx=0).stop 2024-03-12T17:19:17.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.970+0000 7f52d4c00640 1 -- 172.21.15.17:0/1125481070 shutdown_connections 2024-03-12T17:19:17.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.970+0000 7f52d4c00640 1 --2- 172.21.15.17:0/1125481070 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f52ac06ac00 0x7f52ac06d0c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:17.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.970+0000 7f52d4c00640 1 --2- 172.21.15.17:0/1125481070 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f52d015ce80 0x7f52d014b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:17.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.970+0000 7f52d4c00640 1 --2- 172.21.15.17:0/1125481070 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f52d015caa0 0x7f52d014af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:17.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.970+0000 7f52d4c00640 1 --2- 172.21.15.17:0/1125481070 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f52d00cfa40 0x7f52d0148430 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:17.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.970+0000 7f52d4c00640 1 -- 172.21.15.17:0/1125481070 >> 172.21.15.17:0/1125481070 conn(0x7f52d006b160 msgr2=0x7f52d006b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:17.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.970+0000 7f52d4c00640 1 -- 172.21.15.17:0/1125481070 shutdown_connections 2024-03-12T17:19:17.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:17.970+0000 7f52d4c00640 1 -- 172.21.15.17:0/1125481070 wait complete. 2024-03-12T17:19:17.985 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-12T17:18:39.552910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-12T17:18:43.794908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-12T17:18:44.867006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-12T17:19:17.985 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-12T17:19:18.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.207+0000 7fd284a00640 1 Processor -- start 2024-03-12T17:19:18.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.207+0000 7fd284a00640 1 -- start start 2024-03-12T17:19:18.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.209+0000 7fd284a00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd2800cb930 0x7fd2800b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:18.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.209+0000 7fd284a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd2800b23e0 0x7fd2800cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:18.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.209+0000 7fd284a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd2800cd850 0x7fd2800b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:18.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.209+0000 7fd284a00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2800cc250 con 0x7fd2800cd850 2024-03-12T17:19:18.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.209+0000 7fd284a00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2800ce1a0 con 0x7fd2800cb930 2024-03-12T17:19:18.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.209+0000 7fd284a00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2800b1900 con 0x7fd2800b23e0 2024-03-12T17:19:18.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.209+0000 7fd27fe00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd2800cd850 0x7fd2800b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:18.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.209+0000 7fd27fe00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd2800cd850 0x7fd2800b2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38474/0 (socket says 172.21.15.17:38474) 2024-03-12T17:19:18.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.209+0000 7fd27fe00640 1 -- 172.21.15.17:0/2245792825 learned_addr learned my addr 172.21.15.17:0/2245792825 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:18.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.209+0000 7fd27f400640 1 --2- 172.21.15.17:0/2245792825 >> v2:172.21.15.94:3300/0 conn(0x7fd2800cb930 0x7fd2800b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:18.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.210+0000 7fd277e00640 1 --2- 172.21.15.17:0/2245792825 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd2800b23e0 0x7fd2800cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:18.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.210+0000 7fd27fe00640 1 -- 172.21.15.17:0/2245792825 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd2800b23e0 msgr2=0x7fd2800cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:18.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.210+0000 7fd27fe00640 1 --2- 172.21.15.17:0/2245792825 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd2800b23e0 0x7fd2800cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:18.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.210+0000 7fd27fe00640 1 -- 172.21.15.17:0/2245792825 >> v2:172.21.15.94:3300/0 conn(0x7fd2800cb930 msgr2=0x7fd2800b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:18.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.210+0000 7fd27fe00640 1 --2- 172.21.15.17:0/2245792825 >> v2:172.21.15.94:3300/0 conn(0x7fd2800cb930 0x7fd2800b45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:18.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.210+0000 7fd27fe00640 1 -- 172.21.15.17:0/2245792825 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2800b1be0 con 0x7fd2800cd850 2024-03-12T17:19:18.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.211+0000 7fd27fe00640 1 --2- 172.21.15.17:0/2245792825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2800cd850 0x7fd2800b2d50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd28006da00 tx=0x7fd27802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7429245ba1811458 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:18.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.211+0000 7fd27ea00640 1 -- 172.21.15.17:0/2245792825 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd27802ca80 con 0x7fd2800cd850 2024-03-12T17:19:18.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.211+0000 7fd27ea00640 1 -- 172.21.15.17:0/2245792825 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd27802cbe0 con 0x7fd2800cd850 2024-03-12T17:19:18.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.211+0000 7fd27ea00640 1 -- 172.21.15.17:0/2245792825 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2780343f0 con 0x7fd2800cd850 2024-03-12T17:19:18.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.212+0000 7fd284a00640 1 -- 172.21.15.17:0/2245792825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2800cd850 msgr2=0x7fd2800b2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:18.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.212+0000 7fd284a00640 1 --2- 172.21.15.17:0/2245792825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2800cd850 0x7fd2800b2d50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd28006da00 tx=0x7fd27802bee0 comp rx=0 tx=0).stop 2024-03-12T17:19:18.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.212+0000 7fd284a00640 1 -- 172.21.15.17:0/2245792825 shutdown_connections 2024-03-12T17:19:18.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.212+0000 7fd284a00640 1 --2- 172.21.15.17:0/2245792825 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2800cd850 0x7fd2800b2d50 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:18.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.212+0000 7fd284a00640 1 --2- 172.21.15.17:0/2245792825 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd2800b23e0 0x7fd2800cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:18.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.212+0000 7fd284a00640 1 --2- 172.21.15.17:0/2245792825 >> v2:172.21.15.94:3300/0 conn(0x7fd2800cb930 0x7fd2800b45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:18.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.212+0000 7fd284a00640 1 -- 172.21.15.17:0/2245792825 >> 172.21.15.17:0/2245792825 conn(0x7fd280069ce0 msgr2=0x7fd28006a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:18.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.212+0000 7fd284a00640 1 -- 172.21.15.17:0/2245792825 shutdown_connections 2024-03-12T17:19:18.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.212+0000 7fd284a00640 1 -- 172.21.15.17:0/2245792825 wait complete. 2024-03-12T17:19:18.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.214+0000 7fd284a00640 1 Processor -- start 2024-03-12T17:19:18.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.214+0000 7fd284a00640 1 -- start start 2024-03-12T17:19:18.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.215+0000 7fd284a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd2800b23e0 0x7fd2800a74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:18.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.215+0000 7fd284a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2800cb930 0x7fd280141c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:18.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.215+0000 7fd284a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2800cd850 0x7fd2800a80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:18.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.215+0000 7fd284a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2800a9840 con 0x7fd2800cb930 2024-03-12T17:19:18.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.215+0000 7fd284a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2800adee0 con 0x7fd2800cd850 2024-03-12T17:19:18.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.215+0000 7fd284a00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd280161910 con 0x7fd2800b23e0 2024-03-12T17:19:18.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.215+0000 7fd277e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2800cb930 0x7fd280141c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:18.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.215+0000 7fd277e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2800cb930 0x7fd280141c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38488/0 (socket says 172.21.15.17:38488) 2024-03-12T17:19:18.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.215+0000 7fd277e00640 1 -- 172.21.15.17:0/3353007212 learned_addr learned my addr 172.21.15.17:0/3353007212 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:18.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.215+0000 7fd27f400640 1 --2- 172.21.15.17:0/3353007212 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd2800b23e0 0x7fd2800a74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:18.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.215+0000 7fd27fe00640 1 --2- 172.21.15.17:0/3353007212 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2800cd850 0x7fd2800a80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:18.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.215+0000 7fd277e00640 1 -- 172.21.15.17:0/3353007212 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd2800b23e0 msgr2=0x7fd2800a74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:18.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.215+0000 7fd277e00640 1 --2- 172.21.15.17:0/3353007212 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd2800b23e0 0x7fd2800a74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:18.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.215+0000 7fd277e00640 1 -- 172.21.15.17:0/3353007212 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2800cd850 msgr2=0x7fd2800a80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:18.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.215+0000 7fd277e00640 1 --2- 172.21.15.17:0/3353007212 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2800cd850 0x7fd2800a80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:18.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.215+0000 7fd277e00640 1 -- 172.21.15.17:0/3353007212 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd278009b30 con 0x7fd2800cb930 2024-03-12T17:19:18.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.215+0000 7fd27fe00640 1 --2- 172.21.15.17:0/3353007212 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2800cd850 0x7fd2800a80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:18.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.216+0000 7fd277e00640 1 --2- 172.21.15.17:0/3353007212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2800cb930 0x7fd280141c10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd26800d830 tx=0x7fd26800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:18.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.216+0000 7fd277400640 1 -- 172.21.15.17:0/3353007212 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2680096a0 con 0x7fd2800cb930 2024-03-12T17:19:18.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.216+0000 7fd277400640 1 -- 172.21.15.17:0/3353007212 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd268009800 con 0x7fd2800cb930 2024-03-12T17:19:18.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.216+0000 7fd277400640 1 -- 172.21.15.17:0/3353007212 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd268009b90 con 0x7fd2800cb930 2024-03-12T17:19:18.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.216+0000 7fd284a00640 1 -- 172.21.15.17:0/3353007212 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2800ce600 con 0x7fd2800cb930 2024-03-12T17:19:18.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.216+0000 7fd284a00640 1 -- 172.21.15.17:0/3353007212 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2800adc00 con 0x7fd2800cb930 2024-03-12T17:19:18.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.218+0000 7fd284a00640 1 -- 172.21.15.17:0/3353007212 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd28004e030 con 0x7fd2800cb930 2024-03-12T17:19:18.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.218+0000 7fd277400640 1 -- 172.21.15.17:0/3353007212 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fd268014410 con 0x7fd2800cb930 2024-03-12T17:19:18.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.219+0000 7fd277400640 1 --2- 172.21.15.17:0/3353007212 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd25c06ac00 0x7fd25c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:18.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.219+0000 7fd277400640 1 -- 172.21.15.17:0/3353007212 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd268089c00 con 0x7fd2800cb930 2024-03-12T17:19:18.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.220+0000 7fd27f400640 1 --2- 172.21.15.17:0/3353007212 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd25c06ac00 0x7fd25c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:18.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.220+0000 7fd27f400640 1 --2- 172.21.15.17:0/3353007212 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd25c06ac00 0x7fd25c06d0c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd270006fd0 tx=0x7fd270008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:18.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.224+0000 7fd277400640 1 -- 172.21.15.17:0/3353007212 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fd268090080 con 0x7fd2800cb930 2024-03-12T17:19:18.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.422+0000 7fd284a00640 1 -- 172.21.15.17:0/3353007212 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd280070840 con 0x7fd2800cb930 2024-03-12T17:19:18.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.422+0000 7fd277400640 1 -- 172.21.15.17:0/3353007212 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd268054e70 con 0x7fd2800cb930 2024-03-12T17:19:18.418 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-03-12T17:19:18.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.425+0000 7fd284a00640 1 -- 172.21.15.17:0/3353007212 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd25c06ac00 msgr2=0x7fd25c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:18.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.425+0000 7fd284a00640 1 --2- 172.21.15.17:0/3353007212 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd25c06ac00 0x7fd25c06d0c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd270006fd0 tx=0x7fd270008040 comp rx=0 tx=0).stop 2024-03-12T17:19:18.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.425+0000 7fd284a00640 1 -- 172.21.15.17:0/3353007212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2800cb930 msgr2=0x7fd280141c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:18.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.425+0000 7fd284a00640 1 --2- 172.21.15.17:0/3353007212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2800cb930 0x7fd280141c10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd26800d830 tx=0x7fd26800dcf0 comp rx=0 tx=0).stop 2024-03-12T17:19:18.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.425+0000 7fd284a00640 1 -- 172.21.15.17:0/3353007212 shutdown_connections 2024-03-12T17:19:18.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.425+0000 7fd284a00640 1 --2- 172.21.15.17:0/3353007212 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd25c06ac00 0x7fd25c06d0c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:18.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.425+0000 7fd284a00640 1 --2- 172.21.15.17:0/3353007212 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2800cd850 0x7fd2800a80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:18.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.425+0000 7fd284a00640 1 --2- 172.21.15.17:0/3353007212 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2800cb930 0x7fd280141c10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:18.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.425+0000 7fd284a00640 1 --2- 172.21.15.17:0/3353007212 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd2800b23e0 0x7fd2800a74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:18.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.425+0000 7fd284a00640 1 -- 172.21.15.17:0/3353007212 >> 172.21.15.17:0/3353007212 conn(0x7fd280069ce0 msgr2=0x7fd2800b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:18.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.425+0000 7fd284a00640 1 -- 172.21.15.17:0/3353007212 shutdown_connections 2024-03-12T17:19:18.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.425+0000 7fd284a00640 1 -- 172.21.15.17:0/3353007212 wait complete. 2024-03-12T17:19:18.440 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-12T17:19:18.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.671+0000 7f9892000640 1 Processor -- start 2024-03-12T17:19:18.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.671+0000 7f9892000640 1 -- start start 2024-03-12T17:19:18.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.673+0000 7f9892000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f988c160090 0x7f988c06b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:18.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.673+0000 7f9892000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f988c0b86c0 0x7f988c0b4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:18.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.673+0000 7f9892000640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f988c0b4950 0x7f988c1606a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:18.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.673+0000 7f9892000640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f988c0d0e40 con 0x7f988c160090 2024-03-12T17:19:18.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.673+0000 7f9892000640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f988c0b4da0 con 0x7f988c0b4950 2024-03-12T17:19:18.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.673+0000 7f9892000640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f988c160470 con 0x7f988c0b86c0 2024-03-12T17:19:18.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.673+0000 7f9890c00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f988c160090 0x7f988c06b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:18.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.673+0000 7f9890c00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f988c160090 0x7f988c06b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38506/0 (socket says 172.21.15.17:38506) 2024-03-12T17:19:18.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.673+0000 7f9890c00640 1 -- 172.21.15.17:0/2582382032 learned_addr learned my addr 172.21.15.17:0/2582382032 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:18.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.674+0000 7f988be00640 1 --2- 172.21.15.17:0/2582382032 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f988c0b86c0 0x7f988c0b4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:18.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.674+0000 7f9891600640 1 --2- 172.21.15.17:0/2582382032 >> v2:172.21.15.94:3300/0 conn(0x7f988c0b4950 0x7f988c1606a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:18.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.674+0000 7f9890c00640 1 -- 172.21.15.17:0/2582382032 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f988c0b86c0 msgr2=0x7f988c0b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:18.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.674+0000 7f9890c00640 1 --2- 172.21.15.17:0/2582382032 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f988c0b86c0 0x7f988c0b4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:18.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.674+0000 7f9890c00640 1 -- 172.21.15.17:0/2582382032 >> v2:172.21.15.94:3300/0 conn(0x7f988c0b4950 msgr2=0x7f988c1606a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:18.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.674+0000 7f9890c00640 1 --2- 172.21.15.17:0/2582382032 >> v2:172.21.15.94:3300/0 conn(0x7f988c0b4950 0x7f988c1606a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:18.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.674+0000 7f9890c00640 1 -- 172.21.15.17:0/2582382032 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f988c0d0a80 con 0x7f988c160090 2024-03-12T17:19:18.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.674+0000 7f9891600640 1 --2- 172.21.15.17:0/2582382032 >> v2:172.21.15.94:3300/0 conn(0x7f988c0b4950 0x7f988c1606a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:18.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.675+0000 7f9890c00640 1 --2- 172.21.15.17:0/2582382032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f988c160090 0x7f988c06b130 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f988c08b0e0 tx=0x7f987c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2137ef9b39fc898 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:18.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.675+0000 7f988b400640 1 -- 172.21.15.17:0/2582382032 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987c0317e0 con 0x7f988c160090 2024-03-12T17:19:18.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.675+0000 7f988b400640 1 -- 172.21.15.17:0/2582382032 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f987c031940 con 0x7f988c160090 2024-03-12T17:19:18.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.675+0000 7f988b400640 1 -- 172.21.15.17:0/2582382032 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f987c031cd0 con 0x7f988c160090 2024-03-12T17:19:18.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.676+0000 7f9892000640 1 -- 172.21.15.17:0/2582382032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f988c160090 msgr2=0x7f988c06b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:18.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.676+0000 7f9892000640 1 --2- 172.21.15.17:0/2582382032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f988c160090 0x7f988c06b130 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f988c08b0e0 tx=0x7f987c02b880 comp rx=0 tx=0).stop 2024-03-12T17:19:18.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.676+0000 7f9892000640 1 -- 172.21.15.17:0/2582382032 shutdown_connections 2024-03-12T17:19:18.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.676+0000 7f9892000640 1 --2- 172.21.15.17:0/2582382032 >> v2:172.21.15.94:3300/0 conn(0x7f988c0b4950 0x7f988c1606a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:18.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.676+0000 7f9892000640 1 --2- 172.21.15.17:0/2582382032 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f988c0b86c0 0x7f988c0b4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:18.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.676+0000 7f9892000640 1 --2- 172.21.15.17:0/2582382032 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f988c160090 0x7f988c06b130 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:18.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.676+0000 7f9892000640 1 -- 172.21.15.17:0/2582382032 >> 172.21.15.17:0/2582382032 conn(0x7f988c0cf5f0 msgr2=0x7f988c0cfa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:18.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.677+0000 7f9892000640 1 -- 172.21.15.17:0/2582382032 shutdown_connections 2024-03-12T17:19:18.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.677+0000 7f9892000640 1 -- 172.21.15.17:0/2582382032 wait complete. 2024-03-12T17:19:18.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.679+0000 7f9892000640 1 Processor -- start 2024-03-12T17:19:18.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.679+0000 7f9892000640 1 -- start start 2024-03-12T17:19:18.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.680+0000 7f9892000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f988c0b4950 0x7f988c15ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:18.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.680+0000 7f9892000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f988c0b86c0 0x7f988c0abeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:18.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.680+0000 7f9892000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f988c160090 0x7f988c0ac6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:18.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.680+0000 7f9892000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988c0ab4b0 con 0x7f988c160090 2024-03-12T17:19:18.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.680+0000 7f9892000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f988c0ac3f0 con 0x7f988c0b4950 2024-03-12T17:19:18.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.680+0000 7f9892000640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f988c0ccca0 con 0x7f988c0b86c0 2024-03-12T17:19:18.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.681+0000 7f9891600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f988c160090 0x7f988c0ac6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:18.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.681+0000 7f9891600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f988c160090 0x7f988c0ac6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38518/0 (socket says 172.21.15.17:38518) 2024-03-12T17:19:18.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.681+0000 7f9891600640 1 -- 172.21.15.17:0/1736914757 learned_addr learned my addr 172.21.15.17:0/1736914757 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:18.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.681+0000 7f9890c00640 1 --2- 172.21.15.17:0/1736914757 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f988c0b4950 0x7f988c15ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:18.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.681+0000 7f988be00640 1 --2- 172.21.15.17:0/1736914757 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f988c0b86c0 0x7f988c0abeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:18.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.681+0000 7f9891600640 1 -- 172.21.15.17:0/1736914757 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f988c0b86c0 msgr2=0x7f988c0abeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:18.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.681+0000 7f9891600640 1 --2- 172.21.15.17:0/1736914757 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f988c0b86c0 0x7f988c0abeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:18.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.681+0000 7f9891600640 1 -- 172.21.15.17:0/1736914757 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f988c0b4950 msgr2=0x7f988c15ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:18.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.681+0000 7f9891600640 1 --2- 172.21.15.17:0/1736914757 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f988c0b4950 0x7f988c15ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:18.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.681+0000 7f9891600640 1 -- 172.21.15.17:0/1736914757 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f987c0094d0 con 0x7f988c160090 2024-03-12T17:19:18.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.681+0000 7f988be00640 1 --2- 172.21.15.17:0/1736914757 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f988c0b86c0 0x7f988c0abeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:18.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.682+0000 7f9891600640 1 --2- 172.21.15.17:0/1736914757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f988c160090 0x7f988c0ac6a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f988400cd40 tx=0x7f988400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:18.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.682+0000 7f9888c00640 1 -- 172.21.15.17:0/1736914757 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988400f680 con 0x7f988c160090 2024-03-12T17:19:18.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.682+0000 7f9888c00640 1 -- 172.21.15.17:0/1736914757 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f988400f800 con 0x7f988c160090 2024-03-12T17:19:18.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.682+0000 7f9888c00640 1 -- 172.21.15.17:0/1736914757 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988400fbb0 con 0x7f988c160090 2024-03-12T17:19:18.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.682+0000 7f9892000640 1 -- 172.21.15.17:0/1736914757 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f988c0aa830 con 0x7f988c160090 2024-03-12T17:19:18.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.682+0000 7f9892000640 1 -- 172.21.15.17:0/1736914757 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f988c0aadf0 con 0x7f988c160090 2024-03-12T17:19:18.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.683+0000 7f9892000640 1 -- 172.21.15.17:0/1736914757 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f988c067120 con 0x7f988c160090 2024-03-12T17:19:18.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.685+0000 7f9888c00640 1 -- 172.21.15.17:0/1736914757 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f988400b040 con 0x7f988c160090 2024-03-12T17:19:18.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.685+0000 7f9888c00640 1 --2- 172.21.15.17:0/1736914757 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f986806ac30 0x7f986806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:18.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.686+0000 7f9888c00640 1 -- 172.21.15.17:0/1736914757 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9884089cb0 con 0x7f988c160090 2024-03-12T17:19:18.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.686+0000 7f9890c00640 1 --2- 172.21.15.17:0/1736914757 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f986806ac30 0x7f986806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:18.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.687+0000 7f9890c00640 1 --2- 172.21.15.17:0/1736914757 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f986806ac30 0x7f986806d0f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f987c036000 tx=0x7f987c03d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:18.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.690+0000 7f9888c00640 1 -- 172.21.15.17:0/1736914757 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f9884054df0 con 0x7f988c160090 2024-03-12T17:19:18.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.888+0000 7f9892000640 1 -- 172.21.15.17:0/1736914757 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f988c072360 con 0x7f988c160090 2024-03-12T17:19:18.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.889+0000 7f9888c00640 1 -- 172.21.15.17:0/1736914757 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f988401d0a0 con 0x7f988c160090 2024-03-12T17:19:18.884 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-03-12T17:19:18.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.891+0000 7f9892000640 1 -- 172.21.15.17:0/1736914757 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f986806ac30 msgr2=0x7f986806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:18.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.891+0000 7f9892000640 1 --2- 172.21.15.17:0/1736914757 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f986806ac30 0x7f986806d0f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f987c036000 tx=0x7f987c03d040 comp rx=0 tx=0).stop 2024-03-12T17:19:18.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.891+0000 7f9892000640 1 -- 172.21.15.17:0/1736914757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f988c160090 msgr2=0x7f988c0ac6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:18.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.891+0000 7f9892000640 1 --2- 172.21.15.17:0/1736914757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f988c160090 0x7f988c0ac6a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f988400cd40 tx=0x7f988400a650 comp rx=0 tx=0).stop 2024-03-12T17:19:18.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.891+0000 7f9892000640 1 -- 172.21.15.17:0/1736914757 shutdown_connections 2024-03-12T17:19:18.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.891+0000 7f9892000640 1 --2- 172.21.15.17:0/1736914757 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f986806ac30 0x7f986806d0f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:18.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.891+0000 7f9892000640 1 --2- 172.21.15.17:0/1736914757 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f988c160090 0x7f988c0ac6a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:18.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.891+0000 7f9892000640 1 --2- 172.21.15.17:0/1736914757 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f988c0b86c0 0x7f988c0abeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:18.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.891+0000 7f9892000640 1 --2- 172.21.15.17:0/1736914757 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f988c0b4950 0x7f988c15ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:18.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.891+0000 7f9892000640 1 -- 172.21.15.17:0/1736914757 >> 172.21.15.17:0/1736914757 conn(0x7f988c0cf5f0 msgr2=0x7f988c0b2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:18.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.892+0000 7f9892000640 1 -- 172.21.15.17:0/1736914757 shutdown_connections 2024-03-12T17:19:18.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:18.892+0000 7f9892000640 1 -- 172.21.15.17:0/1736914757 wait complete. 2024-03-12T17:19:18.904 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-12T17:19:19.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.134+0000 7fb508e00640 1 Processor -- start 2024-03-12T17:19:19.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.134+0000 7fb508e00640 1 -- start start 2024-03-12T17:19:19.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.136+0000 7fb508e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb5040cde60 0x7fb5040b84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:19.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.136+0000 7fb508e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb50406b0c0 0x7fb5040d1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:19.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.136+0000 7fb508e00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5041604d0 con 0x7fb5041600f0 2024-03-12T17:19:19.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.136+0000 7fb508e00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb50406c0d0 con 0x7fb50406b0c0 2024-03-12T17:19:19.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.136+0000 7fb508e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb50406b830 con 0x7fb5040cde60 2024-03-12T17:19:19.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.136+0000 7fb503400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fb5041600f0 0x7fb5040cd750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:47042/0 (socket says 172.21.15.17:47042) 2024-03-12T17:19:19.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.136+0000 7fb503400640 1 -- 172.21.15.17:0/3230263371 learned_addr learned my addr 172.21.15.17:0/3230263371 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:19.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.136+0000 7fb503e00640 1 --2- 172.21.15.17:0/3230263371 >> v2:172.21.15.94:3300/0 conn(0x7fb50406b0c0 0x7fb5040d1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:19.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.136+0000 7fb502a00640 1 --2- 172.21.15.17:0/3230263371 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb5040cde60 0x7fb5040b84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:19.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.136+0000 7fb502000640 1 -- 172.21.15.17:0/3230263371 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2073235431 0 0) 0x7fb5041604d0 con 0x7fb5041600f0 2024-03-12T17:19:19.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.137+0000 7fb502000640 1 -- 172.21.15.17:0/3230263371 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4e8003520 con 0x7fb5041600f0 2024-03-12T17:19:19.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.137+0000 7fb502000640 1 -- 172.21.15.17:0/3230263371 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2144797430 0 0) 0x7fb4e8003520 con 0x7fb5041600f0 2024-03-12T17:19:19.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.137+0000 7fb502000640 1 -- 172.21.15.17:0/3230263371 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb5040cde60 msgr2=0x7fb5040b84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:19.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.137+0000 7fb502000640 1 --2- 172.21.15.17:0/3230263371 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb5040cde60 0x7fb5040b84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:19.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.137+0000 7fb502000640 1 -- 172.21.15.17:0/3230263371 >> v2:172.21.15.94:3300/0 conn(0x7fb50406b0c0 msgr2=0x7fb5040d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:19.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.137+0000 7fb502000640 1 --2- 172.21.15.17:0/3230263371 >> v2:172.21.15.94:3300/0 conn(0x7fb50406b0c0 0x7fb5040d1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:19.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.137+0000 7fb502000640 1 -- 172.21.15.17:0/3230263371 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb50406bb10 con 0x7fb5041600f0 2024-03-12T17:19:19.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.137+0000 7fb502000640 1 -- 172.21.15.17:0/3230263371 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7fb4f40019f0 con 0x7fb5041600f0 2024-03-12T17:19:19.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.137+0000 7fb502000640 1 -- 172.21.15.17:0/3230263371 >> v1:172.21.15.17:6789/0 conn(0x7fb5041600f0 legacy=0x7fb5040cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:19.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.137+0000 7fb502000640 1 --2- 172.21.15.17:0/3230263371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4e8003970 0x7fb4e8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:19.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.137+0000 7fb502000640 1 --2- 172.21.15.17:0/3230263371 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb5040cde60 0x7fb4e80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:19.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.137+0000 7fb502000640 1 --2- 172.21.15.17:0/3230263371 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4e8004d00 0x7fb4e8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:19.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.137+0000 7fb502000640 1 -- 172.21.15.17:0/3230263371 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50406c0d0 con 0x7fb4e8003970 2024-03-12T17:19:19.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.137+0000 7fb502000640 1 -- 172.21.15.17:0/3230263371 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50406b830 con 0x7fb4e8004d00 2024-03-12T17:19:19.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.137+0000 7fb502000640 1 -- 172.21.15.17:0/3230263371 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e800b980 con 0x7fb5040cde60 2024-03-12T17:19:19.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.137+0000 7fb503400640 1 --2- 172.21.15.17:0/3230263371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4e8003970 0x7fb4e8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:19.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.138+0000 7fb502a00640 1 --2- 172.21.15.17:0/3230263371 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb5040cde60 0x7fb4e80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:19.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.138+0000 7fb503e00640 1 --2- 172.21.15.17:0/3230263371 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4e8004d00 0x7fb4e8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:19.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.138+0000 7fb503400640 1 -- 172.21.15.17:0/3230263371 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb5040cde60 msgr2=0x7fb4e80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:19.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.138+0000 7fb503400640 1 --2- 172.21.15.17:0/3230263371 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb5040cde60 0x7fb4e80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:19.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.138+0000 7fb503400640 1 -- 172.21.15.17:0/3230263371 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4e8004d00 msgr2=0x7fb4e8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:19.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.138+0000 7fb503400640 1 --2- 172.21.15.17:0/3230263371 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4e8004d00 0x7fb4e8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:19.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.138+0000 7fb503400640 1 -- 172.21.15.17:0/3230263371 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e8003520 con 0x7fb4e8003970 2024-03-12T17:19:19.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.139+0000 7fb503400640 1 --2- 172.21.15.17:0/3230263371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4e8003970 0x7fb4e8003d90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb4f400a7c0 tx=0x7fb4e80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c6e267c758b3114 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:19.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.139+0000 7fb502000640 1 -- 172.21.15.17:0/3230263371 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f4034630 con 0x7fb4e8003970 2024-03-12T17:19:19.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.139+0000 7fb502000640 1 -- 172.21.15.17:0/3230263371 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f402f070 con 0x7fb4e8003970 2024-03-12T17:19:19.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.139+0000 7fb502000640 1 -- 172.21.15.17:0/3230263371 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f40349f0 con 0x7fb4e8003970 2024-03-12T17:19:19.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.140+0000 7fb508e00640 1 -- 172.21.15.17:0/3230263371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4e8003970 msgr2=0x7fb4e8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:19.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.140+0000 7fb508e00640 1 --2- 172.21.15.17:0/3230263371 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4e8003970 0x7fb4e8003d90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb4f400a7c0 tx=0x7fb4e80057f0 comp rx=0 tx=0).stop 2024-03-12T17:19:19.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.140+0000 7fb503e00640 1 -- 172.21.15.17:0/3230263371 reap_dead start 2024-03-12T17:19:19.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.140+0000 7fb508e00640 1 -- 172.21.15.17:0/3230263371 shutdown_connections 2024-03-12T17:19:19.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.140+0000 7fb508e00640 1 -- 172.21.15.17:0/3230263371 >> 172.21.15.17:0/3230263371 conn(0x7fb5040cf820 msgr2=0x7fb5040cfc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:19.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.140+0000 7fb508e00640 1 -- 172.21.15.17:0/3230263371 shutdown_connections 2024-03-12T17:19:19.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.140+0000 7fb508e00640 1 -- 172.21.15.17:0/3230263371 wait complete. 2024-03-12T17:19:19.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.142+0000 7fb508e00640 1 Processor -- start 2024-03-12T17:19:19.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.142+0000 7fb508e00640 1 -- start start 2024-03-12T17:19:19.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.143+0000 7fb508e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4e8003970 0x7fb5040c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:19.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.143+0000 7fb508e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb50414f280 0x7fb5040ca460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:19.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.143+0000 7fb508e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb5040c7950 0x7fb5040c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:19.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.143+0000 7fb508e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5040ca9a0 con 0x7fb50414f280 2024-03-12T17:19:19.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.143+0000 7fb508e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5040cb470 con 0x7fb4e8003970 2024-03-12T17:19:19.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.143+0000 7fb508e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5040cabd0 con 0x7fb5040c7950 2024-03-12T17:19:19.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.144+0000 7fb502a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb50414f280 0x7fb5040ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:19.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.144+0000 7fb502a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb50414f280 0x7fb5040ca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38528/0 (socket says 172.21.15.17:38528) 2024-03-12T17:19:19.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.144+0000 7fb502a00640 1 -- 172.21.15.17:0/2425763173 learned_addr learned my addr 172.21.15.17:0/2425763173 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:19.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.144+0000 7fb503400640 1 --2- 172.21.15.17:0/2425763173 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4e8003970 0x7fb5040c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:19.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.144+0000 7fb502a00640 1 -- 172.21.15.17:0/2425763173 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb5040c7950 msgr2=0x7fb5040c7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:19.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.144+0000 7fb502a00640 1 --2- 172.21.15.17:0/2425763173 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb5040c7950 0x7fb5040c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:19.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.144+0000 7fb502a00640 1 -- 172.21.15.17:0/2425763173 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4e8003970 msgr2=0x7fb5040c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:19.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.144+0000 7fb502a00640 1 --2- 172.21.15.17:0/2425763173 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4e8003970 0x7fb5040c8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:19.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.144+0000 7fb502a00640 1 -- 172.21.15.17:0/2425763173 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5040caeb0 con 0x7fb50414f280 2024-03-12T17:19:19.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.144+0000 7fb502a00640 1 --2- 172.21.15.17:0/2425763173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb50414f280 0x7fb5040ca460 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec011600 tx=0x7fb4ec011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:19.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.145+0000 7fb4fb400640 1 -- 172.21.15.17:0/2425763173 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec015870 con 0x7fb50414f280 2024-03-12T17:19:19.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.145+0000 7fb4fb400640 1 -- 172.21.15.17:0/2425763173 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4ec0159d0 con 0x7fb50414f280 2024-03-12T17:19:19.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.145+0000 7fb4fb400640 1 -- 172.21.15.17:0/2425763173 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec015d40 con 0x7fb50414f280 2024-03-12T17:19:19.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.145+0000 7fb508e00640 1 -- 172.21.15.17:0/2425763173 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5040cb190 con 0x7fb50414f280 2024-03-12T17:19:19.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.145+0000 7fb508e00640 1 -- 172.21.15.17:0/2425763173 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5040c8320 con 0x7fb50414f280 2024-03-12T17:19:19.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.146+0000 7fb508e00640 1 -- 172.21.15.17:0/2425763173 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5040cf220 con 0x7fb50414f280 2024-03-12T17:19:19.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.147+0000 7fb4fb400640 1 -- 172.21.15.17:0/2425763173 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fb4ec00f490 con 0x7fb50414f280 2024-03-12T17:19:19.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.148+0000 7fb4fb400640 1 --2- 172.21.15.17:0/2425763173 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb4e006ac00 0x7fb4e006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:19.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.148+0000 7fb4fb400640 1 -- 172.21.15.17:0/2425763173 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4ec089840 con 0x7fb50414f280 2024-03-12T17:19:19.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.148+0000 7fb503400640 1 --2- 172.21.15.17:0/2425763173 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb4e006ac00 0x7fb4e006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:19.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.149+0000 7fb503400640 1 --2- 172.21.15.17:0/2425763173 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb4e006ac00 0x7fb4e006d0c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4034000 tx=0x7fb4f4009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:19.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.154+0000 7fb4fb400640 1 -- 172.21.15.17:0/2425763173 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fb4ec054a10 con 0x7fb50414f280 2024-03-12T17:19:19.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.359+0000 7fb508e00640 1 -- 172.21.15.17:0/2425763173 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb5040ce360 con 0x7fb50414f280 2024-03-12T17:19:19.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.360+0000 7fb4fb400640 1 -- 172.21.15.17:0/2425763173 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb4ec058030 con 0x7fb50414f280 2024-03-12T17:19:19.358 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-03-12T17:19:19.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.363+0000 7fb508e00640 1 -- 172.21.15.17:0/2425763173 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb4e006ac00 msgr2=0x7fb4e006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:19.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.363+0000 7fb508e00640 1 --2- 172.21.15.17:0/2425763173 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb4e006ac00 0x7fb4e006d0c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb4f4034000 tx=0x7fb4f4009030 comp rx=0 tx=0).stop 2024-03-12T17:19:19.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.363+0000 7fb508e00640 1 -- 172.21.15.17:0/2425763173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb50414f280 msgr2=0x7fb5040ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:19.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.363+0000 7fb508e00640 1 --2- 172.21.15.17:0/2425763173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb50414f280 0x7fb5040ca460 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec011600 tx=0x7fb4ec011ac0 comp rx=0 tx=0).stop 2024-03-12T17:19:19.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.363+0000 7fb508e00640 1 -- 172.21.15.17:0/2425763173 shutdown_connections 2024-03-12T17:19:19.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.363+0000 7fb508e00640 1 --2- 172.21.15.17:0/2425763173 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb4e006ac00 0x7fb4e006d0c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:19.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.363+0000 7fb508e00640 1 --2- 172.21.15.17:0/2425763173 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb5040c7950 0x7fb5040c7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:19.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.363+0000 7fb508e00640 1 --2- 172.21.15.17:0/2425763173 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb50414f280 0x7fb5040ca460 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:19.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.363+0000 7fb508e00640 1 --2- 172.21.15.17:0/2425763173 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4e8003970 0x7fb5040c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:19.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.363+0000 7fb508e00640 1 -- 172.21.15.17:0/2425763173 >> 172.21.15.17:0/2425763173 conn(0x7fb5040cf820 msgr2=0x7fb5040b62c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:19.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.364+0000 7fb508e00640 1 -- 172.21.15.17:0/2425763173 shutdown_connections 2024-03-12T17:19:19.360 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.364+0000 7fb508e00640 1 -- 172.21.15.17:0/2425763173 wait complete. 2024-03-12T17:19:19.378 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T17:19:19.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.601+0000 7fcf04800640 1 Processor -- start 2024-03-12T17:19:19.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.601+0000 7fcf04800640 1 -- start start 2024-03-12T17:19:19.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.603+0000 7fcf04800640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fcefc144240 0x7fcefc0ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:19.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.603+0000 7fcf04800640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcefc0cecf0 0x7fcefc0b2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:19.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.603+0000 7fcf04800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fcefc0b25b0 0x7fcefc0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:19.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.603+0000 7fcf04800640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcefc0ce320 con 0x7fcefc0b25b0 2024-03-12T17:19:19.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.603+0000 7fcf04800640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcefc144620 con 0x7fcefc144240 2024-03-12T17:19:19.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.603+0000 7fcf04800640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc15f3d0 con 0x7fcefc0cecf0 2024-03-12T17:19:19.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.603+0000 7fcf02800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fcefc0b25b0 0x7fcefc0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:19.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.603+0000 7fcf02800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fcefc0b25b0 0x7fcefc0cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38544/0 (socket says 172.21.15.17:38544) 2024-03-12T17:19:19.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.603+0000 7fcf02800640 1 -- 172.21.15.17:0/3299972561 learned_addr learned my addr 172.21.15.17:0/3299972561 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:19.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.603+0000 7fcf01e00640 1 --2- 172.21.15.17:0/3299972561 >> v2:172.21.15.94:3300/0 conn(0x7fcefc144240 0x7fcefc0ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:19.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.604+0000 7fcf01400640 1 --2- 172.21.15.17:0/3299972561 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcefc0cecf0 0x7fcefc0b2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:19.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.604+0000 7fcf02800640 1 -- 172.21.15.17:0/3299972561 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcefc0cecf0 msgr2=0x7fcefc0b2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:19.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.604+0000 7fcf02800640 1 --2- 172.21.15.17:0/3299972561 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcefc0cecf0 0x7fcefc0b2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:19.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.604+0000 7fcf02800640 1 -- 172.21.15.17:0/3299972561 >> v2:172.21.15.94:3300/0 conn(0x7fcefc144240 msgr2=0x7fcefc0ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:19.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.604+0000 7fcf02800640 1 --2- 172.21.15.17:0/3299972561 >> v2:172.21.15.94:3300/0 conn(0x7fcefc144240 0x7fcefc0ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:19.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.604+0000 7fcf02800640 1 -- 172.21.15.17:0/3299972561 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcefc0cd9f0 con 0x7fcefc0b25b0 2024-03-12T17:19:19.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.605+0000 7fcf02800640 1 --2- 172.21.15.17:0/3299972561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcefc0b25b0 0x7fcefc0cb970 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcef8009e50 tx=0x7fcef802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eb509d5a45dcb6c server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:19.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.605+0000 7fcf00a00640 1 -- 172.21.15.17:0/3299972561 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef802ca70 con 0x7fcefc0b25b0 2024-03-12T17:19:19.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.605+0000 7fcf00a00640 1 -- 172.21.15.17:0/3299972561 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef802cbd0 con 0x7fcefc0b25b0 2024-03-12T17:19:19.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.605+0000 7fcf00a00640 1 -- 172.21.15.17:0/3299972561 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef80343f0 con 0x7fcefc0b25b0 2024-03-12T17:19:19.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.606+0000 7fcf04800640 1 -- 172.21.15.17:0/3299972561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcefc0b25b0 msgr2=0x7fcefc0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:19.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.606+0000 7fcf04800640 1 --2- 172.21.15.17:0/3299972561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcefc0b25b0 0x7fcefc0cb970 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcef8009e50 tx=0x7fcef802bed0 comp rx=0 tx=0).stop 2024-03-12T17:19:19.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.606+0000 7fcf04800640 1 -- 172.21.15.17:0/3299972561 shutdown_connections 2024-03-12T17:19:19.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.606+0000 7fcf04800640 1 --2- 172.21.15.17:0/3299972561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcefc0b25b0 0x7fcefc0cb970 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:19.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.606+0000 7fcf04800640 1 --2- 172.21.15.17:0/3299972561 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcefc0cecf0 0x7fcefc0b2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:19.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.606+0000 7fcf04800640 1 --2- 172.21.15.17:0/3299972561 >> v2:172.21.15.94:3300/0 conn(0x7fcefc144240 0x7fcefc0ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:19.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.606+0000 7fcf04800640 1 -- 172.21.15.17:0/3299972561 >> 172.21.15.17:0/3299972561 conn(0x7fcefc069ce0 msgr2=0x7fcefc06a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:19.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.606+0000 7fcf04800640 1 -- 172.21.15.17:0/3299972561 shutdown_connections 2024-03-12T17:19:19.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.606+0000 7fcf04800640 1 -- 172.21.15.17:0/3299972561 wait complete. 2024-03-12T17:19:19.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.608+0000 7fcf04800640 1 Processor -- start 2024-03-12T17:19:19.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.608+0000 7fcf04800640 1 -- start start 2024-03-12T17:19:19.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.609+0000 7fcf04800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcefc0b25b0 0x7fcefc15e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:19.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.609+0000 7fcf04800640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcefc0cecf0 0x7fcefc13bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:19.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.609+0000 7fcf04800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcefc144240 0x7fcefc13c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:19.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.609+0000 7fcf04800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc13b9d0 con 0x7fcefc144240 2024-03-12T17:19:19.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.609+0000 7fcf04800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc15de50 con 0x7fcefc0b25b0 2024-03-12T17:19:19.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.609+0000 7fcf04800640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcefc15d260 con 0x7fcefc0cecf0 2024-03-12T17:19:19.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.610+0000 7fcf02800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcefc144240 0x7fcefc13c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:19.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.610+0000 7fcf02800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcefc144240 0x7fcefc13c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38550/0 (socket says 172.21.15.17:38550) 2024-03-12T17:19:19.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.610+0000 7fcf02800640 1 -- 172.21.15.17:0/213650541 learned_addr learned my addr 172.21.15.17:0/213650541 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:19.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.610+0000 7fcf01400640 1 --2- 172.21.15.17:0/213650541 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcefc0cecf0 0x7fcefc13bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:19.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.610+0000 7fcf01e00640 1 --2- 172.21.15.17:0/213650541 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcefc0b25b0 0x7fcefc15e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:19.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.610+0000 7fcf02800640 1 -- 172.21.15.17:0/213650541 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcefc0cecf0 msgr2=0x7fcefc13bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:19.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.610+0000 7fcf02800640 1 --2- 172.21.15.17:0/213650541 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcefc0cecf0 0x7fcefc13bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:19.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.610+0000 7fcf02800640 1 -- 172.21.15.17:0/213650541 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcefc0b25b0 msgr2=0x7fcefc15e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:19.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.610+0000 7fcf02800640 1 --2- 172.21.15.17:0/213650541 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcefc0b25b0 0x7fcefc15e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:19.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.610+0000 7fcf02800640 1 -- 172.21.15.17:0/213650541 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef8009b30 con 0x7fcefc144240 2024-03-12T17:19:19.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.610+0000 7fcf01e00640 1 --2- 172.21.15.17:0/213650541 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcefc0b25b0 0x7fcefc15e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:19:19.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.611+0000 7fcf02800640 1 --2- 172.21.15.17:0/213650541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcefc144240 0x7fcefc13c0d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcef8009e50 tx=0x7fcef8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:19.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.611+0000 7fcef6000640 1 -- 172.21.15.17:0/213650541 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef8009510 con 0x7fcefc144240 2024-03-12T17:19:19.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.611+0000 7fcef6000640 1 -- 172.21.15.17:0/213650541 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcef803e450 con 0x7fcefc144240 2024-03-12T17:19:19.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.611+0000 7fcef6000640 1 -- 172.21.15.17:0/213650541 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcef803e800 con 0x7fcefc144240 2024-03-12T17:19:19.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.611+0000 7fcf04800640 1 -- 172.21.15.17:0/213650541 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcefc15d520 con 0x7fcefc144240 2024-03-12T17:19:19.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.611+0000 7fcf04800640 1 -- 172.21.15.17:0/213650541 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcefc15dae0 con 0x7fcefc144240 2024-03-12T17:19:19.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.612+0000 7fcf04800640 1 -- 172.21.15.17:0/213650541 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcefc15dfe0 con 0x7fcefc144240 2024-03-12T17:19:19.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.614+0000 7fcef6000640 1 -- 172.21.15.17:0/213650541 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fcef803e960 con 0x7fcefc144240 2024-03-12T17:19:19.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.615+0000 7fcef6000640 1 --2- 172.21.15.17:0/213650541 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fcee006ac00 0x7fcee006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:19.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.615+0000 7fcef6000640 1 -- 172.21.15.17:0/213650541 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcef80ac0b0 con 0x7fcefc144240 2024-03-12T17:19:19.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.615+0000 7fcf01e00640 1 --2- 172.21.15.17:0/213650541 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fcee006ac00 0x7fcee006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:19.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.616+0000 7fcf01e00640 1 --2- 172.21.15.17:0/213650541 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fcee006ac00 0x7fcee006d0c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcef0009a70 tx=0x7fcef0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:19.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.620+0000 7fcef6000640 1 -- 172.21.15.17:0/213650541 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fcef8077280 con 0x7fcefc144240 2024-03-12T17:19:19.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.819+0000 7fcf04800640 1 -- 172.21.15.17:0/213650541 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcefc0cc7e0 con 0x7fcefc144240 2024-03-12T17:19:19.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.820+0000 7fcef6000640 1 -- 172.21.15.17:0/213650541 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15989 (secure 0 0 0) 0x7fcef807a8a0 con 0x7fcefc144240 2024-03-12T17:19:19.816 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:19:19.816 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":21,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:18:46.845635+0000","last_up_change":"2024-03-12T17:18:38.144756+0000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-12T17:18:39.552910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-12T17:18:43.794908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-12T17:18:44.867006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":37305},{"type":"v1","addr":"172.21.15.17:6801","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":37305},{"type":"v1","addr":"172.21.15.17:6803","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":37305},{"type":"v1","addr":"172.21.15.17:6807","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":37305},{"type":"v1","addr":"172.21.15.17:6805","nonce":37305}]},"public_addr":"172.21.15.17:6801/37305","cluster_addr":"172.21.15.17:6803/37305","heartbeat_back_addr":"172.21.15.17:6807/37305","heartbeat_front_addr":"172.21.15.17:6805/37305","state":["exists","up"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":37307},{"type":"v1","addr":"172.21.15.17:6814","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":37307},{"type":"v1","addr":"172.21.15.17:6818","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":37307},{"type":"v1","addr":"172.21.15.17:6827","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":37307},{"type":"v1","addr":"172.21.15.17:6823","nonce":37307}]},"public_addr":"172.21.15.17:6814/37307","cluster_addr":"172.21.15.17:6818/37307","heartbeat_back_addr":"172.21.15.17:6827/37307","heartbeat_front_addr":"172.21.15.17:6823/37307","state":["exists","up"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":37303},{"type":"v1","addr":"172.21.15.17:6809","nonce":37303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":37303},{"type":"v1","addr":"172.21.15.17:6811","nonce":37303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":37303},{"type":"v1","addr":"172.21.15.17:6819","nonce":37303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":37303},{"type":"v1","addr":"172.21.15.17:6815","nonce":37303}]},"public_addr":"172.21.15.17:6809/37303","cluster_addr":"172.21.15.17:6811/37303","heartbeat_back_addr":"172.21.15.17:6819/37303","heartbeat_front_addr":"172.21.15.17:6815/37303","state":["exists","up"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":37308},{"type":"v1","addr":"172.21.15.17:6822","nonce":37308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":37308},{"type":"v1","addr":"172.21.15.17:6826","nonce":37308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":37308},{"type":"v1","addr":"172.21.15.17:6831","nonce":37308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":37308},{"type":"v1","addr":"172.21.15.17:6829","nonce":37308}]},"public_addr":"172.21.15.17:6822/37308","cluster_addr":"172.21.15.17:6826/37308","heartbeat_back_addr":"172.21.15.17:6831/37308","heartbeat_front_addr":"172.21.15.17:6829/37308","state":["exists","up"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":37465},{"type":"v1","addr":"172.21.15.94:6809","nonce":37465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6811","nonce":37465},{"type":"v1","addr":"172.21.15.94:6813","nonce":37465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6819","nonce":37465},{"type":"v1","addr":"172.21.15.94:6822","nonce":37465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6815","nonce":37465},{"type":"v1","addr":"172.21.15.94:6817","nonce":37465}]},"public_addr":"172.21.15.94:6809/37465","cluster_addr":"172.21.15.94:6813/37465","heartbeat_back_addr":"172.21.15.94:6822/37465","heartbeat_front_addr":"172.21.15.94:6817/37465","state":["exists","up"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":37464},{"type":"v1","addr":"172.21.15.94:6812","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":37464},{"type":"v1","addr":"172.21.15.94:6816","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":37464},{"type":"v1","addr":"172.21.15.94:6823","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":37464},{"type":"v1","addr":"172.21.15.94:6820","nonce":37464}]},"public_addr":"172.21.15.94:6812/37464","cluster_addr":"172.21.15.94:6816/37464","heartbeat_back_addr":"172.21.15.94:6823/37464","heartbeat_front_addr":"172.21.15.94:6820/37464","state":["exists","up"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":37467},{"type":"v1","addr":"172.21.15.94:6825","nonce":37467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":37467},{"type":"v1","addr":"172.21.15.94:6827","nonce":37467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":37467},{"type":"v1","addr":"172.21.15.94:6831","nonce":37467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":37467},{"type":"v1","addr":"172.21.15.94:6829","nonce":37467}]},"public_addr":"172.21.15.94:6825/37467","cluster_addr":"172.21.15.94:6827/37467","heartbeat_back_addr":"172.21.15.94:6831/37467","heartbeat_front_addr":"172.21.15.94:6829/37467","state":["exists","up"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":37466},{"type":"v1","addr":"172.21.15.94:6801","nonce":37466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":37466},{"type":"v1","addr":"172.21.15.94:6803","nonce":37466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":37466},{"type":"v1","addr":"172.21.15.94:6807","nonce":37466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":37466},{"type":"v1","addr":"172.21.15.94:6805","nonce":37466}]},"public_addr":"172.21.15.94:6801/37466","cluster_addr":"172.21.15.94:6803/37466","heartbeat_back_addr":"172.21.15.94:6807/37466","heartbeat_front_addr":"172.21.15.94:6805/37466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.327217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.186966+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.419986+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.150585+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.120621+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.121576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.181257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.293188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:19:19.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.823+0000 7fcf04800640 1 -- 172.21.15.17:0/213650541 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fcee006ac00 msgr2=0x7fcee006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:19.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.823+0000 7fcf04800640 1 --2- 172.21.15.17:0/213650541 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fcee006ac00 0x7fcee006d0c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fcef0009a70 tx=0x7fcef0008040 comp rx=0 tx=0).stop 2024-03-12T17:19:19.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.823+0000 7fcf04800640 1 -- 172.21.15.17:0/213650541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcefc144240 msgr2=0x7fcefc13c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:19.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.823+0000 7fcf04800640 1 --2- 172.21.15.17:0/213650541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcefc144240 0x7fcefc13c0d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcef8009e50 tx=0x7fcef8004a40 comp rx=0 tx=0).stop 2024-03-12T17:19:19.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.823+0000 7fcf04800640 1 -- 172.21.15.17:0/213650541 shutdown_connections 2024-03-12T17:19:19.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.823+0000 7fcf04800640 1 --2- 172.21.15.17:0/213650541 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fcee006ac00 0x7fcee006d0c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:19.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.823+0000 7fcf04800640 1 --2- 172.21.15.17:0/213650541 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcefc144240 0x7fcefc13c0d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:19.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.823+0000 7fcf04800640 1 --2- 172.21.15.17:0/213650541 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcefc0cecf0 0x7fcefc13bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:19.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.823+0000 7fcf04800640 1 --2- 172.21.15.17:0/213650541 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcefc0b25b0 0x7fcefc15e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:19.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.823+0000 7fcf04800640 1 -- 172.21.15.17:0/213650541 >> 172.21.15.17:0/213650541 conn(0x7fcefc069ce0 msgr2=0x7fcefc06d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:19.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.823+0000 7fcf04800640 1 -- 172.21.15.17:0/213650541 shutdown_connections 2024-03-12T17:19:19.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:19.823+0000 7fcf04800640 1 -- 172.21.15.17:0/213650541 wait complete. 2024-03-12T17:19:19.839 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-12T17:18:39.552910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-12T17:18:43.794908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-12T17:18:44.867006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-12T17:19:19.839 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-12T17:19:20.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.069+0000 7f9972200640 1 Processor -- start 2024-03-12T17:19:20.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.069+0000 7f9972200640 1 -- start start 2024-03-12T17:19:20.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.070+0000 7f9972200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f996c15ce80 0x7f996c0cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:20.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.070+0000 7f9972200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f996c161650 con 0x7f996c0b85f0 2024-03-12T17:19:20.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.071+0000 7f9972200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f996c161090 con 0x7f996c15caa0 2024-03-12T17:19:20.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.071+0000 7f9972200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f996c160ea0 con 0x7f996c15ce80 2024-03-12T17:19:20.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.071+0000 7f9971800640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f996c0b85f0 0x7f996c0d12d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:47046/0 (socket says 172.21.15.17:47046) 2024-03-12T17:19:20.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.071+0000 7f9971800640 1 -- 172.21.15.17:0/1963708516 learned_addr learned my addr 172.21.15.17:0/1963708516 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:20.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.071+0000 7f9963e00640 1 --2- 172.21.15.17:0/1963708516 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f996c15ce80 0x7f996c0cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:20.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.071+0000 7f996be00640 1 -- 172.21.15.17:0/1963708516 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 829652066 0 0) 0x7f996c161650 con 0x7f996c0b85f0 2024-03-12T17:19:20.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.071+0000 7f996be00640 1 -- 172.21.15.17:0/1963708516 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f994c003520 con 0x7f996c0b85f0 2024-03-12T17:19:20.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.072+0000 7f996be00640 1 -- 172.21.15.17:0/1963708516 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 550867506 0 0) 0x7f996c161090 con 0x7f996c15caa0 2024-03-12T17:19:20.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.072+0000 7f996be00640 1 -- 172.21.15.17:0/1963708516 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f996c161650 con 0x7f996c15caa0 2024-03-12T17:19:20.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.072+0000 7f996be00640 1 -- 172.21.15.17:0/1963708516 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2685720628 0 0) 0x7f994c003520 con 0x7f996c0b85f0 2024-03-12T17:19:20.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.072+0000 7f996be00640 1 -- 172.21.15.17:0/1963708516 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f996c15ce80 msgr2=0x7f996c0cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:20.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.072+0000 7f996be00640 1 --2- 172.21.15.17:0/1963708516 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f996c15ce80 0x7f996c0cf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:20.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.072+0000 7f996be00640 1 -- 172.21.15.17:0/1963708516 >> v1:172.21.15.94:6789/0 conn(0x7f996c15caa0 legacy=0x7f996c160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:20.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.072+0000 7f996be00640 1 -- 172.21.15.17:0/1963708516 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f996c161370 con 0x7f996c0b85f0 2024-03-12T17:19:20.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.072+0000 7f996be00640 1 -- 172.21.15.17:0/1963708516 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7f99640019f0 con 0x7f996c0b85f0 2024-03-12T17:19:20.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.072+0000 7f996be00640 1 -- 172.21.15.17:0/1963708516 >> v1:172.21.15.17:6789/0 conn(0x7f996c0b85f0 legacy=0x7f996c0d12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:20.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.072+0000 7f996be00640 1 --2- 172.21.15.17:0/1963708516 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f996c15ce80 0x7f994c003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:20.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.072+0000 7f996be00640 1 --2- 172.21.15.17:0/1963708516 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f994c0040e0 0x7f994c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:20.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.072+0000 7f996be00640 1 --2- 172.21.15.17:0/1963708516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f994c004d00 0x7f994c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:20.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.072+0000 7f996be00640 1 -- 172.21.15.17:0/1963708516 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994c00ba90 con 0x7f994c004d00 2024-03-12T17:19:20.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.072+0000 7f996be00640 1 -- 172.21.15.17:0/1963708516 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994c00bc00 con 0x7f994c0040e0 2024-03-12T17:19:20.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.072+0000 7f996be00640 1 -- 172.21.15.17:0/1963708516 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f994c00bdc0 con 0x7f996c15ce80 2024-03-12T17:19:20.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.072+0000 7f9971800640 1 --2- 172.21.15.17:0/1963708516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f994c004d00 0x7f994c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:20.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.073+0000 7f9963e00640 1 --2- 172.21.15.17:0/1963708516 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f994c0040e0 0x7f994c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:20.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.073+0000 7f9970e00640 1 --2- 172.21.15.17:0/1963708516 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f996c15ce80 0x7f994c003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:20.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.073+0000 7f9971800640 1 -- 172.21.15.17:0/1963708516 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f996c15ce80 msgr2=0x7f994c003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:20.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.073+0000 7f9971800640 1 --2- 172.21.15.17:0/1963708516 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f996c15ce80 0x7f994c003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:20.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.073+0000 7f9971800640 1 -- 172.21.15.17:0/1963708516 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f994c0040e0 msgr2=0x7f994c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:20.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.073+0000 7f9971800640 1 --2- 172.21.15.17:0/1963708516 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f994c0040e0 0x7f994c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:20.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.073+0000 7f9971800640 1 -- 172.21.15.17:0/1963708516 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f994c003520 con 0x7f994c004d00 2024-03-12T17:19:20.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.074+0000 7f9971800640 1 --2- 172.21.15.17:0/1963708516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f994c004d00 0x7f994c005180 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f996400a710 tx=0x7f994c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d423df80adc0c6bc server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:20.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.074+0000 7f996be00640 1 -- 172.21.15.17:0/1963708516 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9964034630 con 0x7f994c004d00 2024-03-12T17:19:20.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.074+0000 7f996be00640 1 -- 172.21.15.17:0/1963708516 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f996402f070 con 0x7f994c004d00 2024-03-12T17:19:20.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.074+0000 7f996be00640 1 -- 172.21.15.17:0/1963708516 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9964034a50 con 0x7f994c004d00 2024-03-12T17:19:20.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.075+0000 7f9972200640 1 -- 172.21.15.17:0/1963708516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f994c004d00 msgr2=0x7f994c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:20.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.075+0000 7f9972200640 1 --2- 172.21.15.17:0/1963708516 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f994c004d00 0x7f994c005180 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f996400a710 tx=0x7f994c0057f0 comp rx=0 tx=0).stop 2024-03-12T17:19:20.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.075+0000 7f9971800640 1 -- 172.21.15.17:0/1963708516 reap_dead start 2024-03-12T17:19:20.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.075+0000 7f9972200640 1 -- 172.21.15.17:0/1963708516 shutdown_connections 2024-03-12T17:19:20.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.075+0000 7f9972200640 1 -- 172.21.15.17:0/1963708516 >> 172.21.15.17:0/1963708516 conn(0x7f996c06b160 msgr2=0x7f996c06b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:20.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.075+0000 7f9972200640 1 -- 172.21.15.17:0/1963708516 shutdown_connections 2024-03-12T17:19:20.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.075+0000 7f9972200640 1 -- 172.21.15.17:0/1963708516 wait complete. 2024-03-12T17:19:20.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.077+0000 7f9972200640 1 Processor -- start 2024-03-12T17:19:20.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.077+0000 7f9972200640 1 -- start start 2024-03-12T17:19:20.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.078+0000 7f9972200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f994c004d00 0x7f996c150da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:20.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.078+0000 7f9972200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f996c0c9aa0 0x7f996c0c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:20.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.078+0000 7f9972200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f996c0c7740 0x7f996c0c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:20.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.078+0000 7f9972200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996c0c7320 con 0x7f996c0c9aa0 2024-03-12T17:19:20.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.078+0000 7f9972200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f996c0c8100 con 0x7f996c0c7740 2024-03-12T17:19:20.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.078+0000 7f9972200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f996c0c6450 con 0x7f994c004d00 2024-03-12T17:19:20.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.078+0000 7f9963e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f996c0c9aa0 0x7f996c0c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:20.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.078+0000 7f9963e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f996c0c9aa0 0x7f996c0c9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38564/0 (socket says 172.21.15.17:38564) 2024-03-12T17:19:20.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.078+0000 7f9963e00640 1 -- 172.21.15.17:0/3570179961 learned_addr learned my addr 172.21.15.17:0/3570179961 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:20.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.079+0000 7f9971800640 1 --2- 172.21.15.17:0/3570179961 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f996c0c7740 0x7f996c0c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:20.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.079+0000 7f9963e00640 1 -- 172.21.15.17:0/3570179961 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f994c004d00 msgr2=0x7f996c150da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:20.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.079+0000 7f9963e00640 1 --2- 172.21.15.17:0/3570179961 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f994c004d00 0x7f996c150da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:20.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.079+0000 7f9963e00640 1 -- 172.21.15.17:0/3570179961 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f996c0c7740 msgr2=0x7f996c0c7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:20.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.079+0000 7f9963e00640 1 --2- 172.21.15.17:0/3570179961 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f996c0c7740 0x7f996c0c7bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:20.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.079+0000 7f9963e00640 1 -- 172.21.15.17:0/3570179961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f996c0c66a0 con 0x7f996c0c9aa0 2024-03-12T17:19:20.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.079+0000 7f9963e00640 1 --2- 172.21.15.17:0/3570179961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f996c0c9aa0 0x7f996c0c9f00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f995c011940 tx=0x7f995c011e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:20.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.079+0000 7f9969600640 1 -- 172.21.15.17:0/3570179961 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c004240 con 0x7f996c0c9aa0 2024-03-12T17:19:20.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.079+0000 7f9969600640 1 -- 172.21.15.17:0/3570179961 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f995c0043a0 con 0x7f996c0c9aa0 2024-03-12T17:19:20.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.079+0000 7f9969600640 1 -- 172.21.15.17:0/3570179961 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f995c00fb20 con 0x7f996c0c9aa0 2024-03-12T17:19:20.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.080+0000 7f9972200640 1 -- 172.21.15.17:0/3570179961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f996c0c6980 con 0x7f996c0c9aa0 2024-03-12T17:19:20.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.080+0000 7f9972200640 1 -- 172.21.15.17:0/3570179961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f996c0c6f40 con 0x7f996c0c9aa0 2024-03-12T17:19:20.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.081+0000 7f9972200640 1 -- 172.21.15.17:0/3570179961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f996c072360 con 0x7f996c0c9aa0 2024-03-12T17:19:20.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.082+0000 7f9969600640 1 -- 172.21.15.17:0/3570179961 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f995c00fc80 con 0x7f996c0c9aa0 2024-03-12T17:19:20.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.083+0000 7f9969600640 1 --2- 172.21.15.17:0/3570179961 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f994806ac00 0x7f994806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:20.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.083+0000 7f9969600640 1 -- 172.21.15.17:0/3570179961 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f995c089af0 con 0x7f996c0c9aa0 2024-03-12T17:19:20.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.083+0000 7f9970e00640 1 --2- 172.21.15.17:0/3570179961 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f994806ac00 0x7f994806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:20.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.084+0000 7f9970e00640 1 --2- 172.21.15.17:0/3570179961 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f994806ac00 0x7f994806d0c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f99540079a0 tx=0x7f9954009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:20.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.088+0000 7f9969600640 1 -- 172.21.15.17:0/3570179961 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f995c054c30 con 0x7f996c0c9aa0 2024-03-12T17:19:20.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.287+0000 7f9972200640 1 -- 172.21.15.17:0/3570179961 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f996c04e030 con 0x7f996c0c9aa0 2024-03-12T17:19:20.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.288+0000 7f9969600640 1 -- 172.21.15.17:0/3570179961 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f995c0230a0 con 0x7f996c0c9aa0 2024-03-12T17:19:20.283 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-03-12T17:19:20.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.291+0000 7f9972200640 1 -- 172.21.15.17:0/3570179961 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f994806ac00 msgr2=0x7f994806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:20.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.291+0000 7f9972200640 1 --2- 172.21.15.17:0/3570179961 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f994806ac00 0x7f994806d0c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f99540079a0 tx=0x7f9954009040 comp rx=0 tx=0).stop 2024-03-12T17:19:20.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.291+0000 7f9972200640 1 -- 172.21.15.17:0/3570179961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f996c0c9aa0 msgr2=0x7f996c0c9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:20.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.291+0000 7f9972200640 1 --2- 172.21.15.17:0/3570179961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f996c0c9aa0 0x7f996c0c9f00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f995c011940 tx=0x7f995c011e00 comp rx=0 tx=0).stop 2024-03-12T17:19:20.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.291+0000 7f9972200640 1 -- 172.21.15.17:0/3570179961 shutdown_connections 2024-03-12T17:19:20.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.291+0000 7f9972200640 1 --2- 172.21.15.17:0/3570179961 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f994806ac00 0x7f994806d0c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:20.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.291+0000 7f9972200640 1 --2- 172.21.15.17:0/3570179961 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f996c0c7740 0x7f996c0c7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:20.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.291+0000 7f9972200640 1 --2- 172.21.15.17:0/3570179961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f996c0c9aa0 0x7f996c0c9f00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:20.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.291+0000 7f9972200640 1 --2- 172.21.15.17:0/3570179961 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f994c004d00 0x7f996c150da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:20.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.291+0000 7f9972200640 1 -- 172.21.15.17:0/3570179961 >> 172.21.15.17:0/3570179961 conn(0x7f996c06b160 msgr2=0x7f996c1608b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:20.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.291+0000 7f9972200640 1 -- 172.21.15.17:0/3570179961 shutdown_connections 2024-03-12T17:19:20.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.291+0000 7f9972200640 1 -- 172.21.15.17:0/3570179961 wait complete. 2024-03-12T17:19:20.305 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-12T17:19:20.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.534+0000 7f2979000640 1 Processor -- start 2024-03-12T17:19:20.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.534+0000 7f2979000640 1 -- start start 2024-03-12T17:19:20.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.536+0000 7f2979000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2974144240 0x7f29740ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:20.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.536+0000 7f2979000640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29740ce320 con 0x7f29740cb970 2024-03-12T17:19:20.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.536+0000 7f2979000640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2974144620 con 0x7f29740cecf0 2024-03-12T17:19:20.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.536+0000 7f2979000640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f297415f3d0 con 0x7f2974144240 2024-03-12T17:19:20.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.536+0000 7f2971e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2974144240 0x7f29740ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:20.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.536+0000 7f2972800640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f29740cb970 0x7f297415e670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:47058/0 (socket says 172.21.15.17:47058) 2024-03-12T17:19:20.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.536+0000 7f2972800640 1 -- 172.21.15.17:0/4233539585 learned_addr learned my addr 172.21.15.17:0/4233539585 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:20.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.537+0000 7f2971e00640 1 -- 172.21.15.17:0/4233539585 >> v1:172.21.15.94:6789/0 conn(0x7f29740cecf0 legacy=0x7f29740b2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:20.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.537+0000 7f2971e00640 1 -- 172.21.15.17:0/4233539585 >> v1:172.21.15.17:6789/0 conn(0x7f29740cb970 legacy=0x7f297415e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:20.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.537+0000 7f2971e00640 1 -- 172.21.15.17:0/4233539585 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29740cd9f0 con 0x7f2974144240 2024-03-12T17:19:20.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.538+0000 7f2971e00640 1 --2- 172.21.15.17:0/4233539585 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2974144240 0x7f29740ce7b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f29640097a0 tx=0x7f296402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78bef6e81f8e1ccf server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:20.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.538+0000 7f2971400640 1 -- 172.21.15.17:0/4233539585 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2964031830 con 0x7f2974144240 2024-03-12T17:19:20.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.539+0000 7f2971400640 1 -- 172.21.15.17:0/4233539585 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2964031990 con 0x7f2974144240 2024-03-12T17:19:20.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.539+0000 7f2971400640 1 -- 172.21.15.17:0/4233539585 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2964031d20 con 0x7f2974144240 2024-03-12T17:19:20.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.539+0000 7f2979000640 1 -- 172.21.15.17:0/4233539585 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2974144240 msgr2=0x7f29740ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:20.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.539+0000 7f2979000640 1 --2- 172.21.15.17:0/4233539585 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2974144240 0x7f29740ce7b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f29640097a0 tx=0x7f296402b8d0 comp rx=0 tx=0).stop 2024-03-12T17:19:20.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.539+0000 7f2979000640 1 -- 172.21.15.17:0/4233539585 shutdown_connections 2024-03-12T17:19:20.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.539+0000 7f2979000640 1 --2- 172.21.15.17:0/4233539585 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2974144240 0x7f29740ce7b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:20.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.539+0000 7f2979000640 1 -- 172.21.15.17:0/4233539585 >> 172.21.15.17:0/4233539585 conn(0x7f2974069ce0 msgr2=0x7f297406a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:20.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.539+0000 7f2979000640 1 -- 172.21.15.17:0/4233539585 shutdown_connections 2024-03-12T17:19:20.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.539+0000 7f2979000640 1 -- 172.21.15.17:0/4233539585 wait complete. 2024-03-12T17:19:20.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.541+0000 7f2979000640 1 Processor -- start 2024-03-12T17:19:20.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.541+0000 7f2979000640 1 -- start start 2024-03-12T17:19:20.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.542+0000 7f2979000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29740cb970 0x7f297415c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:20.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.542+0000 7f2979000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29740cecf0 0x7f297415ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:20.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.542+0000 7f2979000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2974144240 0x7f2974138e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:20.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.542+0000 7f2979000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2974141170 con 0x7f29740cecf0 2024-03-12T17:19:20.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.542+0000 7f2979000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297415c670 con 0x7f29740cb970 2024-03-12T17:19:20.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.542+0000 7f2979000640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f297415c950 con 0x7f2974144240 2024-03-12T17:19:20.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.542+0000 7f2969400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29740cecf0 0x7f297415ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:20.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.542+0000 7f2969400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29740cecf0 0x7f297415ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38584/0 (socket says 172.21.15.17:38584) 2024-03-12T17:19:20.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.542+0000 7f2969400640 1 -- 172.21.15.17:0/4042715907 learned_addr learned my addr 172.21.15.17:0/4042715907 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:20.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.543+0000 7f2971e00640 1 --2- 172.21.15.17:0/4042715907 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29740cb970 0x7f297415c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:20.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.543+0000 7f2969400640 1 -- 172.21.15.17:0/4042715907 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2974144240 msgr2=0x7f2974138e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:20.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.543+0000 7f2969400640 1 --2- 172.21.15.17:0/4042715907 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2974144240 0x7f2974138e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:20.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.543+0000 7f2969400640 1 -- 172.21.15.17:0/4042715907 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29740cb970 msgr2=0x7f297415c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:20.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.543+0000 7f2969400640 1 --2- 172.21.15.17:0/4042715907 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29740cb970 0x7f297415c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:20.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.543+0000 7f2969400640 1 -- 172.21.15.17:0/4042715907 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2964009400 con 0x7f29740cecf0 2024-03-12T17:19:20.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.543+0000 7f2971e00640 1 --2- 172.21.15.17:0/4042715907 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29740cb970 0x7f297415c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:20.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.543+0000 7f2969400640 1 --2- 172.21.15.17:0/4042715907 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29740cecf0 0x7f297415ed40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f295c00c430 tx=0x7f295c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:20.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.543+0000 7f296aa00640 1 -- 172.21.15.17:0/4042715907 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c011790 con 0x7f29740cecf0 2024-03-12T17:19:20.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.543+0000 7f296aa00640 1 -- 172.21.15.17:0/4042715907 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f295c0118f0 con 0x7f29740cecf0 2024-03-12T17:19:20.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.543+0000 7f296aa00640 1 -- 172.21.15.17:0/4042715907 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c011ce0 con 0x7f29740cecf0 2024-03-12T17:19:20.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.543+0000 7f2979000640 1 -- 172.21.15.17:0/4042715907 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f297415cc30 con 0x7f29740cecf0 2024-03-12T17:19:20.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.544+0000 7f2979000640 1 -- 172.21.15.17:0/4042715907 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f297415d1f0 con 0x7f29740cecf0 2024-03-12T17:19:20.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.545+0000 7f2979000640 1 -- 172.21.15.17:0/4042715907 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29740736c0 con 0x7f29740cecf0 2024-03-12T17:19:20.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.545+0000 7f296aa00640 1 -- 172.21.15.17:0/4042715907 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f295c01c460 con 0x7f29740cecf0 2024-03-12T17:19:20.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.546+0000 7f296aa00640 1 --2- 172.21.15.17:0/4042715907 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f295006ac00 0x7f295006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:20.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.546+0000 7f296aa00640 1 -- 172.21.15.17:0/4042715907 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f295c0893e0 con 0x7f29740cecf0 2024-03-12T17:19:20.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.547+0000 7f2971e00640 1 --2- 172.21.15.17:0/4042715907 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f295006ac00 0x7f295006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:20.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.547+0000 7f2971e00640 1 --2- 172.21.15.17:0/4042715907 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f295006ac00 0x7f295006d0c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2964036000 tx=0x7f296403c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:20.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.551+0000 7f296aa00640 1 -- 172.21.15.17:0/4042715907 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f295c054490 con 0x7f29740cecf0 2024-03-12T17:19:20.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.748+0000 7f2979000640 1 -- 172.21.15.17:0/4042715907 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f29740b3840 con 0x7f29740cecf0 2024-03-12T17:19:20.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.749+0000 7f296aa00640 1 -- 172.21.15.17:0/4042715907 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f295c057ab0 con 0x7f29740cecf0 2024-03-12T17:19:20.744 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-03-12T17:19:20.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.751+0000 7f2979000640 1 -- 172.21.15.17:0/4042715907 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f295006ac00 msgr2=0x7f295006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:20.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.751+0000 7f2979000640 1 --2- 172.21.15.17:0/4042715907 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f295006ac00 0x7f295006d0c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2964036000 tx=0x7f296403c040 comp rx=0 tx=0).stop 2024-03-12T17:19:20.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.751+0000 7f2979000640 1 -- 172.21.15.17:0/4042715907 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29740cecf0 msgr2=0x7f297415ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:20.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.751+0000 7f2979000640 1 --2- 172.21.15.17:0/4042715907 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29740cecf0 0x7f297415ed40 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f295c00c430 tx=0x7f295c00c8f0 comp rx=0 tx=0).stop 2024-03-12T17:19:20.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.751+0000 7f2979000640 1 -- 172.21.15.17:0/4042715907 shutdown_connections 2024-03-12T17:19:20.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.751+0000 7f2979000640 1 --2- 172.21.15.17:0/4042715907 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f295006ac00 0x7f295006d0c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:20.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.751+0000 7f2979000640 1 --2- 172.21.15.17:0/4042715907 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2974144240 0x7f2974138e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:20.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.751+0000 7f2979000640 1 --2- 172.21.15.17:0/4042715907 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29740cecf0 0x7f297415ed40 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:20.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.752+0000 7f2979000640 1 --2- 172.21.15.17:0/4042715907 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29740cb970 0x7f297415c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:20.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.752+0000 7f2979000640 1 -- 172.21.15.17:0/4042715907 >> 172.21.15.17:0/4042715907 conn(0x7f2974069ce0 msgr2=0x7f29740b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:20.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.752+0000 7f2979000640 1 -- 172.21.15.17:0/4042715907 shutdown_connections 2024-03-12T17:19:20.748 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.752+0000 7f2979000640 1 -- 172.21.15.17:0/4042715907 wait complete. 2024-03-12T17:19:20.768 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-12T17:19:20.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.996+0000 7f85f9a00640 1 Processor -- start 2024-03-12T17:19:20.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.996+0000 7f85f9a00640 1 -- start start 2024-03-12T17:19:20.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.998+0000 7f85f9a00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f85f40b3710 0x7f85f4159d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:20.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.998+0000 7f85f9a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f85f40d01e0 0x7f85f415a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:20.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.998+0000 7f85f9a00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f415ad20 con 0x7f85f41507d0 2024-03-12T17:19:20.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.998+0000 7f85f9a00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f40cfd50 con 0x7f85f40b3710 2024-03-12T17:19:20.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.998+0000 7f85f9a00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f415a790 con 0x7f85f40d01e0 2024-03-12T17:19:20.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.998+0000 7f85f3e00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f85f41507d0 0x7f85f40b3000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:47060/0 (socket says 172.21.15.17:47060) 2024-03-12T17:19:20.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.998+0000 7f85f3e00640 1 -- 172.21.15.17:0/3323579419 learned_addr learned my addr 172.21.15.17:0/3323579419 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:20.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.998+0000 7f85f3400640 1 --2- 172.21.15.17:0/3323579419 >> v2:172.21.15.94:3300/0 conn(0x7f85f40b3710 0x7f85f4159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:20.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.999+0000 7f85f9000640 1 --2- 172.21.15.17:0/3323579419 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f85f40d01e0 0x7f85f415a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:20.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.999+0000 7f85f2a00640 1 -- 172.21.15.17:0/3323579419 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 189263027 0 0) 0x7f85f415ad20 con 0x7f85f41507d0 2024-03-12T17:19:20.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.999+0000 7f85f2a00640 1 -- 172.21.15.17:0/3323579419 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85d8003520 con 0x7f85f41507d0 2024-03-12T17:19:20.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.999+0000 7f85f3400640 1 -- 172.21.15.17:0/3323579419 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f85f40d01e0 msgr2=0x7f85f415a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:20.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.999+0000 7f85f3400640 1 --2- 172.21.15.17:0/3323579419 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f85f40d01e0 0x7f85f415a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:20.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.999+0000 7f85f2a00640 1 -- 172.21.15.17:0/3323579419 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4049799044 0 0) 0x7f85d8003520 con 0x7f85f41507d0 2024-03-12T17:19:20.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.999+0000 7f85f3400640 1 -- 172.21.15.17:0/3323579419 >> v1:172.21.15.17:6789/0 conn(0x7f85f41507d0 legacy=0x7f85f40b3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:20.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:20.999+0000 7f85f3400640 1 -- 172.21.15.17:0/3323579419 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f415aa40 con 0x7f85f40b3710 2024-03-12T17:19:20.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.001+0000 7f85f3400640 1 --2- 172.21.15.17:0/3323579419 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f85f40b3710 0x7f85f4159d10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f85e00097a0 tx=0x7f85e002b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=675a3d548d79aa2f server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:20.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.002+0000 7f85f2a00640 1 -- 172.21.15.17:0/3323579419 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e4001690 con 0x7f85f40b3710 2024-03-12T17:19:20.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.002+0000 7f85f2a00640 1 -- 172.21.15.17:0/3323579419 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e002e050 con 0x7f85f40b3710 2024-03-12T17:19:20.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.002+0000 7f85f2a00640 1 -- 172.21.15.17:0/3323579419 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e0030730 con 0x7f85f40b3710 2024-03-12T17:19:20.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.002+0000 7f85f9a00640 1 -- 172.21.15.17:0/3323579419 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f85f40b3710 msgr2=0x7f85f4159d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:20.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.002+0000 7f85f9a00640 1 --2- 172.21.15.17:0/3323579419 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f85f40b3710 0x7f85f4159d10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f85e00097a0 tx=0x7f85e002b710 comp rx=0 tx=0).stop 2024-03-12T17:19:20.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.002+0000 7f85f9a00640 1 -- 172.21.15.17:0/3323579419 shutdown_connections 2024-03-12T17:19:20.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.002+0000 7f85f9a00640 1 --2- 172.21.15.17:0/3323579419 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f85f40d01e0 0x7f85f415a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:20.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.002+0000 7f85f9a00640 1 --2- 172.21.15.17:0/3323579419 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f85f40b3710 0x7f85f4159d10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:20.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.002+0000 7f85f9a00640 1 -- 172.21.15.17:0/3323579419 >> 172.21.15.17:0/3323579419 conn(0x7f85f4098a60 msgr2=0x7f85f40b4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:20.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.003+0000 7f85f9a00640 1 -- 172.21.15.17:0/3323579419 shutdown_connections 2024-03-12T17:19:20.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.003+0000 7f85f9a00640 1 -- 172.21.15.17:0/3323579419 wait complete. 2024-03-12T17:19:20.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.004+0000 7f85f9a00640 1 Processor -- start 2024-03-12T17:19:20.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.004+0000 7f85f9a00640 1 -- start start 2024-03-12T17:19:21.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.005+0000 7f85f9a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85f40b3710 0x7f85f409c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:21.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.005+0000 7f85f9a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f85f40d01e0 0x7f85f409ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:21.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.005+0000 7f85f9a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f85f41507d0 0x7f85f414bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:21.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.005+0000 7f85f9a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f414c010 con 0x7f85f40b3710 2024-03-12T17:19:21.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.005+0000 7f85f9a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f409cb60 con 0x7f85f41507d0 2024-03-12T17:19:21.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.005+0000 7f85f9a00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f409ce40 con 0x7f85f40d01e0 2024-03-12T17:19:21.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.006+0000 7f85f3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85f40b3710 0x7f85f409c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:21.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.006+0000 7f85f3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85f40b3710 0x7f85f409c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38590/0 (socket says 172.21.15.17:38590) 2024-03-12T17:19:21.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.006+0000 7f85f3e00640 1 -- 172.21.15.17:0/1398445179 learned_addr learned my addr 172.21.15.17:0/1398445179 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:21.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.006+0000 7f85f9000640 1 --2- 172.21.15.17:0/1398445179 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f85f41507d0 0x7f85f414bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:21.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.006+0000 7f85f3400640 1 --2- 172.21.15.17:0/1398445179 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f85f40d01e0 0x7f85f409ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:21.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.006+0000 7f85f3e00640 1 -- 172.21.15.17:0/1398445179 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f85f40d01e0 msgr2=0x7f85f409ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:21.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.006+0000 7f85f3e00640 1 --2- 172.21.15.17:0/1398445179 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f85f40d01e0 0x7f85f409ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:21.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.006+0000 7f85f3e00640 1 -- 172.21.15.17:0/1398445179 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f85f41507d0 msgr2=0x7f85f414bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:21.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.006+0000 7f85f3e00640 1 --2- 172.21.15.17:0/1398445179 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f85f41507d0 0x7f85f414bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:21.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.006+0000 7f85f3e00640 1 -- 172.21.15.17:0/1398445179 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e0009400 con 0x7f85f40b3710 2024-03-12T17:19:21.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.006+0000 7f85f9000640 1 --2- 172.21.15.17:0/1398445179 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f85f41507d0 0x7f85f414bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:19:21.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.007+0000 7f85f3e00640 1 --2- 172.21.15.17:0/1398445179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85f40b3710 0x7f85f409c530 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f85e4001200 tx=0x7f85e400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:21.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.007+0000 7f85ebe00640 1 -- 172.21.15.17:0/1398445179 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e40072d0 con 0x7f85f40b3710 2024-03-12T17:19:21.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.007+0000 7f85ebe00640 1 -- 172.21.15.17:0/1398445179 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e4007430 con 0x7f85f40b3710 2024-03-12T17:19:21.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.007+0000 7f85ebe00640 1 -- 172.21.15.17:0/1398445179 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e4004a20 con 0x7f85f40b3710 2024-03-12T17:19:21.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.007+0000 7f85f9a00640 1 -- 172.21.15.17:0/1398445179 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85f409d120 con 0x7f85f40b3710 2024-03-12T17:19:21.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.007+0000 7f85f9a00640 1 -- 172.21.15.17:0/1398445179 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f414c3d0 con 0x7f85f40b3710 2024-03-12T17:19:21.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.009+0000 7f85f9a00640 1 -- 172.21.15.17:0/1398445179 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85f404e030 con 0x7f85f40b3710 2024-03-12T17:19:21.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.010+0000 7f85ebe00640 1 -- 172.21.15.17:0/1398445179 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f85e4004b80 con 0x7f85f40b3710 2024-03-12T17:19:21.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.011+0000 7f85ebe00640 1 --2- 172.21.15.17:0/1398445179 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f85d406ac00 0x7f85d406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:21.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.011+0000 7f85ebe00640 1 -- 172.21.15.17:0/1398445179 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f85e4088690 con 0x7f85f40b3710 2024-03-12T17:19:21.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.011+0000 7f85f3400640 1 --2- 172.21.15.17:0/1398445179 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f85d406ac00 0x7f85d406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:21.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.012+0000 7f85f3400640 1 --2- 172.21.15.17:0/1398445179 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f85d406ac00 0x7f85d406d0c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f85e0034000 tx=0x7f85e0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:21.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.016+0000 7f85ebe00640 1 -- 172.21.15.17:0/1398445179 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f85e4053860 con 0x7f85f40b3710 2024-03-12T17:19:21.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.213+0000 7f85f9a00640 1 -- 172.21.15.17:0/1398445179 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f85f4165250 con 0x7f85f40b3710 2024-03-12T17:19:21.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.214+0000 7f85ebe00640 1 -- 172.21.15.17:0/1398445179 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f85e4056e80 con 0x7f85f40b3710 2024-03-12T17:19:21.209 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-03-12T17:19:21.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.216+0000 7f85f9a00640 1 -- 172.21.15.17:0/1398445179 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f85d406ac00 msgr2=0x7f85d406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:21.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.216+0000 7f85f9a00640 1 --2- 172.21.15.17:0/1398445179 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f85d406ac00 0x7f85d406d0c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f85e0034000 tx=0x7f85e0008030 comp rx=0 tx=0).stop 2024-03-12T17:19:21.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.216+0000 7f85f9a00640 1 -- 172.21.15.17:0/1398445179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85f40b3710 msgr2=0x7f85f409c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:21.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.216+0000 7f85f9a00640 1 --2- 172.21.15.17:0/1398445179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85f40b3710 0x7f85f409c530 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f85e4001200 tx=0x7f85e400cbe0 comp rx=0 tx=0).stop 2024-03-12T17:19:21.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.216+0000 7f85f9a00640 1 -- 172.21.15.17:0/1398445179 shutdown_connections 2024-03-12T17:19:21.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.216+0000 7f85f9a00640 1 --2- 172.21.15.17:0/1398445179 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f85d406ac00 0x7f85d406d0c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:21.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.216+0000 7f85f9a00640 1 --2- 172.21.15.17:0/1398445179 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f85f41507d0 0x7f85f414bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:21.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.216+0000 7f85f9a00640 1 --2- 172.21.15.17:0/1398445179 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f85f40d01e0 0x7f85f409ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:21.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.216+0000 7f85f9a00640 1 --2- 172.21.15.17:0/1398445179 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85f40b3710 0x7f85f409c530 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:21.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.216+0000 7f85f9a00640 1 -- 172.21.15.17:0/1398445179 >> 172.21.15.17:0/1398445179 conn(0x7f85f4098a60 msgr2=0x7f85f415b330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:21.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.216+0000 7f85f9a00640 1 -- 172.21.15.17:0/1398445179 shutdown_connections 2024-03-12T17:19:21.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.216+0000 7f85f9a00640 1 -- 172.21.15.17:0/1398445179 wait complete. 2024-03-12T17:19:21.232 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T17:19:21.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.460+0000 7fb82ba00640 1 Processor -- start 2024-03-12T17:19:21.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.460+0000 7fb82ba00640 1 -- start start 2024-03-12T17:19:21.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.462+0000 7fb82ba00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb82415ccc0 0x7fb82415dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:21.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.462+0000 7fb82ba00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb8240b4210 0x7fb824069ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:21.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.462+0000 7fb82ba00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8240b2620 con 0x7fb82406a220 2024-03-12T17:19:21.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.462+0000 7fb82ba00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb82415e230 con 0x7fb82415ccc0 2024-03-12T17:19:21.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.462+0000 7fb82ba00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb82406a690 con 0x7fb8240b4210 2024-03-12T17:19:21.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.462+0000 7fb829a00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fb82406a220 0x7fb824160860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:47072/0 (socket says 172.21.15.17:47072) 2024-03-12T17:19:21.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.462+0000 7fb829a00640 1 -- 172.21.15.17:0/3897692058 learned_addr learned my addr 172.21.15.17:0/3897692058 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:21.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.462+0000 7fb829000640 1 --2- 172.21.15.17:0/3897692058 >> v2:172.21.15.17:3300/0 conn(0x7fb82415ccc0 0x7fb82415dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:21.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.463+0000 7fb81be00640 1 --2- 172.21.15.17:0/3897692058 >> v2:172.21.15.94:3300/0 conn(0x7fb8240b4210 0x7fb824069ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:21.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.463+0000 7fb823e00640 1 -- 172.21.15.17:0/3897692058 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2677321682 0 0) 0x7fb8240b2620 con 0x7fb82406a220 2024-03-12T17:19:21.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.463+0000 7fb823e00640 1 -- 172.21.15.17:0/3897692058 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb808003520 con 0x7fb82406a220 2024-03-12T17:19:21.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.463+0000 7fb829000640 1 -- 172.21.15.17:0/3897692058 >> v2:172.21.15.94:3300/0 conn(0x7fb8240b4210 msgr2=0x7fb824069ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:21.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.463+0000 7fb829000640 1 --2- 172.21.15.17:0/3897692058 >> v2:172.21.15.94:3300/0 conn(0x7fb8240b4210 0x7fb824069ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:21.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.463+0000 7fb829000640 1 -- 172.21.15.17:0/3897692058 >> v1:172.21.15.17:6789/0 conn(0x7fb82406a220 legacy=0x7fb824160860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:21.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.463+0000 7fb829000640 1 -- 172.21.15.17:0/3897692058 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8240ac600 con 0x7fb82415ccc0 2024-03-12T17:19:21.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.464+0000 7fb829000640 1 --2- 172.21.15.17:0/3897692058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb82415ccc0 0x7fb82415dcf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb8140097a0 tx=0x7fb81402b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd34ee26c72d9b8b server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:21.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.465+0000 7fb823e00640 1 -- 172.21.15.17:0/3897692058 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81402f050 con 0x7fb82415ccc0 2024-03-12T17:19:21.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.465+0000 7fb823e00640 1 -- 172.21.15.17:0/3897692058 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb814031700 con 0x7fb82415ccc0 2024-03-12T17:19:21.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.465+0000 7fb823e00640 1 -- 172.21.15.17:0/3897692058 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb814031a70 con 0x7fb82415ccc0 2024-03-12T17:19:21.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.465+0000 7fb82ba00640 1 -- 172.21.15.17:0/3897692058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb82415ccc0 msgr2=0x7fb82415dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:21.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.465+0000 7fb82ba00640 1 --2- 172.21.15.17:0/3897692058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb82415ccc0 0x7fb82415dcf0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb8140097a0 tx=0x7fb81402b7a0 comp rx=0 tx=0).stop 2024-03-12T17:19:21.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.465+0000 7fb82ba00640 1 -- 172.21.15.17:0/3897692058 shutdown_connections 2024-03-12T17:19:21.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.465+0000 7fb82ba00640 1 --2- 172.21.15.17:0/3897692058 >> v2:172.21.15.94:3300/0 conn(0x7fb8240b4210 0x7fb824069ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:21.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.465+0000 7fb82ba00640 1 --2- 172.21.15.17:0/3897692058 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb82415ccc0 0x7fb82415dcf0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:21.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.465+0000 7fb82ba00640 1 -- 172.21.15.17:0/3897692058 >> 172.21.15.17:0/3897692058 conn(0x7fb824098a60 msgr2=0x7fb8240b4b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:21.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.466+0000 7fb82ba00640 1 -- 172.21.15.17:0/3897692058 shutdown_connections 2024-03-12T17:19:21.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.466+0000 7fb82ba00640 1 -- 172.21.15.17:0/3897692058 wait complete. 2024-03-12T17:19:21.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.467+0000 7fb82ba00640 1 Processor -- start 2024-03-12T17:19:21.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.467+0000 7fb82ba00640 1 -- start start 2024-03-12T17:19:21.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.468+0000 7fb82ba00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb82406a220 0x7fb824141910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:21.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.468+0000 7fb82ba00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8240b4210 0x7fb82415b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:21.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.468+0000 7fb82ba00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb82415ccc0 0x7fb8240afc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:21.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.469+0000 7fb82ba00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb82415a5e0 con 0x7fb8240b4210 2024-03-12T17:19:21.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.469+0000 7fb82ba00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb824141e50 con 0x7fb82406a220 2024-03-12T17:19:21.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.469+0000 7fb82ba00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82415baf0 con 0x7fb82415ccc0 2024-03-12T17:19:21.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.469+0000 7fb81be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8240b4210 0x7fb82415b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:21.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.469+0000 7fb81be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8240b4210 0x7fb82415b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38596/0 (socket says 172.21.15.17:38596) 2024-03-12T17:19:21.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.469+0000 7fb81be00640 1 -- 172.21.15.17:0/2223281609 learned_addr learned my addr 172.21.15.17:0/2223281609 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:21.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.469+0000 7fb829000640 1 --2- 172.21.15.17:0/2223281609 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb82406a220 0x7fb824141910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:21.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.469+0000 7fb81be00640 1 -- 172.21.15.17:0/2223281609 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb82415ccc0 msgr2=0x7fb8240afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:21.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.469+0000 7fb81be00640 1 --2- 172.21.15.17:0/2223281609 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb82415ccc0 0x7fb8240afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:21.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.469+0000 7fb81be00640 1 -- 172.21.15.17:0/2223281609 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb82406a220 msgr2=0x7fb824141910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:21.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.469+0000 7fb81be00640 1 --2- 172.21.15.17:0/2223281609 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb82406a220 0x7fb824141910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:21.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.469+0000 7fb81be00640 1 -- 172.21.15.17:0/2223281609 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb814009400 con 0x7fb8240b4210 2024-03-12T17:19:21.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.470+0000 7fb81be00640 1 --2- 172.21.15.17:0/2223281609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8240b4210 0x7fb82415b5b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00e9e0 tx=0x7fb80c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:21.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.470+0000 7fb821600640 1 -- 172.21.15.17:0/2223281609 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c009670 con 0x7fb8240b4210 2024-03-12T17:19:21.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.470+0000 7fb821600640 1 -- 172.21.15.17:0/2223281609 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb80c00c9d0 con 0x7fb8240b4210 2024-03-12T17:19:21.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.470+0000 7fb821600640 1 -- 172.21.15.17:0/2223281609 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb80c00cd80 con 0x7fb8240b4210 2024-03-12T17:19:21.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.470+0000 7fb82ba00640 1 -- 172.21.15.17:0/2223281609 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb82415a7f0 con 0x7fb8240b4210 2024-03-12T17:19:21.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.470+0000 7fb82ba00640 1 -- 172.21.15.17:0/2223281609 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb82415adb0 con 0x7fb8240b4210 2024-03-12T17:19:21.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.471+0000 7fb82ba00640 1 -- 172.21.15.17:0/2223281609 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8240736c0 con 0x7fb8240b4210 2024-03-12T17:19:21.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.472+0000 7fb821600640 1 -- 172.21.15.17:0/2223281609 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fb80c013470 con 0x7fb8240b4210 2024-03-12T17:19:21.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.473+0000 7fb821600640 1 --2- 172.21.15.17:0/2223281609 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb80006ac00 0x7fb80006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:21.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.473+0000 7fb821600640 1 -- 172.21.15.17:0/2223281609 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb80c089650 con 0x7fb8240b4210 2024-03-12T17:19:21.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.473+0000 7fb829000640 1 --2- 172.21.15.17:0/2223281609 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb80006ac00 0x7fb80006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:21.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.474+0000 7fb829000640 1 --2- 172.21.15.17:0/2223281609 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb80006ac00 0x7fb80006d0c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb814035000 tx=0x7fb814008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:21.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.478+0000 7fb821600640 1 -- 172.21.15.17:0/2223281609 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fb80c0547a0 con 0x7fb8240b4210 2024-03-12T17:19:21.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.677+0000 7fb82ba00640 1 -- 172.21.15.17:0/2223281609 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb82415bfb0 con 0x7fb8240b4210 2024-03-12T17:19:21.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.680+0000 7fb821600640 1 -- 172.21.15.17:0/2223281609 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15989 (secure 0 0 0) 0x7fb80c057dc0 con 0x7fb8240b4210 2024-03-12T17:19:21.675 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:19:21.676 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":21,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:18:46.845635+0000","last_up_change":"2024-03-12T17:18:38.144756+0000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-12T17:18:39.552910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-12T17:18:43.794908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-12T17:18:44.867006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":37305},{"type":"v1","addr":"172.21.15.17:6801","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":37305},{"type":"v1","addr":"172.21.15.17:6803","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":37305},{"type":"v1","addr":"172.21.15.17:6807","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":37305},{"type":"v1","addr":"172.21.15.17:6805","nonce":37305}]},"public_addr":"172.21.15.17:6801/37305","cluster_addr":"172.21.15.17:6803/37305","heartbeat_back_addr":"172.21.15.17:6807/37305","heartbeat_front_addr":"172.21.15.17:6805/37305","state":["exists","up"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":37307},{"type":"v1","addr":"172.21.15.17:6814","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":37307},{"type":"v1","addr":"172.21.15.17:6818","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":37307},{"type":"v1","addr":"172.21.15.17:6827","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":37307},{"type":"v1","addr":"172.21.15.17:6823","nonce":37307}]},"public_addr":"172.21.15.17:6814/37307","cluster_addr":"172.21.15.17:6818/37307","heartbeat_back_addr":"172.21.15.17:6827/37307","heartbeat_front_addr":"172.21.15.17:6823/37307","state":["exists","up"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":37303},{"type":"v1","addr":"172.21.15.17:6809","nonce":37303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":37303},{"type":"v1","addr":"172.21.15.17:6811","nonce":37303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":37303},{"type":"v1","addr":"172.21.15.17:6819","nonce":37303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":37303},{"type":"v1","addr":"172.21.15.17:6815","nonce":37303}]},"public_addr":"172.21.15.17:6809/37303","cluster_addr":"172.21.15.17:6811/37303","heartbeat_back_addr":"172.21.15.17:6819/37303","heartbeat_front_addr":"172.21.15.17:6815/37303","state":["exists","up"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":37308},{"type":"v1","addr":"172.21.15.17:6822","nonce":37308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":37308},{"type":"v1","addr":"172.21.15.17:6826","nonce":37308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":37308},{"type":"v1","addr":"172.21.15.17:6831","nonce":37308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":37308},{"type":"v1","addr":"172.21.15.17:6829","nonce":37308}]},"public_addr":"172.21.15.17:6822/37308","cluster_addr":"172.21.15.17:6826/37308","heartbeat_back_addr":"172.21.15.17:6831/37308","heartbeat_front_addr":"172.21.15.17:6829/37308","state":["exists","up"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":37465},{"type":"v1","addr":"172.21.15.94:6809","nonce":37465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6811","nonce":37465},{"type":"v1","addr":"172.21.15.94:6813","nonce":37465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6819","nonce":37465},{"type":"v1","addr":"172.21.15.94:6822","nonce":37465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6815","nonce":37465},{"type":"v1","addr":"172.21.15.94:6817","nonce":37465}]},"public_addr":"172.21.15.94:6809/37465","cluster_addr":"172.21.15.94:6813/37465","heartbeat_back_addr":"172.21.15.94:6822/37465","heartbeat_front_addr":"172.21.15.94:6817/37465","state":["exists","up"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":37464},{"type":"v1","addr":"172.21.15.94:6812","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":37464},{"type":"v1","addr":"172.21.15.94:6816","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":37464},{"type":"v1","addr":"172.21.15.94:6823","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":37464},{"type":"v1","addr":"172.21.15.94:6820","nonce":37464}]},"public_addr":"172.21.15.94:6812/37464","cluster_addr":"172.21.15.94:6816/37464","heartbeat_back_addr":"172.21.15.94:6823/37464","heartbeat_front_addr":"172.21.15.94:6820/37464","state":["exists","up"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":37467},{"type":"v1","addr":"172.21.15.94:6825","nonce":37467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":37467},{"type":"v1","addr":"172.21.15.94:6827","nonce":37467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":37467},{"type":"v1","addr":"172.21.15.94:6831","nonce":37467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":37467},{"type":"v1","addr":"172.21.15.94:6829","nonce":37467}]},"public_addr":"172.21.15.94:6825/37467","cluster_addr":"172.21.15.94:6827/37467","heartbeat_back_addr":"172.21.15.94:6831/37467","heartbeat_front_addr":"172.21.15.94:6829/37467","state":["exists","up"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":37466},{"type":"v1","addr":"172.21.15.94:6801","nonce":37466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":37466},{"type":"v1","addr":"172.21.15.94:6803","nonce":37466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":37466},{"type":"v1","addr":"172.21.15.94:6807","nonce":37466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":37466},{"type":"v1","addr":"172.21.15.94:6805","nonce":37466}]},"public_addr":"172.21.15.94:6801/37466","cluster_addr":"172.21.15.94:6803/37466","heartbeat_back_addr":"172.21.15.94:6807/37466","heartbeat_front_addr":"172.21.15.94:6805/37466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.327217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.186966+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.419986+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.150585+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.120621+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.121576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.181257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.293188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:19:21.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.682+0000 7fb82ba00640 1 -- 172.21.15.17:0/2223281609 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb80006ac00 msgr2=0x7fb80006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:21.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.683+0000 7fb82ba00640 1 --2- 172.21.15.17:0/2223281609 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb80006ac00 0x7fb80006d0c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb814035000 tx=0x7fb814008030 comp rx=0 tx=0).stop 2024-03-12T17:19:21.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.683+0000 7fb82ba00640 1 -- 172.21.15.17:0/2223281609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8240b4210 msgr2=0x7fb82415b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:21.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.683+0000 7fb82ba00640 1 --2- 172.21.15.17:0/2223281609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8240b4210 0x7fb82415b5b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00e9e0 tx=0x7fb80c00eea0 comp rx=0 tx=0).stop 2024-03-12T17:19:21.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.683+0000 7fb82ba00640 1 -- 172.21.15.17:0/2223281609 shutdown_connections 2024-03-12T17:19:21.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.683+0000 7fb82ba00640 1 --2- 172.21.15.17:0/2223281609 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb80006ac00 0x7fb80006d0c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:21.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.683+0000 7fb82ba00640 1 --2- 172.21.15.17:0/2223281609 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb82415ccc0 0x7fb8240afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:21.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.683+0000 7fb82ba00640 1 --2- 172.21.15.17:0/2223281609 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8240b4210 0x7fb82415b5b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:21.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.683+0000 7fb82ba00640 1 --2- 172.21.15.17:0/2223281609 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb82406a220 0x7fb824141910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:21.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.683+0000 7fb82ba00640 1 -- 172.21.15.17:0/2223281609 >> 172.21.15.17:0/2223281609 conn(0x7fb824098a60 msgr2=0x7fb82406d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:21.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.683+0000 7fb82ba00640 1 -- 172.21.15.17:0/2223281609 shutdown_connections 2024-03-12T17:19:21.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.683+0000 7fb82ba00640 1 -- 172.21.15.17:0/2223281609 wait complete. 2024-03-12T17:19:21.697 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-12T17:18:39.552910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-12T17:18:43.794908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-12T17:18:44.867006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-12T17:19:21.698 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-12T17:19:21.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.925+0000 7f3491a00640 1 Processor -- start 2024-03-12T17:19:21.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.925+0000 7f3491a00640 1 -- start start 2024-03-12T17:19:21.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.927+0000 7f3491a00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f348c0b3b70 0x7f348c0b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:21.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.927+0000 7f3491a00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f348c0a7660 con 0x7f348c15ae20 2024-03-12T17:19:21.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.927+0000 7f3491a00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f348c0b44c0 con 0x7f348c1441f0 2024-03-12T17:19:21.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.927+0000 7f3491a00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f348c15e460 con 0x7f348c0b3b70 2024-03-12T17:19:21.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.927+0000 7f348b400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f348c15ae20 0x7f348c06d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:47086/0 (socket says 172.21.15.17:47086) 2024-03-12T17:19:21.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.927+0000 7f348b400640 1 -- 172.21.15.17:0/1174377075 learned_addr learned my addr 172.21.15.17:0/1174377075 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:21.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.927+0000 7f3491000640 1 --2- 172.21.15.17:0/1174377075 >> v2:172.21.15.94:3300/0 conn(0x7f348c0b3b70 0x7f348c0b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:21.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.928+0000 7f348aa00640 1 -- 172.21.15.17:0/1174377075 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3573355497 0 0) 0x7f348c0a7660 con 0x7f348c15ae20 2024-03-12T17:19:21.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.928+0000 7f348aa00640 1 -- 172.21.15.17:0/1174377075 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3470003520 con 0x7f348c15ae20 2024-03-12T17:19:21.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.928+0000 7f348aa00640 1 -- 172.21.15.17:0/1174377075 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2166015898 0 0) 0x7f3470003520 con 0x7f348c15ae20 2024-03-12T17:19:21.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.928+0000 7f348aa00640 1 -- 172.21.15.17:0/1174377075 >> v2:172.21.15.94:3300/0 conn(0x7f348c0b3b70 msgr2=0x7f348c0b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:21.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.928+0000 7f348aa00640 1 --2- 172.21.15.17:0/1174377075 >> v2:172.21.15.94:3300/0 conn(0x7f348c0b3b70 0x7f348c0b3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:21.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.928+0000 7f348aa00640 1 -- 172.21.15.17:0/1174377075 >> v1:172.21.15.94:6789/0 conn(0x7f348c1441f0 legacy=0x7f348c070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:21.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.928+0000 7f348aa00640 1 -- 172.21.15.17:0/1174377075 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f348c1445d0 con 0x7f348c15ae20 2024-03-12T17:19:21.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.928+0000 7f348aa00640 1 -- 172.21.15.17:0/1174377075 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7f3478001670 con 0x7f348c15ae20 2024-03-12T17:19:21.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.928+0000 7f348aa00640 1 -- 172.21.15.17:0/1174377075 >> v1:172.21.15.17:6789/0 conn(0x7f348c15ae20 legacy=0x7f348c06d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:21.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.928+0000 7f348aa00640 1 --2- 172.21.15.17:0/1174377075 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3470003970 0x7f3470003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:21.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.928+0000 7f348aa00640 1 --2- 172.21.15.17:0/1174377075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34700047c0 0x7f3470004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:21.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.928+0000 7f348aa00640 1 --2- 172.21.15.17:0/1174377075 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3470005180 0x7f347000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:21.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.928+0000 7f348aa00640 1 -- 172.21.15.17:0/1174377075 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348c15e460 con 0x7f34700047c0 2024-03-12T17:19:21.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.928+0000 7f348aa00640 1 -- 172.21.15.17:0/1174377075 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f347000c030 con 0x7f3470003970 2024-03-12T17:19:21.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.928+0000 7f348aa00640 1 -- 172.21.15.17:0/1174377075 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f347000c1f0 con 0x7f3470005180 2024-03-12T17:19:21.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.929+0000 7f348b400640 1 --2- 172.21.15.17:0/1174377075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34700047c0 0x7f3470004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:21.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.929+0000 7f3491000640 1 --2- 172.21.15.17:0/1174377075 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3470005180 0x7f347000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:21.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.929+0000 7f348be00640 1 --2- 172.21.15.17:0/1174377075 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3470003970 0x7f3470003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:21.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.929+0000 7f348b400640 1 -- 172.21.15.17:0/1174377075 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3470005180 msgr2=0x7f347000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:21.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.929+0000 7f348b400640 1 --2- 172.21.15.17:0/1174377075 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3470005180 0x7f347000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:21.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.929+0000 7f348b400640 1 -- 172.21.15.17:0/1174377075 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3470003970 msgr2=0x7f3470003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:21.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.929+0000 7f348b400640 1 --2- 172.21.15.17:0/1174377075 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3470003970 0x7f3470003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:21.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.929+0000 7f348b400640 1 -- 172.21.15.17:0/1174377075 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3470003520 con 0x7f34700047c0 2024-03-12T17:19:21.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.929+0000 7f3491000640 1 -- 172.21.15.17:0/1174377075 reap_dead start 2024-03-12T17:19:21.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.930+0000 7f348b400640 1 --2- 172.21.15.17:0/1174377075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34700047c0 0x7f3470004c40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f347800c240 tx=0x7f34700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42da4c2d881698d3 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:21.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.930+0000 7f348aa00640 1 -- 172.21.15.17:0/1174377075 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3478005ad0 con 0x7f34700047c0 2024-03-12T17:19:21.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.930+0000 7f348aa00640 1 -- 172.21.15.17:0/1174377075 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3478005c50 con 0x7f34700047c0 2024-03-12T17:19:21.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.930+0000 7f348aa00640 1 -- 172.21.15.17:0/1174377075 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347802c850 con 0x7f34700047c0 2024-03-12T17:19:21.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.931+0000 7f3491a00640 1 -- 172.21.15.17:0/1174377075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34700047c0 msgr2=0x7f3470004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:21.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.931+0000 7f3491a00640 1 --2- 172.21.15.17:0/1174377075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34700047c0 0x7f3470004c40 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f347800c240 tx=0x7f34700057f0 comp rx=0 tx=0).stop 2024-03-12T17:19:21.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.931+0000 7f3491a00640 1 -- 172.21.15.17:0/1174377075 shutdown_connections 2024-03-12T17:19:21.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.931+0000 7f3491a00640 1 --2- 172.21.15.17:0/1174377075 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f34700047c0 0x7f3470004c40 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:21.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.931+0000 7f3491a00640 1 -- 172.21.15.17:0/1174377075 >> 172.21.15.17:0/1174377075 conn(0x7f348c069ce0 msgr2=0x7f348c06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:21.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.931+0000 7f3491a00640 1 -- 172.21.15.17:0/1174377075 shutdown_connections 2024-03-12T17:19:21.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.931+0000 7f3491a00640 1 -- 172.21.15.17:0/1174377075 wait complete. 2024-03-12T17:19:21.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.933+0000 7f3491a00640 1 Processor -- start 2024-03-12T17:19:21.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.933+0000 7f3491a00640 1 -- start start 2024-03-12T17:19:21.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.934+0000 7f3491a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34700047c0 0x7f348c13fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:21.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.934+0000 7f3491a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f348c0cb2c0 0x7f348c0cb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:21.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.934+0000 7f3491a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f348c0a8560 0x7f348c0a89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:21.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.934+0000 7f3491a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348c13ff70 con 0x7f348c0cb2c0 2024-03-12T17:19:21.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.934+0000 7f3491a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348c0cbc80 con 0x7f34700047c0 2024-03-12T17:19:21.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.934+0000 7f3491a00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f348c1e57d0 con 0x7f348c0a8560 2024-03-12T17:19:21.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.934+0000 7f348b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f348c0cb2c0 0x7f348c0cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:21.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.934+0000 7f348b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f348c0cb2c0 0x7f348c0cb740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:38602/0 (socket says 172.21.15.17:38602) 2024-03-12T17:19:21.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.934+0000 7f348b400640 1 -- 172.21.15.17:0/2292426449 learned_addr learned my addr 172.21.15.17:0/2292426449 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:21.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.935+0000 7f348be00640 1 --2- 172.21.15.17:0/2292426449 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34700047c0 0x7f348c13fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:21.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.935+0000 7f3491000640 1 --2- 172.21.15.17:0/2292426449 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f348c0a8560 0x7f348c0a89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:21.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.935+0000 7f348b400640 1 -- 172.21.15.17:0/2292426449 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f348c0a8560 msgr2=0x7f348c0a89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:21.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.935+0000 7f348b400640 1 --2- 172.21.15.17:0/2292426449 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f348c0a8560 0x7f348c0a89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:21.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.935+0000 7f348b400640 1 -- 172.21.15.17:0/2292426449 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34700047c0 msgr2=0x7f348c13fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:21.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.935+0000 7f348b400640 1 --2- 172.21.15.17:0/2292426449 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34700047c0 0x7f348c13fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:21.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.935+0000 7f348b400640 1 -- 172.21.15.17:0/2292426449 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f348c1e4730 con 0x7f348c0cb2c0 2024-03-12T17:19:21.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.935+0000 7f348b400640 1 --2- 172.21.15.17:0/2292426449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f348c0cb2c0 0x7f348c0cb740 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3478001930 tx=0x7f347802e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:21.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.935+0000 7f3483e00640 1 -- 172.21.15.17:0/2292426449 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347803c040 con 0x7f348c0cb2c0 2024-03-12T17:19:21.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.936+0000 7f3483e00640 1 -- 172.21.15.17:0/2292426449 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f347802cd20 con 0x7f348c0cb2c0 2024-03-12T17:19:21.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.936+0000 7f3483e00640 1 -- 172.21.15.17:0/2292426449 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3478007270 con 0x7f348c0cb2c0 2024-03-12T17:19:21.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.936+0000 7f3491a00640 1 -- 172.21.15.17:0/2292426449 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f348c1e4a10 con 0x7f348c0cb2c0 2024-03-12T17:19:21.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.936+0000 7f3491a00640 1 -- 172.21.15.17:0/2292426449 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f348c1e4fd0 con 0x7f348c0cb2c0 2024-03-12T17:19:21.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.937+0000 7f3491a00640 1 -- 172.21.15.17:0/2292426449 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f348c06c540 con 0x7f348c0cb2c0 2024-03-12T17:19:21.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.938+0000 7f3483e00640 1 -- 172.21.15.17:0/2292426449 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f3478032070 con 0x7f348c0cb2c0 2024-03-12T17:19:21.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.939+0000 7f3483e00640 1 --2- 172.21.15.17:0/2292426449 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f346c06ac80 0x7f346c06d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:21.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.939+0000 7f3483e00640 1 -- 172.21.15.17:0/2292426449 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f34780aa720 con 0x7f348c0cb2c0 2024-03-12T17:19:21.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.939+0000 7f348be00640 1 --2- 172.21.15.17:0/2292426449 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f346c06ac80 0x7f346c06d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:21.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.940+0000 7f348be00640 1 --2- 172.21.15.17:0/2292426449 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f346c06ac80 0x7f346c06d140 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f347c005490 tx=0x7f347c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:21.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:21.943+0000 7f3483e00640 1 -- 172.21.15.17:0/2292426449 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f34780759e0 con 0x7f348c0cb2c0 2024-03-12T17:19:22.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.145+0000 7f3491a00640 1 -- 172.21.15.17:0/2292426449 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f348c04e030 con 0x7f348c0cb2c0 2024-03-12T17:19:22.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.145+0000 7f3483e00640 1 -- 172.21.15.17:0/2292426449 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3478079000 con 0x7f348c0cb2c0 2024-03-12T17:19:22.141 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-03-12T17:19:22.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.148+0000 7f3491a00640 1 -- 172.21.15.17:0/2292426449 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f346c06ac80 msgr2=0x7f346c06d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:22.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.148+0000 7f3491a00640 1 --2- 172.21.15.17:0/2292426449 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f346c06ac80 0x7f346c06d140 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f347c005490 tx=0x7f347c009040 comp rx=0 tx=0).stop 2024-03-12T17:19:22.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.148+0000 7f3491a00640 1 -- 172.21.15.17:0/2292426449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f348c0cb2c0 msgr2=0x7f348c0cb740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:22.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.148+0000 7f3491a00640 1 --2- 172.21.15.17:0/2292426449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f348c0cb2c0 0x7f348c0cb740 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f3478001930 tx=0x7f347802e070 comp rx=0 tx=0).stop 2024-03-12T17:19:22.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.148+0000 7f3491a00640 1 -- 172.21.15.17:0/2292426449 shutdown_connections 2024-03-12T17:19:22.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.148+0000 7f3491a00640 1 --2- 172.21.15.17:0/2292426449 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f346c06ac80 0x7f346c06d140 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:22.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.148+0000 7f3491a00640 1 --2- 172.21.15.17:0/2292426449 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f348c0a8560 0x7f348c0a89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:22.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.148+0000 7f3491a00640 1 --2- 172.21.15.17:0/2292426449 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f348c0cb2c0 0x7f348c0cb740 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:22.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.148+0000 7f3491a00640 1 --2- 172.21.15.17:0/2292426449 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f34700047c0 0x7f348c13fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:22.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.148+0000 7f3491a00640 1 -- 172.21.15.17:0/2292426449 >> 172.21.15.17:0/2292426449 conn(0x7f348c069ce0 msgr2=0x7f348c06d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:22.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.148+0000 7f3491a00640 1 -- 172.21.15.17:0/2292426449 shutdown_connections 2024-03-12T17:19:22.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.149+0000 7f3491a00640 1 -- 172.21.15.17:0/2292426449 wait complete. 2024-03-12T17:19:22.162 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-12T17:19:22.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.384+0000 7fd5bbe00640 1 Processor -- start 2024-03-12T17:19:22.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.385+0000 7fd5bbe00640 1 -- start start 2024-03-12T17:19:22.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.386+0000 7fd5bbe00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd5bc0b4ea0 0x7fd5bc0b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.386+0000 7fd5bbe00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5bc0d15b0 con 0x7fd5bc160150 2024-03-12T17:19:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.386+0000 7fd5bbe00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5bc0d2710 con 0x7fd5bc0b8190 2024-03-12T17:19:22.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.386+0000 7fd5bbe00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5bc160530 con 0x7fd5bc0b4ea0 2024-03-12T17:19:22.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.387+0000 7fd5baa00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fd5bc160150 0x7fd5bc0d2000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:39374/0 (socket says 172.21.15.17:39374) 2024-03-12T17:19:22.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.387+0000 7fd5baa00640 1 -- 172.21.15.17:0/603248227 learned_addr learned my addr 172.21.15.17:0/603248227 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:22.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.387+0000 7fd5bb400640 1 --2- 172.21.15.17:0/603248227 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd5bc0b4ea0 0x7fd5bc0b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:22.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.387+0000 7fd5b9600640 1 -- 172.21.15.17:0/603248227 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3785353876 0 0) 0x7fd5bc0d15b0 con 0x7fd5bc160150 2024-03-12T17:19:22.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.387+0000 7fd5b9600640 1 -- 172.21.15.17:0/603248227 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5a0003520 con 0x7fd5bc160150 2024-03-12T17:19:22.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.388+0000 7fd5b9600640 1 -- 172.21.15.17:0/603248227 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1980531556 0 0) 0x7fd5bc0d2710 con 0x7fd5bc0b8190 2024-03-12T17:19:22.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.388+0000 7fd5b9600640 1 -- 172.21.15.17:0/603248227 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5bc0d15b0 con 0x7fd5bc0b8190 2024-03-12T17:19:22.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.388+0000 7fd5b9600640 1 -- 172.21.15.17:0/603248227 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 875001945 0 0) 0x7fd5a0003520 con 0x7fd5bc160150 2024-03-12T17:19:22.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.388+0000 7fd5b9600640 1 -- 172.21.15.17:0/603248227 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd5bc0b4ea0 msgr2=0x7fd5bc0b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:22.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.388+0000 7fd5b9600640 1 --2- 172.21.15.17:0/603248227 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd5bc0b4ea0 0x7fd5bc0b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:22.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.388+0000 7fd5b9600640 1 -- 172.21.15.17:0/603248227 >> v1:172.21.15.94:6789/0 conn(0x7fd5bc0b8190 legacy=0x7fd5bc0b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:22.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.388+0000 7fd5b9600640 1 -- 172.21.15.17:0/603248227 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5bc0cdac0 con 0x7fd5bc160150 2024-03-12T17:19:22.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.388+0000 7fd5b9600640 1 -- 172.21.15.17:0/603248227 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7fd5ac001670 con 0x7fd5bc160150 2024-03-12T17:19:22.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.388+0000 7fd5b9600640 1 -- 172.21.15.17:0/603248227 >> v1:172.21.15.17:6789/0 conn(0x7fd5bc160150 legacy=0x7fd5bc0d2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:22.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.388+0000 7fd5b9600640 1 --2- 172.21.15.17:0/603248227 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd5bc0b4ea0 0x7fd5a0003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:22.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.388+0000 7fd5b9600640 1 --2- 172.21.15.17:0/603248227 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5a00040e0 0x7fd5a00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:22.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.388+0000 7fd5b9600640 1 --2- 172.21.15.17:0/603248227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5a0004d00 0x7fd5a0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:22.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.388+0000 7fd5b9600640 1 -- 172.21.15.17:0/603248227 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5bc160530 con 0x7fd5a0004d00 2024-03-12T17:19:22.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.388+0000 7fd5b9600640 1 -- 172.21.15.17:0/603248227 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a000bac0 con 0x7fd5a00040e0 2024-03-12T17:19:22.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.388+0000 7fd5b9600640 1 -- 172.21.15.17:0/603248227 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a000bc80 con 0x7fd5bc0b4ea0 2024-03-12T17:19:22.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.388+0000 7fd5bb400640 1 --2- 172.21.15.17:0/603248227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5a0004d00 0x7fd5a0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:22.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.389+0000 7fd5baa00640 1 --2- 172.21.15.17:0/603248227 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd5bc0b4ea0 0x7fd5a0003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:22.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.389+0000 7fd5ba000640 1 --2- 172.21.15.17:0/603248227 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5a00040e0 0x7fd5a00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:22.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.389+0000 7fd5bb400640 1 -- 172.21.15.17:0/603248227 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd5bc0b4ea0 msgr2=0x7fd5a0003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:22.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.389+0000 7fd5bb400640 1 --2- 172.21.15.17:0/603248227 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd5bc0b4ea0 0x7fd5a0003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:22.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.389+0000 7fd5bb400640 1 -- 172.21.15.17:0/603248227 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5a00040e0 msgr2=0x7fd5a00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:22.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.389+0000 7fd5bb400640 1 --2- 172.21.15.17:0/603248227 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5a00040e0 0x7fd5a00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:22.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.389+0000 7fd5bb400640 1 -- 172.21.15.17:0/603248227 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a0003520 con 0x7fd5a0004d00 2024-03-12T17:19:22.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.389+0000 7fd5ba000640 1 --2- 172.21.15.17:0/603248227 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5a00040e0 0x7fd5a00047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:19:22.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.389+0000 7fd5baa00640 1 --2- 172.21.15.17:0/603248227 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd5bc0b4ea0 0x7fd5a0003b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:19:22.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.390+0000 7fd5bb400640 1 --2- 172.21.15.17:0/603248227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5a0004d00 0x7fd5a0005180 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4009f90 tx=0x7fd5a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86f9f732edc2e3bd server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:22.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.391+0000 7fd5b9600640 1 -- 172.21.15.17:0/603248227 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b402cbd0 con 0x7fd5a0004d00 2024-03-12T17:19:22.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.391+0000 7fd5b9600640 1 -- 172.21.15.17:0/603248227 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b400f040 con 0x7fd5a0004d00 2024-03-12T17:19:22.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.391+0000 7fd5b9600640 1 -- 172.21.15.17:0/603248227 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b4034440 con 0x7fd5a0004d00 2024-03-12T17:19:22.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.391+0000 7fd5bbe00640 1 -- 172.21.15.17:0/603248227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5a0004d00 msgr2=0x7fd5a0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:22.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.391+0000 7fd5bbe00640 1 --2- 172.21.15.17:0/603248227 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5a0004d00 0x7fd5a0005180 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4009f90 tx=0x7fd5a00057f0 comp rx=0 tx=0).stop 2024-03-12T17:19:22.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.391+0000 7fd5bb400640 1 -- 172.21.15.17:0/603248227 reap_dead start 2024-03-12T17:19:22.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.391+0000 7fd5bbe00640 1 -- 172.21.15.17:0/603248227 shutdown_connections 2024-03-12T17:19:22.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.391+0000 7fd5bbe00640 1 -- 172.21.15.17:0/603248227 >> 172.21.15.17:0/603248227 conn(0x7fd5bc0cf7d0 msgr2=0x7fd5bc0cfbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:22.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.391+0000 7fd5bbe00640 1 -- 172.21.15.17:0/603248227 shutdown_connections 2024-03-12T17:19:22.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.391+0000 7fd5bbe00640 1 -- 172.21.15.17:0/603248227 wait complete. 2024-03-12T17:19:22.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.393+0000 7fd5bbe00640 1 Processor -- start 2024-03-12T17:19:22.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.393+0000 7fd5bbe00640 1 -- start start 2024-03-12T17:19:22.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.394+0000 7fd5bbe00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd5bc152d60 0x7fd5bc1545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:22.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.394+0000 7fd5bbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5bc153140 0x7fd5bc0b63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:22.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.394+0000 7fd5bbe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5bc0b6930 0x7fd5bc1f5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:22.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.394+0000 7fd5bbe00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5bc0b6dc0 con 0x7fd5bc153140 2024-03-12T17:19:22.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.394+0000 7fd5bbe00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5bc0ca820 con 0x7fd5bc0b6930 2024-03-12T17:19:22.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.394+0000 7fd5bbe00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5bc156100 con 0x7fd5bc152d60 2024-03-12T17:19:22.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.395+0000 7fd5ba000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5bc153140 0x7fd5bc0b63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:22.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.395+0000 7fd5ba000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5bc153140 0x7fd5bc0b63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46472/0 (socket says 172.21.15.17:46472) 2024-03-12T17:19:22.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.395+0000 7fd5ba000640 1 -- 172.21.15.17:0/2513226361 learned_addr learned my addr 172.21.15.17:0/2513226361 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:22.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.395+0000 7fd5baa00640 1 --2- 172.21.15.17:0/2513226361 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd5bc152d60 0x7fd5bc1545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:22.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.395+0000 7fd5bb400640 1 --2- 172.21.15.17:0/2513226361 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5bc0b6930 0x7fd5bc1f5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:22.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.396+0000 7fd5ba000640 1 -- 172.21.15.17:0/2513226361 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd5bc152d60 msgr2=0x7fd5bc1545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:22.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.396+0000 7fd5ba000640 1 --2- 172.21.15.17:0/2513226361 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd5bc152d60 0x7fd5bc1545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:22.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.396+0000 7fd5ba000640 1 -- 172.21.15.17:0/2513226361 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5bc0b6930 msgr2=0x7fd5bc1f5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:22.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.396+0000 7fd5ba000640 1 --2- 172.21.15.17:0/2513226361 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5bc0b6930 0x7fd5bc1f5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:22.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.396+0000 7fd5ba000640 1 -- 172.21.15.17:0/2513226361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5bc1563a0 con 0x7fd5bc153140 2024-03-12T17:19:22.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.396+0000 7fd5bb400640 1 --2- 172.21.15.17:0/2513226361 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5bc0b6930 0x7fd5bc1f5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:19:22.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.396+0000 7fd5ba000640 1 --2- 172.21.15.17:0/2513226361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5bc153140 0x7fd5bc0b63f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd5a80079a0 tx=0x7fd5a800ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:22.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.396+0000 7fd5b2a00640 1 -- 172.21.15.17:0/2513226361 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8017070 con 0x7fd5bc153140 2024-03-12T17:19:22.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.396+0000 7fd5b2a00640 1 -- 172.21.15.17:0/2513226361 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a80050d0 con 0x7fd5bc153140 2024-03-12T17:19:22.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.396+0000 7fd5b2a00640 1 -- 172.21.15.17:0/2513226361 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8005240 con 0x7fd5bc153140 2024-03-12T17:19:22.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.396+0000 7fd5bbe00640 1 -- 172.21.15.17:0/2513226361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5bc156680 con 0x7fd5bc153140 2024-03-12T17:19:22.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.396+0000 7fd5bbe00640 1 -- 172.21.15.17:0/2513226361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5bc0ca4b0 con 0x7fd5bc153140 2024-03-12T17:19:22.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.397+0000 7fd5bbe00640 1 -- 172.21.15.17:0/2513226361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5bc0ca9d0 con 0x7fd5bc153140 2024-03-12T17:19:22.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.398+0000 7fd5b2a00640 1 -- 172.21.15.17:0/2513226361 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fd5a80053a0 con 0x7fd5bc153140 2024-03-12T17:19:22.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.399+0000 7fd5b2a00640 1 --2- 172.21.15.17:0/2513226361 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd59c06ac30 0x7fd59c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:22.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.399+0000 7fd5b2a00640 1 -- 172.21.15.17:0/2513226361 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd5a8088aa0 con 0x7fd5bc153140 2024-03-12T17:19:22.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.400+0000 7fd5baa00640 1 --2- 172.21.15.17:0/2513226361 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd59c06ac30 0x7fd59c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:22.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.400+0000 7fd5baa00640 1 --2- 172.21.15.17:0/2513226361 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd59c06ac30 0x7fd59c06d0f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac000ff0 tx=0x7fd5ac007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:22.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.404+0000 7fd5b2a00640 1 -- 172.21.15.17:0/2513226361 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fd5bc0ca9d0 con 0x7fd5bc153140 2024-03-12T17:19:22.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.605+0000 7fd5bbe00640 1 -- 172.21.15.17:0/2513226361 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd5bc0ca990 con 0x7fd5bc153140 2024-03-12T17:19:22.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.606+0000 7fd5b2a00640 1 -- 172.21.15.17:0/2513226361 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd5a8053d30 con 0x7fd5bc153140 2024-03-12T17:19:22.602 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-03-12T17:19:22.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.609+0000 7fd5bbe00640 1 -- 172.21.15.17:0/2513226361 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd59c06ac30 msgr2=0x7fd59c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:22.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.609+0000 7fd5bbe00640 1 --2- 172.21.15.17:0/2513226361 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd59c06ac30 0x7fd59c06d0f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac000ff0 tx=0x7fd5ac007040 comp rx=0 tx=0).stop 2024-03-12T17:19:22.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.609+0000 7fd5bbe00640 1 -- 172.21.15.17:0/2513226361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5bc153140 msgr2=0x7fd5bc0b63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:22.605 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.609+0000 7fd5bbe00640 1 --2- 172.21.15.17:0/2513226361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5bc153140 0x7fd5bc0b63f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd5a80079a0 tx=0x7fd5a800ec10 comp rx=0 tx=0).stop 2024-03-12T17:19:22.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.609+0000 7fd5bbe00640 1 -- 172.21.15.17:0/2513226361 shutdown_connections 2024-03-12T17:19:22.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.609+0000 7fd5bbe00640 1 --2- 172.21.15.17:0/2513226361 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd59c06ac30 0x7fd59c06d0f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:22.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.609+0000 7fd5bbe00640 1 --2- 172.21.15.17:0/2513226361 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5bc0b6930 0x7fd5bc1f5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:22.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.609+0000 7fd5bbe00640 1 --2- 172.21.15.17:0/2513226361 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5bc153140 0x7fd5bc0b63f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:22.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.609+0000 7fd5bbe00640 1 --2- 172.21.15.17:0/2513226361 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd5bc152d60 0x7fd5bc1545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:22.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.609+0000 7fd5bbe00640 1 -- 172.21.15.17:0/2513226361 >> 172.21.15.17:0/2513226361 conn(0x7fd5bc0cf7d0 msgr2=0x7fd5bc0d2000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:22.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.609+0000 7fd5bbe00640 1 -- 172.21.15.17:0/2513226361 shutdown_connections 2024-03-12T17:19:22.606 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.609+0000 7fd5bbe00640 1 -- 172.21.15.17:0/2513226361 wait complete. 2024-03-12T17:19:22.624 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-12T17:19:22.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.855+0000 7f585d800640 1 Processor -- start 2024-03-12T17:19:22.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.855+0000 7f585d800640 1 -- start start 2024-03-12T17:19:22.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.856+0000 7f585d800640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f585815caa0 0x7f5858160790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:22.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.856+0000 7f585d800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f58580cfa40 0x7f58580d12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:22.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.856+0000 7f585d800640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5858161650 con 0x7f585815ce80 2024-03-12T17:19:22.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.856+0000 7f585d800640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5858161090 con 0x7f58580cfa40 2024-03-12T17:19:22.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.856+0000 7f585d800640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5858161370 con 0x7f585815caa0 2024-03-12T17:19:22.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.857+0000 7f585ce00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f58580cfa40 0x7f58580d12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:22.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.857+0000 7f585ce00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f58580cfa40 0x7f58580d12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46486/0 (socket says 172.21.15.17:46486) 2024-03-12T17:19:22.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.857+0000 7f585ce00640 1 -- 172.21.15.17:0/2034982920 learned_addr learned my addr 172.21.15.17:0/2034982920 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:22.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.857+0000 7f5857e00640 1 --2- 172.21.15.17:0/2034982920 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f585815caa0 0x7f5858160790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:22.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.857+0000 7f585ce00640 1 -- 172.21.15.17:0/2034982920 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f585815caa0 msgr2=0x7f5858160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:22.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.857+0000 7f585ce00640 1 --2- 172.21.15.17:0/2034982920 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f585815caa0 0x7f5858160790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:22.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.857+0000 7f585ce00640 1 -- 172.21.15.17:0/2034982920 >> v1:172.21.15.94:6789/0 conn(0x7f585815ce80 legacy=0x7f58580cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:22.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.857+0000 7f585ce00640 1 -- 172.21.15.17:0/2034982920 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58580d0ad0 con 0x7f58580cfa40 2024-03-12T17:19:22.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.858+0000 7f585ce00640 1 --2- 172.21.15.17:0/2034982920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58580cfa40 0x7f58580d12d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5850009e50 tx=0x7f585002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93d82aceda66b008 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:22.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.859+0000 7f5856a00640 1 -- 172.21.15.17:0/2034982920 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585002ca70 con 0x7f58580cfa40 2024-03-12T17:19:22.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.859+0000 7f5856a00640 1 -- 172.21.15.17:0/2034982920 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585002cbd0 con 0x7f58580cfa40 2024-03-12T17:19:22.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.859+0000 7f5856a00640 1 -- 172.21.15.17:0/2034982920 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58500343f0 con 0x7f58580cfa40 2024-03-12T17:19:22.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.859+0000 7f585d800640 1 -- 172.21.15.17:0/2034982920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58580cfa40 msgr2=0x7f58580d12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:22.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.859+0000 7f585d800640 1 --2- 172.21.15.17:0/2034982920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58580cfa40 0x7f58580d12d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5850009e50 tx=0x7f585002bed0 comp rx=0 tx=0).stop 2024-03-12T17:19:22.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.859+0000 7f585d800640 1 -- 172.21.15.17:0/2034982920 shutdown_connections 2024-03-12T17:19:22.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.859+0000 7f585d800640 1 --2- 172.21.15.17:0/2034982920 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58580cfa40 0x7f58580d12d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:22.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.859+0000 7f585d800640 1 --2- 172.21.15.17:0/2034982920 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f585815caa0 0x7f5858160790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:22.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.859+0000 7f585d800640 1 -- 172.21.15.17:0/2034982920 >> 172.21.15.17:0/2034982920 conn(0x7f585806b160 msgr2=0x7f585806b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:22.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.860+0000 7f585d800640 1 -- 172.21.15.17:0/2034982920 shutdown_connections 2024-03-12T17:19:22.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.860+0000 7f585d800640 1 -- 172.21.15.17:0/2034982920 wait complete. 2024-03-12T17:19:22.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.861+0000 7f585d800640 1 Processor -- start 2024-03-12T17:19:22.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.861+0000 7f585d800640 1 -- start start 2024-03-12T17:19:22.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.862+0000 7f585d800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58580cfa40 0x7f58580c8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:22.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.862+0000 7f585d800640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f585815caa0 0x7f58580b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:22.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.862+0000 7f585d800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f585815ce80 0x7f585814e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:22.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.862+0000 7f585d800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58580c8dd0 con 0x7f58580cfa40 2024-03-12T17:19:22.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.862+0000 7f585d800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58580caf50 con 0x7f585815ce80 2024-03-12T17:19:22.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.862+0000 7f585d800640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58580c77f0 con 0x7f585815caa0 2024-03-12T17:19:22.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.863+0000 7f5857e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58580cfa40 0x7f58580c8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:22.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.863+0000 7f5857e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58580cfa40 0x7f58580c8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46498/0 (socket says 172.21.15.17:46498) 2024-03-12T17:19:22.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.863+0000 7f5857e00640 1 -- 172.21.15.17:0/3422895004 learned_addr learned my addr 172.21.15.17:0/3422895004 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:22.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.863+0000 7f585ce00640 1 --2- 172.21.15.17:0/3422895004 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f585815ce80 0x7f585814e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:22.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.863+0000 7f5857400640 1 --2- 172.21.15.17:0/3422895004 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f585815caa0 0x7f58580b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:22.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.863+0000 7f5857e00640 1 -- 172.21.15.17:0/3422895004 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f585815caa0 msgr2=0x7f58580b4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:22.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.863+0000 7f5857e00640 1 --2- 172.21.15.17:0/3422895004 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f585815caa0 0x7f58580b4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:22.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.863+0000 7f5857e00640 1 -- 172.21.15.17:0/3422895004 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f585815ce80 msgr2=0x7f585814e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:22.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.863+0000 7f5857e00640 1 --2- 172.21.15.17:0/3422895004 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f585815ce80 0x7f585814e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:22.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.863+0000 7f5857e00640 1 -- 172.21.15.17:0/3422895004 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5850009b30 con 0x7f58580cfa40 2024-03-12T17:19:22.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.863+0000 7f5857e00640 1 --2- 172.21.15.17:0/3422895004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58580cfa40 0x7f58580c8890 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f584800c7f0 tx=0x7f584800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:22.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.864+0000 7f584fe00640 1 -- 172.21.15.17:0/3422895004 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5848004220 con 0x7f58580cfa40 2024-03-12T17:19:22.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.864+0000 7f584fe00640 1 -- 172.21.15.17:0/3422895004 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58480043a0 con 0x7f58580cfa40 2024-03-12T17:19:22.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.864+0000 7f584fe00640 1 -- 172.21.15.17:0/3422895004 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5848007860 con 0x7f58580cfa40 2024-03-12T17:19:22.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.864+0000 7f585d800640 1 -- 172.21.15.17:0/3422895004 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58580c7ad0 con 0x7f58580cfa40 2024-03-12T17:19:22.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.864+0000 7f585d800640 1 -- 172.21.15.17:0/3422895004 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58580c8090 con 0x7f58580cfa40 2024-03-12T17:19:22.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.865+0000 7f585d800640 1 -- 172.21.15.17:0/3422895004 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5858072360 con 0x7f58580cfa40 2024-03-12T17:19:22.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.866+0000 7f584fe00640 1 -- 172.21.15.17:0/3422895004 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f5848007bd0 con 0x7f58580cfa40 2024-03-12T17:19:22.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.867+0000 7f584fe00640 1 --2- 172.21.15.17:0/3422895004 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f583406ac00 0x7f583406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:22.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.867+0000 7f584fe00640 1 -- 172.21.15.17:0/3422895004 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5848089360 con 0x7f58580cfa40 2024-03-12T17:19:22.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.867+0000 7f5857400640 1 --2- 172.21.15.17:0/3422895004 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f583406ac00 0x7f583406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:22.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.868+0000 7f5857400640 1 --2- 172.21.15.17:0/3422895004 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f583406ac00 0x7f583406d0c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5858160ae0 tx=0x7f5840008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:22.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:22.871+0000 7f584fe00640 1 -- 172.21.15.17:0/3422895004 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f58480544a0 con 0x7f58580cfa40 2024-03-12T17:19:23.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.070+0000 7f585d800640 1 -- 172.21.15.17:0/3422895004 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f585804e030 con 0x7f58580cfa40 2024-03-12T17:19:23.068 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.071+0000 7f584fe00640 1 -- 172.21.15.17:0/3422895004 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5848057ac0 con 0x7f58580cfa40 2024-03-12T17:19:23.068 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-03-12T17:19:23.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.073+0000 7f585d800640 1 -- 172.21.15.17:0/3422895004 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f583406ac00 msgr2=0x7f583406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:23.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.073+0000 7f585d800640 1 --2- 172.21.15.17:0/3422895004 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f583406ac00 0x7f583406d0c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5858160ae0 tx=0x7f5840008040 comp rx=0 tx=0).stop 2024-03-12T17:19:23.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.073+0000 7f585d800640 1 -- 172.21.15.17:0/3422895004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58580cfa40 msgr2=0x7f58580c8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:23.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.073+0000 7f585d800640 1 --2- 172.21.15.17:0/3422895004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58580cfa40 0x7f58580c8890 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f584800c7f0 tx=0x7f584800ccb0 comp rx=0 tx=0).stop 2024-03-12T17:19:23.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.073+0000 7f585d800640 1 -- 172.21.15.17:0/3422895004 shutdown_connections 2024-03-12T17:19:23.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.073+0000 7f585d800640 1 --2- 172.21.15.17:0/3422895004 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f583406ac00 0x7f583406d0c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:23.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.073+0000 7f585d800640 1 --2- 172.21.15.17:0/3422895004 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f585815ce80 0x7f585814e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:23.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.073+0000 7f585d800640 1 --2- 172.21.15.17:0/3422895004 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f585815caa0 0x7f58580b4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:23.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.073+0000 7f585d800640 1 --2- 172.21.15.17:0/3422895004 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f58580cfa40 0x7f58580c8890 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:23.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.073+0000 7f585d800640 1 -- 172.21.15.17:0/3422895004 >> 172.21.15.17:0/3422895004 conn(0x7f585806b160 msgr2=0x7f585815b080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:23.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.074+0000 7f585d800640 1 -- 172.21.15.17:0/3422895004 shutdown_connections 2024-03-12T17:19:23.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.074+0000 7f585d800640 1 -- 172.21.15.17:0/3422895004 wait complete. 2024-03-12T17:19:23.090 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T17:19:23.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.319+0000 7f3b89000640 1 Processor -- start 2024-03-12T17:19:23.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.319+0000 7f3b89000640 1 -- start start 2024-03-12T17:19:23.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.321+0000 7f3b89000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3b840d2fa0 0x7f3b840d3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:23.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.321+0000 7f3b89000640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3b840b5f70 0x7f3b840d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:23.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.321+0000 7f3b89000640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b840d14e0 con 0x7f3b840b5b50 2024-03-12T17:19:23.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.321+0000 7f3b89000640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b840b59e0 con 0x7f3b840b5f70 2024-03-12T17:19:23.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.321+0000 7f3b89000640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b840d38c0 con 0x7f3b840d2fa0 2024-03-12T17:19:23.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.321+0000 7f3b81400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f3b840b5b50 0x7f3b840cd840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:39384/0 (socket says 172.21.15.17:39384) 2024-03-12T17:19:23.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.321+0000 7f3b81400640 1 -- 172.21.15.17:0/2137721998 learned_addr learned my addr 172.21.15.17:0/2137721998 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:23.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.321+0000 7f3b81e00640 1 --2- 172.21.15.17:0/2137721998 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3b840d2fa0 0x7f3b840d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:23.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.321+0000 7f3b82800640 1 --2- 172.21.15.17:0/2137721998 >> v2:172.21.15.94:3300/0 conn(0x7f3b840b5f70 0x7f3b840d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:23.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.322+0000 7f3b80a00640 1 -- 172.21.15.17:0/2137721998 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 194230619 0 0) 0x7f3b840d14e0 con 0x7f3b840b5b50 2024-03-12T17:19:23.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.322+0000 7f3b80a00640 1 -- 172.21.15.17:0/2137721998 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b68003520 con 0x7f3b840b5b50 2024-03-12T17:19:23.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.322+0000 7f3b80a00640 1 -- 172.21.15.17:0/2137721998 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2642986097 0 0) 0x7f3b68003520 con 0x7f3b840b5b50 2024-03-12T17:19:23.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.322+0000 7f3b80a00640 1 -- 172.21.15.17:0/2137721998 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3b840d2fa0 msgr2=0x7f3b840d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:23.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.322+0000 7f3b80a00640 1 --2- 172.21.15.17:0/2137721998 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3b840d2fa0 0x7f3b840d3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:23.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.322+0000 7f3b80a00640 1 -- 172.21.15.17:0/2137721998 >> v2:172.21.15.94:3300/0 conn(0x7f3b840b5f70 msgr2=0x7f3b840d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:23.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.322+0000 7f3b80a00640 1 --2- 172.21.15.17:0/2137721998 >> v2:172.21.15.94:3300/0 conn(0x7f3b840b5f70 0x7f3b840d1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:23.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.322+0000 7f3b80a00640 1 -- 172.21.15.17:0/2137721998 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b840b85b0 con 0x7f3b840b5b50 2024-03-12T17:19:23.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.322+0000 7f3b80a00640 1 -- 172.21.15.17:0/2137721998 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7f3b70001670 con 0x7f3b840b5b50 2024-03-12T17:19:23.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.322+0000 7f3b80a00640 1 -- 172.21.15.17:0/2137721998 >> v1:172.21.15.17:6789/0 conn(0x7f3b840b5b50 legacy=0x7f3b840cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:23.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.322+0000 7f3b80a00640 1 --2- 172.21.15.17:0/2137721998 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b68003970 0x7f3b68003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:23.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.322+0000 7f3b80a00640 1 --2- 172.21.15.17:0/2137721998 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3b840d2fa0 0x7f3b680047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:23.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.322+0000 7f3b80a00640 1 --2- 172.21.15.17:0/2137721998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b68004d00 0x7f3b68005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:23.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.322+0000 7f3b80a00640 1 -- 172.21.15.17:0/2137721998 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b840d38c0 con 0x7f3b68004d00 2024-03-12T17:19:23.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.322+0000 7f3b80a00640 1 -- 172.21.15.17:0/2137721998 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6800b980 con 0x7f3b68003970 2024-03-12T17:19:23.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.322+0000 7f3b80a00640 1 -- 172.21.15.17:0/2137721998 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6800bac0 con 0x7f3b840d2fa0 2024-03-12T17:19:23.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.322+0000 7f3b82800640 1 --2- 172.21.15.17:0/2137721998 >> v2:172.21.15.94:3300/0 conn(0x7f3b840b5f70 0x7f3b840d1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-12T17:19:23.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.323+0000 7f3b82800640 1 --2- 172.21.15.17:0/2137721998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b68004d00 0x7f3b68005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:23.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.323+0000 7f3b81e00640 1 --2- 172.21.15.17:0/2137721998 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b68003970 0x7f3b68003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:23.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.323+0000 7f3b81400640 1 --2- 172.21.15.17:0/2137721998 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3b840d2fa0 0x7f3b680047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:23.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.323+0000 7f3b82800640 1 -- 172.21.15.17:0/2137721998 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3b840d2fa0 msgr2=0x7f3b680047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:23.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.323+0000 7f3b82800640 1 --2- 172.21.15.17:0/2137721998 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3b840d2fa0 0x7f3b680047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:23.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.323+0000 7f3b82800640 1 -- 172.21.15.17:0/2137721998 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b68003970 msgr2=0x7f3b68003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:23.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.323+0000 7f3b82800640 1 --2- 172.21.15.17:0/2137721998 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b68003970 0x7f3b68003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:23.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.323+0000 7f3b82800640 1 -- 172.21.15.17:0/2137721998 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b68003520 con 0x7f3b68004d00 2024-03-12T17:19:23.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.324+0000 7f3b82800640 1 --2- 172.21.15.17:0/2137721998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b68004d00 0x7f3b68005180 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c00e350 tx=0x7f3b680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aeafb83e6a2939a server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:23.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.324+0000 7f3b80a00640 1 -- 172.21.15.17:0/2137721998 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c02cde0 con 0x7f3b68004d00 2024-03-12T17:19:23.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.325+0000 7f3b80a00640 1 -- 172.21.15.17:0/2137721998 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b7c00f040 con 0x7f3b68004d00 2024-03-12T17:19:23.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.325+0000 7f3b80a00640 1 -- 172.21.15.17:0/2137721998 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c003b90 con 0x7f3b68004d00 2024-03-12T17:19:23.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.325+0000 7f3b89000640 1 -- 172.21.15.17:0/2137721998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b68004d00 msgr2=0x7f3b68005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:23.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.325+0000 7f3b89000640 1 --2- 172.21.15.17:0/2137721998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b68004d00 0x7f3b68005180 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c00e350 tx=0x7f3b680057f0 comp rx=0 tx=0).stop 2024-03-12T17:19:23.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.325+0000 7f3b82800640 1 -- 172.21.15.17:0/2137721998 reap_dead start 2024-03-12T17:19:23.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.325+0000 7f3b89000640 1 -- 172.21.15.17:0/2137721998 shutdown_connections 2024-03-12T17:19:23.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.325+0000 7f3b89000640 1 -- 172.21.15.17:0/2137721998 >> 172.21.15.17:0/2137721998 conn(0x7f3b84065df0 msgr2=0x7f3b84066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:23.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.325+0000 7f3b89000640 1 -- 172.21.15.17:0/2137721998 shutdown_connections 2024-03-12T17:19:23.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.325+0000 7f3b89000640 1 -- 172.21.15.17:0/2137721998 wait complete. 2024-03-12T17:19:23.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.327+0000 7f3b89000640 1 Processor -- start 2024-03-12T17:19:23.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.327+0000 7f3b89000640 1 -- start start 2024-03-12T17:19:23.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.328+0000 7f3b89000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b68004d00 0x7f3b840c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:23.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.328+0000 7f3b89000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b840c8a20 0x7f3b840c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:23.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.328+0000 7f3b89000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3b840cac50 0x7f3b840cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:23.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.328+0000 7f3b89000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b840c93e0 con 0x7f3b68004d00 2024-03-12T17:19:23.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.328+0000 7f3b89000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b840c78b0 con 0x7f3b840c8a20 2024-03-12T17:19:23.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.328+0000 7f3b89000640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b840c8660 con 0x7f3b840cac50 2024-03-12T17:19:23.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.329+0000 7f3b81e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b68004d00 0x7f3b840c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:23.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.329+0000 7f3b81e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b68004d00 0x7f3b840c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46516/0 (socket says 172.21.15.17:46516) 2024-03-12T17:19:23.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.329+0000 7f3b81e00640 1 -- 172.21.15.17:0/1038792966 learned_addr learned my addr 172.21.15.17:0/1038792966 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:23.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.329+0000 7f3b81400640 1 --2- 172.21.15.17:0/1038792966 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b840c8a20 0x7f3b840c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:23.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.329+0000 7f3b81e00640 1 -- 172.21.15.17:0/1038792966 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3b840cac50 msgr2=0x7f3b840cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:23.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.329+0000 7f3b81e00640 1 --2- 172.21.15.17:0/1038792966 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3b840cac50 0x7f3b840cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:23.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.329+0000 7f3b81e00640 1 -- 172.21.15.17:0/1038792966 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b840c8a20 msgr2=0x7f3b840c8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:23.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.329+0000 7f3b81e00640 1 --2- 172.21.15.17:0/1038792966 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b840c8a20 0x7f3b840c8ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:23.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.329+0000 7f3b81e00640 1 -- 172.21.15.17:0/1038792966 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b840c6530 con 0x7f3b68004d00 2024-03-12T17:19:23.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.329+0000 7f3b81e00640 1 --2- 172.21.15.17:0/1038792966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b68004d00 0x7f3b840c8120 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3b740119a0 tx=0x7f3b74011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:23.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.330+0000 7f3b7a000640 1 -- 172.21.15.17:0/1038792966 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7400fa10 con 0x7f3b68004d00 2024-03-12T17:19:23.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.330+0000 7f3b7a000640 1 -- 172.21.15.17:0/1038792966 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b7400fb70 con 0x7f3b68004d00 2024-03-12T17:19:23.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.330+0000 7f3b7a000640 1 -- 172.21.15.17:0/1038792966 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b74014440 con 0x7f3b68004d00 2024-03-12T17:19:23.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.330+0000 7f3b89000640 1 -- 172.21.15.17:0/1038792966 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b840c6810 con 0x7f3b68004d00 2024-03-12T17:19:23.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.330+0000 7f3b89000640 1 -- 172.21.15.17:0/1038792966 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b840c6dd0 con 0x7f3b68004d00 2024-03-12T17:19:23.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.331+0000 7f3b89000640 1 -- 172.21.15.17:0/1038792966 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b840736c0 con 0x7f3b68004d00 2024-03-12T17:19:23.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.332+0000 7f3b7a000640 1 -- 172.21.15.17:0/1038792966 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f3b740145a0 con 0x7f3b68004d00 2024-03-12T17:19:23.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.333+0000 7f3b7a000640 1 --2- 172.21.15.17:0/1038792966 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f3b6406ac50 0x7f3b6406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:23.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.333+0000 7f3b7a000640 1 -- 172.21.15.17:0/1038792966 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b74089ab0 con 0x7f3b68004d00 2024-03-12T17:19:23.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.333+0000 7f3b81400640 1 --2- 172.21.15.17:0/1038792966 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f3b6406ac50 0x7f3b6406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:23.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.334+0000 7f3b81400640 1 --2- 172.21.15.17:0/1038792966 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f3b6406ac50 0x7f3b6406d110 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3b70001050 tx=0x7f3b70001b80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:23.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.337+0000 7f3b7a000640 1 -- 172.21.15.17:0/1038792966 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f3b74054d70 con 0x7f3b68004d00 2024-03-12T17:19:23.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.541+0000 7f3b89000640 1 -- 172.21.15.17:0/1038792966 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b840b65a0 con 0x7f3b68004d00 2024-03-12T17:19:23.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.544+0000 7f3b7a000640 1 -- 172.21.15.17:0/1038792966 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15989 (secure 0 0 0) 0x7f3b74058390 con 0x7f3b68004d00 2024-03-12T17:19:23.540 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:19:23.540 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":21,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:18:46.845635+0000","last_up_change":"2024-03-12T17:18:38.144756+0000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-12T17:18:39.552910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-12T17:18:43.794908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-12T17:18:44.867006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":37305},{"type":"v1","addr":"172.21.15.17:6801","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":37305},{"type":"v1","addr":"172.21.15.17:6803","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":37305},{"type":"v1","addr":"172.21.15.17:6807","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":37305},{"type":"v1","addr":"172.21.15.17:6805","nonce":37305}]},"public_addr":"172.21.15.17:6801/37305","cluster_addr":"172.21.15.17:6803/37305","heartbeat_back_addr":"172.21.15.17:6807/37305","heartbeat_front_addr":"172.21.15.17:6805/37305","state":["exists","up"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":37307},{"type":"v1","addr":"172.21.15.17:6814","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":37307},{"type":"v1","addr":"172.21.15.17:6818","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":37307},{"type":"v1","addr":"172.21.15.17:6827","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":37307},{"type":"v1","addr":"172.21.15.17:6823","nonce":37307}]},"public_addr":"172.21.15.17:6814/37307","cluster_addr":"172.21.15.17:6818/37307","heartbeat_back_addr":"172.21.15.17:6827/37307","heartbeat_front_addr":"172.21.15.17:6823/37307","state":["exists","up"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":37303},{"type":"v1","addr":"172.21.15.17:6809","nonce":37303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":37303},{"type":"v1","addr":"172.21.15.17:6811","nonce":37303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":37303},{"type":"v1","addr":"172.21.15.17:6819","nonce":37303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":37303},{"type":"v1","addr":"172.21.15.17:6815","nonce":37303}]},"public_addr":"172.21.15.17:6809/37303","cluster_addr":"172.21.15.17:6811/37303","heartbeat_back_addr":"172.21.15.17:6819/37303","heartbeat_front_addr":"172.21.15.17:6815/37303","state":["exists","up"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":37308},{"type":"v1","addr":"172.21.15.17:6822","nonce":37308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":37308},{"type":"v1","addr":"172.21.15.17:6826","nonce":37308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":37308},{"type":"v1","addr":"172.21.15.17:6831","nonce":37308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":37308},{"type":"v1","addr":"172.21.15.17:6829","nonce":37308}]},"public_addr":"172.21.15.17:6822/37308","cluster_addr":"172.21.15.17:6826/37308","heartbeat_back_addr":"172.21.15.17:6831/37308","heartbeat_front_addr":"172.21.15.17:6829/37308","state":["exists","up"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":37465},{"type":"v1","addr":"172.21.15.94:6809","nonce":37465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6811","nonce":37465},{"type":"v1","addr":"172.21.15.94:6813","nonce":37465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6819","nonce":37465},{"type":"v1","addr":"172.21.15.94:6822","nonce":37465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6815","nonce":37465},{"type":"v1","addr":"172.21.15.94:6817","nonce":37465}]},"public_addr":"172.21.15.94:6809/37465","cluster_addr":"172.21.15.94:6813/37465","heartbeat_back_addr":"172.21.15.94:6822/37465","heartbeat_front_addr":"172.21.15.94:6817/37465","state":["exists","up"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":37464},{"type":"v1","addr":"172.21.15.94:6812","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":37464},{"type":"v1","addr":"172.21.15.94:6816","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":37464},{"type":"v1","addr":"172.21.15.94:6823","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":37464},{"type":"v1","addr":"172.21.15.94:6820","nonce":37464}]},"public_addr":"172.21.15.94:6812/37464","cluster_addr":"172.21.15.94:6816/37464","heartbeat_back_addr":"172.21.15.94:6823/37464","heartbeat_front_addr":"172.21.15.94:6820/37464","state":["exists","up"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":37467},{"type":"v1","addr":"172.21.15.94:6825","nonce":37467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":37467},{"type":"v1","addr":"172.21.15.94:6827","nonce":37467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":37467},{"type":"v1","addr":"172.21.15.94:6831","nonce":37467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":37467},{"type":"v1","addr":"172.21.15.94:6829","nonce":37467}]},"public_addr":"172.21.15.94:6825/37467","cluster_addr":"172.21.15.94:6827/37467","heartbeat_back_addr":"172.21.15.94:6831/37467","heartbeat_front_addr":"172.21.15.94:6829/37467","state":["exists","up"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":37466},{"type":"v1","addr":"172.21.15.94:6801","nonce":37466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":37466},{"type":"v1","addr":"172.21.15.94:6803","nonce":37466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":37466},{"type":"v1","addr":"172.21.15.94:6807","nonce":37466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":37466},{"type":"v1","addr":"172.21.15.94:6805","nonce":37466}]},"public_addr":"172.21.15.94:6801/37466","cluster_addr":"172.21.15.94:6803/37466","heartbeat_back_addr":"172.21.15.94:6807/37466","heartbeat_front_addr":"172.21.15.94:6805/37466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.327217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.186966+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.419986+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.150585+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.120621+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.121576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.181257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.293188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:19:23.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.547+0000 7f3b89000640 1 -- 172.21.15.17:0/1038792966 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f3b6406ac50 msgr2=0x7f3b6406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:23.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.547+0000 7f3b89000640 1 --2- 172.21.15.17:0/1038792966 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f3b6406ac50 0x7f3b6406d110 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3b70001050 tx=0x7f3b70001b80 comp rx=0 tx=0).stop 2024-03-12T17:19:23.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.547+0000 7f3b89000640 1 -- 172.21.15.17:0/1038792966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b68004d00 msgr2=0x7f3b840c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:23.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.547+0000 7f3b89000640 1 --2- 172.21.15.17:0/1038792966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b68004d00 0x7f3b840c8120 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3b740119a0 tx=0x7f3b74011e60 comp rx=0 tx=0).stop 2024-03-12T17:19:23.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.547+0000 7f3b89000640 1 -- 172.21.15.17:0/1038792966 shutdown_connections 2024-03-12T17:19:23.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.547+0000 7f3b89000640 1 --2- 172.21.15.17:0/1038792966 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f3b6406ac50 0x7f3b6406d110 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:23.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.547+0000 7f3b89000640 1 --2- 172.21.15.17:0/1038792966 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3b840cac50 0x7f3b840cb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:23.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.547+0000 7f3b89000640 1 --2- 172.21.15.17:0/1038792966 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3b840c8a20 0x7f3b840c8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:23.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.547+0000 7f3b89000640 1 --2- 172.21.15.17:0/1038792966 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3b68004d00 0x7f3b840c8120 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:23.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.547+0000 7f3b89000640 1 -- 172.21.15.17:0/1038792966 >> 172.21.15.17:0/1038792966 conn(0x7f3b84065df0 msgr2=0x7f3b840b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:23.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.548+0000 7f3b89000640 1 -- 172.21.15.17:0/1038792966 shutdown_connections 2024-03-12T17:19:23.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.548+0000 7f3b89000640 1 -- 172.21.15.17:0/1038792966 wait complete. 2024-03-12T17:19:23.563 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-12T17:18:39.552910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-12T17:18:43.794908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-12T17:18:44.867006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-12T17:19:23.564 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-12T17:19:23.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.792+0000 7f3168c00640 1 Processor -- start 2024-03-12T17:19:23.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.792+0000 7f3168c00640 1 -- start start 2024-03-12T17:19:23.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.794+0000 7f3168c00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f316415ae20 0x7f316406d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:23.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.794+0000 7f3168c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f31640b3b70 0x7f31640b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:23.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.794+0000 7f3168c00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31640a7660 con 0x7f31641441f0 2024-03-12T17:19:23.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.794+0000 7f3168c00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f316415e460 con 0x7f316415ae20 2024-03-12T17:19:23.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.794+0000 7f3168c00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31640b44e0 con 0x7f31640b3b70 2024-03-12T17:19:23.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.794+0000 7f3162a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f316415ae20 0x7f316406d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:23.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.794+0000 7f3162a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f316415ae20 0x7f316406d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46518/0 (socket says 172.21.15.17:46518) 2024-03-12T17:19:23.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.794+0000 7f3162a00640 1 -- 172.21.15.17:0/2648947831 learned_addr learned my addr 172.21.15.17:0/2648947831 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:23.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.795+0000 7f3163e00640 1 --2- 172.21.15.17:0/2648947831 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f31640b3b70 0x7f31640b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:23.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.795+0000 7f3162a00640 1 -- 172.21.15.17:0/2648947831 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f31640b3b70 msgr2=0x7f31640b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:23.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.795+0000 7f3162a00640 1 --2- 172.21.15.17:0/2648947831 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f31640b3b70 0x7f31640b3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:23.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.795+0000 7f3162a00640 1 -- 172.21.15.17:0/2648947831 >> v1:172.21.15.94:6789/0 conn(0x7f31641441f0 legacy=0x7f3164070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:23.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.795+0000 7f3162a00640 1 -- 172.21.15.17:0/2648947831 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31641445d0 con 0x7f316415ae20 2024-03-12T17:19:23.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.796+0000 7f3162a00640 1 --2- 172.21.15.17:0/2648947831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f316415ae20 0x7f316406d130 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f314c009870 tx=0x7f314c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6d3f359aecddcaf server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:23.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.796+0000 7f3162000640 1 -- 172.21.15.17:0/2648947831 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314c030840 con 0x7f316415ae20 2024-03-12T17:19:23.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.796+0000 7f3162000640 1 -- 172.21.15.17:0/2648947831 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314c0309a0 con 0x7f316415ae20 2024-03-12T17:19:23.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.796+0000 7f3162000640 1 -- 172.21.15.17:0/2648947831 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314c030d30 con 0x7f316415ae20 2024-03-12T17:19:23.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.797+0000 7f3168c00640 1 -- 172.21.15.17:0/2648947831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f316415ae20 msgr2=0x7f316406d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:23.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.797+0000 7f3168c00640 1 --2- 172.21.15.17:0/2648947831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f316415ae20 0x7f316406d130 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f314c009870 tx=0x7f314c02b980 comp rx=0 tx=0).stop 2024-03-12T17:19:23.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.797+0000 7f3168c00640 1 -- 172.21.15.17:0/2648947831 shutdown_connections 2024-03-12T17:19:23.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.797+0000 7f3168c00640 1 --2- 172.21.15.17:0/2648947831 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f31640b3b70 0x7f31640b3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:23.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.797+0000 7f3168c00640 1 --2- 172.21.15.17:0/2648947831 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f316415ae20 0x7f316406d130 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:23.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.797+0000 7f3168c00640 1 -- 172.21.15.17:0/2648947831 >> 172.21.15.17:0/2648947831 conn(0x7f3164069ce0 msgr2=0x7f316406a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:23.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.797+0000 7f3168c00640 1 -- 172.21.15.17:0/2648947831 shutdown_connections 2024-03-12T17:19:23.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.797+0000 7f3168c00640 1 -- 172.21.15.17:0/2648947831 wait complete. 2024-03-12T17:19:23.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.799+0000 7f3168c00640 1 Processor -- start 2024-03-12T17:19:23.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.799+0000 7f3168c00640 1 -- start start 2024-03-12T17:19:23.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.800+0000 7f3168c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f31640b3b70 0x7f31640aa850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:23.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.800+0000 7f3168c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31641441f0 0x7f31640b1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:23.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.800+0000 7f3168c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f316415ae20 0x7f3164136bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:23.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.800+0000 7f3168c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31640aceb0 con 0x7f31641441f0 2024-03-12T17:19:23.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.800+0000 7f3168c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3164137110 con 0x7f31640b3b70 2024-03-12T17:19:23.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.800+0000 7f3168c00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31640aae30 con 0x7f316415ae20 2024-03-12T17:19:23.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.800+0000 7f3162a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31641441f0 0x7f31640b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:23.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.800+0000 7f3162a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31641441f0 0x7f31640b1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46526/0 (socket says 172.21.15.17:46526) 2024-03-12T17:19:23.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.800+0000 7f3162a00640 1 -- 172.21.15.17:0/3789312651 learned_addr learned my addr 172.21.15.17:0/3789312651 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:23.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.801+0000 7f3162a00640 1 -- 172.21.15.17:0/3789312651 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f316415ae20 msgr2=0x7f3164136bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:23.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.801+0000 7f3163400640 1 --2- 172.21.15.17:0/3789312651 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f31640b3b70 0x7f31640aa850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:23.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.801+0000 7f3162a00640 1 --2- 172.21.15.17:0/3789312651 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f316415ae20 0x7f3164136bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:23.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.801+0000 7f3162a00640 1 -- 172.21.15.17:0/3789312651 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f31640b3b70 msgr2=0x7f31640aa850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:23.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.801+0000 7f3162a00640 1 --2- 172.21.15.17:0/3789312651 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f31640b3b70 0x7f31640aa850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:23.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.801+0000 7f3162a00640 1 -- 172.21.15.17:0/3789312651 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314c0094d0 con 0x7f31641441f0 2024-03-12T17:19:23.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.801+0000 7f3163400640 1 --2- 172.21.15.17:0/3789312651 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f31640b3b70 0x7f31640aa850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:23.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.801+0000 7f3162a00640 1 --2- 172.21.15.17:0/3789312651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31641441f0 0x7f31640b1920 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f314c0090b0 tx=0x7f314c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:23.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.801+0000 7f315b400640 1 -- 172.21.15.17:0/3789312651 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314c03e040 con 0x7f31641441f0 2024-03-12T17:19:23.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.801+0000 7f315b400640 1 -- 172.21.15.17:0/3789312651 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314c039cb0 con 0x7f31641441f0 2024-03-12T17:19:23.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.801+0000 7f315b400640 1 -- 172.21.15.17:0/3789312651 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314c044630 con 0x7f31641441f0 2024-03-12T17:19:23.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.801+0000 7f3168c00640 1 -- 172.21.15.17:0/3789312651 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31640ac860 con 0x7f31641441f0 2024-03-12T17:19:23.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.801+0000 7f3168c00640 1 -- 172.21.15.17:0/3789312651 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31640ac510 con 0x7f31641441f0 2024-03-12T17:19:23.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.803+0000 7f3168c00640 1 -- 172.21.15.17:0/3789312651 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31640ad060 con 0x7f31641441f0 2024-03-12T17:19:23.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.803+0000 7f315b400640 1 -- 172.21.15.17:0/3789312651 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f314c04d3b0 con 0x7f31641441f0 2024-03-12T17:19:23.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.804+0000 7f315b400640 1 --2- 172.21.15.17:0/3789312651 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f314006acd0 0x7f314006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:23.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.804+0000 7f315b400640 1 -- 172.21.15.17:0/3789312651 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f314c0abb60 con 0x7f31641441f0 2024-03-12T17:19:23.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.805+0000 7f3163400640 1 --2- 172.21.15.17:0/3789312651 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f314006acd0 0x7f314006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:23.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.806+0000 7f3163400640 1 --2- 172.21.15.17:0/3789312651 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f314006acd0 0x7f314006d190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3154004520 tx=0x7f3154009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:23.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:23.809+0000 7f315b400640 1 -- 172.21.15.17:0/3789312651 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f31640ad060 con 0x7f31641441f0 2024-03-12T17:19:24.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.006+0000 7f3168c00640 1 -- 172.21.15.17:0/3789312651 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f31640ad060 con 0x7f31641441f0 2024-03-12T17:19:24.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.007+0000 7f315b400640 1 -- 172.21.15.17:0/3789312651 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f31640ad060 con 0x7f31641441f0 2024-03-12T17:19:24.003 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-03-12T17:19:24.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.010+0000 7f3168c00640 1 -- 172.21.15.17:0/3789312651 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f314006acd0 msgr2=0x7f314006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:24.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.010+0000 7f3168c00640 1 --2- 172.21.15.17:0/3789312651 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f314006acd0 0x7f314006d190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3154004520 tx=0x7f3154009040 comp rx=0 tx=0).stop 2024-03-12T17:19:24.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.010+0000 7f3168c00640 1 -- 172.21.15.17:0/3789312651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31641441f0 msgr2=0x7f31640b1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:24.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.010+0000 7f3168c00640 1 --2- 172.21.15.17:0/3789312651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31641441f0 0x7f31640b1920 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f314c0090b0 tx=0x7f314c004730 comp rx=0 tx=0).stop 2024-03-12T17:19:24.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.010+0000 7f3168c00640 1 -- 172.21.15.17:0/3789312651 shutdown_connections 2024-03-12T17:19:24.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.010+0000 7f3168c00640 1 --2- 172.21.15.17:0/3789312651 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f314006acd0 0x7f314006d190 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:24.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.010+0000 7f3168c00640 1 --2- 172.21.15.17:0/3789312651 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f316415ae20 0x7f3164136bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:24.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.010+0000 7f3168c00640 1 --2- 172.21.15.17:0/3789312651 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f31641441f0 0x7f31640b1920 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:24.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.010+0000 7f3168c00640 1 --2- 172.21.15.17:0/3789312651 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f31640b3b70 0x7f31640aa850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:24.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.010+0000 7f3168c00640 1 -- 172.21.15.17:0/3789312651 >> 172.21.15.17:0/3789312651 conn(0x7f3164069ce0 msgr2=0x7f3164142910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:24.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.010+0000 7f3168c00640 1 -- 172.21.15.17:0/3789312651 shutdown_connections 2024-03-12T17:19:24.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.010+0000 7f3168c00640 1 -- 172.21.15.17:0/3789312651 wait complete. 2024-03-12T17:19:24.026 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-12T17:19:24.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.257+0000 7f1863e00640 1 Processor -- start 2024-03-12T17:19:24.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.257+0000 7f1863e00640 1 -- start start 2024-03-12T17:19:24.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.259+0000 7f1863e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1864070ba0 0x7f18640cc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:24.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.259+0000 7f1863e00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f186415bd70 con 0x7f18640cccd0 2024-03-12T17:19:24.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.259+0000 7f1863e00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1864070f80 con 0x7f1864140570 2024-03-12T17:19:24.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.259+0000 7f1863e00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1864140e80 con 0x7f1864070ba0 2024-03-12T17:19:24.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.260+0000 7f1862000640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f18640cccd0 0x7f186413fe60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:39400/0 (socket says 172.21.15.17:39400) 2024-03-12T17:19:24.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.260+0000 7f1862000640 1 -- 172.21.15.17:0/320360798 learned_addr learned my addr 172.21.15.17:0/320360798 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:24.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.260+0000 7f1862a00640 1 --2- 172.21.15.17:0/320360798 >> v2:172.21.15.94:3300/0 conn(0x7f1864070ba0 0x7f18640cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:24.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.260+0000 7f1861600640 1 -- 172.21.15.17:0/320360798 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 115594933 0 0) 0x7f1850001110 con 0x7f18640cccd0 2024-03-12T17:19:24.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.260+0000 7f1861600640 1 -- 172.21.15.17:0/320360798 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1848003520 con 0x7f18640cccd0 2024-03-12T17:19:24.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.260+0000 7f1861600640 1 -- 172.21.15.17:0/320360798 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2576667652 0 0) 0x7f1848003520 con 0x7f18640cccd0 2024-03-12T17:19:24.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.260+0000 7f1861600640 1 -- 172.21.15.17:0/320360798 >> v2:172.21.15.94:3300/0 conn(0x7f1864070ba0 msgr2=0x7f18640cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:24.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.260+0000 7f1861600640 1 --2- 172.21.15.17:0/320360798 >> v2:172.21.15.94:3300/0 conn(0x7f1864070ba0 0x7f18640cc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:24.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.260+0000 7f1861600640 1 -- 172.21.15.17:0/320360798 >> v1:172.21.15.94:6789/0 conn(0x7f1864140570 legacy=0x7f18641643f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:24.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.260+0000 7f1861600640 1 -- 172.21.15.17:0/320360798 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186415afd0 con 0x7f18640cccd0 2024-03-12T17:19:24.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.260+0000 7f1861600640 1 -- 172.21.15.17:0/320360798 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7f1850001800 con 0x7f18640cccd0 2024-03-12T17:19:24.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.261+0000 7f1861600640 1 -- 172.21.15.17:0/320360798 >> v1:172.21.15.17:6789/0 conn(0x7f18640cccd0 legacy=0x7f186413fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:24.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.261+0000 7f1861600640 1 --2- 172.21.15.17:0/320360798 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18480039c0 0x7f1848003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:24.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.261+0000 7f1861600640 1 --2- 172.21.15.17:0/320360798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18480047c0 0x7f1848004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:24.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.261+0000 7f1861600640 1 --2- 172.21.15.17:0/320360798 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1848005180 0x7f184800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:24.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.261+0000 7f1861600640 1 -- 172.21.15.17:0/320360798 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184800c050 con 0x7f18480047c0 2024-03-12T17:19:24.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.261+0000 7f1861600640 1 -- 172.21.15.17:0/320360798 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184800c1c0 con 0x7f1848005180 2024-03-12T17:19:24.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.261+0000 7f1861600640 1 -- 172.21.15.17:0/320360798 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f184800c380 con 0x7f18480039c0 2024-03-12T17:19:24.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.261+0000 7f1862000640 1 --2- 172.21.15.17:0/320360798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18480047c0 0x7f1848004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:24.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.261+0000 7f1863400640 1 --2- 172.21.15.17:0/320360798 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1848005180 0x7f184800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:24.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.261+0000 7f1862a00640 1 --2- 172.21.15.17:0/320360798 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18480039c0 0x7f1848003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:24.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.261+0000 7f1862000640 1 -- 172.21.15.17:0/320360798 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18480039c0 msgr2=0x7f1848003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:24.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.261+0000 7f1862000640 1 --2- 172.21.15.17:0/320360798 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18480039c0 0x7f1848003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:24.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.261+0000 7f1862000640 1 -- 172.21.15.17:0/320360798 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1848005180 msgr2=0x7f184800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:24.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.261+0000 7f1862000640 1 --2- 172.21.15.17:0/320360798 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1848005180 0x7f184800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:24.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.261+0000 7f1862000640 1 -- 172.21.15.17:0/320360798 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1848003520 con 0x7f18480047c0 2024-03-12T17:19:24.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.261+0000 7f1863400640 1 -- 172.21.15.17:0/320360798 reap_dead start 2024-03-12T17:19:24.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.262+0000 7f1862000640 1 --2- 172.21.15.17:0/320360798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18480047c0 0x7f1848004c40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1850007fc0 tx=0x7f18480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38cd52067c53c6f1 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:24.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.263+0000 7f1861600640 1 -- 172.21.15.17:0/320360798 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1850005ad0 con 0x7f18480047c0 2024-03-12T17:19:24.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.263+0000 7f1861600640 1 -- 172.21.15.17:0/320360798 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1850005c50 con 0x7f18480047c0 2024-03-12T17:19:24.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.263+0000 7f1861600640 1 -- 172.21.15.17:0/320360798 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185002ca20 con 0x7f18480047c0 2024-03-12T17:19:24.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.263+0000 7f1863e00640 1 -- 172.21.15.17:0/320360798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18480047c0 msgr2=0x7f1848004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:24.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.263+0000 7f1863e00640 1 --2- 172.21.15.17:0/320360798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18480047c0 0x7f1848004c40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1850007fc0 tx=0x7f18480057f0 comp rx=0 tx=0).stop 2024-03-12T17:19:24.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.263+0000 7f1863e00640 1 -- 172.21.15.17:0/320360798 shutdown_connections 2024-03-12T17:19:24.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.263+0000 7f1863e00640 1 --2- 172.21.15.17:0/320360798 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18480047c0 0x7f1848004c40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:24.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.263+0000 7f1863e00640 1 -- 172.21.15.17:0/320360798 >> 172.21.15.17:0/320360798 conn(0x7f1864066000 msgr2=0x7f1864069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:24.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.263+0000 7f1863e00640 1 -- 172.21.15.17:0/320360798 shutdown_connections 2024-03-12T17:19:24.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.264+0000 7f1863e00640 1 -- 172.21.15.17:0/320360798 wait complete. 2024-03-12T17:19:24.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.265+0000 7f1863e00640 1 Processor -- start 2024-03-12T17:19:24.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.266+0000 7f1863e00640 1 -- start start 2024-03-12T17:19:24.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.267+0000 7f1863e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18480047c0 0x7f1864154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:24.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.267+0000 7f1863e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f186413b440 0x7f186406cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:24.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.267+0000 7f1863e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f186413b8c0 0x7f186406d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:24.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.267+0000 7f1863e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1864154d90 con 0x7f186413b8c0 2024-03-12T17:19:24.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.267+0000 7f1863e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186413a610 con 0x7f18480047c0 2024-03-12T17:19:24.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.267+0000 7f1863e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1864139a40 con 0x7f186413b440 2024-03-12T17:19:24.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.267+0000 7f1863400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f186413b8c0 0x7f186406d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:24.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.267+0000 7f1863400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f186413b8c0 0x7f186406d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46556/0 (socket says 172.21.15.17:46556) 2024-03-12T17:19:24.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.267+0000 7f1863400640 1 -- 172.21.15.17:0/362020160 learned_addr learned my addr 172.21.15.17:0/362020160 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:24.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.267+0000 7f1862a00640 1 --2- 172.21.15.17:0/362020160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18480047c0 0x7f1864154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:24.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.267+0000 7f1862000640 1 --2- 172.21.15.17:0/362020160 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f186413b440 0x7f186406cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:24.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.267+0000 7f1863400640 1 -- 172.21.15.17:0/362020160 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f186413b440 msgr2=0x7f186406cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:24.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.267+0000 7f1863400640 1 --2- 172.21.15.17:0/362020160 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f186413b440 0x7f186406cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:24.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.267+0000 7f1863400640 1 -- 172.21.15.17:0/362020160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18480047c0 msgr2=0x7f1864154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:24.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.267+0000 7f1863400640 1 --2- 172.21.15.17:0/362020160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18480047c0 0x7f1864154850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:24.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.267+0000 7f1863400640 1 -- 172.21.15.17:0/362020160 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1864139ce0 con 0x7f186413b8c0 2024-03-12T17:19:24.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.267+0000 7f1862000640 1 --2- 172.21.15.17:0/362020160 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f186413b440 0x7f186406cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:24.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.267+0000 7f1862a00640 1 --2- 172.21.15.17:0/362020160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18480047c0 0x7f1864154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:19:24.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.268+0000 7f1863400640 1 --2- 172.21.15.17:0/362020160 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f186413b8c0 0x7f186406d060 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f185c007fd0 tx=0x7f185c00ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:24.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.268+0000 7f185b400640 1 -- 172.21.15.17:0/362020160 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185c006d60 con 0x7f186413b8c0 2024-03-12T17:19:24.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.268+0000 7f185b400640 1 -- 172.21.15.17:0/362020160 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185c003970 con 0x7f186413b8c0 2024-03-12T17:19:24.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.268+0000 7f185b400640 1 -- 172.21.15.17:0/362020160 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185c003d20 con 0x7f186413b8c0 2024-03-12T17:19:24.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.268+0000 7f1863e00640 1 -- 172.21.15.17:0/362020160 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1864139fc0 con 0x7f186413b8c0 2024-03-12T17:19:24.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.268+0000 7f1863e00640 1 -- 172.21.15.17:0/362020160 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f186413b040 con 0x7f186413b8c0 2024-03-12T17:19:24.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.269+0000 7f1863e00640 1 -- 172.21.15.17:0/362020160 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f186413a780 con 0x7f186413b8c0 2024-03-12T17:19:24.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.270+0000 7f185b400640 1 -- 172.21.15.17:0/362020160 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f185c005070 con 0x7f186413b8c0 2024-03-12T17:19:24.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.271+0000 7f185b400640 1 --2- 172.21.15.17:0/362020160 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f184406ac30 0x7f184406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:24.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.271+0000 7f185b400640 1 -- 172.21.15.17:0/362020160 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f185c088ba0 con 0x7f186413b8c0 2024-03-12T17:19:24.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.271+0000 7f1862a00640 1 --2- 172.21.15.17:0/362020160 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f184406ac30 0x7f184406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:24.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.272+0000 7f1862a00640 1 --2- 172.21.15.17:0/362020160 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f184406ac30 0x7f184406d0f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f18640682f0 tx=0x7f1854008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:24.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.275+0000 7f185b400640 1 -- 172.21.15.17:0/362020160 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f185c053ce0 con 0x7f186413b8c0 2024-03-12T17:19:24.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.474+0000 7f1863e00640 1 -- 172.21.15.17:0/362020160 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f186406d5a0 con 0x7f186413b8c0 2024-03-12T17:19:24.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.474+0000 7f185b400640 1 -- 172.21.15.17:0/362020160 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f186406d5a0 con 0x7f186413b8c0 2024-03-12T17:19:24.470 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-03-12T17:19:24.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.477+0000 7f1863e00640 1 -- 172.21.15.17:0/362020160 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f184406ac30 msgr2=0x7f184406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:24.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.477+0000 7f1863e00640 1 --2- 172.21.15.17:0/362020160 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f184406ac30 0x7f184406d0f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f18640682f0 tx=0x7f1854008040 comp rx=0 tx=0).stop 2024-03-12T17:19:24.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.477+0000 7f1863e00640 1 -- 172.21.15.17:0/362020160 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f186413b8c0 msgr2=0x7f186406d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:24.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.477+0000 7f1863e00640 1 --2- 172.21.15.17:0/362020160 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f186413b8c0 0x7f186406d060 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f185c007fd0 tx=0x7f185c00ea00 comp rx=0 tx=0).stop 2024-03-12T17:19:24.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.477+0000 7f1863e00640 1 -- 172.21.15.17:0/362020160 shutdown_connections 2024-03-12T17:19:24.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.477+0000 7f1863e00640 1 --2- 172.21.15.17:0/362020160 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f184406ac30 0x7f184406d0f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:24.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.477+0000 7f1863e00640 1 --2- 172.21.15.17:0/362020160 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f186413b8c0 0x7f186406d060 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:24.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.477+0000 7f1863e00640 1 --2- 172.21.15.17:0/362020160 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f186413b440 0x7f186406cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:24.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.477+0000 7f1863e00640 1 --2- 172.21.15.17:0/362020160 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18480047c0 0x7f1864154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:24.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.477+0000 7f1863e00640 1 -- 172.21.15.17:0/362020160 >> 172.21.15.17:0/362020160 conn(0x7f1864066000 msgr2=0x7f18640afc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:24.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.477+0000 7f1863e00640 1 -- 172.21.15.17:0/362020160 shutdown_connections 2024-03-12T17:19:24.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.477+0000 7f1863e00640 1 -- 172.21.15.17:0/362020160 wait complete. 2024-03-12T17:19:24.491 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-12T17:19:24.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.715+0000 7f0fe1600640 1 Processor -- start 2024-03-12T17:19:24.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.715+0000 7f0fe1600640 1 -- start start 2024-03-12T17:19:24.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.717+0000 7f0fe1600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0fdc1441f0 0x7f0fdc070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:24.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.717+0000 7f0fe1600640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0fdc15ae20 0x7f0fdc06d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:24.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.717+0000 7f0fe1600640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0fdc0b3b70 0x7f0fdc0b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:24.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.717+0000 7f0fe1600640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fdc15e460 con 0x7f0fdc0b3b70 2024-03-12T17:19:24.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.717+0000 7f0fe1600640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fdc0b4520 con 0x7f0fdc15ae20 2024-03-12T17:19:24.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.717+0000 7f0fe1600640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fdc0a7660 con 0x7f0fdc1441f0 2024-03-12T17:19:24.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.717+0000 7f0fe0c00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0fdc0b3b70 0x7f0fdc0b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:24.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.717+0000 7f0fe0c00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0fdc0b3b70 0x7f0fdc0b3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46560/0 (socket says 172.21.15.17:46560) 2024-03-12T17:19:24.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.717+0000 7f0fe0c00640 1 -- 172.21.15.17:0/423776141 learned_addr learned my addr 172.21.15.17:0/423776141 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:24.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.718+0000 7f0fdbe00640 1 --2- 172.21.15.17:0/423776141 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0fdc1441f0 0x7f0fdc070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:24.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.718+0000 7f0fd3e00640 1 --2- 172.21.15.17:0/423776141 >> v2:172.21.15.94:3300/0 conn(0x7f0fdc15ae20 0x7f0fdc06d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:24.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.718+0000 7f0fe0c00640 1 -- 172.21.15.17:0/423776141 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0fdc1441f0 msgr2=0x7f0fdc070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:24.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.718+0000 7f0fe0c00640 1 --2- 172.21.15.17:0/423776141 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0fdc1441f0 0x7f0fdc070240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:24.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.718+0000 7f0fe0c00640 1 -- 172.21.15.17:0/423776141 >> v2:172.21.15.94:3300/0 conn(0x7f0fdc15ae20 msgr2=0x7f0fdc06d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:24.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.718+0000 7f0fe0c00640 1 --2- 172.21.15.17:0/423776141 >> v2:172.21.15.94:3300/0 conn(0x7f0fdc15ae20 0x7f0fdc06d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:24.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.718+0000 7f0fe0c00640 1 -- 172.21.15.17:0/423776141 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fdc1445d0 con 0x7f0fdc0b3b70 2024-03-12T17:19:24.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.718+0000 7f0fd3e00640 1 --2- 172.21.15.17:0/423776141 >> v2:172.21.15.94:3300/0 conn(0x7f0fdc15ae20 0x7f0fdc06d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:24.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.719+0000 7f0fe0c00640 1 --2- 172.21.15.17:0/423776141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fdc0b3b70 0x7f0fdc0b3fe0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc06e3e0 tx=0x7f0fd402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e107bfa40367d68 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:24.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.719+0000 7f0fdb400640 1 -- 172.21.15.17:0/423776141 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd402cb00 con 0x7f0fdc0b3b70 2024-03-12T17:19:24.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.719+0000 7f0fdb400640 1 -- 172.21.15.17:0/423776141 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd402cc60 con 0x7f0fdc0b3b70 2024-03-12T17:19:24.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.719+0000 7f0fdb400640 1 -- 172.21.15.17:0/423776141 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd40343f0 con 0x7f0fdc0b3b70 2024-03-12T17:19:24.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.720+0000 7f0fe1600640 1 -- 172.21.15.17:0/423776141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fdc0b3b70 msgr2=0x7f0fdc0b3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:24.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.720+0000 7f0fe1600640 1 --2- 172.21.15.17:0/423776141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fdc0b3b70 0x7f0fdc0b3fe0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc06e3e0 tx=0x7f0fd402bf60 comp rx=0 tx=0).stop 2024-03-12T17:19:24.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.720+0000 7f0fe1600640 1 -- 172.21.15.17:0/423776141 shutdown_connections 2024-03-12T17:19:24.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.720+0000 7f0fe1600640 1 --2- 172.21.15.17:0/423776141 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fdc0b3b70 0x7f0fdc0b3fe0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:24.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.720+0000 7f0fe1600640 1 --2- 172.21.15.17:0/423776141 >> v2:172.21.15.94:3300/0 conn(0x7f0fdc15ae20 0x7f0fdc06d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:24.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.720+0000 7f0fe1600640 1 --2- 172.21.15.17:0/423776141 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0fdc1441f0 0x7f0fdc070240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:24.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.720+0000 7f0fe1600640 1 -- 172.21.15.17:0/423776141 >> 172.21.15.17:0/423776141 conn(0x7f0fdc069ce0 msgr2=0x7f0fdc06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:24.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.720+0000 7f0fe1600640 1 -- 172.21.15.17:0/423776141 shutdown_connections 2024-03-12T17:19:24.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.720+0000 7f0fe1600640 1 -- 172.21.15.17:0/423776141 wait complete. 2024-03-12T17:19:24.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.721+0000 7f0fe1600640 1 Processor -- start 2024-03-12T17:19:24.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.722+0000 7f0fe1600640 1 -- start start 2024-03-12T17:19:24.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.722+0000 7f0fe1600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0fdc0b3b70 0x7f0fdc12f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:24.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.723+0000 7f0fe1600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0fdc1441f0 0x7f0fdc1420e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:24.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.723+0000 7f0fe1600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fdc15ae20 0x7f0fdc0ac310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:24.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.723+0000 7f0fe1600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fdc12fe80 con 0x7f0fdc15ae20 2024-03-12T17:19:24.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.723+0000 7f0fe1600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fdc142620 con 0x7f0fdc0b3b70 2024-03-12T17:19:24.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.723+0000 7f0fe1600640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fdc141060 con 0x7f0fdc1441f0 2024-03-12T17:19:24.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.723+0000 7f0fe0c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fdc15ae20 0x7f0fdc0ac310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:24.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.723+0000 7f0fe0c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fdc15ae20 0x7f0fdc0ac310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46576/0 (socket says 172.21.15.17:46576) 2024-03-12T17:19:24.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.723+0000 7f0fe0c00640 1 -- 172.21.15.17:0/3728039443 learned_addr learned my addr 172.21.15.17:0/3728039443 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:24.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.723+0000 7f0fe0c00640 1 -- 172.21.15.17:0/3728039443 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0fdc1441f0 msgr2=0x7f0fdc1420e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:24.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.723+0000 7f0fdbe00640 1 --2- 172.21.15.17:0/3728039443 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0fdc0b3b70 0x7f0fdc12f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:24.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.723+0000 7f0fe0c00640 1 --2- 172.21.15.17:0/3728039443 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0fdc1441f0 0x7f0fdc1420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:24.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.723+0000 7f0fe0c00640 1 -- 172.21.15.17:0/3728039443 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0fdc0b3b70 msgr2=0x7f0fdc12f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:24.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.723+0000 7f0fe0c00640 1 --2- 172.21.15.17:0/3728039443 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0fdc0b3b70 0x7f0fdc12f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:24.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.723+0000 7f0fe0c00640 1 -- 172.21.15.17:0/3728039443 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd4009b30 con 0x7f0fdc15ae20 2024-03-12T17:19:24.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.724+0000 7f0fe0c00640 1 --2- 172.21.15.17:0/3728039443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fdc15ae20 0x7f0fdc0ac310 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0fd4009e50 tx=0x7f0fd4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:24.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.724+0000 7f0fd8c00640 1 -- 172.21.15.17:0/3728039443 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd4009510 con 0x7f0fdc15ae20 2024-03-12T17:19:24.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.724+0000 7f0fd8c00640 1 -- 172.21.15.17:0/3728039443 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fd403e450 con 0x7f0fdc15ae20 2024-03-12T17:19:24.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.724+0000 7f0fd8c00640 1 -- 172.21.15.17:0/3728039443 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fd403e800 con 0x7f0fdc15ae20 2024-03-12T17:19:24.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.724+0000 7f0fe1600640 1 -- 172.21.15.17:0/3728039443 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fdc141340 con 0x7f0fdc15ae20 2024-03-12T17:19:24.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.724+0000 7f0fe1600640 1 -- 172.21.15.17:0/3728039443 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fdc141900 con 0x7f0fdc15ae20 2024-03-12T17:19:24.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.725+0000 7f0fe1600640 1 -- 172.21.15.17:0/3728039443 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fdc06d9d0 con 0x7f0fdc15ae20 2024-03-12T17:19:24.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.726+0000 7f0fd8c00640 1 -- 172.21.15.17:0/3728039443 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f0fd403e960 con 0x7f0fdc15ae20 2024-03-12T17:19:24.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.727+0000 7f0fd8c00640 1 --2- 172.21.15.17:0/3728039443 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f0fb806ac00 0x7f0fb806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:24.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.727+0000 7f0fd8c00640 1 -- 172.21.15.17:0/3728039443 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0fd40ac160 con 0x7f0fdc15ae20 2024-03-12T17:19:24.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.727+0000 7f0fdbe00640 1 --2- 172.21.15.17:0/3728039443 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f0fb806ac00 0x7f0fb806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:24.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.728+0000 7f0fdbe00640 1 --2- 172.21.15.17:0/3728039443 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f0fb806ac00 0x7f0fb806d0c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc13bcd0 tx=0x7f0fcc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:24.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.732+0000 7f0fd8c00640 1 -- 172.21.15.17:0/3728039443 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f0fd40773e0 con 0x7f0fdc15ae20 2024-03-12T17:19:24.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.929+0000 7f0fe1600640 1 -- 172.21.15.17:0/3728039443 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0fdc04e030 con 0x7f0fdc15ae20 2024-03-12T17:19:24.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.930+0000 7f0fd8c00640 1 -- 172.21.15.17:0/3728039443 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0fd407aa00 con 0x7f0fdc15ae20 2024-03-12T17:19:24.925 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-03-12T17:19:24.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.933+0000 7f0fe1600640 1 -- 172.21.15.17:0/3728039443 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f0fb806ac00 msgr2=0x7f0fb806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:24.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.933+0000 7f0fe1600640 1 --2- 172.21.15.17:0/3728039443 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f0fb806ac00 0x7f0fb806d0c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc13bcd0 tx=0x7f0fcc008040 comp rx=0 tx=0).stop 2024-03-12T17:19:24.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.933+0000 7f0fe1600640 1 -- 172.21.15.17:0/3728039443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fdc15ae20 msgr2=0x7f0fdc0ac310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:24.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.933+0000 7f0fe1600640 1 --2- 172.21.15.17:0/3728039443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fdc15ae20 0x7f0fdc0ac310 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0fd4009e50 tx=0x7f0fd4004a40 comp rx=0 tx=0).stop 2024-03-12T17:19:24.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.933+0000 7f0fe1600640 1 -- 172.21.15.17:0/3728039443 shutdown_connections 2024-03-12T17:19:24.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.933+0000 7f0fe1600640 1 --2- 172.21.15.17:0/3728039443 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f0fb806ac00 0x7f0fb806d0c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:24.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.933+0000 7f0fe1600640 1 --2- 172.21.15.17:0/3728039443 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0fdc15ae20 0x7f0fdc0ac310 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:24.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.933+0000 7f0fe1600640 1 --2- 172.21.15.17:0/3728039443 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0fdc1441f0 0x7f0fdc1420e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:24.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.933+0000 7f0fe1600640 1 --2- 172.21.15.17:0/3728039443 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0fdc0b3b70 0x7f0fdc12f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:24.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.933+0000 7f0fe1600640 1 -- 172.21.15.17:0/3728039443 >> 172.21.15.17:0/3728039443 conn(0x7f0fdc069ce0 msgr2=0x7f0fdc1431c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:24.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.933+0000 7f0fe1600640 1 -- 172.21.15.17:0/3728039443 shutdown_connections 2024-03-12T17:19:24.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:24.933+0000 7f0fe1600640 1 -- 172.21.15.17:0/3728039443 wait complete. 2024-03-12T17:19:24.970 INFO:tasks.cephfs_test_runner:Starting test: test_basic (tasks.cephfs.test_dump_tree.TestDumpTree) 2024-03-12T17:19:24.971 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_dump_tree.TestDumpTree.test_basic' 2024-03-12T17:19:25.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.205+0000 7f9fefe00640 1 Processor -- start 2024-03-12T17:19:25.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.205+0000 7f9fefe00640 1 -- start start 2024-03-12T17:19:25.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.206+0000 7f9fefe00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9ff0145dc0 0x7f9ff0160ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:25.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.206+0000 7f9fefe00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff01461a0 con 0x7f9ff00b1860 2024-03-12T17:19:25.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.207+0000 7f9fefe00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ff00b3db0 con 0x7f9ff0070240 2024-03-12T17:19:25.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.207+0000 7f9fefe00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ff00b2000 con 0x7f9ff0145dc0 2024-03-12T17:19:25.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.207+0000 7f9fe7e00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f9ff00b1860 0x7f9ff00b4240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:39408/0 (socket says 172.21.15.17:39408) 2024-03-12T17:19:25.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.207+0000 7f9fe7e00640 1 -- 172.21.15.17:0/2393347207 learned_addr learned my addr 172.21.15.17:0/2393347207 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:25.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.207+0000 7f9feea00640 1 --2- 172.21.15.17:0/2393347207 >> v2:172.21.15.94:3300/0 conn(0x7f9ff0145dc0 0x7f9ff0160ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:25.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.207+0000 7f9fee000640 1 -- 172.21.15.17:0/2393347207 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3822359436 0 0) 0x7f9ff01461a0 con 0x7f9ff00b1860 2024-03-12T17:19:25.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.207+0000 7f9fee000640 1 -- 172.21.15.17:0/2393347207 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fd4003520 con 0x7f9ff00b1860 2024-03-12T17:19:25.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.208+0000 7f9fee000640 1 -- 172.21.15.17:0/2393347207 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2357343404 0 0) 0x7f9fd4003520 con 0x7f9ff00b1860 2024-03-12T17:19:25.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.208+0000 7f9fee000640 1 -- 172.21.15.17:0/2393347207 >> v2:172.21.15.94:3300/0 conn(0x7f9ff0145dc0 msgr2=0x7f9ff0160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:25.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.208+0000 7f9fee000640 1 --2- 172.21.15.17:0/2393347207 >> v2:172.21.15.94:3300/0 conn(0x7f9ff0145dc0 0x7f9ff0160ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:25.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.208+0000 7f9fee000640 1 -- 172.21.15.17:0/2393347207 >> v1:172.21.15.94:6789/0 conn(0x7f9ff0070240 legacy=0x7f9ff00abb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:25.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.208+0000 7f9fee000640 1 -- 172.21.15.17:0/2393347207 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff00b4950 con 0x7f9ff00b1860 2024-03-12T17:19:25.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.208+0000 7f9fee000640 1 -- 172.21.15.17:0/2393347207 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7f9fd8001670 con 0x7f9ff00b1860 2024-03-12T17:19:25.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.208+0000 7f9fee000640 1 -- 172.21.15.17:0/2393347207 >> v1:172.21.15.17:6789/0 conn(0x7f9ff00b1860 legacy=0x7f9ff00b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:25.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.208+0000 7f9fee000640 1 --2- 172.21.15.17:0/2393347207 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9fd4003970 0x7f9fd4003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:25.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.208+0000 7f9fee000640 1 --2- 172.21.15.17:0/2393347207 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fd40047c0 0x7f9fd4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:25.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.208+0000 7f9fee000640 1 --2- 172.21.15.17:0/2393347207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fd4005180 0x7f9fd400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:25.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.208+0000 7f9fee000640 1 -- 172.21.15.17:0/2393347207 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff00b2000 con 0x7f9fd4005180 2024-03-12T17:19:25.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.208+0000 7f9fee000640 1 -- 172.21.15.17:0/2393347207 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd400c000 con 0x7f9fd40047c0 2024-03-12T17:19:25.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.208+0000 7f9fee000640 1 -- 172.21.15.17:0/2393347207 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd400c1c0 con 0x7f9fd4003970 2024-03-12T17:19:25.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.208+0000 7f9fef400640 1 --2- 172.21.15.17:0/2393347207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fd4005180 0x7f9fd400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:25.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.209+0000 7f9feea00640 1 --2- 172.21.15.17:0/2393347207 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9fd4003970 0x7f9fd4003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:25.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.209+0000 7f9fe7e00640 1 --2- 172.21.15.17:0/2393347207 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fd40047c0 0x7f9fd4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:25.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.209+0000 7f9fef400640 1 -- 172.21.15.17:0/2393347207 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9fd4003970 msgr2=0x7f9fd4003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:25.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.209+0000 7f9fef400640 1 --2- 172.21.15.17:0/2393347207 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9fd4003970 0x7f9fd4003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:25.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.209+0000 7f9fef400640 1 -- 172.21.15.17:0/2393347207 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fd40047c0 msgr2=0x7f9fd4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:25.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.209+0000 7f9fef400640 1 --2- 172.21.15.17:0/2393347207 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9fd40047c0 0x7f9fd4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:25.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.209+0000 7f9fef400640 1 -- 172.21.15.17:0/2393347207 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd4003520 con 0x7f9fd4005180 2024-03-12T17:19:25.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.210+0000 7f9fef400640 1 -- 172.21.15.17:0/2393347207 reap_dead start 2024-03-12T17:19:25.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.210+0000 7f9fef400640 1 --2- 172.21.15.17:0/2393347207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fd4005180 0x7f9fd400b980 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9fe80044b0 tx=0x7f9fd40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dbfb9ad356fd4d2 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:25.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.210+0000 7f9fee000640 1 -- 172.21.15.17:0/2393347207 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe8006d50 con 0x7f9fd4005180 2024-03-12T17:19:25.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.210+0000 7f9fee000640 1 -- 172.21.15.17:0/2393347207 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe8007020 con 0x7f9fd4005180 2024-03-12T17:19:25.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.210+0000 7f9fee000640 1 -- 172.21.15.17:0/2393347207 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe80073d0 con 0x7f9fd4005180 2024-03-12T17:19:25.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.211+0000 7f9fefe00640 1 -- 172.21.15.17:0/2393347207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fd4005180 msgr2=0x7f9fd400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:25.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.211+0000 7f9fefe00640 1 --2- 172.21.15.17:0/2393347207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fd4005180 0x7f9fd400b980 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9fe80044b0 tx=0x7f9fd40057f0 comp rx=0 tx=0).stop 2024-03-12T17:19:25.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.211+0000 7f9fefe00640 1 -- 172.21.15.17:0/2393347207 shutdown_connections 2024-03-12T17:19:25.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.211+0000 7f9fefe00640 1 --2- 172.21.15.17:0/2393347207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9fd4005180 0x7f9fd400b980 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:25.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.211+0000 7f9fefe00640 1 -- 172.21.15.17:0/2393347207 >> 172.21.15.17:0/2393347207 conn(0x7f9ff0069ce0 msgr2=0x7f9ff006a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:25.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.211+0000 7f9fefe00640 1 -- 172.21.15.17:0/2393347207 shutdown_connections 2024-03-12T17:19:25.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.211+0000 7f9fefe00640 1 -- 172.21.15.17:0/2393347207 wait complete. 2024-03-12T17:19:25.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.213+0000 7f9fefe00640 1 Processor -- start 2024-03-12T17:19:25.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.213+0000 7f9fefe00640 1 -- start start 2024-03-12T17:19:25.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.214+0000 7f9fefe00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9fd4005180 0x7f9ff0144b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:25.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.214+0000 7f9fefe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ff012dc80 0x7f9ff00afd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:25.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.214+0000 7f9fefe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ff012f250 0x7f9ff012f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:25.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.214+0000 7f9fefe00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff0145040 con 0x7f9ff012f250 2024-03-12T17:19:25.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.214+0000 7f9fefe00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff012e1b0 con 0x7f9ff012dc80 2024-03-12T17:19:25.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.214+0000 7f9fefe00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ff012e490 con 0x7f9fd4005180 2024-03-12T17:19:25.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.214+0000 7f9fef400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ff012f250 0x7f9ff012f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:25.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.214+0000 7f9fef400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ff012f250 0x7f9ff012f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46596/0 (socket says 172.21.15.17:46596) 2024-03-12T17:19:25.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.214+0000 7f9fef400640 1 -- 172.21.15.17:0/2010444021 learned_addr learned my addr 172.21.15.17:0/2010444021 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:25.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.215+0000 7f9fe7e00640 1 --2- 172.21.15.17:0/2010444021 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ff012dc80 0x7f9ff00afd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:25.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.215+0000 7f9feea00640 1 --2- 172.21.15.17:0/2010444021 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9fd4005180 0x7f9ff0144b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:25.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.215+0000 7f9fef400640 1 -- 172.21.15.17:0/2010444021 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9fd4005180 msgr2=0x7f9ff0144b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:25.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.215+0000 7f9fef400640 1 --2- 172.21.15.17:0/2010444021 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9fd4005180 0x7f9ff0144b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:25.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.215+0000 7f9fef400640 1 -- 172.21.15.17:0/2010444021 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ff012dc80 msgr2=0x7f9ff00afd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:25.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.215+0000 7f9fef400640 1 --2- 172.21.15.17:0/2010444021 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ff012dc80 0x7f9ff00afd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:25.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.215+0000 7f9fef400640 1 -- 172.21.15.17:0/2010444021 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff012e770 con 0x7f9ff012f250 2024-03-12T17:19:25.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.215+0000 7f9fef400640 1 --2- 172.21.15.17:0/2010444021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ff012f250 0x7f9ff012f6d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9fe802bf80 tx=0x7f9fe8003a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:25.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.215+0000 7f9fe7400640 1 -- 172.21.15.17:0/2010444021 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe803e070 con 0x7f9ff012f250 2024-03-12T17:19:25.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.215+0000 7f9fe7400640 1 -- 172.21.15.17:0/2010444021 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe80076d0 con 0x7f9ff012f250 2024-03-12T17:19:25.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.215+0000 7f9fe7400640 1 -- 172.21.15.17:0/2010444021 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe8007a80 con 0x7f9ff012f250 2024-03-12T17:19:25.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.215+0000 7f9fefe00640 1 -- 172.21.15.17:0/2010444021 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ff012ea50 con 0x7f9ff012f250 2024-03-12T17:19:25.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.216+0000 7f9fefe00640 1 -- 172.21.15.17:0/2010444021 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ff00b02a0 con 0x7f9ff012f250 2024-03-12T17:19:25.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.217+0000 7f9fefe00640 1 -- 172.21.15.17:0/2010444021 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ff00b0430 con 0x7f9ff012f250 2024-03-12T17:19:25.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.217+0000 7f9fe7400640 1 -- 172.21.15.17:0/2010444021 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f9fe8030420 con 0x7f9ff012f250 2024-03-12T17:19:25.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.218+0000 7f9fe7400640 1 --2- 172.21.15.17:0/2010444021 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f9fcc06ac00 0x7f9fcc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:25.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.218+0000 7f9fe7400640 1 -- 172.21.15.17:0/2010444021 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9fe80aa640 con 0x7f9ff012f250 2024-03-12T17:19:25.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.219+0000 7f9feea00640 1 --2- 172.21.15.17:0/2010444021 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f9fcc06ac00 0x7f9fcc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:25.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.219+0000 7f9feea00640 1 --2- 172.21.15.17:0/2010444021 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f9fcc06ac00 0x7f9fcc06d0c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9fe00098d0 tx=0x7f9fe0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:25.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.223+0000 7f9fe7400640 1 -- 172.21.15.17:0/2010444021 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f9fe8075780 con 0x7f9ff012f250 2024-03-12T17:19:25.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:25.487+0000 7f9fefe00640 1 -- 172.21.15.17:0/2010444021 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_dump_tree.TestDumpTree.test_basic"]} v 0) v1 -- 0x7f9ff004e030 con 0x7f9ff012f250 2024-03-12T17:19:26.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.478+0000 7f9fe7400640 1 -- 172.21.15.17:0/2010444021 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_dump_tree.TestDumpTree.test_basic"]}]=0 v56) v1 ==== 133+0+0 (secure 0 0 0) 0x7f9fe8078da0 con 0x7f9ff012f250 2024-03-12T17:19:26.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.482+0000 7f9fefe00640 1 -- 172.21.15.17:0/2010444021 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f9fcc06ac00 msgr2=0x7f9fcc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:26.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.482+0000 7f9fefe00640 1 --2- 172.21.15.17:0/2010444021 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f9fcc06ac00 0x7f9fcc06d0c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9fe00098d0 tx=0x7f9fe0008040 comp rx=0 tx=0).stop 2024-03-12T17:19:26.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.482+0000 7f9fefe00640 1 -- 172.21.15.17:0/2010444021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ff012f250 msgr2=0x7f9ff012f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:26.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.482+0000 7f9fefe00640 1 --2- 172.21.15.17:0/2010444021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ff012f250 0x7f9ff012f6d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9fe802bf80 tx=0x7f9fe8003a70 comp rx=0 tx=0).stop 2024-03-12T17:19:26.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.482+0000 7f9fefe00640 1 -- 172.21.15.17:0/2010444021 shutdown_connections 2024-03-12T17:19:26.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.482+0000 7f9fefe00640 1 --2- 172.21.15.17:0/2010444021 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f9fcc06ac00 0x7f9fcc06d0c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:26.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.482+0000 7f9fefe00640 1 --2- 172.21.15.17:0/2010444021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ff012f250 0x7f9ff012f6d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:26.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.482+0000 7f9fefe00640 1 --2- 172.21.15.17:0/2010444021 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ff012dc80 0x7f9ff00afd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:26.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.482+0000 7f9fefe00640 1 --2- 172.21.15.17:0/2010444021 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9fd4005180 0x7f9ff0144b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:26.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.482+0000 7f9fefe00640 1 -- 172.21.15.17:0/2010444021 >> 172.21.15.17:0/2010444021 conn(0x7f9ff0069ce0 msgr2=0x7f9ff00adb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:26.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.483+0000 7f9fefe00640 1 -- 172.21.15.17:0/2010444021 shutdown_connections 2024-03-12T17:19:26.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.483+0000 7f9fefe00640 1 -- 172.21.15.17:0/2010444021 wait complete. 2024-03-12T17:19:26.501 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-03-12T17:19:26.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.729+0000 7f54f9c00640 1 Processor -- start 2024-03-12T17:19:26.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.730+0000 7f54f9c00640 1 -- start start 2024-03-12T17:19:26.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.731+0000 7f54f9c00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f54f41441f0 0x7f54f4070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:26.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.731+0000 7f54f9c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f54f40b3b70 0x7f54f40b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:26.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.732+0000 7f54f9c00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54f40a7660 con 0x7f54f415ae20 2024-03-12T17:19:26.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.732+0000 7f54f9c00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54f415e460 con 0x7f54f41441f0 2024-03-12T17:19:26.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.732+0000 7f54f9c00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f406d840 con 0x7f54f40b3b70 2024-03-12T17:19:26.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.732+0000 7f54f3e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f54f41441f0 0x7f54f4070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:26.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.732+0000 7f54f9200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f54f40b3b70 0x7f54f40b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:26.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.732+0000 7f54f3e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f54f41441f0 0x7f54f4070240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.17:33378/0 (socket says 172.21.15.17:33378) 2024-03-12T17:19:26.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.733+0000 7f54f3e00640 1 -- 172.21.15.17:0/488617192 learned_addr learned my addr 172.21.15.17:0/488617192 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:26.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.732+0000 7f54f3400640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f54f415ae20 0x7f54f406d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.17:47456/0 (socket says 172.21.15.17:47456) 2024-03-12T17:19:26.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.733+0000 7f54f3e00640 1 -- 172.21.15.17:0/488617192 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f54f40b3b70 msgr2=0x7f54f40b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:26.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.733+0000 7f54f3e00640 1 --2- 172.21.15.17:0/488617192 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f54f40b3b70 0x7f54f40b3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:26.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.733+0000 7f54f3e00640 1 -- 172.21.15.17:0/488617192 >> v1:172.21.15.94:6789/0 conn(0x7f54f415ae20 legacy=0x7f54f406d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:26.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.733+0000 7f54f3e00640 1 -- 172.21.15.17:0/488617192 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f40b44e0 con 0x7f54f41441f0 2024-03-12T17:19:26.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.735+0000 7f54f3e00640 1 --2- 172.21.15.17:0/488617192 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f54f41441f0 0x7f54f4070240 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f54e4009870 tx=0x7f54e402ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=faebd025b3b17081 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:26.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.735+0000 7f54f2a00640 1 -- 172.21.15.17:0/488617192 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e402f830 con 0x7f54f41441f0 2024-03-12T17:19:26.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.735+0000 7f54f2a00640 1 -- 172.21.15.17:0/488617192 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e402f990 con 0x7f54f41441f0 2024-03-12T17:19:26.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.735+0000 7f54f2a00640 1 -- 172.21.15.17:0/488617192 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e402fd20 con 0x7f54f41441f0 2024-03-12T17:19:26.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.736+0000 7f54f9c00640 1 -- 172.21.15.17:0/488617192 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f54f41441f0 msgr2=0x7f54f4070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:26.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.736+0000 7f54f9c00640 1 --2- 172.21.15.17:0/488617192 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f54f41441f0 0x7f54f4070240 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f54e4009870 tx=0x7f54e402ba10 comp rx=0 tx=0).stop 2024-03-12T17:19:26.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.736+0000 7f54f9c00640 1 -- 172.21.15.17:0/488617192 shutdown_connections 2024-03-12T17:19:26.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.736+0000 7f54f9c00640 1 --2- 172.21.15.17:0/488617192 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f54f40b3b70 0x7f54f40b3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:26.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.736+0000 7f54f9c00640 1 --2- 172.21.15.17:0/488617192 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f54f41441f0 0x7f54f4070240 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:26.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.736+0000 7f54f9c00640 1 -- 172.21.15.17:0/488617192 >> 172.21.15.17:0/488617192 conn(0x7f54f4069ce0 msgr2=0x7f54f406a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:26.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.736+0000 7f54f9c00640 1 -- 172.21.15.17:0/488617192 shutdown_connections 2024-03-12T17:19:26.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.736+0000 7f54f9c00640 1 -- 172.21.15.17:0/488617192 wait complete. 2024-03-12T17:19:26.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.739+0000 7f54f9c00640 1 Processor -- start 2024-03-12T17:19:26.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.739+0000 7f54f9c00640 1 -- start start 2024-03-12T17:19:26.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.740+0000 7f54f9c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f54f40b3b70 0x7f54f413d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:26.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.740+0000 7f54f9c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54f41441f0 0x7f54f4142250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:26.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.740+0000 7f54f9c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f54f415ae20 0x7f54f413e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:26.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.740+0000 7f54f9c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f413d670 con 0x7f54f41441f0 2024-03-12T17:19:26.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.740+0000 7f54f9c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54f413d950 con 0x7f54f40b3b70 2024-03-12T17:19:26.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.740+0000 7f54f9c00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54f413dc30 con 0x7f54f415ae20 2024-03-12T17:19:26.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.741+0000 7f54f3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54f41441f0 0x7f54f4142250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:26.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.741+0000 7f54f3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54f41441f0 0x7f54f4142250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46604/0 (socket says 172.21.15.17:46604) 2024-03-12T17:19:26.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.741+0000 7f54f3400640 1 -- 172.21.15.17:0/486180130 learned_addr learned my addr 172.21.15.17:0/486180130 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:26.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.741+0000 7f54f3e00640 1 --2- 172.21.15.17:0/486180130 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f54f40b3b70 0x7f54f413d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:26.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.741+0000 7f54f9200640 1 --2- 172.21.15.17:0/486180130 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f54f415ae20 0x7f54f413e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:26.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.741+0000 7f54f3400640 1 -- 172.21.15.17:0/486180130 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f54f415ae20 msgr2=0x7f54f413e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:26.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.741+0000 7f54f3400640 1 --2- 172.21.15.17:0/486180130 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f54f415ae20 0x7f54f413e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:26.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.741+0000 7f54f3400640 1 -- 172.21.15.17:0/486180130 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f54f40b3b70 msgr2=0x7f54f413d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:26.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.741+0000 7f54f3400640 1 --2- 172.21.15.17:0/486180130 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f54f40b3b70 0x7f54f413d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:26.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.741+0000 7f54f3400640 1 -- 172.21.15.17:0/486180130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e40094d0 con 0x7f54f41441f0 2024-03-12T17:19:26.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.742+0000 7f54f3400640 1 --2- 172.21.15.17:0/486180130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54f41441f0 0x7f54f4142250 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f54e000c3e0 tx=0x7f54e000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:26.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.742+0000 7f54ebe00640 1 -- 172.21.15.17:0/486180130 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e00074e0 con 0x7f54f41441f0 2024-03-12T17:19:26.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.742+0000 7f54ebe00640 1 -- 172.21.15.17:0/486180130 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54e0007640 con 0x7f54f41441f0 2024-03-12T17:19:26.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.742+0000 7f54ebe00640 1 -- 172.21.15.17:0/486180130 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54e00049e0 con 0x7f54f41441f0 2024-03-12T17:19:26.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.742+0000 7f54f9c00640 1 -- 172.21.15.17:0/486180130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54f413df10 con 0x7f54f41441f0 2024-03-12T17:19:26.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.742+0000 7f54f9c00640 1 -- 172.21.15.17:0/486180130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54f4142790 con 0x7f54f41441f0 2024-03-12T17:19:26.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.744+0000 7f54f9c00640 1 -- 172.21.15.17:0/486180130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54f404e030 con 0x7f54f41441f0 2024-03-12T17:19:26.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.744+0000 7f54ebe00640 1 -- 172.21.15.17:0/486180130 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f54e0004b40 con 0x7f54f41441f0 2024-03-12T17:19:26.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.745+0000 7f54ebe00640 1 --2- 172.21.15.17:0/486180130 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f54d406ac00 0x7f54d406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:26.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.745+0000 7f54ebe00640 1 -- 172.21.15.17:0/486180130 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f54e0088c30 con 0x7f54f41441f0 2024-03-12T17:19:26.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.746+0000 7f54f3e00640 1 --2- 172.21.15.17:0/486180130 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f54d406ac00 0x7f54d406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:26.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.746+0000 7f54f3e00640 1 --2- 172.21.15.17:0/486180130 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f54d406ac00 0x7f54d406d0c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f54e4036000 tx=0x7f54e4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:26.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.750+0000 7f54ebe00640 1 -- 172.21.15.17:0/486180130 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f54e008f080 con 0x7f54f41441f0 2024-03-12T17:19:26.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.953+0000 7f54f9c00640 1 -- 172.21.15.17:0/486180130 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f54f406c990 con 0x7f54f41441f0 2024-03-12T17:19:26.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.960+0000 7f54ebe00640 1 -- 172.21.15.17:0/486180130 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f54e0053ea0 con 0x7f54f41441f0 2024-03-12T17:19:26.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.962+0000 7f54f9c00640 1 -- 172.21.15.17:0/486180130 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f54d406ac00 msgr2=0x7f54d406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:26.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.962+0000 7f54f9c00640 1 --2- 172.21.15.17:0/486180130 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f54d406ac00 0x7f54d406d0c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f54e4036000 tx=0x7f54e4008030 comp rx=0 tx=0).stop 2024-03-12T17:19:26.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.962+0000 7f54f9c00640 1 -- 172.21.15.17:0/486180130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54f41441f0 msgr2=0x7f54f4142250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:26.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.962+0000 7f54f9c00640 1 --2- 172.21.15.17:0/486180130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54f41441f0 0x7f54f4142250 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f54e000c3e0 tx=0x7f54e000c8a0 comp rx=0 tx=0).stop 2024-03-12T17:19:26.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.962+0000 7f54f9c00640 1 -- 172.21.15.17:0/486180130 shutdown_connections 2024-03-12T17:19:26.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.962+0000 7f54f9c00640 1 --2- 172.21.15.17:0/486180130 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f54d406ac00 0x7f54d406d0c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:26.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.963+0000 7f54f9c00640 1 --2- 172.21.15.17:0/486180130 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f54f415ae20 0x7f54f413e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:26.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.963+0000 7f54f9c00640 1 --2- 172.21.15.17:0/486180130 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f54f41441f0 0x7f54f4142250 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:26.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.963+0000 7f54f9c00640 1 --2- 172.21.15.17:0/486180130 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f54f40b3b70 0x7f54f413d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:26.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.963+0000 7f54f9c00640 1 -- 172.21.15.17:0/486180130 >> 172.21.15.17:0/486180130 conn(0x7f54f4069ce0 msgr2=0x7f54f40b2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:26.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.963+0000 7f54f9c00640 1 -- 172.21.15.17:0/486180130 shutdown_connections 2024-03-12T17:19:26.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:26.963+0000 7f54f9c00640 1 -- 172.21.15.17:0/486180130 wait complete. 2024-03-12T17:19:26.977 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-12T17:19:26.977 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-12T17:19:27.090 DEBUG:teuthology.orchestra.run.smithi094:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-12T17:19:27.209 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-12T17:19:27.209 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:19:27.210 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-12T17:19:27.266 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:19:27.266 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-12T17:19:27.315 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:19:27.315 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-12T17:19:27.364 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T17:19:27.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.627+0000 7fdae3a00640 1 Processor -- start 2024-03-12T17:19:27.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.627+0000 7fdae3a00640 1 -- start start 2024-03-12T17:19:27.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.628+0000 7fdae3a00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fdadc15ca10 0x7fdadc0abd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:27.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.628+0000 7fdae3a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fdadc0b2830 0x7fdadc0cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:27.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.628+0000 7fdae3a00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdadc15dee0 con 0x7fdadc15cdf0 2024-03-12T17:19:27.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.628+0000 7fdae3a00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdadc15d2d0 con 0x7fdadc0b2830 2024-03-12T17:19:27.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.628+0000 7fdae3a00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdadc15d5b0 con 0x7fdadc15ca10 2024-03-12T17:19:27.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.629+0000 7fdae1a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fdadc0b2830 0x7fdadc0cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:27.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.629+0000 7fdae1a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fdadc0b2830 0x7fdadc0cee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46612/0 (socket says 172.21.15.17:46612) 2024-03-12T17:19:27.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.629+0000 7fdae1a00640 1 -- 172.21.15.17:0/845016951 learned_addr learned my addr 172.21.15.17:0/845016951 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:27.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.629+0000 7fdae1000640 1 --2- 172.21.15.17:0/845016951 >> v2:172.21.15.94:3300/0 conn(0x7fdadc15ca10 0x7fdadc0abd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:27.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.629+0000 7fdae1a00640 1 -- 172.21.15.17:0/845016951 >> v2:172.21.15.94:3300/0 conn(0x7fdadc15ca10 msgr2=0x7fdadc0abd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:27.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.629+0000 7fdae1a00640 1 --2- 172.21.15.17:0/845016951 >> v2:172.21.15.94:3300/0 conn(0x7fdadc15ca10 0x7fdadc0abd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:27.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.629+0000 7fdae1a00640 1 -- 172.21.15.17:0/845016951 >> v1:172.21.15.94:6789/0 conn(0x7fdadc15cdf0 legacy=0x7fdadc0b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:27.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.629+0000 7fdae1a00640 1 -- 172.21.15.17:0/845016951 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdadc15d890 con 0x7fdadc0b2830 2024-03-12T17:19:27.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.631+0000 7fdae1a00640 1 --2- 172.21.15.17:0/845016951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdadc0b2830 0x7fdadc0cee40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdadc06e7f0 tx=0x7fdad402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e981eebafcc1541 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:27.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.631+0000 7fdadb400640 1 -- 172.21.15.17:0/845016951 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad4031870 con 0x7fdadc0b2830 2024-03-12T17:19:27.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.631+0000 7fdadb400640 1 -- 172.21.15.17:0/845016951 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad40319d0 con 0x7fdadc0b2830 2024-03-12T17:19:27.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.631+0000 7fdadb400640 1 -- 172.21.15.17:0/845016951 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad4031d60 con 0x7fdadc0b2830 2024-03-12T17:19:27.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.632+0000 7fdae3a00640 1 -- 172.21.15.17:0/845016951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdadc0b2830 msgr2=0x7fdadc0cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:27.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.632+0000 7fdae3a00640 1 --2- 172.21.15.17:0/845016951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdadc0b2830 0x7fdadc0cee40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fdadc06e7f0 tx=0x7fdad402b910 comp rx=0 tx=0).stop 2024-03-12T17:19:27.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.632+0000 7fdae3a00640 1 -- 172.21.15.17:0/845016951 shutdown_connections 2024-03-12T17:19:27.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.632+0000 7fdae3a00640 1 --2- 172.21.15.17:0/845016951 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdadc0b2830 0x7fdadc0cee40 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:27.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.632+0000 7fdae3a00640 1 --2- 172.21.15.17:0/845016951 >> v2:172.21.15.94:3300/0 conn(0x7fdadc15ca10 0x7fdadc0abd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:27.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.632+0000 7fdae3a00640 1 -- 172.21.15.17:0/845016951 >> 172.21.15.17:0/845016951 conn(0x7fdadc069ce0 msgr2=0x7fdadc06a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:27.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.632+0000 7fdae3a00640 1 -- 172.21.15.17:0/845016951 shutdown_connections 2024-03-12T17:19:27.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.632+0000 7fdae3a00640 1 -- 172.21.15.17:0/845016951 wait complete. 2024-03-12T17:19:27.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.634+0000 7fdae3a00640 1 Processor -- start 2024-03-12T17:19:27.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.634+0000 7fdae3a00640 1 -- start start 2024-03-12T17:19:27.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.635+0000 7fdae3a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdadc0b2830 0x7fdadc15b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:27.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.635+0000 7fdae3a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdadc15ca10 0x7fdadc14db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:27.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.635+0000 7fdae3a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdadc15cdf0 0x7fdadc1f6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:27.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.635+0000 7fdae3a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc1f5880 con 0x7fdadc15ca10 2024-03-12T17:19:27.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.635+0000 7fdae3a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc14e6c0 con 0x7fdadc15cdf0 2024-03-12T17:19:27.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.635+0000 7fdae3a00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc15bb60 con 0x7fdadc0b2830 2024-03-12T17:19:27.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.635+0000 7fdadbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdadc15ca10 0x7fdadc14db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:27.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.635+0000 7fdadbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdadc15ca10 0x7fdadc14db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46624/0 (socket says 172.21.15.17:46624) 2024-03-12T17:19:27.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.636+0000 7fdadbe00640 1 -- 172.21.15.17:0/3742189969 learned_addr learned my addr 172.21.15.17:0/3742189969 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:27.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.636+0000 7fdae1000640 1 --2- 172.21.15.17:0/3742189969 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdadc0b2830 0x7fdadc15b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:27.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.636+0000 7fdadbe00640 1 -- 172.21.15.17:0/3742189969 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdadc0b2830 msgr2=0x7fdadc15b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:27.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.636+0000 7fdadbe00640 1 --2- 172.21.15.17:0/3742189969 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdadc0b2830 0x7fdadc15b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:27.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.636+0000 7fdadbe00640 1 -- 172.21.15.17:0/3742189969 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdadc15cdf0 msgr2=0x7fdadc1f6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:27.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.636+0000 7fdadbe00640 1 --2- 172.21.15.17:0/3742189969 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdadc15cdf0 0x7fdadc1f6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:27.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.636+0000 7fdadbe00640 1 -- 172.21.15.17:0/3742189969 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad40094d0 con 0x7fdadc15ca10 2024-03-12T17:19:27.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.636+0000 7fdadbe00640 1 --2- 172.21.15.17:0/3742189969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdadc15ca10 0x7fdadc14db40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdac800ba50 tx=0x7fdac800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:27.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.636+0000 7fdad8c00640 1 -- 172.21.15.17:0/3742189969 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac800cbe0 con 0x7fdadc15ca10 2024-03-12T17:19:27.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.637+0000 7fdad8c00640 1 -- 172.21.15.17:0/3742189969 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac800cd80 con 0x7fdadc15ca10 2024-03-12T17:19:27.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.637+0000 7fdad8c00640 1 -- 172.21.15.17:0/3742189969 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac8014680 con 0x7fdadc15ca10 2024-03-12T17:19:27.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.637+0000 7fdae3a00640 1 -- 172.21.15.17:0/3742189969 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdadc1533d0 con 0x7fdadc15ca10 2024-03-12T17:19:27.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.637+0000 7fdae3a00640 1 -- 172.21.15.17:0/3742189969 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdadc1f5af0 con 0x7fdadc15ca10 2024-03-12T17:19:27.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.638+0000 7fdae3a00640 1 -- 172.21.15.17:0/3742189969 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdadc0736c0 con 0x7fdadc15ca10 2024-03-12T17:19:27.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.639+0000 7fdad8c00640 1 -- 172.21.15.17:0/3742189969 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fdac80147e0 con 0x7fdadc15ca10 2024-03-12T17:19:27.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.640+0000 7fdad8c00640 1 --2- 172.21.15.17:0/3742189969 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fdabc06ac00 0x7fdabc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:27.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.640+0000 7fdad8c00640 1 -- 172.21.15.17:0/3742189969 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdac80892a0 con 0x7fdadc15ca10 2024-03-12T17:19:27.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.640+0000 7fdae1000640 1 --2- 172.21.15.17:0/3742189969 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fdabc06ac00 0x7fdabc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:27.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.641+0000 7fdae1000640 1 --2- 172.21.15.17:0/3742189969 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fdabc06ac00 0x7fdabc06d0c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdacc006fd0 tx=0x7fdacc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:27.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.644+0000 7fdad8c00640 1 -- 172.21.15.17:0/3742189969 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fdac8054490 con 0x7fdadc15ca10 2024-03-12T17:19:27.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.864+0000 7fdae3a00640 1 -- 172.21.15.17:0/3742189969 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdadc0aed40 con 0x7fdadc15ca10 2024-03-12T17:19:27.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.866+0000 7fdad8c00640 1 -- 172.21.15.17:0/3742189969 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15989 (secure 0 0 0) 0x7fdac8057ab0 con 0x7fdadc15ca10 2024-03-12T17:19:27.861 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:19:27.861 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":21,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:18:46.845635+0000","last_up_change":"2024-03-12T17:18:38.144756+0000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-12T17:18:39.552910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-12T17:18:43.794908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-12T17:18:44.867006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":37305},{"type":"v1","addr":"172.21.15.17:6801","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":37305},{"type":"v1","addr":"172.21.15.17:6803","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":37305},{"type":"v1","addr":"172.21.15.17:6807","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":37305},{"type":"v1","addr":"172.21.15.17:6805","nonce":37305}]},"public_addr":"172.21.15.17:6801/37305","cluster_addr":"172.21.15.17:6803/37305","heartbeat_back_addr":"172.21.15.17:6807/37305","heartbeat_front_addr":"172.21.15.17:6805/37305","state":["exists","up"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":37307},{"type":"v1","addr":"172.21.15.17:6814","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":37307},{"type":"v1","addr":"172.21.15.17:6818","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":37307},{"type":"v1","addr":"172.21.15.17:6827","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":37307},{"type":"v1","addr":"172.21.15.17:6823","nonce":37307}]},"public_addr":"172.21.15.17:6814/37307","cluster_addr":"172.21.15.17:6818/37307","heartbeat_back_addr":"172.21.15.17:6827/37307","heartbeat_front_addr":"172.21.15.17:6823/37307","state":["exists","up"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":37303},{"type":"v1","addr":"172.21.15.17:6809","nonce":37303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":37303},{"type":"v1","addr":"172.21.15.17:6811","nonce":37303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":37303},{"type":"v1","addr":"172.21.15.17:6819","nonce":37303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":37303},{"type":"v1","addr":"172.21.15.17:6815","nonce":37303}]},"public_addr":"172.21.15.17:6809/37303","cluster_addr":"172.21.15.17:6811/37303","heartbeat_back_addr":"172.21.15.17:6819/37303","heartbeat_front_addr":"172.21.15.17:6815/37303","state":["exists","up"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":37308},{"type":"v1","addr":"172.21.15.17:6822","nonce":37308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":37308},{"type":"v1","addr":"172.21.15.17:6826","nonce":37308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":37308},{"type":"v1","addr":"172.21.15.17:6831","nonce":37308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":37308},{"type":"v1","addr":"172.21.15.17:6829","nonce":37308}]},"public_addr":"172.21.15.17:6822/37308","cluster_addr":"172.21.15.17:6826/37308","heartbeat_back_addr":"172.21.15.17:6831/37308","heartbeat_front_addr":"172.21.15.17:6829/37308","state":["exists","up"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":37465},{"type":"v1","addr":"172.21.15.94:6809","nonce":37465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6811","nonce":37465},{"type":"v1","addr":"172.21.15.94:6813","nonce":37465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6819","nonce":37465},{"type":"v1","addr":"172.21.15.94:6822","nonce":37465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6815","nonce":37465},{"type":"v1","addr":"172.21.15.94:6817","nonce":37465}]},"public_addr":"172.21.15.94:6809/37465","cluster_addr":"172.21.15.94:6813/37465","heartbeat_back_addr":"172.21.15.94:6822/37465","heartbeat_front_addr":"172.21.15.94:6817/37465","state":["exists","up"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":37464},{"type":"v1","addr":"172.21.15.94:6812","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":37464},{"type":"v1","addr":"172.21.15.94:6816","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":37464},{"type":"v1","addr":"172.21.15.94:6823","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":37464},{"type":"v1","addr":"172.21.15.94:6820","nonce":37464}]},"public_addr":"172.21.15.94:6812/37464","cluster_addr":"172.21.15.94:6816/37464","heartbeat_back_addr":"172.21.15.94:6823/37464","heartbeat_front_addr":"172.21.15.94:6820/37464","state":["exists","up"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":37467},{"type":"v1","addr":"172.21.15.94:6825","nonce":37467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":37467},{"type":"v1","addr":"172.21.15.94:6827","nonce":37467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":37467},{"type":"v1","addr":"172.21.15.94:6831","nonce":37467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":37467},{"type":"v1","addr":"172.21.15.94:6829","nonce":37467}]},"public_addr":"172.21.15.94:6825/37467","cluster_addr":"172.21.15.94:6827/37467","heartbeat_back_addr":"172.21.15.94:6831/37467","heartbeat_front_addr":"172.21.15.94:6829/37467","state":["exists","up"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":37466},{"type":"v1","addr":"172.21.15.94:6801","nonce":37466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":37466},{"type":"v1","addr":"172.21.15.94:6803","nonce":37466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":37466},{"type":"v1","addr":"172.21.15.94:6807","nonce":37466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":37466},{"type":"v1","addr":"172.21.15.94:6805","nonce":37466}]},"public_addr":"172.21.15.94:6801/37466","cluster_addr":"172.21.15.94:6803/37466","heartbeat_back_addr":"172.21.15.94:6807/37466","heartbeat_front_addr":"172.21.15.94:6805/37466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.327217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.186966+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.419986+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.150585+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.120621+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.121576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.181257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.293188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:19:27.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.868+0000 7fdae3a00640 1 -- 172.21.15.17:0/3742189969 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fdabc06ac00 msgr2=0x7fdabc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:27.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.868+0000 7fdae3a00640 1 --2- 172.21.15.17:0/3742189969 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fdabc06ac00 0x7fdabc06d0c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fdacc006fd0 tx=0x7fdacc008040 comp rx=0 tx=0).stop 2024-03-12T17:19:27.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.868+0000 7fdae3a00640 1 -- 172.21.15.17:0/3742189969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdadc15ca10 msgr2=0x7fdadc14db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:27.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.868+0000 7fdae3a00640 1 --2- 172.21.15.17:0/3742189969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdadc15ca10 0x7fdadc14db40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fdac800ba50 tx=0x7fdac800bf10 comp rx=0 tx=0).stop 2024-03-12T17:19:27.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.869+0000 7fdae3a00640 1 -- 172.21.15.17:0/3742189969 shutdown_connections 2024-03-12T17:19:27.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.869+0000 7fdae3a00640 1 --2- 172.21.15.17:0/3742189969 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fdabc06ac00 0x7fdabc06d0c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:27.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.869+0000 7fdae3a00640 1 --2- 172.21.15.17:0/3742189969 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdadc15cdf0 0x7fdadc1f6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:27.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.869+0000 7fdae3a00640 1 --2- 172.21.15.17:0/3742189969 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdadc15ca10 0x7fdadc14db40 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:27.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.869+0000 7fdae3a00640 1 --2- 172.21.15.17:0/3742189969 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdadc0b2830 0x7fdadc15b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:27.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.869+0000 7fdae3a00640 1 -- 172.21.15.17:0/3742189969 >> 172.21.15.17:0/3742189969 conn(0x7fdadc069ce0 msgr2=0x7fdadc06d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:27.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.869+0000 7fdae3a00640 1 -- 172.21.15.17:0/3742189969 shutdown_connections 2024-03-12T17:19:27.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:27.869+0000 7fdae3a00640 1 -- 172.21.15.17:0/3742189969 wait complete. 2024-03-12T17:19:27.881 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-12T17:18:39.552910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-12T17:18:43.794908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-12T17:18:44.867006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-12T17:19:27.882 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-12T17:19:28.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.076+0000 7fc4fa600640 1 Processor -- start 2024-03-12T17:19:28.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.077+0000 7fc4fa600640 1 -- start start 2024-03-12T17:19:28.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.078+0000 7fc4fa600640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc4f4098b40 0x7fc4f4098f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:28.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.078+0000 7fc4fa600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc4f40b1e20 0x7fc4f40b0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:28.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.078+0000 7fc4fa600640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4f40b0610 con 0x7fc4f40cb1f0 2024-03-12T17:19:28.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.078+0000 7fc4fa600640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4f4099460 con 0x7fc4f4098b40 2024-03-12T17:19:28.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.078+0000 7fc4fa600640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f40cf270 con 0x7fc4f40b1e20 2024-03-12T17:19:28.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.079+0000 7fc4f3e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc4f40b1e20 0x7fc4f40b0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:28.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.079+0000 7fc4f3e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc4f40b1e20 0x7fc4f40b0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.17:46996/0 (socket says 172.21.15.17:46996) 2024-03-12T17:19:28.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.079+0000 7fc4f3e00640 1 -- 172.21.15.17:0/2157871530 learned_addr learned my addr 172.21.15.17:0/2157871530 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:28.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.079+0000 7fc4f3400640 1 --2- 172.21.15.17:0/2157871530 >> v2:172.21.15.94:3300/0 conn(0x7fc4f4098b40 0x7fc4f4098f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:28.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.080+0000 7fc4f3e00640 1 -- 172.21.15.17:0/2157871530 >> v2:172.21.15.94:3300/0 conn(0x7fc4f4098b40 msgr2=0x7fc4f4098f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:28.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.080+0000 7fc4f3e00640 1 --2- 172.21.15.17:0/2157871530 >> v2:172.21.15.94:3300/0 conn(0x7fc4f4098b40 0x7fc4f4098f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:28.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.080+0000 7fc4f3e00640 1 -- 172.21.15.17:0/2157871530 >> v1:172.21.15.94:6789/0 conn(0x7fc4f40cb1f0 legacy=0x7fc4f40b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:28.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.080+0000 7fc4f3e00640 1 -- 172.21.15.17:0/2157871530 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f40cf550 con 0x7fc4f40b1e20 2024-03-12T17:19:28.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.081+0000 7fc4f3e00640 1 --2- 172.21.15.17:0/2157871530 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc4f40b1e20 0x7fc4f40b0aa0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec009e50 tx=0x7fc4ec02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b61c77453559919 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:28.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.081+0000 7fc4f2a00640 1 -- 172.21.15.17:0/2157871530 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec02cb00 con 0x7fc4f40b1e20 2024-03-12T17:19:28.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.081+0000 7fc4f2a00640 1 -- 172.21.15.17:0/2157871530 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ec02cc60 con 0x7fc4f40b1e20 2024-03-12T17:19:28.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.081+0000 7fc4f2a00640 1 -- 172.21.15.17:0/2157871530 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec0343f0 con 0x7fc4f40b1e20 2024-03-12T17:19:28.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.082+0000 7fc4fa600640 1 -- 172.21.15.17:0/2157871530 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc4f40b1e20 msgr2=0x7fc4f40b0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:28.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.082+0000 7fc4fa600640 1 --2- 172.21.15.17:0/2157871530 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc4f40b1e20 0x7fc4f40b0aa0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec009e50 tx=0x7fc4ec02bf60 comp rx=0 tx=0).stop 2024-03-12T17:19:28.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.082+0000 7fc4fa600640 1 -- 172.21.15.17:0/2157871530 shutdown_connections 2024-03-12T17:19:28.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.082+0000 7fc4fa600640 1 --2- 172.21.15.17:0/2157871530 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc4f40b1e20 0x7fc4f40b0aa0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:28.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.082+0000 7fc4fa600640 1 --2- 172.21.15.17:0/2157871530 >> v2:172.21.15.94:3300/0 conn(0x7fc4f4098b40 0x7fc4f4098f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:28.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.082+0000 7fc4fa600640 1 -- 172.21.15.17:0/2157871530 >> 172.21.15.17:0/2157871530 conn(0x7fc4f40b23d0 msgr2=0x7fc4f40b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:28.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.082+0000 7fc4fa600640 1 -- 172.21.15.17:0/2157871530 shutdown_connections 2024-03-12T17:19:28.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.082+0000 7fc4fa600640 1 -- 172.21.15.17:0/2157871530 wait complete. 2024-03-12T17:19:28.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.084+0000 7fc4fa600640 1 Processor -- start 2024-03-12T17:19:28.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.084+0000 7fc4fa600640 1 -- start start 2024-03-12T17:19:28.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.085+0000 7fc4fa600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc4f4098b40 0x7fc4f414e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:28.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.085+0000 7fc4fa600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4f40b1e20 0x7fc4f414b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:28.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.085+0000 7fc4fa600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4f40cb1f0 0x7fc4f40cdd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:28.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.085+0000 7fc4fa600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f414ea00 con 0x7fc4f40cb1f0 2024-03-12T17:19:28.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.085+0000 7fc4fa600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f414b740 con 0x7fc4f40b1e20 2024-03-12T17:19:28.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.085+0000 7fc4fa600640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f40ce250 con 0x7fc4f4098b40 2024-03-12T17:19:28.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.085+0000 7fc4f3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4f40cb1f0 0x7fc4f40cdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:28.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.085+0000 7fc4f3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4f40cb1f0 0x7fc4f40cdd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46630/0 (socket says 172.21.15.17:46630) 2024-03-12T17:19:28.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.085+0000 7fc4f3e00640 1 -- 172.21.15.17:0/2892788198 learned_addr learned my addr 172.21.15.17:0/2892788198 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:28.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.086+0000 7fc4ebe00640 1 --2- 172.21.15.17:0/2892788198 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4f40b1e20 0x7fc4f414b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:28.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.086+0000 7fc4f3400640 1 --2- 172.21.15.17:0/2892788198 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc4f4098b40 0x7fc4f414e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:28.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.086+0000 7fc4f3e00640 1 -- 172.21.15.17:0/2892788198 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc4f4098b40 msgr2=0x7fc4f414e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:28.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.086+0000 7fc4f3e00640 1 --2- 172.21.15.17:0/2892788198 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc4f4098b40 0x7fc4f414e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:28.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.086+0000 7fc4f3e00640 1 -- 172.21.15.17:0/2892788198 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4f40b1e20 msgr2=0x7fc4f414b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:28.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.086+0000 7fc4f3e00640 1 --2- 172.21.15.17:0/2892788198 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4f40b1e20 0x7fc4f414b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:28.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.086+0000 7fc4f3e00640 1 -- 172.21.15.17:0/2892788198 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ec009b30 con 0x7fc4f40cb1f0 2024-03-12T17:19:28.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.086+0000 7fc4ebe00640 1 --2- 172.21.15.17:0/2892788198 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4f40b1e20 0x7fc4f414b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:28.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.086+0000 7fc4f3400640 1 --2- 172.21.15.17:0/2892788198 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc4f4098b40 0x7fc4f414e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:28.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.086+0000 7fc4f3e00640 1 --2- 172.21.15.17:0/2892788198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4f40cb1f0 0x7fc4f40cdd10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec036040 tx=0x7fc4ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:28.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.086+0000 7fc4eb400640 1 -- 172.21.15.17:0/2892788198 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec03e450 con 0x7fc4f40cb1f0 2024-03-12T17:19:28.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.087+0000 7fc4eb400640 1 -- 172.21.15.17:0/2892788198 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ec03e5b0 con 0x7fc4f40cb1f0 2024-03-12T17:19:28.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.087+0000 7fc4eb400640 1 -- 172.21.15.17:0/2892788198 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec03e960 con 0x7fc4f40cb1f0 2024-03-12T17:19:28.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.087+0000 7fc4fa600640 1 -- 172.21.15.17:0/2892788198 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4f415a7c0 con 0x7fc4f40cb1f0 2024-03-12T17:19:28.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.087+0000 7fc4fa600640 1 -- 172.21.15.17:0/2892788198 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4f40ccf50 con 0x7fc4f40cb1f0 2024-03-12T17:19:28.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.088+0000 7fc4fa600640 1 -- 172.21.15.17:0/2892788198 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4f40736c0 con 0x7fc4f40cb1f0 2024-03-12T17:19:28.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.089+0000 7fc4eb400640 1 -- 172.21.15.17:0/2892788198 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fc4ec03eac0 con 0x7fc4f40cb1f0 2024-03-12T17:19:28.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.090+0000 7fc4eb400640 1 --2- 172.21.15.17:0/2892788198 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc4d006ac00 0x7fc4d006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:28.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.090+0000 7fc4eb400640 1 -- 172.21.15.17:0/2892788198 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc4ec0ac050 con 0x7fc4f40cb1f0 2024-03-12T17:19:28.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.090+0000 7fc4f3400640 1 --2- 172.21.15.17:0/2892788198 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc4d006ac00 0x7fc4d006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:28.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.091+0000 7fc4f3400640 1 --2- 172.21.15.17:0/2892788198 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc4d006ac00 0x7fc4d006d0c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4009a20 tx=0x7fc4e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:28.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.094+0000 7fc4eb400640 1 -- 172.21.15.17:0/2892788198 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fc4ec0df4f0 con 0x7fc4f40cb1f0 2024-03-12T17:19:28.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.289+0000 7fc4fa600640 1 -- 172.21.15.17:0/2892788198 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc4f40b3060 con 0x7fc4f40cb1f0 2024-03-12T17:19:28.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.290+0000 7fc4eb400640 1 -- 172.21.15.17:0/2892788198 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc4ec077190 con 0x7fc4f40cb1f0 2024-03-12T17:19:28.285 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-03-12T17:19:28.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.292+0000 7fc4fa600640 1 -- 172.21.15.17:0/2892788198 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc4d006ac00 msgr2=0x7fc4d006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:28.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.292+0000 7fc4fa600640 1 --2- 172.21.15.17:0/2892788198 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc4d006ac00 0x7fc4d006d0c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4009a20 tx=0x7fc4e4008040 comp rx=0 tx=0).stop 2024-03-12T17:19:28.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.292+0000 7fc4fa600640 1 -- 172.21.15.17:0/2892788198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4f40cb1f0 msgr2=0x7fc4f40cdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:28.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.292+0000 7fc4fa600640 1 --2- 172.21.15.17:0/2892788198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4f40cb1f0 0x7fc4f40cdd10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec036040 tx=0x7fc4ec004a40 comp rx=0 tx=0).stop 2024-03-12T17:19:28.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.292+0000 7fc4fa600640 1 -- 172.21.15.17:0/2892788198 shutdown_connections 2024-03-12T17:19:28.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.292+0000 7fc4fa600640 1 --2- 172.21.15.17:0/2892788198 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc4d006ac00 0x7fc4d006d0c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:28.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.292+0000 7fc4fa600640 1 --2- 172.21.15.17:0/2892788198 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc4f40cb1f0 0x7fc4f40cdd10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:28.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.292+0000 7fc4fa600640 1 --2- 172.21.15.17:0/2892788198 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc4f40b1e20 0x7fc4f414b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:28.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.292+0000 7fc4fa600640 1 --2- 172.21.15.17:0/2892788198 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc4f4098b40 0x7fc4f414e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:28.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.292+0000 7fc4fa600640 1 -- 172.21.15.17:0/2892788198 >> 172.21.15.17:0/2892788198 conn(0x7fc4f40b23d0 msgr2=0x7fc4f406f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:28.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.293+0000 7fc4fa600640 1 -- 172.21.15.17:0/2892788198 shutdown_connections 2024-03-12T17:19:28.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.293+0000 7fc4fa600640 1 -- 172.21.15.17:0/2892788198 wait complete. 2024-03-12T17:19:28.304 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-12T17:19:28.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.515+0000 7f931ae00640 1 Processor -- start 2024-03-12T17:19:28.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.515+0000 7f931ae00640 1 -- start start 2024-03-12T17:19:28.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.517+0000 7f931ae00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9314160090 0x7f931406b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:28.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.517+0000 7f931ae00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f93140b4b20 0x7f93140d1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:28.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.517+0000 7f931ae00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9314160470 con 0x7f93140b86c0 2024-03-12T17:19:28.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.517+0000 7f931ae00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93140d0e40 con 0x7f93140b4b20 2024-03-12T17:19:28.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.517+0000 7f931ae00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93140d0a80 con 0x7f9314160090 2024-03-12T17:19:28.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.517+0000 7f9319000640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f93140b86c0 0x7f93140b4410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:39410/0 (socket says 172.21.15.17:39410) 2024-03-12T17:19:28.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.517+0000 7f9319000640 1 -- 172.21.15.17:0/2736621311 learned_addr learned my addr 172.21.15.17:0/2736621311 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:28.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.518+0000 7f931a400640 1 --2- 172.21.15.17:0/2736621311 >> v2:172.21.15.94:3300/0 conn(0x7f93140b4b20 0x7f93140d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:28.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.518+0000 7f9313e00640 1 -- 172.21.15.17:0/2736621311 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3069729684 0 0) 0x7f9314160470 con 0x7f93140b86c0 2024-03-12T17:19:28.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.518+0000 7f9313e00640 1 -- 172.21.15.17:0/2736621311 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92fc003520 con 0x7f93140b86c0 2024-03-12T17:19:28.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.518+0000 7f9319a00640 1 --2- 172.21.15.17:0/2736621311 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9314160090 0x7f931406b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:28.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.518+0000 7f9313e00640 1 -- 172.21.15.17:0/2736621311 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1920887952 0 0) 0x7f92fc003520 con 0x7f93140b86c0 2024-03-12T17:19:28.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.518+0000 7f9313e00640 1 -- 172.21.15.17:0/2736621311 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9314160090 msgr2=0x7f931406b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:28.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.518+0000 7f9313e00640 1 --2- 172.21.15.17:0/2736621311 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9314160090 0x7f931406b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:28.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.518+0000 7f9313e00640 1 -- 172.21.15.17:0/2736621311 >> v2:172.21.15.94:3300/0 conn(0x7f93140b4b20 msgr2=0x7f93140d1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:28.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.518+0000 7f9313e00640 1 --2- 172.21.15.17:0/2736621311 >> v2:172.21.15.94:3300/0 conn(0x7f93140b4b20 0x7f93140d1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:28.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.518+0000 7f9313e00640 1 -- 172.21.15.17:0/2736621311 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f931406baa0 con 0x7f93140b86c0 2024-03-12T17:19:28.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.518+0000 7f9313e00640 1 -- 172.21.15.17:0/2736621311 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7f9304001670 con 0x7f93140b86c0 2024-03-12T17:19:28.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.518+0000 7f9319a00640 1 --2- 172.21.15.17:0/2736621311 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9314160090 0x7f931406b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:19:28.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.518+0000 7f9313e00640 1 -- 172.21.15.17:0/2736621311 >> v1:172.21.15.17:6789/0 conn(0x7f93140b86c0 legacy=0x7f93140b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:28.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.518+0000 7f9313e00640 1 --2- 172.21.15.17:0/2736621311 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92fc003970 0x7f92fc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:28.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.518+0000 7f9313e00640 1 --2- 172.21.15.17:0/2736621311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92fc0047c0 0x7f92fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:28.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.518+0000 7f9313e00640 1 --2- 172.21.15.17:0/2736621311 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9314160090 0x7f92fc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:28.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.518+0000 7f9313e00640 1 -- 172.21.15.17:0/2736621311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93140d0e40 con 0x7f92fc0047c0 2024-03-12T17:19:28.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.518+0000 7f9313e00640 1 -- 172.21.15.17:0/2736621311 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93140d0a80 con 0x7f92fc003970 2024-03-12T17:19:28.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.518+0000 7f9313e00640 1 -- 172.21.15.17:0/2736621311 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc00ba30 con 0x7f9314160090 2024-03-12T17:19:28.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.518+0000 7f9319000640 1 --2- 172.21.15.17:0/2736621311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92fc0047c0 0x7f92fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:28.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.519+0000 7f9319000640 1 -- 172.21.15.17:0/2736621311 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9314160090 msgr2=0x7f92fc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:28.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.519+0000 7f9319000640 1 --2- 172.21.15.17:0/2736621311 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9314160090 0x7f92fc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:28.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.519+0000 7f9319000640 1 -- 172.21.15.17:0/2736621311 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92fc003970 msgr2=0x7f92fc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:28.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.519+0000 7f9319000640 1 --2- 172.21.15.17:0/2736621311 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92fc003970 0x7f92fc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:28.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.519+0000 7f9319000640 1 -- 172.21.15.17:0/2736621311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92fc003520 con 0x7f92fc0047c0 2024-03-12T17:19:28.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.520+0000 7f9319000640 1 --2- 172.21.15.17:0/2736621311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92fc0047c0 0x7f92fc004c40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f93140b8b00 tx=0x7f92fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=998072391998641 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:28.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.520+0000 7f9313e00640 1 -- 172.21.15.17:0/2736621311 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9304005ad0 con 0x7f92fc0047c0 2024-03-12T17:19:28.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.520+0000 7f9313e00640 1 -- 172.21.15.17:0/2736621311 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9304005c50 con 0x7f92fc0047c0 2024-03-12T17:19:28.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.520+0000 7f9313e00640 1 -- 172.21.15.17:0/2736621311 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930402c7c0 con 0x7f92fc0047c0 2024-03-12T17:19:28.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.521+0000 7f931ae00640 1 -- 172.21.15.17:0/2736621311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92fc0047c0 msgr2=0x7f92fc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:28.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.521+0000 7f931ae00640 1 --2- 172.21.15.17:0/2736621311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92fc0047c0 0x7f92fc004c40 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f93140b8b00 tx=0x7f92fc0057f0 comp rx=0 tx=0).stop 2024-03-12T17:19:28.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.521+0000 7f931a400640 1 -- 172.21.15.17:0/2736621311 reap_dead start 2024-03-12T17:19:28.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.521+0000 7f931ae00640 1 -- 172.21.15.17:0/2736621311 shutdown_connections 2024-03-12T17:19:28.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.521+0000 7f931ae00640 1 -- 172.21.15.17:0/2736621311 >> 172.21.15.17:0/2736621311 conn(0x7f93140cf5f0 msgr2=0x7f93140cfa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:28.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.521+0000 7f931ae00640 1 -- 172.21.15.17:0/2736621311 shutdown_connections 2024-03-12T17:19:28.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.521+0000 7f931ae00640 1 -- 172.21.15.17:0/2736621311 wait complete. 2024-03-12T17:19:28.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.523+0000 7f931ae00640 1 Processor -- start 2024-03-12T17:19:28.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.523+0000 7f931ae00640 1 -- start start 2024-03-12T17:19:28.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.524+0000 7f931ae00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92fc0047c0 0x7f93140cc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:28.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.524+0000 7f931ae00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9314155650 0x7f93141f4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:28.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.524+0000 7f931ae00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93140b3ae0 0x7f93140b3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:28.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.524+0000 7f931ae00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93140b4480 con 0x7f93140b3ae0 2024-03-12T17:19:28.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.524+0000 7f931ae00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9314155d70 con 0x7f92fc0047c0 2024-03-12T17:19:28.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.524+0000 7f931ae00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93140ccec0 con 0x7f9314155650 2024-03-12T17:19:28.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.524+0000 7f931a400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93140b3ae0 0x7f93140b3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:28.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.524+0000 7f931a400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93140b3ae0 0x7f93140b3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46648/0 (socket says 172.21.15.17:46648) 2024-03-12T17:19:28.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.524+0000 7f931a400640 1 -- 172.21.15.17:0/3323585323 learned_addr learned my addr 172.21.15.17:0/3323585323 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:28.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.525+0000 7f9319a00640 1 --2- 172.21.15.17:0/3323585323 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92fc0047c0 0x7f93140cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:28.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.525+0000 7f9319000640 1 --2- 172.21.15.17:0/3323585323 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9314155650 0x7f93141f4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:28.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.525+0000 7f931a400640 1 -- 172.21.15.17:0/3323585323 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9314155650 msgr2=0x7f93141f4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:28.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.525+0000 7f931a400640 1 --2- 172.21.15.17:0/3323585323 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9314155650 0x7f93141f4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:28.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.525+0000 7f931a400640 1 -- 172.21.15.17:0/3323585323 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92fc0047c0 msgr2=0x7f93140cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:28.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.525+0000 7f931a400640 1 --2- 172.21.15.17:0/3323585323 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92fc0047c0 0x7f93140cc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:28.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.525+0000 7f931a400640 1 -- 172.21.15.17:0/3323585323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f931415ae10 con 0x7f93140b3ae0 2024-03-12T17:19:28.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.525+0000 7f9319a00640 1 --2- 172.21.15.17:0/3323585323 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92fc0047c0 0x7f93140cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:28.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.525+0000 7f9319000640 1 --2- 172.21.15.17:0/3323585323 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9314155650 0x7f93141f4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:28.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.525+0000 7f931a400640 1 --2- 172.21.15.17:0/3323585323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93140b3ae0 0x7f93140b3f40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f93140b5480 tx=0x7f930c00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:28.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.525+0000 7f9311600640 1 -- 172.21.15.17:0/3323585323 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930c010040 con 0x7f93140b3ae0 2024-03-12T17:19:28.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.525+0000 7f9311600640 1 -- 172.21.15.17:0/3323585323 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f930c00bae0 con 0x7f93140b3ae0 2024-03-12T17:19:28.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.526+0000 7f9311600640 1 -- 172.21.15.17:0/3323585323 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930c00be70 con 0x7f93140b3ae0 2024-03-12T17:19:28.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.526+0000 7f931ae00640 1 -- 172.21.15.17:0/3323585323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f931415b0f0 con 0x7f93140b3ae0 2024-03-12T17:19:28.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.526+0000 7f931ae00640 1 -- 172.21.15.17:0/3323585323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9314155ad0 con 0x7f93140b3ae0 2024-03-12T17:19:28.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.527+0000 7f931ae00640 1 -- 172.21.15.17:0/3323585323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9314067120 con 0x7f93140b3ae0 2024-03-12T17:19:28.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.528+0000 7f9311600640 1 -- 172.21.15.17:0/3323585323 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f930c01d400 con 0x7f93140b3ae0 2024-03-12T17:19:28.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.529+0000 7f9311600640 1 --2- 172.21.15.17:0/3323585323 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f92f806ac00 0x7f92f806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:28.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.530+0000 7f9311600640 1 -- 172.21.15.17:0/3323585323 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f930c089a50 con 0x7f93140b3ae0 2024-03-12T17:19:28.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.530+0000 7f9319a00640 1 --2- 172.21.15.17:0/3323585323 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f92f806ac00 0x7f92f806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:28.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.530+0000 7f9319a00640 1 --2- 172.21.15.17:0/3323585323 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f92f806ac00 0x7f92f806d0c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9308006a90 tx=0x7f9308008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:28.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.534+0000 7f9311600640 1 -- 172.21.15.17:0/3323585323 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f930c0586b0 con 0x7f93140b3ae0 2024-03-12T17:19:28.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.733+0000 7f931ae00640 1 -- 172.21.15.17:0/3323585323 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9314072360 con 0x7f93140b3ae0 2024-03-12T17:19:28.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.734+0000 7f9311600640 1 -- 172.21.15.17:0/3323585323 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f930c058240 con 0x7f93140b3ae0 2024-03-12T17:19:28.729 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-03-12T17:19:28.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.736+0000 7f931ae00640 1 -- 172.21.15.17:0/3323585323 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f92f806ac00 msgr2=0x7f92f806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:28.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.736+0000 7f931ae00640 1 --2- 172.21.15.17:0/3323585323 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f92f806ac00 0x7f92f806d0c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9308006a90 tx=0x7f9308008040 comp rx=0 tx=0).stop 2024-03-12T17:19:28.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.736+0000 7f931ae00640 1 -- 172.21.15.17:0/3323585323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93140b3ae0 msgr2=0x7f93140b3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:28.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.736+0000 7f931ae00640 1 --2- 172.21.15.17:0/3323585323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93140b3ae0 0x7f93140b3f40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f93140b5480 tx=0x7f930c00b480 comp rx=0 tx=0).stop 2024-03-12T17:19:28.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.736+0000 7f931ae00640 1 -- 172.21.15.17:0/3323585323 shutdown_connections 2024-03-12T17:19:28.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.736+0000 7f931ae00640 1 --2- 172.21.15.17:0/3323585323 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f92f806ac00 0x7f92f806d0c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:28.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.736+0000 7f931ae00640 1 --2- 172.21.15.17:0/3323585323 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93140b3ae0 0x7f93140b3f40 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:28.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.736+0000 7f931ae00640 1 --2- 172.21.15.17:0/3323585323 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9314155650 0x7f93141f4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:28.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.736+0000 7f931ae00640 1 --2- 172.21.15.17:0/3323585323 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92fc0047c0 0x7f93140cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:28.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.736+0000 7f931ae00640 1 -- 172.21.15.17:0/3323585323 >> 172.21.15.17:0/3323585323 conn(0x7f93140cf5f0 msgr2=0x7f93140cd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:28.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.737+0000 7f931ae00640 1 -- 172.21.15.17:0/3323585323 shutdown_connections 2024-03-12T17:19:28.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.737+0000 7f931ae00640 1 -- 172.21.15.17:0/3323585323 wait complete. 2024-03-12T17:19:28.749 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-12T17:19:28.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.962+0000 7f8e2d800640 1 Processor -- start 2024-03-12T17:19:28.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.962+0000 7f8e2d800640 1 -- start start 2024-03-12T17:19:28.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.964+0000 7f8e2d800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8e280b2070 0x7f8e280b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:28.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.964+0000 7f8e2d800640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e280ce320 con 0x7f8e280cb970 2024-03-12T17:19:28.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.964+0000 7f8e2d800640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e28144620 con 0x7f8e28144240 2024-03-12T17:19:28.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.964+0000 7f8e2d800640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e2815f3d0 con 0x7f8e280b2070 2024-03-12T17:19:28.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.964+0000 7f8e26000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8e280b2070 0x7f8e280b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:28.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.964+0000 7f8e26000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8e280b2070 0x7f8e280b2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46650/0 (socket says 172.21.15.17:46650) 2024-03-12T17:19:28.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.964+0000 7f8e26000640 1 -- 172.21.15.17:0/889228998 learned_addr learned my addr 172.21.15.17:0/889228998 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:28.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.964+0000 7f8e26000640 1 -- 172.21.15.17:0/889228998 >> v1:172.21.15.94:6789/0 conn(0x7f8e28144240 legacy=0x7f8e280ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:28.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.964+0000 7f8e26000640 1 -- 172.21.15.17:0/889228998 >> v1:172.21.15.17:6789/0 conn(0x7f8e280cb970 legacy=0x7f8e2815e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:28.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.965+0000 7f8e26000640 1 -- 172.21.15.17:0/889228998 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e280cd9f0 con 0x7f8e280b2070 2024-03-12T17:19:28.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.966+0000 7f8e26000640 1 --2- 172.21.15.17:0/889228998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e280b2070 0x7f8e280b2500 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8e10009870 tx=0x7f8e1002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9e7cec93bd6632a server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:28.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.966+0000 7f8e25600640 1 -- 172.21.15.17:0/889228998 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e10030860 con 0x7f8e280b2070 2024-03-12T17:19:28.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.966+0000 7f8e25600640 1 -- 172.21.15.17:0/889228998 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e100309c0 con 0x7f8e280b2070 2024-03-12T17:19:28.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.966+0000 7f8e25600640 1 -- 172.21.15.17:0/889228998 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e10030d50 con 0x7f8e280b2070 2024-03-12T17:19:28.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.967+0000 7f8e2d800640 1 -- 172.21.15.17:0/889228998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e280b2070 msgr2=0x7f8e280b2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:28.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.967+0000 7f8e2d800640 1 --2- 172.21.15.17:0/889228998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e280b2070 0x7f8e280b2500 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8e10009870 tx=0x7f8e1002b9a0 comp rx=0 tx=0).stop 2024-03-12T17:19:28.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.967+0000 7f8e2d800640 1 -- 172.21.15.17:0/889228998 shutdown_connections 2024-03-12T17:19:28.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.967+0000 7f8e2d800640 1 --2- 172.21.15.17:0/889228998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e280b2070 0x7f8e280b2500 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:28.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.967+0000 7f8e2d800640 1 -- 172.21.15.17:0/889228998 >> 172.21.15.17:0/889228998 conn(0x7f8e28069ce0 msgr2=0x7f8e2806a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:28.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.967+0000 7f8e2d800640 1 -- 172.21.15.17:0/889228998 shutdown_connections 2024-03-12T17:19:28.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.967+0000 7f8e2d800640 1 -- 172.21.15.17:0/889228998 wait complete. 2024-03-12T17:19:28.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.969+0000 7f8e2d800640 1 Processor -- start 2024-03-12T17:19:28.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.969+0000 7f8e2d800640 1 -- start start 2024-03-12T17:19:28.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.970+0000 7f8e2d800640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8e280b2070 0x7f8e281f1b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:28.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.970+0000 7f8e2d800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e280cb970 0x7f8e280aeb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:28.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.970+0000 7f8e2d800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e28144240 0x7f8e280af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:28.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.970+0000 7f8e2d800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e281f2090 con 0x7f8e28144240 2024-03-12T17:19:28.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.970+0000 7f8e2d800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e28130c70 con 0x7f8e280cb970 2024-03-12T17:19:28.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.970+0000 7f8e2d800640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e28133b30 con 0x7f8e280b2070 2024-03-12T17:19:28.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.970+0000 7f8e27400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e28144240 0x7f8e280af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:28.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.970+0000 7f8e27400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e28144240 0x7f8e280af0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46658/0 (socket says 172.21.15.17:46658) 2024-03-12T17:19:28.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.970+0000 7f8e27400640 1 -- 172.21.15.17:0/4210103137 learned_addr learned my addr 172.21.15.17:0/4210103137 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:28.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.970+0000 7f8e26000640 1 --2- 172.21.15.17:0/4210103137 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e280cb970 0x7f8e280aeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:28.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.970+0000 7f8e27400640 1 -- 172.21.15.17:0/4210103137 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8e280b2070 msgr2=0x7f8e281f1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:28.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.970+0000 7f8e26a00640 1 --2- 172.21.15.17:0/4210103137 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8e280b2070 0x7f8e281f1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:28.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.970+0000 7f8e27400640 1 --2- 172.21.15.17:0/4210103137 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8e280b2070 0x7f8e281f1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:28.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.971+0000 7f8e27400640 1 -- 172.21.15.17:0/4210103137 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e280cb970 msgr2=0x7f8e280aeb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:28.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.971+0000 7f8e27400640 1 --2- 172.21.15.17:0/4210103137 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e280cb970 0x7f8e280aeb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:28.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.971+0000 7f8e27400640 1 -- 172.21.15.17:0/4210103137 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e100094d0 con 0x7f8e28144240 2024-03-12T17:19:28.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.971+0000 7f8e26000640 1 --2- 172.21.15.17:0/4210103137 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e280cb970 0x7f8e280aeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:28.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.971+0000 7f8e26a00640 1 --2- 172.21.15.17:0/4210103137 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8e280b2070 0x7f8e281f1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:28.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.971+0000 7f8e27400640 1 --2- 172.21.15.17:0/4210103137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e28144240 0x7f8e280af0d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8e2000c7a0 tx=0x7f8e2000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:28.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.971+0000 7f8e1ea00640 1 -- 172.21.15.17:0/4210103137 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e20003b70 con 0x7f8e28144240 2024-03-12T17:19:28.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.971+0000 7f8e1ea00640 1 -- 172.21.15.17:0/4210103137 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e20003cf0 con 0x7f8e28144240 2024-03-12T17:19:28.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.971+0000 7f8e1ea00640 1 -- 172.21.15.17:0/4210103137 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e20003ea0 con 0x7f8e28144240 2024-03-12T17:19:28.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.971+0000 7f8e2d800640 1 -- 172.21.15.17:0/4210103137 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e28130f30 con 0x7f8e28144240 2024-03-12T17:19:28.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.971+0000 7f8e2d800640 1 -- 172.21.15.17:0/4210103137 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e281314f0 con 0x7f8e28144240 2024-03-12T17:19:28.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.973+0000 7f8e2d800640 1 -- 172.21.15.17:0/4210103137 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e280736c0 con 0x7f8e28144240 2024-03-12T17:19:28.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.973+0000 7f8e1ea00640 1 -- 172.21.15.17:0/4210103137 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f8e2000aa90 con 0x7f8e28144240 2024-03-12T17:19:28.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.975+0000 7f8e1ea00640 1 --2- 172.21.15.17:0/4210103137 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f8e0406ac00 0x7f8e0406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:28.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.975+0000 7f8e1ea00640 1 -- 172.21.15.17:0/4210103137 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e20089260 con 0x7f8e28144240 2024-03-12T17:19:28.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.975+0000 7f8e26a00640 1 --2- 172.21.15.17:0/4210103137 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f8e0406ac00 0x7f8e0406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:28.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.976+0000 7f8e26a00640 1 --2- 172.21.15.17:0/4210103137 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f8e0406ac00 0x7f8e0406d0c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800a830 tx=0x7f8e18008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:28.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:28.979+0000 7f8e1ea00640 1 -- 172.21.15.17:0/4210103137 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f8e200543a0 con 0x7f8e28144240 2024-03-12T17:19:29.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.170+0000 7f8e2d800640 1 -- 172.21.15.17:0/4210103137 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8e280cb600 con 0x7f8e28144240 2024-03-12T17:19:29.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.170+0000 7f8e1ea00640 1 -- 172.21.15.17:0/4210103137 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8e200579c0 con 0x7f8e28144240 2024-03-12T17:19:29.166 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-03-12T17:19:29.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.173+0000 7f8e2d800640 1 -- 172.21.15.17:0/4210103137 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f8e0406ac00 msgr2=0x7f8e0406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:29.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.173+0000 7f8e2d800640 1 --2- 172.21.15.17:0/4210103137 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f8e0406ac00 0x7f8e0406d0c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8e1800a830 tx=0x7f8e18008040 comp rx=0 tx=0).stop 2024-03-12T17:19:29.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.173+0000 7f8e2d800640 1 -- 172.21.15.17:0/4210103137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e28144240 msgr2=0x7f8e280af0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:29.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.173+0000 7f8e2d800640 1 --2- 172.21.15.17:0/4210103137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e28144240 0x7f8e280af0d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8e2000c7a0 tx=0x7f8e2000cc60 comp rx=0 tx=0).stop 2024-03-12T17:19:29.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.173+0000 7f8e2d800640 1 -- 172.21.15.17:0/4210103137 shutdown_connections 2024-03-12T17:19:29.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.173+0000 7f8e2d800640 1 --2- 172.21.15.17:0/4210103137 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f8e0406ac00 0x7f8e0406d0c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:29.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.173+0000 7f8e2d800640 1 --2- 172.21.15.17:0/4210103137 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e28144240 0x7f8e280af0d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:29.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.173+0000 7f8e2d800640 1 --2- 172.21.15.17:0/4210103137 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e280cb970 0x7f8e280aeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:29.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.173+0000 7f8e2d800640 1 --2- 172.21.15.17:0/4210103137 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8e280b2070 0x7f8e281f1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:29.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.173+0000 7f8e2d800640 1 -- 172.21.15.17:0/4210103137 >> 172.21.15.17:0/4210103137 conn(0x7f8e28069ce0 msgr2=0x7f8e280ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:29.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.174+0000 7f8e2d800640 1 -- 172.21.15.17:0/4210103137 shutdown_connections 2024-03-12T17:19:29.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.174+0000 7f8e2d800640 1 -- 172.21.15.17:0/4210103137 wait complete. 2024-03-12T17:19:29.190 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-12T17:19:29.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.406+0000 7f2e88c00640 1 Processor -- start 2024-03-12T17:19:29.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.407+0000 7f2e88c00640 1 -- start start 2024-03-12T17:19:29.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.408+0000 7f2e88c00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2e84070ba0 0x7f2e840cc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:29.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.408+0000 7f2e88c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e840cccd0 0x7f2e8413fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:29.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.408+0000 7f2e88c00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e8415bd70 con 0x7f2e841403a0 2024-03-12T17:19:29.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.408+0000 7f2e88c00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e84140e80 con 0x7f2e84070ba0 2024-03-12T17:19:29.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.408+0000 7f2e88c00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e840cd160 con 0x7f2e840cccd0 2024-03-12T17:19:29.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.409+0000 7f2e83e00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f2e841403a0 0x7f2e840cb2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:39422/0 (socket says 172.21.15.17:39422) 2024-03-12T17:19:29.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.409+0000 7f2e83e00640 1 -- 172.21.15.17:0/2851833496 learned_addr learned my addr 172.21.15.17:0/2851833496 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:29.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.409+0000 7f2e82a00640 1 --2- 172.21.15.17:0/2851833496 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e840cccd0 0x7f2e8413fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:29.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.409+0000 7f2e83400640 1 --2- 172.21.15.17:0/2851833496 >> v2:172.21.15.94:3300/0 conn(0x7f2e84070ba0 0x7f2e840cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:29.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.409+0000 7f2e82000640 1 -- 172.21.15.17:0/2851833496 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2913551602 0 0) 0x7f2e7c001490 con 0x7f2e841403a0 2024-03-12T17:19:29.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.410+0000 7f2e82000640 1 -- 172.21.15.17:0/2851833496 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e68003520 con 0x7f2e841403a0 2024-03-12T17:19:29.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.410+0000 7f2e82a00640 1 -- 172.21.15.17:0/2851833496 >> v2:172.21.15.94:3300/0 conn(0x7f2e84070ba0 msgr2=0x7f2e840cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:29.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.410+0000 7f2e82a00640 1 --2- 172.21.15.17:0/2851833496 >> v2:172.21.15.94:3300/0 conn(0x7f2e84070ba0 0x7f2e840cc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:29.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.410+0000 7f2e82000640 1 -- 172.21.15.17:0/2851833496 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2931203712 0 0) 0x7f2e68003520 con 0x7f2e841403a0 2024-03-12T17:19:29.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.410+0000 7f2e82a00640 1 -- 172.21.15.17:0/2851833496 >> v1:172.21.15.17:6789/0 conn(0x7f2e841403a0 legacy=0x7f2e840cb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:29.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.410+0000 7f2e82a00640 1 -- 172.21.15.17:0/2851833496 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e84070f80 con 0x7f2e840cccd0 2024-03-12T17:19:29.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.410+0000 7f2e83400640 1 --2- 172.21.15.17:0/2851833496 >> v2:172.21.15.94:3300/0 conn(0x7f2e84070ba0 0x7f2e840cc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-12T17:19:29.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.411+0000 7f2e82a00640 1 --2- 172.21.15.17:0/2851833496 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e840cccd0 0x7f2e8413fe60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c0097a0 tx=0x7f2e6c02b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1022437a32990e3 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:29.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.412+0000 7f2e82000640 1 -- 172.21.15.17:0/2851833496 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7c001b80 con 0x7f2e840cccd0 2024-03-12T17:19:29.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.412+0000 7f2e82000640 1 -- 172.21.15.17:0/2851833496 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6c02e050 con 0x7f2e840cccd0 2024-03-12T17:19:29.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.412+0000 7f2e82000640 1 -- 172.21.15.17:0/2851833496 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c030730 con 0x7f2e840cccd0 2024-03-12T17:19:29.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.413+0000 7f2e88c00640 1 -- 172.21.15.17:0/2851833496 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e840cccd0 msgr2=0x7f2e8413fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:29.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.413+0000 7f2e88c00640 1 --2- 172.21.15.17:0/2851833496 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e840cccd0 0x7f2e8413fe60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c0097a0 tx=0x7f2e6c02b790 comp rx=0 tx=0).stop 2024-03-12T17:19:29.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.413+0000 7f2e88c00640 1 -- 172.21.15.17:0/2851833496 shutdown_connections 2024-03-12T17:19:29.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.413+0000 7f2e88c00640 1 --2- 172.21.15.17:0/2851833496 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e840cccd0 0x7f2e8413fe60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:29.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.413+0000 7f2e88c00640 1 --2- 172.21.15.17:0/2851833496 >> v2:172.21.15.94:3300/0 conn(0x7f2e84070ba0 0x7f2e840cc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:29.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.413+0000 7f2e88c00640 1 -- 172.21.15.17:0/2851833496 >> 172.21.15.17:0/2851833496 conn(0x7f2e84066000 msgr2=0x7f2e84069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:29.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.413+0000 7f2e88c00640 1 -- 172.21.15.17:0/2851833496 shutdown_connections 2024-03-12T17:19:29.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.413+0000 7f2e88c00640 1 -- 172.21.15.17:0/2851833496 wait complete. 2024-03-12T17:19:29.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.415+0000 7f2e88c00640 1 Processor -- start 2024-03-12T17:19:29.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.415+0000 7f2e88c00640 1 -- start start 2024-03-12T17:19:29.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.416+0000 7f2e88c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e84070ba0 0x7f2e84153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:29.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.416+0000 7f2e88c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e840cccd0 0x7f2e841384c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:29.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.416+0000 7f2e88c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e841403a0 0x7f2e8413a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:29.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.416+0000 7f2e88c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e84138a00 con 0x7f2e84070ba0 2024-03-12T17:19:29.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.416+0000 7f2e88c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8413a560 con 0x7f2e840cccd0 2024-03-12T17:19:29.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.416+0000 7f2e88c00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8413a830 con 0x7f2e841403a0 2024-03-12T17:19:29.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.416+0000 7f2e83400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e84070ba0 0x7f2e84153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:29.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.416+0000 7f2e83400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e84070ba0 0x7f2e84153480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46660/0 (socket says 172.21.15.17:46660) 2024-03-12T17:19:29.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.416+0000 7f2e83400640 1 -- 172.21.15.17:0/76482159 learned_addr learned my addr 172.21.15.17:0/76482159 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:29.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.417+0000 7f2e82a00640 1 --2- 172.21.15.17:0/76482159 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e840cccd0 0x7f2e841384c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:29.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.417+0000 7f2e83e00640 1 --2- 172.21.15.17:0/76482159 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e841403a0 0x7f2e8413a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:29.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.417+0000 7f2e83400640 1 -- 172.21.15.17:0/76482159 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e841403a0 msgr2=0x7f2e8413a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:29.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.417+0000 7f2e83400640 1 --2- 172.21.15.17:0/76482159 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e841403a0 0x7f2e8413a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:29.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.417+0000 7f2e83400640 1 -- 172.21.15.17:0/76482159 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e840cccd0 msgr2=0x7f2e841384c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:29.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.417+0000 7f2e83400640 1 --2- 172.21.15.17:0/76482159 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e840cccd0 0x7f2e841384c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:29.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.417+0000 7f2e83400640 1 -- 172.21.15.17:0/76482159 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e74009400 con 0x7f2e84070ba0 2024-03-12T17:19:29.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.417+0000 7f2e82a00640 1 --2- 172.21.15.17:0/76482159 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e840cccd0 0x7f2e841384c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:19:29.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.417+0000 7f2e83400640 1 --2- 172.21.15.17:0/76482159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e84070ba0 0x7f2e84153480 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2e7400ebe0 tx=0x7f2e7400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:29.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.418+0000 7f2e7b400640 1 -- 172.21.15.17:0/76482159 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e74009760 con 0x7f2e84070ba0 2024-03-12T17:19:29.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.418+0000 7f2e7b400640 1 -- 172.21.15.17:0/76482159 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e7400cc30 con 0x7f2e84070ba0 2024-03-12T17:19:29.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.418+0000 7f2e7b400640 1 -- 172.21.15.17:0/76482159 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7400eee0 con 0x7f2e84070ba0 2024-03-12T17:19:29.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.418+0000 7f2e88c00640 1 -- 172.21.15.17:0/76482159 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e6c009400 con 0x7f2e84070ba0 2024-03-12T17:19:29.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.418+0000 7f2e88c00640 1 -- 172.21.15.17:0/76482159 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e8413adf0 con 0x7f2e84070ba0 2024-03-12T17:19:29.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.419+0000 7f2e88c00640 1 -- 172.21.15.17:0/76482159 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e840665b0 con 0x7f2e84070ba0 2024-03-12T17:19:29.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.420+0000 7f2e7b400640 1 -- 172.21.15.17:0/76482159 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f2e74013470 con 0x7f2e84070ba0 2024-03-12T17:19:29.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.421+0000 7f2e7b400640 1 --2- 172.21.15.17:0/76482159 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f2e6006ac00 0x7f2e6006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:29.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.421+0000 7f2e7b400640 1 -- 172.21.15.17:0/76482159 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e74089710 con 0x7f2e84070ba0 2024-03-12T17:19:29.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.421+0000 7f2e82a00640 1 --2- 172.21.15.17:0/76482159 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f2e6006ac00 0x7f2e6006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:29.417 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.422+0000 7f2e82a00640 1 --2- 172.21.15.17:0/76482159 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f2e6006ac00 0x7f2e6006d0c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c034000 tx=0x7f2e6c02f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:29.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.425+0000 7f2e7b400640 1 -- 172.21.15.17:0/76482159 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f2e74054850 con 0x7f2e84070ba0 2024-03-12T17:19:29.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.639+0000 7f2e88c00640 1 -- 172.21.15.17:0/76482159 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2e8404e030 con 0x7f2e84070ba0 2024-03-12T17:19:29.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.640+0000 7f2e7b400640 1 -- 172.21.15.17:0/76482159 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2e74057e70 con 0x7f2e84070ba0 2024-03-12T17:19:29.635 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2024-03-12T17:19:29.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.642+0000 7f2e88c00640 1 -- 172.21.15.17:0/76482159 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f2e6006ac00 msgr2=0x7f2e6006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:29.638 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.642+0000 7f2e88c00640 1 --2- 172.21.15.17:0/76482159 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f2e6006ac00 0x7f2e6006d0c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2e6c034000 tx=0x7f2e6c02f000 comp rx=0 tx=0).stop 2024-03-12T17:19:29.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.642+0000 7f2e88c00640 1 -- 172.21.15.17:0/76482159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e84070ba0 msgr2=0x7f2e84153480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:29.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.642+0000 7f2e88c00640 1 --2- 172.21.15.17:0/76482159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e84070ba0 0x7f2e84153480 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2e7400ebe0 tx=0x7f2e7400c520 comp rx=0 tx=0).stop 2024-03-12T17:19:29.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.642+0000 7f2e88c00640 1 -- 172.21.15.17:0/76482159 shutdown_connections 2024-03-12T17:19:29.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.643+0000 7f2e88c00640 1 --2- 172.21.15.17:0/76482159 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f2e6006ac00 0x7f2e6006d0c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:29.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.643+0000 7f2e88c00640 1 --2- 172.21.15.17:0/76482159 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2e841403a0 0x7f2e8413a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:29.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.643+0000 7f2e88c00640 1 --2- 172.21.15.17:0/76482159 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2e840cccd0 0x7f2e841384c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:29.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.643+0000 7f2e88c00640 1 --2- 172.21.15.17:0/76482159 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2e84070ba0 0x7f2e84153480 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:29.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.643+0000 7f2e88c00640 1 -- 172.21.15.17:0/76482159 >> 172.21.15.17:0/76482159 conn(0x7f2e84066000 msgr2=0x7f2e840af210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:29.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.643+0000 7f2e88c00640 1 -- 172.21.15.17:0/76482159 shutdown_connections 2024-03-12T17:19:29.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:29.643+0000 7f2e88c00640 1 -- 172.21.15.17:0/76482159 wait complete. 2024-03-12T17:19:29.656 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-12T17:19:29.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:29.656 DEBUG:teuthology.orchestra.run.smithi017:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-03-12T17:19:29.756 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2024-03-12T17:19:29.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:29.757 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-12T17:19:29.819 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-12T17:19:29.819 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-12T17:19:29.876 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-12T17:19:29.876 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-12T17:19:29.930 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-12T17:19:29.930 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-12T17:19:29.984 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T17:19:30.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.218+0000 7f63b9800640 1 Processor -- start 2024-03-12T17:19:30.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.219+0000 7f63b9800640 1 -- start start 2024-03-12T17:19:30.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.220+0000 7f63b9800640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f63b40b2070 0x7f63b40b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:30.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.220+0000 7f63b9800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f63b40cb970 0x7f63b40cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:30.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.220+0000 7f63b9800640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63b40ce320 con 0x7f63b4144240 2024-03-12T17:19:30.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.220+0000 7f63b9800640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63b40cc340 con 0x7f63b40cb970 2024-03-12T17:19:30.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.220+0000 7f63b9800640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b4144620 con 0x7f63b40b2070 2024-03-12T17:19:30.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.221+0000 7f63b3400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f63b40cb970 0x7f63b40cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:30.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.221+0000 7f63b2a00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f63b4144240 0x7f63b40ce7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:39436/0 (socket says 172.21.15.17:39436) 2024-03-12T17:19:30.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.221+0000 7f63b2a00640 1 -- 172.21.15.17:0/816118458 learned_addr learned my addr 172.21.15.17:0/816118458 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:30.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.221+0000 7f63b2000640 1 --2- 172.21.15.17:0/816118458 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f63b40b2070 0x7f63b40b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:30.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.221+0000 7f63b1600640 1 -- 172.21.15.17:0/816118458 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3183457937 0 0) 0x7f63b40ce320 con 0x7f63b4144240 2024-03-12T17:19:30.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.221+0000 7f63b1600640 1 -- 172.21.15.17:0/816118458 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6398003520 con 0x7f63b4144240 2024-03-12T17:19:30.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.222+0000 7f63b3400640 1 -- 172.21.15.17:0/816118458 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f63b40b2070 msgr2=0x7f63b40b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:30.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.222+0000 7f63b3400640 1 --2- 172.21.15.17:0/816118458 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f63b40b2070 0x7f63b40b24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:30.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.222+0000 7f63b3400640 1 -- 172.21.15.17:0/816118458 >> v1:172.21.15.17:6789/0 conn(0x7f63b4144240 legacy=0x7f63b40ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:30.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.222+0000 7f63b3400640 1 -- 172.21.15.17:0/816118458 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b415f3d0 con 0x7f63b40cb970 2024-03-12T17:19:30.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.222+0000 7f63b2000640 1 --2- 172.21.15.17:0/816118458 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f63b40b2070 0x7f63b40b24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:19:30.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.223+0000 7f63b3400640 1 --2- 172.21.15.17:0/816118458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63b40cb970 0x7f63b40cbe00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f63ac009dc0 tx=0x7f63ac02be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff9eca8425a5d50 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:30.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.223+0000 7f63b1600640 1 -- 172.21.15.17:0/816118458 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac02cc40 con 0x7f63b40cb970 2024-03-12T17:19:30.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.223+0000 7f63b1600640 1 -- 172.21.15.17:0/816118458 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63ac02cda0 con 0x7f63b40cb970 2024-03-12T17:19:30.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.223+0000 7f63b1600640 1 -- 172.21.15.17:0/816118458 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac034640 con 0x7f63b40cb970 2024-03-12T17:19:30.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.224+0000 7f63b9800640 1 -- 172.21.15.17:0/816118458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63b40cb970 msgr2=0x7f63b40cbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:30.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.224+0000 7f63b9800640 1 --2- 172.21.15.17:0/816118458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63b40cb970 0x7f63b40cbe00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f63ac009dc0 tx=0x7f63ac02be90 comp rx=0 tx=0).stop 2024-03-12T17:19:30.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.224+0000 7f63b9800640 1 -- 172.21.15.17:0/816118458 shutdown_connections 2024-03-12T17:19:30.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.224+0000 7f63b9800640 1 --2- 172.21.15.17:0/816118458 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63b40cb970 0x7f63b40cbe00 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:30.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.224+0000 7f63b9800640 1 --2- 172.21.15.17:0/816118458 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f63b40b2070 0x7f63b40b24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:30.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.224+0000 7f63b9800640 1 -- 172.21.15.17:0/816118458 >> 172.21.15.17:0/816118458 conn(0x7f63b4069ce0 msgr2=0x7f63b406a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:30.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.224+0000 7f63b9800640 1 -- 172.21.15.17:0/816118458 shutdown_connections 2024-03-12T17:19:30.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.224+0000 7f63b9800640 1 -- 172.21.15.17:0/816118458 wait complete. 2024-03-12T17:19:30.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.225+0000 7f63b9800640 1 Processor -- start 2024-03-12T17:19:30.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.226+0000 7f63b9800640 1 -- start start 2024-03-12T17:19:30.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.226+0000 7f63b9800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63b40b2070 0x7f63b40cac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:30.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.227+0000 7f63b9800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63b40cb970 0x7f63b41f1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:30.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.227+0000 7f63b9800640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f63b4144240 0x7f63b40a8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:30.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.227+0000 7f63b9800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b4130090 con 0x7f63b40b2070 2024-03-12T17:19:30.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.227+0000 7f63b9800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b4130ed0 con 0x7f63b40cb970 2024-03-12T17:19:30.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.227+0000 7f63b9800640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b41302c0 con 0x7f63b4144240 2024-03-12T17:19:30.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.227+0000 7f63b2a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63b40b2070 0x7f63b40cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:30.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.227+0000 7f63b2a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63b40b2070 0x7f63b40cac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46680/0 (socket says 172.21.15.17:46680) 2024-03-12T17:19:30.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.227+0000 7f63b2a00640 1 -- 172.21.15.17:0/4069896086 learned_addr learned my addr 172.21.15.17:0/4069896086 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:30.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.227+0000 7f63b2a00640 1 -- 172.21.15.17:0/4069896086 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f63b4144240 msgr2=0x7f63b40a8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:30.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.227+0000 7f63b2a00640 1 --2- 172.21.15.17:0/4069896086 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f63b4144240 0x7f63b40a8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:30.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.227+0000 7f63b2a00640 1 -- 172.21.15.17:0/4069896086 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63b40cb970 msgr2=0x7f63b41f1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:30.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.227+0000 7f63b2a00640 1 --2- 172.21.15.17:0/4069896086 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63b40cb970 0x7f63b41f1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:30.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.227+0000 7f63b2a00640 1 -- 172.21.15.17:0/4069896086 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ac009a70 con 0x7f63b40b2070 2024-03-12T17:19:30.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.228+0000 7f63b2a00640 1 --2- 172.21.15.17:0/4069896086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63b40b2070 0x7f63b40cac00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f63a400c390 tx=0x7f63a400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:30.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.228+0000 7f63aaa00640 1 -- 172.21.15.17:0/4069896086 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a4005ce0 con 0x7f63b40b2070 2024-03-12T17:19:30.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.228+0000 7f63aaa00640 1 -- 172.21.15.17:0/4069896086 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a4005e40 con 0x7f63b40b2070 2024-03-12T17:19:30.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.228+0000 7f63b9800640 1 -- 172.21.15.17:0/4069896086 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63b41305a0 con 0x7f63b40b2070 2024-03-12T17:19:30.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.228+0000 7f63aaa00640 1 -- 172.21.15.17:0/4069896086 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a40072d0 con 0x7f63b40b2070 2024-03-12T17:19:30.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.228+0000 7f63b9800640 1 -- 172.21.15.17:0/4069896086 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63b4130b60 con 0x7f63b40b2070 2024-03-12T17:19:30.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.229+0000 7f63b9800640 1 -- 172.21.15.17:0/4069896086 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63b4130d20 con 0x7f63b40b2070 2024-03-12T17:19:30.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.230+0000 7f63aaa00640 1 -- 172.21.15.17:0/4069896086 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f63a4007430 con 0x7f63b40b2070 2024-03-12T17:19:30.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.231+0000 7f63aaa00640 1 --2- 172.21.15.17:0/4069896086 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f639406ac00 0x7f639406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:30.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.231+0000 7f63aaa00640 1 -- 172.21.15.17:0/4069896086 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f63a4088830 con 0x7f63b40b2070 2024-03-12T17:19:30.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.231+0000 7f63b2000640 1 --2- 172.21.15.17:0/4069896086 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f639406ac00 0x7f639406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:30.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.232+0000 7f63b2000640 1 --2- 172.21.15.17:0/4069896086 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f639406ac00 0x7f639406d0c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f63a0006e80 tx=0x7f63a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:30.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.235+0000 7f63aaa00640 1 -- 172.21.15.17:0/4069896086 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f63a4053ac0 con 0x7f63b40b2070 2024-03-12T17:19:30.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.435+0000 7f63b9800640 1 -- 172.21.15.17:0/4069896086 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63b40736c0 con 0x7f63b40b2070 2024-03-12T17:19:30.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.437+0000 7f63aaa00640 1 -- 172.21.15.17:0/4069896086 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+15989 (secure 0 0 0) 0x7f63a4017020 con 0x7f63b40b2070 2024-03-12T17:19:30.432 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:19:30.432 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":21,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:18:46.845635+0000","last_up_change":"2024-03-12T17:18:38.144756+0000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-12T17:18:39.552910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-12T17:18:43.794908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-12T17:18:44.867006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":37305},{"type":"v1","addr":"172.21.15.17:6801","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":37305},{"type":"v1","addr":"172.21.15.17:6803","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":37305},{"type":"v1","addr":"172.21.15.17:6807","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":37305},{"type":"v1","addr":"172.21.15.17:6805","nonce":37305}]},"public_addr":"172.21.15.17:6801/37305","cluster_addr":"172.21.15.17:6803/37305","heartbeat_back_addr":"172.21.15.17:6807/37305","heartbeat_front_addr":"172.21.15.17:6805/37305","state":["exists","up"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":37307},{"type":"v1","addr":"172.21.15.17:6814","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":37307},{"type":"v1","addr":"172.21.15.17:6818","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":37307},{"type":"v1","addr":"172.21.15.17:6827","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":37307},{"type":"v1","addr":"172.21.15.17:6823","nonce":37307}]},"public_addr":"172.21.15.17:6814/37307","cluster_addr":"172.21.15.17:6818/37307","heartbeat_back_addr":"172.21.15.17:6827/37307","heartbeat_front_addr":"172.21.15.17:6823/37307","state":["exists","up"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":37303},{"type":"v1","addr":"172.21.15.17:6809","nonce":37303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":37303},{"type":"v1","addr":"172.21.15.17:6811","nonce":37303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":37303},{"type":"v1","addr":"172.21.15.17:6819","nonce":37303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":37303},{"type":"v1","addr":"172.21.15.17:6815","nonce":37303}]},"public_addr":"172.21.15.17:6809/37303","cluster_addr":"172.21.15.17:6811/37303","heartbeat_back_addr":"172.21.15.17:6819/37303","heartbeat_front_addr":"172.21.15.17:6815/37303","state":["exists","up"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":37308},{"type":"v1","addr":"172.21.15.17:6822","nonce":37308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":37308},{"type":"v1","addr":"172.21.15.17:6826","nonce":37308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":37308},{"type":"v1","addr":"172.21.15.17:6831","nonce":37308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":37308},{"type":"v1","addr":"172.21.15.17:6829","nonce":37308}]},"public_addr":"172.21.15.17:6822/37308","cluster_addr":"172.21.15.17:6826/37308","heartbeat_back_addr":"172.21.15.17:6831/37308","heartbeat_front_addr":"172.21.15.17:6829/37308","state":["exists","up"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":37465},{"type":"v1","addr":"172.21.15.94:6809","nonce":37465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6811","nonce":37465},{"type":"v1","addr":"172.21.15.94:6813","nonce":37465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6819","nonce":37465},{"type":"v1","addr":"172.21.15.94:6822","nonce":37465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6815","nonce":37465},{"type":"v1","addr":"172.21.15.94:6817","nonce":37465}]},"public_addr":"172.21.15.94:6809/37465","cluster_addr":"172.21.15.94:6813/37465","heartbeat_back_addr":"172.21.15.94:6822/37465","heartbeat_front_addr":"172.21.15.94:6817/37465","state":["exists","up"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":37464},{"type":"v1","addr":"172.21.15.94:6812","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":37464},{"type":"v1","addr":"172.21.15.94:6816","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":37464},{"type":"v1","addr":"172.21.15.94:6823","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":37464},{"type":"v1","addr":"172.21.15.94:6820","nonce":37464}]},"public_addr":"172.21.15.94:6812/37464","cluster_addr":"172.21.15.94:6816/37464","heartbeat_back_addr":"172.21.15.94:6823/37464","heartbeat_front_addr":"172.21.15.94:6820/37464","state":["exists","up"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":37467},{"type":"v1","addr":"172.21.15.94:6825","nonce":37467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":37467},{"type":"v1","addr":"172.21.15.94:6827","nonce":37467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":37467},{"type":"v1","addr":"172.21.15.94:6831","nonce":37467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":37467},{"type":"v1","addr":"172.21.15.94:6829","nonce":37467}]},"public_addr":"172.21.15.94:6825/37467","cluster_addr":"172.21.15.94:6827/37467","heartbeat_back_addr":"172.21.15.94:6831/37467","heartbeat_front_addr":"172.21.15.94:6829/37467","state":["exists","up"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":37466},{"type":"v1","addr":"172.21.15.94:6801","nonce":37466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":37466},{"type":"v1","addr":"172.21.15.94:6803","nonce":37466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":37466},{"type":"v1","addr":"172.21.15.94:6807","nonce":37466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":37466},{"type":"v1","addr":"172.21.15.94:6805","nonce":37466}]},"public_addr":"172.21.15.94:6801/37466","cluster_addr":"172.21.15.94:6803/37466","heartbeat_back_addr":"172.21.15.94:6807/37466","heartbeat_front_addr":"172.21.15.94:6805/37466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.327217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.186966+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.419986+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.150585+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.120621+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.121576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.181257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.293188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:19:30.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.439+0000 7f63b9800640 1 -- 172.21.15.17:0/4069896086 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f639406ac00 msgr2=0x7f639406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:30.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.439+0000 7f63b9800640 1 --2- 172.21.15.17:0/4069896086 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f639406ac00 0x7f639406d0c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f63a0006e80 tx=0x7f63a0008040 comp rx=0 tx=0).stop 2024-03-12T17:19:30.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.439+0000 7f63b9800640 1 -- 172.21.15.17:0/4069896086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63b40b2070 msgr2=0x7f63b40cac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:30.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.439+0000 7f63b9800640 1 --2- 172.21.15.17:0/4069896086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63b40b2070 0x7f63b40cac00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f63a400c390 tx=0x7f63a400c850 comp rx=0 tx=0).stop 2024-03-12T17:19:30.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.440+0000 7f63b9800640 1 -- 172.21.15.17:0/4069896086 shutdown_connections 2024-03-12T17:19:30.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.440+0000 7f63b9800640 1 --2- 172.21.15.17:0/4069896086 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f639406ac00 0x7f639406d0c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:30.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.440+0000 7f63b9800640 1 --2- 172.21.15.17:0/4069896086 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f63b4144240 0x7f63b40a8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:30.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.440+0000 7f63b9800640 1 --2- 172.21.15.17:0/4069896086 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f63b40cb970 0x7f63b41f1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:30.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.440+0000 7f63b9800640 1 --2- 172.21.15.17:0/4069896086 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f63b40b2070 0x7f63b40cac00 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:30.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.440+0000 7f63b9800640 1 -- 172.21.15.17:0/4069896086 >> 172.21.15.17:0/4069896086 conn(0x7f63b4069ce0 msgr2=0x7f63b40b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:30.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.440+0000 7f63b9800640 1 -- 172.21.15.17:0/4069896086 shutdown_connections 2024-03-12T17:19:30.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.440+0000 7f63b9800640 1 -- 172.21.15.17:0/4069896086 wait complete. 2024-03-12T17:19:30.456 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-12T17:18:39.552910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-12T17:18:43.794908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-12T17:18:44.867006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-12T17:19:30.457 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-12T17:19:30.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.689+0000 7fd585600640 1 Processor -- start 2024-03-12T17:19:30.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.690+0000 7fd585600640 1 -- start start 2024-03-12T17:19:30.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.691+0000 7fd585600640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd5801441f0 0x7fd580070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:30.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.691+0000 7fd585600640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd5800b3b70 0x7fd5800b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:30.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.691+0000 7fd585600640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5800a7660 con 0x7fd58015ae20 2024-03-12T17:19:30.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.691+0000 7fd585600640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd58015e460 con 0x7fd5801441f0 2024-03-12T17:19:30.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.691+0000 7fd585600640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd58006d840 con 0x7fd5800b3b70 2024-03-12T17:19:30.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.692+0000 7fd57fe00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd5801441f0 0x7fd580070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:30.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.692+0000 7fd57fe00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd5801441f0 0x7fd580070240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46686/0 (socket says 172.21.15.17:46686) 2024-03-12T17:19:30.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.692+0000 7fd57fe00640 1 -- 172.21.15.17:0/480706867 learned_addr learned my addr 172.21.15.17:0/480706867 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:30.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.692+0000 7fd584c00640 1 --2- 172.21.15.17:0/480706867 >> v2:172.21.15.94:3300/0 conn(0x7fd5800b3b70 0x7fd5800b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:30.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.692+0000 7fd57fe00640 1 -- 172.21.15.17:0/480706867 >> v2:172.21.15.94:3300/0 conn(0x7fd5800b3b70 msgr2=0x7fd5800b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:30.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.692+0000 7fd57fe00640 1 --2- 172.21.15.17:0/480706867 >> v2:172.21.15.94:3300/0 conn(0x7fd5800b3b70 0x7fd5800b3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:30.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.692+0000 7fd57fe00640 1 -- 172.21.15.17:0/480706867 >> v1:172.21.15.94:6789/0 conn(0x7fd58015ae20 legacy=0x7fd58006d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:30.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.692+0000 7fd57fe00640 1 -- 172.21.15.17:0/480706867 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5800b44c0 con 0x7fd5801441f0 2024-03-12T17:19:30.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.693+0000 7fd57fe00640 1 --2- 172.21.15.17:0/480706867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5801441f0 0x7fd580070240 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd58015e3a0 tx=0x7fd57002bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb10c2f726a0d5b6 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:30.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.693+0000 7fd57ea00640 1 -- 172.21.15.17:0/480706867 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57002cb10 con 0x7fd5801441f0 2024-03-12T17:19:30.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.694+0000 7fd57ea00640 1 -- 172.21.15.17:0/480706867 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57002cc70 con 0x7fd5801441f0 2024-03-12T17:19:30.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.694+0000 7fd57ea00640 1 -- 172.21.15.17:0/480706867 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5700343f0 con 0x7fd5801441f0 2024-03-12T17:19:30.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.694+0000 7fd585600640 1 -- 172.21.15.17:0/480706867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5801441f0 msgr2=0x7fd580070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:30.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.694+0000 7fd585600640 1 --2- 172.21.15.17:0/480706867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5801441f0 0x7fd580070240 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fd58015e3a0 tx=0x7fd57002bf70 comp rx=0 tx=0).stop 2024-03-12T17:19:30.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.694+0000 7fd585600640 1 -- 172.21.15.17:0/480706867 shutdown_connections 2024-03-12T17:19:30.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.694+0000 7fd585600640 1 --2- 172.21.15.17:0/480706867 >> v2:172.21.15.94:3300/0 conn(0x7fd5800b3b70 0x7fd5800b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:30.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.694+0000 7fd585600640 1 --2- 172.21.15.17:0/480706867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5801441f0 0x7fd580070240 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:30.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.694+0000 7fd585600640 1 -- 172.21.15.17:0/480706867 >> 172.21.15.17:0/480706867 conn(0x7fd580069ce0 msgr2=0x7fd58006a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:30.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.694+0000 7fd585600640 1 -- 172.21.15.17:0/480706867 shutdown_connections 2024-03-12T17:19:30.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.694+0000 7fd585600640 1 -- 172.21.15.17:0/480706867 wait complete. 2024-03-12T17:19:30.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.696+0000 7fd585600640 1 Processor -- start 2024-03-12T17:19:30.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.696+0000 7fd585600640 1 -- start start 2024-03-12T17:19:30.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.697+0000 7fd585600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5800b3b70 0x7fd5800b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:30.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.697+0000 7fd585600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5801441f0 0x7fd5800abc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:30.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.697+0000 7fd585600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd58015ae20 0x7fd580140210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:30.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.697+0000 7fd585600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5800ad1f0 con 0x7fd5801441f0 2024-03-12T17:19:30.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.697+0000 7fd585600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5800ac5e0 con 0x7fd5800b3b70 2024-03-12T17:19:30.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.697+0000 7fd585600640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5800ac8c0 con 0x7fd58015ae20 2024-03-12T17:19:30.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.698+0000 7fd57f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5801441f0 0x7fd5800abc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:30.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.698+0000 7fd57f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5801441f0 0x7fd5800abc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46698/0 (socket says 172.21.15.17:46698) 2024-03-12T17:19:30.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.698+0000 7fd57f400640 1 -- 172.21.15.17:0/3458898168 learned_addr learned my addr 172.21.15.17:0/3458898168 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:30.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.698+0000 7fd57fe00640 1 --2- 172.21.15.17:0/3458898168 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5800b3b70 0x7fd5800b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:30.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.698+0000 7fd57f400640 1 -- 172.21.15.17:0/3458898168 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd58015ae20 msgr2=0x7fd580140210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:30.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.698+0000 7fd57f400640 1 --2- 172.21.15.17:0/3458898168 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd58015ae20 0x7fd580140210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:30.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.698+0000 7fd57f400640 1 -- 172.21.15.17:0/3458898168 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5800b3b70 msgr2=0x7fd5800b32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:30.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.698+0000 7fd57f400640 1 --2- 172.21.15.17:0/3458898168 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5800b3b70 0x7fd5800b32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:30.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.698+0000 7fd57f400640 1 -- 172.21.15.17:0/3458898168 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd570009b30 con 0x7fd5801441f0 2024-03-12T17:19:30.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.699+0000 7fd57f400640 1 --2- 172.21.15.17:0/3458898168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5801441f0 0x7fd5800abc00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd56800b3e0 tx=0x7fd56800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:30.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.699+0000 7fd577e00640 1 -- 172.21.15.17:0/3458898168 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd568011830 con 0x7fd5801441f0 2024-03-12T17:19:30.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.699+0000 7fd577e00640 1 -- 172.21.15.17:0/3458898168 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5680119b0 con 0x7fd5801441f0 2024-03-12T17:19:30.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.699+0000 7fd577e00640 1 -- 172.21.15.17:0/3458898168 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd568011d60 con 0x7fd5801441f0 2024-03-12T17:19:30.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.699+0000 7fd585600640 1 -- 172.21.15.17:0/3458898168 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5800acba0 con 0x7fd5801441f0 2024-03-12T17:19:30.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.699+0000 7fd585600640 1 -- 172.21.15.17:0/3458898168 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5800b37f0 con 0x7fd5801441f0 2024-03-12T17:19:30.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.700+0000 7fd585600640 1 -- 172.21.15.17:0/3458898168 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5800ad3a0 con 0x7fd5801441f0 2024-03-12T17:19:30.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.701+0000 7fd577e00640 1 -- 172.21.15.17:0/3458898168 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fd56801a400 con 0x7fd5801441f0 2024-03-12T17:19:30.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.702+0000 7fd577e00640 1 --2- 172.21.15.17:0/3458898168 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd55c06ac30 0x7fd55c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:30.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.703+0000 7fd577e00640 1 -- 172.21.15.17:0/3458898168 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd5680894a0 con 0x7fd5801441f0 2024-03-12T17:19:30.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.703+0000 7fd57fe00640 1 --2- 172.21.15.17:0/3458898168 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd55c06ac30 0x7fd55c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:30.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.703+0000 7fd57fe00640 1 --2- 172.21.15.17:0/3458898168 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd55c06ac30 0x7fd55c06d0f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd570035000 tx=0x7fd570030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:30.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.707+0000 7fd577e00640 1 -- 172.21.15.17:0/3458898168 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fd5800ad3a0 con 0x7fd5801441f0 2024-03-12T17:19:30.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.906+0000 7fd585600640 1 -- 172.21.15.17:0/3458898168 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd58004e030 con 0x7fd5801441f0 2024-03-12T17:19:30.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.907+0000 7fd577e00640 1 -- 172.21.15.17:0/3458898168 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd568054670 con 0x7fd5801441f0 2024-03-12T17:19:30.902 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-03-12T17:19:30.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.910+0000 7fd585600640 1 -- 172.21.15.17:0/3458898168 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd55c06ac30 msgr2=0x7fd55c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:30.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.910+0000 7fd585600640 1 --2- 172.21.15.17:0/3458898168 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd55c06ac30 0x7fd55c06d0f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd570035000 tx=0x7fd570030000 comp rx=0 tx=0).stop 2024-03-12T17:19:30.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.910+0000 7fd585600640 1 -- 172.21.15.17:0/3458898168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5801441f0 msgr2=0x7fd5800abc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:30.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.910+0000 7fd585600640 1 --2- 172.21.15.17:0/3458898168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5801441f0 0x7fd5800abc00 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd56800b3e0 tx=0x7fd56800b8a0 comp rx=0 tx=0).stop 2024-03-12T17:19:30.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.910+0000 7fd585600640 1 -- 172.21.15.17:0/3458898168 shutdown_connections 2024-03-12T17:19:30.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.910+0000 7fd585600640 1 --2- 172.21.15.17:0/3458898168 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd55c06ac30 0x7fd55c06d0f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:30.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.910+0000 7fd585600640 1 --2- 172.21.15.17:0/3458898168 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd58015ae20 0x7fd580140210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:30.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.910+0000 7fd585600640 1 --2- 172.21.15.17:0/3458898168 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd5801441f0 0x7fd5800abc00 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:30.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.910+0000 7fd585600640 1 --2- 172.21.15.17:0/3458898168 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5800b3b70 0x7fd5800b32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:30.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.910+0000 7fd585600640 1 -- 172.21.15.17:0/3458898168 >> 172.21.15.17:0/3458898168 conn(0x7fd580069ce0 msgr2=0x7fd580143300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:30.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.910+0000 7fd585600640 1 -- 172.21.15.17:0/3458898168 shutdown_connections 2024-03-12T17:19:30.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:30.910+0000 7fd585600640 1 -- 172.21.15.17:0/3458898168 wait complete. 2024-03-12T17:19:30.924 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-12T17:19:31.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.128+0000 7f1b4cc00640 1 Processor -- start 2024-03-12T17:19:31.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.128+0000 7f1b4cc00640 1 -- start start 2024-03-12T17:19:31.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.129+0000 7f1b4cc00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1b480b86c0 0x7f1b480b4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:31.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.129+0000 7f1b4cc00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b48160470 con 0x7f1b48160090 2024-03-12T17:19:31.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.130+0000 7f1b4cc00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b4806b840 con 0x7f1b480b4950 2024-03-12T17:19:31.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.130+0000 7f1b4cc00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b480d0e40 con 0x7f1b480b86c0 2024-03-12T17:19:31.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.130+0000 7f1b46a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1b480b86c0 0x7f1b480b4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:31.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.130+0000 7f1b47400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f1b48160090 0x7f1b4806b130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:39446/0 (socket says 172.21.15.17:39446) 2024-03-12T17:19:31.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.130+0000 7f1b47400640 1 -- 172.21.15.17:0/2671403582 learned_addr learned my addr 172.21.15.17:0/2671403582 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:31.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.130+0000 7f1b46a00640 1 -- 172.21.15.17:0/2671403582 >> v1:172.21.15.94:6789/0 conn(0x7f1b480b4950 legacy=0x7f1b480d1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:31.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.130+0000 7f1b46a00640 1 -- 172.21.15.17:0/2671403582 >> v1:172.21.15.17:6789/0 conn(0x7f1b48160090 legacy=0x7f1b4806b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:31.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.130+0000 7f1b46a00640 1 -- 172.21.15.17:0/2671403582 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b480b4d60 con 0x7f1b480b86c0 2024-03-12T17:19:31.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.131+0000 7f1b46a00640 1 --2- 172.21.15.17:0/2671403582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b480b86c0 0x7f1b480b4410 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1b480b23a0 tx=0x7f1b3402b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92373a8f86f0bd81 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:31.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.132+0000 7f1b46000640 1 -- 172.21.15.17:0/2671403582 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b34031780 con 0x7f1b480b86c0 2024-03-12T17:19:31.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.132+0000 7f1b46000640 1 -- 172.21.15.17:0/2671403582 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b340318e0 con 0x7f1b480b86c0 2024-03-12T17:19:31.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.132+0000 7f1b46000640 1 -- 172.21.15.17:0/2671403582 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b34031c70 con 0x7f1b480b86c0 2024-03-12T17:19:31.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.132+0000 7f1b4cc00640 1 -- 172.21.15.17:0/2671403582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b480b86c0 msgr2=0x7f1b480b4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:31.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.132+0000 7f1b4cc00640 1 --2- 172.21.15.17:0/2671403582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b480b86c0 0x7f1b480b4410 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1b480b23a0 tx=0x7f1b3402b820 comp rx=0 tx=0).stop 2024-03-12T17:19:31.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.132+0000 7f1b4cc00640 1 -- 172.21.15.17:0/2671403582 shutdown_connections 2024-03-12T17:19:31.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.133+0000 7f1b4cc00640 1 --2- 172.21.15.17:0/2671403582 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b480b86c0 0x7f1b480b4410 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:31.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.133+0000 7f1b4cc00640 1 -- 172.21.15.17:0/2671403582 >> 172.21.15.17:0/2671403582 conn(0x7f1b480cf5f0 msgr2=0x7f1b480cfa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:31.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.133+0000 7f1b4cc00640 1 -- 172.21.15.17:0/2671403582 shutdown_connections 2024-03-12T17:19:31.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.133+0000 7f1b4cc00640 1 -- 172.21.15.17:0/2671403582 wait complete. 2024-03-12T17:19:31.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.134+0000 7f1b4cc00640 1 Processor -- start 2024-03-12T17:19:31.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.134+0000 7f1b4cc00640 1 -- start start 2024-03-12T17:19:31.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.135+0000 7f1b4cc00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1b480b4950 0x7f1b48157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:31.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.135+0000 7f1b4cc00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b480b86c0 0x7f1b48158640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:31.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.135+0000 7f1b4cc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b48160090 0x7f1b480c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:31.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.135+0000 7f1b4cc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b480c9fa0 con 0x7f1b48160090 2024-03-12T17:19:31.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.135+0000 7f1b4cc00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b480ca190 con 0x7f1b480b86c0 2024-03-12T17:19:31.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.135+0000 7f1b4cc00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b4815f2a0 con 0x7f1b480b4950 2024-03-12T17:19:31.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.136+0000 7f1b47e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b48160090 0x7f1b480c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:31.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.136+0000 7f1b47e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b48160090 0x7f1b480c9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46718/0 (socket says 172.21.15.17:46718) 2024-03-12T17:19:31.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.136+0000 7f1b47e00640 1 -- 172.21.15.17:0/2052985853 learned_addr learned my addr 172.21.15.17:0/2052985853 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:31.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.136+0000 7f1b47400640 1 --2- 172.21.15.17:0/2052985853 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1b480b4950 0x7f1b48157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:31.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.136+0000 7f1b46a00640 1 --2- 172.21.15.17:0/2052985853 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b480b86c0 0x7f1b48158640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:31.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.136+0000 7f1b47e00640 1 -- 172.21.15.17:0/2052985853 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1b480b4950 msgr2=0x7f1b48157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:31.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.136+0000 7f1b47e00640 1 --2- 172.21.15.17:0/2052985853 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1b480b4950 0x7f1b48157bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:31.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.136+0000 7f1b47e00640 1 -- 172.21.15.17:0/2052985853 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b480b86c0 msgr2=0x7f1b48158640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:31.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.136+0000 7f1b47e00640 1 --2- 172.21.15.17:0/2052985853 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b480b86c0 0x7f1b48158640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:31.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.136+0000 7f1b47e00640 1 -- 172.21.15.17:0/2052985853 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b34009400 con 0x7f1b48160090 2024-03-12T17:19:31.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.136+0000 7f1b47e00640 1 --2- 172.21.15.17:0/2052985853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b48160090 0x7f1b480c9a60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1b4000c780 tx=0x7f1b4000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:31.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.137+0000 7f1b3f400640 1 -- 172.21.15.17:0/2052985853 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b40003d80 con 0x7f1b48160090 2024-03-12T17:19:31.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.137+0000 7f1b3f400640 1 -- 172.21.15.17:0/2052985853 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4000ce90 con 0x7f1b48160090 2024-03-12T17:19:31.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.137+0000 7f1b4cc00640 1 -- 172.21.15.17:0/2052985853 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b4815f580 con 0x7f1b48160090 2024-03-12T17:19:31.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.137+0000 7f1b3f400640 1 -- 172.21.15.17:0/2052985853 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b400052b0 con 0x7f1b48160090 2024-03-12T17:19:31.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.137+0000 7f1b4cc00640 1 -- 172.21.15.17:0/2052985853 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b481576a0 con 0x7f1b48160090 2024-03-12T17:19:31.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.138+0000 7f1b4cc00640 1 -- 172.21.15.17:0/2052985853 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b48067120 con 0x7f1b48160090 2024-03-12T17:19:31.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.139+0000 7f1b3f400640 1 -- 172.21.15.17:0/2052985853 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f1b40005410 con 0x7f1b48160090 2024-03-12T17:19:31.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.140+0000 7f1b3f400640 1 --2- 172.21.15.17:0/2052985853 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f1b2806ac00 0x7f1b2806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:31.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.140+0000 7f1b3f400640 1 -- 172.21.15.17:0/2052985853 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b40088b10 con 0x7f1b48160090 2024-03-12T17:19:31.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.140+0000 7f1b47400640 1 --2- 172.21.15.17:0/2052985853 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f1b2806ac00 0x7f1b2806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:31.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.141+0000 7f1b47400640 1 --2- 172.21.15.17:0/2052985853 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f1b2806ac00 0x7f1b2806d0c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1b38005880 tx=0x7f1b38009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:31.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.144+0000 7f1b3f400640 1 -- 172.21.15.17:0/2052985853 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f1b40053d80 con 0x7f1b48160090 2024-03-12T17:19:31.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.346+0000 7f1b4cc00640 1 -- 172.21.15.17:0/2052985853 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1b48072360 con 0x7f1b48160090 2024-03-12T17:19:31.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.347+0000 7f1b3f400640 1 -- 172.21.15.17:0/2052985853 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1b40017020 con 0x7f1b48160090 2024-03-12T17:19:31.343 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-03-12T17:19:31.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.350+0000 7f1b4cc00640 1 -- 172.21.15.17:0/2052985853 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f1b2806ac00 msgr2=0x7f1b2806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:31.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.350+0000 7f1b4cc00640 1 --2- 172.21.15.17:0/2052985853 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f1b2806ac00 0x7f1b2806d0c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f1b38005880 tx=0x7f1b38009040 comp rx=0 tx=0).stop 2024-03-12T17:19:31.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.350+0000 7f1b4cc00640 1 -- 172.21.15.17:0/2052985853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b48160090 msgr2=0x7f1b480c9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:31.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.350+0000 7f1b4cc00640 1 --2- 172.21.15.17:0/2052985853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b48160090 0x7f1b480c9a60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1b4000c780 tx=0x7f1b4000cc40 comp rx=0 tx=0).stop 2024-03-12T17:19:31.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.351+0000 7f1b4cc00640 1 -- 172.21.15.17:0/2052985853 shutdown_connections 2024-03-12T17:19:31.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.351+0000 7f1b4cc00640 1 --2- 172.21.15.17:0/2052985853 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f1b2806ac00 0x7f1b2806d0c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:31.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.351+0000 7f1b4cc00640 1 --2- 172.21.15.17:0/2052985853 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1b48160090 0x7f1b480c9a60 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:31.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.351+0000 7f1b4cc00640 1 --2- 172.21.15.17:0/2052985853 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1b480b86c0 0x7f1b48158640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:31.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.351+0000 7f1b4cc00640 1 --2- 172.21.15.17:0/2052985853 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1b480b4950 0x7f1b48157bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:31.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.351+0000 7f1b4cc00640 1 -- 172.21.15.17:0/2052985853 >> 172.21.15.17:0/2052985853 conn(0x7f1b480cf5f0 msgr2=0x7f1b4806b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:31.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.351+0000 7f1b4cc00640 1 -- 172.21.15.17:0/2052985853 shutdown_connections 2024-03-12T17:19:31.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.351+0000 7f1b4cc00640 1 -- 172.21.15.17:0/2052985853 wait complete. 2024-03-12T17:19:31.366 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-12T17:19:31.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.575+0000 7fb0a3e00640 1 Processor -- start 2024-03-12T17:19:31.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.575+0000 7fb0a3e00640 1 -- start start 2024-03-12T17:19:31.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.576+0000 7fb0a3e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb0a4145dc0 0x7fb0a4160ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:31.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.577+0000 7fb0a3e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb0a4070240 0x7fb0a40706a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:31.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.577+0000 7fb0a3e00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0a41461a0 con 0x7fb0a40b1860 2024-03-12T17:19:31.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.577+0000 7fb0a3e00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a40b2000 con 0x7fb0a4070240 2024-03-12T17:19:31.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.577+0000 7fb0a3e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a40b3db0 con 0x7fb0a4145dc0 2024-03-12T17:19:31.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.577+0000 7fb0a2000640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fb0a40b1860 0x7fb0a40b4240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:39456/0 (socket says 172.21.15.17:39456) 2024-03-12T17:19:31.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.577+0000 7fb0a2000640 1 -- 172.21.15.17:0/2173900797 learned_addr learned my addr 172.21.15.17:0/2173900797 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:31.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.577+0000 7fb0a3400640 1 --2- 172.21.15.17:0/2173900797 >> v2:172.21.15.17:3300/0 conn(0x7fb0a4070240 0x7fb0a40706a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:31.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.577+0000 7fb0a2a00640 1 --2- 172.21.15.17:0/2173900797 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb0a4145dc0 0x7fb0a4160ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:31.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.577+0000 7fb0a1600640 1 -- 172.21.15.17:0/2173900797 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2517356684 0 0) 0x7fb0a41461a0 con 0x7fb0a40b1860 2024-03-12T17:19:31.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.577+0000 7fb0a1600640 1 -- 172.21.15.17:0/2173900797 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb088003520 con 0x7fb0a40b1860 2024-03-12T17:19:31.573 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.578+0000 7fb0a3400640 1 -- 172.21.15.17:0/2173900797 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb0a4145dc0 msgr2=0x7fb0a4160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:31.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.578+0000 7fb0a3400640 1 --2- 172.21.15.17:0/2173900797 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb0a4145dc0 0x7fb0a4160ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:31.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.578+0000 7fb0a3400640 1 -- 172.21.15.17:0/2173900797 >> v1:172.21.15.17:6789/0 conn(0x7fb0a40b1860 legacy=0x7fb0a40b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:31.574 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.578+0000 7fb0a3400640 1 -- 172.21.15.17:0/2173900797 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a4070be0 con 0x7fb0a4070240 2024-03-12T17:19:31.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.579+0000 7fb0a3400640 1 --2- 172.21.15.17:0/2173900797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0a4070240 0x7fb0a40706a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb09c009d90 tx=0x7fb09c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95fa267e5c044173 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:31.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.579+0000 7fb0a1600640 1 -- 172.21.15.17:0/2173900797 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c02cc50 con 0x7fb0a4070240 2024-03-12T17:19:31.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.579+0000 7fb0a1600640 1 -- 172.21.15.17:0/2173900797 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09c02cdb0 con 0x7fb0a4070240 2024-03-12T17:19:31.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.579+0000 7fb0a1600640 1 -- 172.21.15.17:0/2173900797 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c034660 con 0x7fb0a4070240 2024-03-12T17:19:31.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.579+0000 7fb0a3e00640 1 -- 172.21.15.17:0/2173900797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0a4070240 msgr2=0x7fb0a40706a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:31.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.579+0000 7fb0a3e00640 1 --2- 172.21.15.17:0/2173900797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0a4070240 0x7fb0a40706a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb09c009d90 tx=0x7fb09c02bea0 comp rx=0 tx=0).stop 2024-03-12T17:19:31.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.580+0000 7fb0a3e00640 1 -- 172.21.15.17:0/2173900797 shutdown_connections 2024-03-12T17:19:31.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.580+0000 7fb0a3e00640 1 --2- 172.21.15.17:0/2173900797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0a4070240 0x7fb0a40706a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:31.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.580+0000 7fb0a3e00640 1 --2- 172.21.15.17:0/2173900797 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb0a4145dc0 0x7fb0a4160ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:31.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.580+0000 7fb0a3e00640 1 -- 172.21.15.17:0/2173900797 >> 172.21.15.17:0/2173900797 conn(0x7fb0a4069ce0 msgr2=0x7fb0a406a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:31.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.580+0000 7fb0a3e00640 1 -- 172.21.15.17:0/2173900797 shutdown_connections 2024-03-12T17:19:31.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.580+0000 7fb0a3e00640 1 -- 172.21.15.17:0/2173900797 wait complete. 2024-03-12T17:19:31.576 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.581+0000 7fb0a3e00640 1 Processor -- start 2024-03-12T17:19:31.577 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.582+0000 7fb0a3e00640 1 -- start start 2024-03-12T17:19:31.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.582+0000 7fb0a3e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb0a4070240 0x7fb0a4140460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:31.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.582+0000 7fb0a3e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0a40b1860 0x7fb0a415f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:31.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.582+0000 7fb0a3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0a4145dc0 0x7fb0a415f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:31.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.582+0000 7fb0a3e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a40c41e0 con 0x7fb0a4145dc0 2024-03-12T17:19:31.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.582+0000 7fb0a3e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a40c44c0 con 0x7fb0a40b1860 2024-03-12T17:19:31.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.582+0000 7fb0a3e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a40c47a0 con 0x7fb0a4070240 2024-03-12T17:19:31.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.583+0000 7fb0a3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0a4145dc0 0x7fb0a415f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:31.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.583+0000 7fb0a3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0a4145dc0 0x7fb0a415f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:46746/0 (socket says 172.21.15.17:46746) 2024-03-12T17:19:31.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.583+0000 7fb0a3400640 1 -- 172.21.15.17:0/3395539525 learned_addr learned my addr 172.21.15.17:0/3395539525 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:31.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.583+0000 7fb0a2a00640 1 --2- 172.21.15.17:0/3395539525 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb0a4070240 0x7fb0a4140460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:31.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.583+0000 7fb0a2000640 1 --2- 172.21.15.17:0/3395539525 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0a40b1860 0x7fb0a415f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:31.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.583+0000 7fb0a3400640 1 -- 172.21.15.17:0/3395539525 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb0a4070240 msgr2=0x7fb0a4140460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:31.579 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.583+0000 7fb0a3400640 1 --2- 172.21.15.17:0/3395539525 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb0a4070240 0x7fb0a4140460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:31.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.583+0000 7fb0a3400640 1 -- 172.21.15.17:0/3395539525 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0a40b1860 msgr2=0x7fb0a415f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:31.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.583+0000 7fb0a3400640 1 --2- 172.21.15.17:0/3395539525 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0a40b1860 0x7fb0a415f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:31.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.583+0000 7fb0a3400640 1 -- 172.21.15.17:0/3395539525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb09c009a70 con 0x7fb0a4145dc0 2024-03-12T17:19:31.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.583+0000 7fb0a2000640 1 --2- 172.21.15.17:0/3395539525 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0a40b1860 0x7fb0a415f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:31.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.584+0000 7fb0a3400640 1 --2- 172.21.15.17:0/3395539525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0a4145dc0 0x7fb0a415f790 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb09c009d90 tx=0x7fb09c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:31.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.584+0000 7fb09aa00640 1 -- 172.21.15.17:0/3395539525 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c040650 con 0x7fb0a4145dc0 2024-03-12T17:19:31.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.584+0000 7fb09aa00640 1 -- 172.21.15.17:0/3395539525 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09c0407b0 con 0x7fb0a4145dc0 2024-03-12T17:19:31.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.584+0000 7fb0a3e00640 1 -- 172.21.15.17:0/3395539525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a40c4a80 con 0x7fb0a4145dc0 2024-03-12T17:19:31.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.584+0000 7fb09aa00640 1 -- 172.21.15.17:0/3395539525 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb09c040b60 con 0x7fb0a4145dc0 2024-03-12T17:19:31.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.584+0000 7fb0a3e00640 1 -- 172.21.15.17:0/3395539525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a41409a0 con 0x7fb0a4145dc0 2024-03-12T17:19:31.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.585+0000 7fb0a3e00640 1 -- 172.21.15.17:0/3395539525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0a404e030 con 0x7fb0a4145dc0 2024-03-12T17:19:31.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.586+0000 7fb09aa00640 1 -- 172.21.15.17:0/3395539525 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fb09c040cc0 con 0x7fb0a4145dc0 2024-03-12T17:19:31.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.587+0000 7fb09aa00640 1 --2- 172.21.15.17:0/3395539525 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb08406ac00 0x7fb08406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:31.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.587+0000 7fb09aa00640 1 -- 172.21.15.17:0/3395539525 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb09c0ac150 con 0x7fb0a4145dc0 2024-03-12T17:19:31.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.587+0000 7fb0a2a00640 1 --2- 172.21.15.17:0/3395539525 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb08406ac00 0x7fb08406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:31.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.588+0000 7fb0a2a00640 1 --2- 172.21.15.17:0/3395539525 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb08406ac00 0x7fb08406d0c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb094006fd0 tx=0x7fb094008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:31.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.592+0000 7fb09aa00640 1 -- 172.21.15.17:0/3395539525 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fb09c077290 con 0x7fb0a4145dc0 2024-03-12T17:19:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.779+0000 7fb0a3e00640 1 -- 172.21.15.17:0/3395539525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb0a40ad1b0 con 0x7fb0a4145dc0 2024-03-12T17:19:31.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.780+0000 7fb09aa00640 1 -- 172.21.15.17:0/3395539525 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb09c009450 con 0x7fb0a4145dc0 2024-03-12T17:19:31.776 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-03-12T17:19:31.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.783+0000 7fb0a3e00640 1 -- 172.21.15.17:0/3395539525 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb08406ac00 msgr2=0x7fb08406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:31.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.783+0000 7fb0a3e00640 1 --2- 172.21.15.17:0/3395539525 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb08406ac00 0x7fb08406d0c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb094006fd0 tx=0x7fb094008040 comp rx=0 tx=0).stop 2024-03-12T17:19:31.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.783+0000 7fb0a3e00640 1 -- 172.21.15.17:0/3395539525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0a4145dc0 msgr2=0x7fb0a415f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:31.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.783+0000 7fb0a3e00640 1 --2- 172.21.15.17:0/3395539525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0a4145dc0 0x7fb0a415f790 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb09c009d90 tx=0x7fb09c004a40 comp rx=0 tx=0).stop 2024-03-12T17:19:31.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.783+0000 7fb0a3e00640 1 -- 172.21.15.17:0/3395539525 shutdown_connections 2024-03-12T17:19:31.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.783+0000 7fb0a3e00640 1 --2- 172.21.15.17:0/3395539525 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb08406ac00 0x7fb08406d0c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:31.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.783+0000 7fb0a3e00640 1 --2- 172.21.15.17:0/3395539525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb0a4145dc0 0x7fb0a415f790 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:31.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.783+0000 7fb0a3e00640 1 --2- 172.21.15.17:0/3395539525 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb0a40b1860 0x7fb0a415f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:31.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.783+0000 7fb0a3e00640 1 --2- 172.21.15.17:0/3395539525 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb0a4070240 0x7fb0a4140460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:31.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.783+0000 7fb0a3e00640 1 -- 172.21.15.17:0/3395539525 >> 172.21.15.17:0/3395539525 conn(0x7fb0a4069ce0 msgr2=0x7fb0a40cda80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:31.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.783+0000 7fb0a3e00640 1 -- 172.21.15.17:0/3395539525 shutdown_connections 2024-03-12T17:19:31.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:31.783+0000 7fb0a3e00640 1 -- 172.21.15.17:0/3395539525 wait complete. 2024-03-12T17:19:31.797 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-12T17:19:32.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.008+0000 7f6bfa400640 1 Processor -- start 2024-03-12T17:19:32.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.008+0000 7f6bfa400640 1 -- start start 2024-03-12T17:19:32.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.009+0000 7f6bfa400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6bf415ca10 0x7f6bf40abd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:32.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.009+0000 7f6bfa400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6bf415cdf0 0x7f6bf40cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:32.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.009+0000 7f6bfa400640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bf415dee0 con 0x7f6bf40add50 2024-03-12T17:19:32.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.009+0000 7f6bfa400640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bf415d2d0 con 0x7f6bf415cdf0 2024-03-12T17:19:32.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.009+0000 7f6bfa400640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf415d5b0 con 0x7f6bf415ca10 2024-03-12T17:19:32.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.010+0000 7f6beaa00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f6bf415cdf0 0x7f6bf40cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:32.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.010+0000 7f6bf3e00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f6bf40add50 0x7f6bf40b2120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:38480/0 (socket says 172.21.15.17:38480) 2024-03-12T17:19:32.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.010+0000 7f6bf3e00640 1 -- 172.21.15.17:0/1635065319 learned_addr learned my addr 172.21.15.17:0/1635065319 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:32.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.010+0000 7f6bf3400640 1 --2- 172.21.15.17:0/1635065319 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6bf415ca10 0x7f6bf40abd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:32.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.010+0000 7f6beaa00640 1 -- 172.21.15.17:0/1635065319 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6bf415ca10 msgr2=0x7f6bf40abd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:32.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.010+0000 7f6beaa00640 1 --2- 172.21.15.17:0/1635065319 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6bf415ca10 0x7f6bf40abd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:32.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.010+0000 7f6beaa00640 1 -- 172.21.15.17:0/1635065319 >> v1:172.21.15.17:6789/0 conn(0x7f6bf40add50 legacy=0x7f6bf40b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:32.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.010+0000 7f6beaa00640 1 -- 172.21.15.17:0/1635065319 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf415d890 con 0x7f6bf415cdf0 2024-03-12T17:19:32.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.011+0000 7f6beaa00640 1 --2- 172.21.15.17:0/1635065319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bf415cdf0 0x7f6bf40cee40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc0097a0 tx=0x7f6bdc02b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=749b7841c37c48ef server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:32.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.012+0000 7f6bf2a00640 1 -- 172.21.15.17:0/1635065319 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc031780 con 0x7f6bf415cdf0 2024-03-12T17:19:32.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.012+0000 7f6bf2a00640 1 -- 172.21.15.17:0/1635065319 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bdc0318e0 con 0x7f6bf415cdf0 2024-03-12T17:19:32.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.012+0000 7f6bf2a00640 1 -- 172.21.15.17:0/1635065319 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc031c70 con 0x7f6bf415cdf0 2024-03-12T17:19:32.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.012+0000 7f6bfa400640 1 -- 172.21.15.17:0/1635065319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bf415cdf0 msgr2=0x7f6bf40cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:32.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.012+0000 7f6bfa400640 1 --2- 172.21.15.17:0/1635065319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bf415cdf0 0x7f6bf40cee40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc0097a0 tx=0x7f6bdc02b820 comp rx=0 tx=0).stop 2024-03-12T17:19:32.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.012+0000 7f6bfa400640 1 -- 172.21.15.17:0/1635065319 shutdown_connections 2024-03-12T17:19:32.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.012+0000 7f6bfa400640 1 --2- 172.21.15.17:0/1635065319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bf415cdf0 0x7f6bf40cee40 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:32.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.012+0000 7f6bfa400640 1 --2- 172.21.15.17:0/1635065319 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6bf415ca10 0x7f6bf40abd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:32.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.012+0000 7f6bfa400640 1 -- 172.21.15.17:0/1635065319 >> 172.21.15.17:0/1635065319 conn(0x7f6bf4069ce0 msgr2=0x7f6bf406a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:32.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.012+0000 7f6bfa400640 1 -- 172.21.15.17:0/1635065319 shutdown_connections 2024-03-12T17:19:32.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.012+0000 7f6bfa400640 1 -- 172.21.15.17:0/1635065319 wait complete. 2024-03-12T17:19:32.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.014+0000 7f6bfa400640 1 Processor -- start 2024-03-12T17:19:32.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.014+0000 7f6bfa400640 1 -- start start 2024-03-12T17:19:32.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.015+0000 7f6bfa400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6bf40add50 0x7f6bf41565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:32.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.015+0000 7f6bfa400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bf415ca10 0x7f6bf4151690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:32.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.015+0000 7f6bfa400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bf415cdf0 0x7f6bf4154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:32.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.015+0000 7f6bfa400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf41f2320 con 0x7f6bf415ca10 2024-03-12T17:19:32.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.015+0000 7f6bfa400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf4156ea0 con 0x7f6bf415cdf0 2024-03-12T17:19:32.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.015+0000 7f6bfa400640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf41f2530 con 0x7f6bf40add50 2024-03-12T17:19:32.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.016+0000 7f6beaa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bf415ca10 0x7f6bf4151690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:32.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.016+0000 7f6beaa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bf415ca10 0x7f6bf4151690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55056/0 (socket says 172.21.15.17:55056) 2024-03-12T17:19:32.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.016+0000 7f6beaa00640 1 -- 172.21.15.17:0/896175992 learned_addr learned my addr 172.21.15.17:0/896175992 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:32.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.016+0000 7f6bf3400640 1 --2- 172.21.15.17:0/896175992 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6bf40add50 0x7f6bf41565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:32.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.016+0000 7f6bf3e00640 1 --2- 172.21.15.17:0/896175992 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bf415cdf0 0x7f6bf4154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:32.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.016+0000 7f6beaa00640 1 -- 172.21.15.17:0/896175992 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6bf40add50 msgr2=0x7f6bf41565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:32.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.016+0000 7f6beaa00640 1 --2- 172.21.15.17:0/896175992 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6bf40add50 0x7f6bf41565c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:32.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.016+0000 7f6beaa00640 1 -- 172.21.15.17:0/896175992 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bf415cdf0 msgr2=0x7f6bf4154790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:32.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.016+0000 7f6beaa00640 1 --2- 172.21.15.17:0/896175992 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bf415cdf0 0x7f6bf4154790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:32.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.016+0000 7f6beaa00640 1 -- 172.21.15.17:0/896175992 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bdc009400 con 0x7f6bf415ca10 2024-03-12T17:19:32.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.017+0000 7f6beaa00640 1 --2- 172.21.15.17:0/896175992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bf415ca10 0x7f6bf4151690 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc034040 tx=0x7f6bdc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:32.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.017+0000 7f6bebe00640 1 -- 172.21.15.17:0/896175992 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc032820 con 0x7f6bf415ca10 2024-03-12T17:19:32.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.017+0000 7f6bebe00640 1 -- 172.21.15.17:0/896175992 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bdc032980 con 0x7f6bf415ca10 2024-03-12T17:19:32.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.017+0000 7f6bebe00640 1 -- 172.21.15.17:0/896175992 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc032d30 con 0x7f6bf415ca10 2024-03-12T17:19:32.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.017+0000 7f6bfa400640 1 -- 172.21.15.17:0/896175992 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bf41f2810 con 0x7f6bf415ca10 2024-03-12T17:19:32.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.017+0000 7f6bfa400640 1 -- 172.21.15.17:0/896175992 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bf4156b00 con 0x7f6bf415ca10 2024-03-12T17:19:32.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.019+0000 7f6bfa400640 1 -- 172.21.15.17:0/896175992 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bf40736c0 con 0x7f6bf415ca10 2024-03-12T17:19:32.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.020+0000 7f6bebe00640 1 -- 172.21.15.17:0/896175992 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f6bdc04e440 con 0x7f6bf415ca10 2024-03-12T17:19:32.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.020+0000 7f6bebe00640 1 --2- 172.21.15.17:0/896175992 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f6bd006ac00 0x7f6bd006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:32.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.020+0000 7f6bebe00640 1 -- 172.21.15.17:0/896175992 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6bdc0ab4a0 con 0x7f6bf415ca10 2024-03-12T17:19:32.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.021+0000 7f6bf3400640 1 --2- 172.21.15.17:0/896175992 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f6bd006ac00 0x7f6bd006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:32.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.021+0000 7f6bf3400640 1 --2- 172.21.15.17:0/896175992 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f6bd006ac00 0x7f6bd006d0c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6be4006fd0 tx=0x7f6be4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:32.020 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.025+0000 7f6bebe00640 1 -- 172.21.15.17:0/896175992 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f6bdc076680 con 0x7f6bf415ca10 2024-03-12T17:19:32.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.237+0000 7f6bfa400640 1 -- 172.21.15.17:0/896175992 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6bf40ac790 con 0x7f6bf415ca10 2024-03-12T17:19:32.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.237+0000 7f6bebe00640 1 -- 172.21.15.17:0/896175992 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6bdc079ca0 con 0x7f6bf415ca10 2024-03-12T17:19:32.233 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2024-03-12T17:19:32.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.240+0000 7f6bfa400640 1 -- 172.21.15.17:0/896175992 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f6bd006ac00 msgr2=0x7f6bd006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:32.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.240+0000 7f6bfa400640 1 --2- 172.21.15.17:0/896175992 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f6bd006ac00 0x7f6bd006d0c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6be4006fd0 tx=0x7f6be4008040 comp rx=0 tx=0).stop 2024-03-12T17:19:32.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.240+0000 7f6bfa400640 1 -- 172.21.15.17:0/896175992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bf415ca10 msgr2=0x7f6bf4151690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:32.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.240+0000 7f6bfa400640 1 --2- 172.21.15.17:0/896175992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bf415ca10 0x7f6bf4151690 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc034040 tx=0x7f6bdc0046c0 comp rx=0 tx=0).stop 2024-03-12T17:19:32.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.240+0000 7f6bfa400640 1 -- 172.21.15.17:0/896175992 shutdown_connections 2024-03-12T17:19:32.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.240+0000 7f6bfa400640 1 --2- 172.21.15.17:0/896175992 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f6bd006ac00 0x7f6bd006d0c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:32.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.240+0000 7f6bfa400640 1 --2- 172.21.15.17:0/896175992 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bf415cdf0 0x7f6bf4154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:32.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.240+0000 7f6bfa400640 1 --2- 172.21.15.17:0/896175992 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bf415ca10 0x7f6bf4151690 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:32.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.240+0000 7f6bfa400640 1 --2- 172.21.15.17:0/896175992 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6bf40add50 0x7f6bf41565c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:32.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.240+0000 7f6bfa400640 1 -- 172.21.15.17:0/896175992 >> 172.21.15.17:0/896175992 conn(0x7f6bf4069ce0 msgr2=0x7f6bf40afb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:32.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.240+0000 7f6bfa400640 1 -- 172.21.15.17:0/896175992 shutdown_connections 2024-03-12T17:19:32.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:32.241+0000 7f6bfa400640 1 -- 172.21.15.17:0/896175992 wait complete. 2024-03-12T17:19:32.255 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-03-12T17:19:32.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:32.255 DEBUG:teuthology.orchestra.run.smithi094:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-03-12T17:19:32.364 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi094.front.sepia.ceph.com 2024-03-12T17:19:32.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:32.364 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-12T17:19:32.605 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:19:32.605 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-12T17:19:32.666 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:19:32.666 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-12T17:19:32.718 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:19:32.719 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-12T17:19:32.774 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T17:19:32.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.003+0000 7feeea600640 1 Processor -- start 2024-03-12T17:19:32.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.003+0000 7feeea600640 1 -- start start 2024-03-12T17:19:32.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.004+0000 7feeea600640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7feee40d2fa0 0x7feee40d3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:32.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.004+0000 7feeea600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feee40b5f70 0x7feee40d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:32.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.004+0000 7feeea600640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feee40d14e0 con 0x7feee40b5b50 2024-03-12T17:19:32.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.004+0000 7feeea600640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feee40b59e0 con 0x7feee40d2fa0 2024-03-12T17:19:32.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.004+0000 7feeea600640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee40d38c0 con 0x7feee40b5f70 2024-03-12T17:19:32.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.004+0000 7feedaa00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7feee40b5b50 0x7feee40cd840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:38492/0 (socket says 172.21.15.17:38492) 2024-03-12T17:19:33.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.004+0000 7feedaa00640 1 -- 172.21.15.17:0/1441355292 learned_addr learned my addr 172.21.15.17:0/1441355292 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:33.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.005+0000 7feee3e00640 1 --2- 172.21.15.17:0/1441355292 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feee40b5f70 0x7feee40d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:33.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.005+0000 7feee3400640 1 --2- 172.21.15.17:0/1441355292 >> v2:172.21.15.94:3300/0 conn(0x7feee40d2fa0 0x7feee40d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:33.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.005+0000 7feee2a00640 1 -- 172.21.15.17:0/1441355292 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 378632715 0 0) 0x7feee40d14e0 con 0x7feee40b5b50 2024-03-12T17:19:33.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.005+0000 7feee2a00640 1 -- 172.21.15.17:0/1441355292 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feec8003520 con 0x7feee40b5b50 2024-03-12T17:19:33.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.005+0000 7feee2a00640 1 -- 172.21.15.17:0/1441355292 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2157333589 0 0) 0x7feec8003520 con 0x7feee40b5b50 2024-03-12T17:19:33.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.005+0000 7feee2a00640 1 -- 172.21.15.17:0/1441355292 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feee40b5f70 msgr2=0x7feee40d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:33.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.005+0000 7feee2a00640 1 --2- 172.21.15.17:0/1441355292 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feee40b5f70 0x7feee40d1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:33.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.005+0000 7feee2a00640 1 -- 172.21.15.17:0/1441355292 >> v2:172.21.15.94:3300/0 conn(0x7feee40d2fa0 msgr2=0x7feee40d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:33.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.005+0000 7feee2a00640 1 --2- 172.21.15.17:0/1441355292 >> v2:172.21.15.94:3300/0 conn(0x7feee40d2fa0 0x7feee40d3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:33.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.005+0000 7feee2a00640 1 -- 172.21.15.17:0/1441355292 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee40b85b0 con 0x7feee40b5b50 2024-03-12T17:19:33.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.005+0000 7feee2a00640 1 -- 172.21.15.17:0/1441355292 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7feecc001670 con 0x7feee40b5b50 2024-03-12T17:19:33.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.005+0000 7feee2a00640 1 -- 172.21.15.17:0/1441355292 >> v1:172.21.15.17:6789/0 conn(0x7feee40b5b50 legacy=0x7feee40cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:33.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.005+0000 7feee2a00640 1 --2- 172.21.15.17:0/1441355292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feec8003970 0x7feec8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:33.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.005+0000 7feee2a00640 1 --2- 172.21.15.17:0/1441355292 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feee40b5f70 0x7feec80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:33.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.005+0000 7feee2a00640 1 --2- 172.21.15.17:0/1441355292 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feec8004d00 0x7feec8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:33.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.005+0000 7feee2a00640 1 -- 172.21.15.17:0/1441355292 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee40d38c0 con 0x7feec8003970 2024-03-12T17:19:33.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.005+0000 7feee2a00640 1 -- 172.21.15.17:0/1441355292 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec800b980 con 0x7feec8004d00 2024-03-12T17:19:33.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.005+0000 7feee2a00640 1 -- 172.21.15.17:0/1441355292 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec800bac0 con 0x7feee40b5f70 2024-03-12T17:19:33.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.006+0000 7feee3400640 1 --2- 172.21.15.17:0/1441355292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feec8003970 0x7feec8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:33.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.006+0000 7feedaa00640 1 --2- 172.21.15.17:0/1441355292 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feee40b5f70 0x7feec80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:33.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.006+0000 7feee3e00640 1 --2- 172.21.15.17:0/1441355292 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feec8004d00 0x7feec8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:33.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.006+0000 7feee3400640 1 -- 172.21.15.17:0/1441355292 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feee40b5f70 msgr2=0x7feec80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:33.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.006+0000 7feee3400640 1 --2- 172.21.15.17:0/1441355292 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feee40b5f70 0x7feec80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:33.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.006+0000 7feee3400640 1 -- 172.21.15.17:0/1441355292 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feec8004d00 msgr2=0x7feec8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:33.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.006+0000 7feee3400640 1 --2- 172.21.15.17:0/1441355292 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feec8004d00 0x7feec8005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:33.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.006+0000 7feee3400640 1 -- 172.21.15.17:0/1441355292 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec8003520 con 0x7feec8003970 2024-03-12T17:19:33.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.006+0000 7feedaa00640 1 --2- 172.21.15.17:0/1441355292 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feee40b5f70 0x7feec80047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:33.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.007+0000 7feee3400640 1 --2- 172.21.15.17:0/1441355292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feec8003970 0x7feec8003d90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7feed4009af0 tx=0x7feec80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d790eb46f84cc521 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:33.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.008+0000 7feee2a00640 1 -- 172.21.15.17:0/1441355292 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed402c710 con 0x7feec8003970 2024-03-12T17:19:33.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.008+0000 7feee2a00640 1 -- 172.21.15.17:0/1441355292 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed402c870 con 0x7feec8003970 2024-03-12T17:19:33.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.008+0000 7feee2a00640 1 -- 172.21.15.17:0/1441355292 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed402cc00 con 0x7feec8003970 2024-03-12T17:19:33.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.008+0000 7feeea600640 1 -- 172.21.15.17:0/1441355292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feec8003970 msgr2=0x7feec8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:33.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.008+0000 7feeea600640 1 --2- 172.21.15.17:0/1441355292 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feec8003970 0x7feec8003d90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7feed4009af0 tx=0x7feec80057f0 comp rx=0 tx=0).stop 2024-03-12T17:19:33.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.008+0000 7feee3e00640 1 -- 172.21.15.17:0/1441355292 reap_dead start 2024-03-12T17:19:33.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.008+0000 7feeea600640 1 -- 172.21.15.17:0/1441355292 shutdown_connections 2024-03-12T17:19:33.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.008+0000 7feeea600640 1 -- 172.21.15.17:0/1441355292 >> 172.21.15.17:0/1441355292 conn(0x7feee4065df0 msgr2=0x7feee4066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:33.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.008+0000 7feeea600640 1 -- 172.21.15.17:0/1441355292 shutdown_connections 2024-03-12T17:19:33.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.008+0000 7feeea600640 1 -- 172.21.15.17:0/1441355292 wait complete. 2024-03-12T17:19:33.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.010+0000 7feeea600640 1 Processor -- start 2024-03-12T17:19:33.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.010+0000 7feeea600640 1 -- start start 2024-03-12T17:19:33.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.011+0000 7feeea600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feec8003970 0x7feee40c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:33.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.011+0000 7feeea600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feee40cac00 0x7feee4151cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:33.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.011+0000 7feeea600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feee40cc440 0x7feee415f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:33.007 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.011+0000 7feeea600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee40cb3a0 con 0x7feee40cac00 2024-03-12T17:19:33.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.011+0000 7feeea600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee40cb680 con 0x7feee40cc440 2024-03-12T17:19:33.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.011+0000 7feeea600640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee40cb960 con 0x7feec8003970 2024-03-12T17:19:33.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.012+0000 7feedaa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feee40cac00 0x7feee4151cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:33.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.012+0000 7feedaa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feee40cac00 0x7feee4151cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55062/0 (socket says 172.21.15.17:55062) 2024-03-12T17:19:33.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.012+0000 7feedaa00640 1 -- 172.21.15.17:0/262586591 learned_addr learned my addr 172.21.15.17:0/262586591 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:33.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.012+0000 7feee3400640 1 --2- 172.21.15.17:0/262586591 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feec8003970 0x7feee40c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:33.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.012+0000 7feee3e00640 1 --2- 172.21.15.17:0/262586591 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feee40cc440 0x7feee415f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:33.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.012+0000 7feedaa00640 1 -- 172.21.15.17:0/262586591 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feec8003970 msgr2=0x7feee40c8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:33.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.012+0000 7feedaa00640 1 --2- 172.21.15.17:0/262586591 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feec8003970 0x7feee40c8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:33.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.012+0000 7feedaa00640 1 -- 172.21.15.17:0/262586591 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feee40cc440 msgr2=0x7feee415f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:33.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.012+0000 7feedaa00640 1 --2- 172.21.15.17:0/262586591 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feee40cc440 0x7feee415f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:33.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.012+0000 7feedaa00640 1 -- 172.21.15.17:0/262586591 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee40cbc40 con 0x7feee40cac00 2024-03-12T17:19:33.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.012+0000 7feedaa00640 1 --2- 172.21.15.17:0/262586591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feee40cac00 0x7feee4151cf0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7feecc00d770 tx=0x7feecc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:33.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.013+0000 7feedbe00640 1 -- 172.21.15.17:0/262586591 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feecc0074e0 con 0x7feee40cac00 2024-03-12T17:19:33.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.013+0000 7feedbe00640 1 -- 172.21.15.17:0/262586591 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feecc007640 con 0x7feee40cac00 2024-03-12T17:19:33.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.013+0000 7feedbe00640 1 -- 172.21.15.17:0/262586591 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feecc004a20 con 0x7feee40cac00 2024-03-12T17:19:33.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.013+0000 7feeea600640 1 -- 172.21.15.17:0/262586591 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee40cbf20 con 0x7feee40cac00 2024-03-12T17:19:33.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.013+0000 7feeea600640 1 -- 172.21.15.17:0/262586591 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee40cb080 con 0x7feee40cac00 2024-03-12T17:19:33.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.014+0000 7feeea600640 1 -- 172.21.15.17:0/262586591 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feee40cc110 con 0x7feee40cac00 2024-03-12T17:19:33.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.015+0000 7feedbe00640 1 -- 172.21.15.17:0/262586591 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7feecc004b80 con 0x7feee40cac00 2024-03-12T17:19:33.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.016+0000 7feedbe00640 1 --2- 172.21.15.17:0/262586591 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7feec006ac30 0x7feec006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:33.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.016+0000 7feedbe00640 1 -- 172.21.15.17:0/262586591 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7feecc088bc0 con 0x7feee40cac00 2024-03-12T17:19:33.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.016+0000 7feee3400640 1 --2- 172.21.15.17:0/262586591 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7feec006ac30 0x7feec006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:33.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.017+0000 7feee3400640 1 --2- 172.21.15.17:0/262586591 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7feec006ac30 0x7feec006d0f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7feed4036000 tx=0x7feed4030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:33.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.021+0000 7feedbe00640 1 -- 172.21.15.17:0/262586591 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7feecc053d10 con 0x7feee40cac00 2024-03-12T17:19:33.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.221+0000 7feeea600640 1 -- 172.21.15.17:0/262586591 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feee40736c0 con 0x7feee40cac00 2024-03-12T17:19:33.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.225+0000 7feedbe00640 1 -- 172.21.15.17:0/262586591 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16238 (secure 0 0 0) 0x7feecc019090 con 0x7feee40cac00 2024-03-12T17:19:33.220 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:19:33.220 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":22,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:19:32.378435+0000","last_up_change":"2024-03-12T17:18:38.144756+0000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-12T17:18:39.552910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-12T17:18:43.794908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-12T17:18:44.867006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":37305},{"type":"v1","addr":"172.21.15.17:6801","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":37305},{"type":"v1","addr":"172.21.15.17:6803","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":37305},{"type":"v1","addr":"172.21.15.17:6807","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":37305},{"type":"v1","addr":"172.21.15.17:6805","nonce":37305}]},"public_addr":"172.21.15.17:6801/37305","cluster_addr":"172.21.15.17:6803/37305","heartbeat_back_addr":"172.21.15.17:6807/37305","heartbeat_front_addr":"172.21.15.17:6805/37305","state":["exists","up"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":37307},{"type":"v1","addr":"172.21.15.17:6814","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":37307},{"type":"v1","addr":"172.21.15.17:6818","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":37307},{"type":"v1","addr":"172.21.15.17:6827","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":37307},{"type":"v1","addr":"172.21.15.17:6823","nonce":37307}]},"public_addr":"172.21.15.17:6814/37307","cluster_addr":"172.21.15.17:6818/37307","heartbeat_back_addr":"172.21.15.17:6827/37307","heartbeat_front_addr":"172.21.15.17:6823/37307","state":["exists","up"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":37303},{"type":"v1","addr":"172.21.15.17:6809","nonce":37303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":37303},{"type":"v1","addr":"172.21.15.17:6811","nonce":37303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":37303},{"type":"v1","addr":"172.21.15.17:6819","nonce":37303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":37303},{"type":"v1","addr":"172.21.15.17:6815","nonce":37303}]},"public_addr":"172.21.15.17:6809/37303","cluster_addr":"172.21.15.17:6811/37303","heartbeat_back_addr":"172.21.15.17:6819/37303","heartbeat_front_addr":"172.21.15.17:6815/37303","state":["exists","up"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":37308},{"type":"v1","addr":"172.21.15.17:6822","nonce":37308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":37308},{"type":"v1","addr":"172.21.15.17:6826","nonce":37308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":37308},{"type":"v1","addr":"172.21.15.17:6831","nonce":37308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":37308},{"type":"v1","addr":"172.21.15.17:6829","nonce":37308}]},"public_addr":"172.21.15.17:6822/37308","cluster_addr":"172.21.15.17:6826/37308","heartbeat_back_addr":"172.21.15.17:6831/37308","heartbeat_front_addr":"172.21.15.17:6829/37308","state":["exists","up"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":37465},{"type":"v1","addr":"172.21.15.94:6809","nonce":37465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6811","nonce":37465},{"type":"v1","addr":"172.21.15.94:6813","nonce":37465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6819","nonce":37465},{"type":"v1","addr":"172.21.15.94:6822","nonce":37465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6815","nonce":37465},{"type":"v1","addr":"172.21.15.94:6817","nonce":37465}]},"public_addr":"172.21.15.94:6809/37465","cluster_addr":"172.21.15.94:6813/37465","heartbeat_back_addr":"172.21.15.94:6822/37465","heartbeat_front_addr":"172.21.15.94:6817/37465","state":["exists","up"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":37464},{"type":"v1","addr":"172.21.15.94:6812","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":37464},{"type":"v1","addr":"172.21.15.94:6816","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":37464},{"type":"v1","addr":"172.21.15.94:6823","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":37464},{"type":"v1","addr":"172.21.15.94:6820","nonce":37464}]},"public_addr":"172.21.15.94:6812/37464","cluster_addr":"172.21.15.94:6816/37464","heartbeat_back_addr":"172.21.15.94:6823/37464","heartbeat_front_addr":"172.21.15.94:6820/37464","state":["exists","up"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":37467},{"type":"v1","addr":"172.21.15.94:6825","nonce":37467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":37467},{"type":"v1","addr":"172.21.15.94:6827","nonce":37467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":37467},{"type":"v1","addr":"172.21.15.94:6831","nonce":37467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":37467},{"type":"v1","addr":"172.21.15.94:6829","nonce":37467}]},"public_addr":"172.21.15.94:6825/37467","cluster_addr":"172.21.15.94:6827/37467","heartbeat_back_addr":"172.21.15.94:6831/37467","heartbeat_front_addr":"172.21.15.94:6829/37467","state":["exists","up"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":37466},{"type":"v1","addr":"172.21.15.94:6801","nonce":37466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":37466},{"type":"v1","addr":"172.21.15.94:6803","nonce":37466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":37466},{"type":"v1","addr":"172.21.15.94:6807","nonce":37466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":37466},{"type":"v1","addr":"172.21.15.94:6805","nonce":37466}]},"public_addr":"172.21.15.94:6801/37466","cluster_addr":"172.21.15.94:6803/37466","heartbeat_back_addr":"172.21.15.94:6807/37466","heartbeat_front_addr":"172.21.15.94:6805/37466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.327217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.186966+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.419986+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.150585+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.120621+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.121576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.181257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.293188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:19:33.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.227+0000 7feeea600640 1 -- 172.21.15.17:0/262586591 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7feec006ac30 msgr2=0x7feec006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:33.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.227+0000 7feeea600640 1 --2- 172.21.15.17:0/262586591 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7feec006ac30 0x7feec006d0f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7feed4036000 tx=0x7feed4030000 comp rx=0 tx=0).stop 2024-03-12T17:19:33.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.227+0000 7feeea600640 1 -- 172.21.15.17:0/262586591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feee40cac00 msgr2=0x7feee4151cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:33.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.227+0000 7feeea600640 1 --2- 172.21.15.17:0/262586591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feee40cac00 0x7feee4151cf0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7feecc00d770 tx=0x7feecc00dc30 comp rx=0 tx=0).stop 2024-03-12T17:19:33.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.228+0000 7feeea600640 1 -- 172.21.15.17:0/262586591 shutdown_connections 2024-03-12T17:19:33.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.228+0000 7feeea600640 1 --2- 172.21.15.17:0/262586591 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7feec006ac30 0x7feec006d0f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:33.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.228+0000 7feeea600640 1 --2- 172.21.15.17:0/262586591 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feee40cc440 0x7feee415f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:33.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.228+0000 7feeea600640 1 --2- 172.21.15.17:0/262586591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feee40cac00 0x7feee4151cf0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:33.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.228+0000 7feeea600640 1 --2- 172.21.15.17:0/262586591 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feec8003970 0x7feee40c8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:33.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.228+0000 7feeea600640 1 -- 172.21.15.17:0/262586591 >> 172.21.15.17:0/262586591 conn(0x7feee4065df0 msgr2=0x7feee40b6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:33.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.228+0000 7feeea600640 1 -- 172.21.15.17:0/262586591 shutdown_connections 2024-03-12T17:19:33.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.228+0000 7feeea600640 1 -- 172.21.15.17:0/262586591 wait complete. 2024-03-12T17:19:33.243 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-12T17:18:39.552910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-12T17:18:43.794908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-12T17:18:44.867006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-12T17:19:33.244 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-12T17:19:33.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.483+0000 7fb589200640 1 Processor -- start 2024-03-12T17:19:33.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.483+0000 7fb589200640 1 -- start start 2024-03-12T17:19:33.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.484+0000 7fb589200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb58415ad80 0x7fb58415f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:33.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.484+0000 7fb589200640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb5840992c0 0x7fb5840cb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:33.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.484+0000 7fb589200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb58415f6e0 con 0x7fb5840ce540 2024-03-12T17:19:33.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.484+0000 7fb589200640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5840ceae0 con 0x7fb5840992c0 2024-03-12T17:19:33.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.484+0000 7fb589200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5840cedc0 con 0x7fb58415ad80 2024-03-12T17:19:33.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.484+0000 7fb581e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb58415ad80 0x7fb58415f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:33.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.484+0000 7fb582800640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb5840992c0 0x7fb5840cb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:33.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.484+0000 7fb581e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb58415ad80 0x7fb58415f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.17:41920/0 (socket says 172.21.15.17:41920) 2024-03-12T17:19:33.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.484+0000 7fb581e00640 1 -- 172.21.15.17:0/3630607871 learned_addr learned my addr 172.21.15.17:0/3630607871 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:33.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.486+0000 7fb581e00640 1 -- 172.21.15.17:0/3630607871 >> v2:172.21.15.94:3300/0 conn(0x7fb5840992c0 msgr2=0x7fb5840cb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:33.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.486+0000 7fb581e00640 1 --2- 172.21.15.17:0/3630607871 >> v2:172.21.15.94:3300/0 conn(0x7fb5840992c0 0x7fb5840cb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:33.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.486+0000 7fb581e00640 1 -- 172.21.15.17:0/3630607871 >> v1:172.21.15.94:6789/0 conn(0x7fb5840ce540 legacy=0x7fb584098bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:33.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.486+0000 7fb581e00640 1 -- 172.21.15.17:0/3630607871 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5840cf0a0 con 0x7fb58415ad80 2024-03-12T17:19:33.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.486+0000 7fb581e00640 1 --2- 172.21.15.17:0/3630607871 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb58415ad80 0x7fb58415f1a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb574009e50 tx=0x7fb57402bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12f084e80d897824 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:33.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.488+0000 7fb580a00640 1 -- 172.21.15.17:0/3630607871 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57402ca70 con 0x7fb58415ad80 2024-03-12T17:19:33.482 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.488+0000 7fb580a00640 1 -- 172.21.15.17:0/3630607871 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57402cbd0 con 0x7fb58415ad80 2024-03-12T17:19:33.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.488+0000 7fb580a00640 1 -- 172.21.15.17:0/3630607871 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5740343f0 con 0x7fb58415ad80 2024-03-12T17:19:33.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.489+0000 7fb589200640 1 -- 172.21.15.17:0/3630607871 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb58415ad80 msgr2=0x7fb58415f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:33.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.489+0000 7fb589200640 1 --2- 172.21.15.17:0/3630607871 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb58415ad80 0x7fb58415f1a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb574009e50 tx=0x7fb57402bed0 comp rx=0 tx=0).stop 2024-03-12T17:19:33.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.489+0000 7fb589200640 1 -- 172.21.15.17:0/3630607871 shutdown_connections 2024-03-12T17:19:33.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.489+0000 7fb589200640 1 --2- 172.21.15.17:0/3630607871 >> v2:172.21.15.94:3300/0 conn(0x7fb5840992c0 0x7fb5840cb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:33.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.489+0000 7fb589200640 1 --2- 172.21.15.17:0/3630607871 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb58415ad80 0x7fb58415f1a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:33.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.489+0000 7fb589200640 1 -- 172.21.15.17:0/3630607871 >> 172.21.15.17:0/3630607871 conn(0x7fb5840b2460 msgr2=0x7fb5840b2870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:33.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.490+0000 7fb589200640 1 -- 172.21.15.17:0/3630607871 shutdown_connections 2024-03-12T17:19:33.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.490+0000 7fb589200640 1 -- 172.21.15.17:0/3630607871 wait complete. 2024-03-12T17:19:33.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.491+0000 7fb589200640 1 Processor -- start 2024-03-12T17:19:33.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.491+0000 7fb589200640 1 -- start start 2024-03-12T17:19:33.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.493+0000 7fb589200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb5840992c0 0x7fb5840c3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:33.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.493+0000 7fb589200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5840ce540 0x7fb58414e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:33.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.493+0000 7fb589200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb58415ad80 0x7fb5840b0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:33.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.493+0000 7fb589200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5840c3ab0 con 0x7fb5840ce540 2024-03-12T17:19:33.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.493+0000 7fb589200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58414f2c0 con 0x7fb58415ad80 2024-03-12T17:19:33.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.493+0000 7fb589200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb58414e800 con 0x7fb5840992c0 2024-03-12T17:19:33.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.493+0000 7fb581400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5840ce540 0x7fb58414e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:33.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.493+0000 7fb581400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5840ce540 0x7fb58414e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55068/0 (socket says 172.21.15.17:55068) 2024-03-12T17:19:33.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.493+0000 7fb581400640 1 -- 172.21.15.17:0/3648805862 learned_addr learned my addr 172.21.15.17:0/3648805862 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:33.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.493+0000 7fb581e00640 1 --2- 172.21.15.17:0/3648805862 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb5840992c0 0x7fb5840c3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:33.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.493+0000 7fb582800640 1 --2- 172.21.15.17:0/3648805862 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb58415ad80 0x7fb5840b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:33.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.493+0000 7fb581400640 1 -- 172.21.15.17:0/3648805862 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb5840992c0 msgr2=0x7fb5840c3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:33.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.493+0000 7fb581400640 1 --2- 172.21.15.17:0/3648805862 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb5840992c0 0x7fb5840c3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:33.489 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.493+0000 7fb581400640 1 -- 172.21.15.17:0/3648805862 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb58415ad80 msgr2=0x7fb5840b0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:33.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.493+0000 7fb581400640 1 --2- 172.21.15.17:0/3648805862 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb58415ad80 0x7fb5840b0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:33.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.493+0000 7fb581400640 1 -- 172.21.15.17:0/3648805862 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb574009b30 con 0x7fb5840ce540 2024-03-12T17:19:33.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.493+0000 7fb582800640 1 --2- 172.21.15.17:0/3648805862 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb58415ad80 0x7fb5840b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:33.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.495+0000 7fb581400640 1 --2- 172.21.15.17:0/3648805862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5840ce540 0x7fb58414e2c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb57000c450 tx=0x7fb57000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:33.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.495+0000 7fb57a000640 1 -- 172.21.15.17:0/3648805862 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5700052d0 con 0x7fb5840ce540 2024-03-12T17:19:33.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.495+0000 7fb57a000640 1 -- 172.21.15.17:0/3648805862 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb570005430 con 0x7fb5840ce540 2024-03-12T17:19:33.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.495+0000 7fb57a000640 1 -- 172.21.15.17:0/3648805862 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb570012870 con 0x7fb5840ce540 2024-03-12T17:19:33.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.495+0000 7fb589200640 1 -- 172.21.15.17:0/3648805862 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb584153a00 con 0x7fb5840ce540 2024-03-12T17:19:33.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.495+0000 7fb589200640 1 -- 172.21.15.17:0/3648805862 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb584153fc0 con 0x7fb5840ce540 2024-03-12T17:19:33.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.497+0000 7fb589200640 1 -- 172.21.15.17:0/3648805862 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb58415ec90 con 0x7fb5840ce540 2024-03-12T17:19:33.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.497+0000 7fb57a000640 1 -- 172.21.15.17:0/3648805862 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fb5700129d0 con 0x7fb5840ce540 2024-03-12T17:19:33.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.498+0000 7fb57a000640 1 --2- 172.21.15.17:0/3648805862 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb56406ac00 0x7fb56406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:33.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.498+0000 7fb57a000640 1 -- 172.21.15.17:0/3648805862 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb570088f80 con 0x7fb5840ce540 2024-03-12T17:19:33.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.499+0000 7fb581e00640 1 --2- 172.21.15.17:0/3648805862 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb56406ac00 0x7fb56406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:33.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.499+0000 7fb581e00640 1 --2- 172.21.15.17:0/3648805862 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb56406ac00 0x7fb56406d0c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb574035000 tx=0x7fb574030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:33.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.503+0000 7fb57a000640 1 -- 172.21.15.17:0/3648805862 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fb5700bc4f0 con 0x7fb5840ce540 2024-03-12T17:19:33.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.703+0000 7fb589200640 1 -- 172.21.15.17:0/3648805862 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb5840736c0 con 0x7fb5840ce540 2024-03-12T17:19:33.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.704+0000 7fb57a000640 1 -- 172.21.15.17:0/3648805862 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb570054050 con 0x7fb5840ce540 2024-03-12T17:19:33.698 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-03-12T17:19:33.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.708+0000 7fb589200640 1 -- 172.21.15.17:0/3648805862 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb56406ac00 msgr2=0x7fb56406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:33.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.708+0000 7fb589200640 1 --2- 172.21.15.17:0/3648805862 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb56406ac00 0x7fb56406d0c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb574035000 tx=0x7fb574030000 comp rx=0 tx=0).stop 2024-03-12T17:19:33.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.708+0000 7fb589200640 1 -- 172.21.15.17:0/3648805862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5840ce540 msgr2=0x7fb58414e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:33.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.708+0000 7fb589200640 1 --2- 172.21.15.17:0/3648805862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5840ce540 0x7fb58414e2c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb57000c450 tx=0x7fb57000c910 comp rx=0 tx=0).stop 2024-03-12T17:19:33.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.708+0000 7fb589200640 1 -- 172.21.15.17:0/3648805862 shutdown_connections 2024-03-12T17:19:33.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.708+0000 7fb589200640 1 --2- 172.21.15.17:0/3648805862 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb56406ac00 0x7fb56406d0c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:33.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.708+0000 7fb589200640 1 --2- 172.21.15.17:0/3648805862 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb58415ad80 0x7fb5840b0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:33.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.708+0000 7fb589200640 1 --2- 172.21.15.17:0/3648805862 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb5840ce540 0x7fb58414e2c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:33.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.708+0000 7fb589200640 1 --2- 172.21.15.17:0/3648805862 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb5840992c0 0x7fb5840c3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:33.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.708+0000 7fb589200640 1 -- 172.21.15.17:0/3648805862 >> 172.21.15.17:0/3648805862 conn(0x7fb5840b2460 msgr2=0x7fb584099c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:33.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.708+0000 7fb589200640 1 -- 172.21.15.17:0/3648805862 shutdown_connections 2024-03-12T17:19:33.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.708+0000 7fb589200640 1 -- 172.21.15.17:0/3648805862 wait complete. 2024-03-12T17:19:33.721 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-12T17:19:33.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.953+0000 7f0ba0c00640 1 Processor -- start 2024-03-12T17:19:33.948 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.954+0000 7f0ba0c00640 1 -- start start 2024-03-12T17:19:33.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.955+0000 7f0ba0c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0b9c15ca10 0x7f0b9c0abd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:33.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.955+0000 7f0ba0c00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0b9c15cdf0 0x7f0b9c0cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:33.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.955+0000 7f0ba0c00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b9c15dee0 con 0x7f0b9c0add50 2024-03-12T17:19:33.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.955+0000 7f0ba0c00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b9c15d2d0 con 0x7f0b9c15cdf0 2024-03-12T17:19:33.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.955+0000 7f0ba0c00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9c15d5b0 con 0x7f0b9c15ca10 2024-03-12T17:19:33.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.956+0000 7f0b9a800640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f0b9c0add50 0x7f0b9c0b2120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:38496/0 (socket says 172.21.15.17:38496) 2024-03-12T17:19:33.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.956+0000 7f0b9a800640 1 -- 172.21.15.17:0/3664115939 learned_addr learned my addr 172.21.15.17:0/3664115939 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:33.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.956+0000 7f0b99400640 1 --2- 172.21.15.17:0/3664115939 >> v2:172.21.15.94:3300/0 conn(0x7f0b9c15cdf0 0x7f0b9c0cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:33.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.956+0000 7f0b99e00640 1 --2- 172.21.15.17:0/3664115939 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0b9c15ca10 0x7f0b9c0abd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:33.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.956+0000 7f0b98a00640 1 -- 172.21.15.17:0/3664115939 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3667805850 0 0) 0x7f0b9c15dee0 con 0x7f0b9c0add50 2024-03-12T17:19:33.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.956+0000 7f0b98a00640 1 -- 172.21.15.17:0/3664115939 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b80003520 con 0x7f0b9c0add50 2024-03-12T17:19:33.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.957+0000 7f0b98a00640 1 -- 172.21.15.17:0/3664115939 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3830371812 0 0) 0x7f0b80003520 con 0x7f0b9c0add50 2024-03-12T17:19:33.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.957+0000 7f0b98a00640 1 -- 172.21.15.17:0/3664115939 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0b9c15ca10 msgr2=0x7f0b9c0abd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:33.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.957+0000 7f0b98a00640 1 --2- 172.21.15.17:0/3664115939 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0b9c15ca10 0x7f0b9c0abd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:33.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.957+0000 7f0b98a00640 1 -- 172.21.15.17:0/3664115939 >> v2:172.21.15.94:3300/0 conn(0x7f0b9c15cdf0 msgr2=0x7f0b9c0cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:33.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.957+0000 7f0b98a00640 1 --2- 172.21.15.17:0/3664115939 >> v2:172.21.15.94:3300/0 conn(0x7f0b9c15cdf0 0x7f0b9c0cee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:33.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.957+0000 7f0b98a00640 1 -- 172.21.15.17:0/3664115939 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b9c15d890 con 0x7f0b9c0add50 2024-03-12T17:19:33.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.957+0000 7f0b98a00640 1 -- 172.21.15.17:0/3664115939 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7f0b94001670 con 0x7f0b9c0add50 2024-03-12T17:19:33.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.957+0000 7f0b99400640 1 --2- 172.21.15.17:0/3664115939 >> v2:172.21.15.94:3300/0 conn(0x7f0b9c15cdf0 0x7f0b9c0cee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:19:33.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.957+0000 7f0b98a00640 1 -- 172.21.15.17:0/3664115939 >> v1:172.21.15.17:6789/0 conn(0x7f0b9c0add50 legacy=0x7f0b9c0b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:33.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.957+0000 7f0b98a00640 1 --2- 172.21.15.17:0/3664115939 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0b9c15ca10 0x7f0b80003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:33.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.957+0000 7f0b98a00640 1 --2- 172.21.15.17:0/3664115939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b80003f40 0x7f0b800047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:33.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.957+0000 7f0b98a00640 1 --2- 172.21.15.17:0/3664115939 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b80004d00 0x7f0b80005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:33.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.957+0000 7f0b98a00640 1 -- 172.21.15.17:0/3664115939 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9c15d2d0 con 0x7f0b80003f40 2024-03-12T17:19:33.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.957+0000 7f0b98a00640 1 -- 172.21.15.17:0/3664115939 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9c15d5b0 con 0x7f0b80004d00 2024-03-12T17:19:33.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.957+0000 7f0b98a00640 1 -- 172.21.15.17:0/3664115939 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8000bae0 con 0x7f0b9c15ca10 2024-03-12T17:19:33.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.957+0000 7f0b99400640 1 --2- 172.21.15.17:0/3664115939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b80003f40 0x7f0b800047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:33.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.958+0000 7f0b99e00640 1 --2- 172.21.15.17:0/3664115939 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0b9c15ca10 0x7f0b80003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:33.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.958+0000 7f0b99400640 1 -- 172.21.15.17:0/3664115939 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0b9c15ca10 msgr2=0x7f0b80003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:33.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.958+0000 7f0b99400640 1 --2- 172.21.15.17:0/3664115939 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0b9c15ca10 0x7f0b80003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:33.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.958+0000 7f0b99400640 1 -- 172.21.15.17:0/3664115939 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b80004d00 msgr2=0x7f0b80005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:33.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.958+0000 7f0b99400640 1 --2- 172.21.15.17:0/3664115939 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b80004d00 0x7f0b80005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:33.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.958+0000 7f0b99400640 1 -- 172.21.15.17:0/3664115939 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b80003520 con 0x7f0b80003f40 2024-03-12T17:19:33.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.959+0000 7f0b99400640 1 --2- 172.21.15.17:0/3664115939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b80003f40 0x7f0b800047c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0b880098a0 tx=0x7f0b800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5eeb6b2be81308d server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:33.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.960+0000 7f0b98a00640 1 -- 172.21.15.17:0/3664115939 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b88004230 con 0x7f0b80003f40 2024-03-12T17:19:33.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.961+0000 7f0b98a00640 1 -- 172.21.15.17:0/3664115939 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b88004390 con 0x7f0b80003f40 2024-03-12T17:19:33.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.961+0000 7f0b98a00640 1 -- 172.21.15.17:0/3664115939 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b88003830 con 0x7f0b80003f40 2024-03-12T17:19:33.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.961+0000 7f0ba0c00640 1 -- 172.21.15.17:0/3664115939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b80003f40 msgr2=0x7f0b800047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:33.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.961+0000 7f0ba0c00640 1 --2- 172.21.15.17:0/3664115939 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b80003f40 0x7f0b800047c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0b880098a0 tx=0x7f0b800057f0 comp rx=0 tx=0).stop 2024-03-12T17:19:33.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.962+0000 7f0b9a800640 1 -- 172.21.15.17:0/3664115939 reap_dead start 2024-03-12T17:19:33.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.962+0000 7f0ba0c00640 1 -- 172.21.15.17:0/3664115939 shutdown_connections 2024-03-12T17:19:33.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.962+0000 7f0ba0c00640 1 -- 172.21.15.17:0/3664115939 >> 172.21.15.17:0/3664115939 conn(0x7f0b9c069ce0 msgr2=0x7f0b9c06a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:33.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.962+0000 7f0ba0c00640 1 -- 172.21.15.17:0/3664115939 shutdown_connections 2024-03-12T17:19:33.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.962+0000 7f0ba0c00640 1 -- 172.21.15.17:0/3664115939 wait complete. 2024-03-12T17:19:33.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.964+0000 7f0ba0c00640 1 Processor -- start 2024-03-12T17:19:33.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.964+0000 7f0ba0c00640 1 -- start start 2024-03-12T17:19:33.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.965+0000 7f0ba0c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0b9c148380 0x7f0b9c0c3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:33.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.965+0000 7f0ba0c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b9c154d20 0x7f0b9c15b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:33.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.965+0000 7f0ba0c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b9c15baf0 0x7f0b9c148a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:33.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.965+0000 7f0ba0c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9c15b190 con 0x7f0b9c154d20 2024-03-12T17:19:33.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.965+0000 7f0ba0c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9c0c43d0 con 0x7f0b9c15baf0 2024-03-12T17:19:33.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.965+0000 7f0ba0c00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b9c15aad0 con 0x7f0b9c148380 2024-03-12T17:19:33.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.965+0000 7f0b99400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b9c154d20 0x7f0b9c15b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:33.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.965+0000 7f0b99400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b9c154d20 0x7f0b9c15b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55088/0 (socket says 172.21.15.17:55088) 2024-03-12T17:19:33.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.965+0000 7f0b99400640 1 -- 172.21.15.17:0/2441347621 learned_addr learned my addr 172.21.15.17:0/2441347621 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:33.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.966+0000 7f0b9a800640 1 --2- 172.21.15.17:0/2441347621 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b9c15baf0 0x7f0b9c148a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:33.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.966+0000 7f0b99e00640 1 --2- 172.21.15.17:0/2441347621 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0b9c148380 0x7f0b9c0c3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:33.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.966+0000 7f0b99400640 1 -- 172.21.15.17:0/2441347621 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0b9c148380 msgr2=0x7f0b9c0c3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:33.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.966+0000 7f0b99400640 1 --2- 172.21.15.17:0/2441347621 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0b9c148380 0x7f0b9c0c3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:33.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.966+0000 7f0b99400640 1 -- 172.21.15.17:0/2441347621 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b9c15baf0 msgr2=0x7f0b9c148a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:33.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.966+0000 7f0b99400640 1 --2- 172.21.15.17:0/2441347621 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b9c15baf0 0x7f0b9c148a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:33.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.966+0000 7f0b99400640 1 -- 172.21.15.17:0/2441347621 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b9c15adb0 con 0x7f0b9c154d20 2024-03-12T17:19:33.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.966+0000 7f0b99400640 1 --2- 172.21.15.17:0/2441347621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b9c154d20 0x7f0b9c15b5b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0b8802bff0 tx=0x7f0b88004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:33.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.967+0000 7f0b92000640 1 -- 172.21.15.17:0/2441347621 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b88042600 con 0x7f0b9c154d20 2024-03-12T17:19:33.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.967+0000 7f0b92000640 1 -- 172.21.15.17:0/2441347621 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b88042760 con 0x7f0b9c154d20 2024-03-12T17:19:33.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.967+0000 7f0ba0c00640 1 -- 172.21.15.17:0/2441347621 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b9c0c3ff0 con 0x7f0b9c154d20 2024-03-12T17:19:33.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.967+0000 7f0b92000640 1 -- 172.21.15.17:0/2441347621 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b88042b10 con 0x7f0b9c154d20 2024-03-12T17:19:33.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.967+0000 7f0ba0c00640 1 -- 172.21.15.17:0/2441347621 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b9c148fd0 con 0x7f0b9c154d20 2024-03-12T17:19:33.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.968+0000 7f0ba0c00640 1 -- 172.21.15.17:0/2441347621 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b9c15af40 con 0x7f0b9c154d20 2024-03-12T17:19:33.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.969+0000 7f0b92000640 1 -- 172.21.15.17:0/2441347621 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f0b880373f0 con 0x7f0b9c154d20 2024-03-12T17:19:33.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.970+0000 7f0b92000640 1 --2- 172.21.15.17:0/2441347621 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f0b7c06ac30 0x7f0b7c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:33.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.970+0000 7f0b92000640 1 -- 172.21.15.17:0/2441347621 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f0b880ab440 con 0x7f0b9c154d20 2024-03-12T17:19:33.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.970+0000 7f0b99e00640 1 --2- 172.21.15.17:0/2441347621 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f0b7c06ac30 0x7f0b7c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:33.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.971+0000 7f0b99e00640 1 --2- 172.21.15.17:0/2441347621 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f0b7c06ac30 0x7f0b7c06d0f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c003b80 tx=0x7f0b8c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:33.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:33.974+0000 7f0b92000640 1 -- 172.21.15.17:0/2441347621 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f0b880765b0 con 0x7f0b9c154d20 2024-03-12T17:19:34.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.170+0000 7f0ba0c00640 1 -- 172.21.15.17:0/2441347621 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0b9c0736c0 con 0x7f0b9c154d20 2024-03-12T17:19:34.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.170+0000 7f0b92000640 1 -- 172.21.15.17:0/2441347621 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0b8800f040 con 0x7f0b9c154d20 2024-03-12T17:19:34.165 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-03-12T17:19:34.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.173+0000 7f0ba0c00640 1 -- 172.21.15.17:0/2441347621 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f0b7c06ac30 msgr2=0x7f0b7c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:34.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.173+0000 7f0ba0c00640 1 --2- 172.21.15.17:0/2441347621 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f0b7c06ac30 0x7f0b7c06d0f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0b8c003b80 tx=0x7f0b8c00b040 comp rx=0 tx=0).stop 2024-03-12T17:19:34.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.173+0000 7f0ba0c00640 1 -- 172.21.15.17:0/2441347621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b9c154d20 msgr2=0x7f0b9c15b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:34.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.173+0000 7f0ba0c00640 1 --2- 172.21.15.17:0/2441347621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b9c154d20 0x7f0b9c15b5b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0b8802bff0 tx=0x7f0b88004730 comp rx=0 tx=0).stop 2024-03-12T17:19:34.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.173+0000 7f0ba0c00640 1 -- 172.21.15.17:0/2441347621 shutdown_connections 2024-03-12T17:19:34.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.173+0000 7f0ba0c00640 1 --2- 172.21.15.17:0/2441347621 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f0b7c06ac30 0x7f0b7c06d0f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:34.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.173+0000 7f0ba0c00640 1 --2- 172.21.15.17:0/2441347621 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0b9c15baf0 0x7f0b9c148a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:34.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.173+0000 7f0ba0c00640 1 --2- 172.21.15.17:0/2441347621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0b9c154d20 0x7f0b9c15b5b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:34.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.173+0000 7f0ba0c00640 1 --2- 172.21.15.17:0/2441347621 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0b9c148380 0x7f0b9c0c3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:34.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.173+0000 7f0ba0c00640 1 -- 172.21.15.17:0/2441347621 >> 172.21.15.17:0/2441347621 conn(0x7f0b9c069ce0 msgr2=0x7f0b9c06c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:34.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.174+0000 7f0ba0c00640 1 -- 172.21.15.17:0/2441347621 shutdown_connections 2024-03-12T17:19:34.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.174+0000 7f0ba0c00640 1 -- 172.21.15.17:0/2441347621 wait complete. 2024-03-12T17:19:34.186 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-12T17:19:34.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.414+0000 7f3772400640 1 Processor -- start 2024-03-12T17:19:34.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.414+0000 7f3772400640 1 -- start start 2024-03-12T17:19:34.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.415+0000 7f3772400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f376c15e050 0x7f376c099af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:34.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.415+0000 7f3772400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f376c0cbef0 0x7f376c0cc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:34.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.415+0000 7f3772400640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f376c098d30 con 0x7f376c15e830 2024-03-12T17:19:34.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.415+0000 7f3772400640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f376c0996d0 con 0x7f376c15e050 2024-03-12T17:19:34.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.415+0000 7f3772400640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f376c0cc9f0 con 0x7f376c0cbef0 2024-03-12T17:19:34.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.416+0000 7f376b400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f376c15e050 0x7f376c099af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:34.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.416+0000 7f376b400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f376c15e050 0x7f376c099af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55096/0 (socket says 172.21.15.17:55096) 2024-03-12T17:19:34.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.416+0000 7f376b400640 1 -- 172.21.15.17:0/1018237643 learned_addr learned my addr 172.21.15.17:0/1018237643 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:34.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.416+0000 7f376aa00640 1 --2- 172.21.15.17:0/1018237643 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f376c0cbef0 0x7f376c0cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:34.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.416+0000 7f376b400640 1 -- 172.21.15.17:0/1018237643 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f376c0cbef0 msgr2=0x7f376c0cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:34.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.416+0000 7f376b400640 1 --2- 172.21.15.17:0/1018237643 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f376c0cbef0 0x7f376c0cc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:34.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.416+0000 7f376b400640 1 -- 172.21.15.17:0/1018237643 >> v1:172.21.15.94:6789/0 conn(0x7f376c15e830 legacy=0x7f376c0c44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:34.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.416+0000 7f376b400640 1 -- 172.21.15.17:0/1018237643 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376c099010 con 0x7f376c15e050 2024-03-12T17:19:34.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.416+0000 7f376aa00640 1 --2- 172.21.15.17:0/1018237643 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f376c0cbef0 0x7f376c0cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:34.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.418+0000 7f376b400640 1 --2- 172.21.15.17:0/1018237643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f376c15e050 0x7f376c099af0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f375c009870 tx=0x7f375c02b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b6fd0948610a2ff server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:34.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.418+0000 7f376a000640 1 -- 172.21.15.17:0/1018237643 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c031740 con 0x7f376c15e050 2024-03-12T17:19:34.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.418+0000 7f376a000640 1 -- 172.21.15.17:0/1018237643 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375c0318a0 con 0x7f376c15e050 2024-03-12T17:19:34.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.418+0000 7f376a000640 1 -- 172.21.15.17:0/1018237643 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c031c30 con 0x7f376c15e050 2024-03-12T17:19:34.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.419+0000 7f3772400640 1 -- 172.21.15.17:0/1018237643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f376c15e050 msgr2=0x7f376c099af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:34.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.419+0000 7f3772400640 1 --2- 172.21.15.17:0/1018237643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f376c15e050 0x7f376c099af0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f375c009870 tx=0x7f375c02b7e0 comp rx=0 tx=0).stop 2024-03-12T17:19:34.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.419+0000 7f3772400640 1 -- 172.21.15.17:0/1018237643 shutdown_connections 2024-03-12T17:19:34.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.419+0000 7f3772400640 1 --2- 172.21.15.17:0/1018237643 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f376c0cbef0 0x7f376c0cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:34.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.419+0000 7f3772400640 1 --2- 172.21.15.17:0/1018237643 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f376c15e050 0x7f376c099af0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:34.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.419+0000 7f3772400640 1 -- 172.21.15.17:0/1018237643 >> 172.21.15.17:0/1018237643 conn(0x7f376c0b2440 msgr2=0x7f376c0b2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:34.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.419+0000 7f3772400640 1 -- 172.21.15.17:0/1018237643 shutdown_connections 2024-03-12T17:19:34.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.419+0000 7f3772400640 1 -- 172.21.15.17:0/1018237643 wait complete. 2024-03-12T17:19:34.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.421+0000 7f3772400640 1 Processor -- start 2024-03-12T17:19:34.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.421+0000 7f3772400640 1 -- start start 2024-03-12T17:19:34.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.422+0000 7f3772400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f376c0cbef0 0x7f376c0c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:34.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.422+0000 7f3772400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f376c15e050 0x7f376c14dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:34.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.422+0000 7f3772400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f376c15e830 0x7f376c06f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:34.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.422+0000 7f3772400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376c0ca9c0 con 0x7f376c15e050 2024-03-12T17:19:34.418 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.422+0000 7f3772400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376c0ca120 con 0x7f376c15e830 2024-03-12T17:19:34.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.422+0000 7f3772400640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f376c0ca400 con 0x7f376c0cbef0 2024-03-12T17:19:34.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.422+0000 7f376aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f376c15e050 0x7f376c14dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:34.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.422+0000 7f376aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f376c15e050 0x7f376c14dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55112/0 (socket says 172.21.15.17:55112) 2024-03-12T17:19:34.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.422+0000 7f376aa00640 1 -- 172.21.15.17:0/3290158869 learned_addr learned my addr 172.21.15.17:0/3290158869 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:34.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.422+0000 7f376be00640 1 --2- 172.21.15.17:0/3290158869 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f376c15e830 0x7f376c06f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:34.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.422+0000 7f376b400640 1 --2- 172.21.15.17:0/3290158869 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f376c0cbef0 0x7f376c0c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:34.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.423+0000 7f376aa00640 1 -- 172.21.15.17:0/3290158869 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f376c0cbef0 msgr2=0x7f376c0c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:34.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.423+0000 7f376aa00640 1 --2- 172.21.15.17:0/3290158869 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f376c0cbef0 0x7f376c0c9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:34.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.423+0000 7f376aa00640 1 -- 172.21.15.17:0/3290158869 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f376c15e830 msgr2=0x7f376c06f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:34.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.423+0000 7f376aa00640 1 --2- 172.21.15.17:0/3290158869 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f376c15e830 0x7f376c06f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:34.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.423+0000 7f376aa00640 1 -- 172.21.15.17:0/3290158869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f375c0094d0 con 0x7f376c15e050 2024-03-12T17:19:34.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.423+0000 7f376aa00640 1 --2- 172.21.15.17:0/3290158869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f376c15e050 0x7f376c14dd50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f375400ce00 tx=0x7f375400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:34.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.423+0000 7f3763400640 1 -- 172.21.15.17:0/3290158869 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375400f890 con 0x7f376c15e050 2024-03-12T17:19:34.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.423+0000 7f3763400640 1 -- 172.21.15.17:0/3290158869 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375400f9f0 con 0x7f376c15e050 2024-03-12T17:19:34.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.423+0000 7f3763400640 1 -- 172.21.15.17:0/3290158869 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375400fd80 con 0x7f376c15e050 2024-03-12T17:19:34.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.423+0000 7f3772400640 1 -- 172.21.15.17:0/3290158869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f376c0ca6e0 con 0x7f376c15e050 2024-03-12T17:19:34.420 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.423+0000 7f3772400640 1 -- 172.21.15.17:0/3290158869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f376c159360 con 0x7f376c15e050 2024-03-12T17:19:34.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.425+0000 7f3772400640 1 -- 172.21.15.17:0/3290158869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f376c1e4610 con 0x7f376c15e050 2024-03-12T17:19:34.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.425+0000 7f3763400640 1 -- 172.21.15.17:0/3290158869 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f375400b040 con 0x7f376c15e050 2024-03-12T17:19:34.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.426+0000 7f3763400640 1 --2- 172.21.15.17:0/3290158869 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f374806ac00 0x7f374806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:34.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.426+0000 7f3763400640 1 -- 172.21.15.17:0/3290158869 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3754089f40 con 0x7f376c15e050 2024-03-12T17:19:34.421 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.427+0000 7f376b400640 1 --2- 172.21.15.17:0/3290158869 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f374806ac00 0x7f374806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:34.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.428+0000 7f376b400640 1 --2- 172.21.15.17:0/3290158869 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f374806ac00 0x7f374806d0c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f375c035000 tx=0x7f375c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:34.425 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.431+0000 7f3763400640 1 -- 172.21.15.17:0/3290158869 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f376c1e4610 con 0x7f376c15e050 2024-03-12T17:19:34.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.629+0000 7f3772400640 1 -- 172.21.15.17:0/3290158869 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f376c1e4610 con 0x7f376c15e050 2024-03-12T17:19:34.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.630+0000 7f3763400640 1 -- 172.21.15.17:0/3290158869 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f376c1e4610 con 0x7f376c15e050 2024-03-12T17:19:34.625 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-03-12T17:19:34.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.633+0000 7f3772400640 1 -- 172.21.15.17:0/3290158869 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f374806ac00 msgr2=0x7f374806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:34.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.633+0000 7f3772400640 1 --2- 172.21.15.17:0/3290158869 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f374806ac00 0x7f374806d0c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f375c035000 tx=0x7f375c008030 comp rx=0 tx=0).stop 2024-03-12T17:19:34.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.633+0000 7f3772400640 1 -- 172.21.15.17:0/3290158869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f376c15e050 msgr2=0x7f376c14dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:34.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.633+0000 7f3772400640 1 --2- 172.21.15.17:0/3290158869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f376c15e050 0x7f376c14dd50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f375400ce00 tx=0x7f375400a650 comp rx=0 tx=0).stop 2024-03-12T17:19:34.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.633+0000 7f3772400640 1 -- 172.21.15.17:0/3290158869 shutdown_connections 2024-03-12T17:19:34.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.633+0000 7f3772400640 1 --2- 172.21.15.17:0/3290158869 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f374806ac00 0x7f374806d0c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:34.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.633+0000 7f3772400640 1 --2- 172.21.15.17:0/3290158869 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f376c15e830 0x7f376c06f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:34.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.633+0000 7f3772400640 1 --2- 172.21.15.17:0/3290158869 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f376c15e050 0x7f376c14dd50 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:34.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.633+0000 7f3772400640 1 --2- 172.21.15.17:0/3290158869 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f376c0cbef0 0x7f376c0c9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:34.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.633+0000 7f3772400640 1 -- 172.21.15.17:0/3290158869 >> 172.21.15.17:0/3290158869 conn(0x7f376c0b2440 msgr2=0x7f376c0c4710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:34.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.634+0000 7f3772400640 1 -- 172.21.15.17:0/3290158869 shutdown_connections 2024-03-12T17:19:34.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.634+0000 7f3772400640 1 -- 172.21.15.17:0/3290158869 wait complete. 2024-03-12T17:19:34.646 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-12T17:19:34.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.869+0000 7f90a7200640 1 Processor -- start 2024-03-12T17:19:34.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.869+0000 7f90a7200640 1 -- start start 2024-03-12T17:19:34.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.870+0000 7f90a7200640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f90a00b2ca0 0x7f90a006d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:34.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.871+0000 7f90a7200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f90a006d9b0 0x7f90a00cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:34.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.871+0000 7f90a7200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90a006de10 con 0x7f90a00cbd10 2024-03-12T17:19:34.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.871+0000 7f90a7200640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90a015dee0 con 0x7f90a00b2ca0 2024-03-12T17:19:34.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.871+0000 7f90a7200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a015ab90 con 0x7f90a006d9b0 2024-03-12T17:19:34.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.871+0000 7f90a5400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f90a006d9b0 0x7f90a00cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:34.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.871+0000 7f90a5e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f90a00b2ca0 0x7f90a006d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:34.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.871+0000 7f90a5e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f90a00b2ca0 0x7f90a006d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.17:57520/0 (socket says 172.21.15.17:57520) 2024-03-12T17:19:34.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.871+0000 7f90a5e00640 1 -- 172.21.15.17:0/4088910693 learned_addr learned my addr 172.21.15.17:0/4088910693 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:34.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.872+0000 7f90a5e00640 1 -- 172.21.15.17:0/4088910693 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f90a006d9b0 msgr2=0x7f90a00cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:34.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.872+0000 7f90a5e00640 1 --2- 172.21.15.17:0/4088910693 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f90a006d9b0 0x7f90a00cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:34.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.872+0000 7f90a5e00640 1 -- 172.21.15.17:0/4088910693 >> v1:172.21.15.94:6789/0 conn(0x7f90a00cbd10 legacy=0x7f90a0070260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:34.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.872+0000 7f90a5e00640 1 -- 172.21.15.17:0/4088910693 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a015d260 con 0x7f90a00b2ca0 2024-03-12T17:19:34.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.873+0000 7f90a5e00640 1 --2- 172.21.15.17:0/4088910693 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f90a00b2ca0 0x7f90a006d470 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f909000bb10 tx=0x7f909002e150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59cafc1d53b15bbb server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:34.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.874+0000 7f90a4a00640 1 -- 172.21.15.17:0/4088910693 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9090036440 con 0x7f90a00b2ca0 2024-03-12T17:19:34.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.874+0000 7f90a4a00640 1 -- 172.21.15.17:0/4088910693 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90900365a0 con 0x7f90a00b2ca0 2024-03-12T17:19:34.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.874+0000 7f90a4a00640 1 -- 172.21.15.17:0/4088910693 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9090036930 con 0x7f90a00b2ca0 2024-03-12T17:19:34.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.875+0000 7f90a7200640 1 -- 172.21.15.17:0/4088910693 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f90a00b2ca0 msgr2=0x7f90a006d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:34.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.875+0000 7f90a7200640 1 --2- 172.21.15.17:0/4088910693 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f90a00b2ca0 0x7f90a006d470 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f909000bb10 tx=0x7f909002e150 comp rx=0 tx=0).stop 2024-03-12T17:19:34.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.875+0000 7f90a7200640 1 -- 172.21.15.17:0/4088910693 shutdown_connections 2024-03-12T17:19:34.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.875+0000 7f90a7200640 1 --2- 172.21.15.17:0/4088910693 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f90a006d9b0 0x7f90a00cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:34.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.875+0000 7f90a7200640 1 --2- 172.21.15.17:0/4088910693 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f90a00b2ca0 0x7f90a006d470 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:34.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.875+0000 7f90a7200640 1 -- 172.21.15.17:0/4088910693 >> 172.21.15.17:0/4088910693 conn(0x7f90a0066000 msgr2=0x7f90a0069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:34.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.875+0000 7f90a7200640 1 -- 172.21.15.17:0/4088910693 shutdown_connections 2024-03-12T17:19:34.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.875+0000 7f90a7200640 1 -- 172.21.15.17:0/4088910693 wait complete. 2024-03-12T17:19:34.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.877+0000 7f90a7200640 1 Processor -- start 2024-03-12T17:19:34.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.877+0000 7f90a7200640 1 -- start start 2024-03-12T17:19:34.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.878+0000 7f90a7200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90a006d9b0 0x7f90a015c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:34.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.878+0000 7f90a7200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f90a00b2ca0 0x7f90a0147ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:34.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.878+0000 7f90a7200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f90a00cbd10 0x7f90a0148430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:34.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.878+0000 7f90a7200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a014d9f0 con 0x7f90a006d9b0 2024-03-12T17:19:34.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.878+0000 7f90a7200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a014d710 con 0x7f90a00cbd10 2024-03-12T17:19:34.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.878+0000 7f90a7200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a014ab20 con 0x7f90a00b2ca0 2024-03-12T17:19:34.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.878+0000 7f90a5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90a006d9b0 0x7f90a015c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:34.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.878+0000 7f90a5e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90a006d9b0 0x7f90a015c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55126/0 (socket says 172.21.15.17:55126) 2024-03-12T17:19:34.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.878+0000 7f90a5e00640 1 -- 172.21.15.17:0/2869868506 learned_addr learned my addr 172.21.15.17:0/2869868506 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:34.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.879+0000 7f90a5400640 1 --2- 172.21.15.17:0/2869868506 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f90a00b2ca0 0x7f90a0147ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:34.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.879+0000 7f90a5e00640 1 -- 172.21.15.17:0/2869868506 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f90a00b2ca0 msgr2=0x7f90a0147ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:34.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.879+0000 7f90a5e00640 1 --2- 172.21.15.17:0/2869868506 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f90a00b2ca0 0x7f90a0147ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:34.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.879+0000 7f90a5e00640 1 -- 172.21.15.17:0/2869868506 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f90a00cbd10 msgr2=0x7f90a0148430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:34.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.879+0000 7f90a5e00640 1 --2- 172.21.15.17:0/2869868506 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f90a00cbd10 0x7f90a0148430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:34.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.879+0000 7f90a5e00640 1 -- 172.21.15.17:0/2869868506 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f909000b770 con 0x7f90a006d9b0 2024-03-12T17:19:34.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.879+0000 7f90a5e00640 1 --2- 172.21.15.17:0/2869868506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90a006d9b0 0x7f90a015c0c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f909002e190 tx=0x7f90900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:34.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.879+0000 7f909a000640 1 -- 172.21.15.17:0/2869868506 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9090036440 con 0x7f90a006d9b0 2024-03-12T17:19:34.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.879+0000 7f909a000640 1 -- 172.21.15.17:0/2869868506 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9090034ba0 con 0x7f90a006d9b0 2024-03-12T17:19:34.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.879+0000 7f90a7200640 1 -- 172.21.15.17:0/2869868506 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a014ae00 con 0x7f90a006d9b0 2024-03-12T17:19:34.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.879+0000 7f909a000640 1 -- 172.21.15.17:0/2869868506 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9090041460 con 0x7f90a006d9b0 2024-03-12T17:19:34.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.880+0000 7f90a7200640 1 -- 172.21.15.17:0/2869868506 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a01e3000 con 0x7f90a006d9b0 2024-03-12T17:19:34.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.881+0000 7f90a7200640 1 -- 172.21.15.17:0/2869868506 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a004e030 con 0x7f90a006d9b0 2024-03-12T17:19:34.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.882+0000 7f909a000640 1 -- 172.21.15.17:0/2869868506 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f909004a3b0 con 0x7f90a006d9b0 2024-03-12T17:19:34.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.883+0000 7f909a000640 1 --2- 172.21.15.17:0/2869868506 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f908406ac30 0x7f908406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:34.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.883+0000 7f909a000640 1 -- 172.21.15.17:0/2869868506 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f90900aba60 con 0x7f90a006d9b0 2024-03-12T17:19:34.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.883+0000 7f90a5400640 1 --2- 172.21.15.17:0/2869868506 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f908406ac30 0x7f908406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:34.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.884+0000 7f90a5400640 1 --2- 172.21.15.17:0/2869868506 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f908406ac30 0x7f908406d0f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f90a0150120 tx=0x7f9094008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:34.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:34.888+0000 7f909a000640 1 -- 172.21.15.17:0/2869868506 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f9090076b20 con 0x7f90a006d9b0 2024-03-12T17:19:35.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.098+0000 7f90a7200640 1 -- 172.21.15.17:0/2869868506 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f90a00b1bf0 con 0x7f90a006d9b0 2024-03-12T17:19:35.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.098+0000 7f909a000640 1 -- 172.21.15.17:0/2869868506 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f909003b080 con 0x7f90a006d9b0 2024-03-12T17:19:35.093 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2024-03-12T17:19:35.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.101+0000 7f90a7200640 1 -- 172.21.15.17:0/2869868506 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f908406ac30 msgr2=0x7f908406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:35.095 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.101+0000 7f90a7200640 1 --2- 172.21.15.17:0/2869868506 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f908406ac30 0x7f908406d0f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f90a0150120 tx=0x7f9094008040 comp rx=0 tx=0).stop 2024-03-12T17:19:35.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.101+0000 7f90a7200640 1 -- 172.21.15.17:0/2869868506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90a006d9b0 msgr2=0x7f90a015c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:35.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.101+0000 7f90a7200640 1 --2- 172.21.15.17:0/2869868506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90a006d9b0 0x7f90a015c0c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f909002e190 tx=0x7f90900046c0 comp rx=0 tx=0).stop 2024-03-12T17:19:35.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.101+0000 7f90a7200640 1 -- 172.21.15.17:0/2869868506 shutdown_connections 2024-03-12T17:19:35.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.101+0000 7f90a7200640 1 --2- 172.21.15.17:0/2869868506 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f908406ac30 0x7f908406d0f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:35.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.101+0000 7f90a7200640 1 --2- 172.21.15.17:0/2869868506 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f90a00cbd10 0x7f90a0148430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:35.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.101+0000 7f90a7200640 1 --2- 172.21.15.17:0/2869868506 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f90a00b2ca0 0x7f90a0147ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:35.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.101+0000 7f90a7200640 1 --2- 172.21.15.17:0/2869868506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f90a006d9b0 0x7f90a015c0c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:35.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.101+0000 7f90a7200640 1 -- 172.21.15.17:0/2869868506 >> 172.21.15.17:0/2869868506 conn(0x7f90a0066000 msgr2=0x7f90a006d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:35.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.101+0000 7f90a7200640 1 -- 172.21.15.17:0/2869868506 shutdown_connections 2024-03-12T17:19:35.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.101+0000 7f90a7200640 1 -- 172.21.15.17:0/2869868506 wait complete. 2024-03-12T17:19:35.113 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-03-12T17:19:35.113 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:35.114 DEBUG:teuthology.orchestra.run.smithi017:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-03-12T17:19:35.210 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2024-03-12T17:19:35.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:35.210 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-03-12T17:19:35.264 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-12T17:19:35.264 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-12T17:19:35.321 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-12T17:19:35.321 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-12T17:19:35.369 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-12T17:19:35.369 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-12T17:19:35.464 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T17:19:35.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.700+0000 7f23af200640 1 Processor -- start 2024-03-12T17:19:35.695 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.700+0000 7f23af200640 1 -- start start 2024-03-12T17:19:35.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.702+0000 7f23af200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23b00cb930 0x7f23b00b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:35.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.702+0000 7f23af200640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f23b00b23e0 0x7f23b00cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:35.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.702+0000 7f23af200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f23b00cd850 0x7f23b00b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:35.696 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.702+0000 7f23af200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23b00cc250 con 0x7f23b00cd850 2024-03-12T17:19:35.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.702+0000 7f23af200640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23b00ce1a0 con 0x7f23b00b23e0 2024-03-12T17:19:35.697 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.702+0000 7f23af200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b00b1900 con 0x7f23b00cb930 2024-03-12T17:19:35.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.702+0000 7f23ae800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f23b00cd850 0x7f23b00b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:35.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.703+0000 7f23ae800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f23b00cd850 0x7f23b00b2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55140/0 (socket says 172.21.15.17:55140) 2024-03-12T17:19:35.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.703+0000 7f23ae800640 1 -- 172.21.15.17:0/2624032552 learned_addr learned my addr 172.21.15.17:0/2624032552 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:35.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.703+0000 7f23a7e00640 1 --2- 172.21.15.17:0/2624032552 >> v2:172.21.15.94:3300/0 conn(0x7f23b00b23e0 0x7f23b00cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:35.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.703+0000 7f23ade00640 1 --2- 172.21.15.17:0/2624032552 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23b00cb930 0x7f23b00b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:35.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.703+0000 7f23ae800640 1 -- 172.21.15.17:0/2624032552 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23b00cb930 msgr2=0x7f23b00b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:35.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.703+0000 7f23ae800640 1 --2- 172.21.15.17:0/2624032552 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23b00cb930 0x7f23b00b45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:35.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.703+0000 7f23ae800640 1 -- 172.21.15.17:0/2624032552 >> v2:172.21.15.94:3300/0 conn(0x7f23b00b23e0 msgr2=0x7f23b00cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:35.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.703+0000 7f23ae800640 1 --2- 172.21.15.17:0/2624032552 >> v2:172.21.15.94:3300/0 conn(0x7f23b00b23e0 0x7f23b00cbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:35.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.703+0000 7f23ae800640 1 -- 172.21.15.17:0/2624032552 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b00b1be0 con 0x7f23b00cd850 2024-03-12T17:19:35.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.704+0000 7f23ae800640 1 --2- 172.21.15.17:0/2624032552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23b00cd850 0x7f23b00b2d50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f23b006e3e0 tx=0x7f23a802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc8ffc7c2fd58019 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:35.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.705+0000 7f23ad400640 1 -- 172.21.15.17:0/2624032552 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a802ca70 con 0x7f23b00cd850 2024-03-12T17:19:35.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.705+0000 7f23ad400640 1 -- 172.21.15.17:0/2624032552 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a802cbd0 con 0x7f23b00cd850 2024-03-12T17:19:35.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.705+0000 7f23ad400640 1 -- 172.21.15.17:0/2624032552 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a80343f0 con 0x7f23b00cd850 2024-03-12T17:19:35.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.705+0000 7f23af200640 1 -- 172.21.15.17:0/2624032552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23b00cd850 msgr2=0x7f23b00b2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:35.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.705+0000 7f23af200640 1 --2- 172.21.15.17:0/2624032552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23b00cd850 0x7f23b00b2d50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f23b006e3e0 tx=0x7f23a802bed0 comp rx=0 tx=0).stop 2024-03-12T17:19:35.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.705+0000 7f23af200640 1 -- 172.21.15.17:0/2624032552 shutdown_connections 2024-03-12T17:19:35.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.705+0000 7f23af200640 1 --2- 172.21.15.17:0/2624032552 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23b00cd850 0x7f23b00b2d50 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:35.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.705+0000 7f23af200640 1 --2- 172.21.15.17:0/2624032552 >> v2:172.21.15.94:3300/0 conn(0x7f23b00b23e0 0x7f23b00cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:35.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.705+0000 7f23af200640 1 --2- 172.21.15.17:0/2624032552 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23b00cb930 0x7f23b00b45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:35.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.705+0000 7f23af200640 1 -- 172.21.15.17:0/2624032552 >> 172.21.15.17:0/2624032552 conn(0x7f23b0069ce0 msgr2=0x7f23b006a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:35.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.705+0000 7f23af200640 1 -- 172.21.15.17:0/2624032552 shutdown_connections 2024-03-12T17:19:35.700 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.705+0000 7f23af200640 1 -- 172.21.15.17:0/2624032552 wait complete. 2024-03-12T17:19:35.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.707+0000 7f23af200640 1 Processor -- start 2024-03-12T17:19:35.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.707+0000 7f23af200640 1 -- start start 2024-03-12T17:19:35.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.708+0000 7f23af200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23b00b23e0 0x7f23b013bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:35.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.708+0000 7f23af200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23b00cb930 0x7f23b00b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:35.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.708+0000 7f23af200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23b00cd850 0x7f23b00b3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:35.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.708+0000 7f23af200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b0140df0 con 0x7f23b00cd850 2024-03-12T17:19:35.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.708+0000 7f23af200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b01410d0 con 0x7f23b00b23e0 2024-03-12T17:19:35.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.708+0000 7f23af200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b01413b0 con 0x7f23b00cb930 2024-03-12T17:19:35.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.708+0000 7f23ae800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23b00cd850 0x7f23b00b3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:35.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.708+0000 7f23ae800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23b00cd850 0x7f23b00b3100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55156/0 (socket says 172.21.15.17:55156) 2024-03-12T17:19:35.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.708+0000 7f23ae800640 1 -- 172.21.15.17:0/843971033 learned_addr learned my addr 172.21.15.17:0/843971033 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:35.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.709+0000 7f23a7e00640 1 --2- 172.21.15.17:0/843971033 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23b00cb930 0x7f23b00b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:35.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.709+0000 7f23ade00640 1 --2- 172.21.15.17:0/843971033 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23b00b23e0 0x7f23b013bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:35.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.709+0000 7f23ae800640 1 -- 172.21.15.17:0/843971033 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23b00cb930 msgr2=0x7f23b00b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:35.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.709+0000 7f23ae800640 1 --2- 172.21.15.17:0/843971033 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23b00cb930 0x7f23b00b2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:35.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.709+0000 7f23ae800640 1 -- 172.21.15.17:0/843971033 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23b00b23e0 msgr2=0x7f23b013bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:35.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.709+0000 7f23ae800640 1 --2- 172.21.15.17:0/843971033 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23b00b23e0 0x7f23b013bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:35.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.709+0000 7f23ae800640 1 -- 172.21.15.17:0/843971033 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a8009b30 con 0x7f23b00cd850 2024-03-12T17:19:35.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.709+0000 7f23a7e00640 1 --2- 172.21.15.17:0/843971033 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23b00cb930 0x7f23b00b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:35.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.709+0000 7f23ae800640 1 --2- 172.21.15.17:0/843971033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23b00cd850 0x7f23b00b3100 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f23a8036040 tx=0x7f23a8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:35.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.710+0000 7f23a6000640 1 -- 172.21.15.17:0/843971033 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a803e450 con 0x7f23b00cd850 2024-03-12T17:19:35.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.710+0000 7f23a6000640 1 -- 172.21.15.17:0/843971033 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a803e5d0 con 0x7f23b00cd850 2024-03-12T17:19:35.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.710+0000 7f23a6000640 1 -- 172.21.15.17:0/843971033 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a803e980 con 0x7f23b00cd850 2024-03-12T17:19:35.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.710+0000 7f23af200640 1 -- 172.21.15.17:0/843971033 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23b00ce600 con 0x7f23b00cd850 2024-03-12T17:19:35.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.710+0000 7f23af200640 1 -- 172.21.15.17:0/843971033 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23b0141970 con 0x7f23b00cd850 2024-03-12T17:19:35.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.711+0000 7f23af200640 1 -- 172.21.15.17:0/843971033 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23b004e030 con 0x7f23b00cd850 2024-03-12T17:19:35.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.712+0000 7f23a6000640 1 -- 172.21.15.17:0/843971033 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f23a803eae0 con 0x7f23b00cd850 2024-03-12T17:19:35.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.713+0000 7f23a6000640 1 --2- 172.21.15.17:0/843971033 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f238c06ac00 0x7f238c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:35.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.713+0000 7f23a6000640 1 -- 172.21.15.17:0/843971033 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f23a80ac2d0 con 0x7f23b00cd850 2024-03-12T17:19:35.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.713+0000 7f23ade00640 1 --2- 172.21.15.17:0/843971033 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f238c06ac00 0x7f238c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:35.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.714+0000 7f23ade00640 1 --2- 172.21.15.17:0/843971033 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f238c06ac00 0x7f238c06d0c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f23a000a970 tx=0x7f23a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:35.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.717+0000 7f23a6000640 1 -- 172.21.15.17:0/843971033 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f23a8077430 con 0x7f23b00cd850 2024-03-12T17:19:35.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.920+0000 7f23af200640 1 -- 172.21.15.17:0/843971033 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23b0141b00 con 0x7f23b00cd850 2024-03-12T17:19:35.916 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.922+0000 7f23a6000640 1 -- 172.21.15.17:0/843971033 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16238 (secure 0 0 0) 0x7f23a807aa50 con 0x7f23b00cd850 2024-03-12T17:19:35.916 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:19:35.916 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":23,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:19:33.387374+0000","last_up_change":"2024-03-12T17:18:38.144756+0000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-12T17:18:39.552910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-12T17:18:43.794908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-12T17:18:44.867006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":37305},{"type":"v1","addr":"172.21.15.17:6801","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":37305},{"type":"v1","addr":"172.21.15.17:6803","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":37305},{"type":"v1","addr":"172.21.15.17:6807","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":37305},{"type":"v1","addr":"172.21.15.17:6805","nonce":37305}]},"public_addr":"172.21.15.17:6801/37305","cluster_addr":"172.21.15.17:6803/37305","heartbeat_back_addr":"172.21.15.17:6807/37305","heartbeat_front_addr":"172.21.15.17:6805/37305","state":["exists","up"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":37307},{"type":"v1","addr":"172.21.15.17:6814","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":37307},{"type":"v1","addr":"172.21.15.17:6818","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":37307},{"type":"v1","addr":"172.21.15.17:6827","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":37307},{"type":"v1","addr":"172.21.15.17:6823","nonce":37307}]},"public_addr":"172.21.15.17:6814/37307","cluster_addr":"172.21.15.17:6818/37307","heartbeat_back_addr":"172.21.15.17:6827/37307","heartbeat_front_addr":"172.21.15.17:6823/37307","state":["exists","up"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":37303},{"type":"v1","addr":"172.21.15.17:6809","nonce":37303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":37303},{"type":"v1","addr":"172.21.15.17:6811","nonce":37303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":37303},{"type":"v1","addr":"172.21.15.17:6819","nonce":37303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":37303},{"type":"v1","addr":"172.21.15.17:6815","nonce":37303}]},"public_addr":"172.21.15.17:6809/37303","cluster_addr":"172.21.15.17:6811/37303","heartbeat_back_addr":"172.21.15.17:6819/37303","heartbeat_front_addr":"172.21.15.17:6815/37303","state":["exists","up"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":37308},{"type":"v1","addr":"172.21.15.17:6822","nonce":37308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":37308},{"type":"v1","addr":"172.21.15.17:6826","nonce":37308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":37308},{"type":"v1","addr":"172.21.15.17:6831","nonce":37308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":37308},{"type":"v1","addr":"172.21.15.17:6829","nonce":37308}]},"public_addr":"172.21.15.17:6822/37308","cluster_addr":"172.21.15.17:6826/37308","heartbeat_back_addr":"172.21.15.17:6831/37308","heartbeat_front_addr":"172.21.15.17:6829/37308","state":["exists","up"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":37465},{"type":"v1","addr":"172.21.15.94:6809","nonce":37465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6811","nonce":37465},{"type":"v1","addr":"172.21.15.94:6813","nonce":37465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6819","nonce":37465},{"type":"v1","addr":"172.21.15.94:6822","nonce":37465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6815","nonce":37465},{"type":"v1","addr":"172.21.15.94:6817","nonce":37465}]},"public_addr":"172.21.15.94:6809/37465","cluster_addr":"172.21.15.94:6813/37465","heartbeat_back_addr":"172.21.15.94:6822/37465","heartbeat_front_addr":"172.21.15.94:6817/37465","state":["exists","up"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":37464},{"type":"v1","addr":"172.21.15.94:6812","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":37464},{"type":"v1","addr":"172.21.15.94:6816","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":37464},{"type":"v1","addr":"172.21.15.94:6823","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":37464},{"type":"v1","addr":"172.21.15.94:6820","nonce":37464}]},"public_addr":"172.21.15.94:6812/37464","cluster_addr":"172.21.15.94:6816/37464","heartbeat_back_addr":"172.21.15.94:6823/37464","heartbeat_front_addr":"172.21.15.94:6820/37464","state":["exists","up"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":37467},{"type":"v1","addr":"172.21.15.94:6825","nonce":37467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":37467},{"type":"v1","addr":"172.21.15.94:6827","nonce":37467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":37467},{"type":"v1","addr":"172.21.15.94:6831","nonce":37467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":37467},{"type":"v1","addr":"172.21.15.94:6829","nonce":37467}]},"public_addr":"172.21.15.94:6825/37467","cluster_addr":"172.21.15.94:6827/37467","heartbeat_back_addr":"172.21.15.94:6831/37467","heartbeat_front_addr":"172.21.15.94:6829/37467","state":["exists","up"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":37466},{"type":"v1","addr":"172.21.15.94:6801","nonce":37466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":37466},{"type":"v1","addr":"172.21.15.94:6803","nonce":37466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":37466},{"type":"v1","addr":"172.21.15.94:6807","nonce":37466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":37466},{"type":"v1","addr":"172.21.15.94:6805","nonce":37466}]},"public_addr":"172.21.15.94:6801/37466","cluster_addr":"172.21.15.94:6803/37466","heartbeat_back_addr":"172.21.15.94:6807/37466","heartbeat_front_addr":"172.21.15.94:6805/37466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.327217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.186966+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.419986+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.150585+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.120621+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.121576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.181257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.293188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:19:35.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.924+0000 7f23af200640 1 -- 172.21.15.17:0/843971033 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f238c06ac00 msgr2=0x7f238c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:35.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.924+0000 7f23af200640 1 --2- 172.21.15.17:0/843971033 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f238c06ac00 0x7f238c06d0c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f23a000a970 tx=0x7f23a0008040 comp rx=0 tx=0).stop 2024-03-12T17:19:35.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.924+0000 7f23af200640 1 -- 172.21.15.17:0/843971033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23b00cd850 msgr2=0x7f23b00b3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:35.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.924+0000 7f23af200640 1 --2- 172.21.15.17:0/843971033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23b00cd850 0x7f23b00b3100 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f23a8036040 tx=0x7f23a8004a40 comp rx=0 tx=0).stop 2024-03-12T17:19:35.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.925+0000 7f23af200640 1 -- 172.21.15.17:0/843971033 shutdown_connections 2024-03-12T17:19:35.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.925+0000 7f23af200640 1 --2- 172.21.15.17:0/843971033 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f238c06ac00 0x7f238c06d0c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:35.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.925+0000 7f23af200640 1 --2- 172.21.15.17:0/843971033 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f23b00cd850 0x7f23b00b3100 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:35.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.925+0000 7f23af200640 1 --2- 172.21.15.17:0/843971033 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f23b00cb930 0x7f23b00b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:35.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.925+0000 7f23af200640 1 --2- 172.21.15.17:0/843971033 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f23b00b23e0 0x7f23b013bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:35.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.925+0000 7f23af200640 1 -- 172.21.15.17:0/843971033 >> 172.21.15.17:0/843971033 conn(0x7f23b0069ce0 msgr2=0x7f23b015c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:35.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.925+0000 7f23af200640 1 -- 172.21.15.17:0/843971033 shutdown_connections 2024-03-12T17:19:35.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:35.925+0000 7f23af200640 1 -- 172.21.15.17:0/843971033 wait complete. 2024-03-12T17:19:35.938 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-12T17:18:39.552910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-12T17:18:43.794908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-12T17:18:44.867006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-12T17:19:35.938 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-12T17:19:36.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.164+0000 7f945fe00640 1 Processor -- start 2024-03-12T17:19:36.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.165+0000 7f945fe00640 1 -- start start 2024-03-12T17:19:36.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.166+0000 7f945fe00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f946015ae20 0x7f946006d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:36.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.166+0000 7f945fe00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f94600b3b70 0x7f94600b4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:36.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.166+0000 7f945fe00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94600a7660 con 0x7f94601441f0 2024-03-12T17:19:36.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.166+0000 7f945fe00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94600b4540 con 0x7f94600b3b70 2024-03-12T17:19:36.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.166+0000 7f945fe00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f946015e460 con 0x7f946015ae20 2024-03-12T17:19:36.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.167+0000 7f945ea00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f94601441f0 0x7f9460070240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:38512/0 (socket says 172.21.15.17:38512) 2024-03-12T17:19:36.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.167+0000 7f945ea00640 1 -- 172.21.15.17:0/4105513773 learned_addr learned my addr 172.21.15.17:0/4105513773 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:36.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.167+0000 7f945f400640 1 --2- 172.21.15.17:0/4105513773 >> v2:172.21.15.17:3300/0 conn(0x7f94600b3b70 0x7f94600b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:36.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.167+0000 7f945e000640 1 --2- 172.21.15.17:0/4105513773 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f946015ae20 0x7f946006d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:36.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.167+0000 7f945f400640 1 -- 172.21.15.17:0/4105513773 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f946015ae20 msgr2=0x7f946006d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:36.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.167+0000 7f945f400640 1 --2- 172.21.15.17:0/4105513773 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f946015ae20 0x7f946006d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:36.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.167+0000 7f945f400640 1 -- 172.21.15.17:0/4105513773 >> v1:172.21.15.17:6789/0 conn(0x7f94601441f0 legacy=0x7f9460070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:36.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.168+0000 7f945f400640 1 -- 172.21.15.17:0/4105513773 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94601445d0 con 0x7f94600b3b70 2024-03-12T17:19:36.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.167+0000 7f945d600640 1 -- 172.21.15.17:0/4105513773 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2705458003 0 0) 0x7f94600a7660 con 0x7f94601441f0 2024-03-12T17:19:36.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.169+0000 7f945f400640 1 --2- 172.21.15.17:0/4105513773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94600b3b70 0x7f94600b4000 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f94580097a0 tx=0x7f945802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff7661aeec38a1c3 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:36.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.169+0000 7f945d600640 1 -- 172.21.15.17:0/4105513773 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9458030610 con 0x7f94600b3b70 2024-03-12T17:19:36.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.169+0000 7f945d600640 1 -- 172.21.15.17:0/4105513773 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9458030770 con 0x7f94600b3b70 2024-03-12T17:19:36.163 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.169+0000 7f945d600640 1 -- 172.21.15.17:0/4105513773 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9458030b00 con 0x7f94600b3b70 2024-03-12T17:19:36.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.169+0000 7f945fe00640 1 -- 172.21.15.17:0/4105513773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94600b3b70 msgr2=0x7f94600b4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:36.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.169+0000 7f945fe00640 1 --2- 172.21.15.17:0/4105513773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94600b3b70 0x7f94600b4000 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f94580097a0 tx=0x7f945802b960 comp rx=0 tx=0).stop 2024-03-12T17:19:36.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.170+0000 7f945fe00640 1 -- 172.21.15.17:0/4105513773 shutdown_connections 2024-03-12T17:19:36.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.170+0000 7f945fe00640 1 --2- 172.21.15.17:0/4105513773 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f94600b3b70 0x7f94600b4000 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:36.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.170+0000 7f945fe00640 1 --2- 172.21.15.17:0/4105513773 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f946015ae20 0x7f946006d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:36.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.170+0000 7f945fe00640 1 -- 172.21.15.17:0/4105513773 >> 172.21.15.17:0/4105513773 conn(0x7f9460069ce0 msgr2=0x7f946006a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:36.164 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.170+0000 7f945fe00640 1 -- 172.21.15.17:0/4105513773 shutdown_connections 2024-03-12T17:19:36.165 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.170+0000 7f945fe00640 1 -- 172.21.15.17:0/4105513773 wait complete. 2024-03-12T17:19:36.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.171+0000 7f945fe00640 1 Processor -- start 2024-03-12T17:19:36.166 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.172+0000 7f945fe00640 1 -- start start 2024-03-12T17:19:36.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.173+0000 7f945fe00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f94600b3b70 0x7f94601412e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:36.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.173+0000 7f945fe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94601441f0 0x7f94600c4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:36.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.173+0000 7f945fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f946015ae20 0x7f94600acf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:36.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.173+0000 7f945fe00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94600acb00 con 0x7f946015ae20 2024-03-12T17:19:36.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.173+0000 7f945fe00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94600abe80 con 0x7f94601441f0 2024-03-12T17:19:36.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.173+0000 7f945fe00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94600ac160 con 0x7f94600b3b70 2024-03-12T17:19:36.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.173+0000 7f945f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f946015ae20 0x7f94600acf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:36.168 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.173+0000 7f945f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f946015ae20 0x7f94600acf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55172/0 (socket says 172.21.15.17:55172) 2024-03-12T17:19:36.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.173+0000 7f945f400640 1 -- 172.21.15.17:0/1958833580 learned_addr learned my addr 172.21.15.17:0/1958833580 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:36.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.173+0000 7f945e000640 1 --2- 172.21.15.17:0/1958833580 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94601441f0 0x7f94600c4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:36.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.173+0000 7f945ea00640 1 --2- 172.21.15.17:0/1958833580 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f94600b3b70 0x7f94601412e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:36.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.174+0000 7f945f400640 1 -- 172.21.15.17:0/1958833580 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f94600b3b70 msgr2=0x7f94601412e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:36.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.174+0000 7f945f400640 1 --2- 172.21.15.17:0/1958833580 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f94600b3b70 0x7f94601412e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:36.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.174+0000 7f945f400640 1 -- 172.21.15.17:0/1958833580 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94601441f0 msgr2=0x7f94600c4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:36.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.174+0000 7f945f400640 1 --2- 172.21.15.17:0/1958833580 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94601441f0 0x7f94600c4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:36.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.174+0000 7f945f400640 1 -- 172.21.15.17:0/1958833580 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9458009400 con 0x7f946015ae20 2024-03-12T17:19:36.169 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.174+0000 7f945f400640 1 --2- 172.21.15.17:0/1958833580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f946015ae20 0x7f94600acf20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f94580098c0 tx=0x7f9458004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:36.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.174+0000 7f9456a00640 1 -- 172.21.15.17:0/1958833580 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945803e040 con 0x7f946015ae20 2024-03-12T17:19:36.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.174+0000 7f9456a00640 1 -- 172.21.15.17:0/1958833580 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9458039c10 con 0x7f946015ae20 2024-03-12T17:19:36.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.174+0000 7f945fe00640 1 -- 172.21.15.17:0/1958833580 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94600ac440 con 0x7f946015ae20 2024-03-12T17:19:36.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.174+0000 7f9456a00640 1 -- 172.21.15.17:0/1958833580 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9458006e10 con 0x7f946015ae20 2024-03-12T17:19:36.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.175+0000 7f945fe00640 1 -- 172.21.15.17:0/1958833580 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94600abac0 con 0x7f946015ae20 2024-03-12T17:19:36.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.176+0000 7f945fe00640 1 -- 172.21.15.17:0/1958833580 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94600acc40 con 0x7f946015ae20 2024-03-12T17:19:36.171 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.177+0000 7f9456a00640 1 -- 172.21.15.17:0/1958833580 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f945804d3b0 con 0x7f946015ae20 2024-03-12T17:19:36.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.178+0000 7f9456a00640 1 --2- 172.21.15.17:0/1958833580 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f943c06ac00 0x7f943c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:36.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.178+0000 7f9456a00640 1 -- 172.21.15.17:0/1958833580 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f94580ab9c0 con 0x7f946015ae20 2024-03-12T17:19:36.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.178+0000 7f945ea00640 1 --2- 172.21.15.17:0/1958833580 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f943c06ac00 0x7f943c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:36.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.179+0000 7f945ea00640 1 --2- 172.21.15.17:0/1958833580 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f943c06ac00 0x7f943c06d0c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9448000f60 tx=0x7f9448007b50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:36.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.182+0000 7f9456a00640 1 -- 172.21.15.17:0/1958833580 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f9458076b10 con 0x7f946015ae20 2024-03-12T17:19:36.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.381+0000 7f945fe00640 1 -- 172.21.15.17:0/1958833580 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f946004e030 con 0x7f946015ae20 2024-03-12T17:19:36.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.383+0000 7f9456a00640 1 -- 172.21.15.17:0/1958833580 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9458049020 con 0x7f946015ae20 2024-03-12T17:19:36.377 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-03-12T17:19:36.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.385+0000 7f945fe00640 1 -- 172.21.15.17:0/1958833580 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f943c06ac00 msgr2=0x7f943c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:36.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.385+0000 7f945fe00640 1 --2- 172.21.15.17:0/1958833580 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f943c06ac00 0x7f943c06d0c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9448000f60 tx=0x7f9448007b50 comp rx=0 tx=0).stop 2024-03-12T17:19:36.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.385+0000 7f945fe00640 1 -- 172.21.15.17:0/1958833580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f946015ae20 msgr2=0x7f94600acf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:36.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.385+0000 7f945fe00640 1 --2- 172.21.15.17:0/1958833580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f946015ae20 0x7f94600acf20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f94580098c0 tx=0x7f9458004730 comp rx=0 tx=0).stop 2024-03-12T17:19:36.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.386+0000 7f945fe00640 1 -- 172.21.15.17:0/1958833580 shutdown_connections 2024-03-12T17:19:36.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.386+0000 7f945fe00640 1 --2- 172.21.15.17:0/1958833580 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f943c06ac00 0x7f943c06d0c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:36.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.386+0000 7f945fe00640 1 --2- 172.21.15.17:0/1958833580 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f946015ae20 0x7f94600acf20 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:36.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.386+0000 7f945fe00640 1 --2- 172.21.15.17:0/1958833580 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f94601441f0 0x7f94600c4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:36.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.386+0000 7f945fe00640 1 --2- 172.21.15.17:0/1958833580 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f94600b3b70 0x7f94601412e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:36.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.386+0000 7f945fe00640 1 -- 172.21.15.17:0/1958833580 >> 172.21.15.17:0/1958833580 conn(0x7f9460069ce0 msgr2=0x7f9460143200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:36.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.386+0000 7f945fe00640 1 -- 172.21.15.17:0/1958833580 shutdown_connections 2024-03-12T17:19:36.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.386+0000 7f945fe00640 1 -- 172.21.15.17:0/1958833580 wait complete. 2024-03-12T17:19:36.400 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-12T17:19:36.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.629+0000 7fe427e00640 1 Processor -- start 2024-03-12T17:19:36.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.629+0000 7fe427e00640 1 -- start start 2024-03-12T17:19:36.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.630+0000 7fe427e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe428160150 0x7fe4280d2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:36.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.630+0000 7fe427e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe4280b4790 0x7fe4280b4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:36.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.630+0000 7fe427e00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4280b5120 con 0x7fe4280d2540 2024-03-12T17:19:36.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.630+0000 7fe427e00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe428160530 con 0x7fe4280b4790 2024-03-12T17:19:36.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.630+0000 7fe427e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4280d15b0 con 0x7fe428160150 2024-03-12T17:19:36.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.630+0000 7fe427400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe4280b4790 0x7fe4280b4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:36.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.630+0000 7fe427400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe4280b4790 0x7fe4280b4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55180/0 (socket says 172.21.15.17:55180) 2024-03-12T17:19:36.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.630+0000 7fe426000640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fe4280d2540 0x7fe4280b8190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:38520/0 (socket says 172.21.15.17:38520) 2024-03-12T17:19:36.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.630+0000 7fe427400640 1 -- 172.21.15.17:0/3122119804 learned_addr learned my addr 172.21.15.17:0/3122119804 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:36.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.631+0000 7fe427400640 1 -- 172.21.15.17:0/3122119804 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe428160150 msgr2=0x7fe4280d2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:36.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.631+0000 7fe426a00640 1 --2- 172.21.15.17:0/3122119804 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe428160150 0x7fe4280d2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:36.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.631+0000 7fe427400640 1 --2- 172.21.15.17:0/3122119804 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe428160150 0x7fe4280d2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:36.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.631+0000 7fe425600640 1 -- 172.21.15.17:0/3122119804 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1093191079 0 0) 0x7fe414001110 con 0x7fe4280d2540 2024-03-12T17:19:36.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.631+0000 7fe427400640 1 -- 172.21.15.17:0/3122119804 >> v1:172.21.15.17:6789/0 conn(0x7fe4280d2540 legacy=0x7fe4280b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:36.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.631+0000 7fe427400640 1 -- 172.21.15.17:0/3122119804 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4280b88a0 con 0x7fe4280b4790 2024-03-12T17:19:36.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.631+0000 7fe426a00640 1 --2- 172.21.15.17:0/3122119804 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe428160150 0x7fe4280d2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:36.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.632+0000 7fe427400640 1 --2- 172.21.15.17:0/3122119804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4280b4790 0x7fe4280b4be0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe420009e50 tx=0x7fe42002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc9a1be9e0d8a4e2 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:36.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.632+0000 7fe425600640 1 -- 172.21.15.17:0/3122119804 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42002cb00 con 0x7fe4280b4790 2024-03-12T17:19:36.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.632+0000 7fe425600640 1 -- 172.21.15.17:0/3122119804 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42002cc60 con 0x7fe4280b4790 2024-03-12T17:19:36.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.632+0000 7fe425600640 1 -- 172.21.15.17:0/3122119804 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4200343f0 con 0x7fe4280b4790 2024-03-12T17:19:36.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.633+0000 7fe427e00640 1 -- 172.21.15.17:0/3122119804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4280b4790 msgr2=0x7fe4280b4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:36.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.633+0000 7fe427e00640 1 --2- 172.21.15.17:0/3122119804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4280b4790 0x7fe4280b4be0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fe420009e50 tx=0x7fe42002bf60 comp rx=0 tx=0).stop 2024-03-12T17:19:36.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.633+0000 7fe427e00640 1 -- 172.21.15.17:0/3122119804 shutdown_connections 2024-03-12T17:19:36.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.633+0000 7fe427e00640 1 --2- 172.21.15.17:0/3122119804 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe4280b4790 0x7fe4280b4be0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:36.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.633+0000 7fe427e00640 1 --2- 172.21.15.17:0/3122119804 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe428160150 0x7fe4280d2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:36.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.633+0000 7fe427e00640 1 -- 172.21.15.17:0/3122119804 >> 172.21.15.17:0/3122119804 conn(0x7fe4280cf7d0 msgr2=0x7fe4280cfbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:36.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.633+0000 7fe427e00640 1 -- 172.21.15.17:0/3122119804 shutdown_connections 2024-03-12T17:19:36.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.633+0000 7fe427e00640 1 -- 172.21.15.17:0/3122119804 wait complete. 2024-03-12T17:19:36.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.635+0000 7fe427e00640 1 Processor -- start 2024-03-12T17:19:36.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.635+0000 7fe427e00640 1 -- start start 2024-03-12T17:19:36.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.636+0000 7fe427e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe4280b4790 0x7fe4280ca860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:36.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.636+0000 7fe427e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe428160150 0x7fe42815bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:36.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.636+0000 7fe427e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe428159330 0x7fe4281597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:36.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.636+0000 7fe427e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe428159d20 con 0x7fe428159330 2024-03-12T17:19:36.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.636+0000 7fe427e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4281f3440 con 0x7fe428160150 2024-03-12T17:19:36.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.636+0000 7fe427e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4280c9aa0 con 0x7fe4280b4790 2024-03-12T17:19:36.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.636+0000 7fe427400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe428159330 0x7fe4281597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:36.631 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.636+0000 7fe427400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe428159330 0x7fe4281597e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55194/0 (socket says 172.21.15.17:55194) 2024-03-12T17:19:36.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.636+0000 7fe427400640 1 -- 172.21.15.17:0/1834894817 learned_addr learned my addr 172.21.15.17:0/1834894817 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:36.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.637+0000 7fe426a00640 1 --2- 172.21.15.17:0/1834894817 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe4280b4790 0x7fe4280ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:36.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.637+0000 7fe426000640 1 --2- 172.21.15.17:0/1834894817 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe428160150 0x7fe42815bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:36.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.637+0000 7fe427400640 1 -- 172.21.15.17:0/1834894817 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe4280b4790 msgr2=0x7fe4280ca860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:36.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.637+0000 7fe427400640 1 --2- 172.21.15.17:0/1834894817 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe4280b4790 0x7fe4280ca860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:36.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.637+0000 7fe427400640 1 -- 172.21.15.17:0/1834894817 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe428160150 msgr2=0x7fe42815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:36.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.637+0000 7fe427400640 1 --2- 172.21.15.17:0/1834894817 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe428160150 0x7fe42815bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:36.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.637+0000 7fe427400640 1 -- 172.21.15.17:0/1834894817 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe420009b30 con 0x7fe428159330 2024-03-12T17:19:36.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.637+0000 7fe426000640 1 --2- 172.21.15.17:0/1834894817 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe428160150 0x7fe42815bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:36.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.637+0000 7fe427400640 1 --2- 172.21.15.17:0/1834894817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe428159330 0x7fe4281597e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe420009e50 tx=0x7fe420004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:36.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.638+0000 7fe41ea00640 1 -- 172.21.15.17:0/1834894817 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe420009510 con 0x7fe428159330 2024-03-12T17:19:36.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.638+0000 7fe41ea00640 1 -- 172.21.15.17:0/1834894817 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe42003e450 con 0x7fe428159330 2024-03-12T17:19:36.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.638+0000 7fe41ea00640 1 -- 172.21.15.17:0/1834894817 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe42003e800 con 0x7fe428159330 2024-03-12T17:19:36.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.638+0000 7fe427e00640 1 -- 172.21.15.17:0/1834894817 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4280c9d80 con 0x7fe428159330 2024-03-12T17:19:36.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.638+0000 7fe427e00640 1 -- 172.21.15.17:0/1834894817 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4280ca340 con 0x7fe428159330 2024-03-12T17:19:36.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.639+0000 7fe427e00640 1 -- 172.21.15.17:0/1834894817 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe42804e030 con 0x7fe428159330 2024-03-12T17:19:36.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.640+0000 7fe41ea00640 1 -- 172.21.15.17:0/1834894817 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fe42003e960 con 0x7fe428159330 2024-03-12T17:19:36.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.641+0000 7fe41ea00640 1 --2- 172.21.15.17:0/1834894817 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe40806ac00 0x7fe40806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:36.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.641+0000 7fe41ea00640 1 -- 172.21.15.17:0/1834894817 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fe4200ac310 con 0x7fe428159330 2024-03-12T17:19:36.635 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.641+0000 7fe426a00640 1 --2- 172.21.15.17:0/1834894817 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe40806ac00 0x7fe40806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:36.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.642+0000 7fe426a00640 1 --2- 172.21.15.17:0/1834894817 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe40806ac00 0x7fe40806d0c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe41800a950 tx=0x7fe418008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:36.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.646+0000 7fe41ea00640 1 -- 172.21.15.17:0/1834894817 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fe420077480 con 0x7fe428159330 2024-03-12T17:19:36.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.843+0000 7fe427e00640 1 -- 172.21.15.17:0/1834894817 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe42806c240 con 0x7fe428159330 2024-03-12T17:19:36.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.844+0000 7fe41ea00640 1 -- 172.21.15.17:0/1834894817 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe42007aaa0 con 0x7fe428159330 2024-03-12T17:19:36.839 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-03-12T17:19:36.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.847+0000 7fe427e00640 1 -- 172.21.15.17:0/1834894817 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe40806ac00 msgr2=0x7fe40806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:36.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.847+0000 7fe427e00640 1 --2- 172.21.15.17:0/1834894817 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe40806ac00 0x7fe40806d0c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe41800a950 tx=0x7fe418008040 comp rx=0 tx=0).stop 2024-03-12T17:19:36.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.847+0000 7fe427e00640 1 -- 172.21.15.17:0/1834894817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe428159330 msgr2=0x7fe4281597e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:36.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.847+0000 7fe427e00640 1 --2- 172.21.15.17:0/1834894817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe428159330 0x7fe4281597e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe420009e50 tx=0x7fe420004a40 comp rx=0 tx=0).stop 2024-03-12T17:19:36.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.847+0000 7fe427e00640 1 -- 172.21.15.17:0/1834894817 shutdown_connections 2024-03-12T17:19:36.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.847+0000 7fe427e00640 1 --2- 172.21.15.17:0/1834894817 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe40806ac00 0x7fe40806d0c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:36.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.847+0000 7fe427e00640 1 --2- 172.21.15.17:0/1834894817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe428159330 0x7fe4281597e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:36.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.847+0000 7fe427e00640 1 --2- 172.21.15.17:0/1834894817 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe428160150 0x7fe42815bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:36.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.848+0000 7fe427e00640 1 --2- 172.21.15.17:0/1834894817 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe4280b4790 0x7fe4280ca860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:36.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.848+0000 7fe427e00640 1 -- 172.21.15.17:0/1834894817 >> 172.21.15.17:0/1834894817 conn(0x7fe4280cf7d0 msgr2=0x7fe4280cfbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:36.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.848+0000 7fe427e00640 1 -- 172.21.15.17:0/1834894817 shutdown_connections 2024-03-12T17:19:36.843 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:36.848+0000 7fe427e00640 1 -- 172.21.15.17:0/1834894817 wait complete. 2024-03-12T17:19:36.862 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-12T17:19:37.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.089+0000 7faaaac00640 1 Processor -- start 2024-03-12T17:19:37.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.089+0000 7faaaac00640 1 -- start start 2024-03-12T17:19:37.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.090+0000 7faaaac00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faaa40cb930 0x7faaa40b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:37.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.091+0000 7faaaac00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7faaa40cd850 0x7faaa40b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:37.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.091+0000 7faaaac00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaa40ce1a0 con 0x7faaa40b23e0 2024-03-12T17:19:37.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.091+0000 7faaaac00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaa40b1900 con 0x7faaa40cd850 2024-03-12T17:19:37.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.091+0000 7faaaac00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa40b1be0 con 0x7faaa40cb930 2024-03-12T17:19:37.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.091+0000 7faaaa200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7faaa40cd850 0x7faaa40b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:37.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.091+0000 7faaa8e00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7faaa40b23e0 0x7faaa40cbd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:38528/0 (socket says 172.21.15.17:38528) 2024-03-12T17:19:37.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.091+0000 7faaa8e00640 1 -- 172.21.15.17:0/2345723834 learned_addr learned my addr 172.21.15.17:0/2345723834 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:37.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.091+0000 7faaa9800640 1 --2- 172.21.15.17:0/2345723834 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faaa40cb930 0x7faaa40b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:37.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.092+0000 7faaa3e00640 1 -- 172.21.15.17:0/2345723834 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3539731877 0 0) 0x7faaa40ce1a0 con 0x7faaa40b23e0 2024-03-12T17:19:37.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.092+0000 7faaa3e00640 1 -- 172.21.15.17:0/2345723834 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa8c005730 con 0x7faaa40b23e0 2024-03-12T17:19:37.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.092+0000 7faaaa200640 1 -- 172.21.15.17:0/2345723834 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faaa40cb930 msgr2=0x7faaa40b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:37.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.092+0000 7faaaa200640 1 --2- 172.21.15.17:0/2345723834 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faaa40cb930 0x7faaa40b45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:37.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.092+0000 7faaaa200640 1 -- 172.21.15.17:0/2345723834 >> v1:172.21.15.17:6789/0 conn(0x7faaa40b23e0 legacy=0x7faaa40cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:37.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.092+0000 7faaaa200640 1 -- 172.21.15.17:0/2345723834 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa40b1ec0 con 0x7faaa40cd850 2024-03-12T17:19:37.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.092+0000 7faaa9800640 1 --2- 172.21.15.17:0/2345723834 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faaa40cb930 0x7faaa40b45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:19:37.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.093+0000 7faaaa200640 1 --2- 172.21.15.17:0/2345723834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faaa40cd850 0x7faaa40b2d50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7faa9c009d90 tx=0x7faa9c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97abcfbbc2f9a777 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:37.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.093+0000 7faaa3e00640 1 -- 172.21.15.17:0/2345723834 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9c02cc50 con 0x7faaa40cd850 2024-03-12T17:19:37.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.093+0000 7faaa3e00640 1 -- 172.21.15.17:0/2345723834 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa9c02cdb0 con 0x7faaa40cd850 2024-03-12T17:19:37.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.093+0000 7faaa3e00640 1 -- 172.21.15.17:0/2345723834 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9c034660 con 0x7faaa40cd850 2024-03-12T17:19:37.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.094+0000 7faaaac00640 1 -- 172.21.15.17:0/2345723834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faaa40cd850 msgr2=0x7faaa40b2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:37.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.094+0000 7faaaac00640 1 --2- 172.21.15.17:0/2345723834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faaa40cd850 0x7faaa40b2d50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7faa9c009d90 tx=0x7faa9c02bea0 comp rx=0 tx=0).stop 2024-03-12T17:19:37.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.094+0000 7faaaac00640 1 -- 172.21.15.17:0/2345723834 shutdown_connections 2024-03-12T17:19:37.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.094+0000 7faaaac00640 1 --2- 172.21.15.17:0/2345723834 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faaa40cd850 0x7faaa40b2d50 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:37.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.094+0000 7faaaac00640 1 --2- 172.21.15.17:0/2345723834 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faaa40cb930 0x7faaa40b45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:37.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.094+0000 7faaaac00640 1 -- 172.21.15.17:0/2345723834 >> 172.21.15.17:0/2345723834 conn(0x7faaa4069ce0 msgr2=0x7faaa406a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:37.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.094+0000 7faaaac00640 1 -- 172.21.15.17:0/2345723834 shutdown_connections 2024-03-12T17:19:37.089 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.094+0000 7faaaac00640 1 -- 172.21.15.17:0/2345723834 wait complete. 2024-03-12T17:19:37.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.096+0000 7faaaac00640 1 Processor -- start 2024-03-12T17:19:37.090 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.096+0000 7faaaac00640 1 -- start start 2024-03-12T17:19:37.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.097+0000 7faaaac00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faaa40b23e0 0x7faaa40c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:37.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.097+0000 7faaaac00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faaa40cb930 0x7faaa413f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:37.092 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.097+0000 7faaaac00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faaa40cd850 0x7faaa40c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:37.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.097+0000 7faaaac00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa40c48c0 con 0x7faaa40cb930 2024-03-12T17:19:37.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.097+0000 7faaaac00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa413f950 con 0x7faaa40b23e0 2024-03-12T17:19:37.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.097+0000 7faaaac00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa40ca370 con 0x7faaa40cd850 2024-03-12T17:19:37.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.097+0000 7faaa8e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faaa40cb930 0x7faaa413f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:37.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.097+0000 7faaa8e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faaa40cb930 0x7faaa413f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55206/0 (socket says 172.21.15.17:55206) 2024-03-12T17:19:37.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.097+0000 7faaa8e00640 1 -- 172.21.15.17:0/125585046 learned_addr learned my addr 172.21.15.17:0/125585046 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:37.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.097+0000 7faaaa200640 1 --2- 172.21.15.17:0/125585046 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faaa40cd850 0x7faaa40c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:37.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.097+0000 7faaa9800640 1 --2- 172.21.15.17:0/125585046 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faaa40b23e0 0x7faaa40c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:37.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.098+0000 7faaa8e00640 1 -- 172.21.15.17:0/125585046 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faaa40cd850 msgr2=0x7faaa40c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:37.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.098+0000 7faaa8e00640 1 --2- 172.21.15.17:0/125585046 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faaa40cd850 0x7faaa40c9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:37.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.098+0000 7faaa8e00640 1 -- 172.21.15.17:0/125585046 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faaa40b23e0 msgr2=0x7faaa40c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:37.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.098+0000 7faaa8e00640 1 --2- 172.21.15.17:0/125585046 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faaa40b23e0 0x7faaa40c5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:37.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.098+0000 7faaa8e00640 1 -- 172.21.15.17:0/125585046 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa9c009a70 con 0x7faaa40cb930 2024-03-12T17:19:37.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.098+0000 7faaa8e00640 1 --2- 172.21.15.17:0/125585046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faaa40cb930 0x7faaa413f410 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7faa9400c500 tx=0x7faa9400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:37.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.098+0000 7faaa1600640 1 -- 172.21.15.17:0/125585046 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa94005ce0 con 0x7faaa40cb930 2024-03-12T17:19:37.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.098+0000 7faaa1600640 1 -- 172.21.15.17:0/125585046 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa94005e40 con 0x7faaa40cb930 2024-03-12T17:19:37.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.098+0000 7faaaac00640 1 -- 172.21.15.17:0/125585046 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa40ce600 con 0x7faaa40cb930 2024-03-12T17:19:37.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.098+0000 7faaa1600640 1 -- 172.21.15.17:0/125585046 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa94007330 con 0x7faaa40cb930 2024-03-12T17:19:37.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.098+0000 7faaaac00640 1 -- 172.21.15.17:0/125585046 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa40ca930 con 0x7faaa40cb930 2024-03-12T17:19:37.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.100+0000 7faaaac00640 1 -- 172.21.15.17:0/125585046 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaa40c4a90 con 0x7faaa40cb930 2024-03-12T17:19:37.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.100+0000 7faaa1600640 1 -- 172.21.15.17:0/125585046 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7faa94007550 con 0x7faaa40cb930 2024-03-12T17:19:37.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.102+0000 7faaa1600640 1 --2- 172.21.15.17:0/125585046 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faa8806ac00 0x7faa8806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:37.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.102+0000 7faaa1600640 1 -- 172.21.15.17:0/125585046 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7faa94088ad0 con 0x7faaa40cb930 2024-03-12T17:19:37.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.102+0000 7faaa9800640 1 --2- 172.21.15.17:0/125585046 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faa8806ac00 0x7faa8806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:37.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.103+0000 7faaa9800640 1 --2- 172.21.15.17:0/125585046 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faa8806ac00 0x7faa8806d0c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7faa9800d8b0 tx=0x7faa98008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:37.100 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.106+0000 7faaa1600640 1 -- 172.21.15.17:0/125585046 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7faa94053ce0 con 0x7faaa40cb930 2024-03-12T17:19:37.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.305+0000 7faaaac00640 1 -- 172.21.15.17:0/125585046 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faaa404e030 con 0x7faaa40cb930 2024-03-12T17:19:37.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.306+0000 7faaa1600640 1 -- 172.21.15.17:0/125585046 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7faa94017020 con 0x7faaa40cb930 2024-03-12T17:19:37.300 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-03-12T17:19:37.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.308+0000 7faaaac00640 1 -- 172.21.15.17:0/125585046 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faa8806ac00 msgr2=0x7faa8806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:37.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.308+0000 7faaaac00640 1 --2- 172.21.15.17:0/125585046 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faa8806ac00 0x7faa8806d0c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7faa9800d8b0 tx=0x7faa98008040 comp rx=0 tx=0).stop 2024-03-12T17:19:37.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.308+0000 7faaaac00640 1 -- 172.21.15.17:0/125585046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faaa40cb930 msgr2=0x7faaa413f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:37.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.308+0000 7faaaac00640 1 --2- 172.21.15.17:0/125585046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faaa40cb930 0x7faaa413f410 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7faa9400c500 tx=0x7faa9400c9c0 comp rx=0 tx=0).stop 2024-03-12T17:19:37.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.308+0000 7faaaac00640 1 -- 172.21.15.17:0/125585046 shutdown_connections 2024-03-12T17:19:37.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.308+0000 7faaaac00640 1 --2- 172.21.15.17:0/125585046 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faa8806ac00 0x7faa8806d0c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:37.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.308+0000 7faaaac00640 1 --2- 172.21.15.17:0/125585046 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faaa40cd850 0x7faaa40c9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:37.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.308+0000 7faaaac00640 1 --2- 172.21.15.17:0/125585046 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faaa40cb930 0x7faaa413f410 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:37.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.308+0000 7faaaac00640 1 --2- 172.21.15.17:0/125585046 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faaa40b23e0 0x7faaa40c5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:37.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.308+0000 7faaaac00640 1 -- 172.21.15.17:0/125585046 >> 172.21.15.17:0/125585046 conn(0x7faaa4069ce0 msgr2=0x7faaa406c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:37.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.309+0000 7faaaac00640 1 -- 172.21.15.17:0/125585046 shutdown_connections 2024-03-12T17:19:37.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.309+0000 7faaaac00640 1 -- 172.21.15.17:0/125585046 wait complete. 2024-03-12T17:19:37.322 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-12T17:19:37.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.552+0000 7f7273800640 1 Processor -- start 2024-03-12T17:19:37.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.552+0000 7f7273800640 1 -- start start 2024-03-12T17:19:37.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.553+0000 7f7273800640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f726c06bf10 0x7f726c15c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:37.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.553+0000 7f7273800640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f726c0d0710 con 0x7f726c0995a0 2024-03-12T17:19:37.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.553+0000 7f7273800640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f726c099980 con 0x7f726c06b100 2024-03-12T17:19:37.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.553+0000 7f7273800640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f726c0cf670 con 0x7f726c06bf10 2024-03-12T17:19:37.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.554+0000 7f7270e00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f726c0995a0 0x7f726c0ceb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:38532/0 (socket says 172.21.15.17:38532) 2024-03-12T17:19:37.548 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.554+0000 7f7270e00640 1 -- 172.21.15.17:0/495501717 learned_addr learned my addr 172.21.15.17:0/495501717 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:37.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.554+0000 7f726b400640 1 -- 172.21.15.17:0/495501717 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3411942263 0 0) 0x7f726c0d0710 con 0x7f726c0995a0 2024-03-12T17:19:37.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.554+0000 7f726b400640 1 -- 172.21.15.17:0/495501717 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7250003520 con 0x7f726c0995a0 2024-03-12T17:19:37.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.554+0000 7f7271800640 1 --2- 172.21.15.17:0/495501717 >> v2:172.21.15.94:3300/0 conn(0x7f726c06bf10 0x7f726c15c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:37.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.554+0000 7f726b400640 1 -- 172.21.15.17:0/495501717 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3958140595 0 0) 0x7f7250003520 con 0x7f726c0995a0 2024-03-12T17:19:37.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.554+0000 7f726b400640 1 -- 172.21.15.17:0/495501717 >> v2:172.21.15.94:3300/0 conn(0x7f726c06bf10 msgr2=0x7f726c15c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:37.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.554+0000 7f726b400640 1 --2- 172.21.15.17:0/495501717 >> v2:172.21.15.94:3300/0 conn(0x7f726c06bf10 0x7f726c15c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:37.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.554+0000 7f726b400640 1 -- 172.21.15.17:0/495501717 >> v1:172.21.15.94:6789/0 conn(0x7f726c06b100 legacy=0x7f726c06b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:37.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.554+0000 7f726b400640 1 -- 172.21.15.17:0/495501717 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726c0cf950 con 0x7f726c0995a0 2024-03-12T17:19:37.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.555+0000 7f726b400640 1 -- 172.21.15.17:0/495501717 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7f725c001670 con 0x7f726c0995a0 2024-03-12T17:19:37.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.555+0000 7f726b400640 1 -- 172.21.15.17:0/495501717 >> v1:172.21.15.17:6789/0 conn(0x7f726c0995a0 legacy=0x7f726c0ceb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:37.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.555+0000 7f726b400640 1 --2- 172.21.15.17:0/495501717 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7250003970 0x7f7250003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:37.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.555+0000 7f726b400640 1 --2- 172.21.15.17:0/495501717 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72500047c0 0x7f7250004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:37.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.555+0000 7f726b400640 1 --2- 172.21.15.17:0/495501717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7250005180 0x7f725000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:37.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.555+0000 7f726b400640 1 -- 172.21.15.17:0/495501717 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726c0cf670 con 0x7f7250005180 2024-03-12T17:19:37.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.555+0000 7f726b400640 1 -- 172.21.15.17:0/495501717 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725000c020 con 0x7f72500047c0 2024-03-12T17:19:37.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.555+0000 7f726b400640 1 -- 172.21.15.17:0/495501717 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f725000c1e0 con 0x7f7250003970 2024-03-12T17:19:37.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.555+0000 7f7271800640 1 --2- 172.21.15.17:0/495501717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7250005180 0x7f725000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:37.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.555+0000 7f726be00640 1 --2- 172.21.15.17:0/495501717 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72500047c0 0x7f7250004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:37.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.555+0000 7f7270e00640 1 --2- 172.21.15.17:0/495501717 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7250003970 0x7f7250003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:37.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.556+0000 7f7271800640 1 -- 172.21.15.17:0/495501717 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7250003970 msgr2=0x7f7250003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:37.551 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.556+0000 7f7271800640 1 --2- 172.21.15.17:0/495501717 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7250003970 0x7f7250003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:37.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.556+0000 7f7271800640 1 -- 172.21.15.17:0/495501717 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72500047c0 msgr2=0x7f7250004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:37.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.556+0000 7f7271800640 1 --2- 172.21.15.17:0/495501717 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72500047c0 0x7f7250004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:37.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.556+0000 7f7271800640 1 -- 172.21.15.17:0/495501717 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7250003520 con 0x7f7250005180 2024-03-12T17:19:37.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.556+0000 7f726be00640 1 --2- 172.21.15.17:0/495501717 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f72500047c0 0x7f7250004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:19:37.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.557+0000 7f7271800640 1 -- 172.21.15.17:0/495501717 reap_dead start 2024-03-12T17:19:37.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.557+0000 7f7271800640 1 --2- 172.21.15.17:0/495501717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7250005180 0x7f725000b980 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7264009f90 tx=0x7f72500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f07fc1a4e5093186 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:37.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.557+0000 7f726b400640 1 -- 172.21.15.17:0/495501717 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726402cc20 con 0x7f7250005180 2024-03-12T17:19:37.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.557+0000 7f726b400640 1 -- 172.21.15.17:0/495501717 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726400f040 con 0x7f7250005180 2024-03-12T17:19:37.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.557+0000 7f726b400640 1 -- 172.21.15.17:0/495501717 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7264034440 con 0x7f7250005180 2024-03-12T17:19:37.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.558+0000 7f7273800640 1 -- 172.21.15.17:0/495501717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7250005180 msgr2=0x7f725000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:37.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.558+0000 7f7273800640 1 --2- 172.21.15.17:0/495501717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7250005180 0x7f725000b980 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7264009f90 tx=0x7f72500057f0 comp rx=0 tx=0).stop 2024-03-12T17:19:37.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.558+0000 7f7273800640 1 -- 172.21.15.17:0/495501717 shutdown_connections 2024-03-12T17:19:37.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.558+0000 7f7273800640 1 --2- 172.21.15.17:0/495501717 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7250005180 0x7f725000b980 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:37.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.558+0000 7f7273800640 1 -- 172.21.15.17:0/495501717 >> 172.21.15.17:0/495501717 conn(0x7f726c0b2440 msgr2=0x7f726c0b2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:37.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.558+0000 7f7273800640 1 -- 172.21.15.17:0/495501717 shutdown_connections 2024-03-12T17:19:37.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.558+0000 7f7273800640 1 -- 172.21.15.17:0/495501717 wait complete. 2024-03-12T17:19:37.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.560+0000 7f7273800640 1 Processor -- start 2024-03-12T17:19:37.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.560+0000 7f7273800640 1 -- start start 2024-03-12T17:19:37.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.561+0000 7f7273800640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7250005180 0x7f726c09e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:37.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.561+0000 7f7273800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f726c0b5f30 0x7f726c0b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:37.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.561+0000 7f7273800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f726c0b3a20 0x7f726c15da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:37.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.561+0000 7f7273800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726c0b3ea0 con 0x7f726c0b3a20 2024-03-12T17:19:37.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.561+0000 7f7273800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726c0c5990 con 0x7f726c0b5f30 2024-03-12T17:19:37.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.561+0000 7f7273800640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f726c0b6390 con 0x7f7250005180 2024-03-12T17:19:37.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.561+0000 7f7271800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f726c0b3a20 0x7f726c15da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:37.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.561+0000 7f7271800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f726c0b3a20 0x7f726c15da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55218/0 (socket says 172.21.15.17:55218) 2024-03-12T17:19:37.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.561+0000 7f7271800640 1 -- 172.21.15.17:0/3648806626 learned_addr learned my addr 172.21.15.17:0/3648806626 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:37.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.561+0000 7f726be00640 1 --2- 172.21.15.17:0/3648806626 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f726c0b5f30 0x7f726c0b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:37.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.561+0000 7f7270e00640 1 --2- 172.21.15.17:0/3648806626 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7250005180 0x7f726c09e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:37.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.562+0000 7f7271800640 1 -- 172.21.15.17:0/3648806626 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7250005180 msgr2=0x7f726c09e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:37.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.562+0000 7f7271800640 1 --2- 172.21.15.17:0/3648806626 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7250005180 0x7f726c09e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:37.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.562+0000 7f7271800640 1 -- 172.21.15.17:0/3648806626 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f726c0b5f30 msgr2=0x7f726c0b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:37.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.562+0000 7f7271800640 1 --2- 172.21.15.17:0/3648806626 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f726c0b5f30 0x7f726c0b34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:37.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.562+0000 7f7271800640 1 -- 172.21.15.17:0/3648806626 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726c0c4d80 con 0x7f726c0b3a20 2024-03-12T17:19:37.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.562+0000 7f7271800640 1 --2- 172.21.15.17:0/3648806626 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f726c0b3a20 0x7f726c15da60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f726400e230 tx=0x7f7264009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:37.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.562+0000 7f7268c00640 1 -- 172.21.15.17:0/3648806626 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726402cea0 con 0x7f726c0b3a20 2024-03-12T17:19:37.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.562+0000 7f7268c00640 1 -- 172.21.15.17:0/3648806626 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726403d400 con 0x7f726c0b3a20 2024-03-12T17:19:37.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.562+0000 7f7268c00640 1 -- 172.21.15.17:0/3648806626 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726403d7b0 con 0x7f726c0b3a20 2024-03-12T17:19:37.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.562+0000 7f7273800640 1 -- 172.21.15.17:0/3648806626 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f726c0c5060 con 0x7f726c0b3a20 2024-03-12T17:19:37.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.563+0000 7f7273800640 1 -- 172.21.15.17:0/3648806626 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f726c0c5620 con 0x7f726c0b3a20 2024-03-12T17:19:37.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.564+0000 7f7273800640 1 -- 172.21.15.17:0/3648806626 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f726c0c5b40 con 0x7f726c0b3a20 2024-03-12T17:19:37.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.565+0000 7f7268c00640 1 -- 172.21.15.17:0/3648806626 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f726403b040 con 0x7f726c0b3a20 2024-03-12T17:19:37.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.566+0000 7f7268c00640 1 --2- 172.21.15.17:0/3648806626 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f724c06ac00 0x7f724c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:37.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.566+0000 7f7268c00640 1 -- 172.21.15.17:0/3648806626 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f72640aafd0 con 0x7f726c0b3a20 2024-03-12T17:19:37.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.566+0000 7f7270e00640 1 --2- 172.21.15.17:0/3648806626 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f724c06ac00 0x7f724c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:37.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.567+0000 7f7270e00640 1 --2- 172.21.15.17:0/3648806626 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f724c06ac00 0x7f724c06d0c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f725c005990 tx=0x7f725c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:37.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.571+0000 7f7268c00640 1 -- 172.21.15.17:0/3648806626 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f726c0c5b40 con 0x7f726c0b3a20 2024-03-12T17:19:37.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.781+0000 7f7273800640 1 -- 172.21.15.17:0/3648806626 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f726c0736c0 con 0x7f726c0b3a20 2024-03-12T17:19:37.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.782+0000 7f7268c00640 1 -- 172.21.15.17:0/3648806626 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7264039070 con 0x7f726c0b3a20 2024-03-12T17:19:37.776 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2024-03-12T17:19:37.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.784+0000 7f7273800640 1 -- 172.21.15.17:0/3648806626 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f724c06ac00 msgr2=0x7f724c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:37.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.784+0000 7f7273800640 1 --2- 172.21.15.17:0/3648806626 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f724c06ac00 0x7f724c06d0c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f725c005990 tx=0x7f725c009040 comp rx=0 tx=0).stop 2024-03-12T17:19:37.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.784+0000 7f7273800640 1 -- 172.21.15.17:0/3648806626 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f726c0b3a20 msgr2=0x7f726c15da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:37.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.784+0000 7f7273800640 1 --2- 172.21.15.17:0/3648806626 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f726c0b3a20 0x7f726c15da60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f726400e230 tx=0x7f7264009750 comp rx=0 tx=0).stop 2024-03-12T17:19:37.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.785+0000 7f7273800640 1 -- 172.21.15.17:0/3648806626 shutdown_connections 2024-03-12T17:19:37.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.785+0000 7f7273800640 1 --2- 172.21.15.17:0/3648806626 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f724c06ac00 0x7f724c06d0c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:37.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.785+0000 7f7273800640 1 --2- 172.21.15.17:0/3648806626 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f726c0b3a20 0x7f726c15da60 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:37.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.785+0000 7f7273800640 1 --2- 172.21.15.17:0/3648806626 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f726c0b5f30 0x7f726c0b34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:37.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.785+0000 7f7273800640 1 --2- 172.21.15.17:0/3648806626 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7250005180 0x7f726c09e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:37.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.785+0000 7f7273800640 1 -- 172.21.15.17:0/3648806626 >> 172.21.15.17:0/3648806626 conn(0x7f726c0b2440 msgr2=0x7f726c0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:37.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.785+0000 7f7273800640 1 -- 172.21.15.17:0/3648806626 shutdown_connections 2024-03-12T17:19:37.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:37.785+0000 7f7273800640 1 -- 172.21.15.17:0/3648806626 wait complete. 2024-03-12T17:19:37.798 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-03-12T17:19:37.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:37.798 DEBUG:teuthology.orchestra.run.smithi094:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-03-12T17:19:37.902 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi094.front.sepia.ceph.com 2024-03-12T17:19:37.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:19:37.902 DEBUG:teuthology.orchestra.run.smithi094:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-03-12T17:19:37.951 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-03-12T17:19:37.952 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-12T17:19:38.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.177+0000 7f71dd600640 1 Processor -- start 2024-03-12T17:19:38.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.177+0000 7f71dd600640 1 -- start start 2024-03-12T17:19:38.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.179+0000 7f71dd600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f71d80b1860 0x7f71d80b4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:38.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.179+0000 7f71dd600640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f71d8070240 0x7f71d80706a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:38.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.179+0000 7f71dd600640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d81461a0 con 0x7f71d8145dc0 2024-03-12T17:19:38.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.179+0000 7f71dd600640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71d80b2000 con 0x7f71d8070240 2024-03-12T17:19:38.173 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.179+0000 7f71dd600640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d80b3db0 con 0x7f71d80b1860 2024-03-12T17:19:38.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.180+0000 7f71dcc00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f71d8070240 0x7f71d80706a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:38.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.180+0000 7f71dcc00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f71d8070240 0x7f71d80706a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.17:57600/0 (socket says 172.21.15.17:57600) 2024-03-12T17:19:38.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.180+0000 7f71dcc00640 1 -- 172.21.15.17:0/774567963 learned_addr learned my addr 172.21.15.17:0/774567963 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:38.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.180+0000 7f71d7400640 1 --2- 172.21.15.17:0/774567963 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f71d80b1860 0x7f71d80b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:38.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.180+0000 7f71dcc00640 1 -- 172.21.15.17:0/774567963 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f71d80b1860 msgr2=0x7f71d80b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:38.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.180+0000 7f71dcc00640 1 --2- 172.21.15.17:0/774567963 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f71d80b1860 0x7f71d80b4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:38.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.180+0000 7f71dcc00640 1 -- 172.21.15.17:0/774567963 >> v1:172.21.15.94:6789/0 conn(0x7f71d8145dc0 legacy=0x7f71d8160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:38.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.180+0000 7f71dcc00640 1 -- 172.21.15.17:0/774567963 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d8070be0 con 0x7f71d8070240 2024-03-12T17:19:38.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.182+0000 7f71dcc00640 1 --2- 172.21.15.17:0/774567963 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71d8070240 0x7f71d80706a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f71d0009e50 tx=0x7f71d002bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bb3ea20b2d2059d server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:38.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.182+0000 7f71d6a00640 1 -- 172.21.15.17:0/774567963 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d002cb00 con 0x7f71d8070240 2024-03-12T17:19:38.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.182+0000 7f71d6a00640 1 -- 172.21.15.17:0/774567963 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d002cc60 con 0x7f71d8070240 2024-03-12T17:19:38.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.182+0000 7f71d6a00640 1 -- 172.21.15.17:0/774567963 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d00343f0 con 0x7f71d8070240 2024-03-12T17:19:38.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.183+0000 7f71dd600640 1 -- 172.21.15.17:0/774567963 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71d8070240 msgr2=0x7f71d80706a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:38.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.183+0000 7f71dd600640 1 --2- 172.21.15.17:0/774567963 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71d8070240 0x7f71d80706a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f71d0009e50 tx=0x7f71d002bf60 comp rx=0 tx=0).stop 2024-03-12T17:19:38.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.183+0000 7f71dd600640 1 -- 172.21.15.17:0/774567963 shutdown_connections 2024-03-12T17:19:38.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.183+0000 7f71dd600640 1 --2- 172.21.15.17:0/774567963 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71d8070240 0x7f71d80706a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:38.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.183+0000 7f71dd600640 1 --2- 172.21.15.17:0/774567963 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f71d80b1860 0x7f71d80b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:38.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.183+0000 7f71dd600640 1 -- 172.21.15.17:0/774567963 >> 172.21.15.17:0/774567963 conn(0x7f71d8069ce0 msgr2=0x7f71d806a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:38.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.183+0000 7f71dd600640 1 -- 172.21.15.17:0/774567963 shutdown_connections 2024-03-12T17:19:38.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.183+0000 7f71dd600640 1 -- 172.21.15.17:0/774567963 wait complete. 2024-03-12T17:19:38.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.185+0000 7f71dd600640 1 Processor -- start 2024-03-12T17:19:38.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.185+0000 7f71dd600640 1 -- start start 2024-03-12T17:19:38.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.186+0000 7f71dd600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f71d8070240 0x7f71d813dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:38.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.186+0000 7f71dd600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71d80b1860 0x7f71d813c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:38.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.186+0000 7f71dd600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71d8145dc0 0x7f71d813aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:38.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.186+0000 7f71dd600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d813cc20 con 0x7f71d8145dc0 2024-03-12T17:19:38.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.186+0000 7f71dd600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d813cf00 con 0x7f71d80b1860 2024-03-12T17:19:38.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.186+0000 7f71dd600640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d813d1e0 con 0x7f71d8070240 2024-03-12T17:19:38.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.187+0000 7f71dcc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71d8145dc0 0x7f71d813aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:38.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.187+0000 7f71dcc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71d8145dc0 0x7f71d813aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55228/0 (socket says 172.21.15.17:55228) 2024-03-12T17:19:38.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.187+0000 7f71dcc00640 1 -- 172.21.15.17:0/3722351385 learned_addr learned my addr 172.21.15.17:0/3722351385 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:38.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.187+0000 7f71d7400640 1 --2- 172.21.15.17:0/3722351385 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71d80b1860 0x7f71d813c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:38.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.187+0000 7f71d7e00640 1 --2- 172.21.15.17:0/3722351385 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f71d8070240 0x7f71d813dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:38.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.187+0000 7f71dcc00640 1 -- 172.21.15.17:0/3722351385 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f71d8070240 msgr2=0x7f71d813dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:38.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.187+0000 7f71dcc00640 1 --2- 172.21.15.17:0/3722351385 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f71d8070240 0x7f71d813dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:38.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.187+0000 7f71dcc00640 1 -- 172.21.15.17:0/3722351385 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71d80b1860 msgr2=0x7f71d813c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:38.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.187+0000 7f71dcc00640 1 --2- 172.21.15.17:0/3722351385 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71d80b1860 0x7f71d813c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:38.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.187+0000 7f71dcc00640 1 -- 172.21.15.17:0/3722351385 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d0009b30 con 0x7f71d8145dc0 2024-03-12T17:19:38.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.188+0000 7f71dcc00640 1 --2- 172.21.15.17:0/3722351385 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71d8145dc0 0x7f71d813aec0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f71d0009e50 tx=0x7f71d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:38.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.188+0000 7f71cfe00640 1 -- 172.21.15.17:0/3722351385 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d0009510 con 0x7f71d8145dc0 2024-03-12T17:19:38.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.188+0000 7f71cfe00640 1 -- 172.21.15.17:0/3722351385 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71d003e450 con 0x7f71d8145dc0 2024-03-12T17:19:38.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.188+0000 7f71cfe00640 1 -- 172.21.15.17:0/3722351385 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71d003e800 con 0x7f71d8145dc0 2024-03-12T17:19:38.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.188+0000 7f71dd600640 1 -- 172.21.15.17:0/3722351385 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71d813d4c0 con 0x7f71d8145dc0 2024-03-12T17:19:38.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.188+0000 7f71dd600640 1 -- 172.21.15.17:0/3722351385 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d813e200 con 0x7f71d8145dc0 2024-03-12T17:19:38.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.189+0000 7f71dd600640 1 -- 172.21.15.17:0/3722351385 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71d813e390 con 0x7f71d8145dc0 2024-03-12T17:19:38.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.190+0000 7f71cfe00640 1 -- 172.21.15.17:0/3722351385 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f71d003e960 con 0x7f71d8145dc0 2024-03-12T17:19:38.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.192+0000 7f71cfe00640 1 --2- 172.21.15.17:0/3722351385 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f71b806ac00 0x7f71b806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:38.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.192+0000 7f71cfe00640 1 -- 172.21.15.17:0/3722351385 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f71d00abfc0 con 0x7f71d8145dc0 2024-03-12T17:19:38.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.192+0000 7f71d7e00640 1 --2- 172.21.15.17:0/3722351385 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f71b806ac00 0x7f71b806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:38.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.193+0000 7f71d7e00640 1 --2- 172.21.15.17:0/3722351385 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f71b806ac00 0x7f71b806d0c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f71c8000f60 tx=0x7f71c8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:38.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.197+0000 7f71cfe00640 1 -- 172.21.15.17:0/3722351385 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f71d00df4f0 con 0x7f71d8145dc0 2024-03-12T17:19:38.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.436+0000 7f71dd600640 1 -- 172.21.15.17:0/3722351385 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71d813d980 con 0x7f71d8145dc0 2024-03-12T17:19:38.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.437+0000 7f71cfe00640 1 -- 172.21.15.17:0/3722351385 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4725 (secure 0 0 0) 0x7f71d00771d0 con 0x7f71d8145dc0 2024-03-12T17:19:38.432 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:19:38.432 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/4055209511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":4055209511},{"type":"v1","addr":"172.21.15.94:6833","nonce":4055209511}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4220,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/2079001512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2079001512},{"type":"v1","addr":"172.21.15.94:6835","nonce":2079001512}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6836/3710914262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3710914262},{"type":"v1","addr":"172.21.15.17:6836","nonce":3710914262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T17:18:45.842660+0000","modified":"2024-03-12T17:18:49.354081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6837/749237500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6835","nonce":749237500},{"type":"v1","addr":"172.21.15.17:6837","nonce":749237500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-12T17:19:38.432 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 7 2024-03-12T17:19:38.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.439+0000 7f71dd600640 1 -- 172.21.15.17:0/3722351385 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f71b806ac00 msgr2=0x7f71b806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:38.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.439+0000 7f71dd600640 1 --2- 172.21.15.17:0/3722351385 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f71b806ac00 0x7f71b806d0c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f71c8000f60 tx=0x7f71c8009040 comp rx=0 tx=0).stop 2024-03-12T17:19:38.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.439+0000 7f71dd600640 1 -- 172.21.15.17:0/3722351385 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71d8145dc0 msgr2=0x7f71d813aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:38.434 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.439+0000 7f71dd600640 1 --2- 172.21.15.17:0/3722351385 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71d8145dc0 0x7f71d813aec0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f71d0009e50 tx=0x7f71d0004a40 comp rx=0 tx=0).stop 2024-03-12T17:19:38.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.439+0000 7f71dd600640 1 -- 172.21.15.17:0/3722351385 shutdown_connections 2024-03-12T17:19:38.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.439+0000 7f71dd600640 1 --2- 172.21.15.17:0/3722351385 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f71b806ac00 0x7f71b806d0c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:38.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.439+0000 7f71dd600640 1 --2- 172.21.15.17:0/3722351385 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f71d8145dc0 0x7f71d813aec0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:38.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.439+0000 7f71dd600640 1 --2- 172.21.15.17:0/3722351385 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f71d80b1860 0x7f71d813c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:38.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.439+0000 7f71dd600640 1 --2- 172.21.15.17:0/3722351385 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f71d8070240 0x7f71d813dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:38.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.439+0000 7f71dd600640 1 -- 172.21.15.17:0/3722351385 >> 172.21.15.17:0/3722351385 conn(0x7f71d8069ce0 msgr2=0x7f71d815f120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:38.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.440+0000 7f71dd600640 1 -- 172.21.15.17:0/3722351385 shutdown_connections 2024-03-12T17:19:38.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.440+0000 7f71dd600640 1 -- 172.21.15.17:0/3722351385 wait complete. 2024-03-12T17:19:38.452 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T17:19:38.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.676+0000 7fbfb8800640 1 Processor -- start 2024-03-12T17:19:38.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.676+0000 7fbfb8800640 1 -- start start 2024-03-12T17:19:38.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.677+0000 7fbfb8800640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbfb0144240 0x7fbfb00ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:38.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.677+0000 7fbfb8800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbfb00cb970 0x7fbfb00cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:38.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.677+0000 7fbfb8800640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfb00ce320 con 0x7fbfb00cecf0 2024-03-12T17:19:38.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.677+0000 7fbfb8800640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfb00cc340 con 0x7fbfb00cb970 2024-03-12T17:19:38.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.677+0000 7fbfb8800640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb0144620 con 0x7fbfb0144240 2024-03-12T17:19:38.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.677+0000 7fbfb6800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbfb00cb970 0x7fbfb00cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:38.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.678+0000 7fbfb5400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fbfb00cecf0 0x7fbfb00b2070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:38538/0 (socket says 172.21.15.17:38538) 2024-03-12T17:19:38.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.678+0000 7fbfb5400640 1 -- 172.21.15.17:0/4226697100 learned_addr learned my addr 172.21.15.17:0/4226697100 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:38.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.678+0000 7fbfb5e00640 1 --2- 172.21.15.17:0/4226697100 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbfb0144240 0x7fbfb00ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:38.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.678+0000 7fbfb6800640 1 -- 172.21.15.17:0/4226697100 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbfb0144240 msgr2=0x7fbfb00ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:38.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.678+0000 7fbfb6800640 1 --2- 172.21.15.17:0/4226697100 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbfb0144240 0x7fbfb00ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:38.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.678+0000 7fbfb6800640 1 -- 172.21.15.17:0/4226697100 >> v1:172.21.15.17:6789/0 conn(0x7fbfb00cecf0 legacy=0x7fbfb00b2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:38.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.678+0000 7fbfb6800640 1 -- 172.21.15.17:0/4226697100 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb015f3d0 con 0x7fbfb00cb970 2024-03-12T17:19:38.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.679+0000 7fbfb6800640 1 --2- 172.21.15.17:0/4226697100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfb00cb970 0x7fbfb00cbe00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbfac009dc0 tx=0x7fbfac02be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74bd44d418f02145 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:38.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.680+0000 7fbfb4a00640 1 -- 172.21.15.17:0/4226697100 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfac02cc30 con 0x7fbfb00cb970 2024-03-12T17:19:38.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.680+0000 7fbfb4a00640 1 -- 172.21.15.17:0/4226697100 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfac02cd90 con 0x7fbfb00cb970 2024-03-12T17:19:38.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.680+0000 7fbfb4a00640 1 -- 172.21.15.17:0/4226697100 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfac034660 con 0x7fbfb00cb970 2024-03-12T17:19:38.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.680+0000 7fbfb8800640 1 -- 172.21.15.17:0/4226697100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfb00cb970 msgr2=0x7fbfb00cbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:38.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.680+0000 7fbfb8800640 1 --2- 172.21.15.17:0/4226697100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfb00cb970 0x7fbfb00cbe00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbfac009dc0 tx=0x7fbfac02be80 comp rx=0 tx=0).stop 2024-03-12T17:19:38.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.681+0000 7fbfb8800640 1 -- 172.21.15.17:0/4226697100 shutdown_connections 2024-03-12T17:19:38.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.681+0000 7fbfb8800640 1 --2- 172.21.15.17:0/4226697100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfb00cb970 0x7fbfb00cbe00 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:38.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.681+0000 7fbfb8800640 1 --2- 172.21.15.17:0/4226697100 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbfb0144240 0x7fbfb00ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:38.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.681+0000 7fbfb8800640 1 -- 172.21.15.17:0/4226697100 >> 172.21.15.17:0/4226697100 conn(0x7fbfb0069ce0 msgr2=0x7fbfb006a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:38.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.681+0000 7fbfb8800640 1 -- 172.21.15.17:0/4226697100 shutdown_connections 2024-03-12T17:19:38.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.681+0000 7fbfb8800640 1 -- 172.21.15.17:0/4226697100 wait complete. 2024-03-12T17:19:38.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.682+0000 7fbfb8800640 1 Processor -- start 2024-03-12T17:19:38.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.682+0000 7fbfb8800640 1 -- start start 2024-03-12T17:19:38.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.683+0000 7fbfb8800640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbfb00cb970 0x7fbfb00acf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:38.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.683+0000 7fbfb8800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfb00cecf0 0x7fbfb01edce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:38.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.683+0000 7fbfb8800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbfb0144240 0x7fbfb0159e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:38.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.683+0000 7fbfb8800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb01ee220 con 0x7fbfb00cecf0 2024-03-12T17:19:38.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.683+0000 7fbfb8800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb013f910 con 0x7fbfb0144240 2024-03-12T17:19:38.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.683+0000 7fbfb8800640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb015d860 con 0x7fbfb00cb970 2024-03-12T17:19:38.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.684+0000 7fbfb5400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfb00cecf0 0x7fbfb01edce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:38.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.684+0000 7fbfb5400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfb00cecf0 0x7fbfb01edce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55254/0 (socket says 172.21.15.17:55254) 2024-03-12T17:19:38.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.684+0000 7fbfb5400640 1 -- 172.21.15.17:0/1322112249 learned_addr learned my addr 172.21.15.17:0/1322112249 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:38.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.684+0000 7fbfb5e00640 1 --2- 172.21.15.17:0/1322112249 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbfb00cb970 0x7fbfb00acf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:38.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.684+0000 7fbfb6800640 1 --2- 172.21.15.17:0/1322112249 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbfb0144240 0x7fbfb0159e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:38.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.684+0000 7fbfb5400640 1 -- 172.21.15.17:0/1322112249 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbfb00cb970 msgr2=0x7fbfb00acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:38.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.684+0000 7fbfb5400640 1 --2- 172.21.15.17:0/1322112249 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbfb00cb970 0x7fbfb00acf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:38.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.684+0000 7fbfb5400640 1 -- 172.21.15.17:0/1322112249 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbfb0144240 msgr2=0x7fbfb0159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:38.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.684+0000 7fbfb5400640 1 --2- 172.21.15.17:0/1322112249 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbfb0144240 0x7fbfb0159e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:38.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.684+0000 7fbfb5400640 1 -- 172.21.15.17:0/1322112249 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfac009a70 con 0x7fbfb00cecf0 2024-03-12T17:19:38.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.684+0000 7fbfb6800640 1 --2- 172.21.15.17:0/1322112249 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbfb0144240 0x7fbfb0159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:19:38.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.684+0000 7fbfb5400640 1 --2- 172.21.15.17:0/1322112249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfb00cecf0 0x7fbfb01edce0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbfa000c4a0 tx=0x7fbfa000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:38.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.685+0000 7fbfaa000640 1 -- 172.21.15.17:0/1322112249 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0005ce0 con 0x7fbfb00cecf0 2024-03-12T17:19:38.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.685+0000 7fbfaa000640 1 -- 172.21.15.17:0/1322112249 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa0005e40 con 0x7fbfb00cecf0 2024-03-12T17:19:38.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.685+0000 7fbfaa000640 1 -- 172.21.15.17:0/1322112249 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa0007270 con 0x7fbfb00cecf0 2024-03-12T17:19:38.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.685+0000 7fbfb8800640 1 -- 172.21.15.17:0/1322112249 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfb013fb60 con 0x7fbfb00cecf0 2024-03-12T17:19:38.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.685+0000 7fbfb8800640 1 -- 172.21.15.17:0/1322112249 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfb0140120 con 0x7fbfb00cecf0 2024-03-12T17:19:38.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.686+0000 7fbfb8800640 1 -- 172.21.15.17:0/1322112249 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfb0140310 con 0x7fbfb00cecf0 2024-03-12T17:19:38.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.687+0000 7fbfaa000640 1 -- 172.21.15.17:0/1322112249 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fbfa0007490 con 0x7fbfb00cecf0 2024-03-12T17:19:38.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.688+0000 7fbfaa000640 1 --2- 172.21.15.17:0/1322112249 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fbf9406ac00 0x7fbf9406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:38.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.688+0000 7fbfaa000640 1 -- 172.21.15.17:0/1322112249 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fbfa0088920 con 0x7fbfb00cecf0 2024-03-12T17:19:38.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.688+0000 7fbfb5e00640 1 --2- 172.21.15.17:0/1322112249 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fbf9406ac00 0x7fbf9406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:38.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.688+0000 7fbfb5e00640 1 --2- 172.21.15.17:0/1322112249 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fbf9406ac00 0x7fbf9406d0c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4009aa0 tx=0x7fbfa4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:38.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.692+0000 7fbfaa000640 1 -- 172.21.15.17:0/1322112249 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fbfa0053a90 con 0x7fbfb00cecf0 2024-03-12T17:19:38.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.883+0000 7fbfb8800640 1 -- 172.21.15.17:0/1322112249 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbfb00736c0 con 0x7fbfb00cecf0 2024-03-12T17:19:38.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.885+0000 7fbfaa000640 1 -- 172.21.15.17:0/1322112249 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16238 (secure 0 0 0) 0x7fbfa0017020 con 0x7fbfb00cecf0 2024-03-12T17:19:38.880 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:19:38.880 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":23,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:19:33.387374+0000","last_up_change":"2024-03-12T17:18:38.144756+0000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-12T17:18:39.552910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-12T17:18:43.794908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-12T17:18:44.867006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":37305},{"type":"v1","addr":"172.21.15.17:6801","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":37305},{"type":"v1","addr":"172.21.15.17:6803","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":37305},{"type":"v1","addr":"172.21.15.17:6807","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":37305},{"type":"v1","addr":"172.21.15.17:6805","nonce":37305}]},"public_addr":"172.21.15.17:6801/37305","cluster_addr":"172.21.15.17:6803/37305","heartbeat_back_addr":"172.21.15.17:6807/37305","heartbeat_front_addr":"172.21.15.17:6805/37305","state":["exists","up"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":37307},{"type":"v1","addr":"172.21.15.17:6814","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":37307},{"type":"v1","addr":"172.21.15.17:6818","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":37307},{"type":"v1","addr":"172.21.15.17:6827","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":37307},{"type":"v1","addr":"172.21.15.17:6823","nonce":37307}]},"public_addr":"172.21.15.17:6814/37307","cluster_addr":"172.21.15.17:6818/37307","heartbeat_back_addr":"172.21.15.17:6827/37307","heartbeat_front_addr":"172.21.15.17:6823/37307","state":["exists","up"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":37303},{"type":"v1","addr":"172.21.15.17:6809","nonce":37303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":37303},{"type":"v1","addr":"172.21.15.17:6811","nonce":37303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":37303},{"type":"v1","addr":"172.21.15.17:6819","nonce":37303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":37303},{"type":"v1","addr":"172.21.15.17:6815","nonce":37303}]},"public_addr":"172.21.15.17:6809/37303","cluster_addr":"172.21.15.17:6811/37303","heartbeat_back_addr":"172.21.15.17:6819/37303","heartbeat_front_addr":"172.21.15.17:6815/37303","state":["exists","up"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":37308},{"type":"v1","addr":"172.21.15.17:6822","nonce":37308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":37308},{"type":"v1","addr":"172.21.15.17:6826","nonce":37308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":37308},{"type":"v1","addr":"172.21.15.17:6831","nonce":37308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":37308},{"type":"v1","addr":"172.21.15.17:6829","nonce":37308}]},"public_addr":"172.21.15.17:6822/37308","cluster_addr":"172.21.15.17:6826/37308","heartbeat_back_addr":"172.21.15.17:6831/37308","heartbeat_front_addr":"172.21.15.17:6829/37308","state":["exists","up"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":37465},{"type":"v1","addr":"172.21.15.94:6809","nonce":37465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6811","nonce":37465},{"type":"v1","addr":"172.21.15.94:6813","nonce":37465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6819","nonce":37465},{"type":"v1","addr":"172.21.15.94:6822","nonce":37465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6815","nonce":37465},{"type":"v1","addr":"172.21.15.94:6817","nonce":37465}]},"public_addr":"172.21.15.94:6809/37465","cluster_addr":"172.21.15.94:6813/37465","heartbeat_back_addr":"172.21.15.94:6822/37465","heartbeat_front_addr":"172.21.15.94:6817/37465","state":["exists","up"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":37464},{"type":"v1","addr":"172.21.15.94:6812","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":37464},{"type":"v1","addr":"172.21.15.94:6816","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":37464},{"type":"v1","addr":"172.21.15.94:6823","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":37464},{"type":"v1","addr":"172.21.15.94:6820","nonce":37464}]},"public_addr":"172.21.15.94:6812/37464","cluster_addr":"172.21.15.94:6816/37464","heartbeat_back_addr":"172.21.15.94:6823/37464","heartbeat_front_addr":"172.21.15.94:6820/37464","state":["exists","up"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":37467},{"type":"v1","addr":"172.21.15.94:6825","nonce":37467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":37467},{"type":"v1","addr":"172.21.15.94:6827","nonce":37467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":37467},{"type":"v1","addr":"172.21.15.94:6831","nonce":37467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":37467},{"type":"v1","addr":"172.21.15.94:6829","nonce":37467}]},"public_addr":"172.21.15.94:6825/37467","cluster_addr":"172.21.15.94:6827/37467","heartbeat_back_addr":"172.21.15.94:6831/37467","heartbeat_front_addr":"172.21.15.94:6829/37467","state":["exists","up"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":37466},{"type":"v1","addr":"172.21.15.94:6801","nonce":37466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":37466},{"type":"v1","addr":"172.21.15.94:6803","nonce":37466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":37466},{"type":"v1","addr":"172.21.15.94:6807","nonce":37466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":37466},{"type":"v1","addr":"172.21.15.94:6805","nonce":37466}]},"public_addr":"172.21.15.94:6801/37466","cluster_addr":"172.21.15.94:6803/37466","heartbeat_back_addr":"172.21.15.94:6807/37466","heartbeat_front_addr":"172.21.15.94:6805/37466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.327217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.186966+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.419986+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.150585+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.120621+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.121576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.181257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.293188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:19:38.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.888+0000 7fbfb8800640 1 -- 172.21.15.17:0/1322112249 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fbf9406ac00 msgr2=0x7fbf9406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:38.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.888+0000 7fbfb8800640 1 --2- 172.21.15.17:0/1322112249 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fbf9406ac00 0x7fbf9406d0c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbfa4009aa0 tx=0x7fbfa4009190 comp rx=0 tx=0).stop 2024-03-12T17:19:38.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.888+0000 7fbfb8800640 1 -- 172.21.15.17:0/1322112249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfb00cecf0 msgr2=0x7fbfb01edce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:38.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.888+0000 7fbfb8800640 1 --2- 172.21.15.17:0/1322112249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfb00cecf0 0x7fbfb01edce0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbfa000c4a0 tx=0x7fbfa000c960 comp rx=0 tx=0).stop 2024-03-12T17:19:38.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.888+0000 7fbfb8800640 1 -- 172.21.15.17:0/1322112249 shutdown_connections 2024-03-12T17:19:38.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.888+0000 7fbfb8800640 1 --2- 172.21.15.17:0/1322112249 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fbf9406ac00 0x7fbf9406d0c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:38.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.888+0000 7fbfb8800640 1 --2- 172.21.15.17:0/1322112249 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbfb0144240 0x7fbfb0159e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:38.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.888+0000 7fbfb8800640 1 --2- 172.21.15.17:0/1322112249 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbfb00cecf0 0x7fbfb01edce0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:38.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.888+0000 7fbfb8800640 1 --2- 172.21.15.17:0/1322112249 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbfb00cb970 0x7fbfb00acf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:38.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.888+0000 7fbfb8800640 1 -- 172.21.15.17:0/1322112249 >> 172.21.15.17:0/1322112249 conn(0x7fbfb0069ce0 msgr2=0x7fbfb00aee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:38.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.889+0000 7fbfb8800640 1 -- 172.21.15.17:0/1322112249 shutdown_connections 2024-03-12T17:19:38.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:38.889+0000 7fbfb8800640 1 -- 172.21.15.17:0/1322112249 wait complete. 2024-03-12T17:19:38.902 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-12T17:18:39.552910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-12T17:18:43.794908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-12T17:18:44.867006+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-12T17:19:38.902 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-12T17:19:39.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.129+0000 7f844aa00640 1 Processor -- start 2024-03-12T17:19:39.123 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.129+0000 7f844aa00640 1 -- start start 2024-03-12T17:19:39.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.131+0000 7f844aa00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f84441442b0 0x7f8444071820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:39.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.131+0000 7f844aa00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f844406a3f0 0x7f84440af530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:39.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.131+0000 7f844aa00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84440cc060 con 0x7f84440b08e0 2024-03-12T17:19:39.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.131+0000 7f844aa00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84440b0e50 con 0x7f84441442b0 2024-03-12T17:19:39.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.131+0000 7f844aa00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84440aea50 con 0x7f844406a3f0 2024-03-12T17:19:39.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.131+0000 7f8448c00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f84440b08e0 0x7f8444069ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:38548/0 (socket says 172.21.15.17:38548) 2024-03-12T17:19:39.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.131+0000 7f8448c00640 1 -- 172.21.15.17:0/3480449483 learned_addr learned my addr 172.21.15.17:0/3480449483 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:39.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.131+0000 7f844a000640 1 --2- 172.21.15.17:0/3480449483 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f844406a3f0 0x7f84440af530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:39.126 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.131+0000 7f8449600640 1 --2- 172.21.15.17:0/3480449483 >> v2:172.21.15.94:3300/0 conn(0x7f84441442b0 0x7f8444071820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:39.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.132+0000 7f8443e00640 1 -- 172.21.15.17:0/3480449483 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4042324390 0 0) 0x7f84440cc060 con 0x7f84440b08e0 2024-03-12T17:19:39.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.132+0000 7f8443e00640 1 -- 172.21.15.17:0/3480449483 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f842c003520 con 0x7f84440b08e0 2024-03-12T17:19:39.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.132+0000 7f844a000640 1 -- 172.21.15.17:0/3480449483 >> v2:172.21.15.94:3300/0 conn(0x7f84441442b0 msgr2=0x7f8444071820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:39.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.132+0000 7f844a000640 1 --2- 172.21.15.17:0/3480449483 >> v2:172.21.15.94:3300/0 conn(0x7f84441442b0 0x7f8444071820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:39.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.132+0000 7f844a000640 1 -- 172.21.15.17:0/3480449483 >> v1:172.21.15.17:6789/0 conn(0x7f84440b08e0 legacy=0x7f8444069ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:39.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.132+0000 7f844a000640 1 -- 172.21.15.17:0/3480449483 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84440aed30 con 0x7f844406a3f0 2024-03-12T17:19:39.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.134+0000 7f844a000640 1 --2- 172.21.15.17:0/3480449483 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f844406a3f0 0x7f84440af530 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f843c009d90 tx=0x7f843c02bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3887c20bcfc907b server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:39.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.134+0000 7f8443e00640 1 -- 172.21.15.17:0/3480449483 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843c02cc50 con 0x7f844406a3f0 2024-03-12T17:19:39.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.134+0000 7f8443e00640 1 -- 172.21.15.17:0/3480449483 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f843c02cdb0 con 0x7f844406a3f0 2024-03-12T17:19:39.128 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.134+0000 7f8443e00640 1 -- 172.21.15.17:0/3480449483 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843c034640 con 0x7f844406a3f0 2024-03-12T17:19:39.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.135+0000 7f844aa00640 1 -- 172.21.15.17:0/3480449483 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f844406a3f0 msgr2=0x7f84440af530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:39.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.135+0000 7f844aa00640 1 --2- 172.21.15.17:0/3480449483 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f844406a3f0 0x7f84440af530 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f843c009d90 tx=0x7f843c02bea0 comp rx=0 tx=0).stop 2024-03-12T17:19:39.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.135+0000 7f844aa00640 1 -- 172.21.15.17:0/3480449483 shutdown_connections 2024-03-12T17:19:39.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.135+0000 7f844aa00640 1 --2- 172.21.15.17:0/3480449483 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f844406a3f0 0x7f84440af530 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:39.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.135+0000 7f844aa00640 1 --2- 172.21.15.17:0/3480449483 >> v2:172.21.15.94:3300/0 conn(0x7f84441442b0 0x7f8444071820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:39.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.135+0000 7f844aa00640 1 -- 172.21.15.17:0/3480449483 >> 172.21.15.17:0/3480449483 conn(0x7f84440b4ca0 msgr2=0x7f8444098a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:39.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.135+0000 7f844aa00640 1 -- 172.21.15.17:0/3480449483 shutdown_connections 2024-03-12T17:19:39.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.135+0000 7f844aa00640 1 -- 172.21.15.17:0/3480449483 wait complete. 2024-03-12T17:19:39.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.137+0000 7f844aa00640 1 Processor -- start 2024-03-12T17:19:39.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.137+0000 7f844aa00640 1 -- start start 2024-03-12T17:19:39.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.138+0000 7f844aa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f844406a3f0 0x7f84441e3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:39.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.138+0000 7f844aa00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84440b08e0 0x7f844415c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:39.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.138+0000 7f844aa00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f84441442b0 0x7f84441e4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:39.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.138+0000 7f844aa00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84441e4eb0 con 0x7f844406a3f0 2024-03-12T17:19:39.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.138+0000 7f844aa00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84441e5190 con 0x7f84440b08e0 2024-03-12T17:19:39.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.138+0000 7f844aa00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84441e3330 con 0x7f84441442b0 2024-03-12T17:19:39.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.138+0000 7f8449600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f844406a3f0 0x7f84441e3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:39.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.138+0000 7f8449600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f844406a3f0 0x7f84441e3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55256/0 (socket says 172.21.15.17:55256) 2024-03-12T17:19:39.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.138+0000 7f8449600640 1 -- 172.21.15.17:0/3546938595 learned_addr learned my addr 172.21.15.17:0/3546938595 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:39.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.138+0000 7f8448c00640 1 --2- 172.21.15.17:0/3546938595 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84440b08e0 0x7f844415c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:39.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.138+0000 7f844a000640 1 --2- 172.21.15.17:0/3546938595 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f84441442b0 0x7f84441e4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:39.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.139+0000 7f8449600640 1 -- 172.21.15.17:0/3546938595 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f84441442b0 msgr2=0x7f84441e4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:39.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.139+0000 7f8449600640 1 --2- 172.21.15.17:0/3546938595 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f84441442b0 0x7f84441e4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:39.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.139+0000 7f8449600640 1 -- 172.21.15.17:0/3546938595 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84440b08e0 msgr2=0x7f844415c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:39.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.139+0000 7f8449600640 1 --2- 172.21.15.17:0/3546938595 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84440b08e0 0x7f844415c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:39.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.139+0000 7f8449600640 1 -- 172.21.15.17:0/3546938595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843c009a70 con 0x7f844406a3f0 2024-03-12T17:19:39.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.139+0000 7f8449600640 1 --2- 172.21.15.17:0/3546938595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f844406a3f0 0x7f84441e3b30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f843800e870 tx=0x7f843800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:39.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.139+0000 7f8441600640 1 -- 172.21.15.17:0/3546938595 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84380094f0 con 0x7f844406a3f0 2024-03-12T17:19:39.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.139+0000 7f8441600640 1 -- 172.21.15.17:0/3546938595 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f843800c940 con 0x7f844406a3f0 2024-03-12T17:19:39.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.139+0000 7f8441600640 1 -- 172.21.15.17:0/3546938595 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843800ccf0 con 0x7f844406a3f0 2024-03-12T17:19:39.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.139+0000 7f844aa00640 1 -- 172.21.15.17:0/3546938595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84441e3610 con 0x7f844406a3f0 2024-03-12T17:19:39.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.139+0000 7f844aa00640 1 -- 172.21.15.17:0/3546938595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f844415cb70 con 0x7f844406a3f0 2024-03-12T17:19:39.135 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.141+0000 7f844aa00640 1 -- 172.21.15.17:0/3546938595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84441e53b0 con 0x7f844406a3f0 2024-03-12T17:19:39.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.141+0000 7f8441600640 1 -- 172.21.15.17:0/3546938595 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f8438013470 con 0x7f844406a3f0 2024-03-12T17:19:39.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.142+0000 7f8441600640 1 --2- 172.21.15.17:0/3546938595 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f842406ac30 0x7f842406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:39.136 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.142+0000 7f8441600640 1 -- 172.21.15.17:0/3546938595 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f84380894e0 con 0x7f844406a3f0 2024-03-12T17:19:39.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.143+0000 7f8448c00640 1 --2- 172.21.15.17:0/3546938595 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f842406ac30 0x7f842406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:39.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.143+0000 7f8448c00640 1 --2- 172.21.15.17:0/3546938595 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f842406ac30 0x7f842406d0f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f84440b2210 tx=0x7f8430009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:39.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.147+0000 7f8441600640 1 -- 172.21.15.17:0/3546938595 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f84380545c0 con 0x7f844406a3f0 2024-03-12T17:19:39.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.345+0000 7f844aa00640 1 -- 172.21.15.17:0/3546938595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f844404e030 con 0x7f844406a3f0 2024-03-12T17:19:39.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.346+0000 7f8441600640 1 -- 172.21.15.17:0/3546938595 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8438057be0 con 0x7f844406a3f0 2024-03-12T17:19:39.340 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-03-12T17:19:39.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.349+0000 7f844aa00640 1 -- 172.21.15.17:0/3546938595 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f842406ac30 msgr2=0x7f842406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:39.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.349+0000 7f844aa00640 1 --2- 172.21.15.17:0/3546938595 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f842406ac30 0x7f842406d0f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f84440b2210 tx=0x7f8430009040 comp rx=0 tx=0).stop 2024-03-12T17:19:39.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.349+0000 7f844aa00640 1 -- 172.21.15.17:0/3546938595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f844406a3f0 msgr2=0x7f84441e3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:39.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.349+0000 7f844aa00640 1 --2- 172.21.15.17:0/3546938595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f844406a3f0 0x7f84441e3b30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f843800e870 tx=0x7f843800ed30 comp rx=0 tx=0).stop 2024-03-12T17:19:39.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.349+0000 7f844aa00640 1 -- 172.21.15.17:0/3546938595 shutdown_connections 2024-03-12T17:19:39.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.349+0000 7f844aa00640 1 --2- 172.21.15.17:0/3546938595 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f842406ac30 0x7f842406d0f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:39.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.349+0000 7f844aa00640 1 --2- 172.21.15.17:0/3546938595 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f84441442b0 0x7f84441e4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:39.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.349+0000 7f844aa00640 1 --2- 172.21.15.17:0/3546938595 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f84440b08e0 0x7f844415c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:39.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.349+0000 7f844aa00640 1 --2- 172.21.15.17:0/3546938595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f844406a3f0 0x7f84441e3b30 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:39.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.349+0000 7f844aa00640 1 -- 172.21.15.17:0/3546938595 >> 172.21.15.17:0/3546938595 conn(0x7f84440b4ca0 msgr2=0x7f844415dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:39.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.349+0000 7f844aa00640 1 -- 172.21.15.17:0/3546938595 shutdown_connections 2024-03-12T17:19:39.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.349+0000 7f844aa00640 1 -- 172.21.15.17:0/3546938595 wait complete. 2024-03-12T17:19:39.365 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-12T17:19:39.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.587+0000 7f5ba7000640 1 Processor -- start 2024-03-12T17:19:39.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.588+0000 7f5ba7000640 1 -- start start 2024-03-12T17:19:39.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.589+0000 7f5ba7000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5ba0160090 0x7f5ba006b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:39.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.589+0000 7f5ba7000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f5ba00b4b20 0x7f5ba00d1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:39.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.589+0000 7f5ba7000640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ba0160470 con 0x7f5ba00b86c0 2024-03-12T17:19:39.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.589+0000 7f5ba7000640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ba00d0e40 con 0x7f5ba00b4b20 2024-03-12T17:19:39.583 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.589+0000 7f5ba7000640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba00d0a80 con 0x7f5ba0160090 2024-03-12T17:19:39.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.589+0000 7f5ba5200640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f5ba00b86c0 0x7f5ba00b4410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:38564/0 (socket says 172.21.15.17:38564) 2024-03-12T17:19:39.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.589+0000 7f5ba5200640 1 -- 172.21.15.17:0/1348962503 learned_addr learned my addr 172.21.15.17:0/1348962503 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:39.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.589+0000 7f5ba6600640 1 --2- 172.21.15.17:0/1348962503 >> v2:172.21.15.17:3300/0 conn(0x7f5ba00b4b20 0x7f5ba00d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:39.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.589+0000 7f5ba5c00640 1 --2- 172.21.15.17:0/1348962503 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5ba0160090 0x7f5ba006b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:39.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.590+0000 7f5ba6600640 1 -- 172.21.15.17:0/1348962503 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5ba0160090 msgr2=0x7f5ba006b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:39.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.590+0000 7f5ba6600640 1 --2- 172.21.15.17:0/1348962503 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5ba0160090 0x7f5ba006b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:39.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.590+0000 7f5ba6600640 1 -- 172.21.15.17:0/1348962503 >> v1:172.21.15.17:6789/0 conn(0x7f5ba00b86c0 legacy=0x7f5ba00b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:39.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.590+0000 7f5ba6600640 1 -- 172.21.15.17:0/1348962503 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba006baa0 con 0x7f5ba00b4b20 2024-03-12T17:19:39.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.591+0000 7f5ba6600640 1 --2- 172.21.15.17:0/1348962503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba00b4b20 0x7f5ba00d1260 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5b980097a0 tx=0x7f5b9802b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0cdc1bf65a2c8ff server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:39.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.591+0000 7f5b9fe00640 1 -- 172.21.15.17:0/1348962503 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b98031780 con 0x7f5ba00b4b20 2024-03-12T17:19:39.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.591+0000 7f5b9fe00640 1 -- 172.21.15.17:0/1348962503 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b980318e0 con 0x7f5ba00b4b20 2024-03-12T17:19:39.585 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.591+0000 7f5b9fe00640 1 -- 172.21.15.17:0/1348962503 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b98031c70 con 0x7f5ba00b4b20 2024-03-12T17:19:39.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.592+0000 7f5ba7000640 1 -- 172.21.15.17:0/1348962503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba00b4b20 msgr2=0x7f5ba00d1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:39.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.592+0000 7f5ba7000640 1 --2- 172.21.15.17:0/1348962503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba00b4b20 0x7f5ba00d1260 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5b980097a0 tx=0x7f5b9802b820 comp rx=0 tx=0).stop 2024-03-12T17:19:39.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.592+0000 7f5ba7000640 1 -- 172.21.15.17:0/1348962503 shutdown_connections 2024-03-12T17:19:39.586 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.592+0000 7f5ba7000640 1 --2- 172.21.15.17:0/1348962503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba00b4b20 0x7f5ba00d1260 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:39.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.592+0000 7f5ba7000640 1 --2- 172.21.15.17:0/1348962503 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5ba0160090 0x7f5ba006b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:39.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.592+0000 7f5ba7000640 1 -- 172.21.15.17:0/1348962503 >> 172.21.15.17:0/1348962503 conn(0x7f5ba00cf5f0 msgr2=0x7f5ba00cfa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:39.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.592+0000 7f5ba7000640 1 -- 172.21.15.17:0/1348962503 shutdown_connections 2024-03-12T17:19:39.587 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.592+0000 7f5ba7000640 1 -- 172.21.15.17:0/1348962503 wait complete. 2024-03-12T17:19:39.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.594+0000 7f5ba7000640 1 Processor -- start 2024-03-12T17:19:39.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.594+0000 7f5ba7000640 1 -- start start 2024-03-12T17:19:39.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.595+0000 7f5ba7000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba00b4b20 0x7f5ba015a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:39.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.595+0000 7f5ba7000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ba00b86c0 0x7f5ba00a9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:39.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.595+0000 7f5ba7000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5ba0160090 0x7f5ba00a9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:39.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.595+0000 7f5ba7000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba00caeb0 con 0x7f5ba00b4b20 2024-03-12T17:19:39.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.595+0000 7f5ba7000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba00a98d0 con 0x7f5ba00b86c0 2024-03-12T17:19:39.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.595+0000 7f5ba7000640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba00aa450 con 0x7f5ba0160090 2024-03-12T17:19:39.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.595+0000 7f5ba5c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba00b4b20 0x7f5ba015a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:39.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.595+0000 7f5ba5c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba00b4b20 0x7f5ba015a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55284/0 (socket says 172.21.15.17:55284) 2024-03-12T17:19:39.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.595+0000 7f5ba5c00640 1 -- 172.21.15.17:0/1931256983 learned_addr learned my addr 172.21.15.17:0/1931256983 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:39.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.595+0000 7f5ba5200640 1 --2- 172.21.15.17:0/1931256983 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ba00b86c0 0x7f5ba00a9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:39.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.596+0000 7f5ba6600640 1 --2- 172.21.15.17:0/1931256983 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5ba0160090 0x7f5ba00a9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:39.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.596+0000 7f5ba5c00640 1 -- 172.21.15.17:0/1931256983 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5ba0160090 msgr2=0x7f5ba00a9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:39.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.596+0000 7f5ba5c00640 1 --2- 172.21.15.17:0/1931256983 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5ba0160090 0x7f5ba00a9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:39.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.596+0000 7f5ba5c00640 1 -- 172.21.15.17:0/1931256983 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ba00b86c0 msgr2=0x7f5ba00a9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:39.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.596+0000 7f5ba5c00640 1 --2- 172.21.15.17:0/1931256983 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ba00b86c0 0x7f5ba00a9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:39.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.596+0000 7f5ba5c00640 1 -- 172.21.15.17:0/1931256983 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b98009400 con 0x7f5ba00b4b20 2024-03-12T17:19:39.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.596+0000 7f5ba5c00640 1 --2- 172.21.15.17:0/1931256983 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba00b4b20 0x7f5ba015a1c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5b94007ef0 tx=0x7f5b9400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:39.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.596+0000 7f5b9d600640 1 -- 172.21.15.17:0/1931256983 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b94014620 con 0x7f5ba00b4b20 2024-03-12T17:19:39.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.596+0000 7f5b9d600640 1 -- 172.21.15.17:0/1931256983 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b94014780 con 0x7f5ba00b4b20 2024-03-12T17:19:39.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.596+0000 7f5ba7000640 1 -- 172.21.15.17:0/1931256983 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ba00a9ac0 con 0x7f5ba00b4b20 2024-03-12T17:19:39.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.596+0000 7f5b9d600640 1 -- 172.21.15.17:0/1931256983 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b94014b30 con 0x7f5ba00b4b20 2024-03-12T17:19:39.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.597+0000 7f5ba7000640 1 -- 172.21.15.17:0/1931256983 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ba00ca7f0 con 0x7f5ba00b4b20 2024-03-12T17:19:39.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.598+0000 7f5ba7000640 1 -- 172.21.15.17:0/1931256983 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ba0067120 con 0x7f5ba00b4b20 2024-03-12T17:19:39.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.599+0000 7f5b9d600640 1 -- 172.21.15.17:0/1931256983 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f5b94014c90 con 0x7f5ba00b4b20 2024-03-12T17:19:39.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.600+0000 7f5b9d600640 1 --2- 172.21.15.17:0/1931256983 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f5b8006ac00 0x7f5b8006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:39.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.600+0000 7f5b9d600640 1 -- 172.21.15.17:0/1931256983 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5b94089da0 con 0x7f5ba00b4b20 2024-03-12T17:19:39.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.600+0000 7f5ba5200640 1 --2- 172.21.15.17:0/1931256983 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f5b8006ac00 0x7f5b8006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:39.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.601+0000 7f5ba5200640 1 --2- 172.21.15.17:0/1931256983 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f5b8006ac00 0x7f5b8006d0c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5ba00cd0b0 tx=0x7f5b8c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:39.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.604+0000 7f5b9d600640 1 -- 172.21.15.17:0/1931256983 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f5b94054f90 con 0x7f5ba00b4b20 2024-03-12T17:19:39.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.807+0000 7f5ba7000640 1 -- 172.21.15.17:0/1931256983 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5ba0072360 con 0x7f5ba00b4b20 2024-03-12T17:19:39.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.808+0000 7f5b9d600640 1 -- 172.21.15.17:0/1931256983 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5b940585b0 con 0x7f5ba00b4b20 2024-03-12T17:19:39.802 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-03-12T17:19:39.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.810+0000 7f5ba7000640 1 -- 172.21.15.17:0/1931256983 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f5b8006ac00 msgr2=0x7f5b8006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:39.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.810+0000 7f5ba7000640 1 --2- 172.21.15.17:0/1931256983 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f5b8006ac00 0x7f5b8006d0c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5ba00cd0b0 tx=0x7f5b8c009040 comp rx=0 tx=0).stop 2024-03-12T17:19:39.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.811+0000 7f5ba7000640 1 -- 172.21.15.17:0/1931256983 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba00b4b20 msgr2=0x7f5ba015a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:39.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.811+0000 7f5ba7000640 1 --2- 172.21.15.17:0/1931256983 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba00b4b20 0x7f5ba015a1c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5b94007ef0 tx=0x7f5b9400e4b0 comp rx=0 tx=0).stop 2024-03-12T17:19:39.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.811+0000 7f5ba7000640 1 -- 172.21.15.17:0/1931256983 shutdown_connections 2024-03-12T17:19:39.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.811+0000 7f5ba7000640 1 --2- 172.21.15.17:0/1931256983 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f5b8006ac00 0x7f5b8006d0c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:39.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.811+0000 7f5ba7000640 1 --2- 172.21.15.17:0/1931256983 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5ba0160090 0x7f5ba00a9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:39.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.811+0000 7f5ba7000640 1 --2- 172.21.15.17:0/1931256983 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ba00b86c0 0x7f5ba00a9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:39.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.811+0000 7f5ba7000640 1 --2- 172.21.15.17:0/1931256983 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ba00b4b20 0x7f5ba015a1c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:39.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.811+0000 7f5ba7000640 1 -- 172.21.15.17:0/1931256983 >> 172.21.15.17:0/1931256983 conn(0x7f5ba00cf5f0 msgr2=0x7f5ba00cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:39.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.811+0000 7f5ba7000640 1 -- 172.21.15.17:0/1931256983 shutdown_connections 2024-03-12T17:19:39.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:39.811+0000 7f5ba7000640 1 -- 172.21.15.17:0/1931256983 wait complete. 2024-03-12T17:19:39.825 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-12T17:19:40.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.058+0000 7fab72a00640 1 Processor -- start 2024-03-12T17:19:40.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.058+0000 7fab72a00640 1 -- start start 2024-03-12T17:19:40.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.060+0000 7fab72a00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fab6c1441f0 0x7fab6c070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:40.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.060+0000 7fab72a00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab6c0a7660 con 0x7fab6c15ae20 2024-03-12T17:19:40.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.060+0000 7fab72a00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab6c1445d0 con 0x7fab6c0b3b70 2024-03-12T17:19:40.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.060+0000 7fab72a00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab6c15e460 con 0x7fab6c1441f0 2024-03-12T17:19:40.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.060+0000 7fab70c00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fab6c15ae20 0x7fab6c06d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:38570/0 (socket says 172.21.15.17:38570) 2024-03-12T17:19:40.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.060+0000 7fab70c00640 1 -- 172.21.15.17:0/2376490003 learned_addr learned my addr 172.21.15.17:0/2376490003 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.061+0000 7fab71600640 1 --2- 172.21.15.17:0/2376490003 >> v2:172.21.15.94:3300/0 conn(0x7fab6c1441f0 0x7fab6c070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.061+0000 7fab6be00640 1 -- 172.21.15.17:0/2376490003 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2696499301 0 0) 0x7fab6c0a7660 con 0x7fab6c15ae20 2024-03-12T17:19:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.061+0000 7fab6be00640 1 -- 172.21.15.17:0/2376490003 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab54003520 con 0x7fab6c15ae20 2024-03-12T17:19:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.061+0000 7fab6be00640 1 -- 172.21.15.17:0/2376490003 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1287778073 0 0) 0x7fab54003520 con 0x7fab6c15ae20 2024-03-12T17:19:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.061+0000 7fab6be00640 1 -- 172.21.15.17:0/2376490003 >> v2:172.21.15.94:3300/0 conn(0x7fab6c1441f0 msgr2=0x7fab6c070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.061+0000 7fab6be00640 1 --2- 172.21.15.17:0/2376490003 >> v2:172.21.15.94:3300/0 conn(0x7fab6c1441f0 0x7fab6c070240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.061+0000 7fab6be00640 1 -- 172.21.15.17:0/2376490003 >> v1:172.21.15.94:6789/0 conn(0x7fab6c0b3b70 legacy=0x7fab6c0b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.061+0000 7fab6be00640 1 -- 172.21.15.17:0/2376490003 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6c15b3e0 con 0x7fab6c15ae20 2024-03-12T17:19:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.061+0000 7fab6be00640 1 -- 172.21.15.17:0/2376490003 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7fab58001670 con 0x7fab6c15ae20 2024-03-12T17:19:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.061+0000 7fab6be00640 1 -- 172.21.15.17:0/2376490003 >> v1:172.21.15.17:6789/0 conn(0x7fab6c15ae20 legacy=0x7fab6c06d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.061+0000 7fab6be00640 1 --2- 172.21.15.17:0/2376490003 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab540039c0 0x7fab54003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.061+0000 7fab6be00640 1 --2- 172.21.15.17:0/2376490003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab540047c0 0x7fab54004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:40.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.061+0000 7fab6be00640 1 --2- 172.21.15.17:0/2376490003 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fab540051d0 0x7fab5400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:40.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.061+0000 7fab6be00640 1 -- 172.21.15.17:0/2376490003 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c15e460 con 0x7fab540047c0 2024-03-12T17:19:40.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.061+0000 7fab6be00640 1 -- 172.21.15.17:0/2376490003 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5400c110 con 0x7fab540039c0 2024-03-12T17:19:40.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.061+0000 7fab6be00640 1 -- 172.21.15.17:0/2376490003 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5400c2d0 con 0x7fab540051d0 2024-03-12T17:19:40.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.061+0000 7fab70c00640 1 --2- 172.21.15.17:0/2376490003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab540047c0 0x7fab54004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:40.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.062+0000 7fab71600640 1 --2- 172.21.15.17:0/2376490003 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab540039c0 0x7fab54003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:40.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.062+0000 7fab70c00640 1 -- 172.21.15.17:0/2376490003 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fab540051d0 msgr2=0x7fab5400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:40.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.062+0000 7fab72000640 1 --2- 172.21.15.17:0/2376490003 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fab540051d0 0x7fab5400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:40.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.062+0000 7fab70c00640 1 --2- 172.21.15.17:0/2376490003 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fab540051d0 0x7fab5400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:40.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.062+0000 7fab70c00640 1 -- 172.21.15.17:0/2376490003 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab540039c0 msgr2=0x7fab54003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:40.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.062+0000 7fab70c00640 1 --2- 172.21.15.17:0/2376490003 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab540039c0 0x7fab54003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:40.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.062+0000 7fab70c00640 1 -- 172.21.15.17:0/2376490003 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab54003520 con 0x7fab540047c0 2024-03-12T17:19:40.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.062+0000 7fab72000640 1 --2- 172.21.15.17:0/2376490003 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fab540051d0 0x7fab5400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:40.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.062+0000 7fab71600640 1 --2- 172.21.15.17:0/2376490003 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab540039c0 0x7fab54003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:19:40.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.062+0000 7fab72000640 1 -- 172.21.15.17:0/2376490003 reap_dead start 2024-03-12T17:19:40.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.063+0000 7fab70c00640 1 --2- 172.21.15.17:0/2376490003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab540047c0 0x7fab54004c40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fab5800c0e0 tx=0x7fab540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d819c393a68ab2f0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:40.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.063+0000 7fab6be00640 1 -- 172.21.15.17:0/2376490003 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab58005ad0 con 0x7fab540047c0 2024-03-12T17:19:40.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.063+0000 7fab6be00640 1 -- 172.21.15.17:0/2376490003 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab58005c30 con 0x7fab540047c0 2024-03-12T17:19:40.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.063+0000 7fab6be00640 1 -- 172.21.15.17:0/2376490003 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5802ca50 con 0x7fab540047c0 2024-03-12T17:19:40.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.064+0000 7fab72a00640 1 -- 172.21.15.17:0/2376490003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab540047c0 msgr2=0x7fab54004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:40.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.064+0000 7fab72a00640 1 --2- 172.21.15.17:0/2376490003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab540047c0 0x7fab54004c40 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fab5800c0e0 tx=0x7fab540057f0 comp rx=0 tx=0).stop 2024-03-12T17:19:40.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.064+0000 7fab72a00640 1 -- 172.21.15.17:0/2376490003 shutdown_connections 2024-03-12T17:19:40.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.064+0000 7fab72a00640 1 --2- 172.21.15.17:0/2376490003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab540047c0 0x7fab54004c40 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:40.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.064+0000 7fab72a00640 1 -- 172.21.15.17:0/2376490003 >> 172.21.15.17:0/2376490003 conn(0x7fab6c069ce0 msgr2=0x7fab6c06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:40.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.064+0000 7fab72a00640 1 -- 172.21.15.17:0/2376490003 shutdown_connections 2024-03-12T17:19:40.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.064+0000 7fab72a00640 1 -- 172.21.15.17:0/2376490003 wait complete. 2024-03-12T17:19:40.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.066+0000 7fab72a00640 1 Processor -- start 2024-03-12T17:19:40.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.066+0000 7fab72a00640 1 -- start start 2024-03-12T17:19:40.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.067+0000 7fab72a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fab540047c0 0x7fab6c139470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:40.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.067+0000 7fab72a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab6c140060 0x7fab6c0c9aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:40.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.067+0000 7fab72a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab6c1f5d60 0x7fab6c13be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:40.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.067+0000 7fab72a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c1f6c90 con 0x7fab6c1f5d60 2024-03-12T17:19:40.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.067+0000 7fab72a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c1f66d0 con 0x7fab6c140060 2024-03-12T17:19:40.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.067+0000 7fab72a00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c1f69b0 con 0x7fab540047c0 2024-03-12T17:19:40.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.067+0000 7fab72000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab6c1f5d60 0x7fab6c13be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:40.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.067+0000 7fab72000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab6c1f5d60 0x7fab6c13be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55298/0 (socket says 172.21.15.17:55298) 2024-03-12T17:19:40.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.067+0000 7fab72000640 1 -- 172.21.15.17:0/2221805378 learned_addr learned my addr 172.21.15.17:0/2221805378 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:40.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.068+0000 7fab71600640 1 --2- 172.21.15.17:0/2221805378 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fab540047c0 0x7fab6c139470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:40.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.068+0000 7fab70c00640 1 --2- 172.21.15.17:0/2221805378 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab6c140060 0x7fab6c0c9aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:40.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.068+0000 7fab72000640 1 -- 172.21.15.17:0/2221805378 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fab540047c0 msgr2=0x7fab6c139470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:40.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.068+0000 7fab72000640 1 --2- 172.21.15.17:0/2221805378 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fab540047c0 0x7fab6c139470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:40.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.068+0000 7fab72000640 1 -- 172.21.15.17:0/2221805378 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab6c140060 msgr2=0x7fab6c0c9aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:40.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.068+0000 7fab72000640 1 --2- 172.21.15.17:0/2221805378 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab6c140060 0x7fab6c0c9aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:40.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.068+0000 7fab72000640 1 -- 172.21.15.17:0/2221805378 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6c0c92a0 con 0x7fab6c1f5d60 2024-03-12T17:19:40.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.068+0000 7fab72000640 1 --2- 172.21.15.17:0/2221805378 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab6c1f5d60 0x7fab6c13be80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fab6c070090 tx=0x7fab6400db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:40.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.069+0000 7fab69600640 1 -- 172.21.15.17:0/2221805378 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab64003b70 con 0x7fab6c1f5d60 2024-03-12T17:19:40.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.069+0000 7fab69600640 1 -- 172.21.15.17:0/2221805378 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab64003cd0 con 0x7fab6c1f5d60 2024-03-12T17:19:40.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.069+0000 7fab69600640 1 -- 172.21.15.17:0/2221805378 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab640052b0 con 0x7fab6c1f5d60 2024-03-12T17:19:40.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.069+0000 7fab72a00640 1 -- 172.21.15.17:0/2221805378 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab6c0c9580 con 0x7fab6c1f5d60 2024-03-12T17:19:40.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.069+0000 7fab72a00640 1 -- 172.21.15.17:0/2221805378 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab6c0c9fe0 con 0x7fab6c1f5d60 2024-03-12T17:19:40.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.070+0000 7fab72a00640 1 -- 172.21.15.17:0/2221805378 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab6c0c9100 con 0x7fab6c1f5d60 2024-03-12T17:19:40.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.071+0000 7fab69600640 1 -- 172.21.15.17:0/2221805378 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fab64005410 con 0x7fab6c1f5d60 2024-03-12T17:19:40.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.072+0000 7fab69600640 1 --2- 172.21.15.17:0/2221805378 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fab4c06ac00 0x7fab4c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:40.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.072+0000 7fab69600640 1 -- 172.21.15.17:0/2221805378 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fab64088ce0 con 0x7fab6c1f5d60 2024-03-12T17:19:40.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.072+0000 7fab71600640 1 --2- 172.21.15.17:0/2221805378 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fab4c06ac00 0x7fab4c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:40.067 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.073+0000 7fab71600640 1 --2- 172.21.15.17:0/2221805378 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fab4c06ac00 0x7fab4c06d0c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fab60006fd0 tx=0x7fab60008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:40.071 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.077+0000 7fab69600640 1 -- 172.21.15.17:0/2221805378 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fab6c0c9100 con 0x7fab6c1f5d60 2024-03-12T17:19:40.199 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:19:40.205 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:19:40.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.285+0000 7fab72a00640 1 -- 172.21.15.17:0/2221805378 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fab6c0c9100 con 0x7fab6c1f5d60 2024-03-12T17:19:40.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.286+0000 7fab69600640 1 -- 172.21.15.17:0/2221805378 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fab6c0c9100 con 0x7fab6c1f5d60 2024-03-12T17:19:40.281 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-03-12T17:19:40.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.289+0000 7fab72a00640 1 -- 172.21.15.17:0/2221805378 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fab4c06ac00 msgr2=0x7fab4c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:40.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.289+0000 7fab72a00640 1 --2- 172.21.15.17:0/2221805378 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fab4c06ac00 0x7fab4c06d0c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fab60006fd0 tx=0x7fab60008040 comp rx=0 tx=0).stop 2024-03-12T17:19:40.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.289+0000 7fab72a00640 1 -- 172.21.15.17:0/2221805378 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab6c1f5d60 msgr2=0x7fab6c13be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:40.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.289+0000 7fab72a00640 1 --2- 172.21.15.17:0/2221805378 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab6c1f5d60 0x7fab6c13be80 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fab6c070090 tx=0x7fab6400db80 comp rx=0 tx=0).stop 2024-03-12T17:19:40.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.289+0000 7fab72a00640 1 -- 172.21.15.17:0/2221805378 shutdown_connections 2024-03-12T17:19:40.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.289+0000 7fab72a00640 1 --2- 172.21.15.17:0/2221805378 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fab4c06ac00 0x7fab4c06d0c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:40.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.289+0000 7fab72a00640 1 --2- 172.21.15.17:0/2221805378 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab6c1f5d60 0x7fab6c13be80 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:40.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.289+0000 7fab72a00640 1 --2- 172.21.15.17:0/2221805378 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab6c140060 0x7fab6c0c9aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:40.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.289+0000 7fab72a00640 1 --2- 172.21.15.17:0/2221805378 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fab540047c0 0x7fab6c139470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:40.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.289+0000 7fab72a00640 1 -- 172.21.15.17:0/2221805378 >> 172.21.15.17:0/2221805378 conn(0x7fab6c069ce0 msgr2=0x7fab6c15a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:40.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.289+0000 7fab72a00640 1 -- 172.21.15.17:0/2221805378 shutdown_connections 2024-03-12T17:19:40.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.289+0000 7fab72a00640 1 -- 172.21.15.17:0/2221805378 wait complete. 2024-03-12T17:19:40.304 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-12T17:19:40.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.533+0000 7f93d5600640 1 Processor -- start 2024-03-12T17:19:40.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.533+0000 7f93d5600640 1 -- start start 2024-03-12T17:19:40.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.534+0000 7f93d5600640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f93d015ced0 0x7f93d0098bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:40.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.534+0000 7f93d5600640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f93d00afe20 0x7f93d00990f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:40.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.534+0000 7f93d5600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f93d015d2b0 0x7f93d0160940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:40.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.534+0000 7f93d5600640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d015e3b0 con 0x7f93d00afe20 2024-03-12T17:19:40.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.534+0000 7f93d5600640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d00cece0 con 0x7f93d015ced0 2024-03-12T17:19:40.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.534+0000 7f93d5600640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d015d7a0 con 0x7f93d015d2b0 2024-03-12T17:19:40.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.535+0000 7f93ce000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f93d00afe20 0x7f93d00990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:40.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.535+0000 7f93ce000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f93d00afe20 0x7f93d00990f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55312/0 (socket says 172.21.15.17:55312) 2024-03-12T17:19:40.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.535+0000 7f93ce000640 1 -- 172.21.15.17:0/3617451072 learned_addr learned my addr 172.21.15.17:0/3617451072 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:40.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.535+0000 7f93cf400640 1 --2- 172.21.15.17:0/3617451072 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f93d015d2b0 0x7f93d0160940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:40.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.535+0000 7f93cea00640 1 --2- 172.21.15.17:0/3617451072 >> v2:172.21.15.94:3300/0 conn(0x7f93d015ced0 0x7f93d0098bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:40.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.535+0000 7f93ce000640 1 -- 172.21.15.17:0/3617451072 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f93d015d2b0 msgr2=0x7f93d0160940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:40.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.535+0000 7f93ce000640 1 --2- 172.21.15.17:0/3617451072 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f93d015d2b0 0x7f93d0160940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:40.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.535+0000 7f93ce000640 1 -- 172.21.15.17:0/3617451072 >> v2:172.21.15.94:3300/0 conn(0x7f93d015ced0 msgr2=0x7f93d0098bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:40.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.535+0000 7f93ce000640 1 --2- 172.21.15.17:0/3617451072 >> v2:172.21.15.94:3300/0 conn(0x7f93d015ced0 0x7f93d0098bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:40.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.536+0000 7f93ce000640 1 -- 172.21.15.17:0/3617451072 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d015da80 con 0x7f93d00afe20 2024-03-12T17:19:40.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.537+0000 7f93ce000640 1 --2- 172.21.15.17:0/3617451072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93d00afe20 0x7f93d00990f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f93d0071a50 tx=0x7f93b802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e52d4bd0ece79aa1 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:40.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.537+0000 7f93cd600640 1 -- 172.21.15.17:0/3617451072 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b8031870 con 0x7f93d00afe20 2024-03-12T17:19:40.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.537+0000 7f93cd600640 1 -- 172.21.15.17:0/3617451072 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93b80319d0 con 0x7f93d00afe20 2024-03-12T17:19:40.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.538+0000 7f93cd600640 1 -- 172.21.15.17:0/3617451072 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93b8031d60 con 0x7f93d00afe20 2024-03-12T17:19:40.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.538+0000 7f93d5600640 1 -- 172.21.15.17:0/3617451072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93d00afe20 msgr2=0x7f93d00990f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:40.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.538+0000 7f93d5600640 1 --2- 172.21.15.17:0/3617451072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93d00afe20 0x7f93d00990f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f93d0071a50 tx=0x7f93b802b910 comp rx=0 tx=0).stop 2024-03-12T17:19:40.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.538+0000 7f93d5600640 1 -- 172.21.15.17:0/3617451072 shutdown_connections 2024-03-12T17:19:40.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.538+0000 7f93d5600640 1 --2- 172.21.15.17:0/3617451072 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f93d015d2b0 0x7f93d0160940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:40.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.538+0000 7f93d5600640 1 --2- 172.21.15.17:0/3617451072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93d00afe20 0x7f93d00990f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:40.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.538+0000 7f93d5600640 1 --2- 172.21.15.17:0/3617451072 >> v2:172.21.15.94:3300/0 conn(0x7f93d015ced0 0x7f93d0098bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:40.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.538+0000 7f93d5600640 1 -- 172.21.15.17:0/3617451072 >> 172.21.15.17:0/3617451072 conn(0x7f93d00b2460 msgr2=0x7f93d00b2870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:40.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.538+0000 7f93d5600640 1 -- 172.21.15.17:0/3617451072 shutdown_connections 2024-03-12T17:19:40.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.538+0000 7f93d5600640 1 -- 172.21.15.17:0/3617451072 wait complete. 2024-03-12T17:19:40.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.540+0000 7f93d5600640 1 Processor -- start 2024-03-12T17:19:40.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.540+0000 7f93d5600640 1 -- start start 2024-03-12T17:19:40.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.541+0000 7f93d5600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f93d00afe20 0x7f93d0155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:40.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.541+0000 7f93d5600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f93d015ced0 0x7f93d00af560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:40.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.541+0000 7f93d5600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93d015d2b0 0x7f93d00c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:40.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.541+0000 7f93d5600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d00ad6c0 con 0x7f93d015d2b0 2024-03-12T17:19:40.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.541+0000 7f93d5600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d01f63e0 con 0x7f93d00afe20 2024-03-12T17:19:40.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.541+0000 7f93d5600640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d01f66c0 con 0x7f93d015ced0 2024-03-12T17:19:40.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.542+0000 7f93cf400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93d015d2b0 0x7f93d00c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:40.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.542+0000 7f93cf400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93d015d2b0 0x7f93d00c8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55324/0 (socket says 172.21.15.17:55324) 2024-03-12T17:19:40.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.542+0000 7f93cf400640 1 -- 172.21.15.17:0/1109201887 learned_addr learned my addr 172.21.15.17:0/1109201887 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:40.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.542+0000 7f93cea00640 1 --2- 172.21.15.17:0/1109201887 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f93d00afe20 0x7f93d0155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:40.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.542+0000 7f93ce000640 1 --2- 172.21.15.17:0/1109201887 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f93d015ced0 0x7f93d00af560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:40.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.542+0000 7f93cf400640 1 -- 172.21.15.17:0/1109201887 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f93d015ced0 msgr2=0x7f93d00af560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:40.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.542+0000 7f93cf400640 1 --2- 172.21.15.17:0/1109201887 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f93d015ced0 0x7f93d00af560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:40.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.542+0000 7f93cf400640 1 -- 172.21.15.17:0/1109201887 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f93d00afe20 msgr2=0x7f93d0155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:40.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.542+0000 7f93cf400640 1 --2- 172.21.15.17:0/1109201887 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f93d00afe20 0x7f93d0155eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:40.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.542+0000 7f93cf400640 1 -- 172.21.15.17:0/1109201887 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b80094d0 con 0x7f93d015d2b0 2024-03-12T17:19:40.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.543+0000 7f93cf400640 1 --2- 172.21.15.17:0/1109201887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93d015d2b0 0x7f93d00c8f80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f93c800d5a0 tx=0x7f93c800da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:40.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.543+0000 7f93c6a00640 1 -- 172.21.15.17:0/1109201887 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c80125f0 con 0x7f93d015d2b0 2024-03-12T17:19:40.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.543+0000 7f93c6a00640 1 -- 172.21.15.17:0/1109201887 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c8012750 con 0x7f93d015d2b0 2024-03-12T17:19:40.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.543+0000 7f93c6a00640 1 -- 172.21.15.17:0/1109201887 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c8012ae0 con 0x7f93d015d2b0 2024-03-12T17:19:40.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.543+0000 7f93d5600640 1 -- 172.21.15.17:0/1109201887 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93d01f69a0 con 0x7f93d015d2b0 2024-03-12T17:19:40.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.543+0000 7f93d5600640 1 -- 172.21.15.17:0/1109201887 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d00afaa0 con 0x7f93d015d2b0 2024-03-12T17:19:40.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.544+0000 7f93d5600640 1 -- 172.21.15.17:0/1109201887 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d0066930 con 0x7f93d015d2b0 2024-03-12T17:19:40.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.545+0000 7f93c6a00640 1 -- 172.21.15.17:0/1109201887 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f93c8012c40 con 0x7f93d015d2b0 2024-03-12T17:19:40.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.546+0000 7f93c6a00640 1 --2- 172.21.15.17:0/1109201887 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f93ac06ac00 0x7f93ac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:40.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.547+0000 7f93c6a00640 1 -- 172.21.15.17:0/1109201887 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f93c80898d0 con 0x7f93d015d2b0 2024-03-12T17:19:40.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.547+0000 7f93cea00640 1 --2- 172.21.15.17:0/1109201887 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f93ac06ac00 0x7f93ac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:40.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.548+0000 7f93cea00640 1 --2- 172.21.15.17:0/1109201887 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f93ac06ac00 0x7f93ac06d0c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f93c0009f80 tx=0x7f93c000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:40.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.551+0000 7f93c6a00640 1 -- 172.21.15.17:0/1109201887 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f93c80549a0 con 0x7f93d015d2b0 2024-03-12T17:19:40.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.791+0000 7f93d5600640 1 -- 172.21.15.17:0/1109201887 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93d006b670 con 0x7f93d015d2b0 2024-03-12T17:19:40.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.793+0000 7f93c6a00640 1 -- 172.21.15.17:0/1109201887 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4725 (secure 0 0 0) 0x7f93c8057fc0 con 0x7f93d015d2b0 2024-03-12T17:19:40.787 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:19:40.787 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/4055209511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":4055209511},{"type":"v1","addr":"172.21.15.94:6833","nonce":4055209511}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4220,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/2079001512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2079001512},{"type":"v1","addr":"172.21.15.94:6835","nonce":2079001512}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6836/3710914262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3710914262},{"type":"v1","addr":"172.21.15.17:6836","nonce":3710914262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T17:18:45.842660+0000","modified":"2024-03-12T17:18:49.354081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6837/749237500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6835","nonce":749237500},{"type":"v1","addr":"172.21.15.17:6837","nonce":749237500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-12T17:19:40.788 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 7 2024-03-12T17:19:40.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.796+0000 7f93d5600640 1 -- 172.21.15.17:0/1109201887 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f93ac06ac00 msgr2=0x7f93ac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:40.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.796+0000 7f93d5600640 1 --2- 172.21.15.17:0/1109201887 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f93ac06ac00 0x7f93ac06d0c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f93c0009f80 tx=0x7f93c000b040 comp rx=0 tx=0).stop 2024-03-12T17:19:40.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.796+0000 7f93d5600640 1 -- 172.21.15.17:0/1109201887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93d015d2b0 msgr2=0x7f93d00c8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:40.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.796+0000 7f93d5600640 1 --2- 172.21.15.17:0/1109201887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93d015d2b0 0x7f93d00c8f80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f93c800d5a0 tx=0x7f93c800da60 comp rx=0 tx=0).stop 2024-03-12T17:19:40.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.796+0000 7f93d5600640 1 -- 172.21.15.17:0/1109201887 shutdown_connections 2024-03-12T17:19:40.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.796+0000 7f93d5600640 1 --2- 172.21.15.17:0/1109201887 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f93ac06ac00 0x7f93ac06d0c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:40.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.796+0000 7f93d5600640 1 --2- 172.21.15.17:0/1109201887 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f93d015d2b0 0x7f93d00c8f80 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:40.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.796+0000 7f93d5600640 1 --2- 172.21.15.17:0/1109201887 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f93d015ced0 0x7f93d00af560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:40.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.796+0000 7f93d5600640 1 --2- 172.21.15.17:0/1109201887 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f93d00afe20 0x7f93d0155eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:40.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.796+0000 7f93d5600640 1 -- 172.21.15.17:0/1109201887 >> 172.21.15.17:0/1109201887 conn(0x7f93d00b2460 msgr2=0x7f93d00cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:40.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.796+0000 7f93d5600640 1 -- 172.21.15.17:0/1109201887 shutdown_connections 2024-03-12T17:19:40.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:40.796+0000 7f93d5600640 1 -- 172.21.15.17:0/1109201887 wait complete. 2024-03-12T17:19:40.810 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T17:19:41.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.034+0000 7fc08cc00640 1 Processor -- start 2024-03-12T17:19:41.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.034+0000 7fc08cc00640 1 -- start start 2024-03-12T17:19:41.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.036+0000 7fc08cc00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc08815ae20 0x7fc08806d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:41.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.036+0000 7fc08cc00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc0880b3b70 0x7fc0880b4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:41.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.036+0000 7fc08cc00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0880a7660 con 0x7fc0881441f0 2024-03-12T17:19:41.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.036+0000 7fc08cc00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0880b4540 con 0x7fc0880b3b70 2024-03-12T17:19:41.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.036+0000 7fc08cc00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc08815e460 con 0x7fc08815ae20 2024-03-12T17:19:41.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.036+0000 7fc087400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fc0881441f0 0x7fc088070240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:38578/0 (socket says 172.21.15.17:38578) 2024-03-12T17:19:41.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.036+0000 7fc087400640 1 -- 172.21.15.17:0/453680533 learned_addr learned my addr 172.21.15.17:0/453680533 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:41.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.036+0000 7fc07fe00640 1 --2- 172.21.15.17:0/453680533 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc08815ae20 0x7fc08806d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:41.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.036+0000 7fc087e00640 1 --2- 172.21.15.17:0/453680533 >> v2:172.21.15.94:3300/0 conn(0x7fc0880b3b70 0x7fc0880b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:41.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.036+0000 7fc086a00640 1 -- 172.21.15.17:0/453680533 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3178647770 0 0) 0x7fc0880a7660 con 0x7fc0881441f0 2024-03-12T17:19:41.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.037+0000 7fc086a00640 1 -- 172.21.15.17:0/453680533 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc06c003520 con 0x7fc0881441f0 2024-03-12T17:19:41.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.037+0000 7fc086a00640 1 -- 172.21.15.17:0/453680533 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2929353375 0 0) 0x7fc06c003520 con 0x7fc0881441f0 2024-03-12T17:19:41.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.037+0000 7fc086a00640 1 -- 172.21.15.17:0/453680533 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc08815ae20 msgr2=0x7fc08806d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:41.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.037+0000 7fc086a00640 1 --2- 172.21.15.17:0/453680533 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc08815ae20 0x7fc08806d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:41.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.037+0000 7fc086a00640 1 -- 172.21.15.17:0/453680533 >> v2:172.21.15.94:3300/0 conn(0x7fc0880b3b70 msgr2=0x7fc0880b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:41.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.037+0000 7fc086a00640 1 --2- 172.21.15.17:0/453680533 >> v2:172.21.15.94:3300/0 conn(0x7fc0880b3b70 0x7fc0880b4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:41.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.037+0000 7fc086a00640 1 -- 172.21.15.17:0/453680533 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0881445d0 con 0x7fc0881441f0 2024-03-12T17:19:41.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.037+0000 7fc086a00640 1 -- 172.21.15.17:0/453680533 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7fc078001670 con 0x7fc0881441f0 2024-03-12T17:19:41.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.037+0000 7fc086a00640 1 -- 172.21.15.17:0/453680533 >> v1:172.21.15.17:6789/0 conn(0x7fc0881441f0 legacy=0x7fc088070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:41.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.037+0000 7fc086a00640 1 --2- 172.21.15.17:0/453680533 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc06c003970 0x7fc06c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:41.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.037+0000 7fc086a00640 1 --2- 172.21.15.17:0/453680533 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc08815ae20 0x7fc06c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:41.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.037+0000 7fc086a00640 1 --2- 172.21.15.17:0/453680533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc06c004d00 0x7fc06c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:41.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.037+0000 7fc086a00640 1 -- 172.21.15.17:0/453680533 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0880b4540 con 0x7fc06c004d00 2024-03-12T17:19:41.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.037+0000 7fc086a00640 1 -- 172.21.15.17:0/453680533 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08815e460 con 0x7fc06c003970 2024-03-12T17:19:41.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.037+0000 7fc086a00640 1 -- 172.21.15.17:0/453680533 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc06c00ba00 con 0x7fc08815ae20 2024-03-12T17:19:41.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.037+0000 7fc087e00640 1 --2- 172.21.15.17:0/453680533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc06c004d00 0x7fc06c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:41.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.038+0000 7fc087400640 1 --2- 172.21.15.17:0/453680533 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc06c003970 0x7fc06c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:41.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.038+0000 7fc07fe00640 1 --2- 172.21.15.17:0/453680533 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc08815ae20 0x7fc06c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:41.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.038+0000 7fc087e00640 1 -- 172.21.15.17:0/453680533 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc08815ae20 msgr2=0x7fc06c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:41.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.038+0000 7fc087e00640 1 --2- 172.21.15.17:0/453680533 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc08815ae20 0x7fc06c0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:41.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.038+0000 7fc087e00640 1 -- 172.21.15.17:0/453680533 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc06c003970 msgr2=0x7fc06c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:41.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.038+0000 7fc087e00640 1 --2- 172.21.15.17:0/453680533 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc06c003970 0x7fc06c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:41.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.038+0000 7fc087e00640 1 -- 172.21.15.17:0/453680533 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc06c003520 con 0x7fc06c004d00 2024-03-12T17:19:41.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.038+0000 7fc087400640 1 --2- 172.21.15.17:0/453680533 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc06c003970 0x7fc06c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:41.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.039+0000 7fc087e00640 1 --2- 172.21.15.17:0/453680533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc06c004d00 0x7fc06c005180 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc080009fc0 tx=0x7fc06c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdbf62f848fb9bc0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:41.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.039+0000 7fc086a00640 1 -- 172.21.15.17:0/453680533 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08002cc60 con 0x7fc06c004d00 2024-03-12T17:19:41.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.039+0000 7fc086a00640 1 -- 172.21.15.17:0/453680533 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08000f040 con 0x7fc06c004d00 2024-03-12T17:19:41.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.039+0000 7fc086a00640 1 -- 172.21.15.17:0/453680533 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc080034440 con 0x7fc06c004d00 2024-03-12T17:19:41.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.040+0000 7fc08cc00640 1 -- 172.21.15.17:0/453680533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc06c004d00 msgr2=0x7fc06c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:41.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.040+0000 7fc08cc00640 1 --2- 172.21.15.17:0/453680533 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc06c004d00 0x7fc06c005180 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc080009fc0 tx=0x7fc06c0057f0 comp rx=0 tx=0).stop 2024-03-12T17:19:41.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.040+0000 7fc087e00640 1 -- 172.21.15.17:0/453680533 reap_dead start 2024-03-12T17:19:41.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.040+0000 7fc08cc00640 1 -- 172.21.15.17:0/453680533 shutdown_connections 2024-03-12T17:19:41.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.040+0000 7fc08cc00640 1 -- 172.21.15.17:0/453680533 >> 172.21.15.17:0/453680533 conn(0x7fc088069ce0 msgr2=0x7fc08806a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:41.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.040+0000 7fc08cc00640 1 -- 172.21.15.17:0/453680533 shutdown_connections 2024-03-12T17:19:41.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.040+0000 7fc08cc00640 1 -- 172.21.15.17:0/453680533 wait complete. 2024-03-12T17:19:41.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.042+0000 7fc08cc00640 1 Processor -- start 2024-03-12T17:19:41.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.042+0000 7fc08cc00640 1 -- start start 2024-03-12T17:19:41.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.043+0000 7fc08cc00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc06c004d00 0x7fc08813b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:41.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.043+0000 7fc08cc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0880ae890 0x7fc088137f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:41.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.043+0000 7fc08cc00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0880aecf0 0x7fc088138490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:41.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.043+0000 7fc08cc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0881389d0 con 0x7fc0880ae890 2024-03-12T17:19:41.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.043+0000 7fc08cc00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc088138e80 con 0x7fc0880aecf0 2024-03-12T17:19:41.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.043+0000 7fc08cc00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc088139160 con 0x7fc06c004d00 2024-03-12T17:19:41.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.044+0000 7fc07fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0880ae890 0x7fc088137f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:41.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.044+0000 7fc07fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0880ae890 0x7fc088137f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55342/0 (socket says 172.21.15.17:55342) 2024-03-12T17:19:41.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.044+0000 7fc07fe00640 1 -- 172.21.15.17:0/3865188740 learned_addr learned my addr 172.21.15.17:0/3865188740 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:41.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.044+0000 7fc087400640 1 --2- 172.21.15.17:0/3865188740 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc06c004d00 0x7fc08813b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:41.040 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.044+0000 7fc087e00640 1 --2- 172.21.15.17:0/3865188740 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0880aecf0 0x7fc088138490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:41.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.044+0000 7fc07fe00640 1 -- 172.21.15.17:0/3865188740 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc06c004d00 msgr2=0x7fc08813b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:41.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.044+0000 7fc07fe00640 1 --2- 172.21.15.17:0/3865188740 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc06c004d00 0x7fc08813b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:41.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.044+0000 7fc07fe00640 1 -- 172.21.15.17:0/3865188740 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0880aecf0 msgr2=0x7fc088138490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:41.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.044+0000 7fc07fe00640 1 --2- 172.21.15.17:0/3865188740 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0880aecf0 0x7fc088138490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:41.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.044+0000 7fc07fe00640 1 -- 172.21.15.17:0/3865188740 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08813d9c0 con 0x7fc0880ae890 2024-03-12T17:19:41.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.045+0000 7fc07fe00640 1 --2- 172.21.15.17:0/3865188740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0880ae890 0x7fc088137f50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc070010860 tx=0x7fc070010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:41.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.045+0000 7fc07f400640 1 -- 172.21.15.17:0/3865188740 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc070009610 con 0x7fc0880ae890 2024-03-12T17:19:41.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.045+0000 7fc07f400640 1 -- 172.21.15.17:0/3865188740 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc07000eb60 con 0x7fc0880ae890 2024-03-12T17:19:41.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.045+0000 7fc07f400640 1 -- 172.21.15.17:0/3865188740 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc07001c400 con 0x7fc0880ae890 2024-03-12T17:19:41.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.045+0000 7fc08cc00640 1 -- 172.21.15.17:0/3865188740 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc08813dca0 con 0x7fc0880ae890 2024-03-12T17:19:41.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.045+0000 7fc08cc00640 1 -- 172.21.15.17:0/3865188740 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc088138b30 con 0x7fc0880ae890 2024-03-12T17:19:41.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.046+0000 7fc08cc00640 1 -- 172.21.15.17:0/3865188740 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc08804e030 con 0x7fc0880ae890 2024-03-12T17:19:41.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.047+0000 7fc07f400640 1 -- 172.21.15.17:0/3865188740 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fc07001c560 con 0x7fc0880ae890 2024-03-12T17:19:41.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.048+0000 7fc07f400640 1 --2- 172.21.15.17:0/3865188740 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc06406ac00 0x7fc06406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:41.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.048+0000 7fc07f400640 1 -- 172.21.15.17:0/3865188740 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fc070089a70 con 0x7fc0880ae890 2024-03-12T17:19:41.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.048+0000 7fc087400640 1 --2- 172.21.15.17:0/3865188740 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc06406ac00 0x7fc06406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:41.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.049+0000 7fc087400640 1 --2- 172.21.15.17:0/3865188740 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc06406ac00 0x7fc06406d0c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc078000c00 tx=0x7fc078009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:41.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.053+0000 7fc07f400640 1 -- 172.21.15.17:0/3865188740 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fc070054b50 con 0x7fc0880ae890 2024-03-12T17:19:41.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.251+0000 7fc08cc00640 1 -- 172.21.15.17:0/3865188740 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc08806c990 con 0x7fc0880ae890 2024-03-12T17:19:41.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.254+0000 7fc07f400640 1 -- 172.21.15.17:0/3865188740 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16238 (secure 0 0 0) 0x7fc070058170 con 0x7fc0880ae890 2024-03-12T17:19:41.249 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:19:41.249 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":23,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:19:33.387374+0000","last_up_change":"2024-03-12T17:18:38.144756+0000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-12T17:18:39.552910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-12T17:18:43.794908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-12T17:18:44.867006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":37305},{"type":"v1","addr":"172.21.15.17:6801","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":37305},{"type":"v1","addr":"172.21.15.17:6803","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":37305},{"type":"v1","addr":"172.21.15.17:6807","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":37305},{"type":"v1","addr":"172.21.15.17:6805","nonce":37305}]},"public_addr":"172.21.15.17:6801/37305","cluster_addr":"172.21.15.17:6803/37305","heartbeat_back_addr":"172.21.15.17:6807/37305","heartbeat_front_addr":"172.21.15.17:6805/37305","state":["exists","up"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":37307},{"type":"v1","addr":"172.21.15.17:6814","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":37307},{"type":"v1","addr":"172.21.15.17:6818","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":37307},{"type":"v1","addr":"172.21.15.17:6827","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":37307},{"type":"v1","addr":"172.21.15.17:6823","nonce":37307}]},"public_addr":"172.21.15.17:6814/37307","cluster_addr":"172.21.15.17:6818/37307","heartbeat_back_addr":"172.21.15.17:6827/37307","heartbeat_front_addr":"172.21.15.17:6823/37307","state":["exists","up"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":37303},{"type":"v1","addr":"172.21.15.17:6809","nonce":37303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":37303},{"type":"v1","addr":"172.21.15.17:6811","nonce":37303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":37303},{"type":"v1","addr":"172.21.15.17:6819","nonce":37303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":37303},{"type":"v1","addr":"172.21.15.17:6815","nonce":37303}]},"public_addr":"172.21.15.17:6809/37303","cluster_addr":"172.21.15.17:6811/37303","heartbeat_back_addr":"172.21.15.17:6819/37303","heartbeat_front_addr":"172.21.15.17:6815/37303","state":["exists","up"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":37308},{"type":"v1","addr":"172.21.15.17:6822","nonce":37308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":37308},{"type":"v1","addr":"172.21.15.17:6826","nonce":37308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":37308},{"type":"v1","addr":"172.21.15.17:6831","nonce":37308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":37308},{"type":"v1","addr":"172.21.15.17:6829","nonce":37308}]},"public_addr":"172.21.15.17:6822/37308","cluster_addr":"172.21.15.17:6826/37308","heartbeat_back_addr":"172.21.15.17:6831/37308","heartbeat_front_addr":"172.21.15.17:6829/37308","state":["exists","up"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":37465},{"type":"v1","addr":"172.21.15.94:6809","nonce":37465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6811","nonce":37465},{"type":"v1","addr":"172.21.15.94:6813","nonce":37465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6819","nonce":37465},{"type":"v1","addr":"172.21.15.94:6822","nonce":37465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6815","nonce":37465},{"type":"v1","addr":"172.21.15.94:6817","nonce":37465}]},"public_addr":"172.21.15.94:6809/37465","cluster_addr":"172.21.15.94:6813/37465","heartbeat_back_addr":"172.21.15.94:6822/37465","heartbeat_front_addr":"172.21.15.94:6817/37465","state":["exists","up"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":37464},{"type":"v1","addr":"172.21.15.94:6812","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":37464},{"type":"v1","addr":"172.21.15.94:6816","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":37464},{"type":"v1","addr":"172.21.15.94:6823","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":37464},{"type":"v1","addr":"172.21.15.94:6820","nonce":37464}]},"public_addr":"172.21.15.94:6812/37464","cluster_addr":"172.21.15.94:6816/37464","heartbeat_back_addr":"172.21.15.94:6823/37464","heartbeat_front_addr":"172.21.15.94:6820/37464","state":["exists","up"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":37467},{"type":"v1","addr":"172.21.15.94:6825","nonce":37467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":37467},{"type":"v1","addr":"172.21.15.94:6827","nonce":37467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":37467},{"type":"v1","addr":"172.21.15.94:6831","nonce":37467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":37467},{"type":"v1","addr":"172.21.15.94:6829","nonce":37467}]},"public_addr":"172.21.15.94:6825/37467","cluster_addr":"172.21.15.94:6827/37467","heartbeat_back_addr":"172.21.15.94:6831/37467","heartbeat_front_addr":"172.21.15.94:6829/37467","state":["exists","up"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":37466},{"type":"v1","addr":"172.21.15.94:6801","nonce":37466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":37466},{"type":"v1","addr":"172.21.15.94:6803","nonce":37466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":37466},{"type":"v1","addr":"172.21.15.94:6807","nonce":37466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":37466},{"type":"v1","addr":"172.21.15.94:6805","nonce":37466}]},"public_addr":"172.21.15.94:6801/37466","cluster_addr":"172.21.15.94:6803/37466","heartbeat_back_addr":"172.21.15.94:6807/37466","heartbeat_front_addr":"172.21.15.94:6805/37466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.327217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.186966+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.419986+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.150585+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.120621+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.121576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.181257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.293188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:19:41.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.257+0000 7fc08cc00640 1 -- 172.21.15.17:0/3865188740 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc06406ac00 msgr2=0x7fc06406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:41.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.257+0000 7fc08cc00640 1 --2- 172.21.15.17:0/3865188740 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc06406ac00 0x7fc06406d0c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc078000c00 tx=0x7fc078009040 comp rx=0 tx=0).stop 2024-03-12T17:19:41.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.257+0000 7fc08cc00640 1 -- 172.21.15.17:0/3865188740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0880ae890 msgr2=0x7fc088137f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:41.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.257+0000 7fc08cc00640 1 --2- 172.21.15.17:0/3865188740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0880ae890 0x7fc088137f50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc070010860 tx=0x7fc070010d20 comp rx=0 tx=0).stop 2024-03-12T17:19:41.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.257+0000 7fc08cc00640 1 -- 172.21.15.17:0/3865188740 shutdown_connections 2024-03-12T17:19:41.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.257+0000 7fc08cc00640 1 --2- 172.21.15.17:0/3865188740 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc06406ac00 0x7fc06406d0c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:41.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.257+0000 7fc08cc00640 1 --2- 172.21.15.17:0/3865188740 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc0880aecf0 0x7fc088138490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:41.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.257+0000 7fc08cc00640 1 --2- 172.21.15.17:0/3865188740 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc0880ae890 0x7fc088137f50 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:41.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.257+0000 7fc08cc00640 1 --2- 172.21.15.17:0/3865188740 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc06c004d00 0x7fc08813b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:41.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.257+0000 7fc08cc00640 1 -- 172.21.15.17:0/3865188740 >> 172.21.15.17:0/3865188740 conn(0x7fc088069ce0 msgr2=0x7fc08806d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:41.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.257+0000 7fc08cc00640 1 -- 172.21.15.17:0/3865188740 shutdown_connections 2024-03-12T17:19:41.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.257+0000 7fc08cc00640 1 -- 172.21.15.17:0/3865188740 wait complete. 2024-03-12T17:19:41.271 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-12T17:19:41.271 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-12T17:19:41.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.501+0000 7fed2da00640 1 Processor -- start 2024-03-12T17:19:41.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.502+0000 7fed2da00640 1 -- start start 2024-03-12T17:19:41.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.503+0000 7fed2da00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fed280cfa40 0x7fed28167ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:41.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.503+0000 7fed2da00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed28161650 con 0x7fed2815caa0 2024-03-12T17:19:41.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.503+0000 7fed2da00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed28161090 con 0x7fed2815ce80 2024-03-12T17:19:41.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.503+0000 7fed2da00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed28160ea0 con 0x7fed280cfa40 2024-03-12T17:19:41.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.503+0000 7fed27e00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fed2815caa0 0x7fed28160790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:38584/0 (socket says 172.21.15.17:38584) 2024-03-12T17:19:41.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.503+0000 7fed27e00640 1 -- 172.21.15.17:0/4060231184 learned_addr learned my addr 172.21.15.17:0/4060231184 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:41.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.504+0000 7fed2d000640 1 --2- 172.21.15.17:0/4060231184 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fed280cfa40 0x7fed28167ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:41.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.504+0000 7fed27400640 1 -- 172.21.15.17:0/4060231184 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3467830505 0 0) 0x7fed28161650 con 0x7fed2815caa0 2024-03-12T17:19:41.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.504+0000 7fed27400640 1 -- 172.21.15.17:0/4060231184 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed0c003520 con 0x7fed2815caa0 2024-03-12T17:19:41.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.505+0000 7fed27400640 1 -- 172.21.15.17:0/4060231184 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2788193831 0 0) 0x7fed0c003520 con 0x7fed2815caa0 2024-03-12T17:19:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.505+0000 7fed27400640 1 -- 172.21.15.17:0/4060231184 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fed280cfa40 msgr2=0x7fed28167ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.505+0000 7fed27400640 1 --2- 172.21.15.17:0/4060231184 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fed280cfa40 0x7fed28167ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.505+0000 7fed27400640 1 -- 172.21.15.17:0/4060231184 >> v1:172.21.15.94:6789/0 conn(0x7fed2815ce80 legacy=0x7fed280cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.505+0000 7fed27400640 1 -- 172.21.15.17:0/4060231184 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed28161370 con 0x7fed2815caa0 2024-03-12T17:19:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.505+0000 7fed27400640 1 -- 172.21.15.17:0/4060231184 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7fed18001670 con 0x7fed2815caa0 2024-03-12T17:19:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.505+0000 7fed27400640 1 -- 172.21.15.17:0/4060231184 >> v1:172.21.15.17:6789/0 conn(0x7fed2815caa0 legacy=0x7fed28160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.505+0000 7fed27400640 1 --2- 172.21.15.17:0/4060231184 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed0c0039a0 0x7fed0c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.505+0000 7fed27400640 1 --2- 172.21.15.17:0/4060231184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed0c0047c0 0x7fed0c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.505+0000 7fed27400640 1 --2- 172.21.15.17:0/4060231184 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fed280cfa40 0x7fed0c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.505+0000 7fed27400640 1 -- 172.21.15.17:0/4060231184 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c00ba30 con 0x7fed0c0047c0 2024-03-12T17:19:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.505+0000 7fed27400640 1 -- 172.21.15.17:0/4060231184 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c00bba0 con 0x7fed0c0039a0 2024-03-12T17:19:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.505+0000 7fed27400640 1 -- 172.21.15.17:0/4060231184 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed0c00bd60 con 0x7fed280cfa40 2024-03-12T17:19:41.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.505+0000 7fed1fe00640 1 --2- 172.21.15.17:0/4060231184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed0c0047c0 0x7fed0c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:41.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.505+0000 7fed2d000640 1 --2- 172.21.15.17:0/4060231184 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fed280cfa40 0x7fed0c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:41.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.505+0000 7fed1fe00640 1 -- 172.21.15.17:0/4060231184 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fed280cfa40 msgr2=0x7fed0c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:41.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.505+0000 7fed1fe00640 1 --2- 172.21.15.17:0/4060231184 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fed280cfa40 0x7fed0c005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:41.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.505+0000 7fed1fe00640 1 -- 172.21.15.17:0/4060231184 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed0c0039a0 msgr2=0x7fed0c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:41.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.505+0000 7fed1fe00640 1 --2- 172.21.15.17:0/4060231184 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed0c0039a0 0x7fed0c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:41.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.505+0000 7fed1fe00640 1 -- 172.21.15.17:0/4060231184 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed0c003520 con 0x7fed0c0047c0 2024-03-12T17:19:41.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.507+0000 7fed1fe00640 1 --2- 172.21.15.17:0/4060231184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed0c0047c0 0x7fed0c004c40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fed2815d260 tx=0x7fed0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=779c6caa1ed42a13 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:41.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.507+0000 7fed27400640 1 -- 172.21.15.17:0/4060231184 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed100052d0 con 0x7fed0c0047c0 2024-03-12T17:19:41.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.507+0000 7fed27400640 1 -- 172.21.15.17:0/4060231184 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed1002e050 con 0x7fed0c0047c0 2024-03-12T17:19:41.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.507+0000 7fed27400640 1 -- 172.21.15.17:0/4060231184 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed100035f0 con 0x7fed0c0047c0 2024-03-12T17:19:41.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.507+0000 7fed2da00640 1 -- 172.21.15.17:0/4060231184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed0c0047c0 msgr2=0x7fed0c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:41.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.507+0000 7fed2da00640 1 --2- 172.21.15.17:0/4060231184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed0c0047c0 0x7fed0c004c40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fed2815d260 tx=0x7fed0c0057f0 comp rx=0 tx=0).stop 2024-03-12T17:19:41.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.507+0000 7fed2d000640 1 -- 172.21.15.17:0/4060231184 reap_dead start 2024-03-12T17:19:41.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.507+0000 7fed2da00640 1 -- 172.21.15.17:0/4060231184 shutdown_connections 2024-03-12T17:19:41.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.507+0000 7fed2da00640 1 -- 172.21.15.17:0/4060231184 >> 172.21.15.17:0/4060231184 conn(0x7fed2806b160 msgr2=0x7fed2806b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:41.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.508+0000 7fed2da00640 1 -- 172.21.15.17:0/4060231184 shutdown_connections 2024-03-12T17:19:41.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.508+0000 7fed2da00640 1 -- 172.21.15.17:0/4060231184 wait complete. 2024-03-12T17:19:41.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.510+0000 7fed2da00640 1 Processor -- start 2024-03-12T17:19:41.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.510+0000 7fed2da00640 1 -- start start 2024-03-12T17:19:41.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.511+0000 7fed2da00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed0c0047c0 0x7fed280b2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:41.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.511+0000 7fed2da00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed280b3650 0x7fed280d2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:41.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.511+0000 7fed2da00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fed280caa40 0x7fed280caea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:41.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.511+0000 7fed2da00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed280c7360 con 0x7fed280b3650 2024-03-12T17:19:41.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.511+0000 7fed2da00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed280b3dd0 con 0x7fed0c0047c0 2024-03-12T17:19:41.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.511+0000 7fed2da00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed280b40b0 con 0x7fed280caa40 2024-03-12T17:19:41.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.511+0000 7fed1fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed280b3650 0x7fed280d2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:41.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.511+0000 7fed1fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed280b3650 0x7fed280d2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55348/0 (socket says 172.21.15.17:55348) 2024-03-12T17:19:41.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.511+0000 7fed1fe00640 1 -- 172.21.15.17:0/50148003 learned_addr learned my addr 172.21.15.17:0/50148003 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:41.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.511+0000 7fed2d000640 1 --2- 172.21.15.17:0/50148003 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fed280caa40 0x7fed280caea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:41.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.511+0000 7fed27e00640 1 --2- 172.21.15.17:0/50148003 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed0c0047c0 0x7fed280b2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:41.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.511+0000 7fed1fe00640 1 -- 172.21.15.17:0/50148003 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fed280caa40 msgr2=0x7fed280caea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:41.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.512+0000 7fed1fe00640 1 --2- 172.21.15.17:0/50148003 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fed280caa40 0x7fed280caea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:41.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.512+0000 7fed1fe00640 1 -- 172.21.15.17:0/50148003 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed0c0047c0 msgr2=0x7fed280b2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:41.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.512+0000 7fed1fe00640 1 --2- 172.21.15.17:0/50148003 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed0c0047c0 0x7fed280b2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:41.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.512+0000 7fed1fe00640 1 -- 172.21.15.17:0/50148003 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed280b4390 con 0x7fed280b3650 2024-03-12T17:19:41.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.512+0000 7fed27e00640 1 --2- 172.21.15.17:0/50148003 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed0c0047c0 0x7fed280b2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:41.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.512+0000 7fed1fe00640 1 --2- 172.21.15.17:0/50148003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed280b3650 0x7fed280d2ab0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fed1002bba0 tx=0x7fed10001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:41.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.512+0000 7fed24c00640 1 -- 172.21.15.17:0/50148003 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed100076c0 con 0x7fed280b3650 2024-03-12T17:19:41.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.512+0000 7fed24c00640 1 -- 172.21.15.17:0/50148003 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed10007a30 con 0x7fed280b3650 2024-03-12T17:19:41.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.512+0000 7fed24c00640 1 -- 172.21.15.17:0/50148003 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed10006be0 con 0x7fed280b3650 2024-03-12T17:19:41.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.512+0000 7fed2da00640 1 -- 172.21.15.17:0/50148003 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed280b4670 con 0x7fed280b3650 2024-03-12T17:19:41.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.512+0000 7fed2da00640 1 -- 172.21.15.17:0/50148003 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed280d2ff0 con 0x7fed280b3650 2024-03-12T17:19:41.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.514+0000 7fed2da00640 1 -- 172.21.15.17:0/50148003 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed280d31e0 con 0x7fed280b3650 2024-03-12T17:19:41.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.514+0000 7fed24c00640 1 -- 172.21.15.17:0/50148003 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fed10006d40 con 0x7fed280b3650 2024-03-12T17:19:41.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.515+0000 7fed24c00640 1 --2- 172.21.15.17:0/50148003 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fed0406ac30 0x7fed0406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:41.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.515+0000 7fed24c00640 1 -- 172.21.15.17:0/50148003 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fed100ab070 con 0x7fed280b3650 2024-03-12T17:19:41.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.516+0000 7fed27e00640 1 --2- 172.21.15.17:0/50148003 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fed0406ac30 0x7fed0406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:41.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.516+0000 7fed27e00640 1 --2- 172.21.15.17:0/50148003 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fed0406ac30 0x7fed0406d0f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fed18001eb0 tx=0x7fed18009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:41.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.520+0000 7fed24c00640 1 -- 172.21.15.17:0/50148003 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fed100de4f0 con 0x7fed280b3650 2024-03-12T17:19:41.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.761+0000 7fed2da00640 1 -- 172.21.15.17:0/50148003 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed28072360 con 0x7fed280b3650 2024-03-12T17:19:41.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.762+0000 7fed24c00640 1 -- 172.21.15.17:0/50148003 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4725 (secure 0 0 0) 0x7fed100761c0 con 0x7fed280b3650 2024-03-12T17:19:41.757 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:19:41.757 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/4055209511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":4055209511},{"type":"v1","addr":"172.21.15.94:6833","nonce":4055209511}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4220,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/2079001512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2079001512},{"type":"v1","addr":"172.21.15.94:6835","nonce":2079001512}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6836/3710914262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3710914262},{"type":"v1","addr":"172.21.15.17:6836","nonce":3710914262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T17:18:45.842660+0000","modified":"2024-03-12T17:18:49.354081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6837/749237500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6835","nonce":749237500},{"type":"v1","addr":"172.21.15.17:6837","nonce":749237500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-12T17:19:41.757 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 7 2024-03-12T17:19:41.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.765+0000 7fed2da00640 1 -- 172.21.15.17:0/50148003 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fed0406ac30 msgr2=0x7fed0406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:41.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.765+0000 7fed2da00640 1 --2- 172.21.15.17:0/50148003 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fed0406ac30 0x7fed0406d0f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fed18001eb0 tx=0x7fed18009040 comp rx=0 tx=0).stop 2024-03-12T17:19:41.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.765+0000 7fed2da00640 1 -- 172.21.15.17:0/50148003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed280b3650 msgr2=0x7fed280d2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:41.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.765+0000 7fed2da00640 1 --2- 172.21.15.17:0/50148003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed280b3650 0x7fed280d2ab0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fed1002bba0 tx=0x7fed10001120 comp rx=0 tx=0).stop 2024-03-12T17:19:41.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.765+0000 7fed2da00640 1 -- 172.21.15.17:0/50148003 shutdown_connections 2024-03-12T17:19:41.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.765+0000 7fed2da00640 1 --2- 172.21.15.17:0/50148003 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fed0406ac30 0x7fed0406d0f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:41.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.765+0000 7fed2da00640 1 --2- 172.21.15.17:0/50148003 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fed280caa40 0x7fed280caea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:41.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.765+0000 7fed2da00640 1 --2- 172.21.15.17:0/50148003 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fed280b3650 0x7fed280d2ab0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:41.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.765+0000 7fed2da00640 1 --2- 172.21.15.17:0/50148003 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fed0c0047c0 0x7fed280b2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:41.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.765+0000 7fed2da00640 1 -- 172.21.15.17:0/50148003 >> 172.21.15.17:0/50148003 conn(0x7fed2806b160 msgr2=0x7fed2815fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:41.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.765+0000 7fed2da00640 1 -- 172.21.15.17:0/50148003 shutdown_connections 2024-03-12T17:19:41.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:41.765+0000 7fed2da00640 1 -- 172.21.15.17:0/50148003 wait complete. 2024-03-12T17:19:41.780 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-12T17:19:42.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.010+0000 7fa68cc00640 1 Processor -- start 2024-03-12T17:19:42.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.011+0000 7fa68cc00640 1 -- start start 2024-03-12T17:19:42.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.012+0000 7fa68cc00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa68815ae20 0x7fa68806d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:42.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.012+0000 7fa68cc00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa6880b3b70 0x7fa6880b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:42.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.012+0000 7fa68cc00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6880a7660 con 0x7fa6881441f0 2024-03-12T17:19:42.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.012+0000 7fa68cc00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa68815e460 con 0x7fa68815ae20 2024-03-12T17:19:42.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.012+0000 7fa68cc00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6880b44c0 con 0x7fa6880b3b70 2024-03-12T17:19:42.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.013+0000 7fa687400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fa6881441f0 0x7fa688070240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:40752/0 (socket says 172.21.15.17:40752) 2024-03-12T17:19:42.008 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.013+0000 7fa687400640 1 -- 172.21.15.17:0/1101896428 learned_addr learned my addr 172.21.15.17:0/1101896428 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:42.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.013+0000 7fa67ea00640 1 --2- 172.21.15.17:0/1101896428 >> v2:172.21.15.17:3300/0 conn(0x7fa68815ae20 0x7fa68806d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:42.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.013+0000 7fa686a00640 1 -- 172.21.15.17:0/1101896428 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 801546 0 0) 0x7fa6880a7660 con 0x7fa6881441f0 2024-03-12T17:19:42.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.013+0000 7fa687e00640 1 --2- 172.21.15.17:0/1101896428 >> v2:172.21.15.94:3300/0 conn(0x7fa6880b3b70 0x7fa6880b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:42.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.013+0000 7fa686a00640 1 -- 172.21.15.17:0/1101896428 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa66c003520 con 0x7fa6881441f0 2024-03-12T17:19:42.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.013+0000 7fa67ea00640 1 -- 172.21.15.17:0/1101896428 >> v2:172.21.15.94:3300/0 conn(0x7fa6880b3b70 msgr2=0x7fa6880b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:42.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.013+0000 7fa67ea00640 1 --2- 172.21.15.17:0/1101896428 >> v2:172.21.15.94:3300/0 conn(0x7fa6880b3b70 0x7fa6880b3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:42.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.013+0000 7fa67ea00640 1 -- 172.21.15.17:0/1101896428 >> v1:172.21.15.17:6789/0 conn(0x7fa6881441f0 legacy=0x7fa688070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:42.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.013+0000 7fa67ea00640 1 -- 172.21.15.17:0/1101896428 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6881445d0 con 0x7fa68815ae20 2024-03-12T17:19:42.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.014+0000 7fa67ea00640 1 --2- 172.21.15.17:0/1101896428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa68815ae20 0x7fa68806d130 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa68815e3a0 tx=0x7fa67002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd096c31b757580 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:42.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.015+0000 7fa686a00640 1 -- 172.21.15.17:0/1101896428 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa670030610 con 0x7fa68815ae20 2024-03-12T17:19:42.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.015+0000 7fa686a00640 1 -- 172.21.15.17:0/1101896428 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa670030770 con 0x7fa68815ae20 2024-03-12T17:19:42.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.015+0000 7fa686a00640 1 -- 172.21.15.17:0/1101896428 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa670030b00 con 0x7fa68815ae20 2024-03-12T17:19:42.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.015+0000 7fa68cc00640 1 -- 172.21.15.17:0/1101896428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa68815ae20 msgr2=0x7fa68806d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:42.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.015+0000 7fa68cc00640 1 --2- 172.21.15.17:0/1101896428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa68815ae20 0x7fa68806d130 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa68815e3a0 tx=0x7fa67002b960 comp rx=0 tx=0).stop 2024-03-12T17:19:42.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.015+0000 7fa68cc00640 1 -- 172.21.15.17:0/1101896428 shutdown_connections 2024-03-12T17:19:42.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.015+0000 7fa68cc00640 1 --2- 172.21.15.17:0/1101896428 >> v2:172.21.15.94:3300/0 conn(0x7fa6880b3b70 0x7fa6880b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:42.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.015+0000 7fa68cc00640 1 --2- 172.21.15.17:0/1101896428 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa68815ae20 0x7fa68806d130 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:42.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.015+0000 7fa68cc00640 1 -- 172.21.15.17:0/1101896428 >> 172.21.15.17:0/1101896428 conn(0x7fa688069ce0 msgr2=0x7fa68806a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:42.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.016+0000 7fa68cc00640 1 -- 172.21.15.17:0/1101896428 shutdown_connections 2024-03-12T17:19:42.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.016+0000 7fa68cc00640 1 -- 172.21.15.17:0/1101896428 wait complete. 2024-03-12T17:19:42.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.017+0000 7fa68cc00640 1 Processor -- start 2024-03-12T17:19:42.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.017+0000 7fa68cc00640 1 -- start start 2024-03-12T17:19:42.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.018+0000 7fa68cc00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6880b3b70 0x7fa68813c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:42.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.018+0000 7fa68cc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6881441f0 0x7fa68815c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:42.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.018+0000 7fa68cc00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa68815ae20 0x7fa6880b3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:42.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.019+0000 7fa68cc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6880b27b0 con 0x7fa6881441f0 2024-03-12T17:19:42.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.019+0000 7fa68cc00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6880b1c30 con 0x7fa6880b3b70 2024-03-12T17:19:42.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.019+0000 7fa68cc00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6880b1f10 con 0x7fa68815ae20 2024-03-12T17:19:42.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.019+0000 7fa67ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6881441f0 0x7fa68815c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:42.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.019+0000 7fa67ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6881441f0 0x7fa68815c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39630/0 (socket says 172.21.15.17:39630) 2024-03-12T17:19:42.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.019+0000 7fa67ea00640 1 -- 172.21.15.17:0/1988616514 learned_addr learned my addr 172.21.15.17:0/1988616514 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:42.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.019+0000 7fa687400640 1 --2- 172.21.15.17:0/1988616514 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6880b3b70 0x7fa68813c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:42.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.019+0000 7fa687e00640 1 --2- 172.21.15.17:0/1988616514 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa68815ae20 0x7fa6880b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:42.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.019+0000 7fa67ea00640 1 -- 172.21.15.17:0/1988616514 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa68815ae20 msgr2=0x7fa6880b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:42.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.019+0000 7fa67ea00640 1 --2- 172.21.15.17:0/1988616514 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa68815ae20 0x7fa6880b3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:42.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.019+0000 7fa67ea00640 1 -- 172.21.15.17:0/1988616514 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6880b3b70 msgr2=0x7fa68813c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:42.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.019+0000 7fa67ea00640 1 --2- 172.21.15.17:0/1988616514 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6880b3b70 0x7fa68813c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:42.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.019+0000 7fa67ea00640 1 -- 172.21.15.17:0/1988616514 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa670009400 con 0x7fa6881441f0 2024-03-12T17:19:42.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.020+0000 7fa67ea00640 1 --2- 172.21.15.17:0/1988616514 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6881441f0 0x7fa68815c260 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa670009890 tx=0x7fa6700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:42.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.020+0000 7fa67fe00640 1 -- 172.21.15.17:0/1988616514 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67003e070 con 0x7fa6881441f0 2024-03-12T17:19:42.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.020+0000 7fa67fe00640 1 -- 172.21.15.17:0/1988616514 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa670030e10 con 0x7fa6881441f0 2024-03-12T17:19:42.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.020+0000 7fa67fe00640 1 -- 172.21.15.17:0/1988616514 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa670039c30 con 0x7fa6881441f0 2024-03-12T17:19:42.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.020+0000 7fa68cc00640 1 -- 172.21.15.17:0/1988616514 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6880b21f0 con 0x7fa6881441f0 2024-03-12T17:19:42.016 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.020+0000 7fa68cc00640 1 -- 172.21.15.17:0/1988616514 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa68813ce60 con 0x7fa6881441f0 2024-03-12T17:19:42.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.021+0000 7fa68cc00640 1 -- 172.21.15.17:0/1988616514 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa68804e030 con 0x7fa6881441f0 2024-03-12T17:19:42.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.022+0000 7fa67fe00640 1 -- 172.21.15.17:0/1988616514 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fa6700423f0 con 0x7fa6881441f0 2024-03-12T17:19:42.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.023+0000 7fa67fe00640 1 --2- 172.21.15.17:0/1988616514 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fa66406ac00 0x7fa66406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:42.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.023+0000 7fa67fe00640 1 -- 172.21.15.17:0/1988616514 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa6700aaf90 con 0x7fa6881441f0 2024-03-12T17:19:42.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.023+0000 7fa687400640 1 --2- 172.21.15.17:0/1988616514 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fa66406ac00 0x7fa66406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:42.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.024+0000 7fa687400640 1 --2- 172.21.15.17:0/1988616514 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fa66406ac00 0x7fa66406d0c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa6780011e0 tx=0x7fa678009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:42.021 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.027+0000 7fa67fe00640 1 -- 172.21.15.17:0/1988616514 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fa6700760f0 con 0x7fa6881441f0 2024-03-12T17:19:42.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.264+0000 7fa68cc00640 1 -- 172.21.15.17:0/1988616514 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa68806c990 con 0x7fa6881441f0 2024-03-12T17:19:42.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.265+0000 7fa67fe00640 1 -- 172.21.15.17:0/1988616514 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4725 (secure 0 0 0) 0x7fa670034090 con 0x7fa6881441f0 2024-03-12T17:19:42.260 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:19:42.260 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4217,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6833/4055209511","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":4055209511},{"type":"v1","addr":"172.21.15.94:6833","nonce":4055209511}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4220,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/2079001512","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6834","nonce":2079001512},{"type":"v1","addr":"172.21.15.94:6835","nonce":2079001512}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6836/3710914262","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":3710914262},{"type":"v1","addr":"172.21.15.17:6836","nonce":3710914262}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T17:18:45.842660+0000","modified":"2024-03-12T17:18:49.354081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6837/749237500","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6835","nonce":749237500},{"type":"v1","addr":"172.21.15.17:6837","nonce":749237500}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-03-12T17:19:42.260 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 7 2024-03-12T17:19:42.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.268+0000 7fa68cc00640 1 -- 172.21.15.17:0/1988616514 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fa66406ac00 msgr2=0x7fa66406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:42.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.268+0000 7fa68cc00640 1 --2- 172.21.15.17:0/1988616514 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fa66406ac00 0x7fa66406d0c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa6780011e0 tx=0x7fa678009040 comp rx=0 tx=0).stop 2024-03-12T17:19:42.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.268+0000 7fa68cc00640 1 -- 172.21.15.17:0/1988616514 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6881441f0 msgr2=0x7fa68815c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:42.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.268+0000 7fa68cc00640 1 --2- 172.21.15.17:0/1988616514 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6881441f0 0x7fa68815c260 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa670009890 tx=0x7fa6700046c0 comp rx=0 tx=0).stop 2024-03-12T17:19:42.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.269+0000 7fa68cc00640 1 -- 172.21.15.17:0/1988616514 shutdown_connections 2024-03-12T17:19:42.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.269+0000 7fa68cc00640 1 --2- 172.21.15.17:0/1988616514 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fa66406ac00 0x7fa66406d0c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:42.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.269+0000 7fa68cc00640 1 --2- 172.21.15.17:0/1988616514 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa68815ae20 0x7fa6880b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:42.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.269+0000 7fa68cc00640 1 --2- 172.21.15.17:0/1988616514 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa6881441f0 0x7fa68815c260 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:42.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.269+0000 7fa68cc00640 1 --2- 172.21.15.17:0/1988616514 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa6880b3b70 0x7fa68813c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:42.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.269+0000 7fa68cc00640 1 -- 172.21.15.17:0/1988616514 >> 172.21.15.17:0/1988616514 conn(0x7fa688069ce0 msgr2=0x7fa6880709e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:42.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.269+0000 7fa68cc00640 1 -- 172.21.15.17:0/1988616514 shutdown_connections 2024-03-12T17:19:42.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.269+0000 7fa68cc00640 1 -- 172.21.15.17:0/1988616514 wait complete. 2024-03-12T17:19:42.282 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T17:19:42.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.509+0000 7f1a27e00640 1 Processor -- start 2024-03-12T17:19:42.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.509+0000 7f1a27e00640 1 -- start start 2024-03-12T17:19:42.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.510+0000 7f1a27e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a281441f0 0x7f1a28070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:42.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.511+0000 7f1a27e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1a280b3b70 0x7f1a280b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:42.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.511+0000 7f1a27e00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a280a7660 con 0x7f1a2815ae20 2024-03-12T17:19:42.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.511+0000 7f1a27e00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a2815e460 con 0x7f1a280b3b70 2024-03-12T17:19:42.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.511+0000 7f1a27e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2806d840 con 0x7f1a281441f0 2024-03-12T17:19:42.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.511+0000 7f1a1fe00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f1a2815ae20 0x7f1a2806d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:40756/0 (socket says 172.21.15.17:40756) 2024-03-12T17:19:42.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.511+0000 7f1a1fe00640 1 -- 172.21.15.17:0/902609981 learned_addr learned my addr 172.21.15.17:0/902609981 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:42.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.511+0000 7f1a27400640 1 --2- 172.21.15.17:0/902609981 >> v2:172.21.15.17:3300/0 conn(0x7f1a280b3b70 0x7f1a280b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:42.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.511+0000 7f1a26a00640 1 --2- 172.21.15.17:0/902609981 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a281441f0 0x7f1a28070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:42.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.511+0000 7f1a26000640 1 -- 172.21.15.17:0/902609981 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3379446026 0 0) 0x7f1a280a7660 con 0x7f1a2815ae20 2024-03-12T17:19:42.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.511+0000 7f1a26000640 1 -- 172.21.15.17:0/902609981 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a0c003520 con 0x7f1a2815ae20 2024-03-12T17:19:42.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.511+0000 7f1a27400640 1 -- 172.21.15.17:0/902609981 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a281441f0 msgr2=0x7f1a28070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:42.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.511+0000 7f1a27400640 1 --2- 172.21.15.17:0/902609981 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a281441f0 0x7f1a28070240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:42.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.512+0000 7f1a27400640 1 -- 172.21.15.17:0/902609981 >> v1:172.21.15.17:6789/0 conn(0x7f1a2815ae20 legacy=0x7f1a2806d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:42.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.512+0000 7f1a27400640 1 -- 172.21.15.17:0/902609981 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a281445d0 con 0x7f1a280b3b70 2024-03-12T17:19:42.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.513+0000 7f1a27400640 1 --2- 172.21.15.17:0/902609981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a280b3b70 0x7f1a280b3fe0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1a20009d90 tx=0x7f1a2002bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=424b269f9e8168b server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:42.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.513+0000 7f1a26000640 1 -- 172.21.15.17:0/902609981 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2002cce0 con 0x7f1a280b3b70 2024-03-12T17:19:42.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.513+0000 7f1a26000640 1 -- 172.21.15.17:0/902609981 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2002ce40 con 0x7f1a280b3b70 2024-03-12T17:19:42.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.513+0000 7f1a26000640 1 -- 172.21.15.17:0/902609981 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a20034660 con 0x7f1a280b3b70 2024-03-12T17:19:42.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.513+0000 7f1a27e00640 1 -- 172.21.15.17:0/902609981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a280b3b70 msgr2=0x7f1a280b3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:42.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.513+0000 7f1a27e00640 1 --2- 172.21.15.17:0/902609981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a280b3b70 0x7f1a280b3fe0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1a20009d90 tx=0x7f1a2002bf30 comp rx=0 tx=0).stop 2024-03-12T17:19:42.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.514+0000 7f1a27e00640 1 -- 172.21.15.17:0/902609981 shutdown_connections 2024-03-12T17:19:42.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.514+0000 7f1a27e00640 1 --2- 172.21.15.17:0/902609981 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a280b3b70 0x7f1a280b3fe0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:42.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.514+0000 7f1a27e00640 1 --2- 172.21.15.17:0/902609981 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a281441f0 0x7f1a28070240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:42.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.514+0000 7f1a27e00640 1 -- 172.21.15.17:0/902609981 >> 172.21.15.17:0/902609981 conn(0x7f1a28069ce0 msgr2=0x7f1a2806a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:42.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.514+0000 7f1a27e00640 1 -- 172.21.15.17:0/902609981 shutdown_connections 2024-03-12T17:19:42.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.514+0000 7f1a27e00640 1 -- 172.21.15.17:0/902609981 wait complete. 2024-03-12T17:19:42.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.515+0000 7f1a27e00640 1 Processor -- start 2024-03-12T17:19:42.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.516+0000 7f1a27e00640 1 -- start start 2024-03-12T17:19:42.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.517+0000 7f1a27e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a280b3b70 0x7f1a2815a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:42.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.517+0000 7f1a27e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a281441f0 0x7f1a2813d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:42.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.517+0000 7f1a27e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a2815ae20 0x7f1a2813aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:42.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.517+0000 7f1a27e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a28139b00 con 0x7f1a2815ae20 2024-03-12T17:19:42.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.517+0000 7f1a27e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a28139de0 con 0x7f1a281441f0 2024-03-12T17:19:42.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.517+0000 7f1a27e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2813a0c0 con 0x7f1a280b3b70 2024-03-12T17:19:42.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.517+0000 7f1a27400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a2815ae20 0x7f1a2813aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:42.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.517+0000 7f1a27400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a2815ae20 0x7f1a2813aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39652/0 (socket says 172.21.15.17:39652) 2024-03-12T17:19:42.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.517+0000 7f1a27400640 1 -- 172.21.15.17:0/3671144600 learned_addr learned my addr 172.21.15.17:0/3671144600 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:42.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.517+0000 7f1a26a00640 1 --2- 172.21.15.17:0/3671144600 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a280b3b70 0x7f1a2815a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:42.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.517+0000 7f1a1fe00640 1 --2- 172.21.15.17:0/3671144600 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a281441f0 0x7f1a2813d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:42.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.517+0000 7f1a27400640 1 -- 172.21.15.17:0/3671144600 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a280b3b70 msgr2=0x7f1a2815a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:42.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.517+0000 7f1a27400640 1 --2- 172.21.15.17:0/3671144600 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a280b3b70 0x7f1a2815a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:42.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.517+0000 7f1a27400640 1 -- 172.21.15.17:0/3671144600 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a281441f0 msgr2=0x7f1a2813d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:42.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.517+0000 7f1a27400640 1 --2- 172.21.15.17:0/3671144600 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a281441f0 0x7f1a2813d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:42.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.517+0000 7f1a27400640 1 -- 172.21.15.17:0/3671144600 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a20009a70 con 0x7f1a2815ae20 2024-03-12T17:19:42.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.518+0000 7f1a26a00640 1 --2- 172.21.15.17:0/3671144600 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a280b3b70 0x7f1a2815a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:42.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.518+0000 7f1a27400640 1 --2- 172.21.15.17:0/3671144600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a2815ae20 0x7f1a2813aba0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1a20009d90 tx=0x7f1a20004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:42.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.518+0000 7f1a1f400640 1 -- 172.21.15.17:0/3671144600 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2003d600 con 0x7f1a2815ae20 2024-03-12T17:19:42.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.518+0000 7f1a1f400640 1 -- 172.21.15.17:0/3671144600 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2003d780 con 0x7f1a2815ae20 2024-03-12T17:19:42.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.518+0000 7f1a1f400640 1 -- 172.21.15.17:0/3671144600 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2003db30 con 0x7f1a2815ae20 2024-03-12T17:19:42.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.518+0000 7f1a27e00640 1 -- 172.21.15.17:0/3671144600 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a2813a3a0 con 0x7f1a2815ae20 2024-03-12T17:19:42.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.518+0000 7f1a27e00640 1 -- 172.21.15.17:0/3671144600 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a2815a770 con 0x7f1a2815ae20 2024-03-12T17:19:42.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.520+0000 7f1a27e00640 1 -- 172.21.15.17:0/3671144600 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a280665e0 con 0x7f1a2815ae20 2024-03-12T17:19:42.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.520+0000 7f1a1f400640 1 -- 172.21.15.17:0/3671144600 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f1a2003b040 con 0x7f1a2815ae20 2024-03-12T17:19:42.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.522+0000 7f1a1f400640 1 --2- 172.21.15.17:0/3671144600 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f1a0406ac00 0x7f1a0406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:42.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.522+0000 7f1a1f400640 1 -- 172.21.15.17:0/3671144600 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f1a200ab9e0 con 0x7f1a2815ae20 2024-03-12T17:19:42.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.522+0000 7f1a26a00640 1 --2- 172.21.15.17:0/3671144600 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f1a0406ac00 0x7f1a0406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:42.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.523+0000 7f1a26a00640 1 --2- 172.21.15.17:0/3671144600 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f1a0406ac00 0x7f1a0406d0c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1a18006fd0 tx=0x7f1a18008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:42.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.526+0000 7f1a1f400640 1 -- 172.21.15.17:0/3671144600 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f1a20076bc0 con 0x7f1a2815ae20 2024-03-12T17:19:42.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.730+0000 7f1a27e00640 1 -- 172.21.15.17:0/3671144600 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a2804e030 con 0x7f1a2815ae20 2024-03-12T17:19:42.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.733+0000 7f1a1f400640 1 -- 172.21.15.17:0/3671144600 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16238 (secure 0 0 0) 0x7f1a20039020 con 0x7f1a2815ae20 2024-03-12T17:19:42.727 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:19:42.727 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":23,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:19:33.387374+0000","last_up_change":"2024-03-12T17:18:38.144756+0000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-12T17:18:39.552910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-12T17:18:43.794908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-12T17:18:44.867006+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":37305},{"type":"v1","addr":"172.21.15.17:6801","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":37305},{"type":"v1","addr":"172.21.15.17:6803","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":37305},{"type":"v1","addr":"172.21.15.17:6807","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":37305},{"type":"v1","addr":"172.21.15.17:6805","nonce":37305}]},"public_addr":"172.21.15.17:6801/37305","cluster_addr":"172.21.15.17:6803/37305","heartbeat_back_addr":"172.21.15.17:6807/37305","heartbeat_front_addr":"172.21.15.17:6805/37305","state":["exists","up"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":37307},{"type":"v1","addr":"172.21.15.17:6814","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":37307},{"type":"v1","addr":"172.21.15.17:6818","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":37307},{"type":"v1","addr":"172.21.15.17:6827","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":37307},{"type":"v1","addr":"172.21.15.17:6823","nonce":37307}]},"public_addr":"172.21.15.17:6814/37307","cluster_addr":"172.21.15.17:6818/37307","heartbeat_back_addr":"172.21.15.17:6827/37307","heartbeat_front_addr":"172.21.15.17:6823/37307","state":["exists","up"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":37303},{"type":"v1","addr":"172.21.15.17:6809","nonce":37303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":37303},{"type":"v1","addr":"172.21.15.17:6811","nonce":37303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":37303},{"type":"v1","addr":"172.21.15.17:6819","nonce":37303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":37303},{"type":"v1","addr":"172.21.15.17:6815","nonce":37303}]},"public_addr":"172.21.15.17:6809/37303","cluster_addr":"172.21.15.17:6811/37303","heartbeat_back_addr":"172.21.15.17:6819/37303","heartbeat_front_addr":"172.21.15.17:6815/37303","state":["exists","up"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":37308},{"type":"v1","addr":"172.21.15.17:6822","nonce":37308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":37308},{"type":"v1","addr":"172.21.15.17:6826","nonce":37308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":37308},{"type":"v1","addr":"172.21.15.17:6831","nonce":37308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":37308},{"type":"v1","addr":"172.21.15.17:6829","nonce":37308}]},"public_addr":"172.21.15.17:6822/37308","cluster_addr":"172.21.15.17:6826/37308","heartbeat_back_addr":"172.21.15.17:6831/37308","heartbeat_front_addr":"172.21.15.17:6829/37308","state":["exists","up"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":37465},{"type":"v1","addr":"172.21.15.94:6809","nonce":37465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6811","nonce":37465},{"type":"v1","addr":"172.21.15.94:6813","nonce":37465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6819","nonce":37465},{"type":"v1","addr":"172.21.15.94:6822","nonce":37465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6815","nonce":37465},{"type":"v1","addr":"172.21.15.94:6817","nonce":37465}]},"public_addr":"172.21.15.94:6809/37465","cluster_addr":"172.21.15.94:6813/37465","heartbeat_back_addr":"172.21.15.94:6822/37465","heartbeat_front_addr":"172.21.15.94:6817/37465","state":["exists","up"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":37464},{"type":"v1","addr":"172.21.15.94:6812","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":37464},{"type":"v1","addr":"172.21.15.94:6816","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":37464},{"type":"v1","addr":"172.21.15.94:6823","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":37464},{"type":"v1","addr":"172.21.15.94:6820","nonce":37464}]},"public_addr":"172.21.15.94:6812/37464","cluster_addr":"172.21.15.94:6816/37464","heartbeat_back_addr":"172.21.15.94:6823/37464","heartbeat_front_addr":"172.21.15.94:6820/37464","state":["exists","up"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":37467},{"type":"v1","addr":"172.21.15.94:6825","nonce":37467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":37467},{"type":"v1","addr":"172.21.15.94:6827","nonce":37467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":37467},{"type":"v1","addr":"172.21.15.94:6831","nonce":37467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":37467},{"type":"v1","addr":"172.21.15.94:6829","nonce":37467}]},"public_addr":"172.21.15.94:6825/37467","cluster_addr":"172.21.15.94:6827/37467","heartbeat_back_addr":"172.21.15.94:6831/37467","heartbeat_front_addr":"172.21.15.94:6829/37467","state":["exists","up"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":37466},{"type":"v1","addr":"172.21.15.94:6801","nonce":37466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":37466},{"type":"v1","addr":"172.21.15.94:6803","nonce":37466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":37466},{"type":"v1","addr":"172.21.15.94:6807","nonce":37466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":37466},{"type":"v1","addr":"172.21.15.94:6805","nonce":37466}]},"public_addr":"172.21.15.94:6801/37466","cluster_addr":"172.21.15.94:6803/37466","heartbeat_back_addr":"172.21.15.94:6807/37466","heartbeat_front_addr":"172.21.15.94:6805/37466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.327217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.186966+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.419986+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.150585+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.120621+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.121576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.181257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.293188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:19:42.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.735+0000 7f1a27e00640 1 -- 172.21.15.17:0/3671144600 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f1a0406ac00 msgr2=0x7f1a0406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:42.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.735+0000 7f1a27e00640 1 --2- 172.21.15.17:0/3671144600 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f1a0406ac00 0x7f1a0406d0c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1a18006fd0 tx=0x7f1a18008040 comp rx=0 tx=0).stop 2024-03-12T17:19:42.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.735+0000 7f1a27e00640 1 -- 172.21.15.17:0/3671144600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a2815ae20 msgr2=0x7f1a2813aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:42.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.735+0000 7f1a27e00640 1 --2- 172.21.15.17:0/3671144600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a2815ae20 0x7f1a2813aba0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1a20009d90 tx=0x7f1a20004a40 comp rx=0 tx=0).stop 2024-03-12T17:19:42.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.736+0000 7f1a27e00640 1 -- 172.21.15.17:0/3671144600 shutdown_connections 2024-03-12T17:19:42.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.736+0000 7f1a27e00640 1 --2- 172.21.15.17:0/3671144600 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f1a0406ac00 0x7f1a0406d0c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:42.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.736+0000 7f1a27e00640 1 --2- 172.21.15.17:0/3671144600 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a2815ae20 0x7f1a2813aba0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:42.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.736+0000 7f1a27e00640 1 --2- 172.21.15.17:0/3671144600 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a281441f0 0x7f1a2813d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:42.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.736+0000 7f1a27e00640 1 --2- 172.21.15.17:0/3671144600 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a280b3b70 0x7f1a2815a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:42.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.736+0000 7f1a27e00640 1 -- 172.21.15.17:0/3671144600 >> 172.21.15.17:0/3671144600 conn(0x7f1a28069ce0 msgr2=0x7f1a2815d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:42.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.736+0000 7f1a27e00640 1 -- 172.21.15.17:0/3671144600 shutdown_connections 2024-03-12T17:19:42.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.736+0000 7f1a27e00640 1 -- 172.21.15.17:0/3671144600 wait complete. 2024-03-12T17:19:42.749 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-12T17:19:42.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.979+0000 7f79b2200640 1 Processor -- start 2024-03-12T17:19:42.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.979+0000 7f79b2200640 1 -- start start 2024-03-12T17:19:42.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.981+0000 7f79b2200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f79ac160090 0x7f79ac06b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:42.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.981+0000 7f79b2200640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f79ac0b4b20 0x7f79ac0d1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:42.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.981+0000 7f79b2200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79ac160470 con 0x7f79ac0b86c0 2024-03-12T17:19:42.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.981+0000 7f79b2200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79ac0d0e40 con 0x7f79ac160090 2024-03-12T17:19:42.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.981+0000 7f79b2200640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79ac0d0a80 con 0x7f79ac0b4b20 2024-03-12T17:19:42.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.981+0000 7f79b0e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f79ac160090 0x7f79ac06b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:42.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.981+0000 7f79b0e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f79ac160090 0x7f79ac06b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39666/0 (socket says 172.21.15.17:39666) 2024-03-12T17:19:42.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.981+0000 7f79b0e00640 1 -- 172.21.15.17:0/2132157680 learned_addr learned my addr 172.21.15.17:0/2132157680 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:42.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.982+0000 7f79b1800640 1 --2- 172.21.15.17:0/2132157680 >> v2:172.21.15.94:3300/0 conn(0x7f79ac0b4b20 0x7f79ac0d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:42.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.982+0000 7f79b0e00640 1 -- 172.21.15.17:0/2132157680 >> v2:172.21.15.94:3300/0 conn(0x7f79ac0b4b20 msgr2=0x7f79ac0d1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:42.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.982+0000 7f79b0e00640 1 --2- 172.21.15.17:0/2132157680 >> v2:172.21.15.94:3300/0 conn(0x7f79ac0b4b20 0x7f79ac0d1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:42.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.982+0000 7f79b0e00640 1 -- 172.21.15.17:0/2132157680 >> v1:172.21.15.94:6789/0 conn(0x7f79ac0b86c0 legacy=0x7f79ac0b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:42.977 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.982+0000 7f79b0e00640 1 -- 172.21.15.17:0/2132157680 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ac06baa0 con 0x7f79ac160090 2024-03-12T17:19:42.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.983+0000 7f79b0e00640 1 --2- 172.21.15.17:0/2132157680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79ac160090 0x7f79ac06b130 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f79ac0cf160 tx=0x7f799c02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54f5ae3bc72e6f17 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:42.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.983+0000 7f79abe00640 1 -- 172.21.15.17:0/2132157680 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c02c9f0 con 0x7f79ac160090 2024-03-12T17:19:42.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.984+0000 7f79abe00640 1 -- 172.21.15.17:0/2132157680 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799c02cb50 con 0x7f79ac160090 2024-03-12T17:19:42.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.984+0000 7f79abe00640 1 -- 172.21.15.17:0/2132157680 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c0343f0 con 0x7f79ac160090 2024-03-12T17:19:42.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.984+0000 7f79b2200640 1 -- 172.21.15.17:0/2132157680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79ac160090 msgr2=0x7f79ac06b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:42.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.984+0000 7f79b2200640 1 --2- 172.21.15.17:0/2132157680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79ac160090 0x7f79ac06b130 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f79ac0cf160 tx=0x7f799c02be50 comp rx=0 tx=0).stop 2024-03-12T17:19:42.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.984+0000 7f79b2200640 1 -- 172.21.15.17:0/2132157680 shutdown_connections 2024-03-12T17:19:42.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.984+0000 7f79b2200640 1 --2- 172.21.15.17:0/2132157680 >> v2:172.21.15.94:3300/0 conn(0x7f79ac0b4b20 0x7f79ac0d1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:42.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.984+0000 7f79b2200640 1 --2- 172.21.15.17:0/2132157680 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79ac160090 0x7f79ac06b130 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:42.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.984+0000 7f79b2200640 1 -- 172.21.15.17:0/2132157680 >> 172.21.15.17:0/2132157680 conn(0x7f79ac0cf5f0 msgr2=0x7f79ac0cfa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:42.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.985+0000 7f79b2200640 1 -- 172.21.15.17:0/2132157680 shutdown_connections 2024-03-12T17:19:42.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.985+0000 7f79b2200640 1 -- 172.21.15.17:0/2132157680 wait complete. 2024-03-12T17:19:42.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.987+0000 7f79b2200640 1 Processor -- start 2024-03-12T17:19:42.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.987+0000 7f79b2200640 1 -- start start 2024-03-12T17:19:42.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.988+0000 7f79b2200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79ac0b4b20 0x7f79ac158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:42.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.988+0000 7f79b2200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f79ac0b86c0 0x7f79ac0c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:42.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.988+0000 7f79b2200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f79ac160090 0x7f79ac15af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:42.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.988+0000 7f79b2200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac0c93c0 con 0x7f79ac0b4b20 2024-03-12T17:19:42.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.988+0000 7f79b2200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac156640 con 0x7f79ac160090 2024-03-12T17:19:42.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.988+0000 7f79b2200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79ac156360 con 0x7f79ac0b86c0 2024-03-12T17:19:42.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.989+0000 7f79b0e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79ac0b4b20 0x7f79ac158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:42.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.989+0000 7f79b0e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79ac0b4b20 0x7f79ac158f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39676/0 (socket says 172.21.15.17:39676) 2024-03-12T17:19:42.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.989+0000 7f79b0e00640 1 -- 172.21.15.17:0/929720241 learned_addr learned my addr 172.21.15.17:0/929720241 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:42.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.989+0000 7f79b1800640 1 --2- 172.21.15.17:0/929720241 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f79ac160090 0x7f79ac15af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:42.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.989+0000 7f79a3e00640 1 --2- 172.21.15.17:0/929720241 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f79ac0b86c0 0x7f79ac0c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:42.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.989+0000 7f79b0e00640 1 -- 172.21.15.17:0/929720241 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f79ac0b86c0 msgr2=0x7f79ac0c8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:42.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.989+0000 7f79b0e00640 1 --2- 172.21.15.17:0/929720241 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f79ac0b86c0 0x7f79ac0c8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:42.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.989+0000 7f79b0e00640 1 -- 172.21.15.17:0/929720241 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f79ac160090 msgr2=0x7f79ac15af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:42.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.989+0000 7f79b0e00640 1 --2- 172.21.15.17:0/929720241 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f79ac160090 0x7f79ac15af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:42.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.989+0000 7f79b0e00640 1 -- 172.21.15.17:0/929720241 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f799c009b30 con 0x7f79ac0b4b20 2024-03-12T17:19:42.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.990+0000 7f79b0e00640 1 --2- 172.21.15.17:0/929720241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79ac0b4b20 0x7f79ac158f70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f799c000f80 tx=0x7f799c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:42.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.990+0000 7f79a9600640 1 -- 172.21.15.17:0/929720241 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c009510 con 0x7f79ac0b4b20 2024-03-12T17:19:42.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.990+0000 7f79a9600640 1 -- 172.21.15.17:0/929720241 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799c03e450 con 0x7f79ac0b4b20 2024-03-12T17:19:42.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.990+0000 7f79a9600640 1 -- 172.21.15.17:0/929720241 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799c03e800 con 0x7f79ac0b4b20 2024-03-12T17:19:42.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.990+0000 7f79b2200640 1 -- 172.21.15.17:0/929720241 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79ac0c9e60 con 0x7f79ac0b4b20 2024-03-12T17:19:42.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.990+0000 7f79b2200640 1 -- 172.21.15.17:0/929720241 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79ac155f80 con 0x7f79ac0b4b20 2024-03-12T17:19:42.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.991+0000 7f79b2200640 1 -- 172.21.15.17:0/929720241 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79ac067120 con 0x7f79ac0b4b20 2024-03-12T17:19:42.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.992+0000 7f79a9600640 1 -- 172.21.15.17:0/929720241 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f799c03e960 con 0x7f79ac0b4b20 2024-03-12T17:19:42.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.993+0000 7f79a9600640 1 --2- 172.21.15.17:0/929720241 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f798806ac00 0x7f798806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:42.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.993+0000 7f79a9600640 1 -- 172.21.15.17:0/929720241 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f799c0ac1d0 con 0x7f79ac0b4b20 2024-03-12T17:19:42.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.994+0000 7f79a3e00640 1 --2- 172.21.15.17:0/929720241 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f798806ac00 0x7f798806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:42.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.994+0000 7f79a3e00640 1 --2- 172.21.15.17:0/929720241 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f798806ac00 0x7f798806d0c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f79ac14be40 tx=0x7f7994009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:42.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:42.998+0000 7f79a9600640 1 -- 172.21.15.17:0/929720241 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f799c077330 con 0x7f79ac0b4b20 2024-03-12T17:19:43.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.241+0000 7f79b2200640 1 -- 172.21.15.17:0/929720241 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f79ac072360 con 0x7f79ac0b4b20 2024-03-12T17:19:43.237 INFO:tasks.ceph.mon.a.smithi017.stderr:2024-03-12T17:19:43.243+0000 7f30e5800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-12T17:19:43.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.258+0000 7f79a9600640 1 -- 172.21.15.17:0/929720241 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f799c07a950 con 0x7f79ac0b4b20 2024-03-12T17:19:43.252 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-12T17:19:43.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.261+0000 7f79b2200640 1 -- 172.21.15.17:0/929720241 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f798806ac00 msgr2=0x7f798806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:43.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.261+0000 7f79b2200640 1 --2- 172.21.15.17:0/929720241 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f798806ac00 0x7f798806d0c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f79ac14be40 tx=0x7f7994009040 comp rx=0 tx=0).stop 2024-03-12T17:19:43.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.261+0000 7f79b2200640 1 -- 172.21.15.17:0/929720241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79ac0b4b20 msgr2=0x7f79ac158f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:43.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.261+0000 7f79b2200640 1 --2- 172.21.15.17:0/929720241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79ac0b4b20 0x7f79ac158f70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f799c000f80 tx=0x7f799c004a40 comp rx=0 tx=0).stop 2024-03-12T17:19:43.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.261+0000 7f79b2200640 1 -- 172.21.15.17:0/929720241 shutdown_connections 2024-03-12T17:19:43.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.261+0000 7f79b2200640 1 --2- 172.21.15.17:0/929720241 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f798806ac00 0x7f798806d0c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:43.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.261+0000 7f79b2200640 1 --2- 172.21.15.17:0/929720241 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f79ac160090 0x7f79ac15af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:43.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.261+0000 7f79b2200640 1 --2- 172.21.15.17:0/929720241 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f79ac0b86c0 0x7f79ac0c8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:43.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.261+0000 7f79b2200640 1 --2- 172.21.15.17:0/929720241 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f79ac0b4b20 0x7f79ac158f70 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:43.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.261+0000 7f79b2200640 1 -- 172.21.15.17:0/929720241 >> 172.21.15.17:0/929720241 conn(0x7f79ac0cf5f0 msgr2=0x7f79ac0b24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:43.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.261+0000 7f79b2200640 1 -- 172.21.15.17:0/929720241 shutdown_connections 2024-03-12T17:19:43.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.261+0000 7f79b2200640 1 -- 172.21.15.17:0/929720241 wait complete. 2024-03-12T17:19:43.276 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-12T17:19:43.342 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2024-03-12T17:19:43.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.479+0000 7f0ab7a00640 1 Processor -- start 2024-03-12T17:19:43.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.480+0000 7f0ab7a00640 1 -- start start 2024-03-12T17:19:43.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.481+0000 7f0ab7a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0ab00b5b50 0x7f0ab00b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:43.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.481+0000 7f0ab7a00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0ab00cd840 0x7f0ab00cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:43.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.481+0000 7f0ab7a00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ab00d14e0 con 0x7f0ab00d2fa0 2024-03-12T17:19:43.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.481+0000 7f0ab7a00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ab00b59e0 con 0x7f0ab00b5b50 2024-03-12T17:19:43.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.481+0000 7f0ab7a00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ab00b85b0 con 0x7f0ab00cd840 2024-03-12T17:19:43.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.482+0000 7f0aafe00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0ab00b5b50 0x7f0ab00b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:43.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.482+0000 7f0aafe00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0ab00b5b50 0x7f0ab00b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39710/0 (socket says 172.21.15.17:39710) 2024-03-12T17:19:43.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.482+0000 7f0aafe00640 1 -- 172.21.15.17:0/390512255 learned_addr learned my addr 172.21.15.17:0/390512255 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:43.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.482+0000 7f0aafe00640 1 -- 172.21.15.17:0/390512255 >> v2:172.21.15.94:3300/0 conn(0x7f0ab00cd840 msgr2=0x7f0ab00cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:43.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.482+0000 7f0aafe00640 1 --2- 172.21.15.17:0/390512255 >> v2:172.21.15.94:3300/0 conn(0x7f0ab00cd840 0x7f0ab00cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:43.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.482+0000 7f0aafe00640 1 -- 172.21.15.17:0/390512255 >> v1:172.21.15.94:6789/0 conn(0x7f0ab00d2fa0 legacy=0x7f0ab00d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:43.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.482+0000 7f0aafe00640 1 -- 172.21.15.17:0/390512255 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab00b8890 con 0x7f0ab00b5b50 2024-03-12T17:19:43.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.483+0000 7f0aafe00640 1 --2- 172.21.15.17:0/390512255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ab00b5b50 0x7f0ab00b5f70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0ab00cd480 tx=0x7f0a9c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8f74aed62d6f241 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:43.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.484+0000 7f0aaf400640 1 -- 172.21.15.17:0/390512255 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c031870 con 0x7f0ab00b5b50 2024-03-12T17:19:43.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.484+0000 7f0aaf400640 1 -- 172.21.15.17:0/390512255 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9c0319d0 con 0x7f0ab00b5b50 2024-03-12T17:19:43.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.484+0000 7f0aaf400640 1 -- 172.21.15.17:0/390512255 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c031d60 con 0x7f0ab00b5b50 2024-03-12T17:19:43.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.484+0000 7f0ab7a00640 1 -- 172.21.15.17:0/390512255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ab00b5b50 msgr2=0x7f0ab00b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:43.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.484+0000 7f0ab7a00640 1 --2- 172.21.15.17:0/390512255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ab00b5b50 0x7f0ab00b5f70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f0ab00cd480 tx=0x7f0a9c02b910 comp rx=0 tx=0).stop 2024-03-12T17:19:43.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.485+0000 7f0ab7a00640 1 -- 172.21.15.17:0/390512255 shutdown_connections 2024-03-12T17:19:43.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.485+0000 7f0ab7a00640 1 --2- 172.21.15.17:0/390512255 >> v2:172.21.15.94:3300/0 conn(0x7f0ab00cd840 0x7f0ab00cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:43.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.485+0000 7f0ab7a00640 1 --2- 172.21.15.17:0/390512255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ab00b5b50 0x7f0ab00b5f70 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:43.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.485+0000 7f0ab7a00640 1 -- 172.21.15.17:0/390512255 >> 172.21.15.17:0/390512255 conn(0x7f0ab0065df0 msgr2=0x7f0ab0066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:43.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.485+0000 7f0ab7a00640 1 -- 172.21.15.17:0/390512255 shutdown_connections 2024-03-12T17:19:43.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.485+0000 7f0ab7a00640 1 -- 172.21.15.17:0/390512255 wait complete. 2024-03-12T17:19:43.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.487+0000 7f0ab7a00640 1 Processor -- start 2024-03-12T17:19:43.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.487+0000 7f0ab7a00640 1 -- start start 2024-03-12T17:19:43.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.488+0000 7f0ab7a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ab00cd840 0x7f0ab0149ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:43.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.488+0000 7f0ab7a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0ab00d2fa0 0x7f0ab015fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:43.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.488+0000 7f0ab7a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ab0157180 0x7f0ab006b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:43.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.488+0000 7f0ab7a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab015adc0 con 0x7f0ab0157180 2024-03-12T17:19:43.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.488+0000 7f0ab7a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab015a930 con 0x7f0ab00cd840 2024-03-12T17:19:43.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.488+0000 7f0ab7a00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab0159d90 con 0x7f0ab00d2fa0 2024-03-12T17:19:43.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.488+0000 7f0ab5a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ab0157180 0x7f0ab006b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:43.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.488+0000 7f0ab5a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ab0157180 0x7f0ab006b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39716/0 (socket says 172.21.15.17:39716) 2024-03-12T17:19:43.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.488+0000 7f0ab5a00640 1 -- 172.21.15.17:0/2037372360 learned_addr learned my addr 172.21.15.17:0/2037372360 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:43.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.488+0000 7f0ab5000640 1 --2- 172.21.15.17:0/2037372360 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ab00cd840 0x7f0ab0149ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:43.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.488+0000 7f0aafe00640 1 --2- 172.21.15.17:0/2037372360 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0ab00d2fa0 0x7f0ab015fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:43.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.488+0000 7f0ab5a00640 1 -- 172.21.15.17:0/2037372360 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0ab00d2fa0 msgr2=0x7f0ab015fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:43.483 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.488+0000 7f0ab5a00640 1 --2- 172.21.15.17:0/2037372360 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0ab00d2fa0 0x7f0ab015fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:43.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.488+0000 7f0ab5a00640 1 -- 172.21.15.17:0/2037372360 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ab00cd840 msgr2=0x7f0ab0149ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:43.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.488+0000 7f0ab5a00640 1 --2- 172.21.15.17:0/2037372360 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ab00cd840 0x7f0ab0149ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:43.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.489+0000 7f0ab5a00640 1 -- 172.21.15.17:0/2037372360 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9c0094d0 con 0x7f0ab0157180 2024-03-12T17:19:43.484 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.489+0000 7f0ab5000640 1 --2- 172.21.15.17:0/2037372360 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ab00cd840 0x7f0ab0149ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:43.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.489+0000 7f0ab5a00640 1 --2- 172.21.15.17:0/2037372360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ab0157180 0x7f0ab006b300 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0aa800b9a0 tx=0x7f0aa800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:43.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.489+0000 7f0aacc00640 1 -- 172.21.15.17:0/2037372360 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa800cba0 con 0x7f0ab0157180 2024-03-12T17:19:43.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.489+0000 7f0aacc00640 1 -- 172.21.15.17:0/2037372360 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa800cd20 con 0x7f0ab0157180 2024-03-12T17:19:43.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.489+0000 7f0aacc00640 1 -- 172.21.15.17:0/2037372360 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8014680 con 0x7f0ab0157180 2024-03-12T17:19:43.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.489+0000 7f0ab7a00640 1 -- 172.21.15.17:0/2037372360 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ab014a3e0 con 0x7f0ab0157180 2024-03-12T17:19:43.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.489+0000 7f0ab7a00640 1 -- 172.21.15.17:0/2037372360 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ab015a2e0 con 0x7f0ab0157180 2024-03-12T17:19:43.485 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.490+0000 7f0ab7a00640 1 -- 172.21.15.17:0/2037372360 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ab015aac0 con 0x7f0ab0157180 2024-03-12T17:19:43.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.492+0000 7f0aacc00640 1 -- 172.21.15.17:0/2037372360 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f0aa801d3b0 con 0x7f0ab0157180 2024-03-12T17:19:43.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.493+0000 7f0aacc00640 1 --2- 172.21.15.17:0/2037372360 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f0a9006ac00 0x7f0a9006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:43.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.493+0000 7f0aacc00640 1 -- 172.21.15.17:0/2037372360 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f0aa8089450 con 0x7f0ab0157180 2024-03-12T17:19:43.487 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.493+0000 7f0ab5000640 1 --2- 172.21.15.17:0/2037372360 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f0a9006ac00 0x7f0a9006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:43.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.494+0000 7f0ab5000640 1 --2- 172.21.15.17:0/2037372360 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f0a9006ac00 0x7f0a9006d0c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0aa000a830 tx=0x7f0aa0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:43.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.497+0000 7f0aacc00640 1 -- 172.21.15.17:0/2037372360 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f0aa80544c0 con 0x7f0ab0157180 2024-03-12T17:19:43.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:43.743+0000 7f0ab7a00640 1 -- 172.21.15.17:0/2037372360 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0ab00cd050 con 0x7f0ab0157180 2024-03-12T17:19:44.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.268+0000 7f0aacc00640 1 -- 172.21.15.17:0/2037372360 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0aa8057ae0 con 0x7f0ab0157180 2024-03-12T17:19:44.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.272+0000 7f0ab7a00640 1 -- 172.21.15.17:0/2037372360 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f0a9006ac00 msgr2=0x7f0a9006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:44.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.272+0000 7f0ab7a00640 1 --2- 172.21.15.17:0/2037372360 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f0a9006ac00 0x7f0a9006d0c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0aa000a830 tx=0x7f0aa0008040 comp rx=0 tx=0).stop 2024-03-12T17:19:44.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.272+0000 7f0ab7a00640 1 -- 172.21.15.17:0/2037372360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ab0157180 msgr2=0x7f0ab006b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:44.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.272+0000 7f0ab7a00640 1 --2- 172.21.15.17:0/2037372360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ab0157180 0x7f0ab006b300 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0aa800b9a0 tx=0x7f0aa800be60 comp rx=0 tx=0).stop 2024-03-12T17:19:44.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.272+0000 7f0ab7a00640 1 -- 172.21.15.17:0/2037372360 shutdown_connections 2024-03-12T17:19:44.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.272+0000 7f0ab7a00640 1 --2- 172.21.15.17:0/2037372360 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f0a9006ac00 0x7f0a9006d0c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:44.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.272+0000 7f0ab7a00640 1 --2- 172.21.15.17:0/2037372360 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ab0157180 0x7f0ab006b300 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:44.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.272+0000 7f0ab7a00640 1 --2- 172.21.15.17:0/2037372360 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0ab00d2fa0 0x7f0ab015fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:44.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.272+0000 7f0ab7a00640 1 --2- 172.21.15.17:0/2037372360 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ab00cd840 0x7f0ab0149ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:44.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.272+0000 7f0ab7a00640 1 -- 172.21.15.17:0/2037372360 >> 172.21.15.17:0/2037372360 conn(0x7f0ab0065df0 msgr2=0x7f0ab00b3d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:44.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.272+0000 7f0ab7a00640 1 -- 172.21.15.17:0/2037372360 shutdown_connections 2024-03-12T17:19:44.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.272+0000 7f0ab7a00640 1 -- 172.21.15.17:0/2037372360 wait complete. 2024-03-12T17:19:44.288 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-12T17:19:44.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.517+0000 7fa4a0a00640 1 Processor -- start 2024-03-12T17:19:44.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.517+0000 7fa4a0a00640 1 -- start start 2024-03-12T17:19:44.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.518+0000 7fa4a0a00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fa49c0d06c0 0x7fa49c0d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:44.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.519+0000 7fa4a0a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa49c15ab60 0x7fa49c15e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:44.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.519+0000 7fa4a0a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa49c15e9d0 0x7fa49c0cd160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:44.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.519+0000 7fa4a0a00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa49c0cebf0 con 0x7fa49c15e9d0 2024-03-12T17:19:44.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.519+0000 7fa4a0a00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa49c15ee80 con 0x7fa49c0d06c0 2024-03-12T17:19:44.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.519+0000 7fa4a0a00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa49c0cb230 con 0x7fa49c15ab60 2024-03-12T17:19:44.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.519+0000 7fa49a800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa49c15e9d0 0x7fa49c0cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:44.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.519+0000 7fa49a800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa49c15e9d0 0x7fa49c0cd160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39728/0 (socket says 172.21.15.17:39728) 2024-03-12T17:19:44.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.519+0000 7fa49a800640 1 -- 172.21.15.17:0/3975686437 learned_addr learned my addr 172.21.15.17:0/3975686437 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:44.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.519+0000 7fa499400640 1 --2- 172.21.15.17:0/3975686437 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa49c15ab60 0x7fa49c15e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:44.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.519+0000 7fa499e00640 1 --2- 172.21.15.17:0/3975686437 >> v2:172.21.15.94:3300/0 conn(0x7fa49c0d06c0 0x7fa49c0d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:44.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.520+0000 7fa49a800640 1 -- 172.21.15.17:0/3975686437 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa49c15ab60 msgr2=0x7fa49c15e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:44.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.520+0000 7fa49a800640 1 --2- 172.21.15.17:0/3975686437 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa49c15ab60 0x7fa49c15e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:44.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.520+0000 7fa49a800640 1 -- 172.21.15.17:0/3975686437 >> v2:172.21.15.94:3300/0 conn(0x7fa49c0d06c0 msgr2=0x7fa49c0d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:44.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.520+0000 7fa49a800640 1 --2- 172.21.15.17:0/3975686437 >> v2:172.21.15.94:3300/0 conn(0x7fa49c0d06c0 0x7fa49c0d0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:44.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.520+0000 7fa49a800640 1 -- 172.21.15.17:0/3975686437 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa49c0d0fe0 con 0x7fa49c15e9d0 2024-03-12T17:19:44.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.521+0000 7fa49a800640 1 --2- 172.21.15.17:0/3975686437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa49c15e9d0 0x7fa49c0cd160 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa49c0ce370 tx=0x7fa49402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b7a6c4656cc2030 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:44.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.521+0000 7fa498a00640 1 -- 172.21.15.17:0/3975686437 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49402ca70 con 0x7fa49c15e9d0 2024-03-12T17:19:44.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.521+0000 7fa498a00640 1 -- 172.21.15.17:0/3975686437 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49402cbd0 con 0x7fa49c15e9d0 2024-03-12T17:19:44.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.521+0000 7fa498a00640 1 -- 172.21.15.17:0/3975686437 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4940343f0 con 0x7fa49c15e9d0 2024-03-12T17:19:44.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.522+0000 7fa4a0a00640 1 -- 172.21.15.17:0/3975686437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa49c15e9d0 msgr2=0x7fa49c0cd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:44.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.522+0000 7fa4a0a00640 1 --2- 172.21.15.17:0/3975686437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa49c15e9d0 0x7fa49c0cd160 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa49c0ce370 tx=0x7fa49402bed0 comp rx=0 tx=0).stop 2024-03-12T17:19:44.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.522+0000 7fa4a0a00640 1 -- 172.21.15.17:0/3975686437 shutdown_connections 2024-03-12T17:19:44.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.522+0000 7fa4a0a00640 1 --2- 172.21.15.17:0/3975686437 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa49c15e9d0 0x7fa49c0cd160 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:44.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.522+0000 7fa4a0a00640 1 --2- 172.21.15.17:0/3975686437 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa49c15ab60 0x7fa49c15e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:44.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.522+0000 7fa4a0a00640 1 --2- 172.21.15.17:0/3975686437 >> v2:172.21.15.94:3300/0 conn(0x7fa49c0d06c0 0x7fa49c0d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:44.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.522+0000 7fa4a0a00640 1 -- 172.21.15.17:0/3975686437 >> 172.21.15.17:0/3975686437 conn(0x7fa49c06e6d0 msgr2=0x7fa49c06eae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:44.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.522+0000 7fa4a0a00640 1 -- 172.21.15.17:0/3975686437 shutdown_connections 2024-03-12T17:19:44.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.522+0000 7fa4a0a00640 1 -- 172.21.15.17:0/3975686437 wait complete. 2024-03-12T17:19:44.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.524+0000 7fa4a0a00640 1 Processor -- start 2024-03-12T17:19:44.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.524+0000 7fa4a0a00640 1 -- start start 2024-03-12T17:19:44.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.525+0000 7fa4a0a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa49c0d06c0 0x7fa49c15c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:44.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.525+0000 7fa4a0a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa49c15ab60 0x7fa49c15d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:44.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.525+0000 7fa4a0a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa49c15e9d0 0x7fa49c14d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:44.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.525+0000 7fa4a0a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa49c15af90 con 0x7fa49c15e9d0 2024-03-12T17:19:44.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.525+0000 7fa4a0a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa49c15b1e0 con 0x7fa49c15ab60 2024-03-12T17:19:44.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.525+0000 7fa4a0a00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa49c15b4c0 con 0x7fa49c0d06c0 2024-03-12T17:19:44.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.525+0000 7fa49a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa49c15e9d0 0x7fa49c14d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:44.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.525+0000 7fa49a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa49c15e9d0 0x7fa49c14d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39730/0 (socket says 172.21.15.17:39730) 2024-03-12T17:19:44.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.525+0000 7fa49a800640 1 -- 172.21.15.17:0/3144588882 learned_addr learned my addr 172.21.15.17:0/3144588882 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:44.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.526+0000 7fa499e00640 1 --2- 172.21.15.17:0/3144588882 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa49c0d06c0 0x7fa49c15c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:44.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.526+0000 7fa499400640 1 --2- 172.21.15.17:0/3144588882 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa49c15ab60 0x7fa49c15d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:44.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.526+0000 7fa49a800640 1 -- 172.21.15.17:0/3144588882 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa49c0d06c0 msgr2=0x7fa49c15c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:44.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.526+0000 7fa49a800640 1 --2- 172.21.15.17:0/3144588882 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa49c0d06c0 0x7fa49c15c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:44.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.526+0000 7fa49a800640 1 -- 172.21.15.17:0/3144588882 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa49c15ab60 msgr2=0x7fa49c15d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:44.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.526+0000 7fa49a800640 1 --2- 172.21.15.17:0/3144588882 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa49c15ab60 0x7fa49c15d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:44.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.526+0000 7fa49a800640 1 -- 172.21.15.17:0/3144588882 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa494009b30 con 0x7fa49c15e9d0 2024-03-12T17:19:44.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.526+0000 7fa49a800640 1 --2- 172.21.15.17:0/3144588882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa49c15e9d0 0x7fa49c14d610 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa494036040 tx=0x7fa494004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:44.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.526+0000 7fa492000640 1 -- 172.21.15.17:0/3144588882 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa494009510 con 0x7fa49c15e9d0 2024-03-12T17:19:44.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.527+0000 7fa492000640 1 -- 172.21.15.17:0/3144588882 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49403e450 con 0x7fa49c15e9d0 2024-03-12T17:19:44.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.527+0000 7fa492000640 1 -- 172.21.15.17:0/3144588882 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49403e7e0 con 0x7fa49c15e9d0 2024-03-12T17:19:44.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.527+0000 7fa4a0a00640 1 -- 172.21.15.17:0/3144588882 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa49c15b7a0 con 0x7fa49c15e9d0 2024-03-12T17:19:44.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.527+0000 7fa4a0a00640 1 -- 172.21.15.17:0/3144588882 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa49c15bd60 con 0x7fa49c15e9d0 2024-03-12T17:19:44.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.528+0000 7fa4a0a00640 1 -- 172.21.15.17:0/3144588882 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa49c149b20 con 0x7fa49c15e9d0 2024-03-12T17:19:44.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.529+0000 7fa492000640 1 -- 172.21.15.17:0/3144588882 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fa49403e940 con 0x7fa49c15e9d0 2024-03-12T17:19:44.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.530+0000 7fa492000640 1 --2- 172.21.15.17:0/3144588882 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fa47c06ac00 0x7fa47c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:44.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.530+0000 7fa492000640 1 -- 172.21.15.17:0/3144588882 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5911+0+0 (secure 0 0 0) 0x7fa4940ac060 con 0x7fa49c15e9d0 2024-03-12T17:19:44.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.530+0000 7fa499e00640 1 --2- 172.21.15.17:0/3144588882 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fa47c06ac00 0x7fa47c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:44.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.531+0000 7fa499e00640 1 --2- 172.21.15.17:0/3144588882 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fa47c06ac00 0x7fa47c06d0c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa48c006fd0 tx=0x7fa48c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:44.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.535+0000 7fa492000640 1 -- 172.21.15.17:0/3144588882 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fa49c149b20 con 0x7fa49c15e9d0 2024-03-12T17:19:44.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:44.736+0000 7fa4a0a00640 1 -- 172.21.15.17:0/3144588882 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa49c149b20 con 0x7fa49c15e9d0 2024-03-12T17:19:45.575 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.580+0000 7fa492000640 1 -- 172.21.15.17:0/3144588882 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa49c149b20 con 0x7fa49c15e9d0 2024-03-12T17:19:45.575 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2024-03-12T17:19:45.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.586+0000 7fa4a0a00640 1 -- 172.21.15.17:0/3144588882 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fa47c06ac00 msgr2=0x7fa47c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:45.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.586+0000 7fa4a0a00640 1 --2- 172.21.15.17:0/3144588882 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fa47c06ac00 0x7fa47c06d0c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa48c006fd0 tx=0x7fa48c008040 comp rx=0 tx=0).stop 2024-03-12T17:19:45.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.586+0000 7fa4a0a00640 1 -- 172.21.15.17:0/3144588882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa49c15e9d0 msgr2=0x7fa49c14d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:45.580 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.586+0000 7fa4a0a00640 1 --2- 172.21.15.17:0/3144588882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa49c15e9d0 0x7fa49c14d610 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa494036040 tx=0x7fa494004a40 comp rx=0 tx=0).stop 2024-03-12T17:19:45.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.586+0000 7fa4a0a00640 1 -- 172.21.15.17:0/3144588882 shutdown_connections 2024-03-12T17:19:45.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.586+0000 7fa4a0a00640 1 --2- 172.21.15.17:0/3144588882 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fa47c06ac00 0x7fa47c06d0c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:45.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.586+0000 7fa4a0a00640 1 --2- 172.21.15.17:0/3144588882 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa49c15e9d0 0x7fa49c14d610 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:45.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.586+0000 7fa4a0a00640 1 --2- 172.21.15.17:0/3144588882 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa49c15ab60 0x7fa49c15d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:45.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.586+0000 7fa4a0a00640 1 --2- 172.21.15.17:0/3144588882 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa49c0d06c0 0x7fa49c15c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:45.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.586+0000 7fa4a0a00640 1 -- 172.21.15.17:0/3144588882 >> 172.21.15.17:0/3144588882 conn(0x7fa49c06e6d0 msgr2=0x7fa49c0b1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:45.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.587+0000 7fa4a0a00640 1 -- 172.21.15.17:0/3144588882 shutdown_connections 2024-03-12T17:19:45.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.587+0000 7fa4a0a00640 1 -- 172.21.15.17:0/3144588882 wait complete. 2024-03-12T17:19:45.602 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-12T17:19:45.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.829+0000 7f7ca2200640 1 Processor -- start 2024-03-12T17:19:45.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.829+0000 7f7ca2200640 1 -- start start 2024-03-12T17:19:45.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.830+0000 7f7ca2200640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7c9c153d50 0x7f7c9c0b2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:45.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.830+0000 7f7ca2200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7c9c154130 0x7f7c9c0cb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:45.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.830+0000 7f7ca2200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c9c15e380 con 0x7f7c9c0b25a0 2024-03-12T17:19:45.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.830+0000 7f7ca2200640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c9c15df60 con 0x7f7c9c153d50 2024-03-12T17:19:45.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.830+0000 7f7ca2200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c0b2ae0 con 0x7f7c9c154130 2024-03-12T17:19:45.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.831+0000 7f7c9be00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f7c9c0b25a0 0x7f7c9c06d9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:40760/0 (socket says 172.21.15.17:40760) 2024-03-12T17:19:45.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.831+0000 7f7c9be00640 1 -- 172.21.15.17:0/891465715 learned_addr learned my addr 172.21.15.17:0/891465715 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:45.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.831+0000 7f7c92a00640 1 --2- 172.21.15.17:0/891465715 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7c9c154130 0x7f7c9c0cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:45.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.831+0000 7f7c9b400640 1 --2- 172.21.15.17:0/891465715 >> v2:172.21.15.94:3300/0 conn(0x7f7c9c153d50 0x7f7c9c0b2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:45.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.831+0000 7f7c9aa00640 1 -- 172.21.15.17:0/891465715 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4091393120 0 0) 0x7f7c9c15e380 con 0x7f7c9c0b25a0 2024-03-12T17:19:45.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.831+0000 7f7c9aa00640 1 -- 172.21.15.17:0/891465715 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c80003520 con 0x7f7c9c0b25a0 2024-03-12T17:19:45.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.832+0000 7f7c9aa00640 1 -- 172.21.15.17:0/891465715 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1314716038 0 0) 0x7f7c80003520 con 0x7f7c9c0b25a0 2024-03-12T17:19:45.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.832+0000 7f7c9aa00640 1 -- 172.21.15.17:0/891465715 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7c9c154130 msgr2=0x7f7c9c0cb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:45.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.832+0000 7f7c9aa00640 1 --2- 172.21.15.17:0/891465715 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7c9c154130 0x7f7c9c0cb010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:45.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.832+0000 7f7c9aa00640 1 -- 172.21.15.17:0/891465715 >> v2:172.21.15.94:3300/0 conn(0x7f7c9c153d50 msgr2=0x7f7c9c0b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:45.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.832+0000 7f7c9aa00640 1 --2- 172.21.15.17:0/891465715 >> v2:172.21.15.94:3300/0 conn(0x7f7c9c153d50 0x7f7c9c0b2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:45.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.832+0000 7f7c9aa00640 1 -- 172.21.15.17:0/891465715 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c9c15d5c0 con 0x7f7c9c0b25a0 2024-03-12T17:19:45.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.832+0000 7f7c9aa00640 1 -- 172.21.15.17:0/891465715 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7f7c94001670 con 0x7f7c9c0b25a0 2024-03-12T17:19:45.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.832+0000 7f7c9aa00640 1 -- 172.21.15.17:0/891465715 >> v1:172.21.15.17:6789/0 conn(0x7f7c9c0b25a0 legacy=0x7f7c9c06d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:45.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.832+0000 7f7c9aa00640 1 --2- 172.21.15.17:0/891465715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c80003970 0x7f7c80003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:45.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.832+0000 7f7c9aa00640 1 --2- 172.21.15.17:0/891465715 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7c9c154130 0x7f7c800047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:45.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.832+0000 7f7c9aa00640 1 --2- 172.21.15.17:0/891465715 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c80004d00 0x7f7c80005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:45.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.832+0000 7f7c9aa00640 1 -- 172.21.15.17:0/891465715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c15df60 con 0x7f7c80003970 2024-03-12T17:19:45.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.832+0000 7f7c9aa00640 1 -- 172.21.15.17:0/891465715 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c0b2ae0 con 0x7f7c80004d00 2024-03-12T17:19:45.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.832+0000 7f7c9aa00640 1 -- 172.21.15.17:0/891465715 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8000b980 con 0x7f7c9c154130 2024-03-12T17:19:45.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.832+0000 7f7c9b400640 1 --2- 172.21.15.17:0/891465715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c80003970 0x7f7c80003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:45.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.833+0000 7f7c9b400640 1 -- 172.21.15.17:0/891465715 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7c9c154130 msgr2=0x7f7c800047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:45.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.833+0000 7f7c9be00640 1 --2- 172.21.15.17:0/891465715 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c80004d00 0x7f7c80005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:45.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.833+0000 7f7c92a00640 1 --2- 172.21.15.17:0/891465715 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7c9c154130 0x7f7c800047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:45.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.833+0000 7f7c9b400640 1 --2- 172.21.15.17:0/891465715 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7c9c154130 0x7f7c800047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:45.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.833+0000 7f7c9b400640 1 -- 172.21.15.17:0/891465715 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c80004d00 msgr2=0x7f7c80005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:45.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.833+0000 7f7c9b400640 1 --2- 172.21.15.17:0/891465715 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c80004d00 0x7f7c80005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:45.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.833+0000 7f7c9b400640 1 -- 172.21.15.17:0/891465715 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c80003520 con 0x7f7c80003970 2024-03-12T17:19:45.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.834+0000 7f7c9b400640 1 --2- 172.21.15.17:0/891465715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c80003970 0x7f7c80003d90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c009fc0 tx=0x7f7c800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dfdd83171043000 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:45.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.834+0000 7f7c9aa00640 1 -- 172.21.15.17:0/891465715 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c02cc60 con 0x7f7c80003970 2024-03-12T17:19:45.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.834+0000 7f7c9aa00640 1 -- 172.21.15.17:0/891465715 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8c00f040 con 0x7f7c80003970 2024-03-12T17:19:45.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.834+0000 7f7c9aa00640 1 -- 172.21.15.17:0/891465715 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c034440 con 0x7f7c80003970 2024-03-12T17:19:45.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.835+0000 7f7ca2200640 1 -- 172.21.15.17:0/891465715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c80003970 msgr2=0x7f7c80003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:45.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.835+0000 7f7ca2200640 1 --2- 172.21.15.17:0/891465715 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c80003970 0x7f7c80003d90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c009fc0 tx=0x7f7c800057f0 comp rx=0 tx=0).stop 2024-03-12T17:19:45.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.835+0000 7f7c9be00640 1 -- 172.21.15.17:0/891465715 reap_dead start 2024-03-12T17:19:45.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.835+0000 7f7ca2200640 1 -- 172.21.15.17:0/891465715 shutdown_connections 2024-03-12T17:19:45.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.835+0000 7f7ca2200640 1 -- 172.21.15.17:0/891465715 >> 172.21.15.17:0/891465715 conn(0x7f7c9c069ce0 msgr2=0x7f7c9c06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:45.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.835+0000 7f7ca2200640 1 -- 172.21.15.17:0/891465715 shutdown_connections 2024-03-12T17:19:45.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.835+0000 7f7ca2200640 1 -- 172.21.15.17:0/891465715 wait complete. 2024-03-12T17:19:45.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.837+0000 7f7ca2200640 1 Processor -- start 2024-03-12T17:19:45.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.837+0000 7f7ca2200640 1 -- start start 2024-03-12T17:19:45.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.838+0000 7f7ca2200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7c80003970 0x7f7c9c150610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:45.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.838+0000 7f7ca2200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c9c0cced0 0x7f7c9c0cd350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:45.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.838+0000 7f7ca2200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c9c1f2d20 0x7f7c9c1f31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:45.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.838+0000 7f7ca2200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c0cd890 con 0x7f7c9c0cced0 2024-03-12T17:19:45.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.838+0000 7f7ca2200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c148a00 con 0x7f7c9c1f2d20 2024-03-12T17:19:45.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.838+0000 7f7ca2200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c0ac970 con 0x7f7c80003970 2024-03-12T17:19:45.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.838+0000 7f7c92a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c9c0cced0 0x7f7c9c0cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:45.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.839+0000 7f7c92a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c9c0cced0 0x7f7c9c0cd350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39738/0 (socket says 172.21.15.17:39738) 2024-03-12T17:19:45.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.839+0000 7f7c92a00640 1 -- 172.21.15.17:0/493762667 learned_addr learned my addr 172.21.15.17:0/493762667 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:45.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.839+0000 7f7c9b400640 1 --2- 172.21.15.17:0/493762667 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7c80003970 0x7f7c9c150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:45.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.839+0000 7f7c9be00640 1 --2- 172.21.15.17:0/493762667 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c9c1f2d20 0x7f7c9c1f31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:45.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.839+0000 7f7c92a00640 1 -- 172.21.15.17:0/493762667 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7c80003970 msgr2=0x7f7c9c150610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:45.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.839+0000 7f7c92a00640 1 --2- 172.21.15.17:0/493762667 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7c80003970 0x7f7c9c150610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:45.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.839+0000 7f7c92a00640 1 -- 172.21.15.17:0/493762667 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c9c1f2d20 msgr2=0x7f7c9c1f31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:45.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.839+0000 7f7c92a00640 1 --2- 172.21.15.17:0/493762667 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c9c1f2d20 0x7f7c9c1f31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:45.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.839+0000 7f7c92a00640 1 -- 172.21.15.17:0/493762667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c9c0ac690 con 0x7f7c9c0cced0 2024-03-12T17:19:45.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.839+0000 7f7c9be00640 1 --2- 172.21.15.17:0/493762667 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c9c1f2d20 0x7f7c9c1f31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:45.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.839+0000 7f7c92a00640 1 --2- 172.21.15.17:0/493762667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c9c0cced0 0x7f7c9c0cd350 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7c84010890 tx=0x7f7c84010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:45.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.840+0000 7f7c93e00640 1 -- 172.21.15.17:0/493762667 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c840095b0 con 0x7f7c9c0cced0 2024-03-12T17:19:45.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.840+0000 7f7c93e00640 1 -- 172.21.15.17:0/493762667 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8400eb00 con 0x7f7c9c0cced0 2024-03-12T17:19:45.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.840+0000 7f7c93e00640 1 -- 172.21.15.17:0/493762667 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8400ee90 con 0x7f7c9c0cced0 2024-03-12T17:19:45.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.840+0000 7f7ca2200640 1 -- 172.21.15.17:0/493762667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c9c14fb30 con 0x7f7c9c0cced0 2024-03-12T17:19:45.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.840+0000 7f7ca2200640 1 -- 172.21.15.17:0/493762667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c9c1500f0 con 0x7f7c9c0cced0 2024-03-12T17:19:45.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.841+0000 7f7ca2200640 1 -- 172.21.15.17:0/493762667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c9c06ac70 con 0x7f7c9c0cced0 2024-03-12T17:19:45.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.842+0000 7f7c93e00640 1 -- 172.21.15.17:0/493762667 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f7c8401c400 con 0x7f7c9c0cced0 2024-03-12T17:19:45.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.843+0000 7f7c93e00640 1 --2- 172.21.15.17:0/493762667 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f7c7806ac00 0x7f7c7806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:45.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.843+0000 7f7c93e00640 1 -- 172.21.15.17:0/493762667 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5473+0+0 (secure 0 0 0) 0x7f7c840897d0 con 0x7f7c9c0cced0 2024-03-12T17:19:45.837 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.843+0000 7f7c9b400640 1 --2- 172.21.15.17:0/493762667 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f7c7806ac00 0x7f7c7806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:45.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.844+0000 7f7c9b400640 1 --2- 172.21.15.17:0/493762667 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f7c7806ac00 0x7f7c7806d0c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c036000 tx=0x7f7c8c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:45.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:45.847+0000 7f7c93e00640 1 -- 172.21.15.17:0/493762667 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f7c84054a80 con 0x7f7c9c0cced0 2024-03-12T17:19:46.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.045+0000 7f7ca2200640 1 -- 172.21.15.17:0/493762667 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7c9c0736c0 con 0x7f7c9c0cced0 2024-03-12T17:19:46.584 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.590+0000 7f7c93e00640 1 -- 172.21.15.17:0/493762667 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7c840580a0 con 0x7f7c9c0cced0 2024-03-12T17:19:46.584 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2024-03-12T17:19:46.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.594+0000 7f7ca2200640 1 -- 172.21.15.17:0/493762667 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f7c7806ac00 msgr2=0x7f7c7806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:46.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.594+0000 7f7ca2200640 1 --2- 172.21.15.17:0/493762667 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f7c7806ac00 0x7f7c7806d0c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c036000 tx=0x7f7c8c02e000 comp rx=0 tx=0).stop 2024-03-12T17:19:46.588 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.594+0000 7f7ca2200640 1 -- 172.21.15.17:0/493762667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c9c0cced0 msgr2=0x7f7c9c0cd350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:46.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.594+0000 7f7ca2200640 1 --2- 172.21.15.17:0/493762667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c9c0cced0 0x7f7c9c0cd350 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f7c84010890 tx=0x7f7c84010d50 comp rx=0 tx=0).stop 2024-03-12T17:19:46.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.595+0000 7f7ca2200640 1 -- 172.21.15.17:0/493762667 shutdown_connections 2024-03-12T17:19:46.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.595+0000 7f7ca2200640 1 --2- 172.21.15.17:0/493762667 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f7c7806ac00 0x7f7c7806d0c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:46.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.595+0000 7f7ca2200640 1 --2- 172.21.15.17:0/493762667 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7c9c1f2d20 0x7f7c9c1f31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:46.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.595+0000 7f7ca2200640 1 --2- 172.21.15.17:0/493762667 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7c9c0cced0 0x7f7c9c0cd350 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:46.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.595+0000 7f7ca2200640 1 --2- 172.21.15.17:0/493762667 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7c80003970 0x7f7c9c150610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:46.589 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.595+0000 7f7ca2200640 1 -- 172.21.15.17:0/493762667 >> 172.21.15.17:0/493762667 conn(0x7f7c9c069ce0 msgr2=0x7f7c9c159f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:46.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.596+0000 7f7ca2200640 1 -- 172.21.15.17:0/493762667 shutdown_connections 2024-03-12T17:19:46.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.596+0000 7f7ca2200640 1 -- 172.21.15.17:0/493762667 wait complete. 2024-03-12T17:19:46.616 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-12T17:19:46.616 INFO:tasks.ceph.mds.a:Stopping old one... 2024-03-12T17:19:46.617 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-12T17:19:46.617 INFO:teuthology.orchestra.run:waiting for 300 2024-03-12T17:19:46.617 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-12T17:19:46.617 INFO:tasks.ceph.mds.c:Stopping old one... 2024-03-12T17:19:46.617 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-12T17:19:46.617 INFO:teuthology.orchestra.run:waiting for 300 2024-03-12T17:19:46.618 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-12T17:19:46.618 INFO:tasks.ceph.mds.b:Stopping old one... 2024-03-12T17:19:46.618 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-12T17:19:46.618 INFO:teuthology.orchestra.run:waiting for 300 2024-03-12T17:19:46.618 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-12T17:19:46.618 INFO:tasks.ceph.mds.d:Stopping old one... 2024-03-12T17:19:46.618 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-12T17:19:46.619 INFO:teuthology.orchestra.run:waiting for 300 2024-03-12T17:19:46.636 INFO:tasks.ceph.mds.a:Stopped 2024-03-12T17:19:46.636 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-12T17:19:46.638 INFO:tasks.ceph.mds.b:Stopped 2024-03-12T17:19:46.639 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-12T17:19:46.640 INFO:tasks.ceph.mds.d:Stopped 2024-03-12T17:19:46.640 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-12T17:19:46.641 INFO:tasks.ceph.mds.c:Stopped 2024-03-12T17:19:46.641 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-12T17:19:46.686 INFO:tasks.ceph.mds.b:Started 2024-03-12T17:19:46.687 DEBUG:teuthology.parallel:result is None 2024-03-12T17:19:46.688 INFO:tasks.ceph.mds.a:Started 2024-03-12T17:19:46.688 DEBUG:teuthology.parallel:result is None 2024-03-12T17:19:46.692 INFO:tasks.ceph.mds.d:Started 2024-03-12T17:19:46.692 DEBUG:teuthology.parallel:result is None 2024-03-12T17:19:46.694 INFO:tasks.ceph.mds.c:Started 2024-03-12T17:19:46.694 DEBUG:teuthology.parallel:result is None 2024-03-12T17:19:46.694 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-03-12T17:19:46.844 INFO:tasks.ceph.mds.b.smithi094.stdout:starting mds.b at 2024-03-12T17:19:46.845 INFO:tasks.ceph.mds.d.smithi094.stdout:starting mds.d at 2024-03-12T17:19:46.845 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2024-03-12T17:19:46.846 INFO:tasks.ceph.mds.b.smithi094.stderr:2024-03-12T17:19:46.851+0000 7f0270000640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-03-12T17:19:46.847 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2024-03-12T17:19:46.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.900+0000 7f0a3a000640 1 Processor -- start 2024-03-12T17:19:46.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.900+0000 7f0a3a000640 1 -- start start 2024-03-12T17:19:46.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.901+0000 7f0a3a000640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0a340b86c0 0x7f0a340b4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:46.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.901+0000 7f0a3a000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0a340b4950 0x7f0a340d1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:46.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.901+0000 7f0a3a000640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a34160470 con 0x7f0a34160090 2024-03-12T17:19:46.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.901+0000 7f0a3a000640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a340d0e40 con 0x7f0a340b4950 2024-03-12T17:19:46.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.901+0000 7f0a3a000640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a3406b840 con 0x7f0a340b86c0 2024-03-12T17:19:46.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.902+0000 7f0a39600640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0a340b4950 0x7f0a340d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:46.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.902+0000 7f0a39600640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f0a340b4950 0x7f0a340d1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39782/0 (socket says 172.21.15.17:39782) 2024-03-12T17:19:46.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.902+0000 7f0a39600640 1 -- 172.21.15.17:0/35256153 learned_addr learned my addr 172.21.15.17:0/35256153 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:46.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.902+0000 7f0a2be00640 1 --2- 172.21.15.17:0/35256153 >> v2:172.21.15.94:3300/0 conn(0x7f0a340b86c0 0x7f0a340b4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:46.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.902+0000 7f0a38c00640 1 --1- 172.21.15.17:0/35256153 >> v1:172.21.15.94:6789/0 conn(0x7f0a34160090 0x7f0a3406b130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.17:48620/0 (socket says 172.21.15.17:48620) 2024-03-12T17:19:46.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.902+0000 7f0a39600640 1 -- 172.21.15.17:0/35256153 >> v2:172.21.15.94:3300/0 conn(0x7f0a340b86c0 msgr2=0x7f0a340b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:46.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.902+0000 7f0a39600640 1 --2- 172.21.15.17:0/35256153 >> v2:172.21.15.94:3300/0 conn(0x7f0a340b86c0 0x7f0a340b4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:46.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.902+0000 7f0a39600640 1 -- 172.21.15.17:0/35256153 >> v1:172.21.15.94:6789/0 conn(0x7f0a34160090 legacy=0x7f0a3406b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:46.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.902+0000 7f0a39600640 1 -- 172.21.15.17:0/35256153 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a340b4d60 con 0x7f0a340b4950 2024-03-12T17:19:46.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.903+0000 7f0a39600640 1 --2- 172.21.15.17:0/35256153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a340b4950 0x7f0a340d1260 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0a340b23a0 tx=0x7f0a2c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8644188da841d6ab server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:46.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.904+0000 7f0a33e00640 1 -- 172.21.15.17:0/35256153 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c02ca80 con 0x7f0a340b4950 2024-03-12T17:19:46.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.904+0000 7f0a33e00640 1 -- 172.21.15.17:0/35256153 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2c02cbe0 con 0x7f0a340b4950 2024-03-12T17:19:46.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.904+0000 7f0a33e00640 1 -- 172.21.15.17:0/35256153 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c0343f0 con 0x7f0a340b4950 2024-03-12T17:19:46.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.904+0000 7f0a3a000640 1 -- 172.21.15.17:0/35256153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a340b4950 msgr2=0x7f0a340d1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:46.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.904+0000 7f0a3a000640 1 --2- 172.21.15.17:0/35256153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a340b4950 0x7f0a340d1260 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f0a340b23a0 tx=0x7f0a2c02bee0 comp rx=0 tx=0).stop 2024-03-12T17:19:46.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.904+0000 7f0a3a000640 1 -- 172.21.15.17:0/35256153 shutdown_connections 2024-03-12T17:19:46.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.904+0000 7f0a3a000640 1 --2- 172.21.15.17:0/35256153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a340b4950 0x7f0a340d1260 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:46.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.904+0000 7f0a3a000640 1 --2- 172.21.15.17:0/35256153 >> v2:172.21.15.94:3300/0 conn(0x7f0a340b86c0 0x7f0a340b4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:46.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.904+0000 7f0a3a000640 1 -- 172.21.15.17:0/35256153 >> 172.21.15.17:0/35256153 conn(0x7f0a340cf5f0 msgr2=0x7f0a340cfa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:46.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.905+0000 7f0a3a000640 1 -- 172.21.15.17:0/35256153 shutdown_connections 2024-03-12T17:19:46.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.905+0000 7f0a3a000640 1 -- 172.21.15.17:0/35256153 wait complete. 2024-03-12T17:19:46.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.906+0000 7f0a3a000640 1 Processor -- start 2024-03-12T17:19:46.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.906+0000 7f0a3a000640 1 -- start start 2024-03-12T17:19:46.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.907+0000 7f0a3a000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0a340b4950 0x7f0a3414ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:46.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.907+0000 7f0a3a000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a340b86c0 0x7f0a340ca8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:46.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.907+0000 7f0a3a000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0a34160090 0x7f0a340aba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:46.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.907+0000 7f0a3a000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a340cb930 con 0x7f0a340b86c0 2024-03-12T17:19:46.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.907+0000 7f0a3a000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a340a9830 con 0x7f0a340b4950 2024-03-12T17:19:46.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.907+0000 7f0a3a000640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a340cb370 con 0x7f0a34160090 2024-03-12T17:19:46.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.908+0000 7f0a2be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a340b86c0 0x7f0a340ca8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:46.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.908+0000 7f0a39600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0a34160090 0x7f0a340aba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:46.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.908+0000 7f0a2be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a340b86c0 0x7f0a340ca8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39784/0 (socket says 172.21.15.17:39784) 2024-03-12T17:19:46.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.908+0000 7f0a39600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0a34160090 0x7f0a340aba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.17:48368/0 (socket says 172.21.15.17:48368) 2024-03-12T17:19:46.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.908+0000 7f0a2be00640 1 -- 172.21.15.17:0/1949739906 learned_addr learned my addr 172.21.15.17:0/1949739906 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:46.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.908+0000 7f0a38c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0a340b4950 0x7f0a3414ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:46.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.908+0000 7f0a2be00640 1 -- 172.21.15.17:0/1949739906 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0a34160090 msgr2=0x7f0a340aba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:46.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.908+0000 7f0a2be00640 1 --2- 172.21.15.17:0/1949739906 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0a34160090 0x7f0a340aba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:46.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.908+0000 7f0a2be00640 1 -- 172.21.15.17:0/1949739906 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0a340b4950 msgr2=0x7f0a3414ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:46.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.908+0000 7f0a2be00640 1 --2- 172.21.15.17:0/1949739906 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0a340b4950 0x7f0a3414ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:46.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.908+0000 7f0a2be00640 1 -- 172.21.15.17:0/1949739906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a2c009b30 con 0x7f0a340b86c0 2024-03-12T17:19:46.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.909+0000 7f0a2be00640 1 --2- 172.21.15.17:0/1949739906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a340b86c0 0x7f0a340ca8f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c00e9e0 tx=0x7f0a1c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:46.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.909+0000 7f0a31600640 1 -- 172.21.15.17:0/1949739906 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c009670 con 0x7f0a340b86c0 2024-03-12T17:19:46.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.909+0000 7f0a31600640 1 -- 172.21.15.17:0/1949739906 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a1c00c9d0 con 0x7f0a340b86c0 2024-03-12T17:19:46.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.909+0000 7f0a3a000640 1 -- 172.21.15.17:0/1949739906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a340cb650 con 0x7f0a340b86c0 2024-03-12T17:19:46.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.909+0000 7f0a31600640 1 -- 172.21.15.17:0/1949739906 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c00cd80 con 0x7f0a340b86c0 2024-03-12T17:19:46.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.909+0000 7f0a3a000640 1 -- 172.21.15.17:0/1949739906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a341525a0 con 0x7f0a340b86c0 2024-03-12T17:19:46.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.910+0000 7f0a3a000640 1 -- 172.21.15.17:0/1949739906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a34067120 con 0x7f0a340b86c0 2024-03-12T17:19:46.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.911+0000 7f0a31600640 1 -- 172.21.15.17:0/1949739906 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f0a1c013470 con 0x7f0a340b86c0 2024-03-12T17:19:46.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.912+0000 7f0a31600640 1 --2- 172.21.15.17:0/1949739906 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f0a1006ac50 0x7f0a1006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:46.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.912+0000 7f0a31600640 1 -- 172.21.15.17:0/1949739906 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0a1c089120 con 0x7f0a340b86c0 2024-03-12T17:19:46.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.913+0000 7f0a38c00640 1 --2- 172.21.15.17:0/1949739906 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f0a1006ac50 0x7f0a1006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:46.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.913+0000 7f0a38c00640 1 --2- 172.21.15.17:0/1949739906 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f0a1006ac50 0x7f0a1006d110 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0a24000f60 tx=0x7f0a24000ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:46.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:46.917+0000 7f0a31600640 1 -- 172.21.15.17:0/1949739906 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f0a1c054720 con 0x7f0a340b86c0 2024-03-12T17:19:47.122 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:47.127+0000 7f0a3a000640 1 -- 172.21.15.17:0/1949739906 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f0a34072360 con 0x7f0a340b86c0 2024-03-12T17:19:47.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:47.905+0000 7f0a31600640 1 -- 172.21.15.17:0/1949739906 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v31) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0a1c057d40 con 0x7f0a340b86c0 2024-03-12T17:19:47.900 INFO:teuthology.orchestra.run.smithi017.stderr: removed all blocklist entries 2024-03-12T17:19:47.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:47.908+0000 7f0a3a000640 1 -- 172.21.15.17:0/1949739906 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f0a1006ac50 msgr2=0x7f0a1006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:47.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:47.908+0000 7f0a3a000640 1 --2- 172.21.15.17:0/1949739906 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f0a1006ac50 0x7f0a1006d110 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0a24000f60 tx=0x7f0a24000ed0 comp rx=0 tx=0).stop 2024-03-12T17:19:47.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:47.908+0000 7f0a3a000640 1 -- 172.21.15.17:0/1949739906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a340b86c0 msgr2=0x7f0a340ca8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:47.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:47.908+0000 7f0a3a000640 1 --2- 172.21.15.17:0/1949739906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a340b86c0 0x7f0a340ca8f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c00e9e0 tx=0x7f0a1c00eea0 comp rx=0 tx=0).stop 2024-03-12T17:19:47.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:47.908+0000 7f0a3a000640 1 -- 172.21.15.17:0/1949739906 shutdown_connections 2024-03-12T17:19:47.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:47.908+0000 7f0a3a000640 1 --2- 172.21.15.17:0/1949739906 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f0a1006ac50 0x7f0a1006d110 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:47.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:47.909+0000 7f0a3a000640 1 --2- 172.21.15.17:0/1949739906 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0a34160090 0x7f0a340aba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:47.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:47.909+0000 7f0a3a000640 1 --2- 172.21.15.17:0/1949739906 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0a340b86c0 0x7f0a340ca8f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:47.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:47.909+0000 7f0a3a000640 1 --2- 172.21.15.17:0/1949739906 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0a340b4950 0x7f0a3414ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:47.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:47.909+0000 7f0a3a000640 1 -- 172.21.15.17:0/1949739906 >> 172.21.15.17:0/1949739906 conn(0x7f0a340cf5f0 msgr2=0x7f0a340cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:47.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:47.909+0000 7f0a3a000640 1 -- 172.21.15.17:0/1949739906 shutdown_connections 2024-03-12T17:19:47.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:47.909+0000 7f0a3a000640 1 -- 172.21.15.17:0/1949739906 wait complete. 2024-03-12T17:19:47.923 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-03-12T17:19:48.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.148+0000 7f2f87800640 1 Processor -- start 2024-03-12T17:19:48.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.148+0000 7f2f87800640 1 -- start start 2024-03-12T17:19:48.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.150+0000 7f2f87800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2f8006c3f0 0x7f2f800b3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:48.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.150+0000 7f2f87800640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f2f800b3780 0x7f2f800ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:48.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.150+0000 7f2f87800640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f800cb340 con 0x7f2f800ced90 2024-03-12T17:19:48.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.150+0000 7f2f87800640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f800b3bf0 con 0x7f2f8006c3f0 2024-03-12T17:19:48.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.150+0000 7f2f87800640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f80159d50 con 0x7f2f800b3780 2024-03-12T17:19:48.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.151+0000 7f2f7fe00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2f8006c3f0 0x7f2f800b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:48.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.151+0000 7f2f7fe00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2f8006c3f0 0x7f2f800b3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39786/0 (socket says 172.21.15.17:39786) 2024-03-12T17:19:48.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.151+0000 7f2f7fe00640 1 -- 172.21.15.17:0/3116543663 learned_addr learned my addr 172.21.15.17:0/3116543663 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:48.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.151+0000 7f2f85800640 1 --2- 172.21.15.17:0/3116543663 >> v2:172.21.15.94:3300/0 conn(0x7f2f800b3780 0x7f2f800ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:48.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.151+0000 7f2f7fe00640 1 -- 172.21.15.17:0/3116543663 >> v2:172.21.15.94:3300/0 conn(0x7f2f800b3780 msgr2=0x7f2f800ccd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:48.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.151+0000 7f2f7fe00640 1 --2- 172.21.15.17:0/3116543663 >> v2:172.21.15.94:3300/0 conn(0x7f2f800b3780 0x7f2f800ccd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:48.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.151+0000 7f2f7fe00640 1 -- 172.21.15.17:0/3116543663 >> v1:172.21.15.17:6789/0 conn(0x7f2f800ced90 legacy=0x7f2f800b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:48.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.151+0000 7f2f7fe00640 1 -- 172.21.15.17:0/3116543663 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f800b1ef0 con 0x7f2f8006c3f0 2024-03-12T17:19:48.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.151+0000 7f2f85800640 1 --2- 172.21.15.17:0/3116543663 >> v2:172.21.15.94:3300/0 conn(0x7f2f800b3780 0x7f2f800ccd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:48.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.152+0000 7f2f7fe00640 1 --2- 172.21.15.17:0/3116543663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f8006c3f0 0x7f2f800b3240 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2f800b3de0 tx=0x7f2f6802b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c78aabe9a41c93 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:48.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.153+0000 7f2f7f400640 1 -- 172.21.15.17:0/3116543663 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f68030870 con 0x7f2f8006c3f0 2024-03-12T17:19:48.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.153+0000 7f2f7f400640 1 -- 172.21.15.17:0/3116543663 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f680309d0 con 0x7f2f8006c3f0 2024-03-12T17:19:48.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.153+0000 7f2f7f400640 1 -- 172.21.15.17:0/3116543663 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f68030d60 con 0x7f2f8006c3f0 2024-03-12T17:19:48.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.153+0000 7f2f87800640 1 -- 172.21.15.17:0/3116543663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f8006c3f0 msgr2=0x7f2f800b3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:48.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.153+0000 7f2f87800640 1 --2- 172.21.15.17:0/3116543663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f8006c3f0 0x7f2f800b3240 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2f800b3de0 tx=0x7f2f6802b9b0 comp rx=0 tx=0).stop 2024-03-12T17:19:48.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.154+0000 7f2f87800640 1 -- 172.21.15.17:0/3116543663 shutdown_connections 2024-03-12T17:19:48.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.154+0000 7f2f87800640 1 --2- 172.21.15.17:0/3116543663 >> v2:172.21.15.94:3300/0 conn(0x7f2f800b3780 0x7f2f800ccd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:48.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.154+0000 7f2f87800640 1 --2- 172.21.15.17:0/3116543663 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f8006c3f0 0x7f2f800b3240 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:48.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.154+0000 7f2f87800640 1 -- 172.21.15.17:0/3116543663 >> 172.21.15.17:0/3116543663 conn(0x7f2f80069ce0 msgr2=0x7f2f8006a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:48.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.154+0000 7f2f87800640 1 -- 172.21.15.17:0/3116543663 shutdown_connections 2024-03-12T17:19:48.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.154+0000 7f2f87800640 1 -- 172.21.15.17:0/3116543663 wait complete. 2024-03-12T17:19:48.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.156+0000 7f2f87800640 1 Processor -- start 2024-03-12T17:19:48.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.156+0000 7f2f87800640 1 -- start start 2024-03-12T17:19:48.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.157+0000 7f2f87800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f8006c3f0 0x7f2f80141180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:48.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.157+0000 7f2f87800640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2f800b3780 0x7f2f80157350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:48.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.157+0000 7f2f87800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2f800ced90 0x7f2f80157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:48.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.157+0000 7f2f87800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f801416c0 con 0x7f2f8006c3f0 2024-03-12T17:19:48.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.157+0000 7f2f87800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8014afb0 con 0x7f2f800ced90 2024-03-12T17:19:48.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.157+0000 7f2f87800640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8014b290 con 0x7f2f800b3780 2024-03-12T17:19:48.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.157+0000 7f2f84e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f8006c3f0 0x7f2f80141180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:48.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.157+0000 7f2f84e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f8006c3f0 0x7f2f80141180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39788/0 (socket says 172.21.15.17:39788) 2024-03-12T17:19:48.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.157+0000 7f2f84e00640 1 -- 172.21.15.17:0/701726358 learned_addr learned my addr 172.21.15.17:0/701726358 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:48.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.157+0000 7f2f84e00640 1 -- 172.21.15.17:0/701726358 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2f800b3780 msgr2=0x7f2f80157350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:48.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.157+0000 7f2f84e00640 1 --2- 172.21.15.17:0/701726358 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2f800b3780 0x7f2f80157350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:48.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.157+0000 7f2f84e00640 1 -- 172.21.15.17:0/701726358 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2f800ced90 msgr2=0x7f2f80157890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:48.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.157+0000 7f2f84e00640 1 --2- 172.21.15.17:0/701726358 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2f800ced90 0x7f2f80157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:48.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.157+0000 7f2f84e00640 1 -- 172.21.15.17:0/701726358 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f680094d0 con 0x7f2f8006c3f0 2024-03-12T17:19:48.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.158+0000 7f2f84e00640 1 --2- 172.21.15.17:0/701726358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f8006c3f0 0x7f2f80141180 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2f7000c730 tx=0x7f2f7000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:48.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.158+0000 7f2f7cc00640 1 -- 172.21.15.17:0/701726358 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f70003b70 con 0x7f2f8006c3f0 2024-03-12T17:19:48.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.158+0000 7f2f7cc00640 1 -- 172.21.15.17:0/701726358 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f70003cf0 con 0x7f2f8006c3f0 2024-03-12T17:19:48.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.158+0000 7f2f7cc00640 1 -- 172.21.15.17:0/701726358 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7000aa90 con 0x7f2f8006c3f0 2024-03-12T17:19:48.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.158+0000 7f2f87800640 1 -- 172.21.15.17:0/701726358 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f8014b570 con 0x7f2f8006c3f0 2024-03-12T17:19:48.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.158+0000 7f2f87800640 1 -- 172.21.15.17:0/701726358 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f8014bb30 con 0x7f2f8006c3f0 2024-03-12T17:19:48.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.159+0000 7f2f87800640 1 -- 172.21.15.17:0/701726358 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f800cb810 con 0x7f2f8006c3f0 2024-03-12T17:19:48.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.160+0000 7f2f7cc00640 1 -- 172.21.15.17:0/701726358 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f2f7000abf0 con 0x7f2f8006c3f0 2024-03-12T17:19:48.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.161+0000 7f2f7cc00640 1 --2- 172.21.15.17:0/701726358 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f2f5c06ac00 0x7f2f5c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:48.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.161+0000 7f2f7cc00640 1 -- 172.21.15.17:0/701726358 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2f70088fd0 con 0x7f2f8006c3f0 2024-03-12T17:19:48.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.161+0000 7f2f7fe00640 1 --2- 172.21.15.17:0/701726358 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f2f5c06ac00 0x7f2f5c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:48.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.162+0000 7f2f7fe00640 1 --2- 172.21.15.17:0/701726358 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f2f5c06ac00 0x7f2f5c06d0c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2f68036000 tx=0x7f2f6803b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:48.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.166+0000 7f2f7cc00640 1 -- 172.21.15.17:0/701726358 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f2f700543d0 con 0x7f2f8006c3f0 2024-03-12T17:19:48.432 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.438+0000 7f2f87800640 1 -- 172.21.15.17:0/701726358 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f2f8014bd20 con 0x7f2f8006c3f0 2024-03-12T17:19:48.433 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.439+0000 7f2f7cc00640 1 -- 172.21.15.17:0/701726358 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v2) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f2f70003e60 con 0x7f2f8006c3f0 2024-03-12T17:19:48.433 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:19:48.434 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-12T17:19:48.434 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_dump": [ 2024-03-12T17:19:48.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:19:48.434 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.a", 2024-03-12T17:19:48.434 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQA3jvBl8pscOhAAg7cRCKubs0xJHi6+fzHsQg==", 2024-03-12T17:19:48.434 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:19:48.434 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-03-12T17:19:48.434 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-03-12T17:19:48.434 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-03-12T17:19:48.434 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-03-12T17:19:48.434 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:19:48.434 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:19:48.434 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:19:48.435 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.b", 2024-03-12T17:19:48.435 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQA4jvBl7BmXIBAARcXGpnsnW07RmdLKxAOtDw==", 2024-03-12T17:19:48.435 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:19:48.435 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-03-12T17:19:48.435 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-03-12T17:19:48.435 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-03-12T17:19:48.435 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-03-12T17:19:48.435 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:19:48.435 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:19:48.435 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:19:48.435 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.c", 2024-03-12T17:19:48.435 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQA4jvBlyF62EBAALdtfnD6arVS4lYylDoyb3Q==", 2024-03-12T17:19:48.435 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:19:48.435 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-03-12T17:19:48.436 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-03-12T17:19:48.436 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-03-12T17:19:48.436 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-03-12T17:19:48.436 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:19:48.436 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:19:48.436 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:19:48.436 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.d", 2024-03-12T17:19:48.436 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQA4jvBl/AJwLxAApE9bwTCmJJE4MkW6U0wg/A==", 2024-03-12T17:19:48.436 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:19:48.436 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-03-12T17:19:48.436 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-03-12T17:19:48.436 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-03-12T17:19:48.436 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-03-12T17:19:48.436 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:19:48.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:19:48.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:19:48.437 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.0", 2024-03-12T17:19:48.437 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQA7jvBl3giDExAAnT30pG7fp2lHalG8evhA3g==", 2024-03-12T17:19:48.437 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:19:48.437 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-03-12T17:19:48.437 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-03-12T17:19:48.437 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-03-12T17:19:48.437 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:19:48.437 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:19:48.437 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:19:48.437 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.1", 2024-03-12T17:19:48.437 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQA+jvBlKrEqHhAA40NN4MDLV0Rsncz9gUNSoA==", 2024-03-12T17:19:48.437 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:19:48.437 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-03-12T17:19:48.437 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-03-12T17:19:48.438 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-03-12T17:19:48.438 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:19:48.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:19:48.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:19:48.438 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.2", 2024-03-12T17:19:48.438 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQBBjvBlgfKmNxAAAQJBRIwNzLm66Vqi/jsgsQ==", 2024-03-12T17:19:48.438 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:19:48.438 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-03-12T17:19:48.438 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-03-12T17:19:48.438 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-03-12T17:19:48.438 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:19:48.438 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:19:48.438 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:19:48.438 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.3", 2024-03-12T17:19:48.439 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQBFjvBl24MrFhAA0EmYMPLOZFvtCbfZeENu7g==", 2024-03-12T17:19:48.439 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:19:48.439 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-03-12T17:19:48.439 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-03-12T17:19:48.439 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-03-12T17:19:48.439 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:19:48.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:19:48.439 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:19:48.439 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.4", 2024-03-12T17:19:48.439 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQBKjvBlIPL1EBAAS1B1kQhpHAn4PM9TvJnmqQ==", 2024-03-12T17:19:48.439 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:19:48.439 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-03-12T17:19:48.439 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-03-12T17:19:48.439 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-03-12T17:19:48.439 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:19:48.439 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:19:48.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:19:48.440 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.5", 2024-03-12T17:19:48.440 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQBNjvBl4ncdGhAAQuU1o+s7FbgWGzWk1vgRjQ==", 2024-03-12T17:19:48.440 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:19:48.440 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-03-12T17:19:48.440 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-03-12T17:19:48.440 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-03-12T17:19:48.440 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:19:48.440 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:19:48.440 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:19:48.440 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.6", 2024-03-12T17:19:48.440 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQBQjvBlSJ0wMRAA1+44GX7lMpXP/5xPWlaC9w==", 2024-03-12T17:19:48.440 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:19:48.440 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-03-12T17:19:48.441 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-03-12T17:19:48.441 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-03-12T17:19:48.441 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:19:48.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:19:48.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:19:48.441 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.7", 2024-03-12T17:19:48.441 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQBUjvBlt2qZDRAA5cpkAXcTcN+xMt0tz2imDg==", 2024-03-12T17:19:48.441 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:19:48.441 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-03-12T17:19:48.441 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-03-12T17:19:48.441 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-03-12T17:19:48.441 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:19:48.441 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:19:48.441 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:19:48.441 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.0", 2024-03-12T17:19:48.441 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQA5jvBl3EtgARAAMO0rXhwCHTQ4455DuyFa6w==", 2024-03-12T17:19:48.442 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:19:48.442 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-03-12T17:19:48.442 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-03-12T17:19:48.442 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-03-12T17:19:48.442 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-03-12T17:19:48.442 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:19:48.442 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:19:48.442 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:19:48.442 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.1", 2024-03-12T17:19:48.442 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQA5jvBlM7qcFxAA4v58amLyydfK80N6/pBSFA==", 2024-03-12T17:19:48.442 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:19:48.442 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-03-12T17:19:48.442 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-03-12T17:19:48.442 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-03-12T17:19:48.443 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-03-12T17:19:48.443 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:19:48.443 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:19:48.443 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:19:48.443 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.2", 2024-03-12T17:19:48.443 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQA5jvBlZNi5DBAAmWJzui0X1LNEF2McslvhEw==", 2024-03-12T17:19:48.446 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:19:48.446 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-03-12T17:19:48.446 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-03-12T17:19:48.446 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-03-12T17:19:48.446 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-03-12T17:19:48.447 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:19:48.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:19:48.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:19:48.447 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.3", 2024-03-12T17:19:48.447 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQA5jvBlwlx1IhAADR44dr9HHJeiLyqM9ji0UA==", 2024-03-12T17:19:48.447 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:19:48.447 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-03-12T17:19:48.447 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-03-12T17:19:48.447 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-03-12T17:19:48.447 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-03-12T17:19:48.447 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:19:48.447 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:19:48.447 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:19:48.447 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.admin", 2024-03-12T17:19:48.447 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQA2jvBl/VptLRAAFA32BiOjQTTr5eqi+b9M7A==", 2024-03-12T17:19:48.448 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:19:48.448 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-03-12T17:19:48.448 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-03-12T17:19:48.448 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-03-12T17:19:48.448 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-03-12T17:19:48.448 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:19:48.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:19:48.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:19:48.448 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.bootstrap-mds", 2024-03-12T17:19:48.448 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQBijvBl8Hb8FhAA+xHw+usJCGY4LeN49tIoRA==", 2024-03-12T17:19:48.448 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:19:48.448 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile bootstrap-mds" 2024-03-12T17:19:48.448 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:19:48.448 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:19:48.448 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:19:48.449 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.bootstrap-mgr", 2024-03-12T17:19:48.449 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQBijvBlY5P8FhAAs8APHHZGeHOI3UNewkUdKg==", 2024-03-12T17:19:48.449 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:19:48.449 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile bootstrap-mgr" 2024-03-12T17:19:48.449 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:19:48.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:19:48.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:19:48.449 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.bootstrap-osd", 2024-03-12T17:19:48.449 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQBijvBl/Kv8FhAAsjh3MDujD7AU/Wxp1U9qPA==", 2024-03-12T17:19:48.449 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:19:48.449 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile bootstrap-osd" 2024-03-12T17:19:48.449 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:19:48.449 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:19:48.449 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:19:48.450 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.bootstrap-rbd", 2024-03-12T17:19:48.450 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQBijvBl1Mr8FhAAG9Q8uw/q3eGEAueWeU9rng==", 2024-03-12T17:19:48.450 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:19:48.450 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile bootstrap-rbd" 2024-03-12T17:19:48.450 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:19:48.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:19:48.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:19:48.450 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-03-12T17:19:48.450 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQBijvBlA+T8FhAAlJHe346DdIuYkaXcZQG/Vg==", 2024-03-12T17:19:48.450 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:19:48.450 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-03-12T17:19:48.450 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:19:48.450 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:19:48.450 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:19:48.450 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.bootstrap-rgw", 2024-03-12T17:19:48.451 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQBijvBlcf38FhAABI6uJyirulUwcg7yKpnezw==", 2024-03-12T17:19:48.451 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:19:48.451 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile bootstrap-rgw" 2024-03-12T17:19:48.451 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:19:48.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:19:48.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:19:48.451 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.x", 2024-03-12T17:19:48.451 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQA3jvBl2xQ7LhAAmqFemeo/+3y+6TFvK2W6mw==", 2024-03-12T17:19:48.451 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:19:48.451 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-03-12T17:19:48.451 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2024-03-12T17:19:48.451 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-03-12T17:19:48.451 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:19:48.451 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:19:48.451 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:19:48.452 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.y", 2024-03-12T17:19:48.452 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQA3jvBl52J0IRAAlXujYfGNQsCxv2mWN0a3Gg==", 2024-03-12T17:19:48.452 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:19:48.452 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-03-12T17:19:48.452 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2024-03-12T17:19:48.452 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-03-12T17:19:48.452 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:19:48.452 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:19:48.452 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-03-12T17:19:48.452 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-12T17:19:48.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.442+0000 7f2f87800640 1 -- 172.21.15.17:0/701726358 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f2f5c06ac00 msgr2=0x7f2f5c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:48.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.442+0000 7f2f87800640 1 --2- 172.21.15.17:0/701726358 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f2f5c06ac00 0x7f2f5c06d0c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2f68036000 tx=0x7f2f6803b040 comp rx=0 tx=0).stop 2024-03-12T17:19:48.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.442+0000 7f2f87800640 1 -- 172.21.15.17:0/701726358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f8006c3f0 msgr2=0x7f2f80141180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:48.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.442+0000 7f2f87800640 1 --2- 172.21.15.17:0/701726358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f8006c3f0 0x7f2f80141180 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2f7000c730 tx=0x7f2f7000cbf0 comp rx=0 tx=0).stop 2024-03-12T17:19:48.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.442+0000 7f2f87800640 1 -- 172.21.15.17:0/701726358 shutdown_connections 2024-03-12T17:19:48.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.442+0000 7f2f87800640 1 --2- 172.21.15.17:0/701726358 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f2f5c06ac00 0x7f2f5c06d0c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:48.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.442+0000 7f2f87800640 1 --2- 172.21.15.17:0/701726358 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2f800ced90 0x7f2f80157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:48.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.442+0000 7f2f87800640 1 --2- 172.21.15.17:0/701726358 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2f800b3780 0x7f2f80157350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:48.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.442+0000 7f2f87800640 1 --2- 172.21.15.17:0/701726358 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2f8006c3f0 0x7f2f80141180 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:48.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.442+0000 7f2f87800640 1 -- 172.21.15.17:0/701726358 >> 172.21.15.17:0/701726358 conn(0x7f2f80069ce0 msgr2=0x7f2f800b1680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:48.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.443+0000 7f2f87800640 1 -- 172.21.15.17:0/701726358 shutdown_connections 2024-03-12T17:19:48.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.443+0000 7f2f87800640 1 -- 172.21.15.17:0/701726358 wait complete. 2024-03-12T17:19:48.457 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-03-12T17:19:48.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.690+0000 7efca9a00640 1 Processor -- start 2024-03-12T17:19:48.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.690+0000 7efca9a00640 1 -- start start 2024-03-12T17:19:48.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.691+0000 7efca9a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7efca40b2070 0x7efca40b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:48.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.692+0000 7efca9a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7efca40cb970 0x7efca40cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:48.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.692+0000 7efca9a00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efca40ce320 con 0x7efca4144240 2024-03-12T17:19:48.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.692+0000 7efca9a00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca40cc340 con 0x7efca40cb970 2024-03-12T17:19:48.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.692+0000 7efca9a00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca4144620 con 0x7efca40b2070 2024-03-12T17:19:48.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.692+0000 7efca3400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7efca40cb970 0x7efca40cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:48.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.692+0000 7efca3400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7efca40cb970 0x7efca40cbe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39790/0 (socket says 172.21.15.17:39790) 2024-03-12T17:19:48.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.692+0000 7efca3400640 1 -- 172.21.15.17:0/2657563621 learned_addr learned my addr 172.21.15.17:0/2657563621 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:48.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.692+0000 7efca2000640 1 --2- 172.21.15.17:0/2657563621 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7efca40b2070 0x7efca40b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:48.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.693+0000 7efca3400640 1 -- 172.21.15.17:0/2657563621 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7efca40b2070 msgr2=0x7efca40b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:48.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.693+0000 7efca3400640 1 --2- 172.21.15.17:0/2657563621 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7efca40b2070 0x7efca40b24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:48.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.693+0000 7efca3400640 1 -- 172.21.15.17:0/2657563621 >> v1:172.21.15.94:6789/0 conn(0x7efca4144240 legacy=0x7efca40ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:48.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.693+0000 7efca3400640 1 -- 172.21.15.17:0/2657563621 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca415f3d0 con 0x7efca40cb970 2024-03-12T17:19:48.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.694+0000 7efca3400640 1 --2- 172.21.15.17:0/2657563621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efca40cb970 0x7efca40cbe00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7efc9c009e80 tx=0x7efc9c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7006620ba606fba server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:48.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.694+0000 7efca1600640 1 -- 172.21.15.17:0/2657563621 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c02ca50 con 0x7efca40cb970 2024-03-12T17:19:48.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.694+0000 7efca1600640 1 -- 172.21.15.17:0/2657563621 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9c02cbb0 con 0x7efca40cb970 2024-03-12T17:19:48.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.694+0000 7efca1600640 1 -- 172.21.15.17:0/2657563621 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c0343f0 con 0x7efca40cb970 2024-03-12T17:19:48.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.695+0000 7efca9a00640 1 -- 172.21.15.17:0/2657563621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efca40cb970 msgr2=0x7efca40cbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:48.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.695+0000 7efca9a00640 1 --2- 172.21.15.17:0/2657563621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efca40cb970 0x7efca40cbe00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7efc9c009e80 tx=0x7efc9c02beb0 comp rx=0 tx=0).stop 2024-03-12T17:19:48.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.695+0000 7efca9a00640 1 -- 172.21.15.17:0/2657563621 shutdown_connections 2024-03-12T17:19:48.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.695+0000 7efca9a00640 1 --2- 172.21.15.17:0/2657563621 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efca40cb970 0x7efca40cbe00 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:48.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.695+0000 7efca9a00640 1 --2- 172.21.15.17:0/2657563621 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7efca40b2070 0x7efca40b24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:48.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.695+0000 7efca9a00640 1 -- 172.21.15.17:0/2657563621 >> 172.21.15.17:0/2657563621 conn(0x7efca4069ce0 msgr2=0x7efca406a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:48.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.695+0000 7efca9a00640 1 -- 172.21.15.17:0/2657563621 shutdown_connections 2024-03-12T17:19:48.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.695+0000 7efca9a00640 1 -- 172.21.15.17:0/2657563621 wait complete. 2024-03-12T17:19:48.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.697+0000 7efca9a00640 1 Processor -- start 2024-03-12T17:19:48.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.697+0000 7efca9a00640 1 -- start start 2024-03-12T17:19:48.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.698+0000 7efca9a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efca40b2070 0x7efca415a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:48.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.698+0000 7efca9a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efca40cb970 0x7efca415d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:48.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.698+0000 7efca9a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7efca4144240 0x7efca415dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:48.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.698+0000 7efca9a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca40a7fe0 con 0x7efca40b2070 2024-03-12T17:19:48.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.698+0000 7efca9a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca4141c60 con 0x7efca40cb970 2024-03-12T17:19:48.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.698+0000 7efca9a00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca4141f40 con 0x7efca4144240 2024-03-12T17:19:48.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.698+0000 7efca2a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efca40b2070 0x7efca415a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:48.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.698+0000 7efca2a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efca40b2070 0x7efca415a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39806/0 (socket says 172.21.15.17:39806) 2024-03-12T17:19:48.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.698+0000 7efca2a00640 1 -- 172.21.15.17:0/1643736265 learned_addr learned my addr 172.21.15.17:0/1643736265 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:48.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.699+0000 7efca2000640 1 --2- 172.21.15.17:0/1643736265 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efca40cb970 0x7efca415d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:48.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.699+0000 7efca2a00640 1 -- 172.21.15.17:0/1643736265 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7efca4144240 msgr2=0x7efca415dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:48.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.699+0000 7efca2a00640 1 --2- 172.21.15.17:0/1643736265 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7efca4144240 0x7efca415dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:48.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.699+0000 7efca2a00640 1 -- 172.21.15.17:0/1643736265 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efca40cb970 msgr2=0x7efca415d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:48.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.699+0000 7efca2a00640 1 --2- 172.21.15.17:0/1643736265 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efca40cb970 0x7efca415d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:48.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.699+0000 7efca2a00640 1 -- 172.21.15.17:0/1643736265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc9c009b30 con 0x7efca40b2070 2024-03-12T17:19:48.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.699+0000 7efca2000640 1 --2- 172.21.15.17:0/1643736265 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efca40cb970 0x7efca415d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:48.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.699+0000 7efca2a00640 1 --2- 172.21.15.17:0/1643736265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efca40b2070 0x7efca415a0e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7efc9400b3f0 tx=0x7efc9400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:48.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.700+0000 7efc9aa00640 1 -- 172.21.15.17:0/1643736265 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc94011830 con 0x7efca40b2070 2024-03-12T17:19:48.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.700+0000 7efc9aa00640 1 -- 172.21.15.17:0/1643736265 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc94011990 con 0x7efca40b2070 2024-03-12T17:19:48.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.700+0000 7efc9aa00640 1 -- 172.21.15.17:0/1643736265 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc94011d40 con 0x7efca40b2070 2024-03-12T17:19:48.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.700+0000 7efca9a00640 1 -- 172.21.15.17:0/1643736265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca4142220 con 0x7efca40b2070 2024-03-12T17:19:48.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.700+0000 7efca9a00640 1 -- 172.21.15.17:0/1643736265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca41427e0 con 0x7efca40b2070 2024-03-12T17:19:48.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.702+0000 7efca9a00640 1 -- 172.21.15.17:0/1643736265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efca40aa440 con 0x7efca40b2070 2024-03-12T17:19:48.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.702+0000 7efc9aa00640 1 -- 172.21.15.17:0/1643736265 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7efc9401a400 con 0x7efca40b2070 2024-03-12T17:19:48.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.703+0000 7efc9aa00640 1 --2- 172.21.15.17:0/1643736265 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7efc8406ac00 0x7efc8406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:48.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.703+0000 7efc9aa00640 1 -- 172.21.15.17:0/1643736265 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efc94088f40 con 0x7efca40b2070 2024-03-12T17:19:48.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.703+0000 7efca2000640 1 --2- 172.21.15.17:0/1643736265 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7efc8406ac00 0x7efc8406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:48.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.704+0000 7efca2000640 1 --2- 172.21.15.17:0/1643736265 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7efc8406ac00 0x7efc8406d0c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efca4143360 tx=0x7efc90008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:48.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.708+0000 7efc9aa00640 1 -- 172.21.15.17:0/1643736265 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7efc940543d0 con 0x7efca40b2070 2024-03-12T17:19:48.973 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.979+0000 7efca9a00640 1 -- 172.21.15.17:0/1643736265 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7efca40736c0 con 0x7efca40b2070 2024-03-12T17:19:48.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.985+0000 7efc9aa00640 1 -- 172.21.15.17:0/1643736265 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v3) v1 ==== 90+0+0 (secure 0 0 0) 0x7efc940579f0 con 0x7efca40b2070 2024-03-12T17:19:48.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.988+0000 7efca9a00640 1 -- 172.21.15.17:0/1643736265 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7efc8406ac00 msgr2=0x7efc8406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:48.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.988+0000 7efca9a00640 1 --2- 172.21.15.17:0/1643736265 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7efc8406ac00 0x7efc8406d0c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efca4143360 tx=0x7efc90008040 comp rx=0 tx=0).stop 2024-03-12T17:19:48.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.988+0000 7efca9a00640 1 -- 172.21.15.17:0/1643736265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efca40b2070 msgr2=0x7efca415a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:48.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.988+0000 7efca9a00640 1 --2- 172.21.15.17:0/1643736265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efca40b2070 0x7efca415a0e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7efc9400b3f0 tx=0x7efc9400b8b0 comp rx=0 tx=0).stop 2024-03-12T17:19:48.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.988+0000 7efca9a00640 1 -- 172.21.15.17:0/1643736265 shutdown_connections 2024-03-12T17:19:48.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.988+0000 7efca9a00640 1 --2- 172.21.15.17:0/1643736265 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7efc8406ac00 0x7efc8406d0c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:48.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.988+0000 7efca9a00640 1 --2- 172.21.15.17:0/1643736265 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7efca4144240 0x7efca415dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:48.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.988+0000 7efca9a00640 1 --2- 172.21.15.17:0/1643736265 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7efca40cb970 0x7efca415d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:48.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.988+0000 7efca9a00640 1 --2- 172.21.15.17:0/1643736265 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7efca40b2070 0x7efca415a0e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:48.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.988+0000 7efca9a00640 1 -- 172.21.15.17:0/1643736265 >> 172.21.15.17:0/1643736265 conn(0x7efca4069ce0 msgr2=0x7efca40ce7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:48.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.988+0000 7efca9a00640 1 -- 172.21.15.17:0/1643736265 shutdown_connections 2024-03-12T17:19:48.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:48.989+0000 7efca9a00640 1 -- 172.21.15.17:0/1643736265 wait complete. 2024-03-12T17:19:49.001 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-03-12T17:19:49.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.224+0000 7f0958c00640 1 Processor -- start 2024-03-12T17:19:49.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.225+0000 7f0958c00640 1 -- start start 2024-03-12T17:19:49.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.226+0000 7f0958c00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f09540b86c0 0x7f09540b4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:49.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.226+0000 7f0958c00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0954160470 con 0x7f09540b4950 2024-03-12T17:19:49.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.226+0000 7f0958c00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f095406b840 con 0x7f0954160090 2024-03-12T17:19:49.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.226+0000 7f0958c00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09540d0e40 con 0x7f09540b86c0 2024-03-12T17:19:49.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.227+0000 7f0953e00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f09540b4950 0x7f09540d1260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:40798/0 (socket says 172.21.15.17:40798) 2024-03-12T17:19:49.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.227+0000 7f0953e00640 1 -- 172.21.15.17:0/2249273167 learned_addr learned my addr 172.21.15.17:0/2249273167 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:49.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.227+0000 7f0952000640 1 -- 172.21.15.17:0/2249273167 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3447900198 0 0) 0x7f0954160470 con 0x7f09540b4950 2024-03-12T17:19:49.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.227+0000 7f0952a00640 1 --2- 172.21.15.17:0/2249273167 >> v2:172.21.15.94:3300/0 conn(0x7f09540b86c0 0x7f09540b4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:49.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.227+0000 7f0952000640 1 -- 172.21.15.17:0/2249273167 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0938003520 con 0x7f09540b4950 2024-03-12T17:19:49.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.228+0000 7f0952000640 1 -- 172.21.15.17:0/2249273167 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1405473073 0 0) 0x7f0938003520 con 0x7f09540b4950 2024-03-12T17:19:49.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.228+0000 7f0952000640 1 -- 172.21.15.17:0/2249273167 >> v2:172.21.15.94:3300/0 conn(0x7f09540b86c0 msgr2=0x7f09540b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:49.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.228+0000 7f0952000640 1 --2- 172.21.15.17:0/2249273167 >> v2:172.21.15.94:3300/0 conn(0x7f09540b86c0 0x7f09540b4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:49.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.228+0000 7f0952000640 1 -- 172.21.15.17:0/2249273167 >> v1:172.21.15.94:6789/0 conn(0x7f0954160090 legacy=0x7f095406b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:49.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.228+0000 7f0952000640 1 -- 172.21.15.17:0/2249273167 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09540b4d60 con 0x7f09540b4950 2024-03-12T17:19:49.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.228+0000 7f0952000640 1 -- 172.21.15.17:0/2249273167 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7f094c001670 con 0x7f09540b4950 2024-03-12T17:19:49.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.228+0000 7f0952a00640 1 --2- 172.21.15.17:0/2249273167 >> v2:172.21.15.94:3300/0 conn(0x7f09540b86c0 0x7f09540b4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:19:49.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.228+0000 7f0952000640 1 -- 172.21.15.17:0/2249273167 >> v1:172.21.15.17:6789/0 conn(0x7f09540b4950 legacy=0x7f09540d1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:49.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.228+0000 7f0952000640 1 --2- 172.21.15.17:0/2249273167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09380039c0 0x7f0938003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:49.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.228+0000 7f0952000640 1 --2- 172.21.15.17:0/2249273167 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f09380047c0 0x7f0938004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:49.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.228+0000 7f0952000640 1 --2- 172.21.15.17:0/2249273167 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f09380052a0 0x7f093800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:49.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.228+0000 7f0952000640 1 -- 172.21.15.17:0/2249273167 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09540d0e40 con 0x7f09380039c0 2024-03-12T17:19:49.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.228+0000 7f0952000640 1 -- 172.21.15.17:0/2249273167 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093800c1c0 con 0x7f09380052a0 2024-03-12T17:19:49.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.228+0000 7f0952000640 1 -- 172.21.15.17:0/2249273167 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f093800c380 con 0x7f09380047c0 2024-03-12T17:19:49.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.228+0000 7f0953400640 1 --2- 172.21.15.17:0/2249273167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09380039c0 0x7f0938003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:49.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.229+0000 7f0952a00640 1 --2- 172.21.15.17:0/2249273167 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f09380047c0 0x7f0938004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:49.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.229+0000 7f0953400640 1 -- 172.21.15.17:0/2249273167 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f09380047c0 msgr2=0x7f0938004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:49.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.229+0000 7f0953400640 1 --2- 172.21.15.17:0/2249273167 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f09380047c0 0x7f0938004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:49.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.229+0000 7f0953400640 1 -- 172.21.15.17:0/2249273167 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f09380052a0 msgr2=0x7f093800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:49.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.229+0000 7f0953e00640 1 --2- 172.21.15.17:0/2249273167 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f09380052a0 0x7f093800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:49.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.229+0000 7f0953400640 1 --2- 172.21.15.17:0/2249273167 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f09380052a0 0x7f093800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:49.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.229+0000 7f0953400640 1 -- 172.21.15.17:0/2249273167 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0938003520 con 0x7f09380039c0 2024-03-12T17:19:49.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.229+0000 7f0953e00640 1 --2- 172.21.15.17:0/2249273167 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f09380052a0 0x7f093800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:49.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.229+0000 7f0953e00640 1 -- 172.21.15.17:0/2249273167 reap_dead start 2024-03-12T17:19:49.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.230+0000 7f0953400640 1 --2- 172.21.15.17:0/2249273167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09380039c0 0x7f0938003de0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0944001e20 tx=0x7f09380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c77357ddad6a7ed server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:49.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.230+0000 7f0952000640 1 -- 172.21.15.17:0/2249273167 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0944003b70 con 0x7f09380039c0 2024-03-12T17:19:49.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.230+0000 7f0952000640 1 -- 172.21.15.17:0/2249273167 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0944003cd0 con 0x7f09380039c0 2024-03-12T17:19:49.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.230+0000 7f0952000640 1 -- 172.21.15.17:0/2249273167 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0944005310 con 0x7f09380039c0 2024-03-12T17:19:49.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.231+0000 7f0958c00640 1 -- 172.21.15.17:0/2249273167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09380039c0 msgr2=0x7f0938003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:49.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.231+0000 7f0958c00640 1 --2- 172.21.15.17:0/2249273167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09380039c0 0x7f0938003de0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0944001e20 tx=0x7f09380057f0 comp rx=0 tx=0).stop 2024-03-12T17:19:49.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.231+0000 7f0958c00640 1 -- 172.21.15.17:0/2249273167 shutdown_connections 2024-03-12T17:19:49.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.231+0000 7f0958c00640 1 --2- 172.21.15.17:0/2249273167 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09380039c0 0x7f0938003de0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:49.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.231+0000 7f0958c00640 1 -- 172.21.15.17:0/2249273167 >> 172.21.15.17:0/2249273167 conn(0x7f09540cf5f0 msgr2=0x7f09540cfa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:49.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.231+0000 7f0958c00640 1 -- 172.21.15.17:0/2249273167 shutdown_connections 2024-03-12T17:19:49.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.231+0000 7f0958c00640 1 -- 172.21.15.17:0/2249273167 wait complete. 2024-03-12T17:19:49.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.233+0000 7f0958c00640 1 Processor -- start 2024-03-12T17:19:49.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.233+0000 7f0958c00640 1 -- start start 2024-03-12T17:19:49.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.234+0000 7f0958c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09380039c0 0x7f09541f1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:49.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.234+0000 7f0958c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f095414da60 0x7f09540adad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:49.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.234+0000 7f0958c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f09540ae010 0x7f09540b0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:49.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.234+0000 7f0958c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09540ae4a0 con 0x7f09380039c0 2024-03-12T17:19:49.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.234+0000 7f0958c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09540b13c0 con 0x7f095414da60 2024-03-12T17:19:49.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.234+0000 7f0958c00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09540a94c0 con 0x7f09540ae010 2024-03-12T17:19:49.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.234+0000 7f0953400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09380039c0 0x7f09541f1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:49.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.234+0000 7f0953400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09380039c0 0x7f09541f1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39822/0 (socket says 172.21.15.17:39822) 2024-03-12T17:19:49.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.234+0000 7f0953400640 1 -- 172.21.15.17:0/3697103451 learned_addr learned my addr 172.21.15.17:0/3697103451 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:49.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.234+0000 7f0953400640 1 -- 172.21.15.17:0/3697103451 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f09540ae010 msgr2=0x7f09540b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:49.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.234+0000 7f0953400640 1 --2- 172.21.15.17:0/3697103451 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f09540ae010 0x7f09540b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:49.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.234+0000 7f0953400640 1 -- 172.21.15.17:0/3697103451 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f095414da60 msgr2=0x7f09540adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:49.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.234+0000 7f0953400640 1 --2- 172.21.15.17:0/3697103451 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f095414da60 0x7f09540adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:49.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.234+0000 7f0953400640 1 -- 172.21.15.17:0/3697103451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09540a97a0 con 0x7f09380039c0 2024-03-12T17:19:49.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.235+0000 7f0953400640 1 --2- 172.21.15.17:0/3697103451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09380039c0 0x7f09541f1ba0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f094402bf50 tx=0x7f09440014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:49.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.235+0000 7f094b400640 1 -- 172.21.15.17:0/3697103451 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094403e070 con 0x7f09380039c0 2024-03-12T17:19:49.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.235+0000 7f094b400640 1 -- 172.21.15.17:0/3697103451 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0944003e40 con 0x7f09380039c0 2024-03-12T17:19:49.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.235+0000 7f0958c00640 1 -- 172.21.15.17:0/3697103451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09540a9a80 con 0x7f09380039c0 2024-03-12T17:19:49.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.235+0000 7f094b400640 1 -- 172.21.15.17:0/3697103451 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0944005830 con 0x7f09380039c0 2024-03-12T17:19:49.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.235+0000 7f0958c00640 1 -- 172.21.15.17:0/3697103451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09541f20e0 con 0x7f09380039c0 2024-03-12T17:19:49.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.236+0000 7f0958c00640 1 -- 172.21.15.17:0/3697103451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0954067120 con 0x7f09380039c0 2024-03-12T17:19:49.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.237+0000 7f094b400640 1 -- 172.21.15.17:0/3697103451 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f0944007040 con 0x7f09380039c0 2024-03-12T17:19:49.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.239+0000 7f094b400640 1 --2- 172.21.15.17:0/3697103451 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f093406ac00 0x7f093406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:49.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.239+0000 7f094b400640 1 -- 172.21.15.17:0/3697103451 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f09440aab70 con 0x7f09380039c0 2024-03-12T17:19:49.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.239+0000 7f0952a00640 1 --2- 172.21.15.17:0/3697103451 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f093406ac00 0x7f093406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:49.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.240+0000 7f0952a00640 1 --2- 172.21.15.17:0/3697103451 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f093406ac00 0x7f093406d0c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0940006e80 tx=0x7f0940006e10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:49.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.243+0000 7f094b400640 1 -- 172.21.15.17:0/3697103451 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f0944076090 con 0x7f09380039c0 2024-03-12T17:19:49.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.516+0000 7f0958c00640 1 -- 172.21.15.17:0/3697103451 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f0954072360 con 0x7f09380039c0 2024-03-12T17:19:49.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.525+0000 7f094b400640 1 -- 172.21.15.17:0/3697103451 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v4) v1 ==== 90+0+0 (secure 0 0 0) 0x7f09440796b0 con 0x7f09380039c0 2024-03-12T17:19:49.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.527+0000 7f0958c00640 1 -- 172.21.15.17:0/3697103451 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f093406ac00 msgr2=0x7f093406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:49.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.527+0000 7f0958c00640 1 --2- 172.21.15.17:0/3697103451 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f093406ac00 0x7f093406d0c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0940006e80 tx=0x7f0940006e10 comp rx=0 tx=0).stop 2024-03-12T17:19:49.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.527+0000 7f0958c00640 1 -- 172.21.15.17:0/3697103451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09380039c0 msgr2=0x7f09541f1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:49.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.527+0000 7f0958c00640 1 --2- 172.21.15.17:0/3697103451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09380039c0 0x7f09541f1ba0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f094402bf50 tx=0x7f09440014a0 comp rx=0 tx=0).stop 2024-03-12T17:19:49.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.527+0000 7f0958c00640 1 -- 172.21.15.17:0/3697103451 shutdown_connections 2024-03-12T17:19:49.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.527+0000 7f0958c00640 1 --2- 172.21.15.17:0/3697103451 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f093406ac00 0x7f093406d0c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:49.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.527+0000 7f0958c00640 1 --2- 172.21.15.17:0/3697103451 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f09540ae010 0x7f09540b0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:49.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.527+0000 7f0958c00640 1 --2- 172.21.15.17:0/3697103451 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f095414da60 0x7f09540adad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:49.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.527+0000 7f0958c00640 1 --2- 172.21.15.17:0/3697103451 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f09380039c0 0x7f09541f1ba0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:49.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.528+0000 7f0958c00640 1 -- 172.21.15.17:0/3697103451 >> 172.21.15.17:0/3697103451 conn(0x7f09540cf5f0 msgr2=0x7f09540cda60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:49.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.528+0000 7f0958c00640 1 -- 172.21.15.17:0/3697103451 shutdown_connections 2024-03-12T17:19:49.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.528+0000 7f0958c00640 1 -- 172.21.15.17:0/3697103451 wait complete. 2024-03-12T17:19:49.541 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-03-12T17:19:49.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.768+0000 7fdae2a00640 1 Processor -- start 2024-03-12T17:19:49.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.769+0000 7fdae2a00640 1 -- start start 2024-03-12T17:19:49.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.770+0000 7fdae2a00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fdadc0b4ea0 0x7fdadc0b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:49.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.770+0000 7fdae2a00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdadc0d15b0 con 0x7fdadc160150 2024-03-12T17:19:49.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.770+0000 7fdae2a00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdadc0d2710 con 0x7fdadc0b8190 2024-03-12T17:19:49.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.770+0000 7fdae2a00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdadc160530 con 0x7fdadc0b4ea0 2024-03-12T17:19:49.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.770+0000 7fdae1600640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fdadc160150 0x7fdadc0d2000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:40808/0 (socket says 172.21.15.17:40808) 2024-03-12T17:19:49.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.770+0000 7fdae1600640 1 -- 172.21.15.17:0/462418498 learned_addr learned my addr 172.21.15.17:0/462418498 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:49.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.771+0000 7fdadbe00640 1 -- 172.21.15.17:0/462418498 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1138676781 0 0) 0x7fdadc0d15b0 con 0x7fdadc160150 2024-03-12T17:19:49.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.771+0000 7fdadbe00640 1 -- 172.21.15.17:0/462418498 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdac4003520 con 0x7fdadc160150 2024-03-12T17:19:49.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.771+0000 7fdae2000640 1 --2- 172.21.15.17:0/462418498 >> v2:172.21.15.94:3300/0 conn(0x7fdadc0b4ea0 0x7fdadc0b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:49.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.771+0000 7fdadbe00640 1 -- 172.21.15.17:0/462418498 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3365930637 0 0) 0x7fdac4003520 con 0x7fdadc160150 2024-03-12T17:19:49.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.771+0000 7fdadbe00640 1 -- 172.21.15.17:0/462418498 >> v2:172.21.15.94:3300/0 conn(0x7fdadc0b4ea0 msgr2=0x7fdadc0b59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:49.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.771+0000 7fdadbe00640 1 --2- 172.21.15.17:0/462418498 >> v2:172.21.15.94:3300/0 conn(0x7fdadc0b4ea0 0x7fdadc0b59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:49.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.771+0000 7fdadbe00640 1 -- 172.21.15.17:0/462418498 >> v1:172.21.15.94:6789/0 conn(0x7fdadc0b8190 legacy=0x7fdadc0b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:49.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.771+0000 7fdadbe00640 1 -- 172.21.15.17:0/462418498 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdadc0cdac0 con 0x7fdadc160150 2024-03-12T17:19:49.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.771+0000 7fdadbe00640 1 -- 172.21.15.17:0/462418498 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7fdad0001670 con 0x7fdadc160150 2024-03-12T17:19:49.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.771+0000 7fdadbe00640 1 -- 172.21.15.17:0/462418498 >> v1:172.21.15.17:6789/0 conn(0x7fdadc160150 legacy=0x7fdadc0d2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:49.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.771+0000 7fdadbe00640 1 --2- 172.21.15.17:0/462418498 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdac4003970 0x7fdac4003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:49.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.771+0000 7fdadbe00640 1 --2- 172.21.15.17:0/462418498 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdac40047c0 0x7fdac4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:49.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.771+0000 7fdadbe00640 1 --2- 172.21.15.17:0/462418498 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdac4005180 0x7fdac400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:49.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.771+0000 7fdadbe00640 1 -- 172.21.15.17:0/462418498 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc160530 con 0x7fdac4003970 2024-03-12T17:19:49.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.771+0000 7fdadbe00640 1 -- 172.21.15.17:0/462418498 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac400c0b0 con 0x7fdac4005180 2024-03-12T17:19:49.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.771+0000 7fdadbe00640 1 -- 172.21.15.17:0/462418498 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac400c270 con 0x7fdac40047c0 2024-03-12T17:19:49.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.772+0000 7fdae1600640 1 --2- 172.21.15.17:0/462418498 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdac4003970 0x7fdac4003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:49.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.772+0000 7fdae0c00640 1 --2- 172.21.15.17:0/462418498 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdac40047c0 0x7fdac4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:49.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.772+0000 7fdae1600640 1 -- 172.21.15.17:0/462418498 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdac40047c0 msgr2=0x7fdac4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:49.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.772+0000 7fdae1600640 1 --2- 172.21.15.17:0/462418498 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdac40047c0 0x7fdac4004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:49.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.772+0000 7fdae2000640 1 --2- 172.21.15.17:0/462418498 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdac4005180 0x7fdac400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:49.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.772+0000 7fdae1600640 1 -- 172.21.15.17:0/462418498 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdac4005180 msgr2=0x7fdac400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:49.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.772+0000 7fdae1600640 1 --2- 172.21.15.17:0/462418498 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdac4005180 0x7fdac400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:49.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.772+0000 7fdae1600640 1 -- 172.21.15.17:0/462418498 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac4003520 con 0x7fdac4003970 2024-03-12T17:19:49.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.772+0000 7fdae2000640 1 -- 172.21.15.17:0/462418498 reap_dead start 2024-03-12T17:19:49.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.773+0000 7fdae1600640 1 --2- 172.21.15.17:0/462418498 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdac4003970 0x7fdac4003d70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fdad000c210 tx=0x7fdac40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e2679b00765f61b server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:49.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.774+0000 7fdadbe00640 1 -- 172.21.15.17:0/462418498 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad0005ad0 con 0x7fdac4003970 2024-03-12T17:19:49.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.774+0000 7fdadbe00640 1 -- 172.21.15.17:0/462418498 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad0005c30 con 0x7fdac4003970 2024-03-12T17:19:49.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.774+0000 7fdadbe00640 1 -- 172.21.15.17:0/462418498 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad002c890 con 0x7fdac4003970 2024-03-12T17:19:49.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.774+0000 7fdae2a00640 1 -- 172.21.15.17:0/462418498 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdac4003970 msgr2=0x7fdac4003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:49.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.774+0000 7fdae2a00640 1 --2- 172.21.15.17:0/462418498 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdac4003970 0x7fdac4003d70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fdad000c210 tx=0x7fdac40057f0 comp rx=0 tx=0).stop 2024-03-12T17:19:49.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.774+0000 7fdae2a00640 1 -- 172.21.15.17:0/462418498 shutdown_connections 2024-03-12T17:19:49.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.774+0000 7fdae2a00640 1 --2- 172.21.15.17:0/462418498 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdac4003970 0x7fdac4003d70 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:49.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.774+0000 7fdae2a00640 1 -- 172.21.15.17:0/462418498 >> 172.21.15.17:0/462418498 conn(0x7fdadc0cf7d0 msgr2=0x7fdadc0cfbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:49.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.774+0000 7fdae2a00640 1 -- 172.21.15.17:0/462418498 shutdown_connections 2024-03-12T17:19:49.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.774+0000 7fdae2a00640 1 -- 172.21.15.17:0/462418498 wait complete. 2024-03-12T17:19:49.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.776+0000 7fdae2a00640 1 Processor -- start 2024-03-12T17:19:49.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.776+0000 7fdae2a00640 1 -- start start 2024-03-12T17:19:49.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.777+0000 7fdae2a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdac4003970 0x7fdadc1f1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:49.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.777+0000 7fdae2a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdadc0c69a0 0x7fdadc0a9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:49.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.777+0000 7fdae2a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdadc0a9870 0x7fdadc1f57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:49.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.777+0000 7fdae2a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc0cc450 con 0x7fdadc0c69a0 2024-03-12T17:19:49.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.777+0000 7fdae2a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc0a9cf0 con 0x7fdac4003970 2024-03-12T17:19:49.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.777+0000 7fdae2a00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc0c6e20 con 0x7fdadc0a9870 2024-03-12T17:19:49.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.778+0000 7fdae0c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdadc0c69a0 0x7fdadc0a9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:49.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.778+0000 7fdae0c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdadc0c69a0 0x7fdadc0a9330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39846/0 (socket says 172.21.15.17:39846) 2024-03-12T17:19:49.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.778+0000 7fdae0c00640 1 -- 172.21.15.17:0/1367091088 learned_addr learned my addr 172.21.15.17:0/1367091088 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:49.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.778+0000 7fdae2000640 1 --2- 172.21.15.17:0/1367091088 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdadc0a9870 0x7fdadc1f57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:49.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.778+0000 7fdae1600640 1 --2- 172.21.15.17:0/1367091088 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdac4003970 0x7fdadc1f1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:49.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.778+0000 7fdae0c00640 1 -- 172.21.15.17:0/1367091088 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdadc0a9870 msgr2=0x7fdadc1f57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:49.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.778+0000 7fdae0c00640 1 --2- 172.21.15.17:0/1367091088 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdadc0a9870 0x7fdadc1f57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:49.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.778+0000 7fdae0c00640 1 -- 172.21.15.17:0/1367091088 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdac4003970 msgr2=0x7fdadc1f1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:49.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.778+0000 7fdae0c00640 1 --2- 172.21.15.17:0/1367091088 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdac4003970 0x7fdadc1f1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:49.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.778+0000 7fdae0c00640 1 -- 172.21.15.17:0/1367091088 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdadc0cb8d0 con 0x7fdadc0c69a0 2024-03-12T17:19:49.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.778+0000 7fdae0c00640 1 --2- 172.21.15.17:0/1367091088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdadc0c69a0 0x7fdadc0a9330 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fdacc00d880 tx=0x7fdacc00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:49.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.779+0000 7fdad9600640 1 -- 172.21.15.17:0/1367091088 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc00bac0 con 0x7fdadc0c69a0 2024-03-12T17:19:49.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.779+0000 7fdad9600640 1 -- 172.21.15.17:0/1367091088 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdacc00bc20 con 0x7fdadc0c69a0 2024-03-12T17:19:49.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.779+0000 7fdad9600640 1 -- 172.21.15.17:0/1367091088 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc0123f0 con 0x7fdadc0c69a0 2024-03-12T17:19:49.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.779+0000 7fdae2a00640 1 -- 172.21.15.17:0/1367091088 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdadc0cbbb0 con 0x7fdadc0c69a0 2024-03-12T17:19:49.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.779+0000 7fdae2a00640 1 -- 172.21.15.17:0/1367091088 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdadc0cc170 con 0x7fdadc0c69a0 2024-03-12T17:19:49.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.780+0000 7fdae2a00640 1 -- 172.21.15.17:0/1367091088 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdadc04e030 con 0x7fdadc0c69a0 2024-03-12T17:19:49.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.781+0000 7fdad9600640 1 -- 172.21.15.17:0/1367091088 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fdacc012550 con 0x7fdadc0c69a0 2024-03-12T17:19:49.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.782+0000 7fdad9600640 1 --2- 172.21.15.17:0/1367091088 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fdac006ac00 0x7fdac006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:49.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.782+0000 7fdad9600640 1 -- 172.21.15.17:0/1367091088 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdacc0894e0 con 0x7fdadc0c69a0 2024-03-12T17:19:49.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.782+0000 7fdae1600640 1 --2- 172.21.15.17:0/1367091088 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fdac006ac00 0x7fdac006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:49.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.783+0000 7fdae1600640 1 --2- 172.21.15.17:0/1367091088 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fdac006ac00 0x7fdac006d0c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdad0034000 tx=0x7fdad0009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:49.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:49.786+0000 7fdad9600640 1 -- 172.21.15.17:0/1367091088 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fdacc054970 con 0x7fdadc0c69a0 2024-03-12T17:19:50.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.043+0000 7fdae2a00640 1 -- 172.21.15.17:0/1367091088 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fdadc15f570 con 0x7fdadc0c69a0 2024-03-12T17:19:50.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.051+0000 7fdad9600640 1 -- 172.21.15.17:0/1367091088 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fdacc057f90 con 0x7fdadc0c69a0 2024-03-12T17:19:50.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.054+0000 7fdae2a00640 1 -- 172.21.15.17:0/1367091088 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fdac006ac00 msgr2=0x7fdac006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:50.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.054+0000 7fdae2a00640 1 --2- 172.21.15.17:0/1367091088 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fdac006ac00 0x7fdac006d0c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdad0034000 tx=0x7fdad0009030 comp rx=0 tx=0).stop 2024-03-12T17:19:50.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.054+0000 7fdae2a00640 1 -- 172.21.15.17:0/1367091088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdadc0c69a0 msgr2=0x7fdadc0a9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:50.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.054+0000 7fdae2a00640 1 --2- 172.21.15.17:0/1367091088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdadc0c69a0 0x7fdadc0a9330 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fdacc00d880 tx=0x7fdacc00dd40 comp rx=0 tx=0).stop 2024-03-12T17:19:50.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.054+0000 7fdae2a00640 1 -- 172.21.15.17:0/1367091088 shutdown_connections 2024-03-12T17:19:50.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.054+0000 7fdae2a00640 1 --2- 172.21.15.17:0/1367091088 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fdac006ac00 0x7fdac006d0c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:50.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.054+0000 7fdae2a00640 1 --2- 172.21.15.17:0/1367091088 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fdadc0a9870 0x7fdadc1f57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:50.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.054+0000 7fdae2a00640 1 --2- 172.21.15.17:0/1367091088 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fdadc0c69a0 0x7fdadc0a9330 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:50.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.054+0000 7fdae2a00640 1 --2- 172.21.15.17:0/1367091088 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fdac4003970 0x7fdadc1f1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:50.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.054+0000 7fdae2a00640 1 -- 172.21.15.17:0/1367091088 >> 172.21.15.17:0/1367091088 conn(0x7fdadc0cf7d0 msgr2=0x7fdadc0b5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:50.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.055+0000 7fdae2a00640 1 -- 172.21.15.17:0/1367091088 shutdown_connections 2024-03-12T17:19:50.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.055+0000 7fdae2a00640 1 -- 172.21.15.17:0/1367091088 wait complete. 2024-03-12T17:19:50.066 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-03-12T17:19:50.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.285+0000 7f7714800640 1 Processor -- start 2024-03-12T17:19:50.280 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.285+0000 7f7714800640 1 -- start start 2024-03-12T17:19:50.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.287+0000 7f7714800640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f770c144240 0x7f770c0ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:50.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.287+0000 7f7714800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f770c0cb970 0x7f770c0cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:50.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.287+0000 7f7714800640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f770c0ce320 con 0x7f770c0cecf0 2024-03-12T17:19:50.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.287+0000 7f7714800640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f770c0cc340 con 0x7f770c0cb970 2024-03-12T17:19:50.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.287+0000 7f7714800640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f770c144620 con 0x7f770c144240 2024-03-12T17:19:50.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.287+0000 7f7712800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f770c0cb970 0x7f770c0cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:50.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.287+0000 7f7712800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f770c0cb970 0x7f770c0cbe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39848/0 (socket says 172.21.15.17:39848) 2024-03-12T17:19:50.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.287+0000 7f7712800640 1 -- 172.21.15.17:0/3252809897 learned_addr learned my addr 172.21.15.17:0/3252809897 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:50.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.287+0000 7f7712800640 1 -- 172.21.15.17:0/3252809897 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f770c144240 msgr2=0x7f770c0ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:50.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.287+0000 7f7711e00640 1 --2- 172.21.15.17:0/3252809897 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f770c144240 0x7f770c0ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:50.282 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.288+0000 7f7712800640 1 --2- 172.21.15.17:0/3252809897 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f770c144240 0x7f770c0ce7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:50.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.288+0000 7f7712800640 1 -- 172.21.15.17:0/3252809897 >> v1:172.21.15.17:6789/0 conn(0x7f770c0cecf0 legacy=0x7f770c0b2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:50.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.288+0000 7f7712800640 1 -- 172.21.15.17:0/3252809897 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770c15f3d0 con 0x7f770c0cb970 2024-03-12T17:19:50.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.289+0000 7f7712800640 1 --2- 172.21.15.17:0/3252809897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f770c0cb970 0x7f770c0cbe00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7708009e80 tx=0x7f770802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb2cfa929f7fe7 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:50.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.289+0000 7f7710a00640 1 -- 172.21.15.17:0/3252809897 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770802caf0 con 0x7f770c0cb970 2024-03-12T17:19:50.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.289+0000 7f7710a00640 1 -- 172.21.15.17:0/3252809897 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770802cc50 con 0x7f770c0cb970 2024-03-12T17:19:50.283 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.289+0000 7f7710a00640 1 -- 172.21.15.17:0/3252809897 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77080343f0 con 0x7f770c0cb970 2024-03-12T17:19:50.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.290+0000 7f7714800640 1 -- 172.21.15.17:0/3252809897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f770c0cb970 msgr2=0x7f770c0cbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:50.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.290+0000 7f7714800640 1 --2- 172.21.15.17:0/3252809897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f770c0cb970 0x7f770c0cbe00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7708009e80 tx=0x7f770802bf50 comp rx=0 tx=0).stop 2024-03-12T17:19:50.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.290+0000 7f7714800640 1 -- 172.21.15.17:0/3252809897 shutdown_connections 2024-03-12T17:19:50.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.290+0000 7f7714800640 1 --2- 172.21.15.17:0/3252809897 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f770c0cb970 0x7f770c0cbe00 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:50.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.290+0000 7f7714800640 1 --2- 172.21.15.17:0/3252809897 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f770c144240 0x7f770c0ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:50.284 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.290+0000 7f7714800640 1 -- 172.21.15.17:0/3252809897 >> 172.21.15.17:0/3252809897 conn(0x7f770c069ce0 msgr2=0x7f770c06a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:50.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.290+0000 7f7714800640 1 -- 172.21.15.17:0/3252809897 shutdown_connections 2024-03-12T17:19:50.285 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.290+0000 7f7714800640 1 -- 172.21.15.17:0/3252809897 wait complete. 2024-03-12T17:19:50.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.292+0000 7f7714800640 1 Processor -- start 2024-03-12T17:19:50.286 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.292+0000 7f7714800640 1 -- start start 2024-03-12T17:19:50.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.293+0000 7f7714800640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f770c0cb970 0x7f770c0b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:50.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.293+0000 7f7714800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f770c0cecf0 0x7f770c140140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:50.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.293+0000 7f7714800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f770c144240 0x7f770c140680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:50.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.293+0000 7f7714800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770c1f6610 con 0x7f770c144240 2024-03-12T17:19:50.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.293+0000 7f7714800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f770c140bc0 con 0x7f770c0cecf0 2024-03-12T17:19:50.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.293+0000 7f7714800640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f770c1f5a40 con 0x7f770c0cb970 2024-03-12T17:19:50.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.293+0000 7f7712800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f770c144240 0x7f770c140680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:50.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.293+0000 7f7712800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f770c144240 0x7f770c140680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39850/0 (socket says 172.21.15.17:39850) 2024-03-12T17:19:50.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.293+0000 7f7712800640 1 -- 172.21.15.17:0/2136879127 learned_addr learned my addr 172.21.15.17:0/2136879127 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:50.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.293+0000 7f7712800640 1 -- 172.21.15.17:0/2136879127 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f770c0cb970 msgr2=0x7f770c0b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:50.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.293+0000 7f7712800640 1 --2- 172.21.15.17:0/2136879127 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f770c0cb970 0x7f770c0b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:50.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.293+0000 7f7712800640 1 -- 172.21.15.17:0/2136879127 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f770c0cecf0 msgr2=0x7f770c140140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:50.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.293+0000 7f7712800640 1 --2- 172.21.15.17:0/2136879127 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f770c0cecf0 0x7f770c140140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:50.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.293+0000 7f7712800640 1 -- 172.21.15.17:0/2136879127 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7708009b30 con 0x7f770c144240 2024-03-12T17:19:50.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.294+0000 7f7712800640 1 --2- 172.21.15.17:0/2136879127 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f770c144240 0x7f770c140680 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7708036040 tx=0x7f7708004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:50.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.294+0000 7f7706000640 1 -- 172.21.15.17:0/2136879127 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770803e450 con 0x7f770c144240 2024-03-12T17:19:50.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.294+0000 7f7706000640 1 -- 172.21.15.17:0/2136879127 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f770803e5b0 con 0x7f770c144240 2024-03-12T17:19:50.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.294+0000 7f7706000640 1 -- 172.21.15.17:0/2136879127 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f770803e960 con 0x7f770c144240 2024-03-12T17:19:50.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.294+0000 7f7714800640 1 -- 172.21.15.17:0/2136879127 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f770c1f5ce0 con 0x7f770c144240 2024-03-12T17:19:50.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.294+0000 7f7714800640 1 -- 172.21.15.17:0/2136879127 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f770c1f62a0 con 0x7f770c144240 2024-03-12T17:19:50.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.295+0000 7f7714800640 1 -- 172.21.15.17:0/2136879127 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f770c0736c0 con 0x7f770c144240 2024-03-12T17:19:50.290 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.296+0000 7f7706000640 1 -- 172.21.15.17:0/2136879127 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f770803eac0 con 0x7f770c144240 2024-03-12T17:19:50.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.297+0000 7f7706000640 1 --2- 172.21.15.17:0/2136879127 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f76f006ac00 0x7f76f006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:50.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.297+0000 7f7706000640 1 -- 172.21.15.17:0/2136879127 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f77080abf40 con 0x7f770c144240 2024-03-12T17:19:50.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.298+0000 7f7711e00640 1 --2- 172.21.15.17:0/2136879127 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f76f006ac00 0x7f76f006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:50.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.298+0000 7f7711e00640 1 --2- 172.21.15.17:0/2136879127 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f76f006ac00 0x7f76f006d0c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f770000a810 tx=0x7f7700008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:50.296 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.302+0000 7f7706000640 1 -- 172.21.15.17:0/2136879127 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f7708077480 con 0x7f770c144240 2024-03-12T17:19:50.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.559+0000 7f7714800640 1 -- 172.21.15.17:0/2136879127 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f770c1f6750 con 0x7f770c144240 2024-03-12T17:19:50.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.566+0000 7f7706000640 1 -- 172.21.15.17:0/2136879127 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f770807aaa0 con 0x7f770c144240 2024-03-12T17:19:50.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.568+0000 7f7714800640 1 -- 172.21.15.17:0/2136879127 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f76f006ac00 msgr2=0x7f76f006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:50.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.568+0000 7f7714800640 1 --2- 172.21.15.17:0/2136879127 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f76f006ac00 0x7f76f006d0c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f770000a810 tx=0x7f7700008040 comp rx=0 tx=0).stop 2024-03-12T17:19:50.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.568+0000 7f7714800640 1 -- 172.21.15.17:0/2136879127 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f770c144240 msgr2=0x7f770c140680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:50.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.568+0000 7f7714800640 1 --2- 172.21.15.17:0/2136879127 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f770c144240 0x7f770c140680 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7708036040 tx=0x7f7708004a40 comp rx=0 tx=0).stop 2024-03-12T17:19:50.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.568+0000 7f7714800640 1 -- 172.21.15.17:0/2136879127 shutdown_connections 2024-03-12T17:19:50.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.568+0000 7f7714800640 1 --2- 172.21.15.17:0/2136879127 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f76f006ac00 0x7f76f006d0c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:50.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.568+0000 7f7714800640 1 --2- 172.21.15.17:0/2136879127 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f770c144240 0x7f770c140680 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:50.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.568+0000 7f7714800640 1 --2- 172.21.15.17:0/2136879127 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f770c0cecf0 0x7f770c140140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:50.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.568+0000 7f7714800640 1 --2- 172.21.15.17:0/2136879127 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f770c0cb970 0x7f770c0b0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:50.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.568+0000 7f7714800640 1 -- 172.21.15.17:0/2136879127 >> 172.21.15.17:0/2136879127 conn(0x7f770c069ce0 msgr2=0x7f770c15b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:50.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.569+0000 7f7714800640 1 -- 172.21.15.17:0/2136879127 shutdown_connections 2024-03-12T17:19:50.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.569+0000 7f7714800640 1 -- 172.21.15.17:0/2136879127 wait complete. 2024-03-12T17:19:50.580 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-03-12T17:19:50.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.796+0000 7f05cca00640 1 Processor -- start 2024-03-12T17:19:50.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.796+0000 7f05cca00640 1 -- start start 2024-03-12T17:19:50.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.797+0000 7f05cca00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f05c815bf20 0x7f05c80cf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:50.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.797+0000 7f05cca00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f05c80b1520 0x7f05c8098a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:50.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.797+0000 7f05cca00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05c80b0480 con 0x7f05c8098fa0 2024-03-12T17:19:50.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.797+0000 7f05cca00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c80cf570 con 0x7f05c815bf20 2024-03-12T17:19:50.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.797+0000 7f05cca00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c8099430 con 0x7f05c80b1520 2024-03-12T17:19:50.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.798+0000 7f05c7400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f05c815bf20 0x7f05c80cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:50.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.798+0000 7f05c7e00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f05c8098fa0 0x7f05c80cb020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:40820/0 (socket says 172.21.15.17:40820) 2024-03-12T17:19:50.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.798+0000 7f05c7e00640 1 -- 172.21.15.17:0/3927011765 learned_addr learned my addr 172.21.15.17:0/3927011765 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:50.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.798+0000 7f05c6a00640 1 --2- 172.21.15.17:0/3927011765 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f05c80b1520 0x7f05c8098a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:50.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.798+0000 7f05c7400640 1 -- 172.21.15.17:0/3927011765 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f05c80b1520 msgr2=0x7f05c8098a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:50.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.798+0000 7f05c7400640 1 --2- 172.21.15.17:0/3927011765 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f05c80b1520 0x7f05c8098a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:50.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.798+0000 7f05c7400640 1 -- 172.21.15.17:0/3927011765 >> v1:172.21.15.17:6789/0 conn(0x7f05c8098fa0 legacy=0x7f05c80cb020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:50.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.798+0000 7f05c7400640 1 -- 172.21.15.17:0/3927011765 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c80b0760 con 0x7f05c815bf20 2024-03-12T17:19:50.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.798+0000 7f05c6000640 1 -- 172.21.15.17:0/3927011765 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2915229404 0 0) 0x7f05c80b0480 con 0x7f05c8098fa0 2024-03-12T17:19:50.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.798+0000 7f05c6a00640 1 --2- 172.21.15.17:0/3927011765 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f05c80b1520 0x7f05c8098a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:50.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.800+0000 7f05c7400640 1 --2- 172.21.15.17:0/3927011765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05c815bf20 0x7f05c80cf030 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f05b80097a0 tx=0x7f05b802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35e7482beeca1b4f server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:50.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.800+0000 7f05c6000640 1 -- 172.21.15.17:0/3927011765 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b8031830 con 0x7f05c815bf20 2024-03-12T17:19:50.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.800+0000 7f05c6000640 1 -- 172.21.15.17:0/3927011765 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b8031990 con 0x7f05c815bf20 2024-03-12T17:19:50.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.800+0000 7f05c6000640 1 -- 172.21.15.17:0/3927011765 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b8031d20 con 0x7f05c815bf20 2024-03-12T17:19:50.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.801+0000 7f05cca00640 1 -- 172.21.15.17:0/3927011765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05c815bf20 msgr2=0x7f05c80cf030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:50.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.801+0000 7f05cca00640 1 --2- 172.21.15.17:0/3927011765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05c815bf20 0x7f05c80cf030 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f05b80097a0 tx=0x7f05b802b8d0 comp rx=0 tx=0).stop 2024-03-12T17:19:50.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.801+0000 7f05cca00640 1 -- 172.21.15.17:0/3927011765 shutdown_connections 2024-03-12T17:19:50.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.801+0000 7f05cca00640 1 --2- 172.21.15.17:0/3927011765 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f05c80b1520 0x7f05c8098a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:50.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.801+0000 7f05cca00640 1 --2- 172.21.15.17:0/3927011765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05c815bf20 0x7f05c80cf030 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:50.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.801+0000 7f05cca00640 1 -- 172.21.15.17:0/3927011765 >> 172.21.15.17:0/3927011765 conn(0x7f05c80b21a0 msgr2=0x7f05c80b25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:50.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.801+0000 7f05cca00640 1 -- 172.21.15.17:0/3927011765 shutdown_connections 2024-03-12T17:19:50.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.801+0000 7f05cca00640 1 -- 172.21.15.17:0/3927011765 wait complete. 2024-03-12T17:19:50.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.803+0000 7f05cca00640 1 Processor -- start 2024-03-12T17:19:50.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.803+0000 7f05cca00640 1 -- start start 2024-03-12T17:19:50.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.804+0000 7f05cca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05c8098fa0 0x7f05c80c53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:50.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.804+0000 7f05cca00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f05c80b1520 0x7f05c80ca190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:50.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.804+0000 7f05cca00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f05c815bf20 0x7f05c80aeff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:50.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.804+0000 7f05cca00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c815a260 con 0x7f05c8098fa0 2024-03-12T17:19:50.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.804+0000 7f05cca00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c80c4f20 con 0x7f05c815bf20 2024-03-12T17:19:50.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.804+0000 7f05cca00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c80c4310 con 0x7f05c80b1520 2024-03-12T17:19:50.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.804+0000 7f05c7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05c8098fa0 0x7f05c80c53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:50.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.804+0000 7f05c7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05c8098fa0 0x7f05c80c53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39870/0 (socket says 172.21.15.17:39870) 2024-03-12T17:19:50.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.804+0000 7f05c7400640 1 -- 172.21.15.17:0/3580443344 learned_addr learned my addr 172.21.15.17:0/3580443344 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:50.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.804+0000 7f05c6a00640 1 --2- 172.21.15.17:0/3580443344 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f05c80b1520 0x7f05c80ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:50.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.804+0000 7f05c7400640 1 -- 172.21.15.17:0/3580443344 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f05c80b1520 msgr2=0x7f05c80ca190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:50.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.804+0000 7f05c7400640 1 --2- 172.21.15.17:0/3580443344 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f05c80b1520 0x7f05c80ca190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:50.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.804+0000 7f05c7e00640 1 --2- 172.21.15.17:0/3580443344 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f05c815bf20 0x7f05c80aeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:50.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.804+0000 7f05c7400640 1 -- 172.21.15.17:0/3580443344 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f05c815bf20 msgr2=0x7f05c80aeff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:50.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.805+0000 7f05c7400640 1 --2- 172.21.15.17:0/3580443344 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f05c815bf20 0x7f05c80aeff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:50.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.805+0000 7f05c7400640 1 -- 172.21.15.17:0/3580443344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b8009400 con 0x7f05c8098fa0 2024-03-12T17:19:50.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.805+0000 7f05c7e00640 1 --2- 172.21.15.17:0/3580443344 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f05c815bf20 0x7f05c80aeff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:50.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.805+0000 7f05c7400640 1 --2- 172.21.15.17:0/3580443344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05c8098fa0 0x7f05c80c53b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f05b802bee0 tx=0x7f05b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:50.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.805+0000 7f05bf400640 1 -- 172.21.15.17:0/3580443344 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b803ba70 con 0x7f05c8098fa0 2024-03-12T17:19:50.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.805+0000 7f05bf400640 1 -- 172.21.15.17:0/3580443344 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b803bbf0 con 0x7f05c8098fa0 2024-03-12T17:19:50.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.805+0000 7f05bf400640 1 -- 172.21.15.17:0/3580443344 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b80453f0 con 0x7f05c8098fa0 2024-03-12T17:19:50.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.805+0000 7f05cca00640 1 -- 172.21.15.17:0/3580443344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c80c45f0 con 0x7f05c8098fa0 2024-03-12T17:19:50.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.805+0000 7f05cca00640 1 -- 172.21.15.17:0/3580443344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c80c4bb0 con 0x7f05c8098fa0 2024-03-12T17:19:50.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.806+0000 7f05cca00640 1 -- 172.21.15.17:0/3580443344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c804e030 con 0x7f05c8098fa0 2024-03-12T17:19:50.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.807+0000 7f05bf400640 1 -- 172.21.15.17:0/3580443344 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f05b804e450 con 0x7f05c8098fa0 2024-03-12T17:19:50.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.808+0000 7f05bf400640 1 --2- 172.21.15.17:0/3580443344 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f05a406ac00 0x7f05a406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:50.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.808+0000 7f05bf400640 1 -- 172.21.15.17:0/3580443344 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f05b80ab270 con 0x7f05c8098fa0 2024-03-12T17:19:50.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.808+0000 7f05c6a00640 1 --2- 172.21.15.17:0/3580443344 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f05a406ac00 0x7f05a406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:50.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.809+0000 7f05c6a00640 1 --2- 172.21.15.17:0/3580443344 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f05a406ac00 0x7f05a406d0c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f05c81f5860 tx=0x7f05b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:50.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:50.813+0000 7f05bf400640 1 -- 172.21.15.17:0/3580443344 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f05b8076790 con 0x7f05c8098fa0 2024-03-12T17:19:51.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.080+0000 7f05cca00640 1 -- 172.21.15.17:0/3580443344 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f05c80b30b0 con 0x7f05c8098fa0 2024-03-12T17:19:51.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.085+0000 7f05bf400640 1 -- 172.21.15.17:0/3580443344 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v7) v1 ==== 97+0+0 (secure 0 0 0) 0x7f05b8079db0 con 0x7f05c8098fa0 2024-03-12T17:19:51.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.088+0000 7f05cca00640 1 -- 172.21.15.17:0/3580443344 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f05a406ac00 msgr2=0x7f05a406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:51.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.088+0000 7f05cca00640 1 --2- 172.21.15.17:0/3580443344 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f05a406ac00 0x7f05a406d0c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f05c81f5860 tx=0x7f05b0008040 comp rx=0 tx=0).stop 2024-03-12T17:19:51.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.088+0000 7f05cca00640 1 -- 172.21.15.17:0/3580443344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05c8098fa0 msgr2=0x7f05c80c53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:51.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.088+0000 7f05cca00640 1 --2- 172.21.15.17:0/3580443344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05c8098fa0 0x7f05c80c53b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f05b802bee0 tx=0x7f05b80046c0 comp rx=0 tx=0).stop 2024-03-12T17:19:51.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.088+0000 7f05cca00640 1 -- 172.21.15.17:0/3580443344 shutdown_connections 2024-03-12T17:19:51.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.088+0000 7f05cca00640 1 --2- 172.21.15.17:0/3580443344 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f05a406ac00 0x7f05a406d0c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:51.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.088+0000 7f05cca00640 1 --2- 172.21.15.17:0/3580443344 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f05c815bf20 0x7f05c80aeff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:51.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.088+0000 7f05cca00640 1 --2- 172.21.15.17:0/3580443344 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f05c80b1520 0x7f05c80ca190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:51.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.088+0000 7f05cca00640 1 --2- 172.21.15.17:0/3580443344 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f05c8098fa0 0x7f05c80c53b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:51.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.088+0000 7f05cca00640 1 -- 172.21.15.17:0/3580443344 >> 172.21.15.17:0/3580443344 conn(0x7f05c80b21a0 msgr2=0x7f05c80b2580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:51.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.088+0000 7f05cca00640 1 -- 172.21.15.17:0/3580443344 shutdown_connections 2024-03-12T17:19:51.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.088+0000 7f05cca00640 1 -- 172.21.15.17:0/3580443344 wait complete. 2024-03-12T17:19:51.101 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-03-12T17:19:51.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.323+0000 7f50a6c00640 1 Processor -- start 2024-03-12T17:19:51.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.323+0000 7f50a6c00640 1 -- start start 2024-03-12T17:19:51.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.325+0000 7f50a6c00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f50a00d2fa0 0x7f50a00d3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:51.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.325+0000 7f50a6c00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f50a00b5b50 0x7f50a00b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:51.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.325+0000 7f50a6c00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50a00d14e0 con 0x7f50a00cd840 2024-03-12T17:19:51.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.325+0000 7f50a6c00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50a00b59e0 con 0x7f50a00b5b50 2024-03-12T17:19:51.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.325+0000 7f50a6c00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50a00d38c0 con 0x7f50a00d2fa0 2024-03-12T17:19:51.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.325+0000 7f5097400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f50a00b5b50 0x7f50a00b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:51.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.325+0000 7f5097400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f50a00b5b50 0x7f50a00b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39876/0 (socket says 172.21.15.17:39876) 2024-03-12T17:19:51.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.325+0000 7f5097400640 1 -- 172.21.15.17:0/1788001062 learned_addr learned my addr 172.21.15.17:0/1788001062 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:51.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.325+0000 7f509fe00640 1 --2- 172.21.15.17:0/1788001062 >> v2:172.21.15.94:3300/0 conn(0x7f50a00d2fa0 0x7f50a00d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:51.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.326+0000 7f5097400640 1 -- 172.21.15.17:0/1788001062 >> v2:172.21.15.94:3300/0 conn(0x7f50a00d2fa0 msgr2=0x7f50a00d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:51.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.326+0000 7f5097400640 1 --2- 172.21.15.17:0/1788001062 >> v2:172.21.15.94:3300/0 conn(0x7f50a00d2fa0 0x7f50a00d3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:51.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.326+0000 7f5097400640 1 -- 172.21.15.17:0/1788001062 >> v1:172.21.15.94:6789/0 conn(0x7f50a00cd840 legacy=0x7f50a00d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:51.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.326+0000 7f5097400640 1 -- 172.21.15.17:0/1788001062 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a00b85b0 con 0x7f50a00b5b50 2024-03-12T17:19:51.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.326+0000 7f509fe00640 1 --2- 172.21.15.17:0/1788001062 >> v2:172.21.15.94:3300/0 conn(0x7f50a00d2fa0 0x7f50a00d3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:51.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.327+0000 7f5097400640 1 --2- 172.21.15.17:0/1788001062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50a00b5b50 0x7f50a00b5f70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f50a00b4dc0 tx=0x7f508802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a61f675016f484b7 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:51.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.327+0000 7f509f400640 1 -- 172.21.15.17:0/1788001062 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5088031870 con 0x7f50a00b5b50 2024-03-12T17:19:51.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.327+0000 7f509f400640 1 -- 172.21.15.17:0/1788001062 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50880319d0 con 0x7f50a00b5b50 2024-03-12T17:19:51.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.327+0000 7f509f400640 1 -- 172.21.15.17:0/1788001062 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5088031d60 con 0x7f50a00b5b50 2024-03-12T17:19:51.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.328+0000 7f50a6c00640 1 -- 172.21.15.17:0/1788001062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50a00b5b50 msgr2=0x7f50a00b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:51.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.328+0000 7f50a6c00640 1 --2- 172.21.15.17:0/1788001062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50a00b5b50 0x7f50a00b5f70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f50a00b4dc0 tx=0x7f508802b910 comp rx=0 tx=0).stop 2024-03-12T17:19:51.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.328+0000 7f50a6c00640 1 -- 172.21.15.17:0/1788001062 shutdown_connections 2024-03-12T17:19:51.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.328+0000 7f50a6c00640 1 --2- 172.21.15.17:0/1788001062 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50a00b5b50 0x7f50a00b5f70 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:51.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.328+0000 7f50a6c00640 1 --2- 172.21.15.17:0/1788001062 >> v2:172.21.15.94:3300/0 conn(0x7f50a00d2fa0 0x7f50a00d3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:51.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.328+0000 7f50a6c00640 1 -- 172.21.15.17:0/1788001062 >> 172.21.15.17:0/1788001062 conn(0x7f50a0065df0 msgr2=0x7f50a0066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:51.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.328+0000 7f50a6c00640 1 -- 172.21.15.17:0/1788001062 shutdown_connections 2024-03-12T17:19:51.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.328+0000 7f50a6c00640 1 -- 172.21.15.17:0/1788001062 wait complete. 2024-03-12T17:19:51.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.330+0000 7f50a6c00640 1 Processor -- start 2024-03-12T17:19:51.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.330+0000 7f50a6c00640 1 -- start start 2024-03-12T17:19:51.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.331+0000 7f50a6c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50a00b5b50 0x7f50a0150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:51.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.331+0000 7f50a6c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f50a00cd840 0x7f50a015dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:51.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.331+0000 7f50a6c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50a00d2fa0 0x7f50a00c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:51.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.331+0000 7f50a6c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a01f35a0 con 0x7f50a00b5b50 2024-03-12T17:19:51.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.331+0000 7f50a6c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a00cca40 con 0x7f50a00d2fa0 2024-03-12T17:19:51.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.331+0000 7f50a6c00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a015cf40 con 0x7f50a00cd840 2024-03-12T17:19:51.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.331+0000 7f509fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50a00b5b50 0x7f50a0150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:51.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.331+0000 7f509fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50a00b5b50 0x7f50a0150dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39890/0 (socket says 172.21.15.17:39890) 2024-03-12T17:19:51.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.331+0000 7f509fe00640 1 -- 172.21.15.17:0/1207731999 learned_addr learned my addr 172.21.15.17:0/1207731999 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:51.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.331+0000 7f509fe00640 1 -- 172.21.15.17:0/1207731999 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f50a00cd840 msgr2=0x7f50a015dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:51.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.331+0000 7f509fe00640 1 --2- 172.21.15.17:0/1207731999 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f50a00cd840 0x7f50a015dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:51.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.332+0000 7f509fe00640 1 -- 172.21.15.17:0/1207731999 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50a00d2fa0 msgr2=0x7f50a00c9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:51.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.332+0000 7f509fe00640 1 --2- 172.21.15.17:0/1207731999 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50a00d2fa0 0x7f50a00c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:51.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.332+0000 7f509fe00640 1 -- 172.21.15.17:0/1207731999 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50880094d0 con 0x7f50a00b5b50 2024-03-12T17:19:51.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.332+0000 7f509fe00640 1 --2- 172.21.15.17:0/1207731999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50a00b5b50 0x7f50a0150dc0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f509000c7f0 tx=0x7f509000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:51.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.332+0000 7f509cc00640 1 -- 172.21.15.17:0/1207731999 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5090007820 con 0x7f50a00b5b50 2024-03-12T17:19:51.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.332+0000 7f509cc00640 1 -- 172.21.15.17:0/1207731999 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5090007980 con 0x7f50a00b5b50 2024-03-12T17:19:51.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.332+0000 7f509cc00640 1 -- 172.21.15.17:0/1207731999 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5090007cf0 con 0x7f50a00b5b50 2024-03-12T17:19:51.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.332+0000 7f50a6c00640 1 -- 172.21.15.17:0/1207731999 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50a015d220 con 0x7f50a00b5b50 2024-03-12T17:19:51.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.332+0000 7f50a6c00640 1 -- 172.21.15.17:0/1207731999 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a015d7e0 con 0x7f50a00b5b50 2024-03-12T17:19:51.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.333+0000 7f50a6c00640 1 -- 172.21.15.17:0/1207731999 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50a00d16f0 con 0x7f50a00b5b50 2024-03-12T17:19:51.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.334+0000 7f509cc00640 1 -- 172.21.15.17:0/1207731999 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f50900113f0 con 0x7f50a00b5b50 2024-03-12T17:19:51.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.335+0000 7f509cc00640 1 --2- 172.21.15.17:0/1207731999 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f507c06ac00 0x7f507c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:51.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.335+0000 7f509cc00640 1 -- 172.21.15.17:0/1207731999 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5090089370 con 0x7f50a00b5b50 2024-03-12T17:19:51.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.336+0000 7f5097400640 1 --2- 172.21.15.17:0/1207731999 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f507c06ac00 0x7f507c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:51.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.337+0000 7f5097400640 1 --2- 172.21.15.17:0/1207731999 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f507c06ac00 0x7f507c06d0c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5088036000 tx=0x7f5088030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:51.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.342+0000 7f509cc00640 1 -- 172.21.15.17:0/1207731999 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f50900548a0 con 0x7f50a00b5b50 2024-03-12T17:19:51.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.606+0000 7f50a6c00640 1 -- 172.21.15.17:0/1207731999 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f50a00736c0 con 0x7f50a00b5b50 2024-03-12T17:19:51.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.613+0000 7f509cc00640 1 -- 172.21.15.17:0/1207731999 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5090057ec0 con 0x7f50a00b5b50 2024-03-12T17:19:51.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.616+0000 7f50a6c00640 1 -- 172.21.15.17:0/1207731999 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f507c06ac00 msgr2=0x7f507c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:51.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.616+0000 7f50a6c00640 1 --2- 172.21.15.17:0/1207731999 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f507c06ac00 0x7f507c06d0c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5088036000 tx=0x7f5088030000 comp rx=0 tx=0).stop 2024-03-12T17:19:51.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.616+0000 7f50a6c00640 1 -- 172.21.15.17:0/1207731999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50a00b5b50 msgr2=0x7f50a0150dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:51.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.616+0000 7f50a6c00640 1 --2- 172.21.15.17:0/1207731999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50a00b5b50 0x7f50a0150dc0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f509000c7f0 tx=0x7f509000ccb0 comp rx=0 tx=0).stop 2024-03-12T17:19:51.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.616+0000 7f50a6c00640 1 -- 172.21.15.17:0/1207731999 shutdown_connections 2024-03-12T17:19:51.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.616+0000 7f50a6c00640 1 --2- 172.21.15.17:0/1207731999 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f507c06ac00 0x7f507c06d0c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:51.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.616+0000 7f50a6c00640 1 --2- 172.21.15.17:0/1207731999 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f50a00d2fa0 0x7f50a00c9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:51.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.616+0000 7f50a6c00640 1 --2- 172.21.15.17:0/1207731999 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f50a00cd840 0x7f50a015dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:51.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.616+0000 7f50a6c00640 1 --2- 172.21.15.17:0/1207731999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f50a00b5b50 0x7f50a0150dc0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:51.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.616+0000 7f50a6c00640 1 -- 172.21.15.17:0/1207731999 >> 172.21.15.17:0/1207731999 conn(0x7f50a0065df0 msgr2=0x7f50a00d08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:51.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.616+0000 7f50a6c00640 1 -- 172.21.15.17:0/1207731999 shutdown_connections 2024-03-12T17:19:51.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.617+0000 7f50a6c00640 1 -- 172.21.15.17:0/1207731999 wait complete. 2024-03-12T17:19:51.628 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T17:19:51.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.847+0000 7f99f0400640 1 Processor -- start 2024-03-12T17:19:51.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.848+0000 7f99f0400640 1 -- start start 2024-03-12T17:19:51.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.849+0000 7f99f0400640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f99e815ca10 0x7f99e80abd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:51.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.849+0000 7f99f0400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f99e815cdf0 0x7f99e80cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:51.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.849+0000 7f99f0400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99e80add50 0x7f99e80b2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:51.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.849+0000 7f99f0400640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e815dee0 con 0x7f99e815cdf0 2024-03-12T17:19:51.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.849+0000 7f99f0400640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e815d2d0 con 0x7f99e815ca10 2024-03-12T17:19:51.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.849+0000 7f99f0400640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e815d5b0 con 0x7f99e80add50 2024-03-12T17:19:51.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.850+0000 7f99ed000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f99e815cdf0 0x7f99e80cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:51.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.850+0000 7f99ed000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f99e815cdf0 0x7f99e80cee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39894/0 (socket says 172.21.15.17:39894) 2024-03-12T17:19:51.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.850+0000 7f99ed000640 1 -- 172.21.15.17:0/127085753 learned_addr learned my addr 172.21.15.17:0/127085753 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:51.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.850+0000 7f99ee400640 1 --2- 172.21.15.17:0/127085753 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99e80add50 0x7f99e80b2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:51.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.850+0000 7f99ed000640 1 -- 172.21.15.17:0/127085753 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99e80add50 msgr2=0x7f99e80b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:51.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.850+0000 7f99ed000640 1 --2- 172.21.15.17:0/127085753 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99e80add50 0x7f99e80b2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:51.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.850+0000 7f99ed000640 1 -- 172.21.15.17:0/127085753 >> v2:172.21.15.94:3300/0 conn(0x7f99e815ca10 msgr2=0x7f99e80abd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:51.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.850+0000 7f99ed000640 1 --2- 172.21.15.17:0/127085753 >> v2:172.21.15.94:3300/0 conn(0x7f99e815ca10 0x7f99e80abd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:51.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.850+0000 7f99ed000640 1 -- 172.21.15.17:0/127085753 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e815d890 con 0x7f99e815cdf0 2024-03-12T17:19:51.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.851+0000 7f99ed000640 1 --2- 172.21.15.17:0/127085753 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99e815cdf0 0x7f99e80cee40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f99e806e7f0 tx=0x7f99d402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=682123350e99ff60 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:51.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.852+0000 7f99e7e00640 1 -- 172.21.15.17:0/127085753 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d4031870 con 0x7f99e815cdf0 2024-03-12T17:19:51.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.852+0000 7f99e7e00640 1 -- 172.21.15.17:0/127085753 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d40319d0 con 0x7f99e815cdf0 2024-03-12T17:19:51.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.852+0000 7f99e7e00640 1 -- 172.21.15.17:0/127085753 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d4031d60 con 0x7f99e815cdf0 2024-03-12T17:19:51.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.852+0000 7f99f0400640 1 -- 172.21.15.17:0/127085753 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99e815cdf0 msgr2=0x7f99e80cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:51.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.852+0000 7f99f0400640 1 --2- 172.21.15.17:0/127085753 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99e815cdf0 0x7f99e80cee40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f99e806e7f0 tx=0x7f99d402b910 comp rx=0 tx=0).stop 2024-03-12T17:19:51.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.853+0000 7f99f0400640 1 -- 172.21.15.17:0/127085753 shutdown_connections 2024-03-12T17:19:51.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.853+0000 7f99f0400640 1 --2- 172.21.15.17:0/127085753 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99e80add50 0x7f99e80b2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:51.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.853+0000 7f99f0400640 1 --2- 172.21.15.17:0/127085753 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99e815cdf0 0x7f99e80cee40 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:51.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.853+0000 7f99f0400640 1 --2- 172.21.15.17:0/127085753 >> v2:172.21.15.94:3300/0 conn(0x7f99e815ca10 0x7f99e80abd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:51.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.853+0000 7f99f0400640 1 -- 172.21.15.17:0/127085753 >> 172.21.15.17:0/127085753 conn(0x7f99e8069ce0 msgr2=0x7f99e806a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:51.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.853+0000 7f99f0400640 1 -- 172.21.15.17:0/127085753 shutdown_connections 2024-03-12T17:19:51.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.853+0000 7f99f0400640 1 -- 172.21.15.17:0/127085753 wait complete. 2024-03-12T17:19:51.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.854+0000 7f99f0400640 1 Processor -- start 2024-03-12T17:19:51.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.854+0000 7f99f0400640 1 -- start start 2024-03-12T17:19:51.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.855+0000 7f99f0400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99e80add50 0x7f99e8150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:51.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.855+0000 7f99f0400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99e815ca10 0x7f99e8159d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:51.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.855+0000 7f99f0400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99e815cdf0 0x7f99e80a8740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:51.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.855+0000 7f99f0400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e80cbe90 con 0x7f99e815ca10 2024-03-12T17:19:51.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.855+0000 7f99f0400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e80cc170 con 0x7f99e80add50 2024-03-12T17:19:51.850 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.855+0000 7f99f0400640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e80cc450 con 0x7f99e815cdf0 2024-03-12T17:19:51.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.856+0000 7f99ed000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99e815ca10 0x7f99e8159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:51.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.856+0000 7f99ed000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99e815ca10 0x7f99e8159d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:39902/0 (socket says 172.21.15.17:39902) 2024-03-12T17:19:51.851 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.856+0000 7f99ed000640 1 -- 172.21.15.17:0/3883362279 learned_addr learned my addr 172.21.15.17:0/3883362279 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:51.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.856+0000 7f99ee400640 1 --2- 172.21.15.17:0/3883362279 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99e815cdf0 0x7f99e80a8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:51.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.856+0000 7f99eda00640 1 --2- 172.21.15.17:0/3883362279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99e80add50 0x7f99e8150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:51.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.856+0000 7f99ed000640 1 -- 172.21.15.17:0/3883362279 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99e815cdf0 msgr2=0x7f99e80a8740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:51.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.856+0000 7f99ed000640 1 --2- 172.21.15.17:0/3883362279 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99e815cdf0 0x7f99e80a8740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:51.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.856+0000 7f99ed000640 1 -- 172.21.15.17:0/3883362279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99e80add50 msgr2=0x7f99e8150150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:51.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.856+0000 7f99ed000640 1 --2- 172.21.15.17:0/3883362279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99e80add50 0x7f99e8150150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:51.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.856+0000 7f99ed000640 1 -- 172.21.15.17:0/3883362279 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d40094d0 con 0x7f99e815ca10 2024-03-12T17:19:51.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.857+0000 7f99ed000640 1 --2- 172.21.15.17:0/3883362279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99e815ca10 0x7f99e8159d50 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f99d4000c00 tx=0x7f99d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:51.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.857+0000 7f99e5600640 1 -- 172.21.15.17:0/3883362279 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d4031840 con 0x7f99e815ca10 2024-03-12T17:19:51.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.857+0000 7f99e5600640 1 -- 172.21.15.17:0/3883362279 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d40443f0 con 0x7f99e815ca10 2024-03-12T17:19:51.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.857+0000 7f99f0400640 1 -- 172.21.15.17:0/3883362279 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e80cc730 con 0x7f99e815ca10 2024-03-12T17:19:51.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.857+0000 7f99e5600640 1 -- 172.21.15.17:0/3883362279 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d40447a0 con 0x7f99e815ca10 2024-03-12T17:19:51.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.857+0000 7f99f0400640 1 -- 172.21.15.17:0/3883362279 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e8150690 con 0x7f99e815ca10 2024-03-12T17:19:51.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.859+0000 7f99f0400640 1 -- 172.21.15.17:0/3883362279 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e8066730 con 0x7f99e815ca10 2024-03-12T17:19:51.853 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.859+0000 7f99e5600640 1 -- 172.21.15.17:0/3883362279 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f99d404d450 con 0x7f99e815ca10 2024-03-12T17:19:51.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.860+0000 7f99e5600640 1 --2- 172.21.15.17:0/3883362279 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f99c806ac30 0x7f99c806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:51.854 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.860+0000 7f99e5600640 1 -- 172.21.15.17:0/3883362279 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f99d402d040 con 0x7f99e815ca10 2024-03-12T17:19:51.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.861+0000 7f99eda00640 1 --2- 172.21.15.17:0/3883362279 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f99c806ac30 0x7f99c806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:51.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.861+0000 7f99eda00640 1 --2- 172.21.15.17:0/3883362279 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f99c806ac30 0x7f99c806d0f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f99dc009890 tx=0x7f99dc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:51.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:51.865+0000 7f99e5600640 1 -- 172.21.15.17:0/3883362279 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f99d4076c90 con 0x7f99e815ca10 2024-03-12T17:19:52.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.063+0000 7f99f0400640 1 -- 172.21.15.17:0/3883362279 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99e80736c0 con 0x7f99e815ca10 2024-03-12T17:19:52.059 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.065+0000 7f99e5600640 1 -- 172.21.15.17:0/3883362279 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+12341 (secure 0 0 0) 0x7f99d4035090 con 0x7f99e815ca10 2024-03-12T17:19:52.059 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:19:52.059 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":31,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:19:47.890971+0000","last_up_change":"2024-03-12T17:18:38.144756+0000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-12T17:18:39.552910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":37305},{"type":"v1","addr":"172.21.15.17:6801","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":37305},{"type":"v1","addr":"172.21.15.17:6803","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":37305},{"type":"v1","addr":"172.21.15.17:6807","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":37305},{"type":"v1","addr":"172.21.15.17:6805","nonce":37305}]},"public_addr":"172.21.15.17:6801/37305","cluster_addr":"172.21.15.17:6803/37305","heartbeat_back_addr":"172.21.15.17:6807/37305","heartbeat_front_addr":"172.21.15.17:6805/37305","state":["exists","up"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":37307},{"type":"v1","addr":"172.21.15.17:6814","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":37307},{"type":"v1","addr":"172.21.15.17:6818","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":37307},{"type":"v1","addr":"172.21.15.17:6827","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":37307},{"type":"v1","addr":"172.21.15.17:6823","nonce":37307}]},"public_addr":"172.21.15.17:6814/37307","cluster_addr":"172.21.15.17:6818/37307","heartbeat_back_addr":"172.21.15.17:6827/37307","heartbeat_front_addr":"172.21.15.17:6823/37307","state":["exists","up"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":37303},{"type":"v1","addr":"172.21.15.17:6809","nonce":37303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":37303},{"type":"v1","addr":"172.21.15.17:6811","nonce":37303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":37303},{"type":"v1","addr":"172.21.15.17:6819","nonce":37303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":37303},{"type":"v1","addr":"172.21.15.17:6815","nonce":37303}]},"public_addr":"172.21.15.17:6809/37303","cluster_addr":"172.21.15.17:6811/37303","heartbeat_back_addr":"172.21.15.17:6819/37303","heartbeat_front_addr":"172.21.15.17:6815/37303","state":["exists","up"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":37308},{"type":"v1","addr":"172.21.15.17:6822","nonce":37308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":37308},{"type":"v1","addr":"172.21.15.17:6826","nonce":37308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":37308},{"type":"v1","addr":"172.21.15.17:6831","nonce":37308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":37308},{"type":"v1","addr":"172.21.15.17:6829","nonce":37308}]},"public_addr":"172.21.15.17:6822/37308","cluster_addr":"172.21.15.17:6826/37308","heartbeat_back_addr":"172.21.15.17:6831/37308","heartbeat_front_addr":"172.21.15.17:6829/37308","state":["exists","up"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":37465},{"type":"v1","addr":"172.21.15.94:6809","nonce":37465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6811","nonce":37465},{"type":"v1","addr":"172.21.15.94:6813","nonce":37465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6819","nonce":37465},{"type":"v1","addr":"172.21.15.94:6822","nonce":37465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6815","nonce":37465},{"type":"v1","addr":"172.21.15.94:6817","nonce":37465}]},"public_addr":"172.21.15.94:6809/37465","cluster_addr":"172.21.15.94:6813/37465","heartbeat_back_addr":"172.21.15.94:6822/37465","heartbeat_front_addr":"172.21.15.94:6817/37465","state":["exists","up"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":37464},{"type":"v1","addr":"172.21.15.94:6812","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":37464},{"type":"v1","addr":"172.21.15.94:6816","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":37464},{"type":"v1","addr":"172.21.15.94:6823","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":37464},{"type":"v1","addr":"172.21.15.94:6820","nonce":37464}]},"public_addr":"172.21.15.94:6812/37464","cluster_addr":"172.21.15.94:6816/37464","heartbeat_back_addr":"172.21.15.94:6823/37464","heartbeat_front_addr":"172.21.15.94:6820/37464","state":["exists","up"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":37467},{"type":"v1","addr":"172.21.15.94:6825","nonce":37467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":37467},{"type":"v1","addr":"172.21.15.94:6827","nonce":37467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":37467},{"type":"v1","addr":"172.21.15.94:6831","nonce":37467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":37467},{"type":"v1","addr":"172.21.15.94:6829","nonce":37467}]},"public_addr":"172.21.15.94:6825/37467","cluster_addr":"172.21.15.94:6827/37467","heartbeat_back_addr":"172.21.15.94:6831/37467","heartbeat_front_addr":"172.21.15.94:6829/37467","state":["exists","up"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":37466},{"type":"v1","addr":"172.21.15.94:6801","nonce":37466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":37466},{"type":"v1","addr":"172.21.15.94:6803","nonce":37466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":37466},{"type":"v1","addr":"172.21.15.94:6807","nonce":37466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":37466},{"type":"v1","addr":"172.21.15.94:6805","nonce":37466}]},"public_addr":"172.21.15.94:6801/37466","cluster_addr":"172.21.15.94:6803/37466","heartbeat_back_addr":"172.21.15.94:6807/37466","heartbeat_front_addr":"172.21.15.94:6805/37466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.327217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.186966+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.419986+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.150585+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.120621+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.121576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.181257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.293188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:19:52.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.067+0000 7f99f0400640 1 -- 172.21.15.17:0/3883362279 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f99c806ac30 msgr2=0x7f99c806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:52.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.068+0000 7f99f0400640 1 --2- 172.21.15.17:0/3883362279 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f99c806ac30 0x7f99c806d0f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f99dc009890 tx=0x7f99dc008040 comp rx=0 tx=0).stop 2024-03-12T17:19:52.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.068+0000 7f99f0400640 1 -- 172.21.15.17:0/3883362279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99e815ca10 msgr2=0x7f99e8159d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:52.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.068+0000 7f99f0400640 1 --2- 172.21.15.17:0/3883362279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99e815ca10 0x7f99e8159d50 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f99d4000c00 tx=0x7f99d40046c0 comp rx=0 tx=0).stop 2024-03-12T17:19:52.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.068+0000 7f99f0400640 1 -- 172.21.15.17:0/3883362279 shutdown_connections 2024-03-12T17:19:52.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.068+0000 7f99f0400640 1 --2- 172.21.15.17:0/3883362279 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f99c806ac30 0x7f99c806d0f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:52.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.068+0000 7f99f0400640 1 --2- 172.21.15.17:0/3883362279 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f99e815cdf0 0x7f99e80a8740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:52.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.068+0000 7f99f0400640 1 --2- 172.21.15.17:0/3883362279 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f99e815ca10 0x7f99e8159d50 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:52.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.068+0000 7f99f0400640 1 --2- 172.21.15.17:0/3883362279 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f99e80add50 0x7f99e8150150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:52.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.068+0000 7f99f0400640 1 -- 172.21.15.17:0/3883362279 >> 172.21.15.17:0/3883362279 conn(0x7f99e8069ce0 msgr2=0x7f99e8157390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:52.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.068+0000 7f99f0400640 1 -- 172.21.15.17:0/3883362279 shutdown_connections 2024-03-12T17:19:52.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.068+0000 7f99f0400640 1 -- 172.21.15.17:0/3883362279 wait complete. 2024-03-12T17:19:52.083 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-12T17:18:39.552910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-12T17:19:52.083 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-12T17:19:52.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.316+0000 7f3d64000640 1 Processor -- start 2024-03-12T17:19:52.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.316+0000 7f3d64000640 1 -- start start 2024-03-12T17:19:52.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.317+0000 7f3d64000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d5c0d2fa0 0x7f3d5c0d3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:52.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.317+0000 7f3d64000640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f3d5c0b5b50 0x7f3d5c0b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:52.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.317+0000 7f3d64000640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d5c0d14e0 con 0x7f3d5c0cd840 2024-03-12T17:19:52.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.317+0000 7f3d64000640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d5c0b59e0 con 0x7f3d5c0b5b50 2024-03-12T17:19:52.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.317+0000 7f3d64000640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c0d38c0 con 0x7f3d5c0d2fa0 2024-03-12T17:19:52.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.317+0000 7f3d62000640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f3d5c0cd840 0x7f3d5c0d1f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:50860/0 (socket says 172.21.15.17:50860) 2024-03-12T17:19:52.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.317+0000 7f3d62000640 1 -- 172.21.15.17:0/3785807007 learned_addr learned my addr 172.21.15.17:0/3785807007 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:52.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.318+0000 7f3d60c00640 1 --2- 172.21.15.17:0/3785807007 >> v2:172.21.15.94:3300/0 conn(0x7f3d5c0b5b50 0x7f3d5c0b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:52.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.318+0000 7f3d5be00640 1 -- 172.21.15.17:0/3785807007 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 913795765 0 0) 0x7f3d5c0d14e0 con 0x7f3d5c0cd840 2024-03-12T17:19:52.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.318+0000 7f3d5be00640 1 -- 172.21.15.17:0/3785807007 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d40003520 con 0x7f3d5c0cd840 2024-03-12T17:19:52.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.318+0000 7f3d5be00640 1 -- 172.21.15.17:0/3785807007 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 793109995 0 0) 0x7f3d40003520 con 0x7f3d5c0cd840 2024-03-12T17:19:52.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.318+0000 7f3d5be00640 1 -- 172.21.15.17:0/3785807007 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d5c0d2fa0 msgr2=0x7f3d5c0d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:52.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.318+0000 7f3d5be00640 1 --2- 172.21.15.17:0/3785807007 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d5c0d2fa0 0x7f3d5c0d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:52.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.318+0000 7f3d5be00640 1 -- 172.21.15.17:0/3785807007 >> v2:172.21.15.94:3300/0 conn(0x7f3d5c0b5b50 msgr2=0x7f3d5c0b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:52.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.318+0000 7f3d5be00640 1 --2- 172.21.15.17:0/3785807007 >> v2:172.21.15.94:3300/0 conn(0x7f3d5c0b5b50 0x7f3d5c0b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:52.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.318+0000 7f3d5be00640 1 -- 172.21.15.17:0/3785807007 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5c0b85b0 con 0x7f3d5c0cd840 2024-03-12T17:19:52.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.318+0000 7f3d5be00640 1 -- 172.21.15.17:0/3785807007 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7f3d540019f0 con 0x7f3d5c0cd840 2024-03-12T17:19:52.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.318+0000 7f3d60c00640 1 --2- 172.21.15.17:0/3785807007 >> v2:172.21.15.94:3300/0 conn(0x7f3d5c0b5b50 0x7f3d5c0b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:19:52.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.318+0000 7f3d5be00640 1 -- 172.21.15.17:0/3785807007 >> v1:172.21.15.17:6789/0 conn(0x7f3d5c0cd840 legacy=0x7f3d5c0d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:52.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.318+0000 7f3d5be00640 1 --2- 172.21.15.17:0/3785807007 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d5c0d2fa0 0x7f3d40003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:52.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.318+0000 7f3d5be00640 1 --2- 172.21.15.17:0/3785807007 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3d40003fa0 0x7f3d400047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:52.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.318+0000 7f3d5be00640 1 --2- 172.21.15.17:0/3785807007 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d40004d00 0x7f3d40005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:52.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.319+0000 7f3d5be00640 1 -- 172.21.15.17:0/3785807007 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c0d38c0 con 0x7f3d40004d00 2024-03-12T17:19:52.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.319+0000 7f3d5be00640 1 -- 172.21.15.17:0/3785807007 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4000bb10 con 0x7f3d40003fa0 2024-03-12T17:19:52.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.319+0000 7f3d5be00640 1 -- 172.21.15.17:0/3785807007 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4000bcd0 con 0x7f3d5c0d2fa0 2024-03-12T17:19:52.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.319+0000 7f3d62000640 1 --2- 172.21.15.17:0/3785807007 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d40004d00 0x7f3d40005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:52.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.319+0000 7f3d61600640 1 --2- 172.21.15.17:0/3785807007 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d5c0d2fa0 0x7f3d40003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:52.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.319+0000 7f3d60c00640 1 --2- 172.21.15.17:0/3785807007 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3d40003fa0 0x7f3d400047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:52.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.319+0000 7f3d62000640 1 -- 172.21.15.17:0/3785807007 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d5c0d2fa0 msgr2=0x7f3d40003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:52.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.319+0000 7f3d62000640 1 --2- 172.21.15.17:0/3785807007 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d5c0d2fa0 0x7f3d40003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:52.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.319+0000 7f3d62000640 1 -- 172.21.15.17:0/3785807007 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3d40003fa0 msgr2=0x7f3d400047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:52.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.319+0000 7f3d62000640 1 --2- 172.21.15.17:0/3785807007 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3d40003fa0 0x7f3d400047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:52.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.319+0000 7f3d62000640 1 -- 172.21.15.17:0/3785807007 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d40003520 con 0x7f3d40004d00 2024-03-12T17:19:52.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.321+0000 7f3d62000640 1 --2- 172.21.15.17:0/3785807007 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d40004d00 0x7f3d40005180 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3d5400a860 tx=0x7f3d400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62955bf1ed3ad5ac server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:52.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.321+0000 7f3d5be00640 1 -- 172.21.15.17:0/3785807007 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d54034630 con 0x7f3d40004d00 2024-03-12T17:19:52.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.321+0000 7f3d5be00640 1 -- 172.21.15.17:0/3785807007 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d5402f070 con 0x7f3d40004d00 2024-03-12T17:19:52.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.321+0000 7f3d5be00640 1 -- 172.21.15.17:0/3785807007 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d540349f0 con 0x7f3d40004d00 2024-03-12T17:19:52.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.321+0000 7f3d64000640 1 -- 172.21.15.17:0/3785807007 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d40004d00 msgr2=0x7f3d40005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:52.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.321+0000 7f3d64000640 1 --2- 172.21.15.17:0/3785807007 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d40004d00 0x7f3d40005180 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3d5400a860 tx=0x7f3d400057f0 comp rx=0 tx=0).stop 2024-03-12T17:19:52.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.321+0000 7f3d62000640 1 -- 172.21.15.17:0/3785807007 reap_dead start 2024-03-12T17:19:52.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.321+0000 7f3d64000640 1 -- 172.21.15.17:0/3785807007 shutdown_connections 2024-03-12T17:19:52.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.321+0000 7f3d64000640 1 -- 172.21.15.17:0/3785807007 >> 172.21.15.17:0/3785807007 conn(0x7f3d5c065df0 msgr2=0x7f3d5c066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:52.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.322+0000 7f3d64000640 1 -- 172.21.15.17:0/3785807007 shutdown_connections 2024-03-12T17:19:52.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.322+0000 7f3d64000640 1 -- 172.21.15.17:0/3785807007 wait complete. 2024-03-12T17:19:52.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.323+0000 7f3d64000640 1 Processor -- start 2024-03-12T17:19:52.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.323+0000 7f3d64000640 1 -- start start 2024-03-12T17:19:52.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.324+0000 7f3d64000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d40004d00 0x7f3d5c154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:52.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.324+0000 7f3d64000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d5c15eb20 0x7f3d5c15efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:52.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.324+0000 7f3d64000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3d5c0d08c0 0x7f3d5c0d0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:52.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.324+0000 7f3d64000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c0d1280 con 0x7f3d5c15eb20 2024-03-12T17:19:52.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.324+0000 7f3d64000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c0c9190 con 0x7f3d5c0d08c0 2024-03-12T17:19:52.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.324+0000 7f3d64000640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c154ad0 con 0x7f3d40004d00 2024-03-12T17:19:52.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.325+0000 7f3d60c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d5c15eb20 0x7f3d5c15efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:52.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.325+0000 7f3d60c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d5c15eb20 0x7f3d5c15efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50490/0 (socket says 172.21.15.17:50490) 2024-03-12T17:19:52.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.325+0000 7f3d60c00640 1 -- 172.21.15.17:0/2631065931 learned_addr learned my addr 172.21.15.17:0/2631065931 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:52.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.325+0000 7f3d61600640 1 --2- 172.21.15.17:0/2631065931 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d40004d00 0x7f3d5c154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:52.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.325+0000 7f3d62000640 1 --2- 172.21.15.17:0/2631065931 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3d5c0d08c0 0x7f3d5c0d0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:52.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.325+0000 7f3d60c00640 1 -- 172.21.15.17:0/2631065931 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d40004d00 msgr2=0x7f3d5c154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:52.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.325+0000 7f3d60c00640 1 --2- 172.21.15.17:0/2631065931 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d40004d00 0x7f3d5c154590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:52.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.325+0000 7f3d60c00640 1 -- 172.21.15.17:0/2631065931 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3d5c0d08c0 msgr2=0x7f3d5c0d0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:52.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.325+0000 7f3d60c00640 1 --2- 172.21.15.17:0/2631065931 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3d5c0d08c0 0x7f3d5c0d0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:52.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.325+0000 7f3d60c00640 1 -- 172.21.15.17:0/2631065931 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5c0c8580 con 0x7f3d5c15eb20 2024-03-12T17:19:52.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.326+0000 7f3d60c00640 1 --2- 172.21.15.17:0/2631065931 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d5c15eb20 0x7f3d5c15efa0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3d4800f5a0 tx=0x7f3d4800fa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:52.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.326+0000 7f3d59600640 1 -- 172.21.15.17:0/2631065931 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d48014890 con 0x7f3d5c15eb20 2024-03-12T17:19:52.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.326+0000 7f3d59600640 1 -- 172.21.15.17:0/2631065931 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d4800c030 con 0x7f3d5c15eb20 2024-03-12T17:19:52.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.326+0000 7f3d59600640 1 -- 172.21.15.17:0/2631065931 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d48014c30 con 0x7f3d5c15eb20 2024-03-12T17:19:52.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.326+0000 7f3d64000640 1 -- 172.21.15.17:0/2631065931 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d5c0c8860 con 0x7f3d5c15eb20 2024-03-12T17:19:52.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.326+0000 7f3d64000640 1 -- 172.21.15.17:0/2631065931 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d5c0c8e20 con 0x7f3d5c15eb20 2024-03-12T17:19:52.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.327+0000 7f3d64000640 1 -- 172.21.15.17:0/2631065931 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d5c0736c0 con 0x7f3d5c15eb20 2024-03-12T17:19:52.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.328+0000 7f3d59600640 1 -- 172.21.15.17:0/2631065931 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f3d480133e0 con 0x7f3d5c15eb20 2024-03-12T17:19:52.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.330+0000 7f3d59600640 1 --2- 172.21.15.17:0/2631065931 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f3d3c06ac00 0x7f3d3c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:52.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.330+0000 7f3d59600640 1 -- 172.21.15.17:0/2631065931 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3d480894d0 con 0x7f3d5c15eb20 2024-03-12T17:19:52.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.330+0000 7f3d61600640 1 --2- 172.21.15.17:0/2631065931 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f3d3c06ac00 0x7f3d3c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:52.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.331+0000 7f3d61600640 1 --2- 172.21.15.17:0/2631065931 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f3d3c06ac00 0x7f3d3c06d0c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c004700 tx=0x7f3d4c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:52.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.334+0000 7f3d59600640 1 -- 172.21.15.17:0/2631065931 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f3d480549e0 con 0x7f3d5c15eb20 2024-03-12T17:19:52.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.532+0000 7f3d64000640 1 -- 172.21.15.17:0/2631065931 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3d5c0c8fb0 con 0x7f3d5c15eb20 2024-03-12T17:19:52.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.533+0000 7f3d59600640 1 -- 172.21.15.17:0/2631065931 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3d48058000 con 0x7f3d5c15eb20 2024-03-12T17:19:52.527 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-03-12T17:19:52.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.535+0000 7f3d64000640 1 -- 172.21.15.17:0/2631065931 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f3d3c06ac00 msgr2=0x7f3d3c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:52.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.535+0000 7f3d64000640 1 --2- 172.21.15.17:0/2631065931 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f3d3c06ac00 0x7f3d3c06d0c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c004700 tx=0x7f3d4c008040 comp rx=0 tx=0).stop 2024-03-12T17:19:52.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.535+0000 7f3d64000640 1 -- 172.21.15.17:0/2631065931 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d5c15eb20 msgr2=0x7f3d5c15efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:52.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.535+0000 7f3d64000640 1 --2- 172.21.15.17:0/2631065931 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d5c15eb20 0x7f3d5c15efa0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3d4800f5a0 tx=0x7f3d4800fa60 comp rx=0 tx=0).stop 2024-03-12T17:19:52.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.535+0000 7f3d64000640 1 -- 172.21.15.17:0/2631065931 shutdown_connections 2024-03-12T17:19:52.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.535+0000 7f3d64000640 1 --2- 172.21.15.17:0/2631065931 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f3d3c06ac00 0x7f3d3c06d0c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:52.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.535+0000 7f3d64000640 1 --2- 172.21.15.17:0/2631065931 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3d5c0d08c0 0x7f3d5c0d0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:52.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.535+0000 7f3d64000640 1 --2- 172.21.15.17:0/2631065931 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3d5c15eb20 0x7f3d5c15efa0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:52.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.535+0000 7f3d64000640 1 --2- 172.21.15.17:0/2631065931 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3d40004d00 0x7f3d5c154590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:52.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.535+0000 7f3d64000640 1 -- 172.21.15.17:0/2631065931 >> 172.21.15.17:0/2631065931 conn(0x7f3d5c065df0 msgr2=0x7f3d5c15c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:52.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.536+0000 7f3d64000640 1 -- 172.21.15.17:0/2631065931 shutdown_connections 2024-03-12T17:19:52.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.536+0000 7f3d64000640 1 -- 172.21.15.17:0/2631065931 wait complete. 2024-03-12T17:19:52.550 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-12T17:19:52.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.779+0000 7f037fe00640 1 Processor -- start 2024-03-12T17:19:52.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.780+0000 7f037fe00640 1 -- start start 2024-03-12T17:19:52.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.781+0000 7f037fe00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f03800b8190 0x7f03800b4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:52.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.781+0000 7f037fe00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f03800b85d0 0x7f03800b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:52.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.781+0000 7f037fe00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03800d15b0 con 0x7f0380160150 2024-03-12T17:19:52.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.781+0000 7f037fe00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0380160530 con 0x7f03800b85d0 2024-03-12T17:19:52.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.781+0000 7f037fe00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03800d2710 con 0x7f03800b8190 2024-03-12T17:19:52.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.781+0000 7f037ea00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f0380160150 0x7f03800d2000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:50874/0 (socket says 172.21.15.17:50874) 2024-03-12T17:19:52.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.782+0000 7f037ea00640 1 -- 172.21.15.17:0/3957672604 learned_addr learned my addr 172.21.15.17:0/3957672604 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:52.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.782+0000 7f037e000640 1 --2- 172.21.15.17:0/3957672604 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f03800b8190 0x7f03800b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:52.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.782+0000 7f037f400640 1 --2- 172.21.15.17:0/3957672604 >> v2:172.21.15.94:3300/0 conn(0x7f03800b85d0 0x7f03800b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:52.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.782+0000 7f037d600640 1 -- 172.21.15.17:0/3957672604 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2958792096 0 0) 0x7f03800d15b0 con 0x7f0380160150 2024-03-12T17:19:52.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.782+0000 7f037d600640 1 -- 172.21.15.17:0/3957672604 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0364003520 con 0x7f0380160150 2024-03-12T17:19:52.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.783+0000 7f037d600640 1 -- 172.21.15.17:0/3957672604 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1060271633 0 0) 0x7f0364003520 con 0x7f0380160150 2024-03-12T17:19:52.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.783+0000 7f037d600640 1 -- 172.21.15.17:0/3957672604 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f03800b8190 msgr2=0x7f03800b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:52.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.783+0000 7f037d600640 1 --2- 172.21.15.17:0/3957672604 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f03800b8190 0x7f03800b4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:52.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.783+0000 7f037d600640 1 -- 172.21.15.17:0/3957672604 >> v2:172.21.15.94:3300/0 conn(0x7f03800b85d0 msgr2=0x7f03800b4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:52.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.783+0000 7f037d600640 1 --2- 172.21.15.17:0/3957672604 >> v2:172.21.15.94:3300/0 conn(0x7f03800b85d0 0x7f03800b4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:52.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.783+0000 7f037d600640 1 -- 172.21.15.17:0/3957672604 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03800cdac0 con 0x7f0380160150 2024-03-12T17:19:52.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.783+0000 7f037d600640 1 -- 172.21.15.17:0/3957672604 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7f0370001670 con 0x7f0380160150 2024-03-12T17:19:52.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.783+0000 7f037d600640 1 -- 172.21.15.17:0/3957672604 >> v1:172.21.15.17:6789/0 conn(0x7f0380160150 legacy=0x7f03800d2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:52.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.783+0000 7f037d600640 1 --2- 172.21.15.17:0/3957672604 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0364003970 0x7f0364003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:52.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.783+0000 7f037d600640 1 --2- 172.21.15.17:0/3957672604 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f03640047c0 0x7f0364004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:52.779 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.783+0000 7f037d600640 1 --2- 172.21.15.17:0/3957672604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0364005180 0x7f036400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:52.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.783+0000 7f037d600640 1 -- 172.21.15.17:0/3957672604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0380160530 con 0x7f0364005180 2024-03-12T17:19:52.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.783+0000 7f037d600640 1 -- 172.21.15.17:0/3957672604 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03800d2710 con 0x7f0364003970 2024-03-12T17:19:52.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.783+0000 7f037d600640 1 -- 172.21.15.17:0/3957672604 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f036400bec0 con 0x7f03640047c0 2024-03-12T17:19:52.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.783+0000 7f037e000640 1 --2- 172.21.15.17:0/3957672604 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f03800b8190 0x7f03800b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-12T17:19:52.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.783+0000 7f037f400640 1 --2- 172.21.15.17:0/3957672604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0364005180 0x7f036400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:52.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.784+0000 7f037e000640 1 --2- 172.21.15.17:0/3957672604 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f03640047c0 0x7f0364004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:52.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.784+0000 7f037ea00640 1 --2- 172.21.15.17:0/3957672604 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0364003970 0x7f0364003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:52.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.784+0000 7f037f400640 1 -- 172.21.15.17:0/3957672604 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f03640047c0 msgr2=0x7f0364004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:52.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.784+0000 7f037f400640 1 --2- 172.21.15.17:0/3957672604 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f03640047c0 0x7f0364004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:52.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.784+0000 7f037f400640 1 -- 172.21.15.17:0/3957672604 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0364003970 msgr2=0x7f0364003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:52.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.784+0000 7f037f400640 1 --2- 172.21.15.17:0/3957672604 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0364003970 0x7f0364003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:52.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.784+0000 7f037f400640 1 -- 172.21.15.17:0/3957672604 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0364003520 con 0x7f0364005180 2024-03-12T17:19:52.780 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.784+0000 7f037e000640 1 --2- 172.21.15.17:0/3957672604 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f03640047c0 0x7f0364004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:52.781 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.785+0000 7f037f400640 1 --2- 172.21.15.17:0/3957672604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0364005180 0x7f036400b980 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f037800e170 tx=0x7f03640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a6754c80241368c server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:52.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.785+0000 7f037d600640 1 -- 172.21.15.17:0/3957672604 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037802cc20 con 0x7f0364005180 2024-03-12T17:19:52.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.785+0000 7f037d600640 1 -- 172.21.15.17:0/3957672604 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037800f040 con 0x7f0364005180 2024-03-12T17:19:52.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.785+0000 7f037d600640 1 -- 172.21.15.17:0/3957672604 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0378034440 con 0x7f0364005180 2024-03-12T17:19:52.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.786+0000 7f037fe00640 1 -- 172.21.15.17:0/3957672604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0364005180 msgr2=0x7f036400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:52.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.786+0000 7f037fe00640 1 --2- 172.21.15.17:0/3957672604 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0364005180 0x7f036400b980 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f037800e170 tx=0x7f03640057f0 comp rx=0 tx=0).stop 2024-03-12T17:19:52.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.786+0000 7f037f400640 1 -- 172.21.15.17:0/3957672604 reap_dead start 2024-03-12T17:19:52.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.786+0000 7f037fe00640 1 -- 172.21.15.17:0/3957672604 shutdown_connections 2024-03-12T17:19:52.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.786+0000 7f037fe00640 1 -- 172.21.15.17:0/3957672604 >> 172.21.15.17:0/3957672604 conn(0x7f03800cf7d0 msgr2=0x7f03800cfbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:52.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.786+0000 7f037fe00640 1 -- 172.21.15.17:0/3957672604 shutdown_connections 2024-03-12T17:19:52.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.786+0000 7f037fe00640 1 -- 172.21.15.17:0/3957672604 wait complete. 2024-03-12T17:19:52.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.788+0000 7f037fe00640 1 Processor -- start 2024-03-12T17:19:52.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.788+0000 7f037fe00640 1 -- start start 2024-03-12T17:19:52.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.789+0000 7f037fe00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0364005180 0x7f03800a9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:52.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.789+0000 7f037fe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f03800c9040 0x7f03800c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:52.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.789+0000 7f037fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03801f5590 0x7f03801f5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:52.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.789+0000 7f037fe00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03801f5f50 con 0x7f03801f5590 2024-03-12T17:19:52.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.789+0000 7f037fe00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03800cb600 con 0x7f03800c9040 2024-03-12T17:19:52.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.789+0000 7f037fe00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03800ca9f0 con 0x7f0364005180 2024-03-12T17:19:52.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.790+0000 7f037f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03801f5590 0x7f03801f5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:52.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.790+0000 7f037f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03801f5590 0x7f03801f5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50510/0 (socket says 172.21.15.17:50510) 2024-03-12T17:19:52.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.790+0000 7f037f400640 1 -- 172.21.15.17:0/2143598849 learned_addr learned my addr 172.21.15.17:0/2143598849 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:52.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.790+0000 7f037e000640 1 --2- 172.21.15.17:0/2143598849 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f03800c9040 0x7f03800c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:52.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.790+0000 7f037ea00640 1 --2- 172.21.15.17:0/2143598849 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0364005180 0x7f03800a9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:52.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.790+0000 7f037f400640 1 -- 172.21.15.17:0/2143598849 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0364005180 msgr2=0x7f03800a9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:52.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.790+0000 7f037f400640 1 --2- 172.21.15.17:0/2143598849 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0364005180 0x7f03800a9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:52.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.790+0000 7f037f400640 1 -- 172.21.15.17:0/2143598849 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f03800c9040 msgr2=0x7f03800c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:52.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.790+0000 7f037f400640 1 --2- 172.21.15.17:0/2143598849 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f03800c9040 0x7f03800c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:52.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.790+0000 7f037f400640 1 -- 172.21.15.17:0/2143598849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03800cacd0 con 0x7f03801f5590 2024-03-12T17:19:52.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.790+0000 7f037f400640 1 --2- 172.21.15.17:0/2143598849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03801f5590 0x7f03801f5a10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f037800e170 tx=0x7f0378009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:52.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.791+0000 7f0376a00640 1 -- 172.21.15.17:0/2143598849 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0378034d50 con 0x7f03801f5590 2024-03-12T17:19:52.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.791+0000 7f0376a00640 1 -- 172.21.15.17:0/2143598849 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037802ce80 con 0x7f03801f5590 2024-03-12T17:19:52.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.791+0000 7f0376a00640 1 -- 172.21.15.17:0/2143598849 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0378003bd0 con 0x7f03801f5590 2024-03-12T17:19:52.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.791+0000 7f037fe00640 1 -- 172.21.15.17:0/2143598849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03800cafb0 con 0x7f03801f5590 2024-03-12T17:19:52.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.791+0000 7f037fe00640 1 -- 172.21.15.17:0/2143598849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03800a9870 con 0x7f03801f5590 2024-03-12T17:19:52.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.792+0000 7f037fe00640 1 -- 172.21.15.17:0/2143598849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03800cb7b0 con 0x7f03801f5590 2024-03-12T17:19:52.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.793+0000 7f0376a00640 1 -- 172.21.15.17:0/2143598849 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f0378003d30 con 0x7f03801f5590 2024-03-12T17:19:52.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.794+0000 7f0376a00640 1 --2- 172.21.15.17:0/2143598849 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f036006ac30 0x7f036006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:52.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.795+0000 7f0376a00640 1 -- 172.21.15.17:0/2143598849 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f03780aa510 con 0x7f03801f5590 2024-03-12T17:19:52.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.795+0000 7f037ea00640 1 --2- 172.21.15.17:0/2143598849 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f036006ac30 0x7f036006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:52.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.795+0000 7f037ea00640 1 --2- 172.21.15.17:0/2143598849 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f036006ac30 0x7f036006d0f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0370001eb0 tx=0x7f0370009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:52.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:52.799+0000 7f0376a00640 1 -- 172.21.15.17:0/2143598849 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f03800cb7b0 con 0x7f03801f5590 2024-03-12T17:19:52.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.002+0000 7f037fe00640 1 -- 172.21.15.17:0/2143598849 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f03800cb770 con 0x7f03801f5590 2024-03-12T17:19:52.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.003+0000 7f0376a00640 1 -- 172.21.15.17:0/2143598849 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0378075a50 con 0x7f03801f5590 2024-03-12T17:19:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:19:52.998 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2024-03-12T17:19:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:19:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2024-03-12T17:19:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2024-03-12T17:19:52.998 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:19:52.998 INFO:teuthology.orchestra.run.smithi017.stdout:] 2024-03-12T17:19:53.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.006+0000 7f037fe00640 1 -- 172.21.15.17:0/2143598849 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f036006ac30 msgr2=0x7f036006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:53.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.006+0000 7f037fe00640 1 --2- 172.21.15.17:0/2143598849 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f036006ac30 0x7f036006d0f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f0370001eb0 tx=0x7f0370009040 comp rx=0 tx=0).stop 2024-03-12T17:19:53.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.006+0000 7f037fe00640 1 -- 172.21.15.17:0/2143598849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03801f5590 msgr2=0x7f03801f5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:53.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.006+0000 7f037fe00640 1 --2- 172.21.15.17:0/2143598849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03801f5590 0x7f03801f5a10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f037800e170 tx=0x7f0378009750 comp rx=0 tx=0).stop 2024-03-12T17:19:53.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.006+0000 7f037fe00640 1 -- 172.21.15.17:0/2143598849 shutdown_connections 2024-03-12T17:19:53.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.006+0000 7f037fe00640 1 --2- 172.21.15.17:0/2143598849 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f036006ac30 0x7f036006d0f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:53.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.006+0000 7f037fe00640 1 --2- 172.21.15.17:0/2143598849 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f03801f5590 0x7f03801f5a10 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:53.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.007+0000 7f037fe00640 1 --2- 172.21.15.17:0/2143598849 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f03800c9040 0x7f03800c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:53.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.007+0000 7f037fe00640 1 --2- 172.21.15.17:0/2143598849 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0364005180 0x7f03800a9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:53.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.007+0000 7f037fe00640 1 -- 172.21.15.17:0/2143598849 >> 172.21.15.17:0/2143598849 conn(0x7f03800cf7d0 msgr2=0x7f038015d580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:53.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.007+0000 7f037fe00640 1 -- 172.21.15.17:0/2143598849 shutdown_connections 2024-03-12T17:19:53.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.007+0000 7f037fe00640 1 -- 172.21.15.17:0/2143598849 wait complete. 2024-03-12T17:19:53.019 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-12T17:19:53.019 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-12T17:19:53.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.249+0000 7fe9d7e00640 1 Processor -- start 2024-03-12T17:19:53.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.249+0000 7fe9d7e00640 1 -- start start 2024-03-12T17:19:53.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.250+0000 7fe9d7e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fe9d815c9b0 0x7fe9d80cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:53.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.250+0000 7fe9d7e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe9d815cd90 0x7fe9d80cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:53.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.251+0000 7fe9d7e00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9d80b8520 con 0x7fe9d8160730 2024-03-12T17:19:53.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.251+0000 7fe9d7e00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9d81615f0 con 0x7fe9d815cd90 2024-03-12T17:19:53.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.251+0000 7fe9d7e00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9d8161310 con 0x7fe9d815c9b0 2024-03-12T17:19:53.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.251+0000 7fe9d6000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe9d815cd90 0x7fe9d80cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:53.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.251+0000 7fe9d6000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe9d815cd90 0x7fe9d80cf810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50516/0 (socket says 172.21.15.17:50516) 2024-03-12T17:19:53.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.251+0000 7fe9d6000640 1 -- 172.21.15.17:0/1387374979 learned_addr learned my addr 172.21.15.17:0/1387374979 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:53.246 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.251+0000 7fe9d6a00640 1 --2- 172.21.15.17:0/1387374979 >> v2:172.21.15.94:3300/0 conn(0x7fe9d815c9b0 0x7fe9d80cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:53.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.251+0000 7fe9d6000640 1 -- 172.21.15.17:0/1387374979 >> v2:172.21.15.94:3300/0 conn(0x7fe9d815c9b0 msgr2=0x7fe9d80cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:53.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.251+0000 7fe9d6000640 1 --2- 172.21.15.17:0/1387374979 >> v2:172.21.15.94:3300/0 conn(0x7fe9d815c9b0 0x7fe9d80cf2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:53.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.251+0000 7fe9d6000640 1 -- 172.21.15.17:0/1387374979 >> v1:172.21.15.94:6789/0 conn(0x7fe9d8160730 legacy=0x7fe9d80b4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:53.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.251+0000 7fe9d6000640 1 -- 172.21.15.17:0/1387374979 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d80d0a70 con 0x7fe9d815cd90 2024-03-12T17:19:53.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.251+0000 7fe9d6a00640 1 --2- 172.21.15.17:0/1387374979 >> v2:172.21.15.94:3300/0 conn(0x7fe9d815c9b0 0x7fe9d80cf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:53.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.253+0000 7fe9d6000640 1 --2- 172.21.15.17:0/1387374979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9d815cd90 0x7fe9d80cf810 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe9d80cf2a0 tx=0x7fe9c002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91aa185ba5a43de8 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:53.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.253+0000 7fe9d5600640 1 -- 172.21.15.17:0/1387374979 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c002c9f0 con 0x7fe9d815cd90 2024-03-12T17:19:53.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.253+0000 7fe9d5600640 1 -- 172.21.15.17:0/1387374979 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c002cb50 con 0x7fe9d815cd90 2024-03-12T17:19:53.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.253+0000 7fe9d5600640 1 -- 172.21.15.17:0/1387374979 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c00343f0 con 0x7fe9d815cd90 2024-03-12T17:19:53.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.254+0000 7fe9d7e00640 1 -- 172.21.15.17:0/1387374979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9d815cd90 msgr2=0x7fe9d80cf810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:53.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.254+0000 7fe9d7e00640 1 --2- 172.21.15.17:0/1387374979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9d815cd90 0x7fe9d80cf810 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe9d80cf2a0 tx=0x7fe9c002be50 comp rx=0 tx=0).stop 2024-03-12T17:19:53.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.254+0000 7fe9d7e00640 1 -- 172.21.15.17:0/1387374979 shutdown_connections 2024-03-12T17:19:53.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.254+0000 7fe9d7e00640 1 --2- 172.21.15.17:0/1387374979 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9d815cd90 0x7fe9d80cf810 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:53.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.254+0000 7fe9d7e00640 1 --2- 172.21.15.17:0/1387374979 >> v2:172.21.15.94:3300/0 conn(0x7fe9d815c9b0 0x7fe9d80cf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:53.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.254+0000 7fe9d7e00640 1 -- 172.21.15.17:0/1387374979 >> 172.21.15.17:0/1387374979 conn(0x7fe9d806b160 msgr2=0x7fe9d806b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:53.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.254+0000 7fe9d7e00640 1 -- 172.21.15.17:0/1387374979 shutdown_connections 2024-03-12T17:19:53.249 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.254+0000 7fe9d7e00640 1 -- 172.21.15.17:0/1387374979 wait complete. 2024-03-12T17:19:53.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.256+0000 7fe9d7e00640 1 Processor -- start 2024-03-12T17:19:53.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.256+0000 7fe9d7e00640 1 -- start start 2024-03-12T17:19:53.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.257+0000 7fe9d7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9d815c9b0 0x7fe9d8157e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:53.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.257+0000 7fe9d7e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9d815cd90 0x7fe9d80cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:53.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.257+0000 7fe9d7e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9d8160730 0x7fe9d80cc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:53.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.257+0000 7fe9d7e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d80cb2b0 con 0x7fe9d815c9b0 2024-03-12T17:19:53.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.257+0000 7fe9d7e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d8158360 con 0x7fe9d815cd90 2024-03-12T17:19:53.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.257+0000 7fe9d7e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d80ca6a0 con 0x7fe9d8160730 2024-03-12T17:19:53.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.257+0000 7fe9d6a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9d815c9b0 0x7fe9d8157e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:53.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.257+0000 7fe9d6a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9d815c9b0 0x7fe9d8157e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50520/0 (socket says 172.21.15.17:50520) 2024-03-12T17:19:53.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.257+0000 7fe9d6a00640 1 -- 172.21.15.17:0/3079809270 learned_addr learned my addr 172.21.15.17:0/3079809270 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:53.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.258+0000 7fe9d6a00640 1 -- 172.21.15.17:0/3079809270 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9d8160730 msgr2=0x7fe9d80cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:53.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.258+0000 7fe9d6a00640 1 --2- 172.21.15.17:0/3079809270 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9d8160730 0x7fe9d80cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:53.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.258+0000 7fe9d6000640 1 --2- 172.21.15.17:0/3079809270 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9d815cd90 0x7fe9d80cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:53.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.258+0000 7fe9d6a00640 1 -- 172.21.15.17:0/3079809270 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9d815cd90 msgr2=0x7fe9d80cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:53.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.258+0000 7fe9d6a00640 1 --2- 172.21.15.17:0/3079809270 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9d815cd90 0x7fe9d80cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:53.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.258+0000 7fe9d6a00640 1 -- 172.21.15.17:0/3079809270 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c0009b30 con 0x7fe9d815c9b0 2024-03-12T17:19:53.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.258+0000 7fe9d6a00640 1 --2- 172.21.15.17:0/3079809270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9d815c9b0 0x7fe9d8157e20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe9c800c820 tx=0x7fe9c800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:53.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.258+0000 7fe9cea00640 1 -- 172.21.15.17:0/3079809270 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c8007a30 con 0x7fe9d815c9b0 2024-03-12T17:19:53.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.258+0000 7fe9cea00640 1 -- 172.21.15.17:0/3079809270 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c8007b90 con 0x7fe9d815c9b0 2024-03-12T17:19:53.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.258+0000 7fe9cea00640 1 -- 172.21.15.17:0/3079809270 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c800ce70 con 0x7fe9d815c9b0 2024-03-12T17:19:53.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.258+0000 7fe9d7e00640 1 -- 172.21.15.17:0/3079809270 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9d80ca980 con 0x7fe9d815c9b0 2024-03-12T17:19:53.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.259+0000 7fe9d7e00640 1 -- 172.21.15.17:0/3079809270 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d80caf40 con 0x7fe9d815c9b0 2024-03-12T17:19:53.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.260+0000 7fe9d7e00640 1 -- 172.21.15.17:0/3079809270 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9d8072360 con 0x7fe9d815c9b0 2024-03-12T17:19:53.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.261+0000 7fe9cea00640 1 -- 172.21.15.17:0/3079809270 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fe9c80113f0 con 0x7fe9d815c9b0 2024-03-12T17:19:53.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.262+0000 7fe9cea00640 1 --2- 172.21.15.17:0/3079809270 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe9b406ac00 0x7fe9b406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:53.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.262+0000 7fe9cea00640 1 -- 172.21.15.17:0/3079809270 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe9c8089200 con 0x7fe9d815c9b0 2024-03-12T17:19:53.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.262+0000 7fe9d6000640 1 --2- 172.21.15.17:0/3079809270 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe9b406ac00 0x7fe9b406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:53.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.263+0000 7fe9d6000640 1 --2- 172.21.15.17:0/3079809270 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe9b406ac00 0x7fe9b406d0c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0035000 tx=0x7fe9c0030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:53.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.266+0000 7fe9cea00640 1 -- 172.21.15.17:0/3079809270 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fe9c8054720 con 0x7fe9d815c9b0 2024-03-12T17:19:53.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:53.463+0000 7fe9d7e00640 1 -- 172.21.15.17:0/3079809270 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fe9d80ce540 con 0x7fe9d815c9b0 2024-03-12T17:19:54.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.014+0000 7fe9cea00640 1 -- 172.21.15.17:0/3079809270 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v32) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe9c8057d40 con 0x7fe9d815c9b0 2024-03-12T17:19:54.009 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2024-03-12T17:19:54.013 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.019+0000 7fe9d7e00640 1 -- 172.21.15.17:0/3079809270 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe9b406ac00 msgr2=0x7fe9b406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:54.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.019+0000 7fe9d7e00640 1 --2- 172.21.15.17:0/3079809270 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe9b406ac00 0x7fe9b406d0c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0035000 tx=0x7fe9c0030000 comp rx=0 tx=0).stop 2024-03-12T17:19:54.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.019+0000 7fe9d7e00640 1 -- 172.21.15.17:0/3079809270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9d815c9b0 msgr2=0x7fe9d8157e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:54.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.019+0000 7fe9d7e00640 1 --2- 172.21.15.17:0/3079809270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9d815c9b0 0x7fe9d8157e20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe9c800c820 tx=0x7fe9c800cc20 comp rx=0 tx=0).stop 2024-03-12T17:19:54.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.019+0000 7fe9d7e00640 1 -- 172.21.15.17:0/3079809270 shutdown_connections 2024-03-12T17:19:54.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.019+0000 7fe9d7e00640 1 --2- 172.21.15.17:0/3079809270 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe9b406ac00 0x7fe9b406d0c0 secure :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe9c0035000 tx=0x7fe9c0030000 comp rx=0 tx=0).stop 2024-03-12T17:19:54.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.019+0000 7fe9d7e00640 1 --2- 172.21.15.17:0/3079809270 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9d8160730 0x7fe9d80cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:54.014 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.019+0000 7fe9d7e00640 1 --2- 172.21.15.17:0/3079809270 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9d815cd90 0x7fe9d80cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:54.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.019+0000 7fe9d7e00640 1 --2- 172.21.15.17:0/3079809270 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9d815c9b0 0x7fe9d8157e20 secure :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe9c800c820 tx=0x7fe9c800cc20 comp rx=0 tx=0).stop 2024-03-12T17:19:54.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.019+0000 7fe9d7e00640 1 -- 172.21.15.17:0/3079809270 >> 172.21.15.17:0/3079809270 conn(0x7fe9d806b160 msgr2=0x7fe9d815c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:54.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.020+0000 7fe9d7e00640 1 -- 172.21.15.17:0/3079809270 shutdown_connections 2024-03-12T17:19:54.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.020+0000 7fe9d7e00640 1 -- 172.21.15.17:0/3079809270 wait complete. 2024-03-12T17:19:54.038 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-12T17:19:54.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.269+0000 7f8860c00640 1 Processor -- start 2024-03-12T17:19:54.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.270+0000 7f8860c00640 1 -- start start 2024-03-12T17:19:54.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.271+0000 7f8860c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f885c15ced0 0x7f885c098bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:54.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.271+0000 7f8860c00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f885c0afe20 0x7f885c0990f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:54.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.271+0000 7f8860c00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f885c15d2b0 0x7f885c160940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:54.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.271+0000 7f8860c00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f885c15e3b0 con 0x7f885c0afe20 2024-03-12T17:19:54.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.271+0000 7f8860c00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f885c0cece0 con 0x7f885c15d2b0 2024-03-12T17:19:54.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.271+0000 7f8860c00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f885c15d7a0 con 0x7f885c15ced0 2024-03-12T17:19:54.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.272+0000 7f8859400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f885c0afe20 0x7f885c0990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:54.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.272+0000 7f8859400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f885c0afe20 0x7f885c0990f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50526/0 (socket says 172.21.15.17:50526) 2024-03-12T17:19:54.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.272+0000 7f8859400640 1 -- 172.21.15.17:0/3280771867 learned_addr learned my addr 172.21.15.17:0/3280771867 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:54.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.272+0000 7f885a800640 1 --2- 172.21.15.17:0/3280771867 >> v2:172.21.15.94:3300/0 conn(0x7f885c15d2b0 0x7f885c160940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:54.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.272+0000 7f8859e00640 1 --2- 172.21.15.17:0/3280771867 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f885c15ced0 0x7f885c098bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:54.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.272+0000 7f8859400640 1 -- 172.21.15.17:0/3280771867 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f885c15ced0 msgr2=0x7f885c098bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:54.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.272+0000 7f8859400640 1 --2- 172.21.15.17:0/3280771867 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f885c15ced0 0x7f885c098bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:54.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.272+0000 7f8859400640 1 -- 172.21.15.17:0/3280771867 >> v2:172.21.15.94:3300/0 conn(0x7f885c15d2b0 msgr2=0x7f885c160940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:54.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.272+0000 7f8859400640 1 --2- 172.21.15.17:0/3280771867 >> v2:172.21.15.94:3300/0 conn(0x7f885c15d2b0 0x7f885c160940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:54.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.272+0000 7f8859400640 1 -- 172.21.15.17:0/3280771867 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885c15da80 con 0x7f885c0afe20 2024-03-12T17:19:54.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.273+0000 7f8859400640 1 --2- 172.21.15.17:0/3280771867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f885c0afe20 0x7f885c0990f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f885c0667a0 tx=0x7f884802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3524e3dd3d6cafe server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:54.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.273+0000 7f8858a00640 1 -- 172.21.15.17:0/3280771867 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884802ca70 con 0x7f885c0afe20 2024-03-12T17:19:54.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.274+0000 7f8858a00640 1 -- 172.21.15.17:0/3280771867 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884802cbd0 con 0x7f885c0afe20 2024-03-12T17:19:54.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.274+0000 7f8858a00640 1 -- 172.21.15.17:0/3280771867 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88480343f0 con 0x7f885c0afe20 2024-03-12T17:19:54.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.274+0000 7f8860c00640 1 -- 172.21.15.17:0/3280771867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f885c0afe20 msgr2=0x7f885c0990f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:54.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.274+0000 7f8860c00640 1 --2- 172.21.15.17:0/3280771867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f885c0afe20 0x7f885c0990f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f885c0667a0 tx=0x7f884802bed0 comp rx=0 tx=0).stop 2024-03-12T17:19:54.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.274+0000 7f8860c00640 1 -- 172.21.15.17:0/3280771867 shutdown_connections 2024-03-12T17:19:54.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.274+0000 7f8860c00640 1 --2- 172.21.15.17:0/3280771867 >> v2:172.21.15.94:3300/0 conn(0x7f885c15d2b0 0x7f885c160940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:54.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.274+0000 7f8860c00640 1 --2- 172.21.15.17:0/3280771867 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f885c0afe20 0x7f885c0990f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:54.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.274+0000 7f8860c00640 1 --2- 172.21.15.17:0/3280771867 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f885c15ced0 0x7f885c098bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:54.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.274+0000 7f8860c00640 1 -- 172.21.15.17:0/3280771867 >> 172.21.15.17:0/3280771867 conn(0x7f885c0b2460 msgr2=0x7f885c0b2870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:54.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.274+0000 7f8860c00640 1 -- 172.21.15.17:0/3280771867 shutdown_connections 2024-03-12T17:19:54.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.274+0000 7f8860c00640 1 -- 172.21.15.17:0/3280771867 wait complete. 2024-03-12T17:19:54.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.276+0000 7f8860c00640 1 Processor -- start 2024-03-12T17:19:54.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.276+0000 7f8860c00640 1 -- start start 2024-03-12T17:19:54.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.277+0000 7f8860c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f885c15ced0 0x7f885c15bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:54.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.277+0000 7f8860c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f885c15d2b0 0x7f885c1f2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:54.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.277+0000 7f8860c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f885c0b3980 0x7f885c148210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:54.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.277+0000 7f8860c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885c1f30d0 con 0x7f885c15ced0 2024-03-12T17:19:54.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.277+0000 7f8860c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885c1f3330 con 0x7f885c15d2b0 2024-03-12T17:19:54.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.277+0000 7f8860c00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f885c1f3610 con 0x7f885c0b3980 2024-03-12T17:19:54.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.277+0000 7f8859e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f885c15ced0 0x7f885c15bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:54.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.278+0000 7f8859e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f885c15ced0 0x7f885c15bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50534/0 (socket says 172.21.15.17:50534) 2024-03-12T17:19:54.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.278+0000 7f8859e00640 1 -- 172.21.15.17:0/1789889598 learned_addr learned my addr 172.21.15.17:0/1789889598 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:54.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.278+0000 7f885a800640 1 --2- 172.21.15.17:0/1789889598 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f885c0b3980 0x7f885c148210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:54.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.278+0000 7f8859e00640 1 -- 172.21.15.17:0/1789889598 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f885c0b3980 msgr2=0x7f885c148210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:54.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.278+0000 7f8859e00640 1 --2- 172.21.15.17:0/1789889598 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f885c0b3980 0x7f885c148210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:54.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.278+0000 7f8859e00640 1 -- 172.21.15.17:0/1789889598 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f885c15d2b0 msgr2=0x7f885c1f2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:54.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.278+0000 7f8859e00640 1 --2- 172.21.15.17:0/1789889598 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f885c15d2b0 0x7f885c1f2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:54.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.278+0000 7f8859e00640 1 -- 172.21.15.17:0/1789889598 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8848009b30 con 0x7f885c15ced0 2024-03-12T17:19:54.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.278+0000 7f8859e00640 1 --2- 172.21.15.17:0/1789889598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f885c15ced0 0x7f885c15bac0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f884c00c7f0 tx=0x7f884c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:54.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.279+0000 7f8852000640 1 -- 172.21.15.17:0/1789889598 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c004220 con 0x7f885c15ced0 2024-03-12T17:19:54.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.279+0000 7f8852000640 1 -- 172.21.15.17:0/1789889598 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884c004380 con 0x7f885c15ced0 2024-03-12T17:19:54.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.279+0000 7f8852000640 1 -- 172.21.15.17:0/1789889598 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884c007860 con 0x7f885c15ced0 2024-03-12T17:19:54.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.279+0000 7f8860c00640 1 -- 172.21.15.17:0/1789889598 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f885c1f38f0 con 0x7f885c15ced0 2024-03-12T17:19:54.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.279+0000 7f8860c00640 1 -- 172.21.15.17:0/1789889598 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f885c0b3e30 con 0x7f885c15ced0 2024-03-12T17:19:54.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.280+0000 7f8860c00640 1 -- 172.21.15.17:0/1789889598 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f885c066930 con 0x7f885c15ced0 2024-03-12T17:19:54.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.281+0000 7f8852000640 1 -- 172.21.15.17:0/1789889598 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f884c007bd0 con 0x7f885c15ced0 2024-03-12T17:19:54.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.282+0000 7f8852000640 1 --2- 172.21.15.17:0/1789889598 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f883c06ac00 0x7f883c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:54.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.282+0000 7f8852000640 1 -- 172.21.15.17:0/1789889598 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f884c089180 con 0x7f885c15ced0 2024-03-12T17:19:54.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.283+0000 7f8859400640 1 --2- 172.21.15.17:0/1789889598 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f883c06ac00 0x7f883c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:54.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.283+0000 7f8859400640 1 --2- 172.21.15.17:0/1789889598 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f883c06ac00 0x7f883c06d0c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8848035000 tx=0x7f884802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:54.281 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.287+0000 7f8852000640 1 -- 172.21.15.17:0/1789889598 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f884c0544a0 con 0x7f885c15ced0 2024-03-12T17:19:54.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:54.492+0000 7f8860c00640 1 -- 172.21.15.17:0/1789889598 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f885c06b670 con 0x7f885c15ced0 2024-03-12T17:19:55.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.034+0000 7f8852000640 1 -- 172.21.15.17:0/1789889598 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v33) v1 ==== 170+0+0 (secure 0 0 0) 0x7f884c057ac0 con 0x7f885c15ced0 2024-03-12T17:19:55.030 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2024-03-12T17:19:55.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.040+0000 7f8860c00640 1 -- 172.21.15.17:0/1789889598 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f883c06ac00 msgr2=0x7f883c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:55.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.040+0000 7f8860c00640 1 --2- 172.21.15.17:0/1789889598 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f883c06ac00 0x7f883c06d0c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8848035000 tx=0x7f884802e000 comp rx=0 tx=0).stop 2024-03-12T17:19:55.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.040+0000 7f8860c00640 1 -- 172.21.15.17:0/1789889598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f885c15ced0 msgr2=0x7f885c15bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:55.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.040+0000 7f8860c00640 1 --2- 172.21.15.17:0/1789889598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f885c15ced0 0x7f885c15bac0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f884c00c7f0 tx=0x7f884c00ccb0 comp rx=0 tx=0).stop 2024-03-12T17:19:55.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.043+0000 7f8860c00640 1 -- 172.21.15.17:0/1789889598 shutdown_connections 2024-03-12T17:19:55.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.043+0000 7f8860c00640 1 --2- 172.21.15.17:0/1789889598 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f883c06ac00 0x7f883c06d0c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:55.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.043+0000 7f8860c00640 1 --2- 172.21.15.17:0/1789889598 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f885c0b3980 0x7f885c148210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:55.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.043+0000 7f8860c00640 1 --2- 172.21.15.17:0/1789889598 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f885c15d2b0 0x7f885c1f2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:55.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.043+0000 7f8860c00640 1 --2- 172.21.15.17:0/1789889598 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f885c15ced0 0x7f885c15bac0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:55.038 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.043+0000 7f8860c00640 1 -- 172.21.15.17:0/1789889598 >> 172.21.15.17:0/1789889598 conn(0x7f885c0b2460 msgr2=0x7f885c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:55.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.044+0000 7f8860c00640 1 -- 172.21.15.17:0/1789889598 shutdown_connections 2024-03-12T17:19:55.039 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.044+0000 7f8860c00640 1 -- 172.21.15.17:0/1789889598 wait complete. 2024-03-12T17:19:55.073 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-12T17:19:55.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.265+0000 7fe9f0600640 1 Processor -- start 2024-03-12T17:19:55.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.265+0000 7fe9f0600640 1 -- start start 2024-03-12T17:19:55.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.267+0000 7fe9f0600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9e8144240 0x7fe9e80ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:55.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.267+0000 7fe9f0600640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9e80ce320 con 0x7fe9e80cb970 2024-03-12T17:19:55.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.267+0000 7fe9f0600640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9e8144620 con 0x7fe9e80cecf0 2024-03-12T17:19:55.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.267+0000 7fe9f0600640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e815f3d0 con 0x7fe9e8144240 2024-03-12T17:19:55.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.267+0000 7fe9ee600640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fe9e80cb970 0x7fe9e815e670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:50882/0 (socket says 172.21.15.17:50882) 2024-03-12T17:19:55.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.267+0000 7fe9ee600640 1 -- 172.21.15.17:0/1393833151 learned_addr learned my addr 172.21.15.17:0/1393833151 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:55.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.268+0000 7fe9edc00640 1 --2- 172.21.15.17:0/1393833151 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9e8144240 0x7fe9e80ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:55.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.268+0000 7fe9e7e00640 1 -- 172.21.15.17:0/1393833151 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 977206515 0 0) 0x7fe9e80ce320 con 0x7fe9e80cb970 2024-03-12T17:19:55.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.268+0000 7fe9e7e00640 1 -- 172.21.15.17:0/1393833151 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9d0003520 con 0x7fe9e80cb970 2024-03-12T17:19:55.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.268+0000 7fe9e7e00640 1 -- 172.21.15.17:0/1393833151 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3568788713 0 0) 0x7fe9d0003520 con 0x7fe9e80cb970 2024-03-12T17:19:55.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.268+0000 7fe9e7e00640 1 -- 172.21.15.17:0/1393833151 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9e8144240 msgr2=0x7fe9e80ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:55.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.268+0000 7fe9e7e00640 1 --2- 172.21.15.17:0/1393833151 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9e8144240 0x7fe9e80ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:55.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.268+0000 7fe9e7e00640 1 -- 172.21.15.17:0/1393833151 >> v1:172.21.15.94:6789/0 conn(0x7fe9e80cecf0 legacy=0x7fe9e80b2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:55.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.268+0000 7fe9e7e00640 1 -- 172.21.15.17:0/1393833151 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e80cd9f0 con 0x7fe9e80cb970 2024-03-12T17:19:55.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.268+0000 7fe9e7e00640 1 -- 172.21.15.17:0/1393833151 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7fe9e00019f0 con 0x7fe9e80cb970 2024-03-12T17:19:55.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.268+0000 7fe9e7e00640 1 -- 172.21.15.17:0/1393833151 >> v1:172.21.15.17:6789/0 conn(0x7fe9e80cb970 legacy=0x7fe9e815e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:55.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.268+0000 7fe9e7e00640 1 --2- 172.21.15.17:0/1393833151 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9d00039a0 0x7fe9d0003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:55.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.268+0000 7fe9e7e00640 1 --2- 172.21.15.17:0/1393833151 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9e8144240 0x7fe9d00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:55.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.268+0000 7fe9e7e00640 1 --2- 172.21.15.17:0/1393833151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9d0004d00 0x7fe9d0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:55.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.269+0000 7fe9e7e00640 1 -- 172.21.15.17:0/1393833151 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e815f3d0 con 0x7fe9d0004d00 2024-03-12T17:19:55.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.269+0000 7fe9e7e00640 1 -- 172.21.15.17:0/1393833151 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d000b980 con 0x7fe9d00039a0 2024-03-12T17:19:55.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.269+0000 7fe9e7e00640 1 -- 172.21.15.17:0/1393833151 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d000bb40 con 0x7fe9e8144240 2024-03-12T17:19:55.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.269+0000 7fe9ee600640 1 --2- 172.21.15.17:0/1393833151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9d0004d00 0x7fe9d0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:55.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.269+0000 7fe9edc00640 1 --2- 172.21.15.17:0/1393833151 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9d00039a0 0x7fe9d0003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:55.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.269+0000 7fe9ed200640 1 --2- 172.21.15.17:0/1393833151 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9e8144240 0x7fe9d00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:55.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.269+0000 7fe9ee600640 1 -- 172.21.15.17:0/1393833151 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9e8144240 msgr2=0x7fe9d00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:55.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.269+0000 7fe9ee600640 1 --2- 172.21.15.17:0/1393833151 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9e8144240 0x7fe9d00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:55.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.269+0000 7fe9ee600640 1 -- 172.21.15.17:0/1393833151 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9d00039a0 msgr2=0x7fe9d0003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:55.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.269+0000 7fe9ee600640 1 --2- 172.21.15.17:0/1393833151 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9d00039a0 0x7fe9d0003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:55.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.269+0000 7fe9ee600640 1 -- 172.21.15.17:0/1393833151 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d0003520 con 0x7fe9d0004d00 2024-03-12T17:19:55.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.271+0000 7fe9ee600640 1 --2- 172.21.15.17:0/1393833151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9d0004d00 0x7fe9d0005180 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe9e000a830 tx=0x7fe9d00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa7eaae0ba125b1f server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:55.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.271+0000 7fe9e7e00640 1 -- 172.21.15.17:0/1393833151 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e002cea0 con 0x7fe9d0004d00 2024-03-12T17:19:55.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.271+0000 7fe9e7e00640 1 -- 172.21.15.17:0/1393833151 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e002f070 con 0x7fe9d0004d00 2024-03-12T17:19:55.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.271+0000 7fe9e7e00640 1 -- 172.21.15.17:0/1393833151 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e0034890 con 0x7fe9d0004d00 2024-03-12T17:19:55.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.271+0000 7fe9f0600640 1 -- 172.21.15.17:0/1393833151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9d0004d00 msgr2=0x7fe9d0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:55.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.271+0000 7fe9f0600640 1 --2- 172.21.15.17:0/1393833151 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9d0004d00 0x7fe9d0005180 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fe9e000a830 tx=0x7fe9d00057f0 comp rx=0 tx=0).stop 2024-03-12T17:19:55.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.271+0000 7fe9ee600640 1 -- 172.21.15.17:0/1393833151 reap_dead start 2024-03-12T17:19:55.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.272+0000 7fe9f0600640 1 -- 172.21.15.17:0/1393833151 shutdown_connections 2024-03-12T17:19:55.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.272+0000 7fe9f0600640 1 -- 172.21.15.17:0/1393833151 >> 172.21.15.17:0/1393833151 conn(0x7fe9e8069ce0 msgr2=0x7fe9e806a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:55.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.272+0000 7fe9f0600640 1 -- 172.21.15.17:0/1393833151 shutdown_connections 2024-03-12T17:19:55.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.272+0000 7fe9f0600640 1 -- 172.21.15.17:0/1393833151 wait complete. 2024-03-12T17:19:55.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.273+0000 7fe9f0600640 1 Processor -- start 2024-03-12T17:19:55.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.274+0000 7fe9f0600640 1 -- start start 2024-03-12T17:19:55.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.274+0000 7fe9f0600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9d0004d00 0x7fe9e813b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:55.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.274+0000 7fe9f0600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9e815a060 0x7fe9e81521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:55.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.274+0000 7fe9f0600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9e80b0b40 0x7fe9e815d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:55.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.274+0000 7fe9f0600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e80b0720 con 0x7fe9e815a060 2024-03-12T17:19:55.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.274+0000 7fe9f0600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e813e460 con 0x7fe9d0004d00 2024-03-12T17:19:55.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.274+0000 7fe9f0600640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9e80afaa0 con 0x7fe9e80b0b40 2024-03-12T17:19:55.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.275+0000 7fe9ed200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9e815a060 0x7fe9e81521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:55.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.275+0000 7fe9ed200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9e815a060 0x7fe9e81521d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50548/0 (socket says 172.21.15.17:50548) 2024-03-12T17:19:55.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.275+0000 7fe9ed200640 1 -- 172.21.15.17:0/3417548823 learned_addr learned my addr 172.21.15.17:0/3417548823 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:55.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.275+0000 7fe9ee600640 1 --2- 172.21.15.17:0/3417548823 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9e80b0b40 0x7fe9e815d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:55.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.275+0000 7fe9ed200640 1 -- 172.21.15.17:0/3417548823 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9e80b0b40 msgr2=0x7fe9e815d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:55.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.275+0000 7fe9edc00640 1 --2- 172.21.15.17:0/3417548823 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9d0004d00 0x7fe9e813b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:55.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.275+0000 7fe9ed200640 1 --2- 172.21.15.17:0/3417548823 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9e80b0b40 0x7fe9e815d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:55.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.275+0000 7fe9ed200640 1 -- 172.21.15.17:0/3417548823 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9d0004d00 msgr2=0x7fe9e813b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:55.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.275+0000 7fe9ed200640 1 --2- 172.21.15.17:0/3417548823 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9d0004d00 0x7fe9e813b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:55.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.275+0000 7fe9ed200640 1 -- 172.21.15.17:0/3417548823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e80afd80 con 0x7fe9e815a060 2024-03-12T17:19:55.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.275+0000 7fe9ee600640 1 --2- 172.21.15.17:0/3417548823 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9e80b0b40 0x7fe9e815d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:55.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.275+0000 7fe9edc00640 1 --2- 172.21.15.17:0/3417548823 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9d0004d00 0x7fe9e813b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:55.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.276+0000 7fe9ed200640 1 --2- 172.21.15.17:0/3417548823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9e815a060 0x7fe9e81521d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe9d400e800 tx=0x7fe9d400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:55.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.276+0000 7fe9e5600640 1 -- 172.21.15.17:0/3417548823 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d40050d0 con 0x7fe9e815a060 2024-03-12T17:19:55.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.276+0000 7fe9e5600640 1 -- 172.21.15.17:0/3417548823 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d4005250 con 0x7fe9e815a060 2024-03-12T17:19:55.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.276+0000 7fe9f0600640 1 -- 172.21.15.17:0/3417548823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9e80b0060 con 0x7fe9e815a060 2024-03-12T17:19:55.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.276+0000 7fe9e5600640 1 -- 172.21.15.17:0/3417548823 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d400c6c0 con 0x7fe9e815a060 2024-03-12T17:19:55.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.276+0000 7fe9f0600640 1 -- 172.21.15.17:0/3417548823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9e80b0fc0 con 0x7fe9e815a060 2024-03-12T17:19:55.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.277+0000 7fe9f0600640 1 -- 172.21.15.17:0/3417548823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9e80b0860 con 0x7fe9e815a060 2024-03-12T17:19:55.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.279+0000 7fe9e5600640 1 -- 172.21.15.17:0/3417548823 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fe9d400c820 con 0x7fe9e815a060 2024-03-12T17:19:55.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.279+0000 7fe9e5600640 1 --2- 172.21.15.17:0/3417548823 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe9c806ac00 0x7fe9c806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:55.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.280+0000 7fe9e5600640 1 -- 172.21.15.17:0/3417548823 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fe9d40892c0 con 0x7fe9e815a060 2024-03-12T17:19:55.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.280+0000 7fe9edc00640 1 --2- 172.21.15.17:0/3417548823 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe9c806ac00 0x7fe9c806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:55.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.280+0000 7fe9edc00640 1 --2- 172.21.15.17:0/3417548823 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe9c806ac00 0x7fe9c806d0c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc009a00 tx=0x7fe9dc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:55.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.284+0000 7fe9e5600640 1 -- 172.21.15.17:0/3417548823 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fe9e80b0860 con 0x7fe9e815a060 2024-03-12T17:19:55.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.520+0000 7fe9f0600640 1 -- 172.21.15.17:0/3417548823 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fe9e80b0860 con 0x7fe9e815a060 2024-03-12T17:19:55.526 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.532+0000 7fe9e5600640 1 -- 172.21.15.17:0/3417548823 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe9e80b0860 con 0x7fe9e815a060 2024-03-12T17:19:55.527 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 4 and data pool 5 2024-03-12T17:19:55.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.540+0000 7fe9f0600640 1 -- 172.21.15.17:0/3417548823 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe9c806ac00 msgr2=0x7fe9c806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:55.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.540+0000 7fe9f0600640 1 --2- 172.21.15.17:0/3417548823 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe9c806ac00 0x7fe9c806d0c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc009a00 tx=0x7fe9dc008040 comp rx=0 tx=0).stop 2024-03-12T17:19:55.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.540+0000 7fe9f0600640 1 -- 172.21.15.17:0/3417548823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9e815a060 msgr2=0x7fe9e81521d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:55.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.540+0000 7fe9f0600640 1 --2- 172.21.15.17:0/3417548823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9e815a060 0x7fe9e81521d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe9d400e800 tx=0x7fe9d400ecc0 comp rx=0 tx=0).stop 2024-03-12T17:19:55.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.541+0000 7fe9f0600640 1 -- 172.21.15.17:0/3417548823 shutdown_connections 2024-03-12T17:19:55.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.541+0000 7fe9f0600640 1 --2- 172.21.15.17:0/3417548823 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe9c806ac00 0x7fe9c806d0c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:55.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.541+0000 7fe9f0600640 1 --2- 172.21.15.17:0/3417548823 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe9e80b0b40 0x7fe9e815d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:55.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.541+0000 7fe9f0600640 1 --2- 172.21.15.17:0/3417548823 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe9e815a060 0x7fe9e81521d0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:55.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.541+0000 7fe9f0600640 1 --2- 172.21.15.17:0/3417548823 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe9d0004d00 0x7fe9e813b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:55.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.541+0000 7fe9f0600640 1 -- 172.21.15.17:0/3417548823 >> 172.21.15.17:0/3417548823 conn(0x7fe9e8069ce0 msgr2=0x7fe9e80b34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:55.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.542+0000 7fe9f0600640 1 -- 172.21.15.17:0/3417548823 shutdown_connections 2024-03-12T17:19:55.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.543+0000 7fe9f0600640 1 -- 172.21.15.17:0/3417548823 wait complete. 2024-03-12T17:19:55.568 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T17:19:55.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.746+0000 7f425cc00640 1 Processor -- start 2024-03-12T17:19:55.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.747+0000 7f425cc00640 1 -- start start 2024-03-12T17:19:55.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.748+0000 7f425cc00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4258144240 0x7f42580ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:55.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.748+0000 7f425cc00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f42580cecf0 0x7f42580b2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:55.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.748+0000 7f425cc00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f42580b25b0 0x7f42580cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:55.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.748+0000 7f425cc00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42580ce320 con 0x7f42580cecf0 2024-03-12T17:19:55.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.748+0000 7f425cc00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4258144620 con 0x7f42580b25b0 2024-03-12T17:19:55.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.748+0000 7f425cc00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f425815f3d0 con 0x7f4258144240 2024-03-12T17:19:55.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.748+0000 7f424fe00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f42580cecf0 0x7f42580b2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:55.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.749+0000 7f424fe00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f42580cecf0 0x7f42580b2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50560/0 (socket says 172.21.15.17:50560) 2024-03-12T17:19:55.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.749+0000 7f424fe00640 1 -- 172.21.15.17:0/1884987729 learned_addr learned my addr 172.21.15.17:0/1884987729 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:55.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.749+0000 7f4256800640 1 --2- 172.21.15.17:0/1884987729 >> v2:172.21.15.94:3300/0 conn(0x7f42580b25b0 0x7f42580cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:55.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.749+0000 7f4255e00640 1 --2- 172.21.15.17:0/1884987729 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4258144240 0x7f42580ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:55.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.749+0000 7f424fe00640 1 -- 172.21.15.17:0/1884987729 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4258144240 msgr2=0x7f42580ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:55.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.749+0000 7f424fe00640 1 --2- 172.21.15.17:0/1884987729 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4258144240 0x7f42580ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:55.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.749+0000 7f424fe00640 1 -- 172.21.15.17:0/1884987729 >> v2:172.21.15.94:3300/0 conn(0x7f42580b25b0 msgr2=0x7f42580cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:55.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.749+0000 7f424fe00640 1 --2- 172.21.15.17:0/1884987729 >> v2:172.21.15.94:3300/0 conn(0x7f42580b25b0 0x7f42580cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:55.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.749+0000 7f424fe00640 1 -- 172.21.15.17:0/1884987729 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42580cd9f0 con 0x7f42580cecf0 2024-03-12T17:19:55.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.750+0000 7f424fe00640 1 --2- 172.21.15.17:0/1884987729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42580cecf0 0x7f42580b2070 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4240009870 tx=0x7f424002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41c96a5095a136d9 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:55.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.751+0000 7f4255400640 1 -- 172.21.15.17:0/1884987729 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4240031640 con 0x7f42580cecf0 2024-03-12T17:19:55.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.751+0000 7f4255400640 1 -- 172.21.15.17:0/1884987729 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42400317a0 con 0x7f42580cecf0 2024-03-12T17:19:55.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.751+0000 7f4255400640 1 -- 172.21.15.17:0/1884987729 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4240031b30 con 0x7f42580cecf0 2024-03-12T17:19:55.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.751+0000 7f425cc00640 1 -- 172.21.15.17:0/1884987729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42580cecf0 msgr2=0x7f42580b2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:55.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.751+0000 7f425cc00640 1 --2- 172.21.15.17:0/1884987729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42580cecf0 0x7f42580b2070 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4240009870 tx=0x7f424002b8f0 comp rx=0 tx=0).stop 2024-03-12T17:19:55.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.751+0000 7f425cc00640 1 -- 172.21.15.17:0/1884987729 shutdown_connections 2024-03-12T17:19:55.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.751+0000 7f425cc00640 1 --2- 172.21.15.17:0/1884987729 >> v2:172.21.15.94:3300/0 conn(0x7f42580b25b0 0x7f42580cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:55.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.751+0000 7f425cc00640 1 --2- 172.21.15.17:0/1884987729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42580cecf0 0x7f42580b2070 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:55.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.751+0000 7f425cc00640 1 --2- 172.21.15.17:0/1884987729 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4258144240 0x7f42580ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:55.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.751+0000 7f425cc00640 1 -- 172.21.15.17:0/1884987729 >> 172.21.15.17:0/1884987729 conn(0x7f4258069ce0 msgr2=0x7f425806a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:55.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.752+0000 7f425cc00640 1 -- 172.21.15.17:0/1884987729 shutdown_connections 2024-03-12T17:19:55.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.752+0000 7f425cc00640 1 -- 172.21.15.17:0/1884987729 wait complete. 2024-03-12T17:19:55.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.753+0000 7f425cc00640 1 Processor -- start 2024-03-12T17:19:55.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.753+0000 7f425cc00640 1 -- start start 2024-03-12T17:19:55.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.754+0000 7f425cc00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f42580b25b0 0x7f4258142630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:55.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.754+0000 7f425cc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42580cecf0 0x7f42581f0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:55.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.754+0000 7f425cc00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4258144240 0x7f42581ef010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:55.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.754+0000 7f425cc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42581ef860 con 0x7f42580cecf0 2024-03-12T17:19:55.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.754+0000 7f425cc00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42581efb40 con 0x7f42580b25b0 2024-03-12T17:19:55.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.754+0000 7f425cc00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42581efe20 con 0x7f4258144240 2024-03-12T17:19:55.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.755+0000 7f424fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42580cecf0 0x7f42581f0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:55.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.755+0000 7f424fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42580cecf0 0x7f42581f0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50572/0 (socket says 172.21.15.17:50572) 2024-03-12T17:19:55.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.755+0000 7f424fe00640 1 -- 172.21.15.17:0/3707103255 learned_addr learned my addr 172.21.15.17:0/3707103255 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:55.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.755+0000 7f4256800640 1 --2- 172.21.15.17:0/3707103255 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4258144240 0x7f42581ef010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:55.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.755+0000 7f4255e00640 1 --2- 172.21.15.17:0/3707103255 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f42580b25b0 0x7f4258142630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:55.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.755+0000 7f424fe00640 1 -- 172.21.15.17:0/3707103255 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4258144240 msgr2=0x7f42581ef010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:55.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.755+0000 7f424fe00640 1 --2- 172.21.15.17:0/3707103255 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4258144240 0x7f42581ef010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:55.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.755+0000 7f424fe00640 1 -- 172.21.15.17:0/3707103255 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f42580b25b0 msgr2=0x7f4258142630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:55.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.755+0000 7f424fe00640 1 --2- 172.21.15.17:0/3707103255 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f42580b25b0 0x7f4258142630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:55.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.755+0000 7f424fe00640 1 -- 172.21.15.17:0/3707103255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42400094d0 con 0x7f42580cecf0 2024-03-12T17:19:55.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.755+0000 7f4256800640 1 --2- 172.21.15.17:0/3707103255 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4258144240 0x7f42581ef010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:55.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.755+0000 7f424fe00640 1 --2- 172.21.15.17:0/3707103255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42580cecf0 0x7f42581f0900 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4240000c00 tx=0x7f42400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:55.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.756+0000 7f424e000640 1 -- 172.21.15.17:0/3707103255 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424003ac60 con 0x7f42580cecf0 2024-03-12T17:19:55.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.756+0000 7f424e000640 1 -- 172.21.15.17:0/3707103255 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f424003adc0 con 0x7f42580cecf0 2024-03-12T17:19:55.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.756+0000 7f425cc00640 1 -- 172.21.15.17:0/3707103255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42581f0100 con 0x7f42580cecf0 2024-03-12T17:19:55.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.756+0000 7f424e000640 1 -- 172.21.15.17:0/3707103255 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4240044630 con 0x7f42580cecf0 2024-03-12T17:19:55.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.756+0000 7f425cc00640 1 -- 172.21.15.17:0/3707103255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42581f0e40 con 0x7f42580cecf0 2024-03-12T17:19:55.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.757+0000 7f425cc00640 1 -- 172.21.15.17:0/3707103255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42581f0620 con 0x7f42580cecf0 2024-03-12T17:19:55.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.758+0000 7f424e000640 1 -- 172.21.15.17:0/3707103255 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f424002f050 con 0x7f42580cecf0 2024-03-12T17:19:55.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.759+0000 7f424e000640 1 --2- 172.21.15.17:0/3707103255 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f423406ac00 0x7f423406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:55.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.759+0000 7f424e000640 1 -- 172.21.15.17:0/3707103255 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f42400ab2a0 con 0x7f42580cecf0 2024-03-12T17:19:55.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.759+0000 7f4255e00640 1 --2- 172.21.15.17:0/3707103255 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f423406ac00 0x7f423406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:55.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.760+0000 7f4255e00640 1 --2- 172.21.15.17:0/3707103255 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f423406ac00 0x7f423406d0c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4248006fd0 tx=0x7f4248008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:55.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.764+0000 7f424e000640 1 -- 172.21.15.17:0/3707103255 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f42581f0620 con 0x7f42580cecf0 2024-03-12T17:19:55.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.962+0000 7f425cc00640 1 -- 172.21.15.17:0/3707103255 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42581f0620 con 0x7f42580cecf0 2024-03-12T17:19:55.959 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.965+0000 7f424e000640 1 -- 172.21.15.17:0/3707103255 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16066 (secure 0 0 0) 0x7f42581f0620 con 0x7f42580cecf0 2024-03-12T17:19:55.959 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:19:55.960 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":34,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:19:55.521757+0000","last_up_change":"2024-03-12T17:18:38.144756+0000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-12T17:18:39.552910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-12T17:19:53.519967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-12T17:19:54.546388+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":37305},{"type":"v1","addr":"172.21.15.17:6801","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":37305},{"type":"v1","addr":"172.21.15.17:6803","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":37305},{"type":"v1","addr":"172.21.15.17:6807","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":37305},{"type":"v1","addr":"172.21.15.17:6805","nonce":37305}]},"public_addr":"172.21.15.17:6801/37305","cluster_addr":"172.21.15.17:6803/37305","heartbeat_back_addr":"172.21.15.17:6807/37305","heartbeat_front_addr":"172.21.15.17:6805/37305","state":["exists","up"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":37307},{"type":"v1","addr":"172.21.15.17:6814","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":37307},{"type":"v1","addr":"172.21.15.17:6818","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":37307},{"type":"v1","addr":"172.21.15.17:6827","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":37307},{"type":"v1","addr":"172.21.15.17:6823","nonce":37307}]},"public_addr":"172.21.15.17:6814/37307","cluster_addr":"172.21.15.17:6818/37307","heartbeat_back_addr":"172.21.15.17:6827/37307","heartbeat_front_addr":"172.21.15.17:6823/37307","state":["exists","up"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":37303},{"type":"v1","addr":"172.21.15.17:6809","nonce":37303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":37303},{"type":"v1","addr":"172.21.15.17:6811","nonce":37303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":37303},{"type":"v1","addr":"172.21.15.17:6819","nonce":37303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":37303},{"type":"v1","addr":"172.21.15.17:6815","nonce":37303}]},"public_addr":"172.21.15.17:6809/37303","cluster_addr":"172.21.15.17:6811/37303","heartbeat_back_addr":"172.21.15.17:6819/37303","heartbeat_front_addr":"172.21.15.17:6815/37303","state":["exists","up"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":37308},{"type":"v1","addr":"172.21.15.17:6822","nonce":37308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":37308},{"type":"v1","addr":"172.21.15.17:6826","nonce":37308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":37308},{"type":"v1","addr":"172.21.15.17:6831","nonce":37308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":37308},{"type":"v1","addr":"172.21.15.17:6829","nonce":37308}]},"public_addr":"172.21.15.17:6822/37308","cluster_addr":"172.21.15.17:6826/37308","heartbeat_back_addr":"172.21.15.17:6831/37308","heartbeat_front_addr":"172.21.15.17:6829/37308","state":["exists","up"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":37465},{"type":"v1","addr":"172.21.15.94:6809","nonce":37465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6811","nonce":37465},{"type":"v1","addr":"172.21.15.94:6813","nonce":37465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6819","nonce":37465},{"type":"v1","addr":"172.21.15.94:6822","nonce":37465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6815","nonce":37465},{"type":"v1","addr":"172.21.15.94:6817","nonce":37465}]},"public_addr":"172.21.15.94:6809/37465","cluster_addr":"172.21.15.94:6813/37465","heartbeat_back_addr":"172.21.15.94:6822/37465","heartbeat_front_addr":"172.21.15.94:6817/37465","state":["exists","up"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":37464},{"type":"v1","addr":"172.21.15.94:6812","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":37464},{"type":"v1","addr":"172.21.15.94:6816","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":37464},{"type":"v1","addr":"172.21.15.94:6823","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":37464},{"type":"v1","addr":"172.21.15.94:6820","nonce":37464}]},"public_addr":"172.21.15.94:6812/37464","cluster_addr":"172.21.15.94:6816/37464","heartbeat_back_addr":"172.21.15.94:6823/37464","heartbeat_front_addr":"172.21.15.94:6820/37464","state":["exists","up"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":37467},{"type":"v1","addr":"172.21.15.94:6825","nonce":37467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":37467},{"type":"v1","addr":"172.21.15.94:6827","nonce":37467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":37467},{"type":"v1","addr":"172.21.15.94:6831","nonce":37467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":37467},{"type":"v1","addr":"172.21.15.94:6829","nonce":37467}]},"public_addr":"172.21.15.94:6825/37467","cluster_addr":"172.21.15.94:6827/37467","heartbeat_back_addr":"172.21.15.94:6831/37467","heartbeat_front_addr":"172.21.15.94:6829/37467","state":["exists","up"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":37466},{"type":"v1","addr":"172.21.15.94:6801","nonce":37466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":37466},{"type":"v1","addr":"172.21.15.94:6803","nonce":37466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":37466},{"type":"v1","addr":"172.21.15.94:6807","nonce":37466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":37466},{"type":"v1","addr":"172.21.15.94:6805","nonce":37466}]},"public_addr":"172.21.15.94:6801/37466","cluster_addr":"172.21.15.94:6803/37466","heartbeat_back_addr":"172.21.15.94:6807/37466","heartbeat_front_addr":"172.21.15.94:6805/37466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.327217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.186966+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.419986+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.150585+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.120621+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.121576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.181257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.293188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:19:55.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.968+0000 7f425cc00640 1 -- 172.21.15.17:0/3707103255 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f423406ac00 msgr2=0x7f423406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:55.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.968+0000 7f425cc00640 1 --2- 172.21.15.17:0/3707103255 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f423406ac00 0x7f423406d0c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4248006fd0 tx=0x7f4248008040 comp rx=0 tx=0).stop 2024-03-12T17:19:55.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.968+0000 7f425cc00640 1 -- 172.21.15.17:0/3707103255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42580cecf0 msgr2=0x7f42581f0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:55.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.968+0000 7f425cc00640 1 --2- 172.21.15.17:0/3707103255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42580cecf0 0x7f42581f0900 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4240000c00 tx=0x7f42400046c0 comp rx=0 tx=0).stop 2024-03-12T17:19:55.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.968+0000 7f425cc00640 1 -- 172.21.15.17:0/3707103255 shutdown_connections 2024-03-12T17:19:55.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.968+0000 7f425cc00640 1 --2- 172.21.15.17:0/3707103255 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f423406ac00 0x7f423406d0c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:55.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.968+0000 7f425cc00640 1 --2- 172.21.15.17:0/3707103255 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4258144240 0x7f42581ef010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:55.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.968+0000 7f425cc00640 1 --2- 172.21.15.17:0/3707103255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42580cecf0 0x7f42581f0900 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:55.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.968+0000 7f425cc00640 1 --2- 172.21.15.17:0/3707103255 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f42580b25b0 0x7f4258142630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:55.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.968+0000 7f425cc00640 1 -- 172.21.15.17:0/3707103255 >> 172.21.15.17:0/3707103255 conn(0x7f4258069ce0 msgr2=0x7f425813f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:55.963 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.968+0000 7f425cc00640 1 -- 172.21.15.17:0/3707103255 shutdown_connections 2024-03-12T17:19:55.964 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:55.968+0000 7f425cc00640 1 -- 172.21.15.17:0/3707103255 wait complete. 2024-03-12T17:19:55.981 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T17:19:56.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.209+0000 7f38a5c00640 1 Processor -- start 2024-03-12T17:19:56.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.209+0000 7f38a5c00640 1 -- start start 2024-03-12T17:19:56.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.211+0000 7f38a5c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f38a00cc080 0x7f38a00b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:56.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.211+0000 7f38a5c00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38a00ce320 con 0x7f38a00b2070 2024-03-12T17:19:56.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.211+0000 7f38a5c00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38a0144620 con 0x7f38a0144240 2024-03-12T17:19:56.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.211+0000 7f38a5c00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a015f3d0 con 0x7f38a00cc080 2024-03-12T17:19:56.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.211+0000 7f3896000640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f38a00b2070 0x7f38a00cb970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:50898/0 (socket says 172.21.15.17:50898) 2024-03-12T17:19:56.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.211+0000 7f3896000640 1 -- 172.21.15.17:0/571286965 learned_addr learned my addr 172.21.15.17:0/571286965 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:56.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.212+0000 7f389f400640 1 --2- 172.21.15.17:0/571286965 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f38a00cc080 0x7f38a00b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:56.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.212+0000 7f389e000640 1 -- 172.21.15.17:0/571286965 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2643104755 0 0) 0x7f38a00ce320 con 0x7f38a00b2070 2024-03-12T17:19:56.206 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.212+0000 7f389e000640 1 -- 172.21.15.17:0/571286965 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3884003520 con 0x7f38a00b2070 2024-03-12T17:19:56.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.212+0000 7f389e000640 1 -- 172.21.15.17:0/571286965 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4073502129 0 0) 0x7f3884003520 con 0x7f38a00b2070 2024-03-12T17:19:56.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.212+0000 7f389e000640 1 -- 172.21.15.17:0/571286965 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f38a00cc080 msgr2=0x7f38a00b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:56.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.212+0000 7f389e000640 1 --2- 172.21.15.17:0/571286965 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f38a00cc080 0x7f38a00b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:56.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.212+0000 7f389e000640 1 -- 172.21.15.17:0/571286965 >> v1:172.21.15.94:6789/0 conn(0x7f38a0144240 legacy=0x7f38a00ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:56.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.212+0000 7f389e000640 1 -- 172.21.15.17:0/571286965 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a00cd9f0 con 0x7f38a00b2070 2024-03-12T17:19:56.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.212+0000 7f389e000640 1 -- 172.21.15.17:0/571286965 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7f3888001670 con 0x7f38a00b2070 2024-03-12T17:19:56.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.212+0000 7f389e000640 1 -- 172.21.15.17:0/571286965 >> v1:172.21.15.17:6789/0 conn(0x7f38a00b2070 legacy=0x7f38a00cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:56.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.212+0000 7f389e000640 1 --2- 172.21.15.17:0/571286965 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f38840039a0 0x7f3884003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:56.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.212+0000 7f389e000640 1 --2- 172.21.15.17:0/571286965 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f38a00cc080 0x7f38840047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:56.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.212+0000 7f389e000640 1 --2- 172.21.15.17:0/571286965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3884004d00 0x7f3884005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:56.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.212+0000 7f389e000640 1 -- 172.21.15.17:0/571286965 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a015f3d0 con 0x7f3884004d00 2024-03-12T17:19:56.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.212+0000 7f389e000640 1 -- 172.21.15.17:0/571286965 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f388400b9b0 con 0x7f38840039a0 2024-03-12T17:19:56.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.212+0000 7f389e000640 1 -- 172.21.15.17:0/571286965 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f388400bb70 con 0x7f38a00cc080 2024-03-12T17:19:56.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.213+0000 7f389f400640 1 --2- 172.21.15.17:0/571286965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3884004d00 0x7f3884005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:56.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.213+0000 7f3896000640 1 --2- 172.21.15.17:0/571286965 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f38a00cc080 0x7f38840047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:56.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.213+0000 7f389ea00640 1 --2- 172.21.15.17:0/571286965 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f38840039a0 0x7f3884003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:56.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.213+0000 7f389f400640 1 -- 172.21.15.17:0/571286965 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f38a00cc080 msgr2=0x7f38840047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:56.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.213+0000 7f389f400640 1 --2- 172.21.15.17:0/571286965 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f38a00cc080 0x7f38840047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:56.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.213+0000 7f389f400640 1 -- 172.21.15.17:0/571286965 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f38840039a0 msgr2=0x7f3884003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:56.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.213+0000 7f389f400640 1 --2- 172.21.15.17:0/571286965 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f38840039a0 0x7f3884003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:56.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.213+0000 7f389f400640 1 -- 172.21.15.17:0/571286965 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3884003520 con 0x7f3884004d00 2024-03-12T17:19:56.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.213+0000 7f389ea00640 1 --2- 172.21.15.17:0/571286965 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f38840039a0 0x7f3884003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:19:56.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.215+0000 7f389f400640 1 --2- 172.21.15.17:0/571286965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3884004d00 0x7f3884005180 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3898009a90 tx=0x7f38840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15083d7fcbda9e3a server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:56.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.215+0000 7f389e000640 1 -- 172.21.15.17:0/571286965 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389802c680 con 0x7f3884004d00 2024-03-12T17:19:56.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.215+0000 7f389e000640 1 -- 172.21.15.17:0/571286965 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f389802c7e0 con 0x7f3884004d00 2024-03-12T17:19:56.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.215+0000 7f389e000640 1 -- 172.21.15.17:0/571286965 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389802cb70 con 0x7f3884004d00 2024-03-12T17:19:56.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.215+0000 7f38a5c00640 1 -- 172.21.15.17:0/571286965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3884004d00 msgr2=0x7f3884005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:56.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.215+0000 7f38a5c00640 1 --2- 172.21.15.17:0/571286965 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3884004d00 0x7f3884005180 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f3898009a90 tx=0x7f38840057f0 comp rx=0 tx=0).stop 2024-03-12T17:19:56.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.215+0000 7f389f400640 1 -- 172.21.15.17:0/571286965 reap_dead start 2024-03-12T17:19:56.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.216+0000 7f38a5c00640 1 -- 172.21.15.17:0/571286965 shutdown_connections 2024-03-12T17:19:56.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.216+0000 7f38a5c00640 1 -- 172.21.15.17:0/571286965 >> 172.21.15.17:0/571286965 conn(0x7f38a0069ce0 msgr2=0x7f38a006a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:56.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.216+0000 7f38a5c00640 1 -- 172.21.15.17:0/571286965 shutdown_connections 2024-03-12T17:19:56.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.216+0000 7f38a5c00640 1 -- 172.21.15.17:0/571286965 wait complete. 2024-03-12T17:19:56.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.217+0000 7f38a5c00640 1 Processor -- start 2024-03-12T17:19:56.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.218+0000 7f38a5c00640 1 -- start start 2024-03-12T17:19:56.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.218+0000 7f38a5c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3884004d00 0x7f38a015a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:56.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.218+0000 7f38a5c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f38a01f3240 0x7f38a015e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:56.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.218+0000 7f38a5c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38a015e970 0x7f38a013c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:56.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.218+0000 7f38a5c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a015edf0 con 0x7f38a015e970 2024-03-12T17:19:56.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.218+0000 7f38a5c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a013d4b0 con 0x7f3884004d00 2024-03-12T17:19:56.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.219+0000 7f38a5c00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38a015c230 con 0x7f38a01f3240 2024-03-12T17:19:56.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.219+0000 7f389f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38a015e970 0x7f38a013c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:56.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.219+0000 7f389f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38a015e970 0x7f38a013c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50598/0 (socket says 172.21.15.17:50598) 2024-03-12T17:19:56.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.219+0000 7f389f400640 1 -- 172.21.15.17:0/1452070817 learned_addr learned my addr 172.21.15.17:0/1452070817 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:56.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.219+0000 7f389f400640 1 -- 172.21.15.17:0/1452070817 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f38a01f3240 msgr2=0x7f38a015e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:56.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.219+0000 7f3896000640 1 --2- 172.21.15.17:0/1452070817 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f38a01f3240 0x7f38a015e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:56.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.219+0000 7f389ea00640 1 --2- 172.21.15.17:0/1452070817 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3884004d00 0x7f38a015a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:56.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.219+0000 7f389f400640 1 --2- 172.21.15.17:0/1452070817 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f38a01f3240 0x7f38a015e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:56.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.219+0000 7f389f400640 1 -- 172.21.15.17:0/1452070817 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3884004d00 msgr2=0x7f38a015a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:56.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.219+0000 7f389f400640 1 --2- 172.21.15.17:0/1452070817 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3884004d00 0x7f38a015a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:56.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.219+0000 7f389f400640 1 -- 172.21.15.17:0/1452070817 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a015c510 con 0x7f38a015e970 2024-03-12T17:19:56.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.219+0000 7f389ea00640 1 --2- 172.21.15.17:0/1452070817 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3884004d00 0x7f38a015a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:56.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.220+0000 7f389f400640 1 --2- 172.21.15.17:0/1452070817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38a015e970 0x7f38a013c710 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3898037040 tx=0x7f3898004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:56.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.220+0000 7f3897400640 1 -- 172.21.15.17:0/1452070817 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38980044c0 con 0x7f38a015e970 2024-03-12T17:19:56.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.220+0000 7f3897400640 1 -- 172.21.15.17:0/1452070817 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3898003610 con 0x7f38a015e970 2024-03-12T17:19:56.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.220+0000 7f3897400640 1 -- 172.21.15.17:0/1452070817 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38980039c0 con 0x7f38a015e970 2024-03-12T17:19:56.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.220+0000 7f38a5c00640 1 -- 172.21.15.17:0/1452070817 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38a015c7f0 con 0x7f38a015e970 2024-03-12T17:19:56.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.220+0000 7f38a5c00640 1 -- 172.21.15.17:0/1452070817 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a013ce30 con 0x7f38a015e970 2024-03-12T17:19:56.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.221+0000 7f38a5c00640 1 -- 172.21.15.17:0/1452070817 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38a015c090 con 0x7f38a015e970 2024-03-12T17:19:56.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.222+0000 7f3897400640 1 -- 172.21.15.17:0/1452070817 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f3898003b20 con 0x7f38a015e970 2024-03-12T17:19:56.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.223+0000 7f3897400640 1 --2- 172.21.15.17:0/1452070817 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f387c06ac00 0x7f387c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:56.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.223+0000 7f3897400640 1 -- 172.21.15.17:0/1452070817 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3898000e40 con 0x7f38a015e970 2024-03-12T17:19:56.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.223+0000 7f389ea00640 1 --2- 172.21.15.17:0/1452070817 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f387c06ac00 0x7f387c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:56.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.224+0000 7f389ea00640 1 --2- 172.21.15.17:0/1452070817 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f387c06ac00 0x7f387c06d0c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3890001eb0 tx=0x7f3890009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:56.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.228+0000 7f3897400640 1 -- 172.21.15.17:0/1452070817 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f38a015c090 con 0x7f38a015e970 2024-03-12T17:19:56.430 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.435+0000 7f38a5c00640 1 -- 172.21.15.17:0/1452070817 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38a015c090 con 0x7f38a015e970 2024-03-12T17:19:56.431 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.437+0000 7f3897400640 1 -- 172.21.15.17:0/1452070817 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16066 (secure 0 0 0) 0x7f38a015c090 con 0x7f38a015e970 2024-03-12T17:19:56.432 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:19:56.432 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":34,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:19:55.521757+0000","last_up_change":"2024-03-12T17:18:38.144756+0000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-12T17:18:39.552910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-12T17:19:53.519967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-12T17:19:54.546388+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":37305},{"type":"v1","addr":"172.21.15.17:6801","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":37305},{"type":"v1","addr":"172.21.15.17:6803","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":37305},{"type":"v1","addr":"172.21.15.17:6807","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":37305},{"type":"v1","addr":"172.21.15.17:6805","nonce":37305}]},"public_addr":"172.21.15.17:6801/37305","cluster_addr":"172.21.15.17:6803/37305","heartbeat_back_addr":"172.21.15.17:6807/37305","heartbeat_front_addr":"172.21.15.17:6805/37305","state":["exists","up"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":37307},{"type":"v1","addr":"172.21.15.17:6814","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":37307},{"type":"v1","addr":"172.21.15.17:6818","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":37307},{"type":"v1","addr":"172.21.15.17:6827","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":37307},{"type":"v1","addr":"172.21.15.17:6823","nonce":37307}]},"public_addr":"172.21.15.17:6814/37307","cluster_addr":"172.21.15.17:6818/37307","heartbeat_back_addr":"172.21.15.17:6827/37307","heartbeat_front_addr":"172.21.15.17:6823/37307","state":["exists","up"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":37303},{"type":"v1","addr":"172.21.15.17:6809","nonce":37303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":37303},{"type":"v1","addr":"172.21.15.17:6811","nonce":37303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":37303},{"type":"v1","addr":"172.21.15.17:6819","nonce":37303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":37303},{"type":"v1","addr":"172.21.15.17:6815","nonce":37303}]},"public_addr":"172.21.15.17:6809/37303","cluster_addr":"172.21.15.17:6811/37303","heartbeat_back_addr":"172.21.15.17:6819/37303","heartbeat_front_addr":"172.21.15.17:6815/37303","state":["exists","up"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":37308},{"type":"v1","addr":"172.21.15.17:6822","nonce":37308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":37308},{"type":"v1","addr":"172.21.15.17:6826","nonce":37308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":37308},{"type":"v1","addr":"172.21.15.17:6831","nonce":37308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":37308},{"type":"v1","addr":"172.21.15.17:6829","nonce":37308}]},"public_addr":"172.21.15.17:6822/37308","cluster_addr":"172.21.15.17:6826/37308","heartbeat_back_addr":"172.21.15.17:6831/37308","heartbeat_front_addr":"172.21.15.17:6829/37308","state":["exists","up"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":37465},{"type":"v1","addr":"172.21.15.94:6809","nonce":37465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6811","nonce":37465},{"type":"v1","addr":"172.21.15.94:6813","nonce":37465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6819","nonce":37465},{"type":"v1","addr":"172.21.15.94:6822","nonce":37465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6815","nonce":37465},{"type":"v1","addr":"172.21.15.94:6817","nonce":37465}]},"public_addr":"172.21.15.94:6809/37465","cluster_addr":"172.21.15.94:6813/37465","heartbeat_back_addr":"172.21.15.94:6822/37465","heartbeat_front_addr":"172.21.15.94:6817/37465","state":["exists","up"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":37464},{"type":"v1","addr":"172.21.15.94:6812","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":37464},{"type":"v1","addr":"172.21.15.94:6816","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":37464},{"type":"v1","addr":"172.21.15.94:6823","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":37464},{"type":"v1","addr":"172.21.15.94:6820","nonce":37464}]},"public_addr":"172.21.15.94:6812/37464","cluster_addr":"172.21.15.94:6816/37464","heartbeat_back_addr":"172.21.15.94:6823/37464","heartbeat_front_addr":"172.21.15.94:6820/37464","state":["exists","up"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":37467},{"type":"v1","addr":"172.21.15.94:6825","nonce":37467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":37467},{"type":"v1","addr":"172.21.15.94:6827","nonce":37467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":37467},{"type":"v1","addr":"172.21.15.94:6831","nonce":37467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":37467},{"type":"v1","addr":"172.21.15.94:6829","nonce":37467}]},"public_addr":"172.21.15.94:6825/37467","cluster_addr":"172.21.15.94:6827/37467","heartbeat_back_addr":"172.21.15.94:6831/37467","heartbeat_front_addr":"172.21.15.94:6829/37467","state":["exists","up"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":37466},{"type":"v1","addr":"172.21.15.94:6801","nonce":37466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":37466},{"type":"v1","addr":"172.21.15.94:6803","nonce":37466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":37466},{"type":"v1","addr":"172.21.15.94:6807","nonce":37466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":37466},{"type":"v1","addr":"172.21.15.94:6805","nonce":37466}]},"public_addr":"172.21.15.94:6801/37466","cluster_addr":"172.21.15.94:6803/37466","heartbeat_back_addr":"172.21.15.94:6807/37466","heartbeat_front_addr":"172.21.15.94:6805/37466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.327217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.186966+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.419986+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.150585+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.120621+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.121576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.181257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.293188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:19:56.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.440+0000 7f38a5c00640 1 -- 172.21.15.17:0/1452070817 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f387c06ac00 msgr2=0x7f387c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:56.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.440+0000 7f38a5c00640 1 --2- 172.21.15.17:0/1452070817 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f387c06ac00 0x7f387c06d0c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3890001eb0 tx=0x7f3890009040 comp rx=0 tx=0).stop 2024-03-12T17:19:56.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.440+0000 7f38a5c00640 1 -- 172.21.15.17:0/1452070817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38a015e970 msgr2=0x7f38a013c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:56.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.440+0000 7f38a5c00640 1 --2- 172.21.15.17:0/1452070817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38a015e970 0x7f38a013c710 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3898037040 tx=0x7f3898004730 comp rx=0 tx=0).stop 2024-03-12T17:19:56.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.440+0000 7f38a5c00640 1 -- 172.21.15.17:0/1452070817 shutdown_connections 2024-03-12T17:19:56.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.440+0000 7f38a5c00640 1 --2- 172.21.15.17:0/1452070817 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f387c06ac00 0x7f387c06d0c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:56.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.440+0000 7f38a5c00640 1 --2- 172.21.15.17:0/1452070817 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38a015e970 0x7f38a013c710 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:56.435 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.440+0000 7f38a5c00640 1 --2- 172.21.15.17:0/1452070817 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f38a01f3240 0x7f38a015e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:56.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.440+0000 7f38a5c00640 1 --2- 172.21.15.17:0/1452070817 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3884004d00 0x7f38a015a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:56.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.440+0000 7f38a5c00640 1 -- 172.21.15.17:0/1452070817 >> 172.21.15.17:0/1452070817 conn(0x7f38a0069ce0 msgr2=0x7f38a01427c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:56.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.440+0000 7f38a5c00640 1 -- 172.21.15.17:0/1452070817 shutdown_connections 2024-03-12T17:19:56.436 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.440+0000 7f38a5c00640 1 -- 172.21.15.17:0/1452070817 wait complete. 2024-03-12T17:19:56.455 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-12T17:19:56.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.685+0000 7fcc70800640 1 Processor -- start 2024-03-12T17:19:56.680 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.686+0000 7fcc70800640 1 -- start start 2024-03-12T17:19:56.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.687+0000 7fcc70800640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcc680b5b50 0x7fcc680b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:56.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.687+0000 7fcc70800640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc680d14e0 con 0x7fcc680d2fa0 2024-03-12T17:19:56.681 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.687+0000 7fcc70800640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc680b85b0 con 0x7fcc680cd840 2024-03-12T17:19:56.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.687+0000 7fcc70800640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc680b59e0 con 0x7fcc680b5b50 2024-03-12T17:19:56.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.687+0000 7fcc6de00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fcc680d2fa0 0x7fcc680d3380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:50912/0 (socket says 172.21.15.17:50912) 2024-03-12T17:19:56.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.687+0000 7fcc6de00640 1 -- 172.21.15.17:0/1082156259 learned_addr learned my addr 172.21.15.17:0/1082156259 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:19:56.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.688+0000 7fcc6d400640 1 --2- 172.21.15.17:0/1082156259 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcc680b5b50 0x7fcc680b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:56.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.688+0000 7fcc6ca00640 1 -- 172.21.15.17:0/1082156259 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1644721649 0 0) 0x7fcc680d14e0 con 0x7fcc680d2fa0 2024-03-12T17:19:56.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.688+0000 7fcc6ca00640 1 -- 172.21.15.17:0/1082156259 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc54003520 con 0x7fcc680d2fa0 2024-03-12T17:19:56.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.688+0000 7fcc6ca00640 1 -- 172.21.15.17:0/1082156259 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 469460731 0 0) 0x7fcc54003520 con 0x7fcc680d2fa0 2024-03-12T17:19:56.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.688+0000 7fcc6ca00640 1 -- 172.21.15.17:0/1082156259 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcc680b5b50 msgr2=0x7fcc680b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:56.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.688+0000 7fcc6ca00640 1 --2- 172.21.15.17:0/1082156259 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcc680b5b50 0x7fcc680b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:56.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.688+0000 7fcc6ca00640 1 -- 172.21.15.17:0/1082156259 >> v1:172.21.15.94:6789/0 conn(0x7fcc680cd840 legacy=0x7fcc680d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:56.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.688+0000 7fcc6ca00640 1 -- 172.21.15.17:0/1082156259 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc680b8890 con 0x7fcc680d2fa0 2024-03-12T17:19:56.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.688+0000 7fcc6ca00640 1 -- 172.21.15.17:0/1082156259 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7fcc600019f0 con 0x7fcc680d2fa0 2024-03-12T17:19:56.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.688+0000 7fcc6ca00640 1 -- 172.21.15.17:0/1082156259 >> v1:172.21.15.17:6789/0 conn(0x7fcc680d2fa0 legacy=0x7fcc680d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:56.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.688+0000 7fcc6ca00640 1 --2- 172.21.15.17:0/1082156259 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcc680b5b50 0x7fcc540039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:56.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.688+0000 7fcc6ca00640 1 --2- 172.21.15.17:0/1082156259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc54003ee0 0x7fcc540047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:56.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.689+0000 7fcc6ca00640 1 --2- 172.21.15.17:0/1082156259 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc54004d00 0x7fcc54005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:56.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.689+0000 7fcc6ca00640 1 -- 172.21.15.17:0/1082156259 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5400ba30 con 0x7fcc54003ee0 2024-03-12T17:19:56.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.689+0000 7fcc6ca00640 1 -- 172.21.15.17:0/1082156259 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5400bb70 con 0x7fcc54004d00 2024-03-12T17:19:56.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.689+0000 7fcc6ca00640 1 -- 172.21.15.17:0/1082156259 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5400bd30 con 0x7fcc680b5b50 2024-03-12T17:19:56.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.689+0000 7fcc6d400640 1 --2- 172.21.15.17:0/1082156259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc54003ee0 0x7fcc540047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:56.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.689+0000 7fcc6de00640 1 --2- 172.21.15.17:0/1082156259 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcc680b5b50 0x7fcc540039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:56.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.689+0000 7fcc6e800640 1 --2- 172.21.15.17:0/1082156259 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc54004d00 0x7fcc54005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:56.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.689+0000 7fcc6d400640 1 -- 172.21.15.17:0/1082156259 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcc680b5b50 msgr2=0x7fcc540039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:56.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.689+0000 7fcc6d400640 1 --2- 172.21.15.17:0/1082156259 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcc680b5b50 0x7fcc540039a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:56.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.689+0000 7fcc6d400640 1 -- 172.21.15.17:0/1082156259 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc54004d00 msgr2=0x7fcc54005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:56.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.689+0000 7fcc6d400640 1 --2- 172.21.15.17:0/1082156259 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc54004d00 0x7fcc54005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:56.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.689+0000 7fcc6d400640 1 -- 172.21.15.17:0/1082156259 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc54003520 con 0x7fcc54003ee0 2024-03-12T17:19:56.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.689+0000 7fcc6e800640 1 --2- 172.21.15.17:0/1082156259 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc54004d00 0x7fcc54005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:56.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.690+0000 7fcc6d400640 1 --2- 172.21.15.17:0/1082156259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc54003ee0 0x7fcc540047c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fcc58009ac0 tx=0x7fcc540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12f503b45bb8c4c6 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:56.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.691+0000 7fcc6ca00640 1 -- 172.21.15.17:0/1082156259 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5802c6b0 con 0x7fcc54003ee0 2024-03-12T17:19:56.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.691+0000 7fcc6ca00640 1 -- 172.21.15.17:0/1082156259 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc5802c810 con 0x7fcc54003ee0 2024-03-12T17:19:56.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.691+0000 7fcc6ca00640 1 -- 172.21.15.17:0/1082156259 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc5802cba0 con 0x7fcc54003ee0 2024-03-12T17:19:56.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.691+0000 7fcc70800640 1 -- 172.21.15.17:0/1082156259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc54003ee0 msgr2=0x7fcc540047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:56.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.691+0000 7fcc70800640 1 --2- 172.21.15.17:0/1082156259 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc54003ee0 0x7fcc540047c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fcc58009ac0 tx=0x7fcc540057f0 comp rx=0 tx=0).stop 2024-03-12T17:19:56.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.691+0000 7fcc6e800640 1 -- 172.21.15.17:0/1082156259 reap_dead start 2024-03-12T17:19:56.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.691+0000 7fcc70800640 1 -- 172.21.15.17:0/1082156259 shutdown_connections 2024-03-12T17:19:56.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.691+0000 7fcc70800640 1 -- 172.21.15.17:0/1082156259 >> 172.21.15.17:0/1082156259 conn(0x7fcc68065df0 msgr2=0x7fcc68066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:56.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.691+0000 7fcc70800640 1 -- 172.21.15.17:0/1082156259 shutdown_connections 2024-03-12T17:19:56.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.691+0000 7fcc70800640 1 -- 172.21.15.17:0/1082156259 wait complete. 2024-03-12T17:19:56.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.693+0000 7fcc70800640 1 Processor -- start 2024-03-12T17:19:56.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.693+0000 7fcc70800640 1 -- start start 2024-03-12T17:19:56.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.694+0000 7fcc70800640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcc54003ee0 0x7fcc680cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:56.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.694+0000 7fcc70800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc680c9ad0 0x7fcc681f1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:56.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.694+0000 7fcc70800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc681f1aa0 0x7fcc680cb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:56.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.694+0000 7fcc70800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6815dfa0 con 0x7fcc680c9ad0 2024-03-12T17:19:56.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.694+0000 7fcc70800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc680ca300 con 0x7fcc681f1aa0 2024-03-12T17:19:56.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.694+0000 7fcc70800640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc6815d970 con 0x7fcc54003ee0 2024-03-12T17:19:56.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.695+0000 7fcc6d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc680c9ad0 0x7fcc681f1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:56.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.695+0000 7fcc6d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc680c9ad0 0x7fcc681f1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50612/0 (socket says 172.21.15.17:50612) 2024-03-12T17:19:56.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.695+0000 7fcc6d400640 1 -- 172.21.15.17:0/1984699326 learned_addr learned my addr 172.21.15.17:0/1984699326 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:56.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.695+0000 7fcc6de00640 1 --2- 172.21.15.17:0/1984699326 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcc54003ee0 0x7fcc680cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:56.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.695+0000 7fcc6d400640 1 -- 172.21.15.17:0/1984699326 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcc54003ee0 msgr2=0x7fcc680cc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:56.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.695+0000 7fcc6d400640 1 --2- 172.21.15.17:0/1984699326 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcc54003ee0 0x7fcc680cc3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:56.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.695+0000 7fcc6e800640 1 --2- 172.21.15.17:0/1984699326 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc681f1aa0 0x7fcc680cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:56.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.695+0000 7fcc6d400640 1 -- 172.21.15.17:0/1984699326 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc681f1aa0 msgr2=0x7fcc680cb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:56.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.695+0000 7fcc6d400640 1 --2- 172.21.15.17:0/1984699326 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc681f1aa0 0x7fcc680cb740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:56.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.695+0000 7fcc6d400640 1 -- 172.21.15.17:0/1984699326 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc680ca020 con 0x7fcc680c9ad0 2024-03-12T17:19:56.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.695+0000 7fcc6d400640 1 --2- 172.21.15.17:0/1984699326 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc680c9ad0 0x7fcc681f1560 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fcc58037040 tx=0x7fcc58004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:56.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.696+0000 7fcc5e000640 1 -- 172.21.15.17:0/1984699326 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc58003810 con 0x7fcc680c9ad0 2024-03-12T17:19:56.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.696+0000 7fcc5e000640 1 -- 172.21.15.17:0/1984699326 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc58003970 con 0x7fcc680c9ad0 2024-03-12T17:19:56.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.696+0000 7fcc5e000640 1 -- 172.21.15.17:0/1984699326 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc58003d00 con 0x7fcc680c9ad0 2024-03-12T17:19:56.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.696+0000 7fcc70800640 1 -- 172.21.15.17:0/1984699326 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc6815dfa0 con 0x7fcc680c9ad0 2024-03-12T17:19:56.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.696+0000 7fcc70800640 1 -- 172.21.15.17:0/1984699326 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc681f1f20 con 0x7fcc680c9ad0 2024-03-12T17:19:56.692 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.697+0000 7fcc70800640 1 -- 172.21.15.17:0/1984699326 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc680736c0 con 0x7fcc680c9ad0 2024-03-12T17:19:56.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.698+0000 7fcc5e000640 1 -- 172.21.15.17:0/1984699326 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fcc58034440 con 0x7fcc680c9ad0 2024-03-12T17:19:56.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.699+0000 7fcc5e000640 1 --2- 172.21.15.17:0/1984699326 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fcc4c06ac00 0x7fcc4c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:56.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.699+0000 7fcc5e000640 1 -- 172.21.15.17:0/1984699326 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcc580ab660 con 0x7fcc680c9ad0 2024-03-12T17:19:56.693 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.699+0000 7fcc6de00640 1 --2- 172.21.15.17:0/1984699326 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fcc4c06ac00 0x7fcc4c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:56.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.700+0000 7fcc6de00640 1 --2- 172.21.15.17:0/1984699326 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fcc4c06ac00 0x7fcc4c06d0c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcc60001350 tx=0x7fcc60009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:56.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.704+0000 7fcc5e000640 1 -- 172.21.15.17:0/1984699326 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fcc580768e0 con 0x7fcc680c9ad0 2024-03-12T17:19:56.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:56.946+0000 7fcc70800640 1 -- 172.21.15.17:0/1984699326 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fcc680cf770 con 0x7fcc680c9ad0 2024-03-12T17:19:57.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.535+0000 7fcc5e000640 1 -- 172.21.15.17:0/1984699326 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) v1 ==== 118+0+0 (secure 0 0 0) 0x7fcc58003e60 con 0x7fcc680c9ad0 2024-03-12T17:19:57.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.538+0000 7fcc70800640 1 -- 172.21.15.17:0/1984699326 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fcc4c06ac00 msgr2=0x7fcc4c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:57.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.539+0000 7fcc70800640 1 --2- 172.21.15.17:0/1984699326 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fcc4c06ac00 0x7fcc4c06d0c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcc60001350 tx=0x7fcc60009040 comp rx=0 tx=0).stop 2024-03-12T17:19:57.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.539+0000 7fcc70800640 1 -- 172.21.15.17:0/1984699326 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc680c9ad0 msgr2=0x7fcc681f1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:57.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.539+0000 7fcc70800640 1 --2- 172.21.15.17:0/1984699326 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc680c9ad0 0x7fcc681f1560 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fcc58037040 tx=0x7fcc58004730 comp rx=0 tx=0).stop 2024-03-12T17:19:57.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.539+0000 7fcc70800640 1 -- 172.21.15.17:0/1984699326 shutdown_connections 2024-03-12T17:19:57.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.539+0000 7fcc70800640 1 --2- 172.21.15.17:0/1984699326 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fcc4c06ac00 0x7fcc4c06d0c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:57.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.539+0000 7fcc70800640 1 --2- 172.21.15.17:0/1984699326 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fcc681f1aa0 0x7fcc680cb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:57.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.539+0000 7fcc70800640 1 --2- 172.21.15.17:0/1984699326 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fcc680c9ad0 0x7fcc681f1560 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:57.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.539+0000 7fcc70800640 1 --2- 172.21.15.17:0/1984699326 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fcc54003ee0 0x7fcc680cc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:57.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.539+0000 7fcc70800640 1 -- 172.21.15.17:0/1984699326 >> 172.21.15.17:0/1984699326 conn(0x7fcc68065df0 msgr2=0x7fcc680cfc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:57.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.539+0000 7fcc70800640 1 -- 172.21.15.17:0/1984699326 shutdown_connections 2024-03-12T17:19:57.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.539+0000 7fcc70800640 1 -- 172.21.15.17:0/1984699326 wait complete. 2024-03-12T17:19:57.554 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-12T17:19:57.554 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-12T17:19:57.621 INFO:tasks.ceph.mds.c.smithi017.stderr:2024-03-12T17:19:57.627+0000 7f380b800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-12T17:19:57.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.771+0000 7f2136000640 1 Processor -- start 2024-03-12T17:19:57.765 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.771+0000 7f2136000640 1 -- start start 2024-03-12T17:19:57.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.773+0000 7f2136000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f21300d2fa0 0x7f21300d3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:57.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.773+0000 7f2136000640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f21300b5f70 0x7f21300d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:57.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.773+0000 7f2136000640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21300d14e0 con 0x7f21300b5b50 2024-03-12T17:19:57.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.773+0000 7f2136000640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21300b59e0 con 0x7f21300d2fa0 2024-03-12T17:19:57.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.773+0000 7f2136000640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21300d38c0 con 0x7f21300b5f70 2024-03-12T17:19:57.767 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.773+0000 7f212f400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f21300d2fa0 0x7f21300d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:57.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.773+0000 7f212f400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f21300d2fa0 0x7f21300d3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50628/0 (socket says 172.21.15.17:50628) 2024-03-12T17:19:57.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.773+0000 7f212f400640 1 -- 172.21.15.17:0/2243421154 learned_addr learned my addr 172.21.15.17:0/2243421154 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:57.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.773+0000 7f212fe00640 1 --2- 172.21.15.17:0/2243421154 >> v2:172.21.15.94:3300/0 conn(0x7f21300b5f70 0x7f21300d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:57.768 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.774+0000 7f212f400640 1 -- 172.21.15.17:0/2243421154 >> v2:172.21.15.94:3300/0 conn(0x7f21300b5f70 msgr2=0x7f21300d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:57.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.774+0000 7f212f400640 1 --2- 172.21.15.17:0/2243421154 >> v2:172.21.15.94:3300/0 conn(0x7f21300b5f70 0x7f21300d1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:57.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.774+0000 7f212f400640 1 -- 172.21.15.17:0/2243421154 >> v1:172.21.15.94:6789/0 conn(0x7f21300b5b50 legacy=0x7f21300cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:57.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.774+0000 7f212f400640 1 -- 172.21.15.17:0/2243421154 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21300b85b0 con 0x7f21300d2fa0 2024-03-12T17:19:57.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.774+0000 7f212fe00640 1 --2- 172.21.15.17:0/2243421154 >> v2:172.21.15.94:3300/0 conn(0x7f21300b5f70 0x7f21300d1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:57.769 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.775+0000 7f212f400640 1 --2- 172.21.15.17:0/2243421154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21300d2fa0 0x7f21300d3380 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f21300cd480 tx=0x7f212002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27e87f0d02390cfe server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:57.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.775+0000 7f212e000640 1 -- 172.21.15.17:0/2243421154 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2120031870 con 0x7f21300d2fa0 2024-03-12T17:19:57.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.775+0000 7f212e000640 1 -- 172.21.15.17:0/2243421154 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21200319d0 con 0x7f21300d2fa0 2024-03-12T17:19:57.770 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.775+0000 7f212e000640 1 -- 172.21.15.17:0/2243421154 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2120031d60 con 0x7f21300d2fa0 2024-03-12T17:19:57.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.776+0000 7f2136000640 1 -- 172.21.15.17:0/2243421154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21300d2fa0 msgr2=0x7f21300d3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:57.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.776+0000 7f2136000640 1 --2- 172.21.15.17:0/2243421154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21300d2fa0 0x7f21300d3380 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f21300cd480 tx=0x7f212002b910 comp rx=0 tx=0).stop 2024-03-12T17:19:57.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.776+0000 7f2136000640 1 -- 172.21.15.17:0/2243421154 shutdown_connections 2024-03-12T17:19:57.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.776+0000 7f2136000640 1 --2- 172.21.15.17:0/2243421154 >> v2:172.21.15.94:3300/0 conn(0x7f21300b5f70 0x7f21300d1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:57.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.776+0000 7f2136000640 1 --2- 172.21.15.17:0/2243421154 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21300d2fa0 0x7f21300d3380 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:57.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.776+0000 7f2136000640 1 -- 172.21.15.17:0/2243421154 >> 172.21.15.17:0/2243421154 conn(0x7f2130065df0 msgr2=0x7f2130066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:57.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.776+0000 7f2136000640 1 -- 172.21.15.17:0/2243421154 shutdown_connections 2024-03-12T17:19:57.771 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.776+0000 7f2136000640 1 -- 172.21.15.17:0/2243421154 wait complete. 2024-03-12T17:19:57.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.778+0000 7f2136000640 1 Processor -- start 2024-03-12T17:19:57.772 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.778+0000 7f2136000640 1 -- start start 2024-03-12T17:19:57.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.779+0000 7f2136000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f21300b5b50 0x7f21301f5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:57.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.779+0000 7f2136000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21300b5f70 0x7f21301f4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:57.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.779+0000 7f2136000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f21300d2fa0 0x7f21301f54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:57.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.779+0000 7f2136000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21301f5a10 con 0x7f21300b5f70 2024-03-12T17:19:57.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.779+0000 7f2136000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213014bad0 con 0x7f21300d2fa0 2024-03-12T17:19:57.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.779+0000 7f2136000640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f213014bd70 con 0x7f21300b5b50 2024-03-12T17:19:57.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.779+0000 7f212ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21300b5f70 0x7f21301f4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:57.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.779+0000 7f212ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21300b5f70 0x7f21301f4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50634/0 (socket says 172.21.15.17:50634) 2024-03-12T17:19:57.774 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.779+0000 7f212ea00640 1 -- 172.21.15.17:0/1332529267 learned_addr learned my addr 172.21.15.17:0/1332529267 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:57.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.780+0000 7f212fe00640 1 --2- 172.21.15.17:0/1332529267 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f21300d2fa0 0x7f21301f54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:57.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.780+0000 7f212f400640 1 --2- 172.21.15.17:0/1332529267 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f21300b5b50 0x7f21301f5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:57.775 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.780+0000 7f212ea00640 1 -- 172.21.15.17:0/1332529267 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f21300b5b50 msgr2=0x7f21301f5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:57.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.780+0000 7f212ea00640 1 --2- 172.21.15.17:0/1332529267 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f21300b5b50 0x7f21301f5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:57.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.780+0000 7f212ea00640 1 -- 172.21.15.17:0/1332529267 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f21300d2fa0 msgr2=0x7f21301f54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:57.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.780+0000 7f212ea00640 1 --2- 172.21.15.17:0/1332529267 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f21300d2fa0 0x7f21301f54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:57.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.780+0000 7f212ea00640 1 -- 172.21.15.17:0/1332529267 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21200094d0 con 0x7f21300b5f70 2024-03-12T17:19:57.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.780+0000 7f212fe00640 1 --2- 172.21.15.17:0/1332529267 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f21300d2fa0 0x7f21301f54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:57.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.780+0000 7f212ea00640 1 --2- 172.21.15.17:0/1332529267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21300b5f70 0x7f21301f4f90 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f211800b3f0 tx=0x7f211800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:57.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.780+0000 7f2127400640 1 -- 172.21.15.17:0/1332529267 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2118011830 con 0x7f21300b5f70 2024-03-12T17:19:57.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.780+0000 7f2127400640 1 -- 172.21.15.17:0/1332529267 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2118011990 con 0x7f21300b5f70 2024-03-12T17:19:57.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.780+0000 7f2127400640 1 -- 172.21.15.17:0/1332529267 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2118011d40 con 0x7f21300b5f70 2024-03-12T17:19:57.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.780+0000 7f2136000640 1 -- 172.21.15.17:0/1332529267 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f213014c050 con 0x7f21300b5f70 2024-03-12T17:19:57.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.781+0000 7f2136000640 1 -- 172.21.15.17:0/1332529267 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f213014c610 con 0x7f21300b5f70 2024-03-12T17:19:57.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.782+0000 7f2136000640 1 -- 172.21.15.17:0/1332529267 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21300736c0 con 0x7f21300b5f70 2024-03-12T17:19:57.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.782+0000 7f2127400640 1 -- 172.21.15.17:0/1332529267 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f211801a400 con 0x7f21300b5f70 2024-03-12T17:19:57.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.783+0000 7f2127400640 1 --2- 172.21.15.17:0/1332529267 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f210c06ac30 0x7f210c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:57.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.783+0000 7f2127400640 1 -- 172.21.15.17:0/1332529267 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2118089070 con 0x7f21300b5f70 2024-03-12T17:19:57.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.784+0000 7f212f400640 1 --2- 172.21.15.17:0/1332529267 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f210c06ac30 0x7f210c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:57.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.785+0000 7f212f400640 1 --2- 172.21.15.17:0/1332529267 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f210c06ac30 0x7f210c06d0f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2120036000 tx=0x7f212003c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:57.782 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:57.788+0000 7f2127400640 1 -- 172.21.15.17:0/1332529267 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f2118054390 con 0x7f21300b5f70 2024-03-12T17:19:58.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.024+0000 7f2136000640 1 -- 172.21.15.17:0/1332529267 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f21300b7f20 con 0x7f21300b5f70 2024-03-12T17:19:58.533 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.539+0000 7f2127400640 1 -- 172.21.15.17:0/1332529267 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f21180579b0 con 0x7f21300b5f70 2024-03-12T17:19:58.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.542+0000 7f2136000640 1 -- 172.21.15.17:0/1332529267 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f210c06ac30 msgr2=0x7f210c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:58.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.542+0000 7f2136000640 1 --2- 172.21.15.17:0/1332529267 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f210c06ac30 0x7f210c06d0f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2120036000 tx=0x7f212003c040 comp rx=0 tx=0).stop 2024-03-12T17:19:58.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.543+0000 7f2136000640 1 -- 172.21.15.17:0/1332529267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21300b5f70 msgr2=0x7f21301f4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:58.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.543+0000 7f2136000640 1 --2- 172.21.15.17:0/1332529267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21300b5f70 0x7f21301f4f90 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f211800b3f0 tx=0x7f211800b8b0 comp rx=0 tx=0).stop 2024-03-12T17:19:58.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.543+0000 7f2136000640 1 -- 172.21.15.17:0/1332529267 shutdown_connections 2024-03-12T17:19:58.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.543+0000 7f2136000640 1 --2- 172.21.15.17:0/1332529267 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f210c06ac30 0x7f210c06d0f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:58.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.543+0000 7f2136000640 1 --2- 172.21.15.17:0/1332529267 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f21300d2fa0 0x7f21301f54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:58.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.543+0000 7f2136000640 1 --2- 172.21.15.17:0/1332529267 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21300b5f70 0x7f21301f4f90 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:58.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.543+0000 7f2136000640 1 --2- 172.21.15.17:0/1332529267 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f21300b5b50 0x7f21301f5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:58.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.543+0000 7f2136000640 1 -- 172.21.15.17:0/1332529267 >> 172.21.15.17:0/1332529267 conn(0x7f2130065df0 msgr2=0x7f21300661d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:58.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.543+0000 7f2136000640 1 -- 172.21.15.17:0/1332529267 shutdown_connections 2024-03-12T17:19:58.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.543+0000 7f2136000640 1 -- 172.21.15.17:0/1332529267 wait complete. 2024-03-12T17:19:58.559 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-12T17:19:58.560 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-12T17:19:58.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.778+0000 7fbd4a200640 1 Processor -- start 2024-03-12T17:19:58.773 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.779+0000 7fbd4a200640 1 -- start start 2024-03-12T17:19:58.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.780+0000 7fbd4a200640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fbd440d2fa0 0x7fbd440d3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:58.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.780+0000 7fbd4a200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbd440b5b50 0x7fbd440b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:58.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.780+0000 7fbd4a200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbd440cd840 0x7fbd440cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:58.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.780+0000 7fbd4a200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd440b59e0 con 0x7fbd440b5b50 2024-03-12T17:19:58.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.780+0000 7fbd4a200640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd440d14e0 con 0x7fbd440d2fa0 2024-03-12T17:19:58.776 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.780+0000 7fbd4a200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd440d38c0 con 0x7fbd440cd840 2024-03-12T17:19:58.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.781+0000 7fbd3be00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbd440b5b50 0x7fbd440b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:58.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.781+0000 7fbd3be00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbd440b5b50 0x7fbd440b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50638/0 (socket says 172.21.15.17:50638) 2024-03-12T17:19:58.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.781+0000 7fbd3be00640 1 -- 172.21.15.17:0/1640487069 learned_addr learned my addr 172.21.15.17:0/1640487069 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:58.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.781+0000 7fbd43e00640 1 --2- 172.21.15.17:0/1640487069 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbd440cd840 0x7fbd440cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:58.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.781+0000 7fbd43400640 1 --2- 172.21.15.17:0/1640487069 >> v2:172.21.15.94:3300/0 conn(0x7fbd440d2fa0 0x7fbd440d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:58.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.781+0000 7fbd3be00640 1 -- 172.21.15.17:0/1640487069 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbd440cd840 msgr2=0x7fbd440cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:58.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.781+0000 7fbd3be00640 1 --2- 172.21.15.17:0/1640487069 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbd440cd840 0x7fbd440cdcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:58.777 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.781+0000 7fbd3be00640 1 -- 172.21.15.17:0/1640487069 >> v2:172.21.15.94:3300/0 conn(0x7fbd440d2fa0 msgr2=0x7fbd440d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:58.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.781+0000 7fbd3be00640 1 --2- 172.21.15.17:0/1640487069 >> v2:172.21.15.94:3300/0 conn(0x7fbd440d2fa0 0x7fbd440d3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:58.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.781+0000 7fbd3be00640 1 -- 172.21.15.17:0/1640487069 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd440b85b0 con 0x7fbd440b5b50 2024-03-12T17:19:58.778 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.781+0000 7fbd43400640 1 --2- 172.21.15.17:0/1640487069 >> v2:172.21.15.94:3300/0 conn(0x7fbd440d2fa0 0x7fbd440d3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:58.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.782+0000 7fbd3be00640 1 --2- 172.21.15.17:0/1640487069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd440b5b50 0x7fbd440b5f70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fbd440b4dc0 tx=0x7fbd2c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e35bf4bbc6e9734 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:58.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.783+0000 7fbd42a00640 1 -- 172.21.15.17:0/1640487069 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c031870 con 0x7fbd440b5b50 2024-03-12T17:19:58.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.783+0000 7fbd42a00640 1 -- 172.21.15.17:0/1640487069 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd2c0319d0 con 0x7fbd440b5b50 2024-03-12T17:19:58.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.783+0000 7fbd42a00640 1 -- 172.21.15.17:0/1640487069 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c031d60 con 0x7fbd440b5b50 2024-03-12T17:19:58.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.783+0000 7fbd4a200640 1 -- 172.21.15.17:0/1640487069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd440b5b50 msgr2=0x7fbd440b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:58.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.783+0000 7fbd4a200640 1 --2- 172.21.15.17:0/1640487069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd440b5b50 0x7fbd440b5f70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fbd440b4dc0 tx=0x7fbd2c02b910 comp rx=0 tx=0).stop 2024-03-12T17:19:58.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.783+0000 7fbd4a200640 1 -- 172.21.15.17:0/1640487069 shutdown_connections 2024-03-12T17:19:58.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.783+0000 7fbd4a200640 1 --2- 172.21.15.17:0/1640487069 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbd440cd840 0x7fbd440cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:58.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.783+0000 7fbd4a200640 1 --2- 172.21.15.17:0/1640487069 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd440b5b50 0x7fbd440b5f70 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:58.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.783+0000 7fbd4a200640 1 --2- 172.21.15.17:0/1640487069 >> v2:172.21.15.94:3300/0 conn(0x7fbd440d2fa0 0x7fbd440d3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:58.784 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.783+0000 7fbd4a200640 1 -- 172.21.15.17:0/1640487069 >> 172.21.15.17:0/1640487069 conn(0x7fbd44065df0 msgr2=0x7fbd44066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:58.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.783+0000 7fbd4a200640 1 -- 172.21.15.17:0/1640487069 shutdown_connections 2024-03-12T17:19:58.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.784+0000 7fbd4a200640 1 -- 172.21.15.17:0/1640487069 wait complete. 2024-03-12T17:19:58.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.785+0000 7fbd4a200640 1 Processor -- start 2024-03-12T17:19:58.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.785+0000 7fbd4a200640 1 -- start start 2024-03-12T17:19:58.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.786+0000 7fbd4a200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbd440b5b50 0x7fbd440cc540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:58.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.786+0000 7fbd4a200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd440cd840 0x7fbd4415f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:58.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.786+0000 7fbd4a200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd440d2fa0 0x7fbd441f33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:58.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.786+0000 7fbd4a200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd440cca80 con 0x7fbd440cd840 2024-03-12T17:19:58.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.786+0000 7fbd4a200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd441f2310 con 0x7fbd440d2fa0 2024-03-12T17:19:58.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.786+0000 7fbd4a200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd440cb020 con 0x7fbd440b5b50 2024-03-12T17:19:58.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.787+0000 7fbd3be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd440cd840 0x7fbd4415f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:58.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.787+0000 7fbd3be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd440cd840 0x7fbd4415f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50640/0 (socket says 172.21.15.17:50640) 2024-03-12T17:19:58.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.787+0000 7fbd3be00640 1 -- 172.21.15.17:0/1658882765 learned_addr learned my addr 172.21.15.17:0/1658882765 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:58.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.787+0000 7fbd43400640 1 --2- 172.21.15.17:0/1658882765 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbd440b5b50 0x7fbd440cc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:58.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.787+0000 7fbd43e00640 1 --2- 172.21.15.17:0/1658882765 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd440d2fa0 0x7fbd441f33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:58.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.787+0000 7fbd3be00640 1 -- 172.21.15.17:0/1658882765 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbd440b5b50 msgr2=0x7fbd440cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:58.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.787+0000 7fbd3be00640 1 --2- 172.21.15.17:0/1658882765 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbd440b5b50 0x7fbd440cc540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:58.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.787+0000 7fbd3be00640 1 -- 172.21.15.17:0/1658882765 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd440d2fa0 msgr2=0x7fbd441f33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:58.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.787+0000 7fbd3be00640 1 --2- 172.21.15.17:0/1658882765 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd440d2fa0 0x7fbd441f33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:58.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.787+0000 7fbd3be00640 1 -- 172.21.15.17:0/1658882765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2c0094d0 con 0x7fbd440cd840 2024-03-12T17:19:58.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.787+0000 7fbd43e00640 1 --2- 172.21.15.17:0/1658882765 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd440d2fa0 0x7fbd441f33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:19:58.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.788+0000 7fbd3be00640 1 --2- 172.21.15.17:0/1658882765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd440cd840 0x7fbd4415f190 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c0097c0 tx=0x7fbd2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:58.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.788+0000 7fbd3b400640 1 -- 172.21.15.17:0/1658882765 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c031820 con 0x7fbd440cd840 2024-03-12T17:19:58.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.788+0000 7fbd3b400640 1 -- 172.21.15.17:0/1658882765 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd2c0443f0 con 0x7fbd440cd840 2024-03-12T17:19:58.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.788+0000 7fbd4a200640 1 -- 172.21.15.17:0/1658882765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd440cb300 con 0x7fbd440cd840 2024-03-12T17:19:58.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.788+0000 7fbd3b400640 1 -- 172.21.15.17:0/1658882765 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c0447a0 con 0x7fbd440cd840 2024-03-12T17:19:58.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.788+0000 7fbd4a200640 1 -- 172.21.15.17:0/1658882765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd440cb8c0 con 0x7fbd440cd840 2024-03-12T17:19:58.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.789+0000 7fbd4a200640 1 -- 172.21.15.17:0/1658882765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd440736c0 con 0x7fbd440cd840 2024-03-12T17:19:58.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.790+0000 7fbd3b400640 1 -- 172.21.15.17:0/1658882765 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fbd2c04d450 con 0x7fbd440cd840 2024-03-12T17:19:58.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.791+0000 7fbd3b400640 1 --2- 172.21.15.17:0/1658882765 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fbd2006ac50 0x7fbd2006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:58.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.791+0000 7fbd3b400640 1 -- 172.21.15.17:0/1658882765 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbd2c02d040 con 0x7fbd440cd840 2024-03-12T17:19:58.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.792+0000 7fbd43400640 1 --2- 172.21.15.17:0/1658882765 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fbd2006ac50 0x7fbd2006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:58.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.792+0000 7fbd43400640 1 --2- 172.21.15.17:0/1658882765 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fbd2006ac50 0x7fbd2006d110 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbd440b51c0 tx=0x7fbd34008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:58.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:58.796+0000 7fbd3b400640 1 -- 172.21.15.17:0/1658882765 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fbd2c076c80 con 0x7fbd440cd840 2024-03-12T17:19:59.030 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.035+0000 7fbd4a200640 1 -- 172.21.15.17:0/1658882765 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd441601a0 con 0x7fbd440cd840 2024-03-12T17:19:59.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.036+0000 7fbd3b400640 1 -- 172.21.15.17:0/1658882765 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4728 (secure 0 0 0) 0x7fbd2c07a2a0 con 0x7fbd440cd840 2024-03-12T17:19:59.032 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:19:59.032 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6834/934570591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":934570591},{"type":"v1","addr":"172.21.15.94:6834","nonce":934570591}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/2007868406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6833","nonce":2007868406},{"type":"v1","addr":"172.21.15.94:6835","nonce":2007868406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4768,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6836/2733057827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2733057827},{"type":"v1","addr":"172.21.15.17:6836","nonce":2733057827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T17:19:55.522204+0000","modified":"2024-03-12T17:19:58.531800+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5058},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5058":{"gid":5058,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6837/672288094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6835","nonce":672288094},{"type":"v1","addr":"172.21.15.17:6837","nonce":672288094}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-03-12T17:19:59.032 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 14 2024-03-12T17:19:59.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.039+0000 7fbd4a200640 1 -- 172.21.15.17:0/1658882765 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fbd2006ac50 msgr2=0x7fbd2006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:59.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.039+0000 7fbd4a200640 1 --2- 172.21.15.17:0/1658882765 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fbd2006ac50 0x7fbd2006d110 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbd440b51c0 tx=0x7fbd34008040 comp rx=0 tx=0).stop 2024-03-12T17:19:59.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.039+0000 7fbd4a200640 1 -- 172.21.15.17:0/1658882765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd440cd840 msgr2=0x7fbd4415f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:59.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.039+0000 7fbd4a200640 1 --2- 172.21.15.17:0/1658882765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd440cd840 0x7fbd4415f190 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c0097c0 tx=0x7fbd2c0046c0 comp rx=0 tx=0).stop 2024-03-12T17:19:59.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.039+0000 7fbd4a200640 1 -- 172.21.15.17:0/1658882765 shutdown_connections 2024-03-12T17:19:59.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.039+0000 7fbd4a200640 1 --2- 172.21.15.17:0/1658882765 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fbd2006ac50 0x7fbd2006d110 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:59.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.039+0000 7fbd4a200640 1 --2- 172.21.15.17:0/1658882765 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd440d2fa0 0x7fbd441f33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:59.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.039+0000 7fbd4a200640 1 --2- 172.21.15.17:0/1658882765 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd440cd840 0x7fbd4415f190 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:59.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.039+0000 7fbd4a200640 1 --2- 172.21.15.17:0/1658882765 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbd440b5b50 0x7fbd440cc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:59.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.039+0000 7fbd4a200640 1 -- 172.21.15.17:0/1658882765 >> 172.21.15.17:0/1658882765 conn(0x7fbd44065df0 msgr2=0x7fbd440c8540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:59.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.039+0000 7fbd4a200640 1 -- 172.21.15.17:0/1658882765 shutdown_connections 2024-03-12T17:19:59.036 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.039+0000 7fbd4a200640 1 -- 172.21.15.17:0/1658882765 wait complete. 2024-03-12T17:19:59.051 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T17:19:59.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.262+0000 7fbdcf200640 1 Processor -- start 2024-03-12T17:19:59.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.262+0000 7fbdcf200640 1 -- start start 2024-03-12T17:19:59.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.264+0000 7fbdcf200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbdc80ced90 0x7fbdc80b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:59.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.264+0000 7fbdcf200640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fbdc806c3f0 0x7fbdc80b3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:59.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.264+0000 7fbdcf200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdc80cb340 con 0x7fbdc80b3780 2024-03-12T17:19:59.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.264+0000 7fbdcf200640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdc80b3c10 con 0x7fbdc806c3f0 2024-03-12T17:19:59.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.264+0000 7fbdcf200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc8159d50 con 0x7fbdc80ced90 2024-03-12T17:19:59.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.264+0000 7fbdc7e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbdc80ced90 0x7fbdc80b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:59.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.265+0000 7fbdc7e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbdc80ced90 0x7fbdc80b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.17:59524/0 (socket says 172.21.15.17:59524) 2024-03-12T17:19:59.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.265+0000 7fbdc7e00640 1 -- 172.21.15.17:0/3892660998 learned_addr learned my addr 172.21.15.17:0/3892660998 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:59.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.265+0000 7fbdcd200640 1 --1- 172.21.15.17:0/3892660998 >> v1:172.21.15.94:6789/0 conn(0x7fbdc80b3780 0x7fbdc815d440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.17:58040/0 (socket says 172.21.15.17:58040) 2024-03-12T17:19:59.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.265+0000 7fbdc7400640 1 --2- 172.21.15.17:0/3892660998 >> v2:172.21.15.94:3300/0 conn(0x7fbdc806c3f0 0x7fbdc80b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:59.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.265+0000 7fbdc7e00640 1 -- 172.21.15.17:0/3892660998 >> v2:172.21.15.94:3300/0 conn(0x7fbdc806c3f0 msgr2=0x7fbdc80b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:59.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.265+0000 7fbdc7e00640 1 --2- 172.21.15.17:0/3892660998 >> v2:172.21.15.94:3300/0 conn(0x7fbdc806c3f0 0x7fbdc80b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:59.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.265+0000 7fbdc7e00640 1 -- 172.21.15.17:0/3892660998 >> v1:172.21.15.94:6789/0 conn(0x7fbdc80b3780 legacy=0x7fbdc815d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:59.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.265+0000 7fbdc7e00640 1 -- 172.21.15.17:0/3892660998 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdc80b1c50 con 0x7fbdc80ced90 2024-03-12T17:19:59.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.265+0000 7fbdc6a00640 1 -- 172.21.15.17:0/3892660998 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 116071979 0 0) 0x7fbdc80cb340 con 0x7fbdc80b3780 2024-03-12T17:19:59.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.267+0000 7fbdc7e00640 1 --2- 172.21.15.17:0/3892660998 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbdc80ced90 0x7fbdc80b1710 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8009870 tx=0x7fbdb802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4951da1a1478f51 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:59.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.267+0000 7fbdc6a00640 1 -- 172.21.15.17:0/3892660998 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb8030840 con 0x7fbdc80ced90 2024-03-12T17:19:59.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.267+0000 7fbdc6a00640 1 -- 172.21.15.17:0/3892660998 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb80309a0 con 0x7fbdc80ced90 2024-03-12T17:19:59.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.268+0000 7fbdc6a00640 1 -- 172.21.15.17:0/3892660998 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb8030d30 con 0x7fbdc80ced90 2024-03-12T17:19:59.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.268+0000 7fbdcf200640 1 -- 172.21.15.17:0/3892660998 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbdc80ced90 msgr2=0x7fbdc80b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:59.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.268+0000 7fbdcf200640 1 --2- 172.21.15.17:0/3892660998 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbdc80ced90 0x7fbdc80b1710 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8009870 tx=0x7fbdb802b980 comp rx=0 tx=0).stop 2024-03-12T17:19:59.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.268+0000 7fbdcf200640 1 -- 172.21.15.17:0/3892660998 shutdown_connections 2024-03-12T17:19:59.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.268+0000 7fbdcf200640 1 --2- 172.21.15.17:0/3892660998 >> v2:172.21.15.94:3300/0 conn(0x7fbdc806c3f0 0x7fbdc80b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:59.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.268+0000 7fbdcf200640 1 --2- 172.21.15.17:0/3892660998 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbdc80ced90 0x7fbdc80b1710 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:59.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.268+0000 7fbdcf200640 1 -- 172.21.15.17:0/3892660998 >> 172.21.15.17:0/3892660998 conn(0x7fbdc8069ce0 msgr2=0x7fbdc806a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:59.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.268+0000 7fbdcf200640 1 -- 172.21.15.17:0/3892660998 shutdown_connections 2024-03-12T17:19:59.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.268+0000 7fbdcf200640 1 -- 172.21.15.17:0/3892660998 wait complete. 2024-03-12T17:19:59.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.270+0000 7fbdcf200640 1 Processor -- start 2024-03-12T17:19:59.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.270+0000 7fbdcf200640 1 -- start start 2024-03-12T17:19:59.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.271+0000 7fbdcf200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbdc806c3f0 0x7fbdc80ca130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:59.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.271+0000 7fbdcf200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbdc80b3780 0x7fbdc80ac920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:59.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.271+0000 7fbdcf200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbdc80ced90 0x7fbdc80ace60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:59.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.271+0000 7fbdcf200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc815a830 con 0x7fbdc80b3780 2024-03-12T17:19:59.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.271+0000 7fbdcf200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc8159f20 con 0x7fbdc806c3f0 2024-03-12T17:19:59.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.271+0000 7fbdcf200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdc81f31e0 con 0x7fbdc80ced90 2024-03-12T17:19:59.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.271+0000 7fbdc7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbdc80b3780 0x7fbdc80ac920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:59.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.271+0000 7fbdc7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbdc80b3780 0x7fbdc80ac920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50648/0 (socket says 172.21.15.17:50648) 2024-03-12T17:19:59.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.271+0000 7fbdc7400640 1 -- 172.21.15.17:0/3917911427 learned_addr learned my addr 172.21.15.17:0/3917911427 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:59.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.272+0000 7fbdc7e00640 1 --2- 172.21.15.17:0/3917911427 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbdc806c3f0 0x7fbdc80ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:59.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.272+0000 7fbdcd200640 1 --2- 172.21.15.17:0/3917911427 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbdc80ced90 0x7fbdc80ace60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:59.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.272+0000 7fbdc7400640 1 -- 172.21.15.17:0/3917911427 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbdc80ced90 msgr2=0x7fbdc80ace60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:59.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.272+0000 7fbdc7400640 1 --2- 172.21.15.17:0/3917911427 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbdc80ced90 0x7fbdc80ace60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:59.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.272+0000 7fbdc7400640 1 -- 172.21.15.17:0/3917911427 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbdc806c3f0 msgr2=0x7fbdc80ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:59.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.272+0000 7fbdc7400640 1 --2- 172.21.15.17:0/3917911427 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbdc806c3f0 0x7fbdc80ca130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:59.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.272+0000 7fbdc7400640 1 -- 172.21.15.17:0/3917911427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdb80094d0 con 0x7fbdc80b3780 2024-03-12T17:19:59.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.272+0000 7fbdc7e00640 1 --2- 172.21.15.17:0/3917911427 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbdc806c3f0 0x7fbdc80ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:19:59.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.272+0000 7fbdc7400640 1 --2- 172.21.15.17:0/3917911427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbdc80b3780 0x7fbdc80ac920 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fbdb000efc0 tx=0x7fbdb000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:59.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.272+0000 7fbdbfe00640 1 -- 172.21.15.17:0/3917911427 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb0009b80 con 0x7fbdc80b3780 2024-03-12T17:19:59.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.273+0000 7fbdbfe00640 1 -- 172.21.15.17:0/3917911427 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb000f040 con 0x7fbdc80b3780 2024-03-12T17:19:59.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.273+0000 7fbdcf200640 1 -- 172.21.15.17:0/3917911427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdc815a170 con 0x7fbdc80b3780 2024-03-12T17:19:59.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.273+0000 7fbdbfe00640 1 -- 172.21.15.17:0/3917911427 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb00146a0 con 0x7fbdc80b3780 2024-03-12T17:19:59.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.273+0000 7fbdcf200640 1 -- 172.21.15.17:0/3917911427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdc815ac50 con 0x7fbdc80b3780 2024-03-12T17:19:59.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.274+0000 7fbdcf200640 1 -- 172.21.15.17:0/3917911427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdc815aed0 con 0x7fbdc80b3780 2024-03-12T17:19:59.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.275+0000 7fbdbfe00640 1 -- 172.21.15.17:0/3917911427 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fbdb0014800 con 0x7fbdc80b3780 2024-03-12T17:19:59.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.276+0000 7fbdbfe00640 1 --2- 172.21.15.17:0/3917911427 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fbda406ac00 0x7fbda406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:59.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.276+0000 7fbdbfe00640 1 -- 172.21.15.17:0/3917911427 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbdb008a190 con 0x7fbdc80b3780 2024-03-12T17:19:59.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.276+0000 7fbdc7e00640 1 --2- 172.21.15.17:0/3917911427 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fbda406ac00 0x7fbda406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:59.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.276+0000 7fbdc7e00640 1 --2- 172.21.15.17:0/3917911427 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fbda406ac00 0x7fbda406d0c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8036000 tx=0x7fbdb8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:59.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.280+0000 7fbdbfe00640 1 -- 172.21.15.17:0/3917911427 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fbdc815aed0 con 0x7fbdc80b3780 2024-03-12T17:19:59.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.479+0000 7fbdcf200640 1 -- 172.21.15.17:0/3917911427 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbdc815aed0 con 0x7fbdc80b3780 2024-03-12T17:19:59.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.482+0000 7fbdbfe00640 1 -- 172.21.15.17:0/3917911427 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16053 (secure 0 0 0) 0x7fbdc815aed0 con 0x7fbdc80b3780 2024-03-12T17:19:59.476 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:19:59.477 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":35,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:19:56.525877+0000","last_up_change":"2024-03-12T17:18:38.144756+0000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-12T17:18:39.552910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-12T17:19:53.519967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-12T17:19:54.546388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":37305},{"type":"v1","addr":"172.21.15.17:6801","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":37305},{"type":"v1","addr":"172.21.15.17:6803","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":37305},{"type":"v1","addr":"172.21.15.17:6807","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":37305},{"type":"v1","addr":"172.21.15.17:6805","nonce":37305}]},"public_addr":"172.21.15.17:6801/37305","cluster_addr":"172.21.15.17:6803/37305","heartbeat_back_addr":"172.21.15.17:6807/37305","heartbeat_front_addr":"172.21.15.17:6805/37305","state":["exists","up"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":37307},{"type":"v1","addr":"172.21.15.17:6814","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":37307},{"type":"v1","addr":"172.21.15.17:6818","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":37307},{"type":"v1","addr":"172.21.15.17:6827","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":37307},{"type":"v1","addr":"172.21.15.17:6823","nonce":37307}]},"public_addr":"172.21.15.17:6814/37307","cluster_addr":"172.21.15.17:6818/37307","heartbeat_back_addr":"172.21.15.17:6827/37307","heartbeat_front_addr":"172.21.15.17:6823/37307","state":["exists","up"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":37303},{"type":"v1","addr":"172.21.15.17:6809","nonce":37303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":37303},{"type":"v1","addr":"172.21.15.17:6811","nonce":37303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":37303},{"type":"v1","addr":"172.21.15.17:6819","nonce":37303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":37303},{"type":"v1","addr":"172.21.15.17:6815","nonce":37303}]},"public_addr":"172.21.15.17:6809/37303","cluster_addr":"172.21.15.17:6811/37303","heartbeat_back_addr":"172.21.15.17:6819/37303","heartbeat_front_addr":"172.21.15.17:6815/37303","state":["exists","up"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":37308},{"type":"v1","addr":"172.21.15.17:6822","nonce":37308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":37308},{"type":"v1","addr":"172.21.15.17:6826","nonce":37308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":37308},{"type":"v1","addr":"172.21.15.17:6831","nonce":37308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":37308},{"type":"v1","addr":"172.21.15.17:6829","nonce":37308}]},"public_addr":"172.21.15.17:6822/37308","cluster_addr":"172.21.15.17:6826/37308","heartbeat_back_addr":"172.21.15.17:6831/37308","heartbeat_front_addr":"172.21.15.17:6829/37308","state":["exists","up"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":37465},{"type":"v1","addr":"172.21.15.94:6809","nonce":37465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6811","nonce":37465},{"type":"v1","addr":"172.21.15.94:6813","nonce":37465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6819","nonce":37465},{"type":"v1","addr":"172.21.15.94:6822","nonce":37465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6815","nonce":37465},{"type":"v1","addr":"172.21.15.94:6817","nonce":37465}]},"public_addr":"172.21.15.94:6809/37465","cluster_addr":"172.21.15.94:6813/37465","heartbeat_back_addr":"172.21.15.94:6822/37465","heartbeat_front_addr":"172.21.15.94:6817/37465","state":["exists","up"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":37464},{"type":"v1","addr":"172.21.15.94:6812","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":37464},{"type":"v1","addr":"172.21.15.94:6816","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":37464},{"type":"v1","addr":"172.21.15.94:6823","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":37464},{"type":"v1","addr":"172.21.15.94:6820","nonce":37464}]},"public_addr":"172.21.15.94:6812/37464","cluster_addr":"172.21.15.94:6816/37464","heartbeat_back_addr":"172.21.15.94:6823/37464","heartbeat_front_addr":"172.21.15.94:6820/37464","state":["exists","up"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":37467},{"type":"v1","addr":"172.21.15.94:6825","nonce":37467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":37467},{"type":"v1","addr":"172.21.15.94:6827","nonce":37467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":37467},{"type":"v1","addr":"172.21.15.94:6831","nonce":37467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":37467},{"type":"v1","addr":"172.21.15.94:6829","nonce":37467}]},"public_addr":"172.21.15.94:6825/37467","cluster_addr":"172.21.15.94:6827/37467","heartbeat_back_addr":"172.21.15.94:6831/37467","heartbeat_front_addr":"172.21.15.94:6829/37467","state":["exists","up"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":37466},{"type":"v1","addr":"172.21.15.94:6801","nonce":37466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":37466},{"type":"v1","addr":"172.21.15.94:6803","nonce":37466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":37466},{"type":"v1","addr":"172.21.15.94:6807","nonce":37466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":37466},{"type":"v1","addr":"172.21.15.94:6805","nonce":37466}]},"public_addr":"172.21.15.94:6801/37466","cluster_addr":"172.21.15.94:6803/37466","heartbeat_back_addr":"172.21.15.94:6807/37466","heartbeat_front_addr":"172.21.15.94:6805/37466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.327217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.186966+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.419986+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.150585+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.120621+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.121576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.181257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.293188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:19:59.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.484+0000 7fbdcf200640 1 -- 172.21.15.17:0/3917911427 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fbda406ac00 msgr2=0x7fbda406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:59.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.484+0000 7fbdcf200640 1 --2- 172.21.15.17:0/3917911427 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fbda406ac00 0x7fbda406d0c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8036000 tx=0x7fbdb8008030 comp rx=0 tx=0).stop 2024-03-12T17:19:59.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.484+0000 7fbdcf200640 1 -- 172.21.15.17:0/3917911427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbdc80b3780 msgr2=0x7fbdc80ac920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:59.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.484+0000 7fbdcf200640 1 --2- 172.21.15.17:0/3917911427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbdc80b3780 0x7fbdc80ac920 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fbdb000efc0 tx=0x7fbdb000c490 comp rx=0 tx=0).stop 2024-03-12T17:19:59.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.484+0000 7fbdcf200640 1 -- 172.21.15.17:0/3917911427 shutdown_connections 2024-03-12T17:19:59.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.484+0000 7fbdcf200640 1 --2- 172.21.15.17:0/3917911427 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fbda406ac00 0x7fbda406d0c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:59.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.484+0000 7fbdcf200640 1 --2- 172.21.15.17:0/3917911427 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbdc80ced90 0x7fbdc80ace60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:59.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.484+0000 7fbdcf200640 1 --2- 172.21.15.17:0/3917911427 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbdc80b3780 0x7fbdc80ac920 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:59.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.484+0000 7fbdcf200640 1 --2- 172.21.15.17:0/3917911427 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbdc806c3f0 0x7fbdc80ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:59.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.484+0000 7fbdcf200640 1 -- 172.21.15.17:0/3917911427 >> 172.21.15.17:0/3917911427 conn(0x7fbdc8069ce0 msgr2=0x7fbdc806a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:59.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.485+0000 7fbdcf200640 1 -- 172.21.15.17:0/3917911427 shutdown_connections 2024-03-12T17:19:59.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.485+0000 7fbdcf200640 1 -- 172.21.15.17:0/3917911427 wait complete. 2024-03-12T17:19:59.499 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-12T17:19:59.500 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-12T17:19:59.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.718+0000 7f2677000640 1 Processor -- start 2024-03-12T17:19:59.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.719+0000 7f2677000640 1 -- start start 2024-03-12T17:19:59.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.720+0000 7f2677000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f267015caa0 0x7f2670160790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:59.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.720+0000 7f2677000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f267015ce80 0x7f26700cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:59.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.720+0000 7f2677000640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2670161650 con 0x7f26700b85f0 2024-03-12T17:19:59.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.720+0000 7f2677000640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2670161090 con 0x7f267015ce80 2024-03-12T17:19:59.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.720+0000 7f2677000640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2670161370 con 0x7f267015caa0 2024-03-12T17:19:59.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.721+0000 7f2675200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f267015ce80 0x7f26700cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:59.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.721+0000 7f2675200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f267015ce80 0x7f26700cf330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50656/0 (socket says 172.21.15.17:50656) 2024-03-12T17:19:59.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.721+0000 7f2675200640 1 -- 172.21.15.17:0/2488801472 learned_addr learned my addr 172.21.15.17:0/2488801472 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:59.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.721+0000 7f2675c00640 1 --2- 172.21.15.17:0/2488801472 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f267015caa0 0x7f2670160790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:59.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.721+0000 7f2675200640 1 -- 172.21.15.17:0/2488801472 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f267015caa0 msgr2=0x7f2670160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:19:59.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.721+0000 7f2675200640 1 --2- 172.21.15.17:0/2488801472 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f267015caa0 0x7f2670160790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:59.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.721+0000 7f2675200640 1 -- 172.21.15.17:0/2488801472 >> v1:172.21.15.17:6789/0 conn(0x7f26700b85f0 legacy=0x7f26700b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:59.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.721+0000 7f266fe00640 1 -- 172.21.15.17:0/2488801472 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 698042186 0 0) 0x7f2670161650 con 0x7f26700b85f0 2024-03-12T17:19:59.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.721+0000 7f2675200640 1 -- 172.21.15.17:0/2488801472 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26700d0ad0 con 0x7f267015ce80 2024-03-12T17:19:59.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.723+0000 7f2675200640 1 --2- 172.21.15.17:0/2488801472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f267015ce80 0x7f26700cf330 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2660009870 tx=0x7f266002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ee8d0c9d25eb27 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:59.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.723+0000 7f266fe00640 1 -- 172.21.15.17:0/2488801472 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2660030840 con 0x7f267015ce80 2024-03-12T17:19:59.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.723+0000 7f266fe00640 1 -- 172.21.15.17:0/2488801472 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26600309a0 con 0x7f267015ce80 2024-03-12T17:19:59.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.723+0000 7f266fe00640 1 -- 172.21.15.17:0/2488801472 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2660030d30 con 0x7f267015ce80 2024-03-12T17:19:59.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.723+0000 7f2677000640 1 -- 172.21.15.17:0/2488801472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f267015ce80 msgr2=0x7f26700cf330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:59.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.723+0000 7f2677000640 1 --2- 172.21.15.17:0/2488801472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f267015ce80 0x7f26700cf330 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2660009870 tx=0x7f266002b980 comp rx=0 tx=0).stop 2024-03-12T17:19:59.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.724+0000 7f2677000640 1 -- 172.21.15.17:0/2488801472 shutdown_connections 2024-03-12T17:19:59.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.724+0000 7f2677000640 1 --2- 172.21.15.17:0/2488801472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f267015ce80 0x7f26700cf330 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:59.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.724+0000 7f2677000640 1 --2- 172.21.15.17:0/2488801472 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f267015caa0 0x7f2670160790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:59.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.724+0000 7f2677000640 1 -- 172.21.15.17:0/2488801472 >> 172.21.15.17:0/2488801472 conn(0x7f267006b160 msgr2=0x7f267006b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:59.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.724+0000 7f2677000640 1 -- 172.21.15.17:0/2488801472 shutdown_connections 2024-03-12T17:19:59.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.724+0000 7f2677000640 1 -- 172.21.15.17:0/2488801472 wait complete. 2024-03-12T17:19:59.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.725+0000 7f2677000640 1 Processor -- start 2024-03-12T17:19:59.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.726+0000 7f2677000640 1 -- start start 2024-03-12T17:19:59.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.726+0000 7f2677000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26700b85f0 0x7f26700c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:59.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.726+0000 7f2677000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f267015caa0 0x7f26700c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:59.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.726+0000 7f2677000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f267015ce80 0x7f26700cbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:59.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.726+0000 7f2677000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26700c64f0 con 0x7f26700b85f0 2024-03-12T17:19:59.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.726+0000 7f2677000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26700c8200 con 0x7f267015ce80 2024-03-12T17:19:59.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.726+0000 7f2677000640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26700c84e0 con 0x7f267015caa0 2024-03-12T17:19:59.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.727+0000 7f2675c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26700b85f0 0x7f26700c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:59.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.727+0000 7f2675c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26700b85f0 0x7f26700c69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50668/0 (socket says 172.21.15.17:50668) 2024-03-12T17:19:59.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.727+0000 7f2675c00640 1 -- 172.21.15.17:0/3679222899 learned_addr learned my addr 172.21.15.17:0/3679222899 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:19:59.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.727+0000 7f2675c00640 1 -- 172.21.15.17:0/3679222899 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f267015caa0 msgr2=0x7f26700c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:59.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.727+0000 7f2675c00640 1 --2- 172.21.15.17:0/3679222899 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f267015caa0 0x7f26700c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:59.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.727+0000 7f2675c00640 1 -- 172.21.15.17:0/3679222899 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f267015ce80 msgr2=0x7f26700cbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:59.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.727+0000 7f2675c00640 1 --2- 172.21.15.17:0/3679222899 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f267015ce80 0x7f26700cbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:59.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.727+0000 7f2675c00640 1 -- 172.21.15.17:0/3679222899 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26600094d0 con 0x7f26700b85f0 2024-03-12T17:19:59.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.728+0000 7f2675c00640 1 --2- 172.21.15.17:0/3679222899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26700b85f0 0x7f26700c69a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f266400d800 tx=0x7f266400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:59.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.728+0000 7f266d600640 1 -- 172.21.15.17:0/3679222899 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266400b6c0 con 0x7f26700b85f0 2024-03-12T17:19:59.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.728+0000 7f266d600640 1 -- 172.21.15.17:0/3679222899 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266400b820 con 0x7f26700b85f0 2024-03-12T17:19:59.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.728+0000 7f266d600640 1 -- 172.21.15.17:0/3679222899 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266400bbb0 con 0x7f26700b85f0 2024-03-12T17:19:59.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.728+0000 7f2677000640 1 -- 172.21.15.17:0/3679222899 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26700c87c0 con 0x7f26700b85f0 2024-03-12T17:19:59.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.728+0000 7f2677000640 1 -- 172.21.15.17:0/3679222899 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26700c7e20 con 0x7f26700b85f0 2024-03-12T17:19:59.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.729+0000 7f2677000640 1 -- 172.21.15.17:0/3679222899 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2670072360 con 0x7f26700b85f0 2024-03-12T17:19:59.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.730+0000 7f266d600640 1 -- 172.21.15.17:0/3679222899 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f266400bd10 con 0x7f26700b85f0 2024-03-12T17:19:59.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.731+0000 7f266d600640 1 --2- 172.21.15.17:0/3679222899 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f265406ac00 0x7f265406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:19:59.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.731+0000 7f266d600640 1 -- 172.21.15.17:0/3679222899 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2664089900 con 0x7f26700b85f0 2024-03-12T17:19:59.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.731+0000 7f2675200640 1 --2- 172.21.15.17:0/3679222899 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f265406ac00 0x7f265406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:19:59.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.732+0000 7f2675200640 1 --2- 172.21.15.17:0/3679222899 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f265406ac00 0x7f265406d0c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2660036000 tx=0x7f266003b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:19:59.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.735+0000 7f266d600640 1 -- 172.21.15.17:0/3679222899 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f2664054ae0 con 0x7f26700b85f0 2024-03-12T17:19:59.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.932+0000 7f2677000640 1 -- 172.21.15.17:0/3679222899 --> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f26700d22e0 con 0x7f265406ac00 2024-03-12T17:19:59.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.943+0000 7f266d600640 1 -- 172.21.15.17:0/3679222899 <== mgr.4104 v2:172.21.15.17:6832/37052 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287205 (secure 0 0 0) 0x7f2660030b10 con 0x7f265406ac00 2024-03-12T17:19:59.942 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:19:59.943 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-03-12T17:19:59.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.949+0000 7f2677000640 1 -- 172.21.15.17:0/3679222899 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f265406ac00 msgr2=0x7f265406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:59.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.949+0000 7f2677000640 1 --2- 172.21.15.17:0/3679222899 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f265406ac00 0x7f265406d0c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2660036000 tx=0x7f266003b040 comp rx=0 tx=0).stop 2024-03-12T17:19:59.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.949+0000 7f2677000640 1 -- 172.21.15.17:0/3679222899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26700b85f0 msgr2=0x7f26700c69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:19:59.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.949+0000 7f2677000640 1 --2- 172.21.15.17:0/3679222899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26700b85f0 0x7f26700c69a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f266400d800 tx=0x7f266400dcc0 comp rx=0 tx=0).stop 2024-03-12T17:19:59.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.949+0000 7f2677000640 1 -- 172.21.15.17:0/3679222899 shutdown_connections 2024-03-12T17:19:59.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.949+0000 7f2677000640 1 --2- 172.21.15.17:0/3679222899 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f265406ac00 0x7f265406d0c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:59.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.949+0000 7f2677000640 1 --2- 172.21.15.17:0/3679222899 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f267015ce80 0x7f26700cbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:59.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.949+0000 7f2677000640 1 --2- 172.21.15.17:0/3679222899 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f267015caa0 0x7f26700c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:59.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.949+0000 7f2677000640 1 --2- 172.21.15.17:0/3679222899 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f26700b85f0 0x7f26700c69a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:19:59.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.950+0000 7f2677000640 1 -- 172.21.15.17:0/3679222899 >> 172.21.15.17:0/3679222899 conn(0x7f267006b160 msgr2=0x7f267015b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:19:59.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.950+0000 7f2677000640 1 -- 172.21.15.17:0/3679222899 shutdown_connections 2024-03-12T17:19:59.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:19:59.950+0000 7f2677000640 1 -- 172.21.15.17:0/3679222899 wait complete. 2024-03-12T17:19:59.962 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-03-12T17:19:59.498758+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":98,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253304,"kb_used_data":4328,"kb_used_omap":13,"kb_used_meta":248818,"kb_avail":754721416,"statfs":{"total":773094113280,"available":772834729984,"internally_reserved":0,"allocated":4431872,"data_stored":2437988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":254789720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.485904"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.648564+0000","last_change":"2024-03-12T17:19:55.567062+0000","last_active":"2024-03-12T17:19:57.648564+0000","last_peered":"2024-03-12T17:19:57.648564+0000","last_clean":"2024-03-12T17:19:57.648564+0000","last_became_active":"2024-03-12T17:19:55.566776+0000","last_became_peered":"2024-03-12T17:19:55.566776+0000","last_unstale":"2024-03-12T17:19:57.648564+0000","last_undegraded":"2024-03-12T17:19:57.648564+0000","last_fullsized":"2024-03-12T17:19:57.648564+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T00:14:12.637775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.647102+0000","last_change":"2024-03-12T17:19:55.546637+0000","last_active":"2024-03-12T17:19:57.647102+0000","last_peered":"2024-03-12T17:19:57.647102+0000","last_clean":"2024-03-12T17:19:57.647102+0000","last_became_active":"2024-03-12T17:19:55.546372+0000","last_became_peered":"2024-03-12T17:19:55.546372+0000","last_unstale":"2024-03-12T17:19:57.647102+0000","last_undegraded":"2024-03-12T17:19:57.647102+0000","last_fullsized":"2024-03-12T17:19:57.647102+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:42:43.334658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.535830+0000","last_change":"2024-03-12T17:19:55.564113+0000","last_active":"2024-03-12T17:19:56.535830+0000","last_peered":"2024-03-12T17:19:56.535830+0000","last_clean":"2024-03-12T17:19:56.535830+0000","last_became_active":"2024-03-12T17:19:55.563811+0000","last_became_peered":"2024-03-12T17:19:55.563811+0000","last_unstale":"2024-03-12T17:19:56.535830+0000","last_undegraded":"2024-03-12T17:19:56.535830+0000","last_fullsized":"2024-03-12T17:19:56.535830+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:36:01.074245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.876290+0000","last_change":"2024-03-12T17:19:55.574347+0000","last_active":"2024-03-12T17:19:56.876290+0000","last_peered":"2024-03-12T17:19:56.876290+0000","last_clean":"2024-03-12T17:19:56.876290+0000","last_became_active":"2024-03-12T17:19:55.574094+0000","last_became_peered":"2024-03-12T17:19:55.574094+0000","last_unstale":"2024-03-12T17:19:56.876290+0000","last_undegraded":"2024-03-12T17:19:56.876290+0000","last_fullsized":"2024-03-12T17:19:56.876290+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:42:43.334658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.532265+0000","last_change":"2024-03-12T17:19:55.540070+0000","last_active":"2024-03-12T17:19:56.532265+0000","last_peered":"2024-03-12T17:19:56.532265+0000","last_clean":"2024-03-12T17:19:56.532265+0000","last_became_active":"2024-03-12T17:19:55.539372+0000","last_became_peered":"2024-03-12T17:19:55.539372+0000","last_unstale":"2024-03-12T17:19:56.532265+0000","last_undegraded":"2024-03-12T17:19:56.532265+0000","last_fullsized":"2024-03-12T17:19:56.532265+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:37:23.898515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.645967+0000","last_change":"2024-03-12T17:19:55.546362+0000","last_active":"2024-03-12T17:19:57.645967+0000","last_peered":"2024-03-12T17:19:57.645967+0000","last_clean":"2024-03-12T17:19:57.645967+0000","last_became_active":"2024-03-12T17:19:55.545771+0000","last_became_peered":"2024-03-12T17:19:55.545771+0000","last_unstale":"2024-03-12T17:19:57.645967+0000","last_undegraded":"2024-03-12T17:19:57.645967+0000","last_fullsized":"2024-03-12T17:19:57.645967+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:36:22.768353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.537514+0000","last_change":"2024-03-12T17:19:55.559965+0000","last_active":"2024-03-12T17:19:56.537514+0000","last_peered":"2024-03-12T17:19:56.537514+0000","last_clean":"2024-03-12T17:19:56.537514+0000","last_became_active":"2024-03-12T17:19:55.559700+0000","last_became_peered":"2024-03-12T17:19:55.559700+0000","last_unstale":"2024-03-12T17:19:56.537514+0000","last_undegraded":"2024-03-12T17:19:56.537514+0000","last_fullsized":"2024-03-12T17:19:56.537514+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:42:29.462692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.536356+0000","last_change":"2024-03-12T17:19:55.554600+0000","last_active":"2024-03-12T17:19:56.536356+0000","last_peered":"2024-03-12T17:19:56.536356+0000","last_clean":"2024-03-12T17:19:56.536356+0000","last_became_active":"2024-03-12T17:19:55.554131+0000","last_became_peered":"2024-03-12T17:19:55.554131+0000","last_unstale":"2024-03-12T17:19:56.536356+0000","last_undegraded":"2024-03-12T17:19:56.536356+0000","last_fullsized":"2024-03-12T17:19:56.536356+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:57:43.664364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.370005+0000","last_change":"2024-03-12T17:19:55.564475+0000","last_active":"2024-03-12T17:19:57.370005+0000","last_peered":"2024-03-12T17:19:57.370005+0000","last_clean":"2024-03-12T17:19:57.370005+0000","last_became_active":"2024-03-12T17:19:55.564197+0000","last_became_peered":"2024-03-12T17:19:55.564197+0000","last_unstale":"2024-03-12T17:19:57.370005+0000","last_undegraded":"2024-03-12T17:19:57.370005+0000","last_fullsized":"2024-03-12T17:19:57.370005+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T00:14:12.637775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.876917+0000","last_change":"2024-03-12T17:19:55.555557+0000","last_active":"2024-03-12T17:19:56.876917+0000","last_peered":"2024-03-12T17:19:56.876917+0000","last_clean":"2024-03-12T17:19:56.876917+0000","last_became_active":"2024-03-12T17:19:55.555250+0000","last_became_peered":"2024-03-12T17:19:55.555250+0000","last_unstale":"2024-03-12T17:19:56.876917+0000","last_undegraded":"2024-03-12T17:19:56.876917+0000","last_fullsized":"2024-03-12T17:19:56.876917+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:02:38.287352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.537386+0000","last_change":"2024-03-12T17:19:55.561064+0000","last_active":"2024-03-12T17:19:56.537386+0000","last_peered":"2024-03-12T17:19:56.537386+0000","last_clean":"2024-03-12T17:19:56.537386+0000","last_became_active":"2024-03-12T17:19:55.560773+0000","last_became_peered":"2024-03-12T17:19:55.560773+0000","last_unstale":"2024-03-12T17:19:56.537386+0000","last_undegraded":"2024-03-12T17:19:56.537386+0000","last_fullsized":"2024-03-12T17:19:56.537386+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:53:38.898344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.535621+0000","last_change":"2024-03-12T17:19:55.553246+0000","last_active":"2024-03-12T17:19:56.535621+0000","last_peered":"2024-03-12T17:19:56.535621+0000","last_clean":"2024-03-12T17:19:56.535621+0000","last_became_active":"2024-03-12T17:19:55.552743+0000","last_became_peered":"2024-03-12T17:19:55.552743+0000","last_unstale":"2024-03-12T17:19:56.535621+0000","last_undegraded":"2024-03-12T17:19:56.535621+0000","last_fullsized":"2024-03-12T17:19:56.535621+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:53:38.898344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.532265+0000","last_change":"2024-03-12T17:19:55.561851+0000","last_active":"2024-03-12T17:19:56.532265+0000","last_peered":"2024-03-12T17:19:56.532265+0000","last_clean":"2024-03-12T17:19:56.532265+0000","last_became_active":"2024-03-12T17:19:55.561013+0000","last_became_peered":"2024-03-12T17:19:55.561013+0000","last_unstale":"2024-03-12T17:19:56.532265+0000","last_undegraded":"2024-03-12T17:19:56.532265+0000","last_fullsized":"2024-03-12T17:19:56.532265+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:27:04.837139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.646163+0000","last_change":"2024-03-12T17:19:55.553729+0000","last_active":"2024-03-12T17:19:57.646163+0000","last_peered":"2024-03-12T17:19:57.646163+0000","last_clean":"2024-03-12T17:19:57.646163+0000","last_became_active":"2024-03-12T17:19:55.553224+0000","last_became_peered":"2024-03-12T17:19:55.553224+0000","last_unstale":"2024-03-12T17:19:57.646163+0000","last_undegraded":"2024-03-12T17:19:57.646163+0000","last_fullsized":"2024-03-12T17:19:57.646163+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:41:59.824480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.535461+0000","last_change":"2024-03-12T17:19:55.565221+0000","last_active":"2024-03-12T17:19:56.535461+0000","last_peered":"2024-03-12T17:19:56.535461+0000","last_clean":"2024-03-12T17:19:56.535461+0000","last_became_active":"2024-03-12T17:19:55.564945+0000","last_became_peered":"2024-03-12T17:19:55.564945+0000","last_unstale":"2024-03-12T17:19:56.535461+0000","last_undegraded":"2024-03-12T17:19:56.535461+0000","last_fullsized":"2024-03-12T17:19:56.535461+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:02:56.923259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.537192+0000","last_change":"2024-03-12T17:19:55.554143+0000","last_active":"2024-03-12T17:19:56.537192+0000","last_peered":"2024-03-12T17:19:56.537192+0000","last_clean":"2024-03-12T17:19:56.537192+0000","last_became_active":"2024-03-12T17:19:55.553817+0000","last_became_peered":"2024-03-12T17:19:55.553817+0000","last_unstale":"2024-03-12T17:19:56.537192+0000","last_undegraded":"2024-03-12T17:19:56.537192+0000","last_fullsized":"2024-03-12T17:19:56.537192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:42:43.334658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.538039+0000","last_change":"2024-03-12T17:19:55.559779+0000","last_active":"2024-03-12T17:19:56.538039+0000","last_peered":"2024-03-12T17:19:56.538039+0000","last_clean":"2024-03-12T17:19:56.538039+0000","last_became_active":"2024-03-12T17:19:55.559466+0000","last_became_peered":"2024-03-12T17:19:55.559466+0000","last_unstale":"2024-03-12T17:19:56.538039+0000","last_undegraded":"2024-03-12T17:19:56.538039+0000","last_fullsized":"2024-03-12T17:19:56.538039+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:02:38.287352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.647189+0000","last_change":"2024-03-12T17:19:55.561554+0000","last_active":"2024-03-12T17:19:57.647189+0000","last_peered":"2024-03-12T17:19:57.647189+0000","last_clean":"2024-03-12T17:19:57.647189+0000","last_became_active":"2024-03-12T17:19:55.561296+0000","last_became_peered":"2024-03-12T17:19:55.561296+0000","last_unstale":"2024-03-12T17:19:57.647189+0000","last_undegraded":"2024-03-12T17:19:57.647189+0000","last_fullsized":"2024-03-12T17:19:57.647189+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:07:23.149461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.646773+0000","last_change":"2024-03-12T17:19:55.563357+0000","last_active":"2024-03-12T17:19:57.646773+0000","last_peered":"2024-03-12T17:19:57.646773+0000","last_clean":"2024-03-12T17:19:57.646773+0000","last_became_active":"2024-03-12T17:19:55.563192+0000","last_became_peered":"2024-03-12T17:19:55.563192+0000","last_unstale":"2024-03-12T17:19:57.646773+0000","last_undegraded":"2024-03-12T17:19:57.646773+0000","last_fullsized":"2024-03-12T17:19:57.646773+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:13:57.858538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.532516+0000","last_change":"2024-03-12T17:19:55.559010+0000","last_active":"2024-03-12T17:19:56.532516+0000","last_peered":"2024-03-12T17:19:56.532516+0000","last_clean":"2024-03-12T17:19:56.532516+0000","last_became_active":"2024-03-12T17:19:55.556925+0000","last_became_peered":"2024-03-12T17:19:55.556925+0000","last_unstale":"2024-03-12T17:19:56.532516+0000","last_undegraded":"2024-03-12T17:19:56.532516+0000","last_fullsized":"2024-03-12T17:19:56.532516+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:11:56.543814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.369917+0000","last_change":"2024-03-12T17:19:55.565186+0000","last_active":"2024-03-12T17:19:57.369917+0000","last_peered":"2024-03-12T17:19:57.369917+0000","last_clean":"2024-03-12T17:19:57.369917+0000","last_became_active":"2024-03-12T17:19:55.564882+0000","last_became_peered":"2024-03-12T17:19:55.564882+0000","last_unstale":"2024-03-12T17:19:57.369917+0000","last_undegraded":"2024-03-12T17:19:57.369917+0000","last_fullsized":"2024-03-12T17:19:57.369917+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:27:04.837139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.368946+0000","last_change":"2024-03-12T17:19:55.563668+0000","last_active":"2024-03-12T17:19:57.368946+0000","last_peered":"2024-03-12T17:19:57.368946+0000","last_clean":"2024-03-12T17:19:57.368946+0000","last_became_active":"2024-03-12T17:19:55.563394+0000","last_became_peered":"2024-03-12T17:19:55.563394+0000","last_unstale":"2024-03-12T17:19:57.368946+0000","last_undegraded":"2024-03-12T17:19:57.368946+0000","last_fullsized":"2024-03-12T17:19:57.368946+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:06:33.370089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.869912+0000","last_change":"2024-03-12T17:19:55.551747+0000","last_active":"2024-03-12T17:19:56.869912+0000","last_peered":"2024-03-12T17:19:56.869912+0000","last_clean":"2024-03-12T17:19:56.869912+0000","last_became_active":"2024-03-12T17:19:55.551398+0000","last_became_peered":"2024-03-12T17:19:55.551398+0000","last_unstale":"2024-03-12T17:19:56.869912+0000","last_undegraded":"2024-03-12T17:19:56.869912+0000","last_fullsized":"2024-03-12T17:19:56.869912+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:06:33.370089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.535404+0000","last_change":"2024-03-12T17:19:55.555010+0000","last_active":"2024-03-12T17:19:56.535404+0000","last_peered":"2024-03-12T17:19:56.535404+0000","last_clean":"2024-03-12T17:19:56.535404+0000","last_became_active":"2024-03-12T17:19:55.554259+0000","last_became_peered":"2024-03-12T17:19:55.554259+0000","last_unstale":"2024-03-12T17:19:56.535404+0000","last_undegraded":"2024-03-12T17:19:56.535404+0000","last_fullsized":"2024-03-12T17:19:56.535404+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:36:22.768353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.876980+0000","last_change":"2024-03-12T17:19:55.559083+0000","last_active":"2024-03-12T17:19:56.876980+0000","last_peered":"2024-03-12T17:19:56.876980+0000","last_clean":"2024-03-12T17:19:56.876980+0000","last_became_active":"2024-03-12T17:19:55.558637+0000","last_became_peered":"2024-03-12T17:19:55.558637+0000","last_unstale":"2024-03-12T17:19:56.876980+0000","last_undegraded":"2024-03-12T17:19:56.876980+0000","last_fullsized":"2024-03-12T17:19:56.876980+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:42:29.462692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.647336+0000","last_change":"2024-03-12T17:19:55.551814+0000","last_active":"2024-03-12T17:19:57.647336+0000","last_peered":"2024-03-12T17:19:57.647336+0000","last_clean":"2024-03-12T17:19:57.647336+0000","last_became_active":"2024-03-12T17:19:55.551475+0000","last_became_peered":"2024-03-12T17:19:55.551475+0000","last_unstale":"2024-03-12T17:19:57.647336+0000","last_undegraded":"2024-03-12T17:19:57.647336+0000","last_fullsized":"2024-03-12T17:19:57.647336+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:02:38.287352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.876618+0000","last_change":"2024-03-12T17:19:55.568978+0000","last_active":"2024-03-12T17:19:56.876618+0000","last_peered":"2024-03-12T17:19:56.876618+0000","last_clean":"2024-03-12T17:19:56.876618+0000","last_became_active":"2024-03-12T17:19:55.564335+0000","last_became_peered":"2024-03-12T17:19:55.564335+0000","last_unstale":"2024-03-12T17:19:56.876618+0000","last_undegraded":"2024-03-12T17:19:56.876618+0000","last_fullsized":"2024-03-12T17:19:56.876618+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:02:56.923259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.535582+0000","last_change":"2024-03-12T17:19:55.562593+0000","last_active":"2024-03-12T17:19:56.535582+0000","last_peered":"2024-03-12T17:19:56.535582+0000","last_clean":"2024-03-12T17:19:56.535582+0000","last_became_active":"2024-03-12T17:19:55.562368+0000","last_became_peered":"2024-03-12T17:19:55.562368+0000","last_unstale":"2024-03-12T17:19:56.535582+0000","last_undegraded":"2024-03-12T17:19:56.535582+0000","last_fullsized":"2024-03-12T17:19:56.535582+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:17:34.421310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.369254+0000","last_change":"2024-03-12T17:19:55.560208+0000","last_active":"2024-03-12T17:19:57.369254+0000","last_peered":"2024-03-12T17:19:57.369254+0000","last_clean":"2024-03-12T17:19:57.369254+0000","last_became_active":"2024-03-12T17:19:55.559797+0000","last_became_peered":"2024-03-12T17:19:55.559797+0000","last_unstale":"2024-03-12T17:19:57.369254+0000","last_undegraded":"2024-03-12T17:19:57.369254+0000","last_fullsized":"2024-03-12T17:19:57.369254+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:57:49.973122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.537566+0000","last_change":"2024-03-12T17:19:55.564556+0000","last_active":"2024-03-12T17:19:56.537566+0000","last_peered":"2024-03-12T17:19:56.537566+0000","last_clean":"2024-03-12T17:19:56.537566+0000","last_became_active":"2024-03-12T17:19:55.564310+0000","last_became_peered":"2024-03-12T17:19:55.564310+0000","last_unstale":"2024-03-12T17:19:56.537566+0000","last_undegraded":"2024-03-12T17:19:56.537566+0000","last_fullsized":"2024-03-12T17:19:56.537566+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:12:38.840849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.648033+0000","last_change":"2024-03-12T17:19:55.562511+0000","last_active":"2024-03-12T17:19:57.648033+0000","last_peered":"2024-03-12T17:19:57.648033+0000","last_clean":"2024-03-12T17:19:57.648033+0000","last_became_active":"2024-03-12T17:19:55.561986+0000","last_became_peered":"2024-03-12T17:19:55.561986+0000","last_unstale":"2024-03-12T17:19:57.648033+0000","last_undegraded":"2024-03-12T17:19:57.648033+0000","last_fullsized":"2024-03-12T17:19:57.648033+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:34:50.616590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.536686+0000","last_change":"2024-03-12T17:19:55.567421+0000","last_active":"2024-03-12T17:19:56.536686+0000","last_peered":"2024-03-12T17:19:56.536686+0000","last_clean":"2024-03-12T17:19:56.536686+0000","last_became_active":"2024-03-12T17:19:55.566755+0000","last_became_peered":"2024-03-12T17:19:55.566755+0000","last_unstale":"2024-03-12T17:19:56.536686+0000","last_undegraded":"2024-03-12T17:19:56.536686+0000","last_fullsized":"2024-03-12T17:19:56.536686+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:36:22.768353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.870272+0000","last_change":"2024-03-12T17:19:55.556665+0000","last_active":"2024-03-12T17:19:56.870272+0000","last_peered":"2024-03-12T17:19:56.870272+0000","last_clean":"2024-03-12T17:19:56.870272+0000","last_became_active":"2024-03-12T17:19:55.554984+0000","last_became_peered":"2024-03-12T17:19:55.554984+0000","last_unstale":"2024-03-12T17:19:56.870272+0000","last_undegraded":"2024-03-12T17:19:56.870272+0000","last_fullsized":"2024-03-12T17:19:56.870272+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:34:50.616590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.648683+0000","last_change":"2024-03-12T17:19:55.061501+0000","last_active":"2024-03-12T17:19:57.648683+0000","last_peered":"2024-03-12T17:19:57.648683+0000","last_clean":"2024-03-12T17:19:57.648683+0000","last_became_active":"2024-03-12T17:19:55.060730+0000","last_became_peered":"2024-03-12T17:19:55.060730+0000","last_unstale":"2024-03-12T17:19:57.648683+0000","last_undegraded":"2024-03-12T17:19:57.648683+0000","last_fullsized":"2024-03-12T17:19:57.648683+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:59:05.662117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.648558+0000","last_change":"2024-03-12T17:19:55.574760+0000","last_active":"2024-03-12T17:19:57.648558+0000","last_peered":"2024-03-12T17:19:57.648558+0000","last_clean":"2024-03-12T17:19:57.648558+0000","last_became_active":"2024-03-12T17:19:55.574480+0000","last_became_peered":"2024-03-12T17:19:55.574480+0000","last_unstale":"2024-03-12T17:19:57.648558+0000","last_undegraded":"2024-03-12T17:19:57.648558+0000","last_fullsized":"2024-03-12T17:19:57.648558+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:06:33.370089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.870369+0000","last_change":"2024-03-12T17:19:55.067058+0000","last_active":"2024-03-12T17:19:56.870369+0000","last_peered":"2024-03-12T17:19:56.870369+0000","last_clean":"2024-03-12T17:19:56.870369+0000","last_became_active":"2024-03-12T17:19:55.066778+0000","last_became_peered":"2024-03-12T17:19:55.066778+0000","last_unstale":"2024-03-12T17:19:56.870369+0000","last_undegraded":"2024-03-12T17:19:56.870369+0000","last_fullsized":"2024-03-12T17:19:56.870369+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:11:55.528608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.369730+0000","last_change":"2024-03-12T17:19:55.561642+0000","last_active":"2024-03-12T17:19:57.369730+0000","last_peered":"2024-03-12T17:19:57.369730+0000","last_clean":"2024-03-12T17:19:57.369730+0000","last_became_active":"2024-03-12T17:19:55.561310+0000","last_became_peered":"2024-03-12T17:19:55.561310+0000","last_unstale":"2024-03-12T17:19:57.369730+0000","last_undegraded":"2024-03-12T17:19:57.369730+0000","last_fullsized":"2024-03-12T17:19:57.369730+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:36:18.137764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.646721+0000","last_change":"2024-03-12T17:19:55.060990+0000","last_active":"2024-03-12T17:19:57.646721+0000","last_peered":"2024-03-12T17:19:57.646721+0000","last_clean":"2024-03-12T17:19:57.646721+0000","last_became_active":"2024-03-12T17:19:55.060800+0000","last_became_peered":"2024-03-12T17:19:55.060800+0000","last_unstale":"2024-03-12T17:19:57.646721+0000","last_undegraded":"2024-03-12T17:19:57.646721+0000","last_fullsized":"2024-03-12T17:19:57.646721+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:42:23.714899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.876796+0000","last_change":"2024-03-12T17:19:55.564613+0000","last_active":"2024-03-12T17:19:56.876796+0000","last_peered":"2024-03-12T17:19:56.876796+0000","last_clean":"2024-03-12T17:19:56.876796+0000","last_became_active":"2024-03-12T17:19:55.563895+0000","last_became_peered":"2024-03-12T17:19:55.563895+0000","last_unstale":"2024-03-12T17:19:56.876796+0000","last_undegraded":"2024-03-12T17:19:56.876796+0000","last_fullsized":"2024-03-12T17:19:56.876796+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:36:22.768353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.532716+0000","last_change":"2024-03-12T17:19:55.058622+0000","last_active":"2024-03-12T17:19:56.532716+0000","last_peered":"2024-03-12T17:19:56.532716+0000","last_clean":"2024-03-12T17:19:56.532716+0000","last_became_active":"2024-03-12T17:19:55.058269+0000","last_became_peered":"2024-03-12T17:19:55.058269+0000","last_unstale":"2024-03-12T17:19:56.532716+0000","last_undegraded":"2024-03-12T17:19:56.532716+0000","last_fullsized":"2024-03-12T17:19:56.532716+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:40:51.094630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.537308+0000","last_change":"2024-03-12T17:19:55.574838+0000","last_active":"2024-03-12T17:19:56.537308+0000","last_peered":"2024-03-12T17:19:56.537308+0000","last_clean":"2024-03-12T17:19:56.537308+0000","last_became_active":"2024-03-12T17:19:55.574278+0000","last_became_peered":"2024-03-12T17:19:55.574278+0000","last_unstale":"2024-03-12T17:19:56.537308+0000","last_undegraded":"2024-03-12T17:19:56.537308+0000","last_fullsized":"2024-03-12T17:19:56.537308+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:13:29.308675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.369499+0000","last_change":"2024-03-12T17:19:55.069200+0000","last_active":"2024-03-12T17:19:57.369499+0000","last_peered":"2024-03-12T17:19:57.369499+0000","last_clean":"2024-03-12T17:19:57.369499+0000","last_became_active":"2024-03-12T17:19:55.068410+0000","last_became_peered":"2024-03-12T17:19:55.068410+0000","last_unstale":"2024-03-12T17:19:57.369499+0000","last_undegraded":"2024-03-12T17:19:57.369499+0000","last_fullsized":"2024-03-12T17:19:57.369499+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:44:16.951521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.535633+0000","last_change":"2024-03-12T17:19:55.559107+0000","last_active":"2024-03-12T17:19:56.535633+0000","last_peered":"2024-03-12T17:19:56.535633+0000","last_clean":"2024-03-12T17:19:56.535633+0000","last_became_active":"2024-03-12T17:19:55.558719+0000","last_became_peered":"2024-03-12T17:19:55.558719+0000","last_unstale":"2024-03-12T17:19:56.535633+0000","last_undegraded":"2024-03-12T17:19:56.535633+0000","last_fullsized":"2024-03-12T17:19:56.535633+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:00:27.067346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.369330+0000","last_change":"2024-03-12T17:19:55.067694+0000","last_active":"2024-03-12T17:19:57.369330+0000","last_peered":"2024-03-12T17:19:57.369330+0000","last_clean":"2024-03-12T17:19:57.369330+0000","last_became_active":"2024-03-12T17:19:55.067429+0000","last_became_peered":"2024-03-12T17:19:55.067429+0000","last_unstale":"2024-03-12T17:19:57.369330+0000","last_undegraded":"2024-03-12T17:19:57.369330+0000","last_fullsized":"2024-03-12T17:19:57.369330+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:40:51.094630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.368992+0000","last_change":"2024-03-12T17:19:55.564179+0000","last_active":"2024-03-12T17:19:57.368992+0000","last_peered":"2024-03-12T17:19:57.368992+0000","last_clean":"2024-03-12T17:19:57.368992+0000","last_became_active":"2024-03-12T17:19:55.563792+0000","last_became_peered":"2024-03-12T17:19:55.563792+0000","last_unstale":"2024-03-12T17:19:57.368992+0000","last_undegraded":"2024-03-12T17:19:57.368992+0000","last_fullsized":"2024-03-12T17:19:57.368992+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:34:50.616590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.646012+0000","last_change":"2024-03-12T17:19:55.059830+0000","last_active":"2024-03-12T17:19:57.646012+0000","last_peered":"2024-03-12T17:19:57.646012+0000","last_clean":"2024-03-12T17:19:57.646012+0000","last_became_active":"2024-03-12T17:19:55.059514+0000","last_became_peered":"2024-03-12T17:19:55.059514+0000","last_unstale":"2024-03-12T17:19:57.646012+0000","last_undegraded":"2024-03-12T17:19:57.646012+0000","last_fullsized":"2024-03-12T17:19:57.646012+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:37:20.922305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.875636+0000","last_change":"2024-03-12T17:19:55.565631+0000","last_active":"2024-03-12T17:19:56.875636+0000","last_peered":"2024-03-12T17:19:56.875636+0000","last_clean":"2024-03-12T17:19:56.875636+0000","last_became_active":"2024-03-12T17:19:55.564745+0000","last_became_peered":"2024-03-12T17:19:55.564745+0000","last_unstale":"2024-03-12T17:19:56.875636+0000","last_undegraded":"2024-03-12T17:19:56.875636+0000","last_fullsized":"2024-03-12T17:19:56.875636+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:53:38.898344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.368979+0000","last_change":"2024-03-12T17:19:55.059531+0000","last_active":"2024-03-12T17:19:57.368979+0000","last_peered":"2024-03-12T17:19:57.368979+0000","last_clean":"2024-03-12T17:19:57.368979+0000","last_became_active":"2024-03-12T17:19:55.058948+0000","last_became_peered":"2024-03-12T17:19:55.058948+0000","last_unstale":"2024-03-12T17:19:57.368979+0000","last_undegraded":"2024-03-12T17:19:57.368979+0000","last_fullsized":"2024-03-12T17:19:57.368979+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:59:26.535303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.536446+0000","last_change":"2024-03-12T17:19:55.556091+0000","last_active":"2024-03-12T17:19:56.536446+0000","last_peered":"2024-03-12T17:19:56.536446+0000","last_clean":"2024-03-12T17:19:56.536446+0000","last_became_active":"2024-03-12T17:19:55.555787+0000","last_became_peered":"2024-03-12T17:19:55.555787+0000","last_unstale":"2024-03-12T17:19:56.536446+0000","last_undegraded":"2024-03-12T17:19:56.536446+0000","last_fullsized":"2024-03-12T17:19:56.536446+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:57:43.664364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.646876+0000","last_change":"2024-03-12T17:19:55.070176+0000","last_active":"2024-03-12T17:19:57.646876+0000","last_peered":"2024-03-12T17:19:57.646876+0000","last_clean":"2024-03-12T17:19:57.646876+0000","last_became_active":"2024-03-12T17:19:55.069670+0000","last_became_peered":"2024-03-12T17:19:55.069670+0000","last_unstale":"2024-03-12T17:19:57.646876+0000","last_undegraded":"2024-03-12T17:19:57.646876+0000","last_fullsized":"2024-03-12T17:19:57.646876+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T00:14:11.622570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.646723+0000","last_change":"2024-03-12T17:19:55.560536+0000","last_active":"2024-03-12T17:19:57.646723+0000","last_peered":"2024-03-12T17:19:57.646723+0000","last_clean":"2024-03-12T17:19:57.646723+0000","last_became_active":"2024-03-12T17:19:55.560262+0000","last_became_peered":"2024-03-12T17:19:55.560262+0000","last_unstale":"2024-03-12T17:19:57.646723+0000","last_undegraded":"2024-03-12T17:19:57.646723+0000","last_fullsized":"2024-03-12T17:19:57.646723+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:37:18.594281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.870645+0000","last_change":"2024-03-12T17:19:55.066317+0000","last_active":"2024-03-12T17:19:56.870645+0000","last_peered":"2024-03-12T17:19:56.870645+0000","last_clean":"2024-03-12T17:19:56.870645+0000","last_became_active":"2024-03-12T17:19:55.064902+0000","last_became_peered":"2024-03-12T17:19:55.064902+0000","last_unstale":"2024-03-12T17:19:56.870645+0000","last_undegraded":"2024-03-12T17:19:56.870645+0000","last_fullsized":"2024-03-12T17:19:56.870645+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:12:57.672436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.647107+0000","last_change":"2024-03-12T17:19:55.553757+0000","last_active":"2024-03-12T17:19:57.647107+0000","last_peered":"2024-03-12T17:19:57.647107+0000","last_clean":"2024-03-12T17:19:57.647107+0000","last_became_active":"2024-03-12T17:19:55.551393+0000","last_became_peered":"2024-03-12T17:19:55.551393+0000","last_unstale":"2024-03-12T17:19:57.647107+0000","last_undegraded":"2024-03-12T17:19:57.647107+0000","last_fullsized":"2024-03-12T17:19:57.647107+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:42:29.462692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.536062+0000","last_change":"2024-03-12T17:19:55.067675+0000","last_active":"2024-03-12T17:19:56.536062+0000","last_peered":"2024-03-12T17:19:56.536062+0000","last_clean":"2024-03-12T17:19:56.536062+0000","last_became_active":"2024-03-12T17:19:55.067345+0000","last_became_peered":"2024-03-12T17:19:55.067345+0000","last_unstale":"2024-03-12T17:19:56.536062+0000","last_undegraded":"2024-03-12T17:19:56.536062+0000","last_fullsized":"2024-03-12T17:19:56.536062+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:12:57.672436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.535381+0000","last_change":"2024-03-12T17:19:55.558356+0000","last_active":"2024-03-12T17:19:56.535381+0000","last_peered":"2024-03-12T17:19:56.535381+0000","last_clean":"2024-03-12T17:19:56.535381+0000","last_became_active":"2024-03-12T17:19:55.558030+0000","last_became_peered":"2024-03-12T17:19:55.558030+0000","last_unstale":"2024-03-12T17:19:56.535381+0000","last_undegraded":"2024-03-12T17:19:56.535381+0000","last_fullsized":"2024-03-12T17:19:56.535381+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T00:29:15.942673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.647117+0000","last_change":"2024-03-12T17:19:55.067477+0000","last_active":"2024-03-12T17:19:57.647117+0000","last_peered":"2024-03-12T17:19:57.647117+0000","last_clean":"2024-03-12T17:19:57.647117+0000","last_became_active":"2024-03-12T17:19:55.067211+0000","last_became_peered":"2024-03-12T17:19:55.067211+0000","last_unstale":"2024-03-12T17:19:57.647117+0000","last_undegraded":"2024-03-12T17:19:57.647117+0000","last_fullsized":"2024-03-12T17:19:57.647117+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:37:22.883310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.875956+0000","last_change":"2024-03-12T17:19:55.559256+0000","last_active":"2024-03-12T17:19:56.875956+0000","last_peered":"2024-03-12T17:19:56.875956+0000","last_clean":"2024-03-12T17:19:56.875956+0000","last_became_active":"2024-03-12T17:19:55.559011+0000","last_became_peered":"2024-03-12T17:19:55.559011+0000","last_unstale":"2024-03-12T17:19:56.875956+0000","last_undegraded":"2024-03-12T17:19:56.875956+0000","last_fullsized":"2024-03-12T17:19:56.875956+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:41:59.824480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.369726+0000","last_change":"2024-03-12T17:19:55.066382+0000","last_active":"2024-03-12T17:19:57.369726+0000","last_peered":"2024-03-12T17:19:57.369726+0000","last_clean":"2024-03-12T17:19:57.369726+0000","last_became_active":"2024-03-12T17:19:55.065141+0000","last_became_peered":"2024-03-12T17:19:55.065141+0000","last_unstale":"2024-03-12T17:19:57.369726+0000","last_undegraded":"2024-03-12T17:19:57.369726+0000","last_fullsized":"2024-03-12T17:19:57.369726+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:24:48.618858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.646577+0000","last_change":"2024-03-12T17:19:55.548805+0000","last_active":"2024-03-12T17:19:57.646577+0000","last_peered":"2024-03-12T17:19:57.646577+0000","last_clean":"2024-03-12T17:19:57.646577+0000","last_became_active":"2024-03-12T17:19:55.548530+0000","last_became_peered":"2024-03-12T17:19:55.548530+0000","last_unstale":"2024-03-12T17:19:57.646577+0000","last_undegraded":"2024-03-12T17:19:57.646577+0000","last_fullsized":"2024-03-12T17:19:57.646577+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:57:43.664364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.876019+0000","last_change":"2024-03-12T17:19:55.067167+0000","last_active":"2024-03-12T17:19:56.876019+0000","last_peered":"2024-03-12T17:19:56.876019+0000","last_clean":"2024-03-12T17:19:56.876019+0000","last_became_active":"2024-03-12T17:19:55.066903+0000","last_became_peered":"2024-03-12T17:19:55.066903+0000","last_unstale":"2024-03-12T17:19:56.876019+0000","last_undegraded":"2024-03-12T17:19:56.876019+0000","last_fullsized":"2024-03-12T17:19:56.876019+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T00:14:11.622570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.536717+0000","last_change":"2024-03-12T17:19:55.556807+0000","last_active":"2024-03-12T17:19:56.536717+0000","last_peered":"2024-03-12T17:19:56.536717+0000","last_clean":"2024-03-12T17:19:56.536717+0000","last_became_active":"2024-03-12T17:19:55.556529+0000","last_became_peered":"2024-03-12T17:19:55.556529+0000","last_unstale":"2024-03-12T17:19:56.536717+0000","last_undegraded":"2024-03-12T17:19:56.536717+0000","last_fullsized":"2024-03-12T17:19:56.536717+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:41:59.824480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.646174+0000","last_change":"2024-03-12T17:19:55.064664+0000","last_active":"2024-03-12T17:19:57.646174+0000","last_peered":"2024-03-12T17:19:57.646174+0000","last_clean":"2024-03-12T17:19:57.646174+0000","last_became_active":"2024-03-12T17:19:55.064408+0000","last_became_peered":"2024-03-12T17:19:55.064408+0000","last_unstale":"2024-03-12T17:19:57.646174+0000","last_undegraded":"2024-03-12T17:19:57.646174+0000","last_fullsized":"2024-03-12T17:19:57.646174+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:58:25.756646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.648289+0000","last_change":"2024-03-12T17:19:55.574860+0000","last_active":"2024-03-12T17:19:57.648289+0000","last_peered":"2024-03-12T17:19:57.648289+0000","last_clean":"2024-03-12T17:19:57.648289+0000","last_became_active":"2024-03-12T17:19:55.574578+0000","last_became_peered":"2024-03-12T17:19:55.574578+0000","last_unstale":"2024-03-12T17:19:57.648289+0000","last_undegraded":"2024-03-12T17:19:57.648289+0000","last_fullsized":"2024-03-12T17:19:57.648289+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:57:49.973122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.646217+0000","last_change":"2024-03-12T17:19:55.069825+0000","last_active":"2024-03-12T17:19:57.646217+0000","last_peered":"2024-03-12T17:19:57.646217+0000","last_clean":"2024-03-12T17:19:57.646217+0000","last_became_active":"2024-03-12T17:19:55.069532+0000","last_became_peered":"2024-03-12T17:19:55.069532+0000","last_unstale":"2024-03-12T17:19:57.646217+0000","last_undegraded":"2024-03-12T17:19:57.646217+0000","last_fullsized":"2024-03-12T17:19:57.646217+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:11:55.528608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.369379+0000","last_change":"2024-03-12T17:19:55.572654+0000","last_active":"2024-03-12T17:19:57.369379+0000","last_peered":"2024-03-12T17:19:57.369379+0000","last_clean":"2024-03-12T17:19:57.369379+0000","last_became_active":"2024-03-12T17:19:55.566942+0000","last_became_peered":"2024-03-12T17:19:55.566942+0000","last_unstale":"2024-03-12T17:19:57.369379+0000","last_undegraded":"2024-03-12T17:19:57.369379+0000","last_fullsized":"2024-03-12T17:19:57.369379+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:58:26.771851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.877208+0000","last_change":"2024-03-12T17:19:55.064318+0000","last_active":"2024-03-12T17:19:56.877208+0000","last_peered":"2024-03-12T17:19:56.877208+0000","last_clean":"2024-03-12T17:19:56.877208+0000","last_became_active":"2024-03-12T17:19:55.063836+0000","last_became_peered":"2024-03-12T17:19:55.063836+0000","last_unstale":"2024-03-12T17:19:56.877208+0000","last_undegraded":"2024-03-12T17:19:56.877208+0000","last_fullsized":"2024-03-12T17:19:56.877208+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:27:03.821934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.536945+0000","last_change":"2024-03-12T17:19:55.567084+0000","last_active":"2024-03-12T17:19:56.536945+0000","last_peered":"2024-03-12T17:19:56.536945+0000","last_clean":"2024-03-12T17:19:56.536945+0000","last_became_active":"2024-03-12T17:19:55.565056+0000","last_became_peered":"2024-03-12T17:19:55.565056+0000","last_unstale":"2024-03-12T17:19:56.536945+0000","last_undegraded":"2024-03-12T17:19:56.536945+0000","last_fullsized":"2024-03-12T17:19:56.536945+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:41:59.824480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.369496+0000","last_change":"2024-03-12T17:19:55.062826+0000","last_active":"2024-03-12T17:19:57.369496+0000","last_peered":"2024-03-12T17:19:57.369496+0000","last_clean":"2024-03-12T17:19:57.369496+0000","last_became_active":"2024-03-12T17:19:55.062613+0000","last_became_peered":"2024-03-12T17:19:55.062613+0000","last_unstale":"2024-03-12T17:19:57.369496+0000","last_undegraded":"2024-03-12T17:19:57.369496+0000","last_fullsized":"2024-03-12T17:19:57.369496+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:51:08.519751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.876312+0000","last_change":"2024-03-12T17:19:55.574242+0000","last_active":"2024-03-12T17:19:56.876312+0000","last_peered":"2024-03-12T17:19:56.876312+0000","last_clean":"2024-03-12T17:19:56.876312+0000","last_became_active":"2024-03-12T17:19:55.573999+0000","last_became_peered":"2024-03-12T17:19:55.573999+0000","last_unstale":"2024-03-12T17:19:56.876312+0000","last_undegraded":"2024-03-12T17:19:56.876312+0000","last_fullsized":"2024-03-12T17:19:56.876312+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:57:43.664364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.369496+0000","last_change":"2024-03-12T17:19:55.064563+0000","last_active":"2024-03-12T17:19:57.369496+0000","last_peered":"2024-03-12T17:19:57.369496+0000","last_clean":"2024-03-12T17:19:57.369496+0000","last_became_active":"2024-03-12T17:19:55.063936+0000","last_became_peered":"2024-03-12T17:19:55.063936+0000","last_unstale":"2024-03-12T17:19:57.369496+0000","last_undegraded":"2024-03-12T17:19:57.369496+0000","last_fullsized":"2024-03-12T17:19:57.369496+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:41:14.891860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.532656+0000","last_change":"2024-03-12T17:19:55.556504+0000","last_active":"2024-03-12T17:19:56.532656+0000","last_peered":"2024-03-12T17:19:56.532656+0000","last_clean":"2024-03-12T17:19:56.532656+0000","last_became_active":"2024-03-12T17:19:55.555694+0000","last_became_peered":"2024-03-12T17:19:55.555694+0000","last_unstale":"2024-03-12T17:19:56.532656+0000","last_undegraded":"2024-03-12T17:19:56.532656+0000","last_fullsized":"2024-03-12T17:19:56.532656+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T00:14:12.637775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.369635+0000","last_change":"2024-03-12T17:19:55.068813+0000","last_active":"2024-03-12T17:19:57.369635+0000","last_peered":"2024-03-12T17:19:57.369635+0000","last_clean":"2024-03-12T17:19:57.369635+0000","last_became_active":"2024-03-12T17:19:55.067406+0000","last_became_peered":"2024-03-12T17:19:55.067406+0000","last_unstale":"2024-03-12T17:19:57.369635+0000","last_undegraded":"2024-03-12T17:19:57.369635+0000","last_fullsized":"2024-03-12T17:19:57.369635+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:55:28.002748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.532350+0000","last_change":"2024-03-12T17:19:55.574331+0000","last_active":"2024-03-12T17:19:56.532350+0000","last_peered":"2024-03-12T17:19:56.532350+0000","last_clean":"2024-03-12T17:19:56.532350+0000","last_became_active":"2024-03-12T17:19:55.574085+0000","last_became_peered":"2024-03-12T17:19:55.574085+0000","last_unstale":"2024-03-12T17:19:56.532350+0000","last_undegraded":"2024-03-12T17:19:56.532350+0000","last_fullsized":"2024-03-12T17:19:56.532350+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:58:26.771851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.870525+0000","last_change":"2024-03-12T17:19:55.048881+0000","last_active":"2024-03-12T17:19:56.870525+0000","last_peered":"2024-03-12T17:19:56.870525+0000","last_clean":"2024-03-12T17:19:56.870525+0000","last_became_active":"2024-03-12T17:19:55.047277+0000","last_became_peered":"2024-03-12T17:19:55.047277+0000","last_unstale":"2024-03-12T17:19:56.870525+0000","last_undegraded":"2024-03-12T17:19:56.870525+0000","last_fullsized":"2024-03-12T17:19:56.870525+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:59:05.662117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.532435+0000","last_change":"2024-03-12T17:19:55.552248+0000","last_active":"2024-03-12T17:19:56.532435+0000","last_peered":"2024-03-12T17:19:56.532435+0000","last_clean":"2024-03-12T17:19:56.532435+0000","last_became_active":"2024-03-12T17:19:55.552057+0000","last_became_peered":"2024-03-12T17:19:55.552057+0000","last_unstale":"2024-03-12T17:19:56.532435+0000","last_undegraded":"2024-03-12T17:19:56.532435+0000","last_fullsized":"2024-03-12T17:19:56.532435+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:37:21.937511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.648460+0000","last_change":"2024-03-12T17:19:55.069135+0000","last_active":"2024-03-12T17:19:57.648460+0000","last_peered":"2024-03-12T17:19:57.648460+0000","last_clean":"2024-03-12T17:19:57.648460+0000","last_became_active":"2024-03-12T17:19:55.068823+0000","last_became_peered":"2024-03-12T17:19:55.068823+0000","last_unstale":"2024-03-12T17:19:57.648460+0000","last_undegraded":"2024-03-12T17:19:57.648460+0000","last_fullsized":"2024-03-12T17:19:57.648460+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:54:34.302800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.532616+0000","last_change":"2024-03-12T17:19:55.552307+0000","last_active":"2024-03-12T17:19:56.532616+0000","last_peered":"2024-03-12T17:19:56.532616+0000","last_clean":"2024-03-12T17:19:56.532616+0000","last_became_active":"2024-03-12T17:19:55.552054+0000","last_became_peered":"2024-03-12T17:19:55.552054+0000","last_unstale":"2024-03-12T17:19:56.532616+0000","last_undegraded":"2024-03-12T17:19:56.532616+0000","last_fullsized":"2024-03-12T17:19:56.532616+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:42:24.730105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.368890+0000","last_change":"2024-03-12T17:19:55.053466+0000","last_active":"2024-03-12T17:19:57.368890+0000","last_peered":"2024-03-12T17:19:57.368890+0000","last_clean":"2024-03-12T17:19:57.368890+0000","last_became_active":"2024-03-12T17:19:55.053059+0000","last_became_peered":"2024-03-12T17:19:55.053059+0000","last_unstale":"2024-03-12T17:19:57.368890+0000","last_undegraded":"2024-03-12T17:19:57.368890+0000","last_fullsized":"2024-03-12T17:19:57.368890+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:08:58.432164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.536880+0000","last_change":"2024-03-12T17:19:55.570514+0000","last_active":"2024-03-12T17:19:56.536880+0000","last_peered":"2024-03-12T17:19:56.536880+0000","last_clean":"2024-03-12T17:19:56.536880+0000","last_became_active":"2024-03-12T17:19:55.570158+0000","last_became_peered":"2024-03-12T17:19:55.570158+0000","last_unstale":"2024-03-12T17:19:56.536880+0000","last_undegraded":"2024-03-12T17:19:56.536880+0000","last_fullsized":"2024-03-12T17:19:56.536880+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:13:57.858538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.535102+0000","last_change":"2024-03-12T17:19:55.061401+0000","last_active":"2024-03-12T17:19:56.535102+0000","last_peered":"2024-03-12T17:19:56.535102+0000","last_clean":"2024-03-12T17:19:56.535102+0000","last_became_active":"2024-03-12T17:19:55.061121+0000","last_became_peered":"2024-03-12T17:19:55.061121+0000","last_unstale":"2024-03-12T17:19:56.535102+0000","last_undegraded":"2024-03-12T17:19:56.535102+0000","last_fullsized":"2024-03-12T17:19:56.535102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:59:05.662117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.532697+0000","last_change":"2024-03-12T17:19:55.547829+0000","last_active":"2024-03-12T17:19:56.532697+0000","last_peered":"2024-03-12T17:19:56.532697+0000","last_clean":"2024-03-12T17:19:56.532697+0000","last_became_active":"2024-03-12T17:19:55.547565+0000","last_became_peered":"2024-03-12T17:19:55.547565+0000","last_unstale":"2024-03-12T17:19:56.532697+0000","last_undegraded":"2024-03-12T17:19:56.532697+0000","last_fullsized":"2024-03-12T17:19:56.532697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:13:20.301998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.877252+0000","last_change":"2024-03-12T17:19:55.056996+0000","last_active":"2024-03-12T17:19:56.877252+0000","last_peered":"2024-03-12T17:19:56.877252+0000","last_clean":"2024-03-12T17:19:56.877252+0000","last_became_active":"2024-03-12T17:19:55.056418+0000","last_became_peered":"2024-03-12T17:19:55.056418+0000","last_unstale":"2024-03-12T17:19:56.877252+0000","last_undegraded":"2024-03-12T17:19:56.877252+0000","last_fullsized":"2024-03-12T17:19:56.877252+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:37:22.883310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.537158+0000","last_change":"2024-03-12T17:19:55.563452+0000","last_active":"2024-03-12T17:19:56.537158+0000","last_peered":"2024-03-12T17:19:56.537158+0000","last_clean":"2024-03-12T17:19:56.537158+0000","last_became_active":"2024-03-12T17:19:55.563105+0000","last_became_peered":"2024-03-12T17:19:55.563105+0000","last_unstale":"2024-03-12T17:19:56.537158+0000","last_undegraded":"2024-03-12T17:19:56.537158+0000","last_fullsized":"2024-03-12T17:19:56.537158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:59:20.544804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.874098+0000","last_change":"2024-03-12T17:19:55.057397+0000","last_active":"2024-03-12T17:19:56.874098+0000","last_peered":"2024-03-12T17:19:56.874098+0000","last_clean":"2024-03-12T17:19:56.874098+0000","last_became_active":"2024-03-12T17:19:55.057010+0000","last_became_peered":"2024-03-12T17:19:55.057010+0000","last_unstale":"2024-03-12T17:19:56.874098+0000","last_undegraded":"2024-03-12T17:19:56.874098+0000","last_fullsized":"2024-03-12T17:19:56.874098+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:13:19.286793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.870052+0000","last_change":"2024-03-12T17:19:55.561561+0000","last_active":"2024-03-12T17:19:56.870052+0000","last_peered":"2024-03-12T17:19:56.870052+0000","last_clean":"2024-03-12T17:19:56.870052+0000","last_became_active":"2024-03-12T17:19:55.560657+0000","last_became_peered":"2024-03-12T17:19:55.560657+0000","last_unstale":"2024-03-12T17:19:56.870052+0000","last_undegraded":"2024-03-12T17:19:56.870052+0000","last_fullsized":"2024-03-12T17:19:56.870052+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:27:04.837139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.877314+0000","last_change":"2024-03-12T17:19:55.057979+0000","last_active":"2024-03-12T17:19:56.877314+0000","last_peered":"2024-03-12T17:19:56.877314+0000","last_clean":"2024-03-12T17:19:56.877314+0000","last_became_active":"2024-03-12T17:19:55.050805+0000","last_became_peered":"2024-03-12T17:19:55.050805+0000","last_unstale":"2024-03-12T17:19:56.877314+0000","last_undegraded":"2024-03-12T17:19:56.877314+0000","last_fullsized":"2024-03-12T17:19:56.877314+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:58:25.756646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.647993+0000","last_change":"2024-03-12T17:19:55.561473+0000","last_active":"2024-03-12T17:19:57.647993+0000","last_peered":"2024-03-12T17:19:57.647993+0000","last_clean":"2024-03-12T17:19:57.647993+0000","last_became_active":"2024-03-12T17:19:55.560661+0000","last_became_peered":"2024-03-12T17:19:55.560661+0000","last_unstale":"2024-03-12T17:19:57.647993+0000","last_undegraded":"2024-03-12T17:19:57.647993+0000","last_fullsized":"2024-03-12T17:19:57.647993+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:27:04.837139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.870892+0000","last_change":"2024-03-12T17:19:55.056644+0000","last_active":"2024-03-12T17:19:56.870892+0000","last_peered":"2024-03-12T17:19:56.870892+0000","last_clean":"2024-03-12T17:19:56.870892+0000","last_became_active":"2024-03-12T17:19:55.053235+0000","last_became_peered":"2024-03-12T17:19:55.053235+0000","last_unstale":"2024-03-12T17:19:56.870892+0000","last_undegraded":"2024-03-12T17:19:56.870892+0000","last_fullsized":"2024-03-12T17:19:56.870892+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:54:34.302800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.870602+0000","last_change":"2024-03-12T17:19:55.564848+0000","last_active":"2024-03-12T17:19:56.870602+0000","last_peered":"2024-03-12T17:19:56.870602+0000","last_clean":"2024-03-12T17:19:56.870602+0000","last_became_active":"2024-03-12T17:19:55.564603+0000","last_became_peered":"2024-03-12T17:19:55.564603+0000","last_unstale":"2024-03-12T17:19:56.870602+0000","last_undegraded":"2024-03-12T17:19:56.870602+0000","last_fullsized":"2024-03-12T17:19:56.870602+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T00:14:12.637775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.876214+0000","last_change":"2024-03-12T17:19:55.053638+0000","last_active":"2024-03-12T17:19:56.876214+0000","last_peered":"2024-03-12T17:19:56.876214+0000","last_clean":"2024-03-12T17:19:56.876214+0000","last_became_active":"2024-03-12T17:19:55.052357+0000","last_became_peered":"2024-03-12T17:19:55.052357+0000","last_unstale":"2024-03-12T17:19:56.876214+0000","last_undegraded":"2024-03-12T17:19:56.876214+0000","last_fullsized":"2024-03-12T17:19:56.876214+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:37:20.922305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.646333+0000","last_change":"2024-03-12T17:19:55.557968+0000","last_active":"2024-03-12T17:19:57.646333+0000","last_peered":"2024-03-12T17:19:57.646333+0000","last_clean":"2024-03-12T17:19:57.646333+0000","last_became_active":"2024-03-12T17:19:55.557663+0000","last_became_peered":"2024-03-12T17:19:55.557663+0000","last_unstale":"2024-03-12T17:19:57.646333+0000","last_undegraded":"2024-03-12T17:19:57.646333+0000","last_fullsized":"2024-03-12T17:19:57.646333+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:12:38.840849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.369114+0000","last_change":"2024-03-12T17:19:55.062184+0000","last_active":"2024-03-12T17:19:57.369114+0000","last_peered":"2024-03-12T17:19:57.369114+0000","last_clean":"2024-03-12T17:19:57.369114+0000","last_became_active":"2024-03-12T17:19:55.059523+0000","last_became_peered":"2024-03-12T17:19:55.059523+0000","last_unstale":"2024-03-12T17:19:57.369114+0000","last_undegraded":"2024-03-12T17:19:57.369114+0000","last_fullsized":"2024-03-12T17:19:57.369114+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:20:15.689939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.368715+0000","last_change":"2024-03-12T17:19:55.560295+0000","last_active":"2024-03-12T17:19:57.368715+0000","last_peered":"2024-03-12T17:19:57.368715+0000","last_clean":"2024-03-12T17:19:57.368715+0000","last_became_active":"2024-03-12T17:19:55.559990+0000","last_became_peered":"2024-03-12T17:19:55.559990+0000","last_unstale":"2024-03-12T17:19:57.368715+0000","last_undegraded":"2024-03-12T17:19:57.368715+0000","last_fullsized":"2024-03-12T17:19:57.368715+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:13:29.308675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.646435+0000","last_change":"2024-03-12T17:19:55.061814+0000","last_active":"2024-03-12T17:19:57.646435+0000","last_peered":"2024-03-12T17:19:57.646435+0000","last_clean":"2024-03-12T17:19:57.646435+0000","last_became_active":"2024-03-12T17:19:55.061516+0000","last_became_peered":"2024-03-12T17:19:55.061516+0000","last_unstale":"2024-03-12T17:19:57.646435+0000","last_undegraded":"2024-03-12T17:19:57.646435+0000","last_fullsized":"2024-03-12T17:19:57.646435+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:27:03.821934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.537306+0000","last_change":"2024-03-12T17:19:55.571056+0000","last_active":"2024-03-12T17:19:56.537306+0000","last_peered":"2024-03-12T17:19:56.537306+0000","last_clean":"2024-03-12T17:19:56.537306+0000","last_became_active":"2024-03-12T17:19:55.570748+0000","last_became_peered":"2024-03-12T17:19:55.570748+0000","last_unstale":"2024-03-12T17:19:56.537306+0000","last_undegraded":"2024-03-12T17:19:56.537306+0000","last_fullsized":"2024-03-12T17:19:56.537306+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:02:56.923259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.648364+0000","last_change":"2024-03-12T17:19:55.063245+0000","last_active":"2024-03-12T17:19:57.648364+0000","last_peered":"2024-03-12T17:19:57.648364+0000","last_clean":"2024-03-12T17:19:57.648364+0000","last_became_active":"2024-03-12T17:19:55.062409+0000","last_became_peered":"2024-03-12T17:19:55.062409+0000","last_unstale":"2024-03-12T17:19:57.648364+0000","last_undegraded":"2024-03-12T17:19:57.648364+0000","last_fullsized":"2024-03-12T17:19:57.648364+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:13:19.286793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":174,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-12T17:19:55.544239+0000","last_change":"2024-03-12T17:18:41.331756+0000","last_active":"2024-03-12T17:19:55.544239+0000","last_peered":"2024-03-12T17:19:55.544239+0000","last_clean":"2024-03-12T17:19:55.544239+0000","last_became_active":"2024-03-12T17:18:41.329237+0000","last_became_peered":"2024-03-12T17:18:41.329237+0000","last_unstale":"2024-03-12T17:19:55.544239+0000","last_undegraded":"2024-03-12T17:19:55.544239+0000","last_fullsized":"2024-03-12T17:19:55.544239+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:40.152422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:40.152422+0000","last_clean_scrub_stamp":"2024-03-12T17:18:40.152422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:35:43.664403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":995328,"data_stored":747024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.76000000000000001}]},{"osd":1,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.0600000000000001}]},{"osd":2,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":1.2509999999999999}]},{"osd":3,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":1.4139999999999999}]},{"osd":4,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.347},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":2.2490000000000001,"5min":2.2490000000000001,"15min":2.2490000000000001},"last":1.393}]},{"osd":5,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.1909999999999998,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.496},{"interface":"front","average":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":3.9689999999999999,"5min":3.9689999999999999,"15min":3.9689999999999999},"last":1.1799999999999999}]},{"osd":6,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":3.8319999999999999,"5min":3.8319999999999999,"15min":3.8319999999999999},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":1.1200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31512,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340328,"statfs":{"total":96636764160,"available":96604495872,"internally_reserved":0,"allocated":405504,"data_stored":157182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.5390000000000001,"5min":3.5390000000000001,"15min":3.5390000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.93999999999999995}]},{"osd":1,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.78500000000000003},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":1.206}]},{"osd":2,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.9689999999999999,"5min":2.9689999999999999,"15min":2.9689999999999999},"last":1.141}]},{"osd":3,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.077},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.88200000000000001}]},{"osd":4,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.256},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.2330000000000001}]},{"osd":5,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.8660000000000001,"5min":2.8660000000000001,"15min":2.8660000000000001},"last":1.173},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.931,"5min":2.931,"15min":2.931},"last":1.0349999999999999}]},{"osd":7,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":1.98,"5min":1.98,"15min":1.98},"last":1.286}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":405504,"data_stored":157238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.284},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.8149999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.109}]},{"osd":1,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":1.155},{"interface":"front","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":2.5699999999999998,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":1.548}]},{"osd":2,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.613,"5min":2.613,"15min":2.613},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.359,"5min":2.359,"15min":2.359},"last":1.462}]},{"osd":3,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":1.5980000000000001},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":2.0670000000000002,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":1.2030000000000001}]},{"osd":4,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.25},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.4279999999999999}]},{"osd":6,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":2.4609999999999999,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":1.397},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.371}]},{"osd":7,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"min":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"max":{"1min":2.8700000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.494},{"interface":"front","average":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"min":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"max":{"1min":2.722,"5min":2.722,"15min":2.722},"last":1.337}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":405504,"data_stored":156670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":4.8979999999999997,"5min":4.8979999999999997,"15min":4.8979999999999997},"last":1.788},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":4.8300000000000001,"5min":4.8300000000000001,"15min":4.8300000000000001},"last":1.3620000000000001}]},{"osd":1,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":4.7779999999999996,"5min":4.7779999999999996,"15min":4.7779999999999996},"last":1.8540000000000001},{"interface":"front","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":1.911}]},{"osd":2,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.7450000000000001},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.3220000000000001,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":1.994}]},{"osd":3,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.6879999999999999}]},{"osd":5,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.6539999999999999},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":2.1850000000000001}]},{"osd":6,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":2.4750000000000001,"5min":2.4750000000000001,"15min":2.4750000000000001},"last":2.077}]},{"osd":7,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.9550000000000001},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.4260000000000002,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":2.056}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":413696,"data_stored":158152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.9580000000000002,"5min":2.9580000000000002,"15min":2.9580000000000002},"last":0.499},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":3.9940000000000002,"5min":3.9940000000000002,"15min":3.9940000000000002},"last":0.58599999999999997}]},{"osd":1,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":4.774,"5min":4.774,"15min":4.774},"last":0.622},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":5.0069999999999997,"5min":5.0069999999999997,"15min":5.0069999999999997},"last":0.71399999999999997}]},{"osd":2,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":2.4660000000000002,"5min":2.4660000000000002,"15min":2.4660000000000002},"last":0.68700000000000006},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":4.5650000000000004,"5min":4.5650000000000004,"15min":4.5650000000000004},"last":0.749}]},{"osd":4,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.482,"15min":1.482},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":2.8860000000000001,"5min":2.8860000000000001,"15min":2.8860000000000001},"last":1.123},{"interface":"front","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":4.3520000000000003,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":0.81200000000000006}]},{"osd":5,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":2.843,"5min":2.843,"15min":2.843},"last":0.874},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.8149999999999999,"5min":2.8149999999999999,"15min":2.8149999999999999},"last":1.099}]},{"osd":6,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":2.9199999999999999,"5min":2.9199999999999999,"15min":2.9199999999999999},"last":1.028},{"interface":"front","average":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":2.6589999999999998,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.05}]},{"osd":7,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"min":{"1min":1.006,"5min":1.006,"15min":1.006},"max":{"1min":4.6600000000000001,"5min":4.6600000000000001,"15min":4.6600000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.599,"5min":1.599,"15min":1.599},"min":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"max":{"1min":4.4720000000000004,"5min":4.4720000000000004,"15min":4.4720000000000004},"last":1.0740000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31516,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340324,"statfs":{"total":96636764160,"available":96604491776,"internally_reserved":0,"allocated":401408,"data_stored":156636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":3.1829999999999998,"5min":3.1829999999999998,"15min":3.1829999999999998},"last":0.75900000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.45}]},{"osd":1,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":3.1019999999999999,"5min":3.1019999999999999,"15min":3.1019999999999999},"last":1.2749999999999999}]},{"osd":3,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":2.7810000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":3.1419999999999999,"5min":3.1419999999999999,"15min":3.1419999999999999},"last":1.833}]},{"osd":4,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.643,"5min":1.643,"15min":1.643},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":7.96,"5min":7.96,"15min":7.96},"last":1.52},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":3.3780000000000001,"5min":3.3780000000000001,"15min":3.3780000000000001},"last":1.347}]},{"osd":5,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":4.0659999999999998,"5min":4.0659999999999998,"15min":4.0659999999999998},"last":1.571},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":3.012,"5min":3.012,"15min":3.012},"last":1.6180000000000001}]},{"osd":6,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":3.2330000000000001,"5min":3.2330000000000001,"15min":3.2330000000000001},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.804,"5min":1.804,"15min":1.804},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":7.9059999999999997,"5min":7.9059999999999997,"15min":7.9059999999999997},"last":1.7070000000000001}]},{"osd":7,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":4.0229999999999997,"5min":4.0229999999999997,"15min":4.0229999999999997},"last":1.671},{"interface":"front","average":{"1min":1.506,"5min":1.506,"15min":1.506},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":3.27,"5min":3.27,"15min":3.27},"last":1.744}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":413696,"data_stored":158152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.581,"5min":2.581,"15min":2.581},"last":1.115}]},{"osd":2,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.5720000000000001,"5min":2.5720000000000001,"15min":2.5720000000000001},"last":1.0469999999999999}]},{"osd":3,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.4580000000000002,"5min":2.4580000000000002,"15min":2.4580000000000002},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.208,"5min":1.208,"15min":1.208},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.9609999999999999,"5min":2.9609999999999999,"15min":2.9609999999999999},"last":1.2370000000000001}]},{"osd":4,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":2.4580000000000002,"5min":2.4580000000000002,"15min":2.4580000000000002},"last":1.5820000000000001},{"interface":"front","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.6909999999999998,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":1.387}]},{"osd":5,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":3.0609999999999999,"5min":3.0609999999999999,"15min":3.0609999999999999},"last":1.425},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":1.4630000000000001}]},{"osd":6,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":3.1030000000000002,"5min":3.1030000000000002,"15min":3.1030000000000002},"last":1.671},{"interface":"front","average":{"1min":1.395,"5min":1.395,"15min":1.395},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.274,"5min":2.274,"15min":2.274},"last":1.329}]},{"osd":7,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.7959999999999998,"5min":2.7959999999999998,"15min":2.7959999999999998},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.55,"5min":1.55,"15min":1.55},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":3.1440000000000001,"5min":3.1440000000000001,"15min":3.1440000000000001},"last":1.5329999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":991232,"data_stored":746934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.127}]},{"osd":2,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.99,"5min":1.99,"15min":1.99},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":1.276}]},{"osd":3,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":1.0529999999999999}]},{"osd":4,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":3.2349999999999999,"5min":3.2349999999999999,"15min":3.2349999999999999},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":2.5369999999999999,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":1.327}]},{"osd":5,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.988,"5min":2.988,"15min":2.988},"last":1.8979999999999999},{"interface":"front","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.843,"5min":2.843,"15min":2.843},"last":1.004}]},{"osd":6,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":2.431,"5min":2.431,"15min":2.431},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.589,"5min":2.589,"15min":2.589},"last":1.9910000000000001}]},{"osd":7,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.637,"5min":1.637,"15min":1.637},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":2.0489999999999999},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":2.8929999999999998,"5min":2.8929999999999998,"15min":2.8929999999999998},"last":1.0960000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-12T17:19:59.968 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-12T17:20:00.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.237+0000 7fb815e00640 1 Processor -- start 2024-03-12T17:20:00.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.237+0000 7fb815e00640 1 -- start start 2024-03-12T17:20:00.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.238+0000 7fb815e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb81015ce80 0x7fb8100cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:00.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.238+0000 7fb815e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb8100b85f0 0x7fb8100cf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:00.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.238+0000 7fb815e00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb810161650 con 0x7fb81015caa0 2024-03-12T17:20:00.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.238+0000 7fb815e00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb810160ea0 con 0x7fb8100b85f0 2024-03-12T17:20:00.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.238+0000 7fb815e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb810161090 con 0x7fb81015ce80 2024-03-12T17:20:00.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.239+0000 7fb815400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb8100b85f0 0x7fb8100cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:00.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.239+0000 7fb815400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb8100b85f0 0x7fb8100cf870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50680/0 (socket says 172.21.15.17:50680) 2024-03-12T17:20:00.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.239+0000 7fb815400640 1 -- 172.21.15.17:0/3334448302 learned_addr learned my addr 172.21.15.17:0/3334448302 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:00.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.239+0000 7fb80fe00640 1 --2- 172.21.15.17:0/3334448302 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb81015ce80 0x7fb8100cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:00.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.239+0000 7fb815400640 1 -- 172.21.15.17:0/3334448302 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb81015ce80 msgr2=0x7fb8100cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:00.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.239+0000 7fb815400640 1 --2- 172.21.15.17:0/3334448302 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb81015ce80 0x7fb8100cf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:00.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.239+0000 7fb815400640 1 -- 172.21.15.17:0/3334448302 >> v1:172.21.15.17:6789/0 conn(0x7fb81015caa0 legacy=0x7fb810160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:00.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.239+0000 7fb815400640 1 -- 172.21.15.17:0/3334448302 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb810161370 con 0x7fb8100b85f0 2024-03-12T17:20:00.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.241+0000 7fb815400640 1 --2- 172.21.15.17:0/3334448302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8100b85f0 0x7fb8100cf870 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb808009870 tx=0x7fb80802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99268b01fe489d37 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:00.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.241+0000 7fb80f400640 1 -- 172.21.15.17:0/3334448302 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb808030840 con 0x7fb8100b85f0 2024-03-12T17:20:00.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.241+0000 7fb80f400640 1 -- 172.21.15.17:0/3334448302 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8080309a0 con 0x7fb8100b85f0 2024-03-12T17:20:00.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.241+0000 7fb80f400640 1 -- 172.21.15.17:0/3334448302 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb808030d30 con 0x7fb8100b85f0 2024-03-12T17:20:00.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.242+0000 7fb815e00640 1 -- 172.21.15.17:0/3334448302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8100b85f0 msgr2=0x7fb8100cf870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:00.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.242+0000 7fb815e00640 1 --2- 172.21.15.17:0/3334448302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8100b85f0 0x7fb8100cf870 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb808009870 tx=0x7fb80802b980 comp rx=0 tx=0).stop 2024-03-12T17:20:00.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.242+0000 7fb815e00640 1 -- 172.21.15.17:0/3334448302 shutdown_connections 2024-03-12T17:20:00.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.242+0000 7fb815e00640 1 --2- 172.21.15.17:0/3334448302 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb8100b85f0 0x7fb8100cf870 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:00.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.242+0000 7fb815e00640 1 --2- 172.21.15.17:0/3334448302 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb81015ce80 0x7fb8100cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:00.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.242+0000 7fb815e00640 1 -- 172.21.15.17:0/3334448302 >> 172.21.15.17:0/3334448302 conn(0x7fb81006b160 msgr2=0x7fb81006b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:00.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.242+0000 7fb815e00640 1 -- 172.21.15.17:0/3334448302 shutdown_connections 2024-03-12T17:20:00.237 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.242+0000 7fb815e00640 1 -- 172.21.15.17:0/3334448302 wait complete. 2024-03-12T17:20:00.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.244+0000 7fb815e00640 1 Processor -- start 2024-03-12T17:20:00.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.244+0000 7fb815e00640 1 -- start start 2024-03-12T17:20:00.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.245+0000 7fb815e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8100b85f0 0x7fb8100ca270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:00.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.245+0000 7fb815e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb81015caa0 0x7fb810156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:00.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.245+0000 7fb815e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb81015ce80 0x7fb8100b6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:00.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.245+0000 7fb815e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8100caac0 con 0x7fb81015ce80 2024-03-12T17:20:00.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.245+0000 7fb815e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8100cada0 con 0x7fb8100b85f0 2024-03-12T17:20:00.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.245+0000 7fb815e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8100cb080 con 0x7fb81015caa0 2024-03-12T17:20:00.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.245+0000 7fb815400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb81015ce80 0x7fb8100b6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:00.240 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.245+0000 7fb815400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb81015ce80 0x7fb8100b6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50692/0 (socket says 172.21.15.17:50692) 2024-03-12T17:20:00.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.245+0000 7fb815400640 1 -- 172.21.15.17:0/2810144474 learned_addr learned my addr 172.21.15.17:0/2810144474 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:00.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.246+0000 7fb80fe00640 1 --2- 172.21.15.17:0/2810144474 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb81015caa0 0x7fb810156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:00.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.246+0000 7fb814a00640 1 --2- 172.21.15.17:0/2810144474 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8100b85f0 0x7fb8100ca270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:00.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.246+0000 7fb815400640 1 -- 172.21.15.17:0/2810144474 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb81015caa0 msgr2=0x7fb810156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:00.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.246+0000 7fb815400640 1 --2- 172.21.15.17:0/2810144474 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb81015caa0 0x7fb810156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:00.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.246+0000 7fb815400640 1 -- 172.21.15.17:0/2810144474 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8100b85f0 msgr2=0x7fb8100ca270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:00.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.246+0000 7fb815400640 1 --2- 172.21.15.17:0/2810144474 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8100b85f0 0x7fb8100ca270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:00.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.246+0000 7fb815400640 1 -- 172.21.15.17:0/2810144474 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8080094d0 con 0x7fb81015ce80 2024-03-12T17:20:00.241 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.246+0000 7fb814a00640 1 --2- 172.21.15.17:0/2810144474 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8100b85f0 0x7fb8100ca270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:00.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.246+0000 7fb815400640 1 --2- 172.21.15.17:0/2810144474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb81015ce80 0x7fb8100b6580 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb808009870 tx=0x7fb808004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:00.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.247+0000 7fb80cc00640 1 -- 172.21.15.17:0/2810144474 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb808039c90 con 0x7fb81015ce80 2024-03-12T17:20:00.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.247+0000 7fb80cc00640 1 -- 172.21.15.17:0/2810144474 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb808039e10 con 0x7fb81015ce80 2024-03-12T17:20:00.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.247+0000 7fb80cc00640 1 -- 172.21.15.17:0/2810144474 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb808043640 con 0x7fb81015ce80 2024-03-12T17:20:00.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.247+0000 7fb815e00640 1 -- 172.21.15.17:0/2810144474 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8100cb360 con 0x7fb81015ce80 2024-03-12T17:20:00.242 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.247+0000 7fb815e00640 1 -- 172.21.15.17:0/2810144474 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8100ca7b0 con 0x7fb81015ce80 2024-03-12T17:20:00.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.248+0000 7fb815e00640 1 -- 172.21.15.17:0/2810144474 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb810072360 con 0x7fb81015ce80 2024-03-12T17:20:00.243 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.249+0000 7fb80cc00640 1 -- 172.21.15.17:0/2810144474 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fb8080437a0 con 0x7fb81015ce80 2024-03-12T17:20:00.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.250+0000 7fb80cc00640 1 --2- 172.21.15.17:0/2810144474 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb7f006ac00 0x7fb7f006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:00.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.250+0000 7fb80cc00640 1 -- 172.21.15.17:0/2810144474 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb80803e070 con 0x7fb81015ce80 2024-03-12T17:20:00.244 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.250+0000 7fb814a00640 1 --2- 172.21.15.17:0/2810144474 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb7f006ac00 0x7fb7f006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:00.245 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.251+0000 7fb814a00640 1 --2- 172.21.15.17:0/2810144474 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb7f006ac00 0x7fb7f006d0c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb8000012e0 tx=0x7fb800009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:00.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.254+0000 7fb80cc00640 1 -- 172.21.15.17:0/2810144474 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fb808077620 con 0x7fb81015ce80 2024-03-12T17:20:00.444 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.450+0000 7fb815e00640 1 -- 172.21.15.17:0/2810144474 --> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb8100caf10 con 0x7fb7f006ac00 2024-03-12T17:20:00.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.459+0000 7fb80cc00640 1 -- 172.21.15.17:0/2810144474 <== mgr.4104 v2:172.21.15.17:6832/37052 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287205 (secure 0 0 0) 0x7fb8100caf10 con 0x7fb7f006ac00 2024-03-12T17:20:00.457 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:20:00.459 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-03-12T17:20:00.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.464+0000 7fb815e00640 1 -- 172.21.15.17:0/2810144474 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb7f006ac00 msgr2=0x7fb7f006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:00.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.464+0000 7fb815e00640 1 --2- 172.21.15.17:0/2810144474 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb7f006ac00 0x7fb7f006d0c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb8000012e0 tx=0x7fb800009040 comp rx=0 tx=0).stop 2024-03-12T17:20:00.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.464+0000 7fb815e00640 1 -- 172.21.15.17:0/2810144474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb81015ce80 msgr2=0x7fb8100b6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:00.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.464+0000 7fb815e00640 1 --2- 172.21.15.17:0/2810144474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb81015ce80 0x7fb8100b6580 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb808009870 tx=0x7fb808004730 comp rx=0 tx=0).stop 2024-03-12T17:20:00.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.465+0000 7fb815e00640 1 -- 172.21.15.17:0/2810144474 shutdown_connections 2024-03-12T17:20:00.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.465+0000 7fb815e00640 1 --2- 172.21.15.17:0/2810144474 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb7f006ac00 0x7fb7f006d0c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:00.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.465+0000 7fb815e00640 1 --2- 172.21.15.17:0/2810144474 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb81015ce80 0x7fb8100b6580 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:00.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.465+0000 7fb815e00640 1 --2- 172.21.15.17:0/2810144474 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb81015caa0 0x7fb810156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:00.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.465+0000 7fb815e00640 1 --2- 172.21.15.17:0/2810144474 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb8100b85f0 0x7fb8100ca270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:00.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.465+0000 7fb815e00640 1 -- 172.21.15.17:0/2810144474 >> 172.21.15.17:0/2810144474 conn(0x7fb81006b160 msgr2=0x7fb8100b77a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:00.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.465+0000 7fb815e00640 1 -- 172.21.15.17:0/2810144474 shutdown_connections 2024-03-12T17:20:00.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.465+0000 7fb815e00640 1 -- 172.21.15.17:0/2810144474 wait complete. 2024-03-12T17:20:00.477 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-03-12T17:19:59.498758+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":98,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253304,"kb_used_data":4328,"kb_used_omap":13,"kb_used_meta":248818,"kb_avail":754721416,"statfs":{"total":773094113280,"available":772834729984,"internally_reserved":0,"allocated":4431872,"data_stored":2437988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":254789720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":31,"apply_latency_ms":31,"commit_latency_ns":31000000,"apply_latency_ns":31000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.485904"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.648564+0000","last_change":"2024-03-12T17:19:55.567062+0000","last_active":"2024-03-12T17:19:57.648564+0000","last_peered":"2024-03-12T17:19:57.648564+0000","last_clean":"2024-03-12T17:19:57.648564+0000","last_became_active":"2024-03-12T17:19:55.566776+0000","last_became_peered":"2024-03-12T17:19:55.566776+0000","last_unstale":"2024-03-12T17:19:57.648564+0000","last_undegraded":"2024-03-12T17:19:57.648564+0000","last_fullsized":"2024-03-12T17:19:57.648564+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T00:14:12.637775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.647102+0000","last_change":"2024-03-12T17:19:55.546637+0000","last_active":"2024-03-12T17:19:57.647102+0000","last_peered":"2024-03-12T17:19:57.647102+0000","last_clean":"2024-03-12T17:19:57.647102+0000","last_became_active":"2024-03-12T17:19:55.546372+0000","last_became_peered":"2024-03-12T17:19:55.546372+0000","last_unstale":"2024-03-12T17:19:57.647102+0000","last_undegraded":"2024-03-12T17:19:57.647102+0000","last_fullsized":"2024-03-12T17:19:57.647102+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:42:43.334658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.535830+0000","last_change":"2024-03-12T17:19:55.564113+0000","last_active":"2024-03-12T17:19:56.535830+0000","last_peered":"2024-03-12T17:19:56.535830+0000","last_clean":"2024-03-12T17:19:56.535830+0000","last_became_active":"2024-03-12T17:19:55.563811+0000","last_became_peered":"2024-03-12T17:19:55.563811+0000","last_unstale":"2024-03-12T17:19:56.535830+0000","last_undegraded":"2024-03-12T17:19:56.535830+0000","last_fullsized":"2024-03-12T17:19:56.535830+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:36:01.074245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.876290+0000","last_change":"2024-03-12T17:19:55.574347+0000","last_active":"2024-03-12T17:19:56.876290+0000","last_peered":"2024-03-12T17:19:56.876290+0000","last_clean":"2024-03-12T17:19:56.876290+0000","last_became_active":"2024-03-12T17:19:55.574094+0000","last_became_peered":"2024-03-12T17:19:55.574094+0000","last_unstale":"2024-03-12T17:19:56.876290+0000","last_undegraded":"2024-03-12T17:19:56.876290+0000","last_fullsized":"2024-03-12T17:19:56.876290+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:42:43.334658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.532265+0000","last_change":"2024-03-12T17:19:55.540070+0000","last_active":"2024-03-12T17:19:56.532265+0000","last_peered":"2024-03-12T17:19:56.532265+0000","last_clean":"2024-03-12T17:19:56.532265+0000","last_became_active":"2024-03-12T17:19:55.539372+0000","last_became_peered":"2024-03-12T17:19:55.539372+0000","last_unstale":"2024-03-12T17:19:56.532265+0000","last_undegraded":"2024-03-12T17:19:56.532265+0000","last_fullsized":"2024-03-12T17:19:56.532265+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:37:23.898515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.645967+0000","last_change":"2024-03-12T17:19:55.546362+0000","last_active":"2024-03-12T17:19:57.645967+0000","last_peered":"2024-03-12T17:19:57.645967+0000","last_clean":"2024-03-12T17:19:57.645967+0000","last_became_active":"2024-03-12T17:19:55.545771+0000","last_became_peered":"2024-03-12T17:19:55.545771+0000","last_unstale":"2024-03-12T17:19:57.645967+0000","last_undegraded":"2024-03-12T17:19:57.645967+0000","last_fullsized":"2024-03-12T17:19:57.645967+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:36:22.768353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.537514+0000","last_change":"2024-03-12T17:19:55.559965+0000","last_active":"2024-03-12T17:19:56.537514+0000","last_peered":"2024-03-12T17:19:56.537514+0000","last_clean":"2024-03-12T17:19:56.537514+0000","last_became_active":"2024-03-12T17:19:55.559700+0000","last_became_peered":"2024-03-12T17:19:55.559700+0000","last_unstale":"2024-03-12T17:19:56.537514+0000","last_undegraded":"2024-03-12T17:19:56.537514+0000","last_fullsized":"2024-03-12T17:19:56.537514+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:42:29.462692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.536356+0000","last_change":"2024-03-12T17:19:55.554600+0000","last_active":"2024-03-12T17:19:56.536356+0000","last_peered":"2024-03-12T17:19:56.536356+0000","last_clean":"2024-03-12T17:19:56.536356+0000","last_became_active":"2024-03-12T17:19:55.554131+0000","last_became_peered":"2024-03-12T17:19:55.554131+0000","last_unstale":"2024-03-12T17:19:56.536356+0000","last_undegraded":"2024-03-12T17:19:56.536356+0000","last_fullsized":"2024-03-12T17:19:56.536356+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:57:43.664364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.370005+0000","last_change":"2024-03-12T17:19:55.564475+0000","last_active":"2024-03-12T17:19:57.370005+0000","last_peered":"2024-03-12T17:19:57.370005+0000","last_clean":"2024-03-12T17:19:57.370005+0000","last_became_active":"2024-03-12T17:19:55.564197+0000","last_became_peered":"2024-03-12T17:19:55.564197+0000","last_unstale":"2024-03-12T17:19:57.370005+0000","last_undegraded":"2024-03-12T17:19:57.370005+0000","last_fullsized":"2024-03-12T17:19:57.370005+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T00:14:12.637775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.876917+0000","last_change":"2024-03-12T17:19:55.555557+0000","last_active":"2024-03-12T17:19:56.876917+0000","last_peered":"2024-03-12T17:19:56.876917+0000","last_clean":"2024-03-12T17:19:56.876917+0000","last_became_active":"2024-03-12T17:19:55.555250+0000","last_became_peered":"2024-03-12T17:19:55.555250+0000","last_unstale":"2024-03-12T17:19:56.876917+0000","last_undegraded":"2024-03-12T17:19:56.876917+0000","last_fullsized":"2024-03-12T17:19:56.876917+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:02:38.287352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.537386+0000","last_change":"2024-03-12T17:19:55.561064+0000","last_active":"2024-03-12T17:19:56.537386+0000","last_peered":"2024-03-12T17:19:56.537386+0000","last_clean":"2024-03-12T17:19:56.537386+0000","last_became_active":"2024-03-12T17:19:55.560773+0000","last_became_peered":"2024-03-12T17:19:55.560773+0000","last_unstale":"2024-03-12T17:19:56.537386+0000","last_undegraded":"2024-03-12T17:19:56.537386+0000","last_fullsized":"2024-03-12T17:19:56.537386+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:53:38.898344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.535621+0000","last_change":"2024-03-12T17:19:55.553246+0000","last_active":"2024-03-12T17:19:56.535621+0000","last_peered":"2024-03-12T17:19:56.535621+0000","last_clean":"2024-03-12T17:19:56.535621+0000","last_became_active":"2024-03-12T17:19:55.552743+0000","last_became_peered":"2024-03-12T17:19:55.552743+0000","last_unstale":"2024-03-12T17:19:56.535621+0000","last_undegraded":"2024-03-12T17:19:56.535621+0000","last_fullsized":"2024-03-12T17:19:56.535621+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:53:38.898344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.532265+0000","last_change":"2024-03-12T17:19:55.561851+0000","last_active":"2024-03-12T17:19:56.532265+0000","last_peered":"2024-03-12T17:19:56.532265+0000","last_clean":"2024-03-12T17:19:56.532265+0000","last_became_active":"2024-03-12T17:19:55.561013+0000","last_became_peered":"2024-03-12T17:19:55.561013+0000","last_unstale":"2024-03-12T17:19:56.532265+0000","last_undegraded":"2024-03-12T17:19:56.532265+0000","last_fullsized":"2024-03-12T17:19:56.532265+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:27:04.837139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.646163+0000","last_change":"2024-03-12T17:19:55.553729+0000","last_active":"2024-03-12T17:19:57.646163+0000","last_peered":"2024-03-12T17:19:57.646163+0000","last_clean":"2024-03-12T17:19:57.646163+0000","last_became_active":"2024-03-12T17:19:55.553224+0000","last_became_peered":"2024-03-12T17:19:55.553224+0000","last_unstale":"2024-03-12T17:19:57.646163+0000","last_undegraded":"2024-03-12T17:19:57.646163+0000","last_fullsized":"2024-03-12T17:19:57.646163+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:41:59.824480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.535461+0000","last_change":"2024-03-12T17:19:55.565221+0000","last_active":"2024-03-12T17:19:56.535461+0000","last_peered":"2024-03-12T17:19:56.535461+0000","last_clean":"2024-03-12T17:19:56.535461+0000","last_became_active":"2024-03-12T17:19:55.564945+0000","last_became_peered":"2024-03-12T17:19:55.564945+0000","last_unstale":"2024-03-12T17:19:56.535461+0000","last_undegraded":"2024-03-12T17:19:56.535461+0000","last_fullsized":"2024-03-12T17:19:56.535461+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:02:56.923259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.537192+0000","last_change":"2024-03-12T17:19:55.554143+0000","last_active":"2024-03-12T17:19:56.537192+0000","last_peered":"2024-03-12T17:19:56.537192+0000","last_clean":"2024-03-12T17:19:56.537192+0000","last_became_active":"2024-03-12T17:19:55.553817+0000","last_became_peered":"2024-03-12T17:19:55.553817+0000","last_unstale":"2024-03-12T17:19:56.537192+0000","last_undegraded":"2024-03-12T17:19:56.537192+0000","last_fullsized":"2024-03-12T17:19:56.537192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:42:43.334658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.538039+0000","last_change":"2024-03-12T17:19:55.559779+0000","last_active":"2024-03-12T17:19:56.538039+0000","last_peered":"2024-03-12T17:19:56.538039+0000","last_clean":"2024-03-12T17:19:56.538039+0000","last_became_active":"2024-03-12T17:19:55.559466+0000","last_became_peered":"2024-03-12T17:19:55.559466+0000","last_unstale":"2024-03-12T17:19:56.538039+0000","last_undegraded":"2024-03-12T17:19:56.538039+0000","last_fullsized":"2024-03-12T17:19:56.538039+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:02:38.287352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.647189+0000","last_change":"2024-03-12T17:19:55.561554+0000","last_active":"2024-03-12T17:19:57.647189+0000","last_peered":"2024-03-12T17:19:57.647189+0000","last_clean":"2024-03-12T17:19:57.647189+0000","last_became_active":"2024-03-12T17:19:55.561296+0000","last_became_peered":"2024-03-12T17:19:55.561296+0000","last_unstale":"2024-03-12T17:19:57.647189+0000","last_undegraded":"2024-03-12T17:19:57.647189+0000","last_fullsized":"2024-03-12T17:19:57.647189+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:07:23.149461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.646773+0000","last_change":"2024-03-12T17:19:55.563357+0000","last_active":"2024-03-12T17:19:57.646773+0000","last_peered":"2024-03-12T17:19:57.646773+0000","last_clean":"2024-03-12T17:19:57.646773+0000","last_became_active":"2024-03-12T17:19:55.563192+0000","last_became_peered":"2024-03-12T17:19:55.563192+0000","last_unstale":"2024-03-12T17:19:57.646773+0000","last_undegraded":"2024-03-12T17:19:57.646773+0000","last_fullsized":"2024-03-12T17:19:57.646773+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:13:57.858538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.532516+0000","last_change":"2024-03-12T17:19:55.559010+0000","last_active":"2024-03-12T17:19:56.532516+0000","last_peered":"2024-03-12T17:19:56.532516+0000","last_clean":"2024-03-12T17:19:56.532516+0000","last_became_active":"2024-03-12T17:19:55.556925+0000","last_became_peered":"2024-03-12T17:19:55.556925+0000","last_unstale":"2024-03-12T17:19:56.532516+0000","last_undegraded":"2024-03-12T17:19:56.532516+0000","last_fullsized":"2024-03-12T17:19:56.532516+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:11:56.543814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.369917+0000","last_change":"2024-03-12T17:19:55.565186+0000","last_active":"2024-03-12T17:19:57.369917+0000","last_peered":"2024-03-12T17:19:57.369917+0000","last_clean":"2024-03-12T17:19:57.369917+0000","last_became_active":"2024-03-12T17:19:55.564882+0000","last_became_peered":"2024-03-12T17:19:55.564882+0000","last_unstale":"2024-03-12T17:19:57.369917+0000","last_undegraded":"2024-03-12T17:19:57.369917+0000","last_fullsized":"2024-03-12T17:19:57.369917+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:27:04.837139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.368946+0000","last_change":"2024-03-12T17:19:55.563668+0000","last_active":"2024-03-12T17:19:57.368946+0000","last_peered":"2024-03-12T17:19:57.368946+0000","last_clean":"2024-03-12T17:19:57.368946+0000","last_became_active":"2024-03-12T17:19:55.563394+0000","last_became_peered":"2024-03-12T17:19:55.563394+0000","last_unstale":"2024-03-12T17:19:57.368946+0000","last_undegraded":"2024-03-12T17:19:57.368946+0000","last_fullsized":"2024-03-12T17:19:57.368946+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:06:33.370089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.869912+0000","last_change":"2024-03-12T17:19:55.551747+0000","last_active":"2024-03-12T17:19:56.869912+0000","last_peered":"2024-03-12T17:19:56.869912+0000","last_clean":"2024-03-12T17:19:56.869912+0000","last_became_active":"2024-03-12T17:19:55.551398+0000","last_became_peered":"2024-03-12T17:19:55.551398+0000","last_unstale":"2024-03-12T17:19:56.869912+0000","last_undegraded":"2024-03-12T17:19:56.869912+0000","last_fullsized":"2024-03-12T17:19:56.869912+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:06:33.370089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.535404+0000","last_change":"2024-03-12T17:19:55.555010+0000","last_active":"2024-03-12T17:19:56.535404+0000","last_peered":"2024-03-12T17:19:56.535404+0000","last_clean":"2024-03-12T17:19:56.535404+0000","last_became_active":"2024-03-12T17:19:55.554259+0000","last_became_peered":"2024-03-12T17:19:55.554259+0000","last_unstale":"2024-03-12T17:19:56.535404+0000","last_undegraded":"2024-03-12T17:19:56.535404+0000","last_fullsized":"2024-03-12T17:19:56.535404+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:36:22.768353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.876980+0000","last_change":"2024-03-12T17:19:55.559083+0000","last_active":"2024-03-12T17:19:56.876980+0000","last_peered":"2024-03-12T17:19:56.876980+0000","last_clean":"2024-03-12T17:19:56.876980+0000","last_became_active":"2024-03-12T17:19:55.558637+0000","last_became_peered":"2024-03-12T17:19:55.558637+0000","last_unstale":"2024-03-12T17:19:56.876980+0000","last_undegraded":"2024-03-12T17:19:56.876980+0000","last_fullsized":"2024-03-12T17:19:56.876980+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:42:29.462692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.647336+0000","last_change":"2024-03-12T17:19:55.551814+0000","last_active":"2024-03-12T17:19:57.647336+0000","last_peered":"2024-03-12T17:19:57.647336+0000","last_clean":"2024-03-12T17:19:57.647336+0000","last_became_active":"2024-03-12T17:19:55.551475+0000","last_became_peered":"2024-03-12T17:19:55.551475+0000","last_unstale":"2024-03-12T17:19:57.647336+0000","last_undegraded":"2024-03-12T17:19:57.647336+0000","last_fullsized":"2024-03-12T17:19:57.647336+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:02:38.287352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.876618+0000","last_change":"2024-03-12T17:19:55.568978+0000","last_active":"2024-03-12T17:19:56.876618+0000","last_peered":"2024-03-12T17:19:56.876618+0000","last_clean":"2024-03-12T17:19:56.876618+0000","last_became_active":"2024-03-12T17:19:55.564335+0000","last_became_peered":"2024-03-12T17:19:55.564335+0000","last_unstale":"2024-03-12T17:19:56.876618+0000","last_undegraded":"2024-03-12T17:19:56.876618+0000","last_fullsized":"2024-03-12T17:19:56.876618+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:02:56.923259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.535582+0000","last_change":"2024-03-12T17:19:55.562593+0000","last_active":"2024-03-12T17:19:56.535582+0000","last_peered":"2024-03-12T17:19:56.535582+0000","last_clean":"2024-03-12T17:19:56.535582+0000","last_became_active":"2024-03-12T17:19:55.562368+0000","last_became_peered":"2024-03-12T17:19:55.562368+0000","last_unstale":"2024-03-12T17:19:56.535582+0000","last_undegraded":"2024-03-12T17:19:56.535582+0000","last_fullsized":"2024-03-12T17:19:56.535582+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:17:34.421310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.369254+0000","last_change":"2024-03-12T17:19:55.560208+0000","last_active":"2024-03-12T17:19:57.369254+0000","last_peered":"2024-03-12T17:19:57.369254+0000","last_clean":"2024-03-12T17:19:57.369254+0000","last_became_active":"2024-03-12T17:19:55.559797+0000","last_became_peered":"2024-03-12T17:19:55.559797+0000","last_unstale":"2024-03-12T17:19:57.369254+0000","last_undegraded":"2024-03-12T17:19:57.369254+0000","last_fullsized":"2024-03-12T17:19:57.369254+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:57:49.973122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.537566+0000","last_change":"2024-03-12T17:19:55.564556+0000","last_active":"2024-03-12T17:19:56.537566+0000","last_peered":"2024-03-12T17:19:56.537566+0000","last_clean":"2024-03-12T17:19:56.537566+0000","last_became_active":"2024-03-12T17:19:55.564310+0000","last_became_peered":"2024-03-12T17:19:55.564310+0000","last_unstale":"2024-03-12T17:19:56.537566+0000","last_undegraded":"2024-03-12T17:19:56.537566+0000","last_fullsized":"2024-03-12T17:19:56.537566+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:12:38.840849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.648033+0000","last_change":"2024-03-12T17:19:55.562511+0000","last_active":"2024-03-12T17:19:57.648033+0000","last_peered":"2024-03-12T17:19:57.648033+0000","last_clean":"2024-03-12T17:19:57.648033+0000","last_became_active":"2024-03-12T17:19:55.561986+0000","last_became_peered":"2024-03-12T17:19:55.561986+0000","last_unstale":"2024-03-12T17:19:57.648033+0000","last_undegraded":"2024-03-12T17:19:57.648033+0000","last_fullsized":"2024-03-12T17:19:57.648033+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:34:50.616590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.536686+0000","last_change":"2024-03-12T17:19:55.567421+0000","last_active":"2024-03-12T17:19:56.536686+0000","last_peered":"2024-03-12T17:19:56.536686+0000","last_clean":"2024-03-12T17:19:56.536686+0000","last_became_active":"2024-03-12T17:19:55.566755+0000","last_became_peered":"2024-03-12T17:19:55.566755+0000","last_unstale":"2024-03-12T17:19:56.536686+0000","last_undegraded":"2024-03-12T17:19:56.536686+0000","last_fullsized":"2024-03-12T17:19:56.536686+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:36:22.768353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.870272+0000","last_change":"2024-03-12T17:19:55.556665+0000","last_active":"2024-03-12T17:19:56.870272+0000","last_peered":"2024-03-12T17:19:56.870272+0000","last_clean":"2024-03-12T17:19:56.870272+0000","last_became_active":"2024-03-12T17:19:55.554984+0000","last_became_peered":"2024-03-12T17:19:55.554984+0000","last_unstale":"2024-03-12T17:19:56.870272+0000","last_undegraded":"2024-03-12T17:19:56.870272+0000","last_fullsized":"2024-03-12T17:19:56.870272+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:34:50.616590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.648683+0000","last_change":"2024-03-12T17:19:55.061501+0000","last_active":"2024-03-12T17:19:57.648683+0000","last_peered":"2024-03-12T17:19:57.648683+0000","last_clean":"2024-03-12T17:19:57.648683+0000","last_became_active":"2024-03-12T17:19:55.060730+0000","last_became_peered":"2024-03-12T17:19:55.060730+0000","last_unstale":"2024-03-12T17:19:57.648683+0000","last_undegraded":"2024-03-12T17:19:57.648683+0000","last_fullsized":"2024-03-12T17:19:57.648683+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:59:05.662117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.648558+0000","last_change":"2024-03-12T17:19:55.574760+0000","last_active":"2024-03-12T17:19:57.648558+0000","last_peered":"2024-03-12T17:19:57.648558+0000","last_clean":"2024-03-12T17:19:57.648558+0000","last_became_active":"2024-03-12T17:19:55.574480+0000","last_became_peered":"2024-03-12T17:19:55.574480+0000","last_unstale":"2024-03-12T17:19:57.648558+0000","last_undegraded":"2024-03-12T17:19:57.648558+0000","last_fullsized":"2024-03-12T17:19:57.648558+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:06:33.370089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.870369+0000","last_change":"2024-03-12T17:19:55.067058+0000","last_active":"2024-03-12T17:19:56.870369+0000","last_peered":"2024-03-12T17:19:56.870369+0000","last_clean":"2024-03-12T17:19:56.870369+0000","last_became_active":"2024-03-12T17:19:55.066778+0000","last_became_peered":"2024-03-12T17:19:55.066778+0000","last_unstale":"2024-03-12T17:19:56.870369+0000","last_undegraded":"2024-03-12T17:19:56.870369+0000","last_fullsized":"2024-03-12T17:19:56.870369+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:11:55.528608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.369730+0000","last_change":"2024-03-12T17:19:55.561642+0000","last_active":"2024-03-12T17:19:57.369730+0000","last_peered":"2024-03-12T17:19:57.369730+0000","last_clean":"2024-03-12T17:19:57.369730+0000","last_became_active":"2024-03-12T17:19:55.561310+0000","last_became_peered":"2024-03-12T17:19:55.561310+0000","last_unstale":"2024-03-12T17:19:57.369730+0000","last_undegraded":"2024-03-12T17:19:57.369730+0000","last_fullsized":"2024-03-12T17:19:57.369730+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:36:18.137764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.646721+0000","last_change":"2024-03-12T17:19:55.060990+0000","last_active":"2024-03-12T17:19:57.646721+0000","last_peered":"2024-03-12T17:19:57.646721+0000","last_clean":"2024-03-12T17:19:57.646721+0000","last_became_active":"2024-03-12T17:19:55.060800+0000","last_became_peered":"2024-03-12T17:19:55.060800+0000","last_unstale":"2024-03-12T17:19:57.646721+0000","last_undegraded":"2024-03-12T17:19:57.646721+0000","last_fullsized":"2024-03-12T17:19:57.646721+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:42:23.714899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.876796+0000","last_change":"2024-03-12T17:19:55.564613+0000","last_active":"2024-03-12T17:19:56.876796+0000","last_peered":"2024-03-12T17:19:56.876796+0000","last_clean":"2024-03-12T17:19:56.876796+0000","last_became_active":"2024-03-12T17:19:55.563895+0000","last_became_peered":"2024-03-12T17:19:55.563895+0000","last_unstale":"2024-03-12T17:19:56.876796+0000","last_undegraded":"2024-03-12T17:19:56.876796+0000","last_fullsized":"2024-03-12T17:19:56.876796+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:36:22.768353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.532716+0000","last_change":"2024-03-12T17:19:55.058622+0000","last_active":"2024-03-12T17:19:56.532716+0000","last_peered":"2024-03-12T17:19:56.532716+0000","last_clean":"2024-03-12T17:19:56.532716+0000","last_became_active":"2024-03-12T17:19:55.058269+0000","last_became_peered":"2024-03-12T17:19:55.058269+0000","last_unstale":"2024-03-12T17:19:56.532716+0000","last_undegraded":"2024-03-12T17:19:56.532716+0000","last_fullsized":"2024-03-12T17:19:56.532716+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:40:51.094630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.537308+0000","last_change":"2024-03-12T17:19:55.574838+0000","last_active":"2024-03-12T17:19:56.537308+0000","last_peered":"2024-03-12T17:19:56.537308+0000","last_clean":"2024-03-12T17:19:56.537308+0000","last_became_active":"2024-03-12T17:19:55.574278+0000","last_became_peered":"2024-03-12T17:19:55.574278+0000","last_unstale":"2024-03-12T17:19:56.537308+0000","last_undegraded":"2024-03-12T17:19:56.537308+0000","last_fullsized":"2024-03-12T17:19:56.537308+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:13:29.308675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.369499+0000","last_change":"2024-03-12T17:19:55.069200+0000","last_active":"2024-03-12T17:19:57.369499+0000","last_peered":"2024-03-12T17:19:57.369499+0000","last_clean":"2024-03-12T17:19:57.369499+0000","last_became_active":"2024-03-12T17:19:55.068410+0000","last_became_peered":"2024-03-12T17:19:55.068410+0000","last_unstale":"2024-03-12T17:19:57.369499+0000","last_undegraded":"2024-03-12T17:19:57.369499+0000","last_fullsized":"2024-03-12T17:19:57.369499+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:44:16.951521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.535633+0000","last_change":"2024-03-12T17:19:55.559107+0000","last_active":"2024-03-12T17:19:56.535633+0000","last_peered":"2024-03-12T17:19:56.535633+0000","last_clean":"2024-03-12T17:19:56.535633+0000","last_became_active":"2024-03-12T17:19:55.558719+0000","last_became_peered":"2024-03-12T17:19:55.558719+0000","last_unstale":"2024-03-12T17:19:56.535633+0000","last_undegraded":"2024-03-12T17:19:56.535633+0000","last_fullsized":"2024-03-12T17:19:56.535633+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:00:27.067346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.369330+0000","last_change":"2024-03-12T17:19:55.067694+0000","last_active":"2024-03-12T17:19:57.369330+0000","last_peered":"2024-03-12T17:19:57.369330+0000","last_clean":"2024-03-12T17:19:57.369330+0000","last_became_active":"2024-03-12T17:19:55.067429+0000","last_became_peered":"2024-03-12T17:19:55.067429+0000","last_unstale":"2024-03-12T17:19:57.369330+0000","last_undegraded":"2024-03-12T17:19:57.369330+0000","last_fullsized":"2024-03-12T17:19:57.369330+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:40:51.094630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.368992+0000","last_change":"2024-03-12T17:19:55.564179+0000","last_active":"2024-03-12T17:19:57.368992+0000","last_peered":"2024-03-12T17:19:57.368992+0000","last_clean":"2024-03-12T17:19:57.368992+0000","last_became_active":"2024-03-12T17:19:55.563792+0000","last_became_peered":"2024-03-12T17:19:55.563792+0000","last_unstale":"2024-03-12T17:19:57.368992+0000","last_undegraded":"2024-03-12T17:19:57.368992+0000","last_fullsized":"2024-03-12T17:19:57.368992+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:34:50.616590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.646012+0000","last_change":"2024-03-12T17:19:55.059830+0000","last_active":"2024-03-12T17:19:57.646012+0000","last_peered":"2024-03-12T17:19:57.646012+0000","last_clean":"2024-03-12T17:19:57.646012+0000","last_became_active":"2024-03-12T17:19:55.059514+0000","last_became_peered":"2024-03-12T17:19:55.059514+0000","last_unstale":"2024-03-12T17:19:57.646012+0000","last_undegraded":"2024-03-12T17:19:57.646012+0000","last_fullsized":"2024-03-12T17:19:57.646012+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:37:20.922305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.875636+0000","last_change":"2024-03-12T17:19:55.565631+0000","last_active":"2024-03-12T17:19:56.875636+0000","last_peered":"2024-03-12T17:19:56.875636+0000","last_clean":"2024-03-12T17:19:56.875636+0000","last_became_active":"2024-03-12T17:19:55.564745+0000","last_became_peered":"2024-03-12T17:19:55.564745+0000","last_unstale":"2024-03-12T17:19:56.875636+0000","last_undegraded":"2024-03-12T17:19:56.875636+0000","last_fullsized":"2024-03-12T17:19:56.875636+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:53:38.898344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.368979+0000","last_change":"2024-03-12T17:19:55.059531+0000","last_active":"2024-03-12T17:19:57.368979+0000","last_peered":"2024-03-12T17:19:57.368979+0000","last_clean":"2024-03-12T17:19:57.368979+0000","last_became_active":"2024-03-12T17:19:55.058948+0000","last_became_peered":"2024-03-12T17:19:55.058948+0000","last_unstale":"2024-03-12T17:19:57.368979+0000","last_undegraded":"2024-03-12T17:19:57.368979+0000","last_fullsized":"2024-03-12T17:19:57.368979+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:59:26.535303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.536446+0000","last_change":"2024-03-12T17:19:55.556091+0000","last_active":"2024-03-12T17:19:56.536446+0000","last_peered":"2024-03-12T17:19:56.536446+0000","last_clean":"2024-03-12T17:19:56.536446+0000","last_became_active":"2024-03-12T17:19:55.555787+0000","last_became_peered":"2024-03-12T17:19:55.555787+0000","last_unstale":"2024-03-12T17:19:56.536446+0000","last_undegraded":"2024-03-12T17:19:56.536446+0000","last_fullsized":"2024-03-12T17:19:56.536446+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:57:43.664364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.646876+0000","last_change":"2024-03-12T17:19:55.070176+0000","last_active":"2024-03-12T17:19:57.646876+0000","last_peered":"2024-03-12T17:19:57.646876+0000","last_clean":"2024-03-12T17:19:57.646876+0000","last_became_active":"2024-03-12T17:19:55.069670+0000","last_became_peered":"2024-03-12T17:19:55.069670+0000","last_unstale":"2024-03-12T17:19:57.646876+0000","last_undegraded":"2024-03-12T17:19:57.646876+0000","last_fullsized":"2024-03-12T17:19:57.646876+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T00:14:11.622570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.646723+0000","last_change":"2024-03-12T17:19:55.560536+0000","last_active":"2024-03-12T17:19:57.646723+0000","last_peered":"2024-03-12T17:19:57.646723+0000","last_clean":"2024-03-12T17:19:57.646723+0000","last_became_active":"2024-03-12T17:19:55.560262+0000","last_became_peered":"2024-03-12T17:19:55.560262+0000","last_unstale":"2024-03-12T17:19:57.646723+0000","last_undegraded":"2024-03-12T17:19:57.646723+0000","last_fullsized":"2024-03-12T17:19:57.646723+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:37:18.594281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.870645+0000","last_change":"2024-03-12T17:19:55.066317+0000","last_active":"2024-03-12T17:19:56.870645+0000","last_peered":"2024-03-12T17:19:56.870645+0000","last_clean":"2024-03-12T17:19:56.870645+0000","last_became_active":"2024-03-12T17:19:55.064902+0000","last_became_peered":"2024-03-12T17:19:55.064902+0000","last_unstale":"2024-03-12T17:19:56.870645+0000","last_undegraded":"2024-03-12T17:19:56.870645+0000","last_fullsized":"2024-03-12T17:19:56.870645+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:12:57.672436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.647107+0000","last_change":"2024-03-12T17:19:55.553757+0000","last_active":"2024-03-12T17:19:57.647107+0000","last_peered":"2024-03-12T17:19:57.647107+0000","last_clean":"2024-03-12T17:19:57.647107+0000","last_became_active":"2024-03-12T17:19:55.551393+0000","last_became_peered":"2024-03-12T17:19:55.551393+0000","last_unstale":"2024-03-12T17:19:57.647107+0000","last_undegraded":"2024-03-12T17:19:57.647107+0000","last_fullsized":"2024-03-12T17:19:57.647107+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:42:29.462692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.536062+0000","last_change":"2024-03-12T17:19:55.067675+0000","last_active":"2024-03-12T17:19:56.536062+0000","last_peered":"2024-03-12T17:19:56.536062+0000","last_clean":"2024-03-12T17:19:56.536062+0000","last_became_active":"2024-03-12T17:19:55.067345+0000","last_became_peered":"2024-03-12T17:19:55.067345+0000","last_unstale":"2024-03-12T17:19:56.536062+0000","last_undegraded":"2024-03-12T17:19:56.536062+0000","last_fullsized":"2024-03-12T17:19:56.536062+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:12:57.672436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.535381+0000","last_change":"2024-03-12T17:19:55.558356+0000","last_active":"2024-03-12T17:19:56.535381+0000","last_peered":"2024-03-12T17:19:56.535381+0000","last_clean":"2024-03-12T17:19:56.535381+0000","last_became_active":"2024-03-12T17:19:55.558030+0000","last_became_peered":"2024-03-12T17:19:55.558030+0000","last_unstale":"2024-03-12T17:19:56.535381+0000","last_undegraded":"2024-03-12T17:19:56.535381+0000","last_fullsized":"2024-03-12T17:19:56.535381+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T00:29:15.942673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.647117+0000","last_change":"2024-03-12T17:19:55.067477+0000","last_active":"2024-03-12T17:19:57.647117+0000","last_peered":"2024-03-12T17:19:57.647117+0000","last_clean":"2024-03-12T17:19:57.647117+0000","last_became_active":"2024-03-12T17:19:55.067211+0000","last_became_peered":"2024-03-12T17:19:55.067211+0000","last_unstale":"2024-03-12T17:19:57.647117+0000","last_undegraded":"2024-03-12T17:19:57.647117+0000","last_fullsized":"2024-03-12T17:19:57.647117+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:37:22.883310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.875956+0000","last_change":"2024-03-12T17:19:55.559256+0000","last_active":"2024-03-12T17:19:56.875956+0000","last_peered":"2024-03-12T17:19:56.875956+0000","last_clean":"2024-03-12T17:19:56.875956+0000","last_became_active":"2024-03-12T17:19:55.559011+0000","last_became_peered":"2024-03-12T17:19:55.559011+0000","last_unstale":"2024-03-12T17:19:56.875956+0000","last_undegraded":"2024-03-12T17:19:56.875956+0000","last_fullsized":"2024-03-12T17:19:56.875956+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:41:59.824480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.369726+0000","last_change":"2024-03-12T17:19:55.066382+0000","last_active":"2024-03-12T17:19:57.369726+0000","last_peered":"2024-03-12T17:19:57.369726+0000","last_clean":"2024-03-12T17:19:57.369726+0000","last_became_active":"2024-03-12T17:19:55.065141+0000","last_became_peered":"2024-03-12T17:19:55.065141+0000","last_unstale":"2024-03-12T17:19:57.369726+0000","last_undegraded":"2024-03-12T17:19:57.369726+0000","last_fullsized":"2024-03-12T17:19:57.369726+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:24:48.618858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.646577+0000","last_change":"2024-03-12T17:19:55.548805+0000","last_active":"2024-03-12T17:19:57.646577+0000","last_peered":"2024-03-12T17:19:57.646577+0000","last_clean":"2024-03-12T17:19:57.646577+0000","last_became_active":"2024-03-12T17:19:55.548530+0000","last_became_peered":"2024-03-12T17:19:55.548530+0000","last_unstale":"2024-03-12T17:19:57.646577+0000","last_undegraded":"2024-03-12T17:19:57.646577+0000","last_fullsized":"2024-03-12T17:19:57.646577+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:57:43.664364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.876019+0000","last_change":"2024-03-12T17:19:55.067167+0000","last_active":"2024-03-12T17:19:56.876019+0000","last_peered":"2024-03-12T17:19:56.876019+0000","last_clean":"2024-03-12T17:19:56.876019+0000","last_became_active":"2024-03-12T17:19:55.066903+0000","last_became_peered":"2024-03-12T17:19:55.066903+0000","last_unstale":"2024-03-12T17:19:56.876019+0000","last_undegraded":"2024-03-12T17:19:56.876019+0000","last_fullsized":"2024-03-12T17:19:56.876019+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T00:14:11.622570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.536717+0000","last_change":"2024-03-12T17:19:55.556807+0000","last_active":"2024-03-12T17:19:56.536717+0000","last_peered":"2024-03-12T17:19:56.536717+0000","last_clean":"2024-03-12T17:19:56.536717+0000","last_became_active":"2024-03-12T17:19:55.556529+0000","last_became_peered":"2024-03-12T17:19:55.556529+0000","last_unstale":"2024-03-12T17:19:56.536717+0000","last_undegraded":"2024-03-12T17:19:56.536717+0000","last_fullsized":"2024-03-12T17:19:56.536717+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:41:59.824480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.646174+0000","last_change":"2024-03-12T17:19:55.064664+0000","last_active":"2024-03-12T17:19:57.646174+0000","last_peered":"2024-03-12T17:19:57.646174+0000","last_clean":"2024-03-12T17:19:57.646174+0000","last_became_active":"2024-03-12T17:19:55.064408+0000","last_became_peered":"2024-03-12T17:19:55.064408+0000","last_unstale":"2024-03-12T17:19:57.646174+0000","last_undegraded":"2024-03-12T17:19:57.646174+0000","last_fullsized":"2024-03-12T17:19:57.646174+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:58:25.756646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.648289+0000","last_change":"2024-03-12T17:19:55.574860+0000","last_active":"2024-03-12T17:19:57.648289+0000","last_peered":"2024-03-12T17:19:57.648289+0000","last_clean":"2024-03-12T17:19:57.648289+0000","last_became_active":"2024-03-12T17:19:55.574578+0000","last_became_peered":"2024-03-12T17:19:55.574578+0000","last_unstale":"2024-03-12T17:19:57.648289+0000","last_undegraded":"2024-03-12T17:19:57.648289+0000","last_fullsized":"2024-03-12T17:19:57.648289+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:57:49.973122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":19,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.646217+0000","last_change":"2024-03-12T17:19:55.069825+0000","last_active":"2024-03-12T17:19:57.646217+0000","last_peered":"2024-03-12T17:19:57.646217+0000","last_clean":"2024-03-12T17:19:57.646217+0000","last_became_active":"2024-03-12T17:19:55.069532+0000","last_became_peered":"2024-03-12T17:19:55.069532+0000","last_unstale":"2024-03-12T17:19:57.646217+0000","last_undegraded":"2024-03-12T17:19:57.646217+0000","last_fullsized":"2024-03-12T17:19:57.646217+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:11:55.528608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.369379+0000","last_change":"2024-03-12T17:19:55.572654+0000","last_active":"2024-03-12T17:19:57.369379+0000","last_peered":"2024-03-12T17:19:57.369379+0000","last_clean":"2024-03-12T17:19:57.369379+0000","last_became_active":"2024-03-12T17:19:55.566942+0000","last_became_peered":"2024-03-12T17:19:55.566942+0000","last_unstale":"2024-03-12T17:19:57.369379+0000","last_undegraded":"2024-03-12T17:19:57.369379+0000","last_fullsized":"2024-03-12T17:19:57.369379+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:58:26.771851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.877208+0000","last_change":"2024-03-12T17:19:55.064318+0000","last_active":"2024-03-12T17:19:56.877208+0000","last_peered":"2024-03-12T17:19:56.877208+0000","last_clean":"2024-03-12T17:19:56.877208+0000","last_became_active":"2024-03-12T17:19:55.063836+0000","last_became_peered":"2024-03-12T17:19:55.063836+0000","last_unstale":"2024-03-12T17:19:56.877208+0000","last_undegraded":"2024-03-12T17:19:56.877208+0000","last_fullsized":"2024-03-12T17:19:56.877208+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:27:03.821934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.536945+0000","last_change":"2024-03-12T17:19:55.567084+0000","last_active":"2024-03-12T17:19:56.536945+0000","last_peered":"2024-03-12T17:19:56.536945+0000","last_clean":"2024-03-12T17:19:56.536945+0000","last_became_active":"2024-03-12T17:19:55.565056+0000","last_became_peered":"2024-03-12T17:19:55.565056+0000","last_unstale":"2024-03-12T17:19:56.536945+0000","last_undegraded":"2024-03-12T17:19:56.536945+0000","last_fullsized":"2024-03-12T17:19:56.536945+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:41:59.824480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.369496+0000","last_change":"2024-03-12T17:19:55.062826+0000","last_active":"2024-03-12T17:19:57.369496+0000","last_peered":"2024-03-12T17:19:57.369496+0000","last_clean":"2024-03-12T17:19:57.369496+0000","last_became_active":"2024-03-12T17:19:55.062613+0000","last_became_peered":"2024-03-12T17:19:55.062613+0000","last_unstale":"2024-03-12T17:19:57.369496+0000","last_undegraded":"2024-03-12T17:19:57.369496+0000","last_fullsized":"2024-03-12T17:19:57.369496+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:51:08.519751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.876312+0000","last_change":"2024-03-12T17:19:55.574242+0000","last_active":"2024-03-12T17:19:56.876312+0000","last_peered":"2024-03-12T17:19:56.876312+0000","last_clean":"2024-03-12T17:19:56.876312+0000","last_became_active":"2024-03-12T17:19:55.573999+0000","last_became_peered":"2024-03-12T17:19:55.573999+0000","last_unstale":"2024-03-12T17:19:56.876312+0000","last_undegraded":"2024-03-12T17:19:56.876312+0000","last_fullsized":"2024-03-12T17:19:56.876312+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:57:43.664364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.369496+0000","last_change":"2024-03-12T17:19:55.064563+0000","last_active":"2024-03-12T17:19:57.369496+0000","last_peered":"2024-03-12T17:19:57.369496+0000","last_clean":"2024-03-12T17:19:57.369496+0000","last_became_active":"2024-03-12T17:19:55.063936+0000","last_became_peered":"2024-03-12T17:19:55.063936+0000","last_unstale":"2024-03-12T17:19:57.369496+0000","last_undegraded":"2024-03-12T17:19:57.369496+0000","last_fullsized":"2024-03-12T17:19:57.369496+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:41:14.891860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.532656+0000","last_change":"2024-03-12T17:19:55.556504+0000","last_active":"2024-03-12T17:19:56.532656+0000","last_peered":"2024-03-12T17:19:56.532656+0000","last_clean":"2024-03-12T17:19:56.532656+0000","last_became_active":"2024-03-12T17:19:55.555694+0000","last_became_peered":"2024-03-12T17:19:55.555694+0000","last_unstale":"2024-03-12T17:19:56.532656+0000","last_undegraded":"2024-03-12T17:19:56.532656+0000","last_fullsized":"2024-03-12T17:19:56.532656+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T00:14:12.637775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.369635+0000","last_change":"2024-03-12T17:19:55.068813+0000","last_active":"2024-03-12T17:19:57.369635+0000","last_peered":"2024-03-12T17:19:57.369635+0000","last_clean":"2024-03-12T17:19:57.369635+0000","last_became_active":"2024-03-12T17:19:55.067406+0000","last_became_peered":"2024-03-12T17:19:55.067406+0000","last_unstale":"2024-03-12T17:19:57.369635+0000","last_undegraded":"2024-03-12T17:19:57.369635+0000","last_fullsized":"2024-03-12T17:19:57.369635+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:55:28.002748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.532350+0000","last_change":"2024-03-12T17:19:55.574331+0000","last_active":"2024-03-12T17:19:56.532350+0000","last_peered":"2024-03-12T17:19:56.532350+0000","last_clean":"2024-03-12T17:19:56.532350+0000","last_became_active":"2024-03-12T17:19:55.574085+0000","last_became_peered":"2024-03-12T17:19:55.574085+0000","last_unstale":"2024-03-12T17:19:56.532350+0000","last_undegraded":"2024-03-12T17:19:56.532350+0000","last_fullsized":"2024-03-12T17:19:56.532350+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:58:26.771851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.870525+0000","last_change":"2024-03-12T17:19:55.048881+0000","last_active":"2024-03-12T17:19:56.870525+0000","last_peered":"2024-03-12T17:19:56.870525+0000","last_clean":"2024-03-12T17:19:56.870525+0000","last_became_active":"2024-03-12T17:19:55.047277+0000","last_became_peered":"2024-03-12T17:19:55.047277+0000","last_unstale":"2024-03-12T17:19:56.870525+0000","last_undegraded":"2024-03-12T17:19:56.870525+0000","last_fullsized":"2024-03-12T17:19:56.870525+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:59:05.662117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.532435+0000","last_change":"2024-03-12T17:19:55.552248+0000","last_active":"2024-03-12T17:19:56.532435+0000","last_peered":"2024-03-12T17:19:56.532435+0000","last_clean":"2024-03-12T17:19:56.532435+0000","last_became_active":"2024-03-12T17:19:55.552057+0000","last_became_peered":"2024-03-12T17:19:55.552057+0000","last_unstale":"2024-03-12T17:19:56.532435+0000","last_undegraded":"2024-03-12T17:19:56.532435+0000","last_fullsized":"2024-03-12T17:19:56.532435+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:37:21.937511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.648460+0000","last_change":"2024-03-12T17:19:55.069135+0000","last_active":"2024-03-12T17:19:57.648460+0000","last_peered":"2024-03-12T17:19:57.648460+0000","last_clean":"2024-03-12T17:19:57.648460+0000","last_became_active":"2024-03-12T17:19:55.068823+0000","last_became_peered":"2024-03-12T17:19:55.068823+0000","last_unstale":"2024-03-12T17:19:57.648460+0000","last_undegraded":"2024-03-12T17:19:57.648460+0000","last_fullsized":"2024-03-12T17:19:57.648460+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:54:34.302800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.532616+0000","last_change":"2024-03-12T17:19:55.552307+0000","last_active":"2024-03-12T17:19:56.532616+0000","last_peered":"2024-03-12T17:19:56.532616+0000","last_clean":"2024-03-12T17:19:56.532616+0000","last_became_active":"2024-03-12T17:19:55.552054+0000","last_became_peered":"2024-03-12T17:19:55.552054+0000","last_unstale":"2024-03-12T17:19:56.532616+0000","last_undegraded":"2024-03-12T17:19:56.532616+0000","last_fullsized":"2024-03-12T17:19:56.532616+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:42:24.730105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.368890+0000","last_change":"2024-03-12T17:19:55.053466+0000","last_active":"2024-03-12T17:19:57.368890+0000","last_peered":"2024-03-12T17:19:57.368890+0000","last_clean":"2024-03-12T17:19:57.368890+0000","last_became_active":"2024-03-12T17:19:55.053059+0000","last_became_peered":"2024-03-12T17:19:55.053059+0000","last_unstale":"2024-03-12T17:19:57.368890+0000","last_undegraded":"2024-03-12T17:19:57.368890+0000","last_fullsized":"2024-03-12T17:19:57.368890+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:08:58.432164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.536880+0000","last_change":"2024-03-12T17:19:55.570514+0000","last_active":"2024-03-12T17:19:56.536880+0000","last_peered":"2024-03-12T17:19:56.536880+0000","last_clean":"2024-03-12T17:19:56.536880+0000","last_became_active":"2024-03-12T17:19:55.570158+0000","last_became_peered":"2024-03-12T17:19:55.570158+0000","last_unstale":"2024-03-12T17:19:56.536880+0000","last_undegraded":"2024-03-12T17:19:56.536880+0000","last_fullsized":"2024-03-12T17:19:56.536880+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:13:57.858538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.535102+0000","last_change":"2024-03-12T17:19:55.061401+0000","last_active":"2024-03-12T17:19:56.535102+0000","last_peered":"2024-03-12T17:19:56.535102+0000","last_clean":"2024-03-12T17:19:56.535102+0000","last_became_active":"2024-03-12T17:19:55.061121+0000","last_became_peered":"2024-03-12T17:19:55.061121+0000","last_unstale":"2024-03-12T17:19:56.535102+0000","last_undegraded":"2024-03-12T17:19:56.535102+0000","last_fullsized":"2024-03-12T17:19:56.535102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:59:05.662117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.532697+0000","last_change":"2024-03-12T17:19:55.547829+0000","last_active":"2024-03-12T17:19:56.532697+0000","last_peered":"2024-03-12T17:19:56.532697+0000","last_clean":"2024-03-12T17:19:56.532697+0000","last_became_active":"2024-03-12T17:19:55.547565+0000","last_became_peered":"2024-03-12T17:19:55.547565+0000","last_unstale":"2024-03-12T17:19:56.532697+0000","last_undegraded":"2024-03-12T17:19:56.532697+0000","last_fullsized":"2024-03-12T17:19:56.532697+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:13:20.301998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":13,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.877252+0000","last_change":"2024-03-12T17:19:55.056996+0000","last_active":"2024-03-12T17:19:56.877252+0000","last_peered":"2024-03-12T17:19:56.877252+0000","last_clean":"2024-03-12T17:19:56.877252+0000","last_became_active":"2024-03-12T17:19:55.056418+0000","last_became_peered":"2024-03-12T17:19:55.056418+0000","last_unstale":"2024-03-12T17:19:56.877252+0000","last_undegraded":"2024-03-12T17:19:56.877252+0000","last_fullsized":"2024-03-12T17:19:56.877252+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:37:22.883310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.537158+0000","last_change":"2024-03-12T17:19:55.563452+0000","last_active":"2024-03-12T17:19:56.537158+0000","last_peered":"2024-03-12T17:19:56.537158+0000","last_clean":"2024-03-12T17:19:56.537158+0000","last_became_active":"2024-03-12T17:19:55.563105+0000","last_became_peered":"2024-03-12T17:19:55.563105+0000","last_unstale":"2024-03-12T17:19:56.537158+0000","last_undegraded":"2024-03-12T17:19:56.537158+0000","last_fullsized":"2024-03-12T17:19:56.537158+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:59:20.544804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.874098+0000","last_change":"2024-03-12T17:19:55.057397+0000","last_active":"2024-03-12T17:19:56.874098+0000","last_peered":"2024-03-12T17:19:56.874098+0000","last_clean":"2024-03-12T17:19:56.874098+0000","last_became_active":"2024-03-12T17:19:55.057010+0000","last_became_peered":"2024-03-12T17:19:55.057010+0000","last_unstale":"2024-03-12T17:19:56.874098+0000","last_undegraded":"2024-03-12T17:19:56.874098+0000","last_fullsized":"2024-03-12T17:19:56.874098+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:13:19.286793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.870052+0000","last_change":"2024-03-12T17:19:55.561561+0000","last_active":"2024-03-12T17:19:56.870052+0000","last_peered":"2024-03-12T17:19:56.870052+0000","last_clean":"2024-03-12T17:19:56.870052+0000","last_became_active":"2024-03-12T17:19:55.560657+0000","last_became_peered":"2024-03-12T17:19:55.560657+0000","last_unstale":"2024-03-12T17:19:56.870052+0000","last_undegraded":"2024-03-12T17:19:56.870052+0000","last_fullsized":"2024-03-12T17:19:56.870052+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:27:04.837139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.877314+0000","last_change":"2024-03-12T17:19:55.057979+0000","last_active":"2024-03-12T17:19:56.877314+0000","last_peered":"2024-03-12T17:19:56.877314+0000","last_clean":"2024-03-12T17:19:56.877314+0000","last_became_active":"2024-03-12T17:19:55.050805+0000","last_became_peered":"2024-03-12T17:19:55.050805+0000","last_unstale":"2024-03-12T17:19:56.877314+0000","last_undegraded":"2024-03-12T17:19:56.877314+0000","last_fullsized":"2024-03-12T17:19:56.877314+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:58:25.756646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.647993+0000","last_change":"2024-03-12T17:19:55.561473+0000","last_active":"2024-03-12T17:19:57.647993+0000","last_peered":"2024-03-12T17:19:57.647993+0000","last_clean":"2024-03-12T17:19:57.647993+0000","last_became_active":"2024-03-12T17:19:55.560661+0000","last_became_peered":"2024-03-12T17:19:55.560661+0000","last_unstale":"2024-03-12T17:19:57.647993+0000","last_undegraded":"2024-03-12T17:19:57.647993+0000","last_fullsized":"2024-03-12T17:19:57.647993+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:27:04.837139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.870892+0000","last_change":"2024-03-12T17:19:55.056644+0000","last_active":"2024-03-12T17:19:56.870892+0000","last_peered":"2024-03-12T17:19:56.870892+0000","last_clean":"2024-03-12T17:19:56.870892+0000","last_became_active":"2024-03-12T17:19:55.053235+0000","last_became_peered":"2024-03-12T17:19:55.053235+0000","last_unstale":"2024-03-12T17:19:56.870892+0000","last_undegraded":"2024-03-12T17:19:56.870892+0000","last_fullsized":"2024-03-12T17:19:56.870892+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:54:34.302800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.870602+0000","last_change":"2024-03-12T17:19:55.564848+0000","last_active":"2024-03-12T17:19:56.870602+0000","last_peered":"2024-03-12T17:19:56.870602+0000","last_clean":"2024-03-12T17:19:56.870602+0000","last_became_active":"2024-03-12T17:19:55.564603+0000","last_became_peered":"2024-03-12T17:19:55.564603+0000","last_unstale":"2024-03-12T17:19:56.870602+0000","last_undegraded":"2024-03-12T17:19:56.870602+0000","last_fullsized":"2024-03-12T17:19:56.870602+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T00:14:12.637775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.876214+0000","last_change":"2024-03-12T17:19:55.053638+0000","last_active":"2024-03-12T17:19:56.876214+0000","last_peered":"2024-03-12T17:19:56.876214+0000","last_clean":"2024-03-12T17:19:56.876214+0000","last_became_active":"2024-03-12T17:19:55.052357+0000","last_became_peered":"2024-03-12T17:19:55.052357+0000","last_unstale":"2024-03-12T17:19:56.876214+0000","last_undegraded":"2024-03-12T17:19:56.876214+0000","last_fullsized":"2024-03-12T17:19:56.876214+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:37:20.922305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.646333+0000","last_change":"2024-03-12T17:19:55.557968+0000","last_active":"2024-03-12T17:19:57.646333+0000","last_peered":"2024-03-12T17:19:57.646333+0000","last_clean":"2024-03-12T17:19:57.646333+0000","last_became_active":"2024-03-12T17:19:55.557663+0000","last_became_peered":"2024-03-12T17:19:55.557663+0000","last_unstale":"2024-03-12T17:19:57.646333+0000","last_undegraded":"2024-03-12T17:19:57.646333+0000","last_fullsized":"2024-03-12T17:19:57.646333+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:12:38.840849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.369114+0000","last_change":"2024-03-12T17:19:55.062184+0000","last_active":"2024-03-12T17:19:57.369114+0000","last_peered":"2024-03-12T17:19:57.369114+0000","last_clean":"2024-03-12T17:19:57.369114+0000","last_became_active":"2024-03-12T17:19:55.059523+0000","last_became_peered":"2024-03-12T17:19:55.059523+0000","last_unstale":"2024-03-12T17:19:57.369114+0000","last_undegraded":"2024-03-12T17:19:57.369114+0000","last_fullsized":"2024-03-12T17:19:57.369114+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:20:15.689939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.368715+0000","last_change":"2024-03-12T17:19:55.560295+0000","last_active":"2024-03-12T17:19:57.368715+0000","last_peered":"2024-03-12T17:19:57.368715+0000","last_clean":"2024-03-12T17:19:57.368715+0000","last_became_active":"2024-03-12T17:19:55.559990+0000","last_became_peered":"2024-03-12T17:19:55.559990+0000","last_unstale":"2024-03-12T17:19:57.368715+0000","last_undegraded":"2024-03-12T17:19:57.368715+0000","last_fullsized":"2024-03-12T17:19:57.368715+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:13:29.308675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.646435+0000","last_change":"2024-03-12T17:19:55.061814+0000","last_active":"2024-03-12T17:19:57.646435+0000","last_peered":"2024-03-12T17:19:57.646435+0000","last_clean":"2024-03-12T17:19:57.646435+0000","last_became_active":"2024-03-12T17:19:55.061516+0000","last_became_peered":"2024-03-12T17:19:55.061516+0000","last_unstale":"2024-03-12T17:19:57.646435+0000","last_undegraded":"2024-03-12T17:19:57.646435+0000","last_fullsized":"2024-03-12T17:19:57.646435+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:27:03.821934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:56.537306+0000","last_change":"2024-03-12T17:19:55.571056+0000","last_active":"2024-03-12T17:19:56.537306+0000","last_peered":"2024-03-12T17:19:56.537306+0000","last_clean":"2024-03-12T17:19:56.537306+0000","last_became_active":"2024-03-12T17:19:55.570748+0000","last_became_peered":"2024-03-12T17:19:55.570748+0000","last_unstale":"2024-03-12T17:19:56.537306+0000","last_undegraded":"2024-03-12T17:19:56.537306+0000","last_fullsized":"2024-03-12T17:19:56.537306+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:55.011056+0000","last_clean_scrub_stamp":"2024-03-12T17:19:55.011056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:02:56.923259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-12T17:19:57.648364+0000","last_change":"2024-03-12T17:19:55.063245+0000","last_active":"2024-03-12T17:19:57.648364+0000","last_peered":"2024-03-12T17:19:57.648364+0000","last_clean":"2024-03-12T17:19:57.648364+0000","last_became_active":"2024-03-12T17:19:55.062409+0000","last_became_peered":"2024-03-12T17:19:55.062409+0000","last_unstale":"2024-03-12T17:19:57.648364+0000","last_undegraded":"2024-03-12T17:19:57.648364+0000","last_fullsized":"2024-03-12T17:19:57.648364+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:19:53.995850+0000","last_clean_scrub_stamp":"2024-03-12T17:19:53.995850+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:13:19.286793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":174,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-12T17:19:55.544239+0000","last_change":"2024-03-12T17:18:41.331756+0000","last_active":"2024-03-12T17:19:55.544239+0000","last_peered":"2024-03-12T17:19:55.544239+0000","last_clean":"2024-03-12T17:19:55.544239+0000","last_became_active":"2024-03-12T17:18:41.329237+0000","last_became_peered":"2024-03-12T17:18:41.329237+0000","last_unstale":"2024-03-12T17:19:55.544239+0000","last_undegraded":"2024-03-12T17:19:55.544239+0000","last_fullsized":"2024-03-12T17:19:55.544239+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:40.152422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:40.152422+0000","last_clean_scrub_stamp":"2024-03-12T17:18:40.152422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:35:43.664403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32096,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339744,"statfs":{"total":96636764160,"available":96603897856,"internally_reserved":0,"allocated":995328,"data_stored":747024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.76000000000000001}]},{"osd":1,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.0600000000000001}]},{"osd":2,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":1.2509999999999999}]},{"osd":3,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":1.4139999999999999}]},{"osd":4,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.347},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":2.2490000000000001,"5min":2.2490000000000001,"15min":2.2490000000000001},"last":1.393}]},{"osd":5,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.1909999999999998,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.496},{"interface":"front","average":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":3.9689999999999999,"5min":3.9689999999999999,"15min":3.9689999999999999},"last":1.1799999999999999}]},{"osd":6,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":3.8319999999999999,"5min":3.8319999999999999,"15min":3.8319999999999999},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":1.1200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31512,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340328,"statfs":{"total":96636764160,"available":96604495872,"internally_reserved":0,"allocated":405504,"data_stored":157182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.5390000000000001,"5min":3.5390000000000001,"15min":3.5390000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.93999999999999995}]},{"osd":1,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.78500000000000003},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":1.206}]},{"osd":2,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.9689999999999999,"5min":2.9689999999999999,"15min":2.9689999999999999},"last":1.141}]},{"osd":3,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.077},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.88200000000000001}]},{"osd":4,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.256},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.2330000000000001}]},{"osd":5,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.8660000000000001,"5min":2.8660000000000001,"15min":2.8660000000000001},"last":1.173},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.931,"5min":2.931,"15min":2.931},"last":1.0349999999999999}]},{"osd":7,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":1.98,"5min":1.98,"15min":1.98},"last":1.286}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":405504,"data_stored":157238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":1.284},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.8149999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.109}]},{"osd":1,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":1.155},{"interface":"front","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":2.5699999999999998,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":1.548}]},{"osd":2,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.613,"5min":2.613,"15min":2.613},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.359,"5min":2.359,"15min":2.359},"last":1.462}]},{"osd":3,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":1.5980000000000001},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":2.0670000000000002,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":1.2030000000000001}]},{"osd":4,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.25},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.4279999999999999}]},{"osd":6,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":2.4609999999999999,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":1.397},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.371}]},{"osd":7,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"min":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"max":{"1min":2.8700000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.494},{"interface":"front","average":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"min":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"max":{"1min":2.722,"5min":2.722,"15min":2.722},"last":1.337}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":405504,"data_stored":156670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":4.8979999999999997,"5min":4.8979999999999997,"15min":4.8979999999999997},"last":1.788},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":4.8300000000000001,"5min":4.8300000000000001,"15min":4.8300000000000001},"last":1.3620000000000001}]},{"osd":1,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":4.7779999999999996,"5min":4.7779999999999996,"15min":4.7779999999999996},"last":1.8540000000000001},{"interface":"front","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":1.911}]},{"osd":2,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.7450000000000001},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.3220000000000001,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":1.994}]},{"osd":3,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.6879999999999999}]},{"osd":5,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.6539999999999999},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":2.1850000000000001}]},{"osd":6,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":2.4750000000000001,"5min":2.4750000000000001,"15min":2.4750000000000001},"last":2.077}]},{"osd":7,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.9550000000000001},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.4260000000000002,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":2.056}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":413696,"data_stored":158152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.9580000000000002,"5min":2.9580000000000002,"15min":2.9580000000000002},"last":0.499},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":3.9940000000000002,"5min":3.9940000000000002,"15min":3.9940000000000002},"last":0.58599999999999997}]},{"osd":1,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":4.774,"5min":4.774,"15min":4.774},"last":0.622},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":5.0069999999999997,"5min":5.0069999999999997,"15min":5.0069999999999997},"last":0.71399999999999997}]},{"osd":2,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":2.4660000000000002,"5min":2.4660000000000002,"15min":2.4660000000000002},"last":0.68700000000000006},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":4.5650000000000004,"5min":4.5650000000000004,"15min":4.5650000000000004},"last":0.749}]},{"osd":4,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.482,"15min":1.482},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":2.8860000000000001,"5min":2.8860000000000001,"15min":2.8860000000000001},"last":1.123},{"interface":"front","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":4.3520000000000003,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":0.81200000000000006}]},{"osd":5,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":2.843,"5min":2.843,"15min":2.843},"last":0.874},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.8149999999999999,"5min":2.8149999999999999,"15min":2.8149999999999999},"last":1.099}]},{"osd":6,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":2.9199999999999999,"5min":2.9199999999999999,"15min":2.9199999999999999},"last":1.028},{"interface":"front","average":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":2.6589999999999998,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.05}]},{"osd":7,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"min":{"1min":1.006,"5min":1.006,"15min":1.006},"max":{"1min":4.6600000000000001,"5min":4.6600000000000001,"15min":4.6600000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.599,"5min":1.599,"15min":1.599},"min":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"max":{"1min":4.4720000000000004,"5min":4.4720000000000004,"15min":4.4720000000000004},"last":1.0740000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31516,"kb_used_data":392,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340324,"statfs":{"total":96636764160,"available":96604491776,"internally_reserved":0,"allocated":401408,"data_stored":156636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":3.1829999999999998,"5min":3.1829999999999998,"15min":3.1829999999999998},"last":0.75900000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.45}]},{"osd":1,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":3.1019999999999999,"5min":3.1019999999999999,"15min":3.1019999999999999},"last":1.2749999999999999}]},{"osd":3,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":2.7810000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":3.1419999999999999,"5min":3.1419999999999999,"15min":3.1419999999999999},"last":1.833}]},{"osd":4,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.643,"5min":1.643,"15min":1.643},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":7.96,"5min":7.96,"15min":7.96},"last":1.52},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":3.3780000000000001,"5min":3.3780000000000001,"15min":3.3780000000000001},"last":1.347}]},{"osd":5,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":4.0659999999999998,"5min":4.0659999999999998,"15min":4.0659999999999998},"last":1.571},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":3.012,"5min":3.012,"15min":3.012},"last":1.6180000000000001}]},{"osd":6,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":3.2330000000000001,"5min":3.2330000000000001,"15min":3.2330000000000001},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.804,"5min":1.804,"15min":1.804},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":7.9059999999999997,"5min":7.9059999999999997,"15min":7.9059999999999997},"last":1.7070000000000001}]},{"osd":7,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":4.0229999999999997,"5min":4.0229999999999997,"15min":4.0229999999999997},"last":1.671},{"interface":"front","average":{"1min":1.506,"5min":1.506,"15min":1.506},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":3.27,"5min":3.27,"15min":3.27},"last":1.744}]}]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31528,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340312,"statfs":{"total":96636764160,"available":96604479488,"internally_reserved":0,"allocated":413696,"data_stored":158152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.581,"5min":2.581,"15min":2.581},"last":1.115}]},{"osd":2,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.5720000000000001,"5min":2.5720000000000001,"15min":2.5720000000000001},"last":1.0469999999999999}]},{"osd":3,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.4580000000000002,"5min":2.4580000000000002,"15min":2.4580000000000002},"last":1.1819999999999999},{"interface":"front","average":{"1min":1.208,"5min":1.208,"15min":1.208},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.9609999999999999,"5min":2.9609999999999999,"15min":2.9609999999999999},"last":1.2370000000000001}]},{"osd":4,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":2.4580000000000002,"5min":2.4580000000000002,"15min":2.4580000000000002},"last":1.5820000000000001},{"interface":"front","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.6909999999999998,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":1.387}]},{"osd":5,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":3.0609999999999999,"5min":3.0609999999999999,"15min":3.0609999999999999},"last":1.425},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":1.4630000000000001}]},{"osd":6,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":3.1030000000000002,"5min":3.1030000000000002,"15min":3.1030000000000002},"last":1.671},{"interface":"front","average":{"1min":1.395,"5min":1.395,"15min":1.395},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.274,"5min":2.274,"15min":2.274},"last":1.329}]},{"osd":7,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.7959999999999998,"5min":2.7959999999999998,"15min":2.7959999999999998},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.55,"5min":1.55,"15min":1.55},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":3.1440000000000001,"5min":3.1440000000000001,"15min":3.1440000000000001},"last":1.5329999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32092,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339748,"statfs":{"total":96636764160,"available":96603901952,"internally_reserved":0,"allocated":991232,"data_stored":746934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.127}]},{"osd":2,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.99,"5min":1.99,"15min":1.99},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":1.276}]},{"osd":3,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.84899999999999998},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":1.0529999999999999}]},{"osd":4,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":3.2349999999999999,"5min":3.2349999999999999,"15min":3.2349999999999999},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":2.5369999999999999,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":1.327}]},{"osd":5,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.988,"5min":2.988,"15min":2.988},"last":1.8979999999999999},{"interface":"front","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.843,"5min":2.843,"15min":2.843},"last":1.004}]},{"osd":6,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":2.431,"5min":2.431,"15min":2.431},"last":1.4450000000000001},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.589,"5min":2.589,"15min":2.589},"last":1.9910000000000001}]},{"osd":7,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.637,"5min":1.637,"15min":1.637},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":2.0489999999999999},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":2.8929999999999998,"5min":2.8929999999999998,"15min":2.8929999999999998},"last":1.0960000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-12T17:20:00.482 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-12T17:20:00.482 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-03-12T17:20:00.746 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.752+0000 7faa59c00640 1 Processor -- start 2024-03-12T17:20:00.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.752+0000 7faa59c00640 1 -- start start 2024-03-12T17:20:00.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.754+0000 7faa59c00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7faa540d2fa0 0x7faa540d3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:00.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.754+0000 7faa59c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faa540b5b50 0x7faa540b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:00.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.754+0000 7faa59c00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7faa540cd840 0x7faa540cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:00.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.754+0000 7faa59c00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa540b59e0 con 0x7faa540cd840 2024-03-12T17:20:00.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.754+0000 7faa59c00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa540d14e0 con 0x7faa540d2fa0 2024-03-12T17:20:00.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.754+0000 7faa59c00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa540d38c0 con 0x7faa540b5b50 2024-03-12T17:20:00.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.754+0000 7faa53400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7faa540cd840 0x7faa540cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:00.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.754+0000 7faa53400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7faa540cd840 0x7faa540cdcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50702/0 (socket says 172.21.15.17:50702) 2024-03-12T17:20:00.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.754+0000 7faa53400640 1 -- 172.21.15.17:0/3529557682 learned_addr learned my addr 172.21.15.17:0/3529557682 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:00.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.754+0000 7faa52a00640 1 --2- 172.21.15.17:0/3529557682 >> v2:172.21.15.94:3300/0 conn(0x7faa540d2fa0 0x7faa540d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:00.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.755+0000 7faa52000640 1 --2- 172.21.15.17:0/3529557682 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faa540b5b50 0x7faa540b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:00.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.755+0000 7faa53400640 1 -- 172.21.15.17:0/3529557682 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faa540b5b50 msgr2=0x7faa540b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:00.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.755+0000 7faa53400640 1 --2- 172.21.15.17:0/3529557682 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faa540b5b50 0x7faa540b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:00.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.755+0000 7faa53400640 1 -- 172.21.15.17:0/3529557682 >> v2:172.21.15.94:3300/0 conn(0x7faa540d2fa0 msgr2=0x7faa540d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:00.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.755+0000 7faa53400640 1 --2- 172.21.15.17:0/3529557682 >> v2:172.21.15.94:3300/0 conn(0x7faa540d2fa0 0x7faa540d3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:00.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.755+0000 7faa53400640 1 -- 172.21.15.17:0/3529557682 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa540b85b0 con 0x7faa540cd840 2024-03-12T17:20:00.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.756+0000 7faa53400640 1 --2- 172.21.15.17:0/3529557682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa540cd840 0x7faa540cdcd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7faa540b4dc0 tx=0x7faa4c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf07c0c6300087d server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:00.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.756+0000 7faa51600640 1 -- 172.21.15.17:0/3529557682 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c031870 con 0x7faa540cd840 2024-03-12T17:20:00.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.756+0000 7faa51600640 1 -- 172.21.15.17:0/3529557682 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4c0319d0 con 0x7faa540cd840 2024-03-12T17:20:00.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.756+0000 7faa51600640 1 -- 172.21.15.17:0/3529557682 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c031d60 con 0x7faa540cd840 2024-03-12T17:20:00.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.757+0000 7faa59c00640 1 -- 172.21.15.17:0/3529557682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa540cd840 msgr2=0x7faa540cdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:00.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.757+0000 7faa59c00640 1 --2- 172.21.15.17:0/3529557682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa540cd840 0x7faa540cdcd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7faa540b4dc0 tx=0x7faa4c02b910 comp rx=0 tx=0).stop 2024-03-12T17:20:00.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.757+0000 7faa59c00640 1 -- 172.21.15.17:0/3529557682 shutdown_connections 2024-03-12T17:20:00.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.757+0000 7faa59c00640 1 --2- 172.21.15.17:0/3529557682 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa540cd840 0x7faa540cdcd0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:00.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.757+0000 7faa59c00640 1 --2- 172.21.15.17:0/3529557682 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faa540b5b50 0x7faa540b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:00.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.757+0000 7faa59c00640 1 --2- 172.21.15.17:0/3529557682 >> v2:172.21.15.94:3300/0 conn(0x7faa540d2fa0 0x7faa540d3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:00.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.757+0000 7faa59c00640 1 -- 172.21.15.17:0/3529557682 >> 172.21.15.17:0/3529557682 conn(0x7faa54065df0 msgr2=0x7faa54066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:00.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.757+0000 7faa59c00640 1 -- 172.21.15.17:0/3529557682 shutdown_connections 2024-03-12T17:20:00.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.758+0000 7faa59c00640 1 -- 172.21.15.17:0/3529557682 wait complete. 2024-03-12T17:20:00.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.760+0000 7faa59c00640 1 Processor -- start 2024-03-12T17:20:00.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.760+0000 7faa59c00640 1 -- start start 2024-03-12T17:20:00.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.761+0000 7faa59c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faa540b5b50 0x7faa541f1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:00.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.761+0000 7faa59c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faa540cd840 0x7faa540cb730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:00.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.761+0000 7faa59c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa540d2fa0 0x7faa540cbc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:00.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.761+0000 7faa59c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5415ef60 con 0x7faa540d2fa0 2024-03-12T17:20:00.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.761+0000 7faa59c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5415e2e0 con 0x7faa540b5b50 2024-03-12T17:20:00.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.761+0000 7faa59c00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa5415e5c0 con 0x7faa540cd840 2024-03-12T17:20:00.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.762+0000 7faa53400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa540d2fa0 0x7faa540cbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:00.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.762+0000 7faa53400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa540d2fa0 0x7faa540cbc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50710/0 (socket says 172.21.15.17:50710) 2024-03-12T17:20:00.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.762+0000 7faa53400640 1 -- 172.21.15.17:0/3154056594 learned_addr learned my addr 172.21.15.17:0/3154056594 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:00.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.762+0000 7faa52a00640 1 --2- 172.21.15.17:0/3154056594 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faa540b5b50 0x7faa541f1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:00.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.762+0000 7faa52000640 1 --2- 172.21.15.17:0/3154056594 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faa540cd840 0x7faa540cb730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:00.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.762+0000 7faa53400640 1 -- 172.21.15.17:0/3154056594 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faa540cd840 msgr2=0x7faa540cb730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:00.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.762+0000 7faa53400640 1 --2- 172.21.15.17:0/3154056594 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faa540cd840 0x7faa540cb730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:00.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.762+0000 7faa53400640 1 -- 172.21.15.17:0/3154056594 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faa540b5b50 msgr2=0x7faa541f1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:00.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.762+0000 7faa53400640 1 --2- 172.21.15.17:0/3154056594 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faa540b5b50 0x7faa541f1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:00.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.762+0000 7faa53400640 1 -- 172.21.15.17:0/3154056594 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4c0094d0 con 0x7faa540d2fa0 2024-03-12T17:20:00.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.763+0000 7faa53400640 1 --2- 172.21.15.17:0/3154056594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa540d2fa0 0x7faa540cbc70 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7faa4c0090b0 tx=0x7faa4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:00.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.763+0000 7faa4aa00640 1 -- 172.21.15.17:0/3154056594 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c03ad20 con 0x7faa540d2fa0 2024-03-12T17:20:00.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.763+0000 7faa4aa00640 1 -- 172.21.15.17:0/3154056594 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa4c0443f0 con 0x7faa540d2fa0 2024-03-12T17:20:00.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.763+0000 7faa4aa00640 1 -- 172.21.15.17:0/3154056594 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c03aea0 con 0x7faa540d2fa0 2024-03-12T17:20:00.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.763+0000 7faa59c00640 1 -- 172.21.15.17:0/3154056594 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa5415e8a0 con 0x7faa540d2fa0 2024-03-12T17:20:00.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.763+0000 7faa59c00640 1 -- 172.21.15.17:0/3154056594 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa5415df90 con 0x7faa540d2fa0 2024-03-12T17:20:00.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.765+0000 7faa59c00640 1 -- 172.21.15.17:0/3154056594 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa540736c0 con 0x7faa540d2fa0 2024-03-12T17:20:00.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.766+0000 7faa4aa00640 1 -- 172.21.15.17:0/3154056594 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7faa4c0447a0 con 0x7faa540d2fa0 2024-03-12T17:20:00.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.767+0000 7faa4aa00640 1 --2- 172.21.15.17:0/3154056594 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faa3406ac00 0x7faa3406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:00.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.767+0000 7faa4aa00640 1 -- 172.21.15.17:0/3154056594 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faa4c02d040 con 0x7faa540d2fa0 2024-03-12T17:20:00.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.767+0000 7faa52a00640 1 --2- 172.21.15.17:0/3154056594 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faa3406ac00 0x7faa3406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:00.762 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.768+0000 7faa52a00640 1 --2- 172.21.15.17:0/3154056594 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faa3406ac00 0x7faa3406d0c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7faa440079a0 tx=0x7faa44008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:00.766 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:00.771+0000 7faa4aa00640 1 -- 172.21.15.17:0/3154056594 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7faa4c076b50 con 0x7faa540d2fa0 2024-03-12T17:20:01.035 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.041+0000 7faa59c00640 1 -- 172.21.15.17:0/3154056594 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7faa541601a0 con 0x7faa540d2fa0 2024-03-12T17:20:01.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.049+0000 7faa4aa00640 1 -- 172.21.15.17:0/3154056594 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v9) v1 ==== 190+0+0 (secure 0 0 0) 0x7faa4c07a170 con 0x7faa540d2fa0 2024-03-12T17:20:01.043 INFO:teuthology.orchestra.run.smithi017.stderr:updated caps for client.0 2024-03-12T17:20:01.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.051+0000 7faa59c00640 1 -- 172.21.15.17:0/3154056594 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faa3406ac00 msgr2=0x7faa3406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:01.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.051+0000 7faa59c00640 1 --2- 172.21.15.17:0/3154056594 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faa3406ac00 0x7faa3406d0c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7faa440079a0 tx=0x7faa44008040 comp rx=0 tx=0).stop 2024-03-12T17:20:01.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.051+0000 7faa59c00640 1 -- 172.21.15.17:0/3154056594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa540d2fa0 msgr2=0x7faa540cbc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:01.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.051+0000 7faa59c00640 1 --2- 172.21.15.17:0/3154056594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa540d2fa0 0x7faa540cbc70 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7faa4c0090b0 tx=0x7faa4c0046c0 comp rx=0 tx=0).stop 2024-03-12T17:20:01.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.052+0000 7faa59c00640 1 -- 172.21.15.17:0/3154056594 shutdown_connections 2024-03-12T17:20:01.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.052+0000 7faa59c00640 1 --2- 172.21.15.17:0/3154056594 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faa3406ac00 0x7faa3406d0c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:01.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.052+0000 7faa59c00640 1 --2- 172.21.15.17:0/3154056594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faa540d2fa0 0x7faa540cbc70 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:01.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.052+0000 7faa59c00640 1 --2- 172.21.15.17:0/3154056594 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faa540cd840 0x7faa540cb730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:01.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.052+0000 7faa59c00640 1 --2- 172.21.15.17:0/3154056594 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faa540b5b50 0x7faa541f1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:01.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.052+0000 7faa59c00640 1 -- 172.21.15.17:0/3154056594 >> 172.21.15.17:0/3154056594 conn(0x7faa54065df0 msgr2=0x7faa540c8d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:01.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.052+0000 7faa59c00640 1 -- 172.21.15.17:0/3154056594 shutdown_connections 2024-03-12T17:20:01.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.052+0000 7faa59c00640 1 -- 172.21.15.17:0/3154056594 wait complete. 2024-03-12T17:20:01.065 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-12T17:20:01.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.293+0000 7fb9cae00640 1 Processor -- start 2024-03-12T17:20:01.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.294+0000 7fb9cae00640 1 -- start start 2024-03-12T17:20:01.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.295+0000 7fb9cae00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb9c40ced90 0x7fb9c40b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:01.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.295+0000 7fb9cae00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb9c406c3f0 0x7fb9c40b3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:01.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.295+0000 7fb9cae00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9c40cb340 con 0x7fb9c40b3780 2024-03-12T17:20:01.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.295+0000 7fb9cae00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c40b3c10 con 0x7fb9c40ced90 2024-03-12T17:20:01.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.295+0000 7fb9cae00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c4159d50 con 0x7fb9c406c3f0 2024-03-12T17:20:01.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.296+0000 7fb9c3e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb9c40ced90 0x7fb9c40b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:01.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.296+0000 7fb9c3e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb9c40ced90 0x7fb9c40b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50718/0 (socket says 172.21.15.17:50718) 2024-03-12T17:20:01.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.296+0000 7fb9c3e00640 1 -- 172.21.15.17:0/686224949 learned_addr learned my addr 172.21.15.17:0/686224949 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:01.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.296+0000 7fb9c3400640 1 --2- 172.21.15.17:0/686224949 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb9c406c3f0 0x7fb9c40b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:01.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.296+0000 7fb9c3e00640 1 -- 172.21.15.17:0/686224949 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb9c406c3f0 msgr2=0x7fb9c40b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:01.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.296+0000 7fb9c3e00640 1 --2- 172.21.15.17:0/686224949 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb9c406c3f0 0x7fb9c40b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:01.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.296+0000 7fb9c3e00640 1 -- 172.21.15.17:0/686224949 >> v1:172.21.15.94:6789/0 conn(0x7fb9c40b3780 legacy=0x7fb9c415d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:01.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.296+0000 7fb9c3e00640 1 -- 172.21.15.17:0/686224949 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c40b1c50 con 0x7fb9c40ced90 2024-03-12T17:20:01.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.296+0000 7fb9c3400640 1 --2- 172.21.15.17:0/686224949 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb9c406c3f0 0x7fb9c40b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:01.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.297+0000 7fb9c3e00640 1 --2- 172.21.15.17:0/686224949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9c40ced90 0x7fb9c40b1710 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb9b400bb10 tx=0x7fb9b402e0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb49d24349f2d3d9 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:01.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.298+0000 7fb9c2a00640 1 -- 172.21.15.17:0/686224949 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b402ee70 con 0x7fb9c40ced90 2024-03-12T17:20:01.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.298+0000 7fb9c2a00640 1 -- 172.21.15.17:0/686224949 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b4036440 con 0x7fb9c40ced90 2024-03-12T17:20:01.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.298+0000 7fb9c2a00640 1 -- 172.21.15.17:0/686224949 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b40367d0 con 0x7fb9c40ced90 2024-03-12T17:20:01.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.298+0000 7fb9cae00640 1 -- 172.21.15.17:0/686224949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9c40ced90 msgr2=0x7fb9c40b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:01.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.298+0000 7fb9cae00640 1 --2- 172.21.15.17:0/686224949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9c40ced90 0x7fb9c40b1710 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fb9b400bb10 tx=0x7fb9b402e0c0 comp rx=0 tx=0).stop 2024-03-12T17:20:01.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.298+0000 7fb9cae00640 1 -- 172.21.15.17:0/686224949 shutdown_connections 2024-03-12T17:20:01.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.298+0000 7fb9cae00640 1 --2- 172.21.15.17:0/686224949 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb9c406c3f0 0x7fb9c40b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:01.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.298+0000 7fb9cae00640 1 --2- 172.21.15.17:0/686224949 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9c40ced90 0x7fb9c40b1710 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:01.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.298+0000 7fb9cae00640 1 -- 172.21.15.17:0/686224949 >> 172.21.15.17:0/686224949 conn(0x7fb9c4069ce0 msgr2=0x7fb9c406a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:01.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.298+0000 7fb9cae00640 1 -- 172.21.15.17:0/686224949 shutdown_connections 2024-03-12T17:20:01.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.299+0000 7fb9cae00640 1 -- 172.21.15.17:0/686224949 wait complete. 2024-03-12T17:20:01.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.300+0000 7fb9cae00640 1 Processor -- start 2024-03-12T17:20:01.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.300+0000 7fb9cae00640 1 -- start start 2024-03-12T17:20:01.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.301+0000 7fb9cae00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9c406c3f0 0x7fb9c4144ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:01.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.301+0000 7fb9cae00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9c40b3780 0x7fb9c40ade30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:01.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.301+0000 7fb9cae00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb9c40ced90 0x7fb9c41e3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:01.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.301+0000 7fb9cae00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c4145000 con 0x7fb9c40b3780 2024-03-12T17:20:01.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.301+0000 7fb9cae00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c41423c0 con 0x7fb9c406c3f0 2024-03-12T17:20:01.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.301+0000 7fb9cae00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c41426a0 con 0x7fb9c40ced90 2024-03-12T17:20:01.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.302+0000 7fb9c3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9c40b3780 0x7fb9c40ade30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:01.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.302+0000 7fb9c3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9c40b3780 0x7fb9c40ade30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:50734/0 (socket says 172.21.15.17:50734) 2024-03-12T17:20:01.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.302+0000 7fb9c3400640 1 -- 172.21.15.17:0/2525880158 learned_addr learned my addr 172.21.15.17:0/2525880158 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:01.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.302+0000 7fb9c3e00640 1 --2- 172.21.15.17:0/2525880158 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9c406c3f0 0x7fb9c4144ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:01.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.302+0000 7fb9c8e00640 1 --2- 172.21.15.17:0/2525880158 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb9c40ced90 0x7fb9c41e3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:01.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.302+0000 7fb9c3400640 1 -- 172.21.15.17:0/2525880158 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb9c40ced90 msgr2=0x7fb9c41e3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:01.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.302+0000 7fb9c3400640 1 --2- 172.21.15.17:0/2525880158 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb9c40ced90 0x7fb9c41e3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:01.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.302+0000 7fb9c3400640 1 -- 172.21.15.17:0/2525880158 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9c406c3f0 msgr2=0x7fb9c4144ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:01.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.302+0000 7fb9c3400640 1 --2- 172.21.15.17:0/2525880158 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9c406c3f0 0x7fb9c4144ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:01.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.302+0000 7fb9c3400640 1 -- 172.21.15.17:0/2525880158 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9b400b770 con 0x7fb9c40b3780 2024-03-12T17:20:01.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.302+0000 7fb9c8e00640 1 --2- 172.21.15.17:0/2525880158 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb9c40ced90 0x7fb9c41e3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:01.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.303+0000 7fb9c3400640 1 --2- 172.21.15.17:0/2525880158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9c40b3780 0x7fb9c40ade30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb9b000c7f0 tx=0x7fb9b000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:01.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.303+0000 7fb9bbe00640 1 -- 172.21.15.17:0/2525880158 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b0007820 con 0x7fb9c40b3780 2024-03-12T17:20:01.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.303+0000 7fb9bbe00640 1 -- 172.21.15.17:0/2525880158 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9b0007980 con 0x7fb9c40b3780 2024-03-12T17:20:01.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.303+0000 7fb9cae00640 1 -- 172.21.15.17:0/2525880158 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c4142980 con 0x7fb9c40b3780 2024-03-12T17:20:01.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.303+0000 7fb9bbe00640 1 -- 172.21.15.17:0/2525880158 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9b0007cf0 con 0x7fb9c40b3780 2024-03-12T17:20:01.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.303+0000 7fb9cae00640 1 -- 172.21.15.17:0/2525880158 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c4142f40 con 0x7fb9c40b3780 2024-03-12T17:20:01.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.304+0000 7fb9cae00640 1 -- 172.21.15.17:0/2525880158 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c41430d0 con 0x7fb9c40b3780 2024-03-12T17:20:01.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.305+0000 7fb9bbe00640 1 -- 172.21.15.17:0/2525880158 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fb9b00113f0 con 0x7fb9c40b3780 2024-03-12T17:20:01.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.306+0000 7fb9bbe00640 1 --2- 172.21.15.17:0/2525880158 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb9a406ac00 0x7fb9a406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:01.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.306+0000 7fb9bbe00640 1 -- 172.21.15.17:0/2525880158 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9b00896e0 con 0x7fb9c40b3780 2024-03-12T17:20:01.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.307+0000 7fb9c3e00640 1 --2- 172.21.15.17:0/2525880158 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb9a406ac00 0x7fb9a406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:01.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.307+0000 7fb9c3e00640 1 --2- 172.21.15.17:0/2525880158 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb9a406ac00 0x7fb9a406d0c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4038000 tx=0x7fb9b4032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:01.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.310+0000 7fb9bbe00640 1 -- 172.21.15.17:0/2525880158 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fb9b0054850 con 0x7fb9c40b3780 2024-03-12T17:20:01.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.553+0000 7fb9cae00640 1 -- 172.21.15.17:0/2525880158 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb9c40736c0 con 0x7fb9c40b3780 2024-03-12T17:20:01.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.554+0000 7fb9bbe00640 1 -- 172.21.15.17:0/2525880158 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4728 (secure 0 0 0) 0x7fb9b0057e70 con 0x7fb9c40b3780 2024-03-12T17:20:01.549 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:20:01.549 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6834/934570591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":934570591},{"type":"v1","addr":"172.21.15.94:6834","nonce":934570591}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/2007868406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6833","nonce":2007868406},{"type":"v1","addr":"172.21.15.94:6835","nonce":2007868406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4768,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6836/2733057827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2733057827},{"type":"v1","addr":"172.21.15.17:6836","nonce":2733057827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T17:19:55.522204+0000","modified":"2024-03-12T17:19:58.531800+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5058},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5058":{"gid":5058,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6837/672288094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6835","nonce":672288094},{"type":"v1","addr":"172.21.15.17:6837","nonce":672288094}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-03-12T17:20:01.549 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 14 2024-03-12T17:20:01.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.557+0000 7fb9cae00640 1 -- 172.21.15.17:0/2525880158 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb9a406ac00 msgr2=0x7fb9a406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:01.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.557+0000 7fb9cae00640 1 --2- 172.21.15.17:0/2525880158 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb9a406ac00 0x7fb9a406d0c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4038000 tx=0x7fb9b4032000 comp rx=0 tx=0).stop 2024-03-12T17:20:01.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.557+0000 7fb9cae00640 1 -- 172.21.15.17:0/2525880158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9c40b3780 msgr2=0x7fb9c40ade30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:01.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.557+0000 7fb9cae00640 1 --2- 172.21.15.17:0/2525880158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9c40b3780 0x7fb9c40ade30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fb9b000c7f0 tx=0x7fb9b000ccb0 comp rx=0 tx=0).stop 2024-03-12T17:20:01.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.557+0000 7fb9cae00640 1 -- 172.21.15.17:0/2525880158 shutdown_connections 2024-03-12T17:20:01.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.557+0000 7fb9cae00640 1 --2- 172.21.15.17:0/2525880158 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb9a406ac00 0x7fb9a406d0c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:01.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.557+0000 7fb9cae00640 1 --2- 172.21.15.17:0/2525880158 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb9c40ced90 0x7fb9c41e3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:01.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.557+0000 7fb9cae00640 1 --2- 172.21.15.17:0/2525880158 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9c40b3780 0x7fb9c40ade30 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:01.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.557+0000 7fb9cae00640 1 --2- 172.21.15.17:0/2525880158 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9c406c3f0 0x7fb9c4144ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:01.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.557+0000 7fb9cae00640 1 -- 172.21.15.17:0/2525880158 >> 172.21.15.17:0/2525880158 conn(0x7fb9c4069ce0 msgr2=0x7fb9c40ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:01.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.558+0000 7fb9cae00640 1 -- 172.21.15.17:0/2525880158 shutdown_connections 2024-03-12T17:20:01.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:01.558+0000 7fb9cae00640 1 -- 172.21.15.17:0/2525880158 wait complete. 2024-03-12T17:20:01.975 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-12T17:19:55.522204+0000', 'modified': '2024-03-12T17:19:58.531800+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5058}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5058': {'gid': 5058, 'name': 'c', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.17:6837/672288094', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6835', 'nonce': 672288094}, {'type': 'v1', 'addr': '172.21.15.17:6837', 'nonce': 672288094}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-03-12T17:20:01.976 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-12T17:20:01.976 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-03-12T17:20:02.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.215+0000 7fca15200640 1 Processor -- start 2024-03-12T17:20:02.209 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.215+0000 7fca15200640 1 -- start start 2024-03-12T17:20:02.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.216+0000 7fca15200640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fca1006db80 0x7fca100cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:02.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.217+0000 7fca15200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fca100cbd10 0x7fca10159b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:02.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.217+0000 7fca15200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca1015d260 con 0x7fca100b2ca0 2024-03-12T17:20:02.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.217+0000 7fca15200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca1015dee0 con 0x7fca100cbd10 2024-03-12T17:20:02.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.217+0000 7fca15200640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca1015d540 con 0x7fca1006db80 2024-03-12T17:20:02.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.217+0000 7fca0f400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fca100b2ca0 0x7fca1006d470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53560/0 (socket says 172.21.15.17:53560) 2024-03-12T17:20:02.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.217+0000 7fca0f400640 1 -- 172.21.15.17:0/1952824313 learned_addr learned my addr 172.21.15.17:0/1952824313 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:20:02.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.217+0000 7fca0fe00640 1 --2- 172.21.15.17:0/1952824313 >> v2:172.21.15.17:3300/0 conn(0x7fca100cbd10 0x7fca10159b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:02.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.217+0000 7fca0ea00640 1 --2- 172.21.15.17:0/1952824313 >> v2:172.21.15.94:3300/0 conn(0x7fca1006db80 0x7fca100cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:02.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.218+0000 7fca0e000640 1 -- 172.21.15.17:0/1952824313 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3192722093 0 0) 0x7fca1015d260 con 0x7fca100b2ca0 2024-03-12T17:20:02.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.218+0000 7fca0e000640 1 -- 172.21.15.17:0/1952824313 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9f4005730 con 0x7fca100b2ca0 2024-03-12T17:20:02.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.218+0000 7fca0fe00640 1 -- 172.21.15.17:0/1952824313 >> v2:172.21.15.94:3300/0 conn(0x7fca1006db80 msgr2=0x7fca100cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:02.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.218+0000 7fca0fe00640 1 --2- 172.21.15.17:0/1952824313 >> v2:172.21.15.94:3300/0 conn(0x7fca1006db80 0x7fca100cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.218+0000 7fca0fe00640 1 -- 172.21.15.17:0/1952824313 >> v1:172.21.15.17:6789/0 conn(0x7fca100b2ca0 legacy=0x7fca1006d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:02.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.218+0000 7fca0fe00640 1 -- 172.21.15.17:0/1952824313 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca1015d820 con 0x7fca100cbd10 2024-03-12T17:20:02.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.219+0000 7fca0fe00640 1 --2- 172.21.15.17:0/1952824313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca100cbd10 0x7fca10159b80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fca10066540 tx=0x7fca0802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b621b96467a0cc90 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:02.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.220+0000 7fca0e000640 1 -- 172.21.15.17:0/1952824313 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca08031830 con 0x7fca100cbd10 2024-03-12T17:20:02.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.220+0000 7fca0e000640 1 -- 172.21.15.17:0/1952824313 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca08031990 con 0x7fca100cbd10 2024-03-12T17:20:02.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.220+0000 7fca0e000640 1 -- 172.21.15.17:0/1952824313 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca08031d20 con 0x7fca100cbd10 2024-03-12T17:20:02.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.220+0000 7fca15200640 1 -- 172.21.15.17:0/1952824313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca100cbd10 msgr2=0x7fca10159b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:02.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.220+0000 7fca15200640 1 --2- 172.21.15.17:0/1952824313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca100cbd10 0x7fca10159b80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fca10066540 tx=0x7fca0802b8d0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.221+0000 7fca15200640 1 -- 172.21.15.17:0/1952824313 shutdown_connections 2024-03-12T17:20:02.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.221+0000 7fca15200640 1 --2- 172.21.15.17:0/1952824313 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca100cbd10 0x7fca10159b80 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.221+0000 7fca15200640 1 --2- 172.21.15.17:0/1952824313 >> v2:172.21.15.94:3300/0 conn(0x7fca1006db80 0x7fca100cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.221+0000 7fca15200640 1 -- 172.21.15.17:0/1952824313 >> 172.21.15.17:0/1952824313 conn(0x7fca10066000 msgr2=0x7fca10069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:02.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.221+0000 7fca15200640 1 -- 172.21.15.17:0/1952824313 shutdown_connections 2024-03-12T17:20:02.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.221+0000 7fca15200640 1 -- 172.21.15.17:0/1952824313 wait complete. 2024-03-12T17:20:02.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.222+0000 7fca15200640 1 Processor -- start 2024-03-12T17:20:02.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.223+0000 7fca15200640 1 -- start start 2024-03-12T17:20:02.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.223+0000 7fca15200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca1006db80 0x7fca10141050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:02.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.223+0000 7fca15200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fca100b2ca0 0x7fca1013fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:02.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.224+0000 7fca15200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fca100cbd10 0x7fca10154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:02.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.224+0000 7fca15200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca10141590 con 0x7fca1006db80 2024-03-12T17:20:02.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.224+0000 7fca15200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca101423d0 con 0x7fca100cbd10 2024-03-12T17:20:02.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.224+0000 7fca15200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca101417c0 con 0x7fca100b2ca0 2024-03-12T17:20:02.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.224+0000 7fca0f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca1006db80 0x7fca10141050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:02.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.224+0000 7fca0f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca1006db80 0x7fca10141050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47928/0 (socket says 172.21.15.17:47928) 2024-03-12T17:20:02.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.224+0000 7fca0f400640 1 -- 172.21.15.17:0/3133294813 learned_addr learned my addr 172.21.15.17:0/3133294813 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:02.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.224+0000 7fca0f400640 1 -- 172.21.15.17:0/3133294813 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fca100b2ca0 msgr2=0x7fca1013fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:02.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.224+0000 7fca0f400640 1 --2- 172.21.15.17:0/3133294813 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fca100b2ca0 0x7fca1013fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.224+0000 7fca0f400640 1 -- 172.21.15.17:0/3133294813 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fca100cbd10 msgr2=0x7fca10154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:02.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.224+0000 7fca0f400640 1 --2- 172.21.15.17:0/3133294813 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fca100cbd10 0x7fca10154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.224+0000 7fca0f400640 1 -- 172.21.15.17:0/3133294813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca08009400 con 0x7fca1006db80 2024-03-12T17:20:02.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.225+0000 7fca0f400640 1 --2- 172.21.15.17:0/3133294813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca1006db80 0x7fca10141050 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fca0000cbc0 tx=0x7fca0000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:02.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.225+0000 7fca07400640 1 -- 172.21.15.17:0/3133294813 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0000ad40 con 0x7fca1006db80 2024-03-12T17:20:02.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.225+0000 7fca07400640 1 -- 172.21.15.17:0/3133294813 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca00012400 con 0x7fca1006db80 2024-03-12T17:20:02.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.225+0000 7fca15200640 1 -- 172.21.15.17:0/3133294813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca10141aa0 con 0x7fca1006db80 2024-03-12T17:20:02.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.225+0000 7fca07400640 1 -- 172.21.15.17:0/3133294813 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0000aea0 con 0x7fca1006db80 2024-03-12T17:20:02.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.225+0000 7fca15200640 1 -- 172.21.15.17:0/3133294813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca10142060 con 0x7fca1006db80 2024-03-12T17:20:02.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.227+0000 7fca07400640 1 -- 172.21.15.17:0/3133294813 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fca00007070 con 0x7fca1006db80 2024-03-12T17:20:02.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.228+0000 7fca07400640 1 --2- 172.21.15.17:0/3133294813 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc9f006ac00 0x7fc9f006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:02.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.228+0000 7fca07400640 1 -- 172.21.15.17:0/3133294813 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca000892a0 con 0x7fca1006db80 2024-03-12T17:20:02.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.228+0000 7fca0ea00640 1 --2- 172.21.15.17:0/3133294813 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc9f006ac00 0x7fc9f006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:02.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.229+0000 7fca19416740 1 Processor -- start 2024-03-12T17:20:02.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.229+0000 7fca19416740 1 -- start start 2024-03-12T17:20:02.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.229+0000 7fca0ea00640 1 --2- 172.21.15.17:0/3133294813 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc9f006ac00 0x7fc9f006d0c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc006a90 tx=0x7fc9fc006a20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:02.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.230+0000 7fca19416740 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x561383ec9200 0x561383e80830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:02.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.230+0000 7fca19416740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561383e7f280 0x561383e80d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:02.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.230+0000 7fca19416740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561383e7b720 0x561383eab510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:02.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.230+0000 7fca19416740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561383e56e40 con 0x561383e7f280 2024-03-12T17:20:02.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.230+0000 7fca19416740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x561383dec090 con 0x561383e7b720 2024-03-12T17:20:02.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.230+0000 7fca19416740 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x561383de9820 con 0x561383ec9200 2024-03-12T17:20:02.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.230+0000 7fca0ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561383e7f280 0x561383e80d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:02.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.230+0000 7fca0ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561383e7f280 0x561383e80d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47940/0 (socket says 172.21.15.17:47940) 2024-03-12T17:20:02.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.230+0000 7fca0ea00640 1 -- 172.21.15.17:0/1785899235 learned_addr learned my addr 172.21.15.17:0/1785899235 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:02.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.231+0000 7fca0f400640 1 --2- 172.21.15.17:0/1785899235 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x561383ec9200 0x561383e80830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:02.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.231+0000 7fca0ea00640 1 -- 172.21.15.17:0/1785899235 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x561383ec9200 msgr2=0x561383e80830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:02.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.231+0000 7fca0ea00640 1 --2- 172.21.15.17:0/1785899235 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x561383ec9200 0x561383e80830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.231+0000 7fca0ea00640 1 -- 172.21.15.17:0/1785899235 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561383e7b720 msgr2=0x561383eab510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:02.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.231+0000 7fca0ea00640 1 --2- 172.21.15.17:0/1785899235 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561383e7b720 0x561383eab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.231+0000 7fca0ea00640 1 -- 172.21.15.17:0/1785899235 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561383dac780 con 0x561383e7f280 2024-03-12T17:20:02.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.231+0000 7fca0ea00640 1 --2- 172.21.15.17:0/1785899235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561383e7f280 0x561383e80d70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc00ebb0 tx=0x7fc9fc011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17c150a4ca2618b7 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:02.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.231+0000 7fc9fbe00640 1 -- 172.21.15.17:0/1785899235 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc015b00 con 0x561383e7f280 2024-03-12T17:20:02.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.231+0000 7fc9fbe00640 1 -- 172.21.15.17:0/1785899235 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9fc015c60 con 0x561383e7f280 2024-03-12T17:20:02.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.231+0000 7fc9fbe00640 1 -- 172.21.15.17:0/1785899235 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc013450 con 0x561383e7f280 2024-03-12T17:20:02.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.232+0000 7fca19416740 1 -- 172.21.15.17:0/1785899235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561383e7f280 msgr2=0x561383e80d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:02.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.232+0000 7fca19416740 1 --2- 172.21.15.17:0/1785899235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561383e7f280 0x561383e80d70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc00ebb0 tx=0x7fc9fc011000 comp rx=0 tx=0).stop 2024-03-12T17:20:02.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.232+0000 7fca19416740 1 -- 172.21.15.17:0/1785899235 shutdown_connections 2024-03-12T17:20:02.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.232+0000 7fca19416740 1 --2- 172.21.15.17:0/1785899235 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561383e7b720 0x561383eab510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.232+0000 7fca19416740 1 --2- 172.21.15.17:0/1785899235 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561383e7f280 0x561383e80d70 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.232+0000 7fca19416740 1 --2- 172.21.15.17:0/1785899235 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x561383ec9200 0x561383e80830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.232+0000 7fca19416740 1 -- 172.21.15.17:0/1785899235 >> 172.21.15.17:0/1785899235 conn(0x561383e7d990 msgr2=0x561383ec6510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:02.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.232+0000 7fca19416740 1 -- 172.21.15.17:0/1785899235 shutdown_connections 2024-03-12T17:20:02.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.232+0000 7fca19416740 1 -- 172.21.15.17:0/1785899235 wait complete. 2024-03-12T17:20:02.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.233+0000 7fca19416740 1 -- start start 2024-03-12T17:20:02.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.233+0000 7fca19416740 1 Processor -- start 2024-03-12T17:20:02.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.234+0000 7fca19416740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561383e7f280 0x561383ea35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:02.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.234+0000 7fca19416740 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x561383ec9200 0x561383e91020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:02.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.234+0000 7fca19416740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561383ecbd10 0x561383ea6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:02.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.234+0000 7fca19416740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561383de5110 con 0x561383e7f280 2024-03-12T17:20:02.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.234+0000 7fca19416740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x561383d868c0 con 0x561383ecbd10 2024-03-12T17:20:02.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.234+0000 7fca19416740 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x561383d86560 con 0x561383ec9200 2024-03-12T17:20:02.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.235+0000 7fca19416740 10 client.0 _ll_register_callbacks cb 0x561383dde8d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-12T17:20:02.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.235+0000 7fca0f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561383e7f280 0x561383ea35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:02.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.235+0000 7fca0f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561383e7f280 0x561383ea35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47942/0 (socket says 172.21.15.17:47942) 2024-03-12T17:20:02.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.235+0000 7fca0f400640 1 -- 172.21.15.17:0/3298445832 learned_addr learned my addr 172.21.15.17:0/3298445832 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:02.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.235+0000 7fca0f400640 1 -- 172.21.15.17:0/3298445832 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x561383ec9200 msgr2=0x561383e91020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:02.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.235+0000 7fca0f400640 1 --2- 172.21.15.17:0/3298445832 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x561383ec9200 0x561383e91020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.235+0000 7fca0f400640 1 -- 172.21.15.17:0/3298445832 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561383ecbd10 msgr2=0x561383ea6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:02.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.235+0000 7fca0f400640 1 --2- 172.21.15.17:0/3298445832 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561383ecbd10 0x561383ea6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.235+0000 7fca0f400640 1 -- 172.21.15.17:0/3298445832 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9fc00e860 con 0x561383e7f280 2024-03-12T17:20:02.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.235+0000 7fca0f400640 1 --2- 172.21.15.17:0/3298445832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561383e7f280 0x561383ea35e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fca0000a930 tx=0x7fca0005c020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b25750d73b9e68eb server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:02.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.235+0000 7fc9f8c00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-12T17:20:02.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.236+0000 7fc9f8c00640 1 -- 172.21.15.17:0/3298445832 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca000578d0 con 0x561383e7f280 2024-03-12T17:20:02.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.236+0000 7fc9f8c00640 1 -- 172.21.15.17:0/3298445832 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca00060090 con 0x561383e7f280 2024-03-12T17:20:02.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.236+0000 7fca19416740 1 -- 172.21.15.17:0/3298445832 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561383e0f660 con 0x561383e7f280 2024-03-12T17:20:02.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.236+0000 7fc9f8c00640 1 -- 172.21.15.17:0/3298445832 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca0005e280 con 0x561383e7f280 2024-03-12T17:20:02.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.236+0000 7fca19416740 10 client.5232 fetch_fsmap learned FSMap version 14 2024-03-12T17:20:02.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.236+0000 7fca19416740 1 -- 172.21.15.17:0/3298445832 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x561383de3790 con 0x561383e7f280 2024-03-12T17:20:02.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.236+0000 7fc9f8c00640 1 -- 172.21.15.17:0/3298445832 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561383e0f660 con 0x561383e7f280 2024-03-12T17:20:02.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.236+0000 7fc9f8c00640 1 -- 172.21.15.17:0/3298445832 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 14) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fca00004b60 con 0x561383e7f280 2024-03-12T17:20:02.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.236+0000 7fca19416740 10 client.5232 fetch_fsmap finished waiting for FSMap version 14 2024-03-12T17:20:02.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.236+0000 7fca19416740 10 client.5232 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-12T17:20:02.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.236+0000 7fca19416740 20 client.5232 populate_metadata read hostname 'smithi017' 2024-03-12T17:20:02.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.236+0000 7fca19416740 1 --2- 172.21.15.17:0/3298445832 >> [v2:172.21.15.17:6835/672288094,v1:172.21.15.17:6837/672288094] conn(0x561383ecabe0 0x561383ecafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:02.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.237+0000 7fca19416740 4 client.5232 mds_command: new command op to 5058 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-12T17:20:02.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.237+0000 7fca19416740 1 -- 172.21.15.17:0/3298445832 --> [v2:172.21.15.17:6835/672288094,v1:172.21.15.17:6837/672288094] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561383dd7e50 con 0x561383ecabe0 2024-03-12T17:20:02.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.237+0000 7fca0ea00640 1 --2- 172.21.15.17:0/3298445832 >> [v2:172.21.15.17:6835/672288094,v1:172.21.15.17:6837/672288094] conn(0x561383ecabe0 0x561383ecafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:02.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.237+0000 7fca0ea00640 1 --2- 172.21.15.17:0/3298445832 >> [v2:172.21.15.17:6835/672288094,v1:172.21.15.17:6837/672288094] conn(0x561383ecabe0 0x561383ecafc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd4e21345396d9c2 server_cookie=3bbf178d8e4af7fc in_seq=0 out_seq=0 2024-03-12T17:20:02.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.237+0000 7fc9f8c00640 10 client.5232 ms_handle_connect on v2:172.21.15.17:6835/672288094 2024-03-12T17:20:02.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.238+0000 7fc9f8c00640 1 -- 172.21.15.17:0/3298445832 <== mds.0 v2:172.21.15.17:6835/672288094 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561383dd7e50 con 0x561383ecabe0 2024-03-12T17:20:02.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.238+0000 7fc9f8c00640 10 client.5232 handle_command_reply: tid=0 2024-03-12T17:20:02.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.238+0000 7fca19416740 1 client.5232 shutdown 2024-03-12T17:20:02.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.239+0000 7fca19416740 1 -- 172.21.15.17:0/3298445832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561383e7f280 msgr2=0x561383ea35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:02.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.239+0000 7fca19416740 1 --2- 172.21.15.17:0/3298445832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561383e7f280 0x561383ea35e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fca0000a930 tx=0x7fca0005c020 comp rx=0 tx=0).stop 2024-03-12T17:20:02.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.239+0000 7fca19416740 1 -- 172.21.15.17:0/3298445832 shutdown_connections 2024-03-12T17:20:02.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.239+0000 7fca19416740 1 --2- 172.21.15.17:0/3298445832 >> [v2:172.21.15.17:6835/672288094,v1:172.21.15.17:6837/672288094] conn(0x561383ecabe0 0x561383ecafc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.239+0000 7fca19416740 1 --2- 172.21.15.17:0/3298445832 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561383ecbd10 0x561383ea6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.239+0000 7fca19416740 1 --2- 172.21.15.17:0/3298445832 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x561383ec9200 0x561383e91020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.239+0000 7fca19416740 1 --2- 172.21.15.17:0/3298445832 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561383e7f280 0x561383ea35e0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.239+0000 7fca19416740 1 -- 172.21.15.17:0/3298445832 >> 172.21.15.17:0/3298445832 conn(0x561383e7b720 msgr2=0x561383e7a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:02.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.239+0000 7fc9f8c00640 0 client.5232 ms_handle_reset on v2:172.21.15.17:6835/672288094 2024-03-12T17:20:02.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.239+0000 7fca19416740 1 -- 172.21.15.17:0/3298445832 shutdown_connections 2024-03-12T17:20:02.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.239+0000 7fca19416740 1 -- 172.21.15.17:0/3298445832 wait complete. 2024-03-12T17:20:02.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.239+0000 7fca19416740 20 client.5232 trim_cache size 0 max 16384 2024-03-12T17:20:02.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.256+0000 7fca19416740 1 Processor -- start 2024-03-12T17:20:02.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.256+0000 7fca19416740 1 -- start start 2024-03-12T17:20:02.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.257+0000 7fca19416740 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x561383e7f280 0x561383e808c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:02.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.257+0000 7fca19416740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561383ec9200 0x561383ea2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:02.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.257+0000 7fca19416740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561383ecbd10 0x561383ea2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:02.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.257+0000 7fca19416740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561383b4cf20 con 0x561383ecbd10 2024-03-12T17:20:02.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.257+0000 7fca19416740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x561383da3c10 con 0x561383ec9200 2024-03-12T17:20:02.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.257+0000 7fca19416740 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x561383ec68e0 con 0x561383e7f280 2024-03-12T17:20:02.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.257+0000 7fca0fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561383ecbd10 0x561383ea2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:02.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.257+0000 7fca0fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561383ecbd10 0x561383ea2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47946/0 (socket says 172.21.15.17:47946) 2024-03-12T17:20:02.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.257+0000 7fca0fe00640 1 -- 172.21.15.17:0/161428970 learned_addr learned my addr 172.21.15.17:0/161428970 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:02.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.258+0000 7fca0ea00640 1 --2- 172.21.15.17:0/161428970 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561383ec9200 0x561383ea2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:02.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.258+0000 7fca0fe00640 1 -- 172.21.15.17:0/161428970 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x561383e7f280 msgr2=0x561383e808c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:02.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.258+0000 7fca0f400640 1 --2- 172.21.15.17:0/161428970 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x561383e7f280 0x561383e808c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:02.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.258+0000 7fca0fe00640 1 --2- 172.21.15.17:0/161428970 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x561383e7f280 0x561383e808c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.258+0000 7fca0fe00640 1 -- 172.21.15.17:0/161428970 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561383ec9200 msgr2=0x561383ea2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:02.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.258+0000 7fca0fe00640 1 --2- 172.21.15.17:0/161428970 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561383ec9200 0x561383ea2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.258+0000 7fca0fe00640 1 -- 172.21.15.17:0/161428970 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561383d85ad0 con 0x561383ecbd10 2024-03-12T17:20:02.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.258+0000 7fca0f400640 1 --2- 172.21.15.17:0/161428970 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x561383e7f280 0x561383e808c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:02.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.258+0000 7fca0ea00640 1 --2- 172.21.15.17:0/161428970 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561383ec9200 0x561383ea2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:02.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.258+0000 7fca0fe00640 1 --2- 172.21.15.17:0/161428970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561383ecbd10 0x561383ea2c40 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fca0802bee0 tx=0x7fca080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3b9221c6ffbdb67 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:02.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.259+0000 7fca04c00640 1 -- 172.21.15.17:0/161428970 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca08031b00 con 0x561383ecbd10 2024-03-12T17:20:02.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.259+0000 7fca04c00640 1 -- 172.21.15.17:0/161428970 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca08031c60 con 0x561383ecbd10 2024-03-12T17:20:02.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.259+0000 7fca04c00640 1 -- 172.21.15.17:0/161428970 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca0803a420 con 0x561383ecbd10 2024-03-12T17:20:02.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.259+0000 7fca19416740 1 -- 172.21.15.17:0/161428970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561383ecbd10 msgr2=0x561383ea2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:02.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.259+0000 7fca19416740 1 --2- 172.21.15.17:0/161428970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561383ecbd10 0x561383ea2c40 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fca0802bee0 tx=0x7fca080046c0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.259+0000 7fca19416740 1 -- 172.21.15.17:0/161428970 shutdown_connections 2024-03-12T17:20:02.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.259+0000 7fca19416740 1 --2- 172.21.15.17:0/161428970 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561383ecbd10 0x561383ea2c40 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.259+0000 7fca19416740 1 --2- 172.21.15.17:0/161428970 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561383ec9200 0x561383ea2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.259+0000 7fca19416740 1 --2- 172.21.15.17:0/161428970 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x561383e7f280 0x561383e808c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.259+0000 7fca19416740 1 -- 172.21.15.17:0/161428970 >> 172.21.15.17:0/161428970 conn(0x561383e7b720 msgr2=0x561383ea6810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:02.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.259+0000 7fca19416740 1 -- 172.21.15.17:0/161428970 shutdown_connections 2024-03-12T17:20:02.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.259+0000 7fca19416740 1 -- 172.21.15.17:0/161428970 wait complete. 2024-03-12T17:20:02.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.260+0000 7fca19416740 1 -- start start 2024-03-12T17:20:02.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.260+0000 7fca19416740 1 Processor -- start 2024-03-12T17:20:02.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.261+0000 7fca19416740 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x561383e7f280 0x561383f316c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:02.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.261+0000 7fca19416740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561383ec9200 0x561383e81250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:02.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.261+0000 7fca19416740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561383ecbd10 0x561383e81790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:02.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.261+0000 7fca19416740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x561383ea9c70 con 0x561383ecbd10 2024-03-12T17:20:02.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.261+0000 7fca19416740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x561383ea8bf0 con 0x561383ec9200 2024-03-12T17:20:02.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.261+0000 7fca19416740 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x561383f31c00 con 0x561383e7f280 2024-03-12T17:20:02.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.261+0000 7fca19416740 10 client.0 _ll_register_callbacks cb 0x7fca000581e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-12T17:20:02.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.262+0000 7fca0fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561383ecbd10 0x561383e81790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:02.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.262+0000 7fca0fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561383ecbd10 0x561383e81790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47950/0 (socket says 172.21.15.17:47950) 2024-03-12T17:20:02.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.262+0000 7fca0fe00640 1 -- 172.21.15.17:0/2861326828 learned_addr learned my addr 172.21.15.17:0/2861326828 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:02.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.262+0000 7fca0f400640 1 --2- 172.21.15.17:0/2861326828 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x561383e7f280 0x561383f316c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:02.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.262+0000 7fca0ea00640 1 --2- 172.21.15.17:0/2861326828 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561383ec9200 0x561383e81250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:02.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.262+0000 7fca0fe00640 1 -- 172.21.15.17:0/2861326828 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x561383e7f280 msgr2=0x561383f316c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:02.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.262+0000 7fca0fe00640 1 --2- 172.21.15.17:0/2861326828 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x561383e7f280 0x561383f316c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.262+0000 7fca0fe00640 1 -- 172.21.15.17:0/2861326828 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561383ec9200 msgr2=0x561383e81250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:02.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.262+0000 7fca0fe00640 1 --2- 172.21.15.17:0/2861326828 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561383ec9200 0x561383e81250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.262+0000 7fca0fe00640 1 -- 172.21.15.17:0/2861326828 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca1015d820 con 0x561383ecbd10 2024-03-12T17:20:02.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.262+0000 7fca0fe00640 1 --2- 172.21.15.17:0/2861326828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561383ecbd10 0x561383e81790 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fca08045040 tx=0x7fca0802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c95c7678857520b server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:02.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.262+0000 7fc9f8c00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-12T17:20:02.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.263+0000 7fc9f8c00640 1 -- 172.21.15.17:0/2861326828 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca08050070 con 0x561383ecbd10 2024-03-12T17:20:02.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.263+0000 7fc9f8c00640 1 -- 172.21.15.17:0/2861326828 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca08031dd0 con 0x561383ecbd10 2024-03-12T17:20:02.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.263+0000 7fca19416740 1 -- 172.21.15.17:0/2861326828 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561383ec6bb0 con 0x561383ecbd10 2024-03-12T17:20:02.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.263+0000 7fc9f8c00640 1 -- 172.21.15.17:0/2861326828 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca08031b00 con 0x561383ecbd10 2024-03-12T17:20:02.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.263+0000 7fca19416740 10 client.5238 fetch_fsmap learned FSMap version 14 2024-03-12T17:20:02.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.263+0000 7fca19416740 1 -- 172.21.15.17:0/2861326828 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) v3 -- 0x561383daafe0 con 0x561383ecbd10 2024-03-12T17:20:02.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.263+0000 7fc9f8c00640 1 -- 172.21.15.17:0/2861326828 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561383ec6bb0 con 0x561383ecbd10 2024-03-12T17:20:02.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.263+0000 7fc9f8c00640 1 -- 172.21.15.17:0/2861326828 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 14) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fca08053020 con 0x561383ecbd10 2024-03-12T17:20:02.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.263+0000 7fca19416740 10 client.5238 fetch_fsmap finished waiting for FSMap version 14 2024-03-12T17:20:02.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.263+0000 7fca19416740 10 client.5238 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-12T17:20:02.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.263+0000 7fca19416740 20 client.5238 populate_metadata read hostname 'smithi017' 2024-03-12T17:20:02.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.263+0000 7fca19416740 1 --2- 172.21.15.17:0/2861326828 >> [v2:172.21.15.17:6835/672288094,v1:172.21.15.17:6837/672288094] conn(0x561383ec9630 0x561383ec9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:02.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.264+0000 7fca19416740 4 client.5238 mds_command: new command op to 5058 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-12T17:20:02.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.264+0000 7fca19416740 1 -- 172.21.15.17:0/2861326828 --> [v2:172.21.15.17:6835/672288094,v1:172.21.15.17:6837/672288094] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fc9fc015c60 con 0x561383ec9630 2024-03-12T17:20:02.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.264+0000 7fca0f400640 1 --2- 172.21.15.17:0/2861326828 >> [v2:172.21.15.17:6835/672288094,v1:172.21.15.17:6837/672288094] conn(0x561383ec9630 0x561383ec9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:02.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.264+0000 7fca0f400640 1 --2- 172.21.15.17:0/2861326828 >> [v2:172.21.15.17:6835/672288094,v1:172.21.15.17:6837/672288094] conn(0x561383ec9630 0x561383ec9a10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a00ea5abc3214b2 server_cookie=fcd1434fa9f33a97 in_seq=0 out_seq=0 2024-03-12T17:20:02.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.264+0000 7fc9f8c00640 10 client.5238 ms_handle_connect on v2:172.21.15.17:6835/672288094 2024-03-12T17:20:02.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.265+0000 7fc9f8c00640 1 -- 172.21.15.17:0/2861326828 <== mds.0 v2:172.21.15.17:6835/672288094 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x7fc9fc015c60 con 0x561383ec9630 2024-03-12T17:20:02.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.265+0000 7fc9f8c00640 10 client.5238 handle_command_reply: tid=0 2024-03-12T17:20:02.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.265+0000 7fca19416740 1 client.5238 shutdown 2024-03-12T17:20:02.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.265+0000 7fca19416740 1 -- 172.21.15.17:0/2861326828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561383ecbd10 msgr2=0x561383e81790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:02.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.265+0000 7fca19416740 1 --2- 172.21.15.17:0/2861326828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561383ecbd10 0x561383e81790 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fca08045040 tx=0x7fca0802e000 comp rx=0 tx=0).stop 2024-03-12T17:20:02.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.265+0000 7fca19416740 1 -- 172.21.15.17:0/2861326828 shutdown_connections 2024-03-12T17:20:02.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.265+0000 7fca19416740 1 --2- 172.21.15.17:0/2861326828 >> [v2:172.21.15.17:6835/672288094,v1:172.21.15.17:6837/672288094] conn(0x561383ec9630 0x561383ec9a10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.265+0000 7fca19416740 1 --2- 172.21.15.17:0/2861326828 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x561383ecbd10 0x561383e81790 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.265+0000 7fca19416740 1 --2- 172.21.15.17:0/2861326828 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x561383ec9200 0x561383e81250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.265+0000 7fca19416740 1 --2- 172.21.15.17:0/2861326828 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x561383e7f280 0x561383f316c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.265+0000 7fc9f8c00640 0 client.5238 ms_handle_reset on v2:172.21.15.17:6835/672288094 2024-03-12T17:20:02.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.265+0000 7fca19416740 1 -- 172.21.15.17:0/2861326828 >> 172.21.15.17:0/2861326828 conn(0x561383e7b720 msgr2=0x561383ea6810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:02.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.265+0000 7fca19416740 1 -- 172.21.15.17:0/2861326828 shutdown_connections 2024-03-12T17:20:02.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.265+0000 7fca19416740 1 -- 172.21.15.17:0/2861326828 wait complete. 2024-03-12T17:20:02.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.265+0000 7fca19416740 20 client.5238 trim_cache size 0 max 16384 2024-03-12T17:20:02.263 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-12T17:20:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "73425bc1-630f-4bd2-8abb-716ed5d8ca29", 2024-03-12T17:20:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-03-12T17:20:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 5058, 2024-03-12T17:20:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-03-12T17:20:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-03-12T17:20:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-03-12T17:20:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 6.7374234340000001, 2024-03-12T17:20:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 14, 2024-03-12T17:20:02.263 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 35, 2024-03-12T17:20:02.264 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 35, 2024-03-12T17:20:02.264 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 15.407001762 2024-03-12T17:20:02.264 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-12T17:20:02.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.266+0000 7fca15200640 1 -- 172.21.15.17:0/3133294813 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc9f006ac00 msgr2=0x7fc9f006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:02.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.266+0000 7fca15200640 1 --2- 172.21.15.17:0/3133294813 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc9f006ac00 0x7fc9f006d0c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc006a90 tx=0x7fc9fc006a20 comp rx=0 tx=0).stop 2024-03-12T17:20:02.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.266+0000 7fca15200640 1 -- 172.21.15.17:0/3133294813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca1006db80 msgr2=0x7fca10141050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:02.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.266+0000 7fca15200640 1 --2- 172.21.15.17:0/3133294813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca1006db80 0x7fca10141050 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fca0000cbc0 tx=0x7fca0000a430 comp rx=0 tx=0).stop 2024-03-12T17:20:02.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.266+0000 7fca15200640 1 -- 172.21.15.17:0/3133294813 shutdown_connections 2024-03-12T17:20:02.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.266+0000 7fca15200640 1 --2- 172.21.15.17:0/3133294813 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc9f006ac00 0x7fc9f006d0c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.266+0000 7fca15200640 1 --2- 172.21.15.17:0/3133294813 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fca100cbd10 0x7fca10154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.266+0000 7fca15200640 1 --2- 172.21.15.17:0/3133294813 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fca100b2ca0 0x7fca1013fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.266+0000 7fca15200640 1 --2- 172.21.15.17:0/3133294813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fca1006db80 0x7fca10141050 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.266+0000 7fca15200640 1 -- 172.21.15.17:0/3133294813 >> 172.21.15.17:0/3133294813 conn(0x7fca10066000 msgr2=0x7fca1015a690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:02.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.266+0000 7fca15200640 1 -- 172.21.15.17:0/3133294813 shutdown_connections 2024-03-12T17:20:02.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.266+0000 7fca15200640 1 -- 172.21.15.17:0/3133294813 wait complete. 2024-03-12T17:20:02.277 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-12T17:20:02.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.498+0000 7fe2b7800640 1 Processor -- start 2024-03-12T17:20:02.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.499+0000 7fe2b7800640 1 -- start start 2024-03-12T17:20:02.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.500+0000 7fe2b7800640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe2b00d2fa0 0x7fe2b00d3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:02.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.500+0000 7fe2b7800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe2b00b5f70 0x7fe2b00d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:02.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.500+0000 7fe2b7800640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2b00d14e0 con 0x7fe2b00b5b50 2024-03-12T17:20:02.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.500+0000 7fe2b7800640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b00b59e0 con 0x7fe2b00b5f70 2024-03-12T17:20:02.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.500+0000 7fe2b7800640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b00d38c0 con 0x7fe2b00d2fa0 2024-03-12T17:20:02.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.500+0000 7fe2b5800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe2b00b5f70 0x7fe2b00d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:02.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.500+0000 7fe2b5800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe2b00b5f70 0x7fe2b00d1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47954/0 (socket says 172.21.15.17:47954) 2024-03-12T17:20:02.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.500+0000 7fe2b5800640 1 -- 172.21.15.17:0/3334209999 learned_addr learned my addr 172.21.15.17:0/3334209999 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:02.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.501+0000 7fe2b4e00640 1 --2- 172.21.15.17:0/3334209999 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe2b00d2fa0 0x7fe2b00d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:02.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.501+0000 7fe2b5800640 1 -- 172.21.15.17:0/3334209999 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe2b00d2fa0 msgr2=0x7fe2b00d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:02.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.501+0000 7fe2b5800640 1 --2- 172.21.15.17:0/3334209999 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe2b00d2fa0 0x7fe2b00d3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.501+0000 7fe2b5800640 1 -- 172.21.15.17:0/3334209999 >> v1:172.21.15.17:6789/0 conn(0x7fe2b00b5b50 legacy=0x7fe2b00cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:02.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.501+0000 7fe2b5800640 1 -- 172.21.15.17:0/3334209999 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b00b85b0 con 0x7fe2b00b5f70 2024-03-12T17:20:02.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.502+0000 7fe2b5800640 1 --2- 172.21.15.17:0/3334209999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2b00b5f70 0x7fe2b00d1f30 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8009e50 tx=0x7fe2a802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89716cf9c58f8525 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:02.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.502+0000 7fe2afe00640 1 -- 172.21.15.17:0/3334209999 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a802cb00 con 0x7fe2b00b5f70 2024-03-12T17:20:02.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.502+0000 7fe2afe00640 1 -- 172.21.15.17:0/3334209999 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a802cc60 con 0x7fe2b00b5f70 2024-03-12T17:20:02.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.502+0000 7fe2afe00640 1 -- 172.21.15.17:0/3334209999 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a80343f0 con 0x7fe2b00b5f70 2024-03-12T17:20:02.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.503+0000 7fe2b7800640 1 -- 172.21.15.17:0/3334209999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2b00b5f70 msgr2=0x7fe2b00d1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:02.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.503+0000 7fe2b7800640 1 --2- 172.21.15.17:0/3334209999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2b00b5f70 0x7fe2b00d1f30 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8009e50 tx=0x7fe2a802bf60 comp rx=0 tx=0).stop 2024-03-12T17:20:02.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.503+0000 7fe2b7800640 1 -- 172.21.15.17:0/3334209999 shutdown_connections 2024-03-12T17:20:02.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.503+0000 7fe2b7800640 1 --2- 172.21.15.17:0/3334209999 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2b00b5f70 0x7fe2b00d1f30 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.503+0000 7fe2b7800640 1 --2- 172.21.15.17:0/3334209999 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe2b00d2fa0 0x7fe2b00d3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.503+0000 7fe2b7800640 1 -- 172.21.15.17:0/3334209999 >> 172.21.15.17:0/3334209999 conn(0x7fe2b0065df0 msgr2=0x7fe2b0066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:02.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.503+0000 7fe2b7800640 1 -- 172.21.15.17:0/3334209999 shutdown_connections 2024-03-12T17:20:02.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.503+0000 7fe2b7800640 1 -- 172.21.15.17:0/3334209999 wait complete. 2024-03-12T17:20:02.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.505+0000 7fe2b7800640 1 Processor -- start 2024-03-12T17:20:02.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.505+0000 7fe2b7800640 1 -- start start 2024-03-12T17:20:02.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.506+0000 7fe2b7800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2b00b5b50 0x7fe2b01f2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:02.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.506+0000 7fe2b7800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2b00b5f70 0x7fe2b00c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:02.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.506+0000 7fe2b7800640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe2b00d2fa0 0x7fe2b00ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:02.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.506+0000 7fe2b7800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b00ccd70 con 0x7fe2b00b5f70 2024-03-12T17:20:02.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.506+0000 7fe2b7800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b00c7fe0 con 0x7fe2b00b5b50 2024-03-12T17:20:02.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.506+0000 7fe2b7800640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b00c76b0 con 0x7fe2b00d2fa0 2024-03-12T17:20:02.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.506+0000 7fe2a7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2b00b5f70 0x7fe2b00c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:02.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.506+0000 7fe2a7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2b00b5f70 0x7fe2b00c9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47958/0 (socket says 172.21.15.17:47958) 2024-03-12T17:20:02.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.506+0000 7fe2a7e00640 1 -- 172.21.15.17:0/2108446485 learned_addr learned my addr 172.21.15.17:0/2108446485 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:02.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.507+0000 7fe2b5800640 1 --2- 172.21.15.17:0/2108446485 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe2b00d2fa0 0x7fe2b00ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:02.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.507+0000 7fe2b4e00640 1 --2- 172.21.15.17:0/2108446485 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2b00b5b50 0x7fe2b01f2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:02.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.507+0000 7fe2a7e00640 1 -- 172.21.15.17:0/2108446485 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe2b00d2fa0 msgr2=0x7fe2b00ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:02.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.507+0000 7fe2a7e00640 1 --2- 172.21.15.17:0/2108446485 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe2b00d2fa0 0x7fe2b00ca010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.507+0000 7fe2a7e00640 1 -- 172.21.15.17:0/2108446485 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2b00b5b50 msgr2=0x7fe2b01f2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:02.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.507+0000 7fe2a7e00640 1 --2- 172.21.15.17:0/2108446485 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2b00b5b50 0x7fe2b01f2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.507+0000 7fe2a7e00640 1 -- 172.21.15.17:0/2108446485 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a8009b30 con 0x7fe2b00b5f70 2024-03-12T17:20:02.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.507+0000 7fe2b5800640 1 --2- 172.21.15.17:0/2108446485 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe2b00d2fa0 0x7fe2b00ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:02.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.507+0000 7fe2a7e00640 1 --2- 172.21.15.17:0/2108446485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2b00b5f70 0x7fe2b00c9ad0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe29800c400 tx=0x7fe29800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:02.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.507+0000 7fe2ad600640 1 -- 172.21.15.17:0/2108446485 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2980052d0 con 0x7fe2b00b5f70 2024-03-12T17:20:02.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.507+0000 7fe2ad600640 1 -- 172.21.15.17:0/2108446485 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe298005430 con 0x7fe2b00b5f70 2024-03-12T17:20:02.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.507+0000 7fe2ad600640 1 -- 172.21.15.17:0/2108446485 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe298003830 con 0x7fe2b00b5f70 2024-03-12T17:20:02.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.507+0000 7fe2b7800640 1 -- 172.21.15.17:0/2108446485 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b00c7990 con 0x7fe2b00b5f70 2024-03-12T17:20:02.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.508+0000 7fe2b7800640 1 -- 172.21.15.17:0/2108446485 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b01521b0 con 0x7fe2b00b5f70 2024-03-12T17:20:02.503 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.509+0000 7fe2b7800640 1 -- 172.21.15.17:0/2108446485 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2b00c8150 con 0x7fe2b00b5f70 2024-03-12T17:20:02.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.510+0000 7fe2ad600640 1 -- 172.21.15.17:0/2108446485 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fe298003990 con 0x7fe2b00b5f70 2024-03-12T17:20:02.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.510+0000 7fe2ad600640 1 --2- 172.21.15.17:0/2108446485 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe28c06ac00 0x7fe28c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:02.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.510+0000 7fe2ad600640 1 -- 172.21.15.17:0/2108446485 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe2980888e0 con 0x7fe2b00b5f70 2024-03-12T17:20:02.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.511+0000 7fe2b4e00640 1 --2- 172.21.15.17:0/2108446485 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe28c06ac00 0x7fe28c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:02.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.511+0000 7fe2b4e00640 1 --2- 172.21.15.17:0/2108446485 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe28c06ac00 0x7fe28c06d0c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0006fd0 tx=0x7fe2a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:02.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.516+0000 7fe2ad600640 1 -- 172.21.15.17:0/2108446485 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fe298053ab0 con 0x7fe2b00b5f70 2024-03-12T17:20:02.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.755+0000 7fe2b7800640 1 -- 172.21.15.17:0/2108446485 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe2b00736c0 con 0x7fe2b00b5f70 2024-03-12T17:20:02.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.756+0000 7fe2ad600640 1 -- 172.21.15.17:0/2108446485 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe298017070 con 0x7fe2b00b5f70 2024-03-12T17:20:02.750 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-12T17:20:02.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.758+0000 7fe2b7800640 1 -- 172.21.15.17:0/2108446485 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe28c06ac00 msgr2=0x7fe28c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:02.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.758+0000 7fe2b7800640 1 --2- 172.21.15.17:0/2108446485 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe28c06ac00 0x7fe28c06d0c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe2a0006fd0 tx=0x7fe2a0008040 comp rx=0 tx=0).stop 2024-03-12T17:20:02.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.758+0000 7fe2b7800640 1 -- 172.21.15.17:0/2108446485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2b00b5f70 msgr2=0x7fe2b00c9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:02.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.758+0000 7fe2b7800640 1 --2- 172.21.15.17:0/2108446485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2b00b5f70 0x7fe2b00c9ad0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fe29800c400 tx=0x7fe29800c8c0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.759+0000 7fe2b7800640 1 -- 172.21.15.17:0/2108446485 shutdown_connections 2024-03-12T17:20:02.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.759+0000 7fe2b7800640 1 --2- 172.21.15.17:0/2108446485 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe28c06ac00 0x7fe28c06d0c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.759+0000 7fe2b7800640 1 --2- 172.21.15.17:0/2108446485 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe2b00d2fa0 0x7fe2b00ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.759+0000 7fe2b7800640 1 --2- 172.21.15.17:0/2108446485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe2b00b5f70 0x7fe2b00c9ad0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.759+0000 7fe2b7800640 1 --2- 172.21.15.17:0/2108446485 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe2b00b5b50 0x7fe2b01f2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:02.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.759+0000 7fe2b7800640 1 -- 172.21.15.17:0/2108446485 >> 172.21.15.17:0/2108446485 conn(0x7fe2b0065df0 msgr2=0x7fe2b00cdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:02.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.759+0000 7fe2b7800640 1 -- 172.21.15.17:0/2108446485 shutdown_connections 2024-03-12T17:20:02.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:02.759+0000 7fe2b7800640 1 -- 172.21.15.17:0/2108446485 wait complete. 2024-03-12T17:20:02.773 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-03-12T17:20:02.773 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-12T17:20:02.773 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2024-03-12T17:20:02.773 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-12T17:20:02.773 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-12T17:20:02.773 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-03-12T17:20:02.773 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-03-12T17:20:02.773 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-12T17:20:02.773 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-12T17:20:02.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:20:02.774 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2024-03-12T17:20:02.826 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-12T17:20:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-12T17:20:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2024-03-12T17:20:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:20:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2024-03-12T17:20:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:20:02.826 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-12T17:20:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2024-03-12T17:20:02.826 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2024-03-12T17:20:02.826 INFO:teuthology.orchestra.run.smithi017.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-12T17:20:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2024-03-12T17:20:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2024-03-12T17:20:02.827 INFO:teuthology.orchestra.run.smithi017.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-12T17:20:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2024-03-12T17:20:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2024-03-12T17:20:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-12T17:20:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 42508sec preferred_lft 42508sec 2024-03-12T17:20:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link noprefixroute 2024-03-12T17:20:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:20:02.827 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-12T17:20:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2024-03-12T17:20:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2024-03-12T17:20:02.827 INFO:teuthology.orchestra.run.smithi017.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-12T17:20:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 92:1b:ce:ee:d8:f5 brd ff:ff:ff:ff:ff:ff 2024-03-12T17:20:02.827 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-12T17:20:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:20:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::2494:13ff:fe8b:62c9/64 scope link 2024-03-12T17:20:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:20:02.828 INFO:teuthology.orchestra.run.smithi017.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-12T17:20:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether ea:df:37:d7:69:8a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-12T17:20:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::e8df:37ff:fed7:698a/64 scope link 2024-03-12T17:20:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:20:02.828 INFO:teuthology.orchestra.run.smithi017.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-12T17:20:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 92:1b:ce:ee:d8:f5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-12T17:20:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::901b:ceff:feee:d8f5/64 scope link 2024-03-12T17:20:02.828 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:20:02.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:20:02.829 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-12T17:20:02.926 INFO:teuthology.orchestra.run.smithi017.stdout:1 2024-03-12T17:20:02.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:20:02.931 DEBUG:teuthology.orchestra.run.smithi017:> route 2024-03-12T17:20:02.984 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2024-03-12T17:20:02.984 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-12T17:20:02.984 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-12T17:20:02.985 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-12T17:20:02.985 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-12T17:20:02.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:20:02.986 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2024-03-12T17:20:02.986 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-03-12T17:20:02.986 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-12T17:20:02.986 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-12T17:20:02.986 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-12T17:20:02.986 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-03-12T17:20:03.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:20:03.179 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-03-12T17:20:03.231 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-12T17:20:03.231 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-12T17:20:03.232 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-12T17:20:03.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:20:03.233 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2024-03-12T17:20:03.334 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-12T17:20:03.334 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-12T17:20:03.392 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-12T17:20:03.392 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-12T17:20:03.392 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-12T17:20:03.444 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-03-12T17:20:03.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:20:03.444 DEBUG:teuthology.orchestra.run.smithi017:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-12T17:20:03.593 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-12T17:20:03.593 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-12T17:20:03.625 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-12T17:20:03.625 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-12T17:20:03.625 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.94:3300,172.21.15.94:3301" 2024-03-12T17:20:03.625 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: trying mount with new device syntax: 0@73425bc1-630f-4bd2-8abb-716ed5d8ca29.cephfs=/ 2024-03-12T17:20:03.625 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.17:3300/172.21.15.94:3300/172.21.15.94:3301" will pass to kernel 2024-03-12T17:20:03.627 INFO:teuthology.orchestra.run.smithi017.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-03-12T17:20:03.627 INFO:teuthology.orchestra.run.smithi017.stdout: You just mounted a file system that supports labels which does not 2024-03-12T17:20:03.627 INFO:teuthology.orchestra.run.smithi017.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-12T17:20:03.627 INFO:teuthology.orchestra.run.smithi017.stdout: applications will generate AVC messages and not be allowed access to 2024-03-12T17:20:03.627 INFO:teuthology.orchestra.run.smithi017.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-12T17:20:03.632 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-12T17:20:03.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:20:03.632 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-12T17:20:03.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:20:03.722 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-12T17:20:03.798 INFO:teuthology.orchestra.run.smithi017.stdout:client4715 2024-03-12T17:20:03.798 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:20:03.798 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-12T17:20:03.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:20:03.853 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent) 2024-03-12T17:20:03.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:20:03.918 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent/child) 2024-03-12T17:20:03.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:20:03.975 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parent/child/file) 2024-03-12T17:20:04.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:20:04.035 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent/child/grandchild) 2024-03-12T17:20:04.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:20:04.096 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parent/child/grandchild/file) 2024-03-12T17:20:04.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:20:04.154 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-03-12T17:20:04.227 INFO:teuthology.orchestra.run.smithi017.stdout:./ 2024-03-12T17:20:04.227 INFO:teuthology.orchestra.run.smithi017.stdout:./parent 2024-03-12T17:20:04.227 INFO:teuthology.orchestra.run.smithi017.stdout:./parent/child 2024-03-12T17:20:04.227 INFO:teuthology.orchestra.run.smithi017.stdout:./parent/child/grandchild 2024-03-12T17:20:04.227 INFO:teuthology.orchestra.run.smithi017.stdout:./parent/child/grandchild/file 2024-03-12T17:20:04.227 INFO:teuthology.orchestra.run.smithi017.stdout:./parent/child/file 2024-03-12T17:20:04.230 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:20:04.230 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:20:04.230 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:20:04.230 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:20:04.230 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-03-12T17:20:04.231 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:20:04.365 INFO:teuthology.orchestra.run.smithi017.stdout:1 2024-03-12T17:20:04.546 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:20:04.546 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:20:04.546 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:20:04.546 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:20:04.546 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-03-12T17:20:04.546 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:20:04.721 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627776 2024-03-12T17:20:04.901 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:20:04.901 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:20:04.901 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:20:04.901 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:20:04.901 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./parent/child").st_ino) 2024-03-12T17:20:04.901 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:20:05.071 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627777 2024-03-12T17:20:05.251 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:20:05.251 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:20:05.251 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:20:05.251 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:20:05.251 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./parent/child/grandchild").st_ino) 2024-03-12T17:20:05.251 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:20:05.419 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628279 2024-03-12T17:20:05.600 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:20:05.600 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:20:05.600 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:20:05.600 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:20:05.600 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./parent/child/grandchild/file").st_ino) 2024-03-12T17:20:05.600 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:20:05.772 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628280 2024-03-12T17:20:05.952 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:20:05.953 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:20:05.953 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:20:05.953 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:20:05.953 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./parent/child/file").st_ino) 2024-03-12T17:20:05.953 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:20:06.142 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627778 2024-03-12T17:20:06.323 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-12T17:20:06.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.597+0000 7fd39b200640 1 Processor -- start 2024-03-12T17:20:06.591 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.597+0000 7fd39b200640 1 -- start start 2024-03-12T17:20:06.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.598+0000 7fd39b200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd39c0cd850 0x7fd39c0b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:06.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.598+0000 7fd39b200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd39c0ce1a0 con 0x7fd39c0b45d0 2024-03-12T17:20:06.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.598+0000 7fd39b200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd39c0b1900 con 0x7fd39c0cb930 2024-03-12T17:20:06.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.598+0000 7fd39b200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd39c0b4a10 con 0x7fd39c0cd850 2024-03-12T17:20:06.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.599+0000 7fd399400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fd39c0b45d0 0x7fd39c0cbd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53564/0 (socket says 172.21.15.17:53564) 2024-03-12T17:20:06.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.599+0000 7fd399400640 1 -- 172.21.15.17:0/4138873564 learned_addr learned my addr 172.21.15.17:0/4138873564 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:20:06.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.599+0000 7fd39a800640 1 --2- 172.21.15.17:0/4138873564 >> v2:172.21.15.17:3300/0 conn(0x7fd39c0cd850 0x7fd39c0b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:06.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.599+0000 7fd39a800640 1 -- 172.21.15.17:0/4138873564 >> v1:172.21.15.94:6789/0 conn(0x7fd39c0cb930 legacy=0x7fd39c0b23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:06.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.599+0000 7fd39a800640 1 -- 172.21.15.17:0/4138873564 >> v1:172.21.15.17:6789/0 conn(0x7fd39c0b45d0 legacy=0x7fd39c0cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:06.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.599+0000 7fd39a800640 1 -- 172.21.15.17:0/4138873564 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd39c0b1be0 con 0x7fd39c0cd850 2024-03-12T17:20:06.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.600+0000 7fd39a800640 1 --2- 172.21.15.17:0/4138873564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd39c0cd850 0x7fd39c0b2d50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd394009d90 tx=0x7fd39402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=347d0052234cc6d7 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:06.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.601+0000 7fd398a00640 1 -- 172.21.15.17:0/4138873564 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39402cc60 con 0x7fd39c0cd850 2024-03-12T17:20:06.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.601+0000 7fd398a00640 1 -- 172.21.15.17:0/4138873564 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd39402cdc0 con 0x7fd39c0cd850 2024-03-12T17:20:06.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.601+0000 7fd398a00640 1 -- 172.21.15.17:0/4138873564 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd394034660 con 0x7fd39c0cd850 2024-03-12T17:20:06.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.601+0000 7fd39b200640 1 -- 172.21.15.17:0/4138873564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd39c0cd850 msgr2=0x7fd39c0b2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:06.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.601+0000 7fd39b200640 1 --2- 172.21.15.17:0/4138873564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd39c0cd850 0x7fd39c0b2d50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd394009d90 tx=0x7fd39402beb0 comp rx=0 tx=0).stop 2024-03-12T17:20:06.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.601+0000 7fd39b200640 1 -- 172.21.15.17:0/4138873564 shutdown_connections 2024-03-12T17:20:06.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.601+0000 7fd39b200640 1 --2- 172.21.15.17:0/4138873564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd39c0cd850 0x7fd39c0b2d50 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:06.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.601+0000 7fd39b200640 1 -- 172.21.15.17:0/4138873564 >> 172.21.15.17:0/4138873564 conn(0x7fd39c069ce0 msgr2=0x7fd39c06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:06.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.602+0000 7fd39b200640 1 -- 172.21.15.17:0/4138873564 shutdown_connections 2024-03-12T17:20:06.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.602+0000 7fd39b200640 1 -- 172.21.15.17:0/4138873564 wait complete. 2024-03-12T17:20:06.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.603+0000 7fd39b200640 1 Processor -- start 2024-03-12T17:20:06.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.603+0000 7fd39b200640 1 -- start start 2024-03-12T17:20:06.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.604+0000 7fd39b200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd39c0b45d0 0x7fd39c155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:06.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.604+0000 7fd39b200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd39c0cb930 0x7fd39c13eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:06.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.604+0000 7fd39b200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd39c0cd850 0x7fd39c0b07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:06.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.604+0000 7fd39b200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c155850 con 0x7fd39c0cb930 2024-03-12T17:20:06.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.604+0000 7fd39b200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c13e610 con 0x7fd39c0b45d0 2024-03-12T17:20:06.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.604+0000 7fd39b200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c13efe0 con 0x7fd39c0cd850 2024-03-12T17:20:06.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.605+0000 7fd399400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd39c0cb930 0x7fd39c13eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:06.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.605+0000 7fd399400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd39c0cb930 0x7fd39c13eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47978/0 (socket says 172.21.15.17:47978) 2024-03-12T17:20:06.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.605+0000 7fd399400640 1 -- 172.21.15.17:0/1730620353 learned_addr learned my addr 172.21.15.17:0/1730620353 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:06.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.605+0000 7fd399e00640 1 --2- 172.21.15.17:0/1730620353 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd39c0b45d0 0x7fd39c155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:06.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.605+0000 7fd39a800640 1 --2- 172.21.15.17:0/1730620353 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd39c0cd850 0x7fd39c0b07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:06.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.605+0000 7fd399400640 1 -- 172.21.15.17:0/1730620353 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd39c0cd850 msgr2=0x7fd39c0b07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:06.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.605+0000 7fd399400640 1 --2- 172.21.15.17:0/1730620353 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd39c0cd850 0x7fd39c0b07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:06.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.605+0000 7fd399400640 1 -- 172.21.15.17:0/1730620353 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd39c0b45d0 msgr2=0x7fd39c155310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:06.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.605+0000 7fd399400640 1 --2- 172.21.15.17:0/1730620353 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd39c0b45d0 0x7fd39c155310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:06.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.605+0000 7fd399400640 1 -- 172.21.15.17:0/1730620353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd394009a70 con 0x7fd39c0cb930 2024-03-12T17:20:06.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.605+0000 7fd39a800640 1 --2- 172.21.15.17:0/1730620353 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd39c0cd850 0x7fd39c0b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:06.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.606+0000 7fd399400640 1 --2- 172.21.15.17:0/1730620353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd39c0cb930 0x7fd39c13eaa0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd38400c4a0 tx=0x7fd38400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:06.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.606+0000 7fd392000640 1 -- 172.21.15.17:0/1730620353 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd384005ce0 con 0x7fd39c0cb930 2024-03-12T17:20:06.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.606+0000 7fd392000640 1 -- 172.21.15.17:0/1730620353 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd384005e40 con 0x7fd39c0cb930 2024-03-12T17:20:06.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.606+0000 7fd392000640 1 -- 172.21.15.17:0/1730620353 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd384007270 con 0x7fd39c0cb930 2024-03-12T17:20:06.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.606+0000 7fd39b200640 1 -- 172.21.15.17:0/1730620353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd39c0ce600 con 0x7fd39c0cb930 2024-03-12T17:20:06.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.606+0000 7fd39b200640 1 -- 172.21.15.17:0/1730620353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd39c13e2a0 con 0x7fd39c0cb930 2024-03-12T17:20:06.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.607+0000 7fd39b200640 1 -- 172.21.15.17:0/1730620353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd39c13e7a0 con 0x7fd39c0cb930 2024-03-12T17:20:06.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.608+0000 7fd392000640 1 -- 172.21.15.17:0/1730620353 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fd3840073d0 con 0x7fd39c0cb930 2024-03-12T17:20:06.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.609+0000 7fd392000640 1 --2- 172.21.15.17:0/1730620353 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd37806ac00 0x7fd37806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:06.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.609+0000 7fd392000640 1 -- 172.21.15.17:0/1730620353 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd384088840 con 0x7fd39c0cb930 2024-03-12T17:20:06.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.609+0000 7fd399e00640 1 --2- 172.21.15.17:0/1730620353 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd37806ac00 0x7fd37806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:06.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.610+0000 7fd399e00640 1 --2- 172.21.15.17:0/1730620353 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd37806ac00 0x7fd37806d0c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd38c007fd0 tx=0x7fd38c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:06.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.614+0000 7fd392000640 1 -- 172.21.15.17:0/1730620353 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fd384053a30 con 0x7fd39c0cb930 2024-03-12T17:20:06.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.851+0000 7fd39b200640 1 -- 172.21.15.17:0/1730620353 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd39c04e030 con 0x7fd39c0cb930 2024-03-12T17:20:06.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.852+0000 7fd392000640 1 -- 172.21.15.17:0/1730620353 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4728 (secure 0 0 0) 0x7fd384017090 con 0x7fd39c0cb930 2024-03-12T17:20:06.846 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:20:06.846 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6834/934570591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":934570591},{"type":"v1","addr":"172.21.15.94:6834","nonce":934570591}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/2007868406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6833","nonce":2007868406},{"type":"v1","addr":"172.21.15.94:6835","nonce":2007868406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4768,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6836/2733057827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2733057827},{"type":"v1","addr":"172.21.15.17:6836","nonce":2733057827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T17:19:55.522204+0000","modified":"2024-03-12T17:19:58.531800+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5058},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5058":{"gid":5058,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6837/672288094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6835","nonce":672288094},{"type":"v1","addr":"172.21.15.17:6837","nonce":672288094}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-03-12T17:20:06.847 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 14 2024-03-12T17:20:06.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.854+0000 7fd39b200640 1 -- 172.21.15.17:0/1730620353 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd37806ac00 msgr2=0x7fd37806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:06.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.854+0000 7fd39b200640 1 --2- 172.21.15.17:0/1730620353 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd37806ac00 0x7fd37806d0c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd38c007fd0 tx=0x7fd38c009040 comp rx=0 tx=0).stop 2024-03-12T17:20:06.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.854+0000 7fd39b200640 1 -- 172.21.15.17:0/1730620353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd39c0cb930 msgr2=0x7fd39c13eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:06.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.854+0000 7fd39b200640 1 --2- 172.21.15.17:0/1730620353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd39c0cb930 0x7fd39c13eaa0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd38400c4a0 tx=0x7fd38400c960 comp rx=0 tx=0).stop 2024-03-12T17:20:06.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.854+0000 7fd39b200640 1 -- 172.21.15.17:0/1730620353 shutdown_connections 2024-03-12T17:20:06.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.854+0000 7fd39b200640 1 --2- 172.21.15.17:0/1730620353 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd37806ac00 0x7fd37806d0c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:06.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.854+0000 7fd39b200640 1 --2- 172.21.15.17:0/1730620353 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd39c0cd850 0x7fd39c0b07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:06.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.854+0000 7fd39b200640 1 --2- 172.21.15.17:0/1730620353 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd39c0cb930 0x7fd39c13eaa0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:06.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.854+0000 7fd39b200640 1 --2- 172.21.15.17:0/1730620353 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd39c0b45d0 0x7fd39c155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:06.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.854+0000 7fd39b200640 1 -- 172.21.15.17:0/1730620353 >> 172.21.15.17:0/1730620353 conn(0x7fd39c069ce0 msgr2=0x7fd39c0cbd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:06.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.854+0000 7fd39b200640 1 -- 172.21.15.17:0/1730620353 shutdown_connections 2024-03-12T17:20:06.849 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:06.854+0000 7fd39b200640 1 -- 172.21.15.17:0/1730620353 wait complete. 2024-03-12T17:20:06.871 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump tree /parent/child 1 2024-03-12T17:20:07.081 INFO:teuthology.orchestra.run.smithi017.stdout:[{"ino":1099511628279,"rdev":0,"ctime":"2024-03-12T17:20:04.156213+0000","btime":"2024-03-12T17:20:04.097213+0000","mode":16877,"uid":1000,"gid":1301,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-03-12T17:20:04.156213+0000","atime":"2024-03-12T17:20:04.097213+0000","time_warp_seq":0,"change_attr":1,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-03-12T17:20:04.156213+0000","num_files":1,"num_subdirs":0,"change_attr":1},"rstat":{"version":0,"rbytes":0,"rfiles":1,"rsubdirs":1,"rsnaps":0,"rctime":"2024-03-12T17:20:04.156213+0000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":1,"rsubdirs":1,"rsnaps":0,"rctime":"2024-03-12T17:20:04.156213+0000"},"version":6,"file_data_version":0,"xattr_version":1,"backtrace_version":4,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1,"waiter":0,"authpin":0},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","type":"ifile","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":4715,"pending":"pAsLsXsFsx","issued":"pAsLsXsFsx","wanted":"pAsLsXsFsxcral","last_sent":6}],"loner":4715,"want_loner":4715,"mds_caps_wanted":[],"dirfrags":[{"path":"/parent/child/grandchild","dirfrag":"0x100000001f7","snapid_first":2,"projected_version":"3","version":"3","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"dirty":1,"authpin":0},"nref":2,"dentries":[{"path":"parent/child/grandchild/file","path_ino":1,"snap_first":2,"snap_last":18446744073709551614,"is_primary":true,"is_remote":false,"is_null":false,"is_new":false,"inode":1099511628280,"remote_type":"","version":2,"projected_version":2,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"inodepin":1,"dirty":1,"authpin":0},"nref":2,"lock":{},"versionlock":{"gather_set":[],"state":"lock","type":"dversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]}]}]},{"ino":1099511627778,"rdev":0,"ctime":"2024-03-12T17:20:04.036214+0000","btime":"2024-03-12T17:20:04.036214+0000","mode":33188,"uid":1000,"gid":1301,"nlink":1,"dir_layout":{"dir_hash":0,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":4194304,"stripe_count":1,"object_size":4194304,"pool_id":5,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-03-12T17:20:04.036214+0000","atime":"2024-03-12T17:20:04.036214+0000","time_warp_seq":0,"change_attr":0,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"client_ranges":[{"client":4715,"byte range":{"first":0,"last":4194304},"follows":1}],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":0,"rfiles":1,"rsubdirs":0,"rsnaps":0,"rctime":"0.000000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":1,"rsubdirs":0,"rsnaps":0,"rctime":"0.000000"},"version":2,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"caps":1,"dirtyparent":1,"dirty":1},"nref":3,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{"gather_set":[],"state":"excl","type":"iauth","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","type":"ifile","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{"gather_set":[],"state":"excl","type":"ixattr","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":4715,"pending":"pAsxLsXsxFsxcrwb","issued":"pAsxLsXsxFsxcrwb","wanted":"pAsxXsxFxwb","last_sent":3}],"loner":4715,"want_loner":4715,"mds_caps_wanted":[],"dirfrags":[]},{"ino":1099511627777,"rdev":0,"ctime":"2024-03-12T17:20:04.097213+0000","btime":"2024-03-12T17:20:03.977214+0000","mode":16877,"uid":1000,"gid":1301,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-03-12T17:20:04.097213+0000","atime":"2024-03-12T17:20:03.977214+0000","time_warp_seq":0,"change_attr":2,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-03-12T17:20:04.097213+0000","num_files":1,"num_subdirs":1,"change_attr":2},"rstat":{"version":0,"rbytes":0,"rfiles":1,"rsubdirs":2,"rsnaps":0,"rctime":"2024-03-12T17:20:04.097213+0000"},"accounted_rstat":{"version":0,"rbytes":0,"rfiles":1,"rsubdirs":2,"rsnaps":0,"rctime":"2024-03-12T17:20:04.097213+0000"},"version":6,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"dirtyscattered":1,"request":0,"lock":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1,"waiter":0,"authpin":0},"nref":5,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","type":"ifile","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":4715,"pending":"pAsLsXsFsx","issued":"pAsLsXsFsx","wanted":"pAsLsXsFsxcral","last_sent":7}],"loner":4715,"want_loner":4715,"mds_caps_wanted":[],"dirfrags":[{"path":"/parent/child","dirfrag":"0x10000000001","snapid_first":2,"projected_version":"7","version":"7","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"dirty":1,"authpin":0},"nref":2,"dentries":[{"path":"parent/child/grandchild","path_ino":1,"snap_first":2,"snap_last":18446744073709551614,"is_primary":true,"is_remote":false,"is_null":false,"is_new":false,"inode":1099511628279,"remote_type":"","version":6,"projected_version":6,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"inodepin":1,"dirty":1,"authpin":0},"nref":2,"lock":{},"versionlock":{"gather_set":[],"state":"lock","type":"dversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]},{"path":"parent/child/file","path_ino":1,"snap_first":2,"snap_last":18446744073709551614,"is_primary":true,"is_remote":false,"is_null":false,"is_new":false,"inode":1099511627778,"remote_type":"","version":2,"projected_version":2,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"inodepin":1,"dirty":1,"authpin":0},"nref":2,"lock":{},"versionlock":{"gather_set":[],"state":"lock","type":"dversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]}]}]}] 2024-03-12T17:20:07.083 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "accounted_rstat": { "rbytes": 0, "rctime": "2024-03-12T17:20:04.156213+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-03-12T17:20:04.097213+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 4, "btime": "2024-03-12T17:20:04.097213+0000", "change_attr": 1, "client_caps": [ { "client_id": 4715, "issued": "pAsLsXsFsx", "last_sent": 6, "pending": "pAsLsXsFsx", "wanted": "pAsLsXsFsxcral" } ], "client_ranges": [], "ctime": "2024-03-12T17:20:04.156213+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfrags": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dentries": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 1099511628280, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": false, "is_primary": true, "is_remote": false, "lock": {}, "nref": 2, "path": "parent/child/grandchild/file", "path_ino": 1, "pins": { "authpin": 0, "dirty": 1, "inodepin": 1, "lock": 0, "request": 0 }, "projected_version": 2, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 2, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "dversion", "xlock_by": {} } } ], "dir_auth": "", "dirfrag": "0x100000001f7", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/parent/child/grandchild", "pins": { "authpin": 0, "child": 1, "dirty": 1 }, "projected_version": "3", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "3" } ], "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 1, "mtime": "2024-03-12T17:20:04.156213+0000", "num_files": 1, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ifile", "xlock_by": {} }, "flocklock": {}, "gid": 1301, "ino": 1099511628279, "is_auth": true, "is_freezing": false, "is_frozen": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 4715, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-03-12T17:20:04.156213+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "pins": { "authpin": 0, "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "lock": 0, "request": 0, "waiter": 0 }, "policylock": {}, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "2024-03-12T17:20:04.156213+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 6, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": 4715, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] }, { "accounted_rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 0, "version": 0 }, "atime": "2024-03-12T17:20:04.036214+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "iauth", "xlock_by": {} }, "backtrace_version": 2, "btime": "2024-03-12T17:20:04.036214+0000", "change_attr": 0, "client_caps": [ { "client_id": 4715, "issued": "pAsxLsXsxFsxcrwb", "last_sent": 3, "pending": "pAsxLsXsxFsxcrwb", "wanted": "pAsxXsxFxwb" } ], "client_ranges": [ { "byte range": { "first": 0, "last": 4194304 }, "client": 4715, "follows": 1 } ], "ctime": "2024-03-12T17:20:04.036214+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 0, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfrags": [], "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ifile", "xlock_by": {} }, "flocklock": {}, "gid": 1301, "ino": 1099511627778, "is_auth": true, "is_freezing": false, "is_frozen": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 4194304, "pool_id": 5, "pool_ns": "", "stripe_count": 1, "stripe_unit": 4194304 }, "linklock": {}, "loner": 4715, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 33188, "mtime": "2024-03-12T17:20:04.036214+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 3, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "pins": { "caps": 1, "dirty": 1, "dirtyparent": 1, "request": 0 }, "policylock": {}, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "0.000000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 0, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": 4715, "xattr_version": 1, "xattrlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ixattr", "xlock_by": {} }, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] }, { "accounted_rstat": { "rbytes": 0, "rctime": "2024-03-12T17:20:04.097213+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 2, "version": 0 }, "atime": "2024-03-12T17:20:03.977214+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-03-12T17:20:03.977214+0000", "change_attr": 2, "client_caps": [ { "client_id": 4715, "issued": "pAsLsXsFsx", "last_sent": 7, "pending": "pAsLsXsFsx", "wanted": "pAsLsXsFsxcral" } ], "client_ranges": [], "ctime": "2024-03-12T17:20:04.097213+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfrags": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dentries": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 1099511628279, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": false, "is_primary": true, "is_remote": false, "lock": {}, "nref": 2, "path": "parent/child/grandchild", "path_ino": 1, "pins": { "authpin": 0, "dirty": 1, "inodepin": 1, "lock": 0, "request": 0 }, "projected_version": 6, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 2, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 6, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "dversion", "xlock_by": {} } }, { "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 1099511627778, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": false, "is_primary": true, "is_remote": false, "lock": {}, "nref": 2, "path": "parent/child/file", "path_ino": 1, "pins": { "authpin": 0, "dirty": 1, "inodepin": 1, "lock": 0, "request": 0 }, "projected_version": 2, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 2, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 2, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "dversion", "xlock_by": {} } } ], "dir_auth": "", "dirfrag": "0x10000000001", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/parent/child", "pins": { "authpin": 0, "child": 1, "dirty": 1 }, "projected_version": "7", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "7" } ], "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 2, "mtime": "2024-03-12T17:20:04.097213+0000", "num_files": 1, "num_subdirs": 1, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ifile", "xlock_by": {} }, "flocklock": {}, "gid": 1301, "ino": 1099511627777, "is_auth": true, "is_freezing": false, "is_frozen": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 4715, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-03-12T17:20:04.097213+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 5, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "pins": { "authpin": 0, "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "dirtyscattered": 1, "lock": 0, "request": 0, "waiter": 0 }, "policylock": {}, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 0, "rctime": "2024-03-12T17:20:04.097213+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 2, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 6, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": 4715, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } ] 2024-03-12T17:20:07.083 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-12T17:20:07.084 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-12T17:20:07.197 DEBUG:teuthology.orchestra.run.smithi094:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-12T17:20:07.522 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-12T17:20:07.523 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:20:07.523 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-12T17:20:07.583 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:20:07.584 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-12T17:20:07.641 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T17:20:07.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.869+0000 7f92f7200640 1 Processor -- start 2024-03-12T17:20:07.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.869+0000 7f92f7200640 1 -- start start 2024-03-12T17:20:07.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.871+0000 7f92f7200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f92f01441f0 0x7f92f0070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:07.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.871+0000 7f92f7200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f92f00b3b70 0x7f92f00b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:07.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.871+0000 7f92f7200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92f00a7660 con 0x7f92f015ae20 2024-03-12T17:20:07.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.871+0000 7f92f7200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92f015e460 con 0x7f92f01441f0 2024-03-12T17:20:07.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.871+0000 7f92f7200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f006d840 con 0x7f92f00b3b70 2024-03-12T17:20:07.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.871+0000 7f92f5e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f92f01441f0 0x7f92f0070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:07.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.871+0000 7f92f5e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f92f01441f0 0x7f92f0070240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47982/0 (socket says 172.21.15.17:47982) 2024-03-12T17:20:07.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.871+0000 7f92f5e00640 1 -- 172.21.15.17:0/1915468661 learned_addr learned my addr 172.21.15.17:0/1915468661 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:07.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.872+0000 7f92f6800640 1 --2- 172.21.15.17:0/1915468661 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f92f00b3b70 0x7f92f00b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:07.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.872+0000 7f92f5e00640 1 -- 172.21.15.17:0/1915468661 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f92f00b3b70 msgr2=0x7f92f00b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:07.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.872+0000 7f92f5e00640 1 --2- 172.21.15.17:0/1915468661 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f92f00b3b70 0x7f92f00b3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:07.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.872+0000 7f92f5e00640 1 -- 172.21.15.17:0/1915468661 >> v1:172.21.15.94:6789/0 conn(0x7f92f015ae20 legacy=0x7f92f006d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:07.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.872+0000 7f92f5e00640 1 -- 172.21.15.17:0/1915468661 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f00b44e0 con 0x7f92f01441f0 2024-03-12T17:20:07.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.873+0000 7f92f5e00640 1 --2- 172.21.15.17:0/1915468661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92f01441f0 0x7f92f0070240 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f92e4009870 tx=0x7f92e402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af7b25ecbe03bd0d server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:07.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.873+0000 7f92f4a00640 1 -- 172.21.15.17:0/1915468661 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e4030840 con 0x7f92f01441f0 2024-03-12T17:20:07.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.873+0000 7f92f4a00640 1 -- 172.21.15.17:0/1915468661 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92e40309a0 con 0x7f92f01441f0 2024-03-12T17:20:07.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.873+0000 7f92f4a00640 1 -- 172.21.15.17:0/1915468661 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92e4030d30 con 0x7f92f01441f0 2024-03-12T17:20:07.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.874+0000 7f92f7200640 1 -- 172.21.15.17:0/1915468661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92f01441f0 msgr2=0x7f92f0070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:07.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.874+0000 7f92f7200640 1 --2- 172.21.15.17:0/1915468661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92f01441f0 0x7f92f0070240 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f92e4009870 tx=0x7f92e402b980 comp rx=0 tx=0).stop 2024-03-12T17:20:07.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.874+0000 7f92f7200640 1 -- 172.21.15.17:0/1915468661 shutdown_connections 2024-03-12T17:20:07.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.874+0000 7f92f7200640 1 --2- 172.21.15.17:0/1915468661 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f92f00b3b70 0x7f92f00b3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:07.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.874+0000 7f92f7200640 1 --2- 172.21.15.17:0/1915468661 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92f01441f0 0x7f92f0070240 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:07.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.874+0000 7f92f7200640 1 -- 172.21.15.17:0/1915468661 >> 172.21.15.17:0/1915468661 conn(0x7f92f0069ce0 msgr2=0x7f92f006a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:07.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.874+0000 7f92f7200640 1 -- 172.21.15.17:0/1915468661 shutdown_connections 2024-03-12T17:20:07.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.874+0000 7f92f7200640 1 -- 172.21.15.17:0/1915468661 wait complete. 2024-03-12T17:20:07.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.876+0000 7f92f7200640 1 Processor -- start 2024-03-12T17:20:07.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.876+0000 7f92f7200640 1 -- start start 2024-03-12T17:20:07.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.877+0000 7f92f7200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92f00b3b70 0x7f92f00b3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:07.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.877+0000 7f92f7200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f92f01441f0 0x7f92f00acd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:07.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.877+0000 7f92f7200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92f015ae20 0x7f92f01f5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:07.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.877+0000 7f92f7200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f013b490 con 0x7f92f015ae20 2024-03-12T17:20:07.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.877+0000 7f92f7200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f013b770 con 0x7f92f00b3b70 2024-03-12T17:20:07.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.877+0000 7f92f7200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f013ba50 con 0x7f92f01441f0 2024-03-12T17:20:07.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.877+0000 7f92f6800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92f015ae20 0x7f92f01f5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:07.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.877+0000 7f92f6800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92f015ae20 0x7f92f01f5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47994/0 (socket says 172.21.15.17:47994) 2024-03-12T17:20:07.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.877+0000 7f92f6800640 1 -- 172.21.15.17:0/303195100 learned_addr learned my addr 172.21.15.17:0/303195100 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:07.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.877+0000 7f92f5e00640 1 --2- 172.21.15.17:0/303195100 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92f00b3b70 0x7f92f00b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:07.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.878+0000 7f92f5400640 1 --2- 172.21.15.17:0/303195100 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f92f01441f0 0x7f92f00acd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:07.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.878+0000 7f92f6800640 1 -- 172.21.15.17:0/303195100 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f92f01441f0 msgr2=0x7f92f00acd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:07.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.878+0000 7f92f6800640 1 --2- 172.21.15.17:0/303195100 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f92f01441f0 0x7f92f00acd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:07.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.878+0000 7f92f6800640 1 -- 172.21.15.17:0/303195100 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92f00b3b70 msgr2=0x7f92f00b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:07.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.878+0000 7f92f6800640 1 --2- 172.21.15.17:0/303195100 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92f00b3b70 0x7f92f00b3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:07.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.878+0000 7f92f6800640 1 -- 172.21.15.17:0/303195100 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92e40094d0 con 0x7f92f015ae20 2024-03-12T17:20:07.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.878+0000 7f92f5400640 1 --2- 172.21.15.17:0/303195100 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f92f01441f0 0x7f92f00acd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:07.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.878+0000 7f92f6800640 1 --2- 172.21.15.17:0/303195100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92f015ae20 0x7f92f01f5910 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f92ec00cd70 tx=0x7f92ec00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:07.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.878+0000 7f92ea000640 1 -- 172.21.15.17:0/303195100 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ec003b90 con 0x7f92f015ae20 2024-03-12T17:20:07.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.878+0000 7f92ea000640 1 -- 172.21.15.17:0/303195100 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92ec003cf0 con 0x7f92f015ae20 2024-03-12T17:20:07.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.878+0000 7f92ea000640 1 -- 172.21.15.17:0/303195100 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ec004240 con 0x7f92f015ae20 2024-03-12T17:20:07.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.878+0000 7f92f7200640 1 -- 172.21.15.17:0/303195100 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92f013bd30 con 0x7f92f015ae20 2024-03-12T17:20:07.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.879+0000 7f92f7200640 1 -- 172.21.15.17:0/303195100 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92f00ad240 con 0x7f92f015ae20 2024-03-12T17:20:07.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.880+0000 7f92f7200640 1 -- 172.21.15.17:0/303195100 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92f013c250 con 0x7f92f015ae20 2024-03-12T17:20:07.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.881+0000 7f92ea000640 1 -- 172.21.15.17:0/303195100 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f92ec0043a0 con 0x7f92f015ae20 2024-03-12T17:20:07.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.882+0000 7f92ea000640 1 --2- 172.21.15.17:0/303195100 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f92d406ac00 0x7f92d406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:07.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.882+0000 7f92ea000640 1 -- 172.21.15.17:0/303195100 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f92ec012070 con 0x7f92f015ae20 2024-03-12T17:20:07.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.882+0000 7f92f5e00640 1 --2- 172.21.15.17:0/303195100 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f92d406ac00 0x7f92d406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:07.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.883+0000 7f92f5e00640 1 --2- 172.21.15.17:0/303195100 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f92d406ac00 0x7f92d406d0c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f92e4036000 tx=0x7f92e4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:07.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:07.886+0000 7f92ea000640 1 -- 172.21.15.17:0/303195100 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f92f013c250 con 0x7f92f015ae20 2024-03-12T17:20:08.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.086+0000 7f92f7200640 1 -- 172.21.15.17:0/303195100 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92f013c250 con 0x7f92f015ae20 2024-03-12T17:20:08.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.089+0000 7f92ea000640 1 -- 172.21.15.17:0/303195100 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16053 (secure 0 0 0) 0x7f92f013c250 con 0x7f92f015ae20 2024-03-12T17:20:08.083 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:20:08.083 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":35,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:19:56.525877+0000","last_up_change":"2024-03-12T17:18:38.144756+0000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-12T17:18:39.552910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-12T17:19:53.519967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-12T17:19:54.546388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":37305},{"type":"v1","addr":"172.21.15.17:6801","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":37305},{"type":"v1","addr":"172.21.15.17:6803","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":37305},{"type":"v1","addr":"172.21.15.17:6807","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":37305},{"type":"v1","addr":"172.21.15.17:6805","nonce":37305}]},"public_addr":"172.21.15.17:6801/37305","cluster_addr":"172.21.15.17:6803/37305","heartbeat_back_addr":"172.21.15.17:6807/37305","heartbeat_front_addr":"172.21.15.17:6805/37305","state":["exists","up"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":37307},{"type":"v1","addr":"172.21.15.17:6814","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":37307},{"type":"v1","addr":"172.21.15.17:6818","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":37307},{"type":"v1","addr":"172.21.15.17:6827","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":37307},{"type":"v1","addr":"172.21.15.17:6823","nonce":37307}]},"public_addr":"172.21.15.17:6814/37307","cluster_addr":"172.21.15.17:6818/37307","heartbeat_back_addr":"172.21.15.17:6827/37307","heartbeat_front_addr":"172.21.15.17:6823/37307","state":["exists","up"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":37303},{"type":"v1","addr":"172.21.15.17:6809","nonce":37303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":37303},{"type":"v1","addr":"172.21.15.17:6811","nonce":37303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":37303},{"type":"v1","addr":"172.21.15.17:6819","nonce":37303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":37303},{"type":"v1","addr":"172.21.15.17:6815","nonce":37303}]},"public_addr":"172.21.15.17:6809/37303","cluster_addr":"172.21.15.17:6811/37303","heartbeat_back_addr":"172.21.15.17:6819/37303","heartbeat_front_addr":"172.21.15.17:6815/37303","state":["exists","up"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":37308},{"type":"v1","addr":"172.21.15.17:6822","nonce":37308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":37308},{"type":"v1","addr":"172.21.15.17:6826","nonce":37308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":37308},{"type":"v1","addr":"172.21.15.17:6831","nonce":37308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":37308},{"type":"v1","addr":"172.21.15.17:6829","nonce":37308}]},"public_addr":"172.21.15.17:6822/37308","cluster_addr":"172.21.15.17:6826/37308","heartbeat_back_addr":"172.21.15.17:6831/37308","heartbeat_front_addr":"172.21.15.17:6829/37308","state":["exists","up"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":37465},{"type":"v1","addr":"172.21.15.94:6809","nonce":37465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6811","nonce":37465},{"type":"v1","addr":"172.21.15.94:6813","nonce":37465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6819","nonce":37465},{"type":"v1","addr":"172.21.15.94:6822","nonce":37465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6815","nonce":37465},{"type":"v1","addr":"172.21.15.94:6817","nonce":37465}]},"public_addr":"172.21.15.94:6809/37465","cluster_addr":"172.21.15.94:6813/37465","heartbeat_back_addr":"172.21.15.94:6822/37465","heartbeat_front_addr":"172.21.15.94:6817/37465","state":["exists","up"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":37464},{"type":"v1","addr":"172.21.15.94:6812","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":37464},{"type":"v1","addr":"172.21.15.94:6816","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":37464},{"type":"v1","addr":"172.21.15.94:6823","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":37464},{"type":"v1","addr":"172.21.15.94:6820","nonce":37464}]},"public_addr":"172.21.15.94:6812/37464","cluster_addr":"172.21.15.94:6816/37464","heartbeat_back_addr":"172.21.15.94:6823/37464","heartbeat_front_addr":"172.21.15.94:6820/37464","state":["exists","up"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":37467},{"type":"v1","addr":"172.21.15.94:6825","nonce":37467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":37467},{"type":"v1","addr":"172.21.15.94:6827","nonce":37467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":37467},{"type":"v1","addr":"172.21.15.94:6831","nonce":37467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":37467},{"type":"v1","addr":"172.21.15.94:6829","nonce":37467}]},"public_addr":"172.21.15.94:6825/37467","cluster_addr":"172.21.15.94:6827/37467","heartbeat_back_addr":"172.21.15.94:6831/37467","heartbeat_front_addr":"172.21.15.94:6829/37467","state":["exists","up"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":37466},{"type":"v1","addr":"172.21.15.94:6801","nonce":37466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":37466},{"type":"v1","addr":"172.21.15.94:6803","nonce":37466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":37466},{"type":"v1","addr":"172.21.15.94:6807","nonce":37466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":37466},{"type":"v1","addr":"172.21.15.94:6805","nonce":37466}]},"public_addr":"172.21.15.94:6801/37466","cluster_addr":"172.21.15.94:6803/37466","heartbeat_back_addr":"172.21.15.94:6807/37466","heartbeat_front_addr":"172.21.15.94:6805/37466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.327217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.186966+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.419986+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.150585+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.120621+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.121576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.181257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.293188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:20:08.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.091+0000 7f92f7200640 1 -- 172.21.15.17:0/303195100 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f92d406ac00 msgr2=0x7f92d406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:08.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.091+0000 7f92f7200640 1 --2- 172.21.15.17:0/303195100 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f92d406ac00 0x7f92d406d0c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f92e4036000 tx=0x7f92e4008030 comp rx=0 tx=0).stop 2024-03-12T17:20:08.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.091+0000 7f92f7200640 1 -- 172.21.15.17:0/303195100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92f015ae20 msgr2=0x7f92f01f5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:08.086 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.091+0000 7f92f7200640 1 --2- 172.21.15.17:0/303195100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92f015ae20 0x7f92f01f5910 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f92ec00cd70 tx=0x7f92ec00a660 comp rx=0 tx=0).stop 2024-03-12T17:20:08.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.092+0000 7f92f7200640 1 -- 172.21.15.17:0/303195100 shutdown_connections 2024-03-12T17:20:08.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.092+0000 7f92f7200640 1 --2- 172.21.15.17:0/303195100 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f92d406ac00 0x7f92d406d0c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:08.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.092+0000 7f92f7200640 1 --2- 172.21.15.17:0/303195100 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f92f015ae20 0x7f92f01f5910 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:08.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.092+0000 7f92f7200640 1 --2- 172.21.15.17:0/303195100 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f92f01441f0 0x7f92f00acd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:08.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.092+0000 7f92f7200640 1 --2- 172.21.15.17:0/303195100 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f92f00b3b70 0x7f92f00b3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:08.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.092+0000 7f92f7200640 1 -- 172.21.15.17:0/303195100 >> 172.21.15.17:0/303195100 conn(0x7f92f0069ce0 msgr2=0x7f92f00cb450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:08.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.092+0000 7f92f7200640 1 -- 172.21.15.17:0/303195100 shutdown_connections 2024-03-12T17:20:08.087 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.092+0000 7f92f7200640 1 -- 172.21.15.17:0/303195100 wait complete. 2024-03-12T17:20:08.105 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-12T17:18:39.552910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-12T17:19:53.519967+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-12T17:19:54.546388+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-12T17:20:08.105 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-12T17:20:08.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.330+0000 7f67dda00640 1 Processor -- start 2024-03-12T17:20:08.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.331+0000 7f67dda00640 1 -- start start 2024-03-12T17:20:08.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.332+0000 7f67dda00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f67d8145dc0 0x7f67d8160ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:08.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.332+0000 7f67dda00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f67d80b1860 0x7f67d80b4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:08.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.332+0000 7f67dda00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67d81461a0 con 0x7f67d8070240 2024-03-12T17:20:08.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.332+0000 7f67dda00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67d80b2000 con 0x7f67d8145dc0 2024-03-12T17:20:08.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.332+0000 7f67dda00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d80b3db0 con 0x7f67d80b1860 2024-03-12T17:20:08.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.333+0000 7f67d7e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f67d8145dc0 0x7f67d8160ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:08.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.333+0000 7f67d7e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f67d8145dc0 0x7f67d8160ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48010/0 (socket says 172.21.15.17:48010) 2024-03-12T17:20:08.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.333+0000 7f67d7e00640 1 -- 172.21.15.17:0/2464033309 learned_addr learned my addr 172.21.15.17:0/2464033309 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:08.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.333+0000 7f67cfe00640 1 --2- 172.21.15.17:0/2464033309 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f67d80b1860 0x7f67d80b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:08.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.333+0000 7f67d7e00640 1 -- 172.21.15.17:0/2464033309 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f67d80b1860 msgr2=0x7f67d80b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:08.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.333+0000 7f67d7e00640 1 --2- 172.21.15.17:0/2464033309 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f67d80b1860 0x7f67d80b4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:08.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.333+0000 7f67d7e00640 1 -- 172.21.15.17:0/2464033309 >> v1:172.21.15.17:6789/0 conn(0x7f67d8070240 legacy=0x7f67d80abb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:08.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.333+0000 7f67d7e00640 1 -- 172.21.15.17:0/2464033309 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d8146680 con 0x7f67d8145dc0 2024-03-12T17:20:08.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.334+0000 7f67d7e00640 1 --2- 172.21.15.17:0/2464033309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67d8145dc0 0x7f67d8160ff0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f67c8009870 tx=0x7f67c802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1efaf4e75fdda2d9 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:08.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.335+0000 7f67d7400640 1 -- 172.21.15.17:0/2464033309 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c8030840 con 0x7f67d8145dc0 2024-03-12T17:20:08.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.335+0000 7f67d7400640 1 -- 172.21.15.17:0/2464033309 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c80309a0 con 0x7f67d8145dc0 2024-03-12T17:20:08.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.335+0000 7f67d7400640 1 -- 172.21.15.17:0/2464033309 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c8030d30 con 0x7f67d8145dc0 2024-03-12T17:20:08.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.335+0000 7f67dda00640 1 -- 172.21.15.17:0/2464033309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67d8145dc0 msgr2=0x7f67d8160ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:08.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.335+0000 7f67dda00640 1 --2- 172.21.15.17:0/2464033309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67d8145dc0 0x7f67d8160ff0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f67c8009870 tx=0x7f67c802b980 comp rx=0 tx=0).stop 2024-03-12T17:20:08.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.335+0000 7f67dda00640 1 -- 172.21.15.17:0/2464033309 shutdown_connections 2024-03-12T17:20:08.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.335+0000 7f67dda00640 1 --2- 172.21.15.17:0/2464033309 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f67d80b1860 0x7f67d80b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:08.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.335+0000 7f67dda00640 1 --2- 172.21.15.17:0/2464033309 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67d8145dc0 0x7f67d8160ff0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:08.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.335+0000 7f67dda00640 1 -- 172.21.15.17:0/2464033309 >> 172.21.15.17:0/2464033309 conn(0x7f67d8069ce0 msgr2=0x7f67d806a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:08.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.336+0000 7f67dda00640 1 -- 172.21.15.17:0/2464033309 shutdown_connections 2024-03-12T17:20:08.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.336+0000 7f67dda00640 1 -- 172.21.15.17:0/2464033309 wait complete. 2024-03-12T17:20:08.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.337+0000 7f67dda00640 1 Processor -- start 2024-03-12T17:20:08.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.337+0000 7f67dda00640 1 -- start start 2024-03-12T17:20:08.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.338+0000 7f67dda00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f67d8070240 0x7f67d8144790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:08.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.338+0000 7f67dda00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67d80b1860 0x7f67d815c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:08.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.338+0000 7f67dda00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f67d8145dc0 0x7f67d815e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:08.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.338+0000 7f67dda00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d81f2d70 con 0x7f67d80b1860 2024-03-12T17:20:08.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.338+0000 7f67dda00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d80c37d0 con 0x7f67d8070240 2024-03-12T17:20:08.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.338+0000 7f67dda00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d81f2120 con 0x7f67d8145dc0 2024-03-12T17:20:08.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.339+0000 7f67cfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67d80b1860 0x7f67d815c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:08.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.339+0000 7f67cfe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67d80b1860 0x7f67d815c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48014/0 (socket says 172.21.15.17:48014) 2024-03-12T17:20:08.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.339+0000 7f67cfe00640 1 -- 172.21.15.17:0/3796245049 learned_addr learned my addr 172.21.15.17:0/3796245049 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:08.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.339+0000 7f67d7e00640 1 --2- 172.21.15.17:0/3796245049 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f67d8070240 0x7f67d8144790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:08.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.339+0000 7f67cfe00640 1 -- 172.21.15.17:0/3796245049 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f67d8145dc0 msgr2=0x7f67d815e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:08.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.339+0000 7f67cfe00640 1 --2- 172.21.15.17:0/3796245049 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f67d8145dc0 0x7f67d815e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:08.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.339+0000 7f67cfe00640 1 -- 172.21.15.17:0/3796245049 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f67d8070240 msgr2=0x7f67d8144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:08.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.339+0000 7f67cfe00640 1 --2- 172.21.15.17:0/3796245049 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f67d8070240 0x7f67d8144790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:08.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.339+0000 7f67cfe00640 1 -- 172.21.15.17:0/3796245049 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c80094d0 con 0x7f67d80b1860 2024-03-12T17:20:08.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.339+0000 7f67cfe00640 1 --2- 172.21.15.17:0/3796245049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67d80b1860 0x7f67d815c170 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f67c000d800 tx=0x7f67c000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:08.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.340+0000 7f67d4c00640 1 -- 172.21.15.17:0/3796245049 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c000b6c0 con 0x7f67d80b1860 2024-03-12T17:20:08.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.340+0000 7f67d4c00640 1 -- 172.21.15.17:0/3796245049 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c000b820 con 0x7f67d80b1860 2024-03-12T17:20:08.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.340+0000 7f67d4c00640 1 -- 172.21.15.17:0/3796245049 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c000bbb0 con 0x7f67d80b1860 2024-03-12T17:20:08.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.340+0000 7f67dda00640 1 -- 172.21.15.17:0/3796245049 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67d81f2400 con 0x7f67d80b1860 2024-03-12T17:20:08.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.340+0000 7f67dda00640 1 -- 172.21.15.17:0/3796245049 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67d81f29c0 con 0x7f67d80b1860 2024-03-12T17:20:08.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.341+0000 7f67dda00640 1 -- 172.21.15.17:0/3796245049 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67d804e030 con 0x7f67d80b1860 2024-03-12T17:20:08.336 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.342+0000 7f67d4c00640 1 -- 172.21.15.17:0/3796245049 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f67c000bd10 con 0x7f67d80b1860 2024-03-12T17:20:08.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.343+0000 7f67d4c00640 1 --2- 172.21.15.17:0/3796245049 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f67b406ac00 0x7f67b406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:08.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.343+0000 7f67d4c00640 1 -- 172.21.15.17:0/3796245049 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f67c0089910 con 0x7f67d80b1860 2024-03-12T17:20:08.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.343+0000 7f67d7e00640 1 --2- 172.21.15.17:0/3796245049 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f67b406ac00 0x7f67b406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:08.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.344+0000 7f67d7e00640 1 --2- 172.21.15.17:0/3796245049 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f67b406ac00 0x7f67b406d0c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f67c8036000 tx=0x7f67c803b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:08.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.347+0000 7f67d4c00640 1 -- 172.21.15.17:0/3796245049 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f67c0054ae0 con 0x7f67d80b1860 2024-03-12T17:20:08.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.546+0000 7f67dda00640 1 -- 172.21.15.17:0/3796245049 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f67d806b320 con 0x7f67d80b1860 2024-03-12T17:20:08.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.547+0000 7f67d4c00640 1 -- 172.21.15.17:0/3796245049 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f67c0058100 con 0x7f67d80b1860 2024-03-12T17:20:08.541 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-03-12T17:20:08.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.550+0000 7f67dda00640 1 -- 172.21.15.17:0/3796245049 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f67b406ac00 msgr2=0x7f67b406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:08.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.550+0000 7f67dda00640 1 --2- 172.21.15.17:0/3796245049 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f67b406ac00 0x7f67b406d0c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f67c8036000 tx=0x7f67c803b040 comp rx=0 tx=0).stop 2024-03-12T17:20:08.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.550+0000 7f67dda00640 1 -- 172.21.15.17:0/3796245049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67d80b1860 msgr2=0x7f67d815c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:08.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.550+0000 7f67dda00640 1 --2- 172.21.15.17:0/3796245049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67d80b1860 0x7f67d815c170 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f67c000d800 tx=0x7f67c000dcc0 comp rx=0 tx=0).stop 2024-03-12T17:20:08.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.550+0000 7f67dda00640 1 -- 172.21.15.17:0/3796245049 shutdown_connections 2024-03-12T17:20:08.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.550+0000 7f67dda00640 1 --2- 172.21.15.17:0/3796245049 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f67b406ac00 0x7f67b406d0c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:08.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.550+0000 7f67dda00640 1 --2- 172.21.15.17:0/3796245049 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f67d8145dc0 0x7f67d815e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:08.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.550+0000 7f67dda00640 1 --2- 172.21.15.17:0/3796245049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f67d80b1860 0x7f67d815c170 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:08.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.550+0000 7f67dda00640 1 --2- 172.21.15.17:0/3796245049 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f67d8070240 0x7f67d8144790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:08.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.550+0000 7f67dda00640 1 -- 172.21.15.17:0/3796245049 >> 172.21.15.17:0/3796245049 conn(0x7f67d8069ce0 msgr2=0x7f67d80b0750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:08.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.550+0000 7f67dda00640 1 -- 172.21.15.17:0/3796245049 shutdown_connections 2024-03-12T17:20:08.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.550+0000 7f67dda00640 1 -- 172.21.15.17:0/3796245049 wait complete. 2024-03-12T17:20:08.563 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-12T17:20:08.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.796+0000 7f4ddbe00640 1 Processor -- start 2024-03-12T17:20:08.791 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.797+0000 7f4ddbe00640 1 -- start start 2024-03-12T17:20:08.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.798+0000 7f4ddbe00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4ddc0cbee0 0x7f4ddc164550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:08.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.798+0000 7f4ddbe00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ddc15ab90 con 0x7f4ddc0b2ca0 2024-03-12T17:20:08.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.798+0000 7f4ddbe00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ddc15d260 con 0x7f4ddc06db80 2024-03-12T17:20:08.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.798+0000 7f4ddbe00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ddc15dee0 con 0x7f4ddc0cbee0 2024-03-12T17:20:08.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.799+0000 7f4ddb400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4ddc0cbee0 0x7f4ddc164550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:08.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.799+0000 7f4ddb400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4ddc0cbee0 0x7f4ddc164550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48030/0 (socket says 172.21.15.17:48030) 2024-03-12T17:20:08.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.799+0000 7f4ddb400640 1 -- 172.21.15.17:0/1814182054 learned_addr learned my addr 172.21.15.17:0/1814182054 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:08.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.799+0000 7f4ddb400640 1 -- 172.21.15.17:0/1814182054 >> v1:172.21.15.94:6789/0 conn(0x7f4ddc06db80 legacy=0x7f4ddc0cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:08.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.799+0000 7f4ddb400640 1 -- 172.21.15.17:0/1814182054 >> v1:172.21.15.17:6789/0 conn(0x7f4ddc0b2ca0 legacy=0x7f4ddc06d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:08.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.799+0000 7f4ddb400640 1 -- 172.21.15.17:0/1814182054 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ddc15d540 con 0x7f4ddc0cbee0 2024-03-12T17:20:08.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.800+0000 7f4ddb400640 1 --2- 172.21.15.17:0/1814182054 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ddc0cbee0 0x7f4ddc164550 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4009e50 tx=0x7f4dd402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba564fc007f8639 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:08.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.801+0000 7f4dd9600640 1 -- 172.21.15.17:0/1814182054 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd402cb20 con 0x7f4ddc0cbee0 2024-03-12T17:20:08.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.801+0000 7f4dd9600640 1 -- 172.21.15.17:0/1814182054 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd402cc80 con 0x7f4ddc0cbee0 2024-03-12T17:20:08.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.801+0000 7f4dd9600640 1 -- 172.21.15.17:0/1814182054 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd40343f0 con 0x7f4ddc0cbee0 2024-03-12T17:20:08.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.801+0000 7f4ddbe00640 1 -- 172.21.15.17:0/1814182054 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ddc0cbee0 msgr2=0x7f4ddc164550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:08.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.801+0000 7f4ddbe00640 1 --2- 172.21.15.17:0/1814182054 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ddc0cbee0 0x7f4ddc164550 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4009e50 tx=0x7f4dd402bf80 comp rx=0 tx=0).stop 2024-03-12T17:20:08.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.801+0000 7f4ddbe00640 1 -- 172.21.15.17:0/1814182054 shutdown_connections 2024-03-12T17:20:08.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.801+0000 7f4ddbe00640 1 --2- 172.21.15.17:0/1814182054 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ddc0cbee0 0x7f4ddc164550 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:08.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.801+0000 7f4ddbe00640 1 -- 172.21.15.17:0/1814182054 >> 172.21.15.17:0/1814182054 conn(0x7f4ddc066000 msgr2=0x7f4ddc069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:08.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.802+0000 7f4ddbe00640 1 -- 172.21.15.17:0/1814182054 shutdown_connections 2024-03-12T17:20:08.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.802+0000 7f4ddbe00640 1 -- 172.21.15.17:0/1814182054 wait complete. 2024-03-12T17:20:08.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.803+0000 7f4ddbe00640 1 Processor -- start 2024-03-12T17:20:08.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.803+0000 7f4ddbe00640 1 -- start start 2024-03-12T17:20:08.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.804+0000 7f4ddbe00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4ddc06db80 0x7f4ddc13bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:08.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.804+0000 7f4ddbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ddc0b2ca0 0x7f4ddc14a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:08.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.804+0000 7f4ddbe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4ddc0cbee0 0x7f4ddc14b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:08.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.804+0000 7f4ddbe00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc151260 con 0x7f4ddc0b2ca0 2024-03-12T17:20:08.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.804+0000 7f4ddbe00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc151540 con 0x7f4ddc0cbee0 2024-03-12T17:20:08.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.804+0000 7f4ddbe00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ddc151820 con 0x7f4ddc06db80 2024-03-12T17:20:08.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.805+0000 7f4dda000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ddc0b2ca0 0x7f4ddc14a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:08.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.805+0000 7f4dda000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ddc0b2ca0 0x7f4ddc14a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48046/0 (socket says 172.21.15.17:48046) 2024-03-12T17:20:08.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.805+0000 7f4dda000640 1 -- 172.21.15.17:0/1931629837 learned_addr learned my addr 172.21.15.17:0/1931629837 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:08.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.805+0000 7f4ddb400640 1 --2- 172.21.15.17:0/1931629837 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4ddc0cbee0 0x7f4ddc14b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:08.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.805+0000 7f4dda000640 1 -- 172.21.15.17:0/1931629837 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4ddc06db80 msgr2=0x7f4ddc13bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:08.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.805+0000 7f4ddaa00640 1 --2- 172.21.15.17:0/1931629837 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4ddc06db80 0x7f4ddc13bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:08.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.805+0000 7f4dda000640 1 --2- 172.21.15.17:0/1931629837 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4ddc06db80 0x7f4ddc13bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:08.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.805+0000 7f4dda000640 1 -- 172.21.15.17:0/1931629837 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4ddc0cbee0 msgr2=0x7f4ddc14b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:08.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.805+0000 7f4dda000640 1 --2- 172.21.15.17:0/1931629837 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4ddc0cbee0 0x7f4ddc14b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:08.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.805+0000 7f4dda000640 1 -- 172.21.15.17:0/1931629837 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd4009b30 con 0x7f4ddc0b2ca0 2024-03-12T17:20:08.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.805+0000 7f4ddb400640 1 --2- 172.21.15.17:0/1931629837 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4ddc0cbee0 0x7f4ddc14b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:08.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.805+0000 7f4ddaa00640 1 --2- 172.21.15.17:0/1931629837 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4ddc06db80 0x7f4ddc13bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:08.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.806+0000 7f4dda000640 1 --2- 172.21.15.17:0/1931629837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ddc0b2ca0 0x7f4ddc14a470 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4dc800c430 tx=0x7f4dc800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:08.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.806+0000 7f4dd2a00640 1 -- 172.21.15.17:0/1931629837 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc8011790 con 0x7f4ddc0b2ca0 2024-03-12T17:20:08.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.806+0000 7f4dd2a00640 1 -- 172.21.15.17:0/1931629837 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dc80118f0 con 0x7f4ddc0b2ca0 2024-03-12T17:20:08.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.806+0000 7f4dd2a00640 1 -- 172.21.15.17:0/1931629837 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dc8011ce0 con 0x7f4ddc0b2ca0 2024-03-12T17:20:08.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.806+0000 7f4ddbe00640 1 -- 172.21.15.17:0/1931629837 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ddc151b00 con 0x7f4ddc0b2ca0 2024-03-12T17:20:08.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.806+0000 7f4ddbe00640 1 -- 172.21.15.17:0/1931629837 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ddc13c4b0 con 0x7f4ddc0b2ca0 2024-03-12T17:20:08.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.807+0000 7f4ddbe00640 1 -- 172.21.15.17:0/1931629837 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ddc152020 con 0x7f4ddc0b2ca0 2024-03-12T17:20:08.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.808+0000 7f4dd2a00640 1 -- 172.21.15.17:0/1931629837 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f4dc801c460 con 0x7f4ddc0b2ca0 2024-03-12T17:20:08.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.809+0000 7f4dd2a00640 1 --2- 172.21.15.17:0/1931629837 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f4dbc06ac00 0x7f4dbc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:08.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.809+0000 7f4dd2a00640 1 -- 172.21.15.17:0/1931629837 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4dc80893e0 con 0x7f4ddc0b2ca0 2024-03-12T17:20:08.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.809+0000 7f4ddaa00640 1 --2- 172.21.15.17:0/1931629837 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f4dbc06ac00 0x7f4dbc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:08.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.810+0000 7f4ddaa00640 1 --2- 172.21.15.17:0/1931629837 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f4dbc06ac00 0x7f4dbc06d0c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc000f60 tx=0x7f4dcc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:08.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:08.813+0000 7f4dd2a00640 1 -- 172.21.15.17:0/1931629837 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f4ddc152020 con 0x7f4ddc0b2ca0 2024-03-12T17:20:09.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.011+0000 7f4ddbe00640 1 -- 172.21.15.17:0/1931629837 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4ddc152020 con 0x7f4ddc0b2ca0 2024-03-12T17:20:09.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.011+0000 7f4dd2a00640 1 -- 172.21.15.17:0/1931629837 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4ddc152020 con 0x7f4ddc0b2ca0 2024-03-12T17:20:09.006 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-03-12T17:20:09.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.014+0000 7f4ddbe00640 1 -- 172.21.15.17:0/1931629837 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f4dbc06ac00 msgr2=0x7f4dbc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:09.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.014+0000 7f4ddbe00640 1 --2- 172.21.15.17:0/1931629837 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f4dbc06ac00 0x7f4dbc06d0c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4dcc000f60 tx=0x7f4dcc009040 comp rx=0 tx=0).stop 2024-03-12T17:20:09.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.014+0000 7f4ddbe00640 1 -- 172.21.15.17:0/1931629837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ddc0b2ca0 msgr2=0x7f4ddc14a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:09.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.014+0000 7f4ddbe00640 1 --2- 172.21.15.17:0/1931629837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ddc0b2ca0 0x7f4ddc14a470 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4dc800c430 tx=0x7f4dc800c8f0 comp rx=0 tx=0).stop 2024-03-12T17:20:09.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.014+0000 7f4ddbe00640 1 -- 172.21.15.17:0/1931629837 shutdown_connections 2024-03-12T17:20:09.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.014+0000 7f4ddbe00640 1 --2- 172.21.15.17:0/1931629837 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f4dbc06ac00 0x7f4dbc06d0c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:09.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.014+0000 7f4ddbe00640 1 --2- 172.21.15.17:0/1931629837 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4ddc0cbee0 0x7f4ddc14b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:09.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.014+0000 7f4ddbe00640 1 --2- 172.21.15.17:0/1931629837 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4ddc0b2ca0 0x7f4ddc14a470 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:09.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.014+0000 7f4ddbe00640 1 --2- 172.21.15.17:0/1931629837 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4ddc06db80 0x7f4ddc13bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:09.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.014+0000 7f4ddbe00640 1 -- 172.21.15.17:0/1931629837 >> 172.21.15.17:0/1931629837 conn(0x7f4ddc066000 msgr2=0x7f4ddc0b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:09.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.014+0000 7f4ddbe00640 1 -- 172.21.15.17:0/1931629837 shutdown_connections 2024-03-12T17:20:09.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.014+0000 7f4ddbe00640 1 -- 172.21.15.17:0/1931629837 wait complete. 2024-03-12T17:20:09.027 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-12T17:20:09.247 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.253+0000 7f973e800640 1 Processor -- start 2024-03-12T17:20:09.248 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.253+0000 7f973e800640 1 -- start start 2024-03-12T17:20:09.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.255+0000 7f973e800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f973815caa0 0x7f9738160790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:09.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.255+0000 7f973e800640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f973815ce80 0x7f97380cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:09.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.255+0000 7f973e800640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9738161650 con 0x7f97380b85f0 2024-03-12T17:20:09.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.255+0000 7f973e800640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9738161090 con 0x7f973815caa0 2024-03-12T17:20:09.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.255+0000 7f973e800640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9738161370 con 0x7f973815ce80 2024-03-12T17:20:09.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.255+0000 7f973d400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f973815caa0 0x7f9738160790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:09.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.255+0000 7f973d400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f973815caa0 0x7f9738160790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48054/0 (socket says 172.21.15.17:48054) 2024-03-12T17:20:09.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.255+0000 7f973d400640 1 -- 172.21.15.17:0/2015868879 learned_addr learned my addr 172.21.15.17:0/2015868879 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:09.250 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.256+0000 7f973ca00640 1 --2- 172.21.15.17:0/2015868879 >> v2:172.21.15.94:3300/0 conn(0x7f973815ce80 0x7f97380cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:09.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.256+0000 7f973d400640 1 -- 172.21.15.17:0/2015868879 >> v2:172.21.15.94:3300/0 conn(0x7f973815ce80 msgr2=0x7f97380cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:09.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.256+0000 7f973d400640 1 --2- 172.21.15.17:0/2015868879 >> v2:172.21.15.94:3300/0 conn(0x7f973815ce80 0x7f97380cf330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:09.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.256+0000 7f973d400640 1 -- 172.21.15.17:0/2015868879 >> v1:172.21.15.94:6789/0 conn(0x7f97380b85f0 legacy=0x7f97380b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:09.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.256+0000 7f973d400640 1 -- 172.21.15.17:0/2015868879 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97380d0ad0 con 0x7f973815caa0 2024-03-12T17:20:09.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.257+0000 7f973d400640 1 --2- 172.21.15.17:0/2015868879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f973815caa0 0x7f9738160790 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f973806cc00 tx=0x7f972802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8ad9592d5bad3e server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:09.251 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.257+0000 7f9737e00640 1 -- 172.21.15.17:0/2015868879 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9728031870 con 0x7f973815caa0 2024-03-12T17:20:09.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.257+0000 7f9737e00640 1 -- 172.21.15.17:0/2015868879 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97280319d0 con 0x7f973815caa0 2024-03-12T17:20:09.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.257+0000 7f9737e00640 1 -- 172.21.15.17:0/2015868879 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9728031d60 con 0x7f973815caa0 2024-03-12T17:20:09.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.258+0000 7f973e800640 1 -- 172.21.15.17:0/2015868879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f973815caa0 msgr2=0x7f9738160790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:09.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.258+0000 7f973e800640 1 --2- 172.21.15.17:0/2015868879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f973815caa0 0x7f9738160790 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f973806cc00 tx=0x7f972802b910 comp rx=0 tx=0).stop 2024-03-12T17:20:09.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.258+0000 7f973e800640 1 -- 172.21.15.17:0/2015868879 shutdown_connections 2024-03-12T17:20:09.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.258+0000 7f973e800640 1 --2- 172.21.15.17:0/2015868879 >> v2:172.21.15.94:3300/0 conn(0x7f973815ce80 0x7f97380cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:09.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.258+0000 7f973e800640 1 --2- 172.21.15.17:0/2015868879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f973815caa0 0x7f9738160790 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:09.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.258+0000 7f973e800640 1 -- 172.21.15.17:0/2015868879 >> 172.21.15.17:0/2015868879 conn(0x7f973806b160 msgr2=0x7f973806b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:09.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.258+0000 7f973e800640 1 -- 172.21.15.17:0/2015868879 shutdown_connections 2024-03-12T17:20:09.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.258+0000 7f973e800640 1 -- 172.21.15.17:0/2015868879 wait complete. 2024-03-12T17:20:09.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.260+0000 7f973e800640 1 Processor -- start 2024-03-12T17:20:09.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.260+0000 7f973e800640 1 -- start start 2024-03-12T17:20:09.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.261+0000 7f973e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97380b85f0 0x7f97381569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:09.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.261+0000 7f973e800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f973815caa0 0x7f97381f6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:09.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.261+0000 7f973e800640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f973815ce80 0x7f97380b5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:09.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.261+0000 7f973e800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973815a740 con 0x7f97380b85f0 2024-03-12T17:20:09.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.261+0000 7f973e800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97381f6970 con 0x7f973815caa0 2024-03-12T17:20:09.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.261+0000 7f973e800640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97380c79e0 con 0x7f973815ce80 2024-03-12T17:20:09.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.261+0000 7f973d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97380b85f0 0x7f97381569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:09.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.261+0000 7f973d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97380b85f0 0x7f97381569b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48058/0 (socket says 172.21.15.17:48058) 2024-03-12T17:20:09.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.261+0000 7f973d400640 1 -- 172.21.15.17:0/2258497205 learned_addr learned my addr 172.21.15.17:0/2258497205 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:09.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.262+0000 7f973ca00640 1 --2- 172.21.15.17:0/2258497205 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f973815caa0 0x7f97381f6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:09.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.262+0000 7f973d400640 1 -- 172.21.15.17:0/2258497205 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f973815ce80 msgr2=0x7f97380b5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:09.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.262+0000 7f973d400640 1 --2- 172.21.15.17:0/2258497205 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f973815ce80 0x7f97380b5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:09.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.262+0000 7f973d400640 1 -- 172.21.15.17:0/2258497205 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f973815caa0 msgr2=0x7f97381f6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:09.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.262+0000 7f973d400640 1 --2- 172.21.15.17:0/2258497205 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f973815caa0 0x7f97381f6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:09.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.262+0000 7f973d400640 1 -- 172.21.15.17:0/2258497205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97280094d0 con 0x7f97380b85f0 2024-03-12T17:20:09.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.262+0000 7f973ca00640 1 --2- 172.21.15.17:0/2258497205 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f973815caa0 0x7f97381f6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:09.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.262+0000 7f973d400640 1 --2- 172.21.15.17:0/2258497205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97380b85f0 0x7f97381569b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9728000c00 tx=0x7f97280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:09.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.262+0000 7f9735600640 1 -- 172.21.15.17:0/2258497205 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9728031840 con 0x7f97380b85f0 2024-03-12T17:20:09.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.263+0000 7f9735600640 1 -- 172.21.15.17:0/2258497205 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97280443f0 con 0x7f97380b85f0 2024-03-12T17:20:09.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.263+0000 7f973e800640 1 -- 172.21.15.17:0/2258497205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97380c7cc0 con 0x7f97380b85f0 2024-03-12T17:20:09.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.263+0000 7f9735600640 1 -- 172.21.15.17:0/2258497205 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97280447a0 con 0x7f97380b85f0 2024-03-12T17:20:09.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.263+0000 7f973e800640 1 -- 172.21.15.17:0/2258497205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97380b33b0 con 0x7f97380b85f0 2024-03-12T17:20:09.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.264+0000 7f973e800640 1 -- 172.21.15.17:0/2258497205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9738072360 con 0x7f97380b85f0 2024-03-12T17:20:09.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.265+0000 7f9735600640 1 -- 172.21.15.17:0/2258497205 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f9728044900 con 0x7f97380b85f0 2024-03-12T17:20:09.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.266+0000 7f9735600640 1 --2- 172.21.15.17:0/2258497205 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f971c06ac30 0x7f971c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:09.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.266+0000 7f9735600640 1 -- 172.21.15.17:0/2258497205 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f972802d040 con 0x7f97380b85f0 2024-03-12T17:20:09.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.266+0000 7f973ca00640 1 --2- 172.21.15.17:0/2258497205 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f971c06ac30 0x7f971c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:09.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.267+0000 7f973ca00640 1 --2- 172.21.15.17:0/2258497205 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f971c06ac30 0x7f971c06d0f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f97380b2140 tx=0x7f972c007400 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:09.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.271+0000 7f9735600640 1 -- 172.21.15.17:0/2258497205 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f9728076dc0 con 0x7f97380b85f0 2024-03-12T17:20:09.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.470+0000 7f973e800640 1 -- 172.21.15.17:0/2258497205 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f97380b5270 con 0x7f97380b85f0 2024-03-12T17:20:09.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.471+0000 7f9735600640 1 -- 172.21.15.17:0/2258497205 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9728035020 con 0x7f97380b85f0 2024-03-12T17:20:09.465 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-03-12T17:20:09.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.473+0000 7f973e800640 1 -- 172.21.15.17:0/2258497205 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f971c06ac30 msgr2=0x7f971c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:09.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.473+0000 7f973e800640 1 --2- 172.21.15.17:0/2258497205 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f971c06ac30 0x7f971c06d0f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f97380b2140 tx=0x7f972c007400 comp rx=0 tx=0).stop 2024-03-12T17:20:09.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.473+0000 7f973e800640 1 -- 172.21.15.17:0/2258497205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97380b85f0 msgr2=0x7f97381569b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:09.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.473+0000 7f973e800640 1 --2- 172.21.15.17:0/2258497205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97380b85f0 0x7f97381569b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9728000c00 tx=0x7f97280046c0 comp rx=0 tx=0).stop 2024-03-12T17:20:09.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.474+0000 7f973e800640 1 -- 172.21.15.17:0/2258497205 shutdown_connections 2024-03-12T17:20:09.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.474+0000 7f973e800640 1 --2- 172.21.15.17:0/2258497205 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f971c06ac30 0x7f971c06d0f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:09.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.474+0000 7f973e800640 1 --2- 172.21.15.17:0/2258497205 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f973815ce80 0x7f97380b5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:09.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.474+0000 7f973e800640 1 --2- 172.21.15.17:0/2258497205 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f973815caa0 0x7f97381f6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:09.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.474+0000 7f973e800640 1 --2- 172.21.15.17:0/2258497205 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f97380b85f0 0x7f97381569b0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:09.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.474+0000 7f973e800640 1 -- 172.21.15.17:0/2258497205 >> 172.21.15.17:0/2258497205 conn(0x7f973806b160 msgr2=0x7f97380b7650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:09.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.474+0000 7f973e800640 1 -- 172.21.15.17:0/2258497205 shutdown_connections 2024-03-12T17:20:09.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.474+0000 7f973e800640 1 -- 172.21.15.17:0/2258497205 wait complete. 2024-03-12T17:20:09.486 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-12T17:20:09.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.705+0000 7f6aeda00640 1 Processor -- start 2024-03-12T17:20:09.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.705+0000 7f6aeda00640 1 -- start start 2024-03-12T17:20:09.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.707+0000 7f6aeda00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6ae8159a50 0x7f6ae815cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:09.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.707+0000 7f6aeda00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6ae80b35f0 0x7f6ae80b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:09.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.707+0000 7f6aeda00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae815beb0 con 0x7f6ae80b2620 2024-03-12T17:20:09.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.707+0000 7f6aeda00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae80b3f70 con 0x7f6ae80b35f0 2024-03-12T17:20:09.701 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.707+0000 7f6aeda00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae815c190 con 0x7f6ae8159a50 2024-03-12T17:20:09.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.707+0000 7f6ae7400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f6ae80b2620 0x7f6ae8099710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53586/0 (socket says 172.21.15.17:53586) 2024-03-12T17:20:09.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.707+0000 7f6ae7400640 1 -- 172.21.15.17:0/2855245126 learned_addr learned my addr 172.21.15.17:0/2855245126 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:20:09.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.707+0000 7f6ae6000640 1 --2- 172.21.15.17:0/2855245126 >> v2:172.21.15.94:3300/0 conn(0x7f6ae80b35f0 0x7f6ae80b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:09.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.707+0000 7f6ae6a00640 1 --2- 172.21.15.17:0/2855245126 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6ae8159a50 0x7f6ae815cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:09.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.708+0000 7f6ae5600640 1 -- 172.21.15.17:0/2855245126 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 411403466 0 0) 0x7f6ae815beb0 con 0x7f6ae80b2620 2024-03-12T17:20:09.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.708+0000 7f6ae5600640 1 -- 172.21.15.17:0/2855245126 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6acc003520 con 0x7f6ae80b2620 2024-03-12T17:20:09.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.708+0000 7f6ae6000640 1 -- 172.21.15.17:0/2855245126 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6ae8159a50 msgr2=0x7f6ae815cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:09.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.708+0000 7f6ae6000640 1 --2- 172.21.15.17:0/2855245126 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6ae8159a50 0x7f6ae815cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:09.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.708+0000 7f6ae6000640 1 -- 172.21.15.17:0/2855245126 >> v1:172.21.15.17:6789/0 conn(0x7f6ae80b2620 legacy=0x7f6ae8099710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:09.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.708+0000 7f6ae6000640 1 -- 172.21.15.17:0/2855245126 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae815c470 con 0x7f6ae80b35f0 2024-03-12T17:20:09.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.709+0000 7f6ae6000640 1 --2- 172.21.15.17:0/2855245126 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ae80b35f0 0x7f6ae80b3a30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6ad00097a0 tx=0x7f6ad002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4683ba10ca4b8932 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:09.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.710+0000 7f6ae5600640 1 -- 172.21.15.17:0/2855245126 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0030610 con 0x7f6ae80b35f0 2024-03-12T17:20:09.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.710+0000 7f6ae5600640 1 -- 172.21.15.17:0/2855245126 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad0030770 con 0x7f6ae80b35f0 2024-03-12T17:20:09.704 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.710+0000 7f6ae5600640 1 -- 172.21.15.17:0/2855245126 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0030b00 con 0x7f6ae80b35f0 2024-03-12T17:20:09.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.710+0000 7f6aeda00640 1 -- 172.21.15.17:0/2855245126 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ae80b35f0 msgr2=0x7f6ae80b3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:09.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.710+0000 7f6aeda00640 1 --2- 172.21.15.17:0/2855245126 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ae80b35f0 0x7f6ae80b3a30 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6ad00097a0 tx=0x7f6ad002b960 comp rx=0 tx=0).stop 2024-03-12T17:20:09.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.711+0000 7f6aeda00640 1 -- 172.21.15.17:0/2855245126 shutdown_connections 2024-03-12T17:20:09.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.711+0000 7f6aeda00640 1 --2- 172.21.15.17:0/2855245126 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ae80b35f0 0x7f6ae80b3a30 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:09.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.711+0000 7f6aeda00640 1 --2- 172.21.15.17:0/2855245126 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6ae8159a50 0x7f6ae815cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:09.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.711+0000 7f6aeda00640 1 -- 172.21.15.17:0/2855245126 >> 172.21.15.17:0/2855245126 conn(0x7f6ae8098a60 msgr2=0x7f6ae80b4b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:09.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.711+0000 7f6aeda00640 1 -- 172.21.15.17:0/2855245126 shutdown_connections 2024-03-12T17:20:09.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.711+0000 7f6aeda00640 1 -- 172.21.15.17:0/2855245126 wait complete. 2024-03-12T17:20:09.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.713+0000 7f6aeda00640 1 Processor -- start 2024-03-12T17:20:09.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.713+0000 7f6aeda00640 1 -- start start 2024-03-12T17:20:09.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.714+0000 7f6aeda00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6ae80b2620 0x7f6ae81f1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:09.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.714+0000 7f6aeda00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ae80b35f0 0x7f6ae81367a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:09.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.714+0000 7f6aeda00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ae8159a50 0x7f6ae80ae3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:09.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.714+0000 7f6aeda00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae8136380 con 0x7f6ae8159a50 2024-03-12T17:20:09.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.714+0000 7f6aeda00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae81f1fb0 con 0x7f6ae80b35f0 2024-03-12T17:20:09.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.714+0000 7f6aeda00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae8135700 con 0x7f6ae80b2620 2024-03-12T17:20:09.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.714+0000 7f6ae7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ae8159a50 0x7f6ae80ae3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:09.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.714+0000 7f6ae7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ae8159a50 0x7f6ae80ae3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48066/0 (socket says 172.21.15.17:48066) 2024-03-12T17:20:09.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.714+0000 7f6ae7400640 1 -- 172.21.15.17:0/2860846948 learned_addr learned my addr 172.21.15.17:0/2860846948 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:09.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.714+0000 7f6ae6000640 1 --2- 172.21.15.17:0/2860846948 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ae80b35f0 0x7f6ae81367a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:09.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.715+0000 7f6ae6a00640 1 --2- 172.21.15.17:0/2860846948 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6ae80b2620 0x7f6ae81f1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:09.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.715+0000 7f6ae7400640 1 -- 172.21.15.17:0/2860846948 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6ae80b2620 msgr2=0x7f6ae81f1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:09.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.715+0000 7f6ae7400640 1 --2- 172.21.15.17:0/2860846948 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6ae80b2620 0x7f6ae81f1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:09.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.715+0000 7f6ae7400640 1 -- 172.21.15.17:0/2860846948 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ae80b35f0 msgr2=0x7f6ae81367a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:09.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.715+0000 7f6ae7400640 1 --2- 172.21.15.17:0/2860846948 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ae80b35f0 0x7f6ae81367a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:09.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.715+0000 7f6ae7400640 1 -- 172.21.15.17:0/2860846948 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad0009400 con 0x7f6ae8159a50 2024-03-12T17:20:09.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.715+0000 7f6ae6a00640 1 --2- 172.21.15.17:0/2860846948 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6ae80b2620 0x7f6ae81f1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:09.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.715+0000 7f6ae7400640 1 --2- 172.21.15.17:0/2860846948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ae8159a50 0x7f6ae80ae3d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6ae000cb40 tx=0x7f6ae000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:09.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.715+0000 7f6adea00640 1 -- 172.21.15.17:0/2860846948 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae000aca0 con 0x7f6ae8159a50 2024-03-12T17:20:09.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.715+0000 7f6adea00640 1 -- 172.21.15.17:0/2860846948 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ae000ae00 con 0x7f6ae8159a50 2024-03-12T17:20:09.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.715+0000 7f6aeda00640 1 -- 172.21.15.17:0/2860846948 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae81359e0 con 0x7f6ae8159a50 2024-03-12T17:20:09.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.715+0000 7f6adea00640 1 -- 172.21.15.17:0/2860846948 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ae0012620 con 0x7f6ae8159a50 2024-03-12T17:20:09.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.716+0000 7f6aeda00640 1 -- 172.21.15.17:0/2860846948 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ae8135fa0 con 0x7f6ae8159a50 2024-03-12T17:20:09.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.717+0000 7f6aeda00640 1 -- 172.21.15.17:0/2860846948 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ae81364c0 con 0x7f6ae8159a50 2024-03-12T17:20:09.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.718+0000 7f6adea00640 1 -- 172.21.15.17:0/2860846948 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f6ae0007070 con 0x7f6ae8159a50 2024-03-12T17:20:09.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.718+0000 7f6adea00640 1 --2- 172.21.15.17:0/2860846948 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f6ac406ac00 0x7f6ac406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:09.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.719+0000 7f6adea00640 1 -- 172.21.15.17:0/2860846948 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ae00892d0 con 0x7f6ae8159a50 2024-03-12T17:20:09.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.719+0000 7f6ae6a00640 1 --2- 172.21.15.17:0/2860846948 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f6ac406ac00 0x7f6ac406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:09.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.720+0000 7f6ae6a00640 1 --2- 172.21.15.17:0/2860846948 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f6ac406ac00 0x7f6ac406d0c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8009a20 tx=0x7f6ad8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:09.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.723+0000 7f6adea00640 1 -- 172.21.15.17:0/2860846948 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f6ae81364c0 con 0x7f6ae8159a50 2024-03-12T17:20:09.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.934+0000 7f6aeda00640 1 -- 172.21.15.17:0/2860846948 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6ae81364c0 con 0x7f6ae8159a50 2024-03-12T17:20:09.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.935+0000 7f6adea00640 1 -- 172.21.15.17:0/2860846948 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v35) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6ae81364c0 con 0x7f6ae8159a50 2024-03-12T17:20:09.929 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2024-03-12T17:20:09.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.937+0000 7f6aeda00640 1 -- 172.21.15.17:0/2860846948 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f6ac406ac00 msgr2=0x7f6ac406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:09.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.938+0000 7f6aeda00640 1 --2- 172.21.15.17:0/2860846948 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f6ac406ac00 0x7f6ac406d0c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6ad8009a20 tx=0x7f6ad8008040 comp rx=0 tx=0).stop 2024-03-12T17:20:09.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.938+0000 7f6aeda00640 1 -- 172.21.15.17:0/2860846948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ae8159a50 msgr2=0x7f6ae80ae3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:09.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.938+0000 7f6aeda00640 1 --2- 172.21.15.17:0/2860846948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ae8159a50 0x7f6ae80ae3d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6ae000cb40 tx=0x7f6ae000a060 comp rx=0 tx=0).stop 2024-03-12T17:20:09.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.938+0000 7f6aeda00640 1 -- 172.21.15.17:0/2860846948 shutdown_connections 2024-03-12T17:20:09.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.938+0000 7f6aeda00640 1 --2- 172.21.15.17:0/2860846948 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f6ac406ac00 0x7f6ac406d0c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:09.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.938+0000 7f6aeda00640 1 --2- 172.21.15.17:0/2860846948 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6ae8159a50 0x7f6ae80ae3d0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:09.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.938+0000 7f6aeda00640 1 --2- 172.21.15.17:0/2860846948 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6ae80b35f0 0x7f6ae81367a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:09.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.938+0000 7f6aeda00640 1 --2- 172.21.15.17:0/2860846948 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6ae80b2620 0x7f6ae81f1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:09.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.938+0000 7f6aeda00640 1 -- 172.21.15.17:0/2860846948 >> 172.21.15.17:0/2860846948 conn(0x7f6ae8098a60 msgr2=0x7f6ae80b2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:09.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.938+0000 7f6aeda00640 1 -- 172.21.15.17:0/2860846948 shutdown_connections 2024-03-12T17:20:09.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:09.938+0000 7f6aeda00640 1 -- 172.21.15.17:0/2860846948 wait complete. 2024-03-12T17:20:09.952 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-12T17:20:09.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:20:09.953 DEBUG:teuthology.orchestra.run.smithi017:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-03-12T17:20:10.091 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2024-03-12T17:20:10.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:20:10.091 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-12T17:20:10.151 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-12T17:20:10.151 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-12T17:20:10.190 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053417,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498348k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249172k,nr_inodes=812293,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498348k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-12T17:20:10.191 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:20:10.191 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-12T17:20:10.230 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054202,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249800k,nr_inodes=812450,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-12T17:20:10.230 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-12T17:20:10.230 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-12T17:20:10.276 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053417,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498348k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249172k,nr_inodes=812293,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498348k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-12T17:20:10.276 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-12T17:20:10.335 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:20:10.340 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:20:10.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.491+0000 7f0ef2600640 1 Processor -- start 2024-03-12T17:20:10.486 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.492+0000 7f0ef2600640 1 -- start start 2024-03-12T17:20:10.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.493+0000 7f0ef2600640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f0eec145dc0 0x7f0eec160ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:10.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.493+0000 7f0ef2600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0eec0b1860 0x7f0eec0b4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:10.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.493+0000 7f0ef2600640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eec1461a0 con 0x7f0eec070240 2024-03-12T17:20:10.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.493+0000 7f0ef2600640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eec0b2000 con 0x7f0eec145dc0 2024-03-12T17:20:10.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.493+0000 7f0ef2600640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec0b3db0 con 0x7f0eec0b1860 2024-03-12T17:20:10.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.494+0000 7f0ef1c00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f0eec070240 0x7f0eec0abb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53590/0 (socket says 172.21.15.17:53590) 2024-03-12T17:20:10.488 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.494+0000 7f0ef1c00640 1 -- 172.21.15.17:0/3986179485 learned_addr learned my addr 172.21.15.17:0/3986179485 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:20:10.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.494+0000 7f0ef1200640 1 --2- 172.21.15.17:0/3986179485 >> v2:172.21.15.94:3300/0 conn(0x7f0eec145dc0 0x7f0eec160ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:10.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.494+0000 7f0eebe00640 1 --2- 172.21.15.17:0/3986179485 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0eec0b1860 0x7f0eec0b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:10.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.494+0000 7f0eeb400640 1 -- 172.21.15.17:0/3986179485 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3068316469 0 0) 0x7f0eec1461a0 con 0x7f0eec070240 2024-03-12T17:20:10.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.494+0000 7f0eeb400640 1 -- 172.21.15.17:0/3986179485 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ed4003520 con 0x7f0eec070240 2024-03-12T17:20:10.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.495+0000 7f0eeb400640 1 -- 172.21.15.17:0/3986179485 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2930498023 0 0) 0x7f0ed4003520 con 0x7f0eec070240 2024-03-12T17:20:10.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.495+0000 7f0eeb400640 1 -- 172.21.15.17:0/3986179485 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0eec0b1860 msgr2=0x7f0eec0b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:10.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.495+0000 7f0eeb400640 1 --2- 172.21.15.17:0/3986179485 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0eec0b1860 0x7f0eec0b4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:10.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.495+0000 7f0eeb400640 1 -- 172.21.15.17:0/3986179485 >> v2:172.21.15.94:3300/0 conn(0x7f0eec145dc0 msgr2=0x7f0eec160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:10.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.495+0000 7f0eeb400640 1 --2- 172.21.15.17:0/3986179485 >> v2:172.21.15.94:3300/0 conn(0x7f0eec145dc0 0x7f0eec160ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:10.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.495+0000 7f0eeb400640 1 -- 172.21.15.17:0/3986179485 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eec146680 con 0x7f0eec070240 2024-03-12T17:20:10.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.495+0000 7f0eeb400640 1 -- 172.21.15.17:0/3986179485 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7f0ee40019f0 con 0x7f0eec070240 2024-03-12T17:20:10.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.495+0000 7f0eeb400640 1 -- 172.21.15.17:0/3986179485 >> v1:172.21.15.17:6789/0 conn(0x7f0eec070240 legacy=0x7f0eec0abb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:10.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.495+0000 7f0eeb400640 1 --2- 172.21.15.17:0/3986179485 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ed4003970 0x7f0ed4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:10.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.495+0000 7f0eeb400640 1 --2- 172.21.15.17:0/3986179485 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0eec0b1860 0x7f0ed40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:10.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.495+0000 7f0eeb400640 1 --2- 172.21.15.17:0/3986179485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ed4004d00 0x7f0ed4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:10.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.495+0000 7f0eeb400640 1 -- 172.21.15.17:0/3986179485 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec0b2000 con 0x7f0ed4004d00 2024-03-12T17:20:10.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.495+0000 7f0eeb400640 1 -- 172.21.15.17:0/3986179485 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec0b3db0 con 0x7f0ed4003970 2024-03-12T17:20:10.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.495+0000 7f0eeb400640 1 -- 172.21.15.17:0/3986179485 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed400b980 con 0x7f0eec0b1860 2024-03-12T17:20:10.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.495+0000 7f0ef1c00640 1 --2- 172.21.15.17:0/3986179485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ed4004d00 0x7f0ed4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:10.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.495+0000 7f0ef1200640 1 --2- 172.21.15.17:0/3986179485 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ed4003970 0x7f0ed4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:10.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.496+0000 7f0eebe00640 1 --2- 172.21.15.17:0/3986179485 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0eec0b1860 0x7f0ed40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:10.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.496+0000 7f0ef1c00640 1 -- 172.21.15.17:0/3986179485 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0eec0b1860 msgr2=0x7f0ed40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:10.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.496+0000 7f0ef1c00640 1 --2- 172.21.15.17:0/3986179485 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0eec0b1860 0x7f0ed40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:10.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.496+0000 7f0ef1c00640 1 -- 172.21.15.17:0/3986179485 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ed4003970 msgr2=0x7f0ed4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:10.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.496+0000 7f0ef1c00640 1 --2- 172.21.15.17:0/3986179485 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0ed4003970 0x7f0ed4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:10.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.496+0000 7f0ef1c00640 1 -- 172.21.15.17:0/3986179485 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed4003520 con 0x7f0ed4004d00 2024-03-12T17:20:10.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.497+0000 7f0ef1c00640 1 --2- 172.21.15.17:0/3986179485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ed4004d00 0x7f0ed4005180 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0ee400a780 tx=0x7f0ed40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a603768ec2ade82b server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:10.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.497+0000 7f0eeb400640 1 -- 172.21.15.17:0/3986179485 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee4034630 con 0x7f0ed4004d00 2024-03-12T17:20:10.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.497+0000 7f0eeb400640 1 -- 172.21.15.17:0/3986179485 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee402f070 con 0x7f0ed4004d00 2024-03-12T17:20:10.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.497+0000 7f0eeb400640 1 -- 172.21.15.17:0/3986179485 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee40349d0 con 0x7f0ed4004d00 2024-03-12T17:20:10.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.498+0000 7f0ef2600640 1 -- 172.21.15.17:0/3986179485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ed4004d00 msgr2=0x7f0ed4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:10.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.498+0000 7f0ef2600640 1 --2- 172.21.15.17:0/3986179485 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0ed4004d00 0x7f0ed4005180 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f0ee400a780 tx=0x7f0ed40057f0 comp rx=0 tx=0).stop 2024-03-12T17:20:10.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.498+0000 7f0ef1c00640 1 -- 172.21.15.17:0/3986179485 reap_dead start 2024-03-12T17:20:10.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.498+0000 7f0ef2600640 1 -- 172.21.15.17:0/3986179485 shutdown_connections 2024-03-12T17:20:10.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.498+0000 7f0ef2600640 1 -- 172.21.15.17:0/3986179485 >> 172.21.15.17:0/3986179485 conn(0x7f0eec069ce0 msgr2=0x7f0eec06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:10.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.498+0000 7f0ef2600640 1 -- 172.21.15.17:0/3986179485 shutdown_connections 2024-03-12T17:20:10.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.498+0000 7f0ef2600640 1 -- 172.21.15.17:0/3986179485 wait complete. 2024-03-12T17:20:10.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.500+0000 7f0ef2600640 1 Processor -- start 2024-03-12T17:20:10.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.500+0000 7f0ef2600640 1 -- start start 2024-03-12T17:20:10.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.501+0000 7f0ef2600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0ed4004d00 0x7f0eec141950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:10.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.501+0000 7f0ef2600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0eec15c530 0x7f0eec13dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:10.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.501+0000 7f0ef2600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0eec13e230 0x7f0eec13e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:10.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.501+0000 7f0ef2600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec141f80 con 0x7f0eec13e230 2024-03-12T17:20:10.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.501+0000 7f0ef2600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec13d0d0 con 0x7f0eec15c530 2024-03-12T17:20:10.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.501+0000 7f0ef2600640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec13ebf0 con 0x7f0ed4004d00 2024-03-12T17:20:10.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.502+0000 7f0ef1c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0eec13e230 0x7f0eec13e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:10.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.502+0000 7f0ef1c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0eec13e230 0x7f0eec13e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48076/0 (socket says 172.21.15.17:48076) 2024-03-12T17:20:10.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.502+0000 7f0ef1c00640 1 -- 172.21.15.17:0/131006982 learned_addr learned my addr 172.21.15.17:0/131006982 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:10.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.502+0000 7f0ef1200640 1 --2- 172.21.15.17:0/131006982 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0ed4004d00 0x7f0eec141950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:10.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.502+0000 7f0ef1c00640 1 -- 172.21.15.17:0/131006982 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0ed4004d00 msgr2=0x7f0eec141950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:10.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.502+0000 7f0ef1c00640 1 --2- 172.21.15.17:0/131006982 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0ed4004d00 0x7f0eec141950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:10.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.502+0000 7f0ef1c00640 1 -- 172.21.15.17:0/131006982 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0eec15c530 msgr2=0x7f0eec13dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:10.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.502+0000 7f0ef1c00640 1 --2- 172.21.15.17:0/131006982 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0eec15c530 0x7f0eec13dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:10.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.502+0000 7f0ef1c00640 1 -- 172.21.15.17:0/131006982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eec13eea0 con 0x7f0eec13e230 2024-03-12T17:20:10.498 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.502+0000 7f0ef1c00640 1 --2- 172.21.15.17:0/131006982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0eec13e230 0x7f0eec13e6b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f0ee402cba0 tx=0x7f0ee4001360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:10.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.503+0000 7f0ee8c00640 1 -- 172.21.15.17:0/131006982 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee4034840 con 0x7f0eec13e230 2024-03-12T17:20:10.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.503+0000 7f0ee8c00640 1 -- 172.21.15.17:0/131006982 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee40349a0 con 0x7f0eec13e230 2024-03-12T17:20:10.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.503+0000 7f0ee8c00640 1 -- 172.21.15.17:0/131006982 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee4034d10 con 0x7f0eec13e230 2024-03-12T17:20:10.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.503+0000 7f0ef2600640 1 -- 172.21.15.17:0/131006982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eec13f180 con 0x7f0eec13e230 2024-03-12T17:20:10.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.503+0000 7f0ef2600640 1 -- 172.21.15.17:0/131006982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eec12eca0 con 0x7f0eec13e230 2024-03-12T17:20:10.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.504+0000 7f0ef2600640 1 -- 172.21.15.17:0/131006982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eec1614e0 con 0x7f0eec13e230 2024-03-12T17:20:10.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.505+0000 7f0ee8c00640 1 -- 172.21.15.17:0/131006982 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f0ee4031030 con 0x7f0eec13e230 2024-03-12T17:20:10.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.506+0000 7f0ee8c00640 1 --2- 172.21.15.17:0/131006982 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f0ecc06ac00 0x7f0ecc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:10.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.506+0000 7f0ee8c00640 1 -- 172.21.15.17:0/131006982 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ee40ab220 con 0x7f0eec13e230 2024-03-12T17:20:10.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.507+0000 7f0ef1200640 1 --2- 172.21.15.17:0/131006982 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f0ecc06ac00 0x7f0ecc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:10.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.507+0000 7f0ef1200640 1 --2- 172.21.15.17:0/131006982 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f0ecc06ac00 0x7f0ecc06d0c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0009a10 tx=0x7f0ee0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:10.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.511+0000 7f0ee8c00640 1 -- 172.21.15.17:0/131006982 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f0ee4079ea0 con 0x7f0eec13e230 2024-03-12T17:20:10.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.757+0000 7f0ef2600640 1 -- 172.21.15.17:0/131006982 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0eec04e030 con 0x7f0eec13e230 2024-03-12T17:20:10.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.758+0000 7f0ee8c00640 1 -- 172.21.15.17:0/131006982 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4728 (secure 0 0 0) 0x7f0ee4001f30 con 0x7f0eec13e230 2024-03-12T17:20:10.753 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:20:10.753 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6834/934570591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":934570591},{"type":"v1","addr":"172.21.15.94:6834","nonce":934570591}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/2007868406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6833","nonce":2007868406},{"type":"v1","addr":"172.21.15.94:6835","nonce":2007868406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4768,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6836/2733057827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2733057827},{"type":"v1","addr":"172.21.15.17:6836","nonce":2733057827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T17:19:55.522204+0000","modified":"2024-03-12T17:19:58.531800+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5058},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5058":{"gid":5058,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6837/672288094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6835","nonce":672288094},{"type":"v1","addr":"172.21.15.17:6837","nonce":672288094}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-03-12T17:20:10.753 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 14 2024-03-12T17:20:10.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.761+0000 7f0ef2600640 1 -- 172.21.15.17:0/131006982 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f0ecc06ac00 msgr2=0x7f0ecc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:10.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.761+0000 7f0ef2600640 1 --2- 172.21.15.17:0/131006982 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f0ecc06ac00 0x7f0ecc06d0c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0009a10 tx=0x7f0ee0008040 comp rx=0 tx=0).stop 2024-03-12T17:20:10.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.761+0000 7f0ef2600640 1 -- 172.21.15.17:0/131006982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0eec13e230 msgr2=0x7f0eec13e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:10.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.761+0000 7f0ef2600640 1 --2- 172.21.15.17:0/131006982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0eec13e230 0x7f0eec13e6b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f0ee402cba0 tx=0x7f0ee4001360 comp rx=0 tx=0).stop 2024-03-12T17:20:10.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.761+0000 7f0ef2600640 1 -- 172.21.15.17:0/131006982 shutdown_connections 2024-03-12T17:20:10.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.761+0000 7f0ef2600640 1 --2- 172.21.15.17:0/131006982 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f0ecc06ac00 0x7f0ecc06d0c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:10.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.761+0000 7f0ef2600640 1 --2- 172.21.15.17:0/131006982 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f0eec13e230 0x7f0eec13e6b0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:10.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.762+0000 7f0ef2600640 1 --2- 172.21.15.17:0/131006982 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f0eec15c530 0x7f0eec13dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:10.756 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.762+0000 7f0ef2600640 1 --2- 172.21.15.17:0/131006982 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f0ed4004d00 0x7f0eec141950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:10.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.762+0000 7f0ef2600640 1 -- 172.21.15.17:0/131006982 >> 172.21.15.17:0/131006982 conn(0x7f0eec069ce0 msgr2=0x7f0eec144f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:10.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.762+0000 7f0ef2600640 1 -- 172.21.15.17:0/131006982 shutdown_connections 2024-03-12T17:20:10.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:10.762+0000 7f0ef2600640 1 -- 172.21.15.17:0/131006982 wait complete. 2024-03-12T17:20:10.778 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T17:20:11.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.048+0000 7f56cf200640 1 Processor -- start 2024-03-12T17:20:11.043 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.049+0000 7f56cf200640 1 -- start start 2024-03-12T17:20:11.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.050+0000 7f56cf200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f56d015ce80 0x7f56d00cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:11.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.050+0000 7f56cf200640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f56d00b85f0 0x7f56d00cf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:11.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.050+0000 7f56cf200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56d0161650 con 0x7f56d015caa0 2024-03-12T17:20:11.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.050+0000 7f56cf200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56d0160ea0 con 0x7f56d015ce80 2024-03-12T17:20:11.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.050+0000 7f56cf200640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56d0161090 con 0x7f56d00b85f0 2024-03-12T17:20:11.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.051+0000 7f56cde00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f56d015caa0 0x7f56d0160790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53596/0 (socket says 172.21.15.17:53596) 2024-03-12T17:20:11.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.051+0000 7f56cde00640 1 -- 172.21.15.17:0/2803369472 learned_addr learned my addr 172.21.15.17:0/2803369472 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:20:11.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.051+0000 7f56c7e00640 1 --2- 172.21.15.17:0/2803369472 >> v2:172.21.15.17:3300/0 conn(0x7f56d015ce80 0x7f56d00cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:11.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.051+0000 7f56ce800640 1 --2- 172.21.15.17:0/2803369472 >> v2:172.21.15.94:3300/0 conn(0x7f56d00b85f0 0x7f56d00cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:11.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.051+0000 7f56c7e00640 1 -- 172.21.15.17:0/2803369472 >> v2:172.21.15.94:3300/0 conn(0x7f56d00b85f0 msgr2=0x7f56d00cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:11.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.051+0000 7f56c7e00640 1 --2- 172.21.15.17:0/2803369472 >> v2:172.21.15.94:3300/0 conn(0x7f56d00b85f0 0x7f56d00cf870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:11.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.051+0000 7f56c7e00640 1 -- 172.21.15.17:0/2803369472 >> v1:172.21.15.17:6789/0 conn(0x7f56d015caa0 legacy=0x7f56d0160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:11.046 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.051+0000 7f56c7e00640 1 -- 172.21.15.17:0/2803369472 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d0161370 con 0x7f56d015ce80 2024-03-12T17:20:11.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.052+0000 7f56c7e00640 1 --2- 172.21.15.17:0/2803369472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56d015ce80 0x7f56d00cf330 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f56d00b59a0 tx=0x7f56b802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38282823c826c34f server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:11.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.053+0000 7f56cd400640 1 -- 172.21.15.17:0/2803369472 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b8031830 con 0x7f56d015ce80 2024-03-12T17:20:11.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.053+0000 7f56cd400640 1 -- 172.21.15.17:0/2803369472 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b8031990 con 0x7f56d015ce80 2024-03-12T17:20:11.047 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.053+0000 7f56cd400640 1 -- 172.21.15.17:0/2803369472 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b8031d20 con 0x7f56d015ce80 2024-03-12T17:20:11.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.053+0000 7f56cf200640 1 -- 172.21.15.17:0/2803369472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56d015ce80 msgr2=0x7f56d00cf330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:11.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.053+0000 7f56cf200640 1 --2- 172.21.15.17:0/2803369472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56d015ce80 0x7f56d00cf330 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f56d00b59a0 tx=0x7f56b802b8d0 comp rx=0 tx=0).stop 2024-03-12T17:20:11.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.053+0000 7f56cf200640 1 -- 172.21.15.17:0/2803369472 shutdown_connections 2024-03-12T17:20:11.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.053+0000 7f56cf200640 1 --2- 172.21.15.17:0/2803369472 >> v2:172.21.15.94:3300/0 conn(0x7f56d00b85f0 0x7f56d00cf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:11.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.053+0000 7f56cf200640 1 --2- 172.21.15.17:0/2803369472 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56d015ce80 0x7f56d00cf330 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:11.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.053+0000 7f56cf200640 1 -- 172.21.15.17:0/2803369472 >> 172.21.15.17:0/2803369472 conn(0x7f56d006b160 msgr2=0x7f56d006b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:11.048 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.054+0000 7f56cf200640 1 -- 172.21.15.17:0/2803369472 shutdown_connections 2024-03-12T17:20:11.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.054+0000 7f56cf200640 1 -- 172.21.15.17:0/2803369472 wait complete. 2024-03-12T17:20:11.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.055+0000 7f56cf200640 1 Processor -- start 2024-03-12T17:20:11.049 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.056+0000 7f56cf200640 1 -- start start 2024-03-12T17:20:11.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.056+0000 7f56cf200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f56d00b85f0 0x7f56d015adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:11.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.056+0000 7f56cf200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56d015caa0 0x7f56d00b3640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:11.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.057+0000 7f56cf200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56d015ce80 0x7f56d00b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:11.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.057+0000 7f56cf200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d01f26e0 con 0x7f56d015caa0 2024-03-12T17:20:11.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.057+0000 7f56cf200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d00c72b0 con 0x7f56d015ce80 2024-03-12T17:20:11.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.057+0000 7f56cf200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d00c6450 con 0x7f56d00b85f0 2024-03-12T17:20:11.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.057+0000 7f56c7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56d015caa0 0x7f56d00b3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:11.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.057+0000 7f56c7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56d015caa0 0x7f56d00b3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48106/0 (socket says 172.21.15.17:48106) 2024-03-12T17:20:11.051 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.057+0000 7f56c7e00640 1 -- 172.21.15.17:0/1837095422 learned_addr learned my addr 172.21.15.17:0/1837095422 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:11.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.057+0000 7f56ce800640 1 --2- 172.21.15.17:0/1837095422 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56d015ce80 0x7f56d00b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:11.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.057+0000 7f56cde00640 1 --2- 172.21.15.17:0/1837095422 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f56d00b85f0 0x7f56d015adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:11.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.057+0000 7f56c7e00640 1 -- 172.21.15.17:0/1837095422 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f56d00b85f0 msgr2=0x7f56d015adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:11.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.057+0000 7f56c7e00640 1 --2- 172.21.15.17:0/1837095422 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f56d00b85f0 0x7f56d015adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:11.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.057+0000 7f56c7e00640 1 -- 172.21.15.17:0/1837095422 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56d015ce80 msgr2=0x7f56d00b3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:11.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.057+0000 7f56c7e00640 1 --2- 172.21.15.17:0/1837095422 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56d015ce80 0x7f56d00b3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:11.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.057+0000 7f56c7e00640 1 -- 172.21.15.17:0/1837095422 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b8009400 con 0x7f56d015caa0 2024-03-12T17:20:11.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.057+0000 7f56ce800640 1 --2- 172.21.15.17:0/1837095422 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56d015ce80 0x7f56d00b3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:11.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.057+0000 7f56cde00640 1 --2- 172.21.15.17:0/1837095422 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f56d00b85f0 0x7f56d015adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:11.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.058+0000 7f56c7e00640 1 --2- 172.21.15.17:0/1837095422 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56d015caa0 0x7f56d00b3640 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f56b8000c00 tx=0x7f56b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:11.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.058+0000 7f56c6000640 1 -- 172.21.15.17:0/1837095422 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b803aa60 con 0x7f56d015caa0 2024-03-12T17:20:11.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.058+0000 7f56c6000640 1 -- 172.21.15.17:0/1837095422 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b803abe0 con 0x7f56d015caa0 2024-03-12T17:20:11.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.058+0000 7f56cf200640 1 -- 172.21.15.17:0/1837095422 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56d00c6730 con 0x7f56d015caa0 2024-03-12T17:20:11.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.058+0000 7f56c6000640 1 -- 172.21.15.17:0/1837095422 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b80443f0 con 0x7f56d015caa0 2024-03-12T17:20:11.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.058+0000 7f56cf200640 1 -- 172.21.15.17:0/1837095422 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d00c6cf0 con 0x7f56d015caa0 2024-03-12T17:20:11.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.060+0000 7f56cf200640 1 -- 172.21.15.17:0/1837095422 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56d0072360 con 0x7f56d015caa0 2024-03-12T17:20:11.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.061+0000 7f56c6000640 1 -- 172.21.15.17:0/1837095422 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f56b804d450 con 0x7f56d015caa0 2024-03-12T17:20:11.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.062+0000 7f56c6000640 1 --2- 172.21.15.17:0/1837095422 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f56ac06ac00 0x7f56ac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:11.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.062+0000 7f56c6000640 1 -- 172.21.15.17:0/1837095422 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f56b80ab550 con 0x7f56d015caa0 2024-03-12T17:20:11.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.062+0000 7f56cde00640 1 --2- 172.21.15.17:0/1837095422 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f56ac06ac00 0x7f56ac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:11.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.063+0000 7f56cde00640 1 --2- 172.21.15.17:0/1837095422 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f56ac06ac00 0x7f56ac06d0c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f56c0005880 tx=0x7f56c0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:11.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.066+0000 7f56c6000640 1 -- 172.21.15.17:0/1837095422 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f56b80767b0 con 0x7f56d015caa0 2024-03-12T17:20:11.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.267+0000 7f56cf200640 1 -- 172.21.15.17:0/1837095422 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56d004e030 con 0x7f56d015caa0 2024-03-12T17:20:11.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.271+0000 7f56c6000640 1 -- 172.21.15.17:0/1837095422 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16053 (secure 0 0 0) 0x7f56b8035090 con 0x7f56d015caa0 2024-03-12T17:20:11.265 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:20:11.265 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":35,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:19:56.525877+0000","last_up_change":"2024-03-12T17:18:38.144756+0000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-12T17:18:39.552910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-12T17:19:53.519967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-12T17:19:54.546388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":37305},{"type":"v1","addr":"172.21.15.17:6801","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":37305},{"type":"v1","addr":"172.21.15.17:6803","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":37305},{"type":"v1","addr":"172.21.15.17:6807","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":37305},{"type":"v1","addr":"172.21.15.17:6805","nonce":37305}]},"public_addr":"172.21.15.17:6801/37305","cluster_addr":"172.21.15.17:6803/37305","heartbeat_back_addr":"172.21.15.17:6807/37305","heartbeat_front_addr":"172.21.15.17:6805/37305","state":["exists","up"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":37307},{"type":"v1","addr":"172.21.15.17:6814","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":37307},{"type":"v1","addr":"172.21.15.17:6818","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":37307},{"type":"v1","addr":"172.21.15.17:6827","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":37307},{"type":"v1","addr":"172.21.15.17:6823","nonce":37307}]},"public_addr":"172.21.15.17:6814/37307","cluster_addr":"172.21.15.17:6818/37307","heartbeat_back_addr":"172.21.15.17:6827/37307","heartbeat_front_addr":"172.21.15.17:6823/37307","state":["exists","up"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":37303},{"type":"v1","addr":"172.21.15.17:6809","nonce":37303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":37303},{"type":"v1","addr":"172.21.15.17:6811","nonce":37303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":37303},{"type":"v1","addr":"172.21.15.17:6819","nonce":37303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":37303},{"type":"v1","addr":"172.21.15.17:6815","nonce":37303}]},"public_addr":"172.21.15.17:6809/37303","cluster_addr":"172.21.15.17:6811/37303","heartbeat_back_addr":"172.21.15.17:6819/37303","heartbeat_front_addr":"172.21.15.17:6815/37303","state":["exists","up"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":37308},{"type":"v1","addr":"172.21.15.17:6822","nonce":37308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":37308},{"type":"v1","addr":"172.21.15.17:6826","nonce":37308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":37308},{"type":"v1","addr":"172.21.15.17:6831","nonce":37308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":37308},{"type":"v1","addr":"172.21.15.17:6829","nonce":37308}]},"public_addr":"172.21.15.17:6822/37308","cluster_addr":"172.21.15.17:6826/37308","heartbeat_back_addr":"172.21.15.17:6831/37308","heartbeat_front_addr":"172.21.15.17:6829/37308","state":["exists","up"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":37465},{"type":"v1","addr":"172.21.15.94:6809","nonce":37465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6811","nonce":37465},{"type":"v1","addr":"172.21.15.94:6813","nonce":37465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6819","nonce":37465},{"type":"v1","addr":"172.21.15.94:6822","nonce":37465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6815","nonce":37465},{"type":"v1","addr":"172.21.15.94:6817","nonce":37465}]},"public_addr":"172.21.15.94:6809/37465","cluster_addr":"172.21.15.94:6813/37465","heartbeat_back_addr":"172.21.15.94:6822/37465","heartbeat_front_addr":"172.21.15.94:6817/37465","state":["exists","up"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":37464},{"type":"v1","addr":"172.21.15.94:6812","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":37464},{"type":"v1","addr":"172.21.15.94:6816","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":37464},{"type":"v1","addr":"172.21.15.94:6823","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":37464},{"type":"v1","addr":"172.21.15.94:6820","nonce":37464}]},"public_addr":"172.21.15.94:6812/37464","cluster_addr":"172.21.15.94:6816/37464","heartbeat_back_addr":"172.21.15.94:6823/37464","heartbeat_front_addr":"172.21.15.94:6820/37464","state":["exists","up"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":37467},{"type":"v1","addr":"172.21.15.94:6825","nonce":37467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":37467},{"type":"v1","addr":"172.21.15.94:6827","nonce":37467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":37467},{"type":"v1","addr":"172.21.15.94:6831","nonce":37467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":37467},{"type":"v1","addr":"172.21.15.94:6829","nonce":37467}]},"public_addr":"172.21.15.94:6825/37467","cluster_addr":"172.21.15.94:6827/37467","heartbeat_back_addr":"172.21.15.94:6831/37467","heartbeat_front_addr":"172.21.15.94:6829/37467","state":["exists","up"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":37466},{"type":"v1","addr":"172.21.15.94:6801","nonce":37466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":37466},{"type":"v1","addr":"172.21.15.94:6803","nonce":37466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":37466},{"type":"v1","addr":"172.21.15.94:6807","nonce":37466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":37466},{"type":"v1","addr":"172.21.15.94:6805","nonce":37466}]},"public_addr":"172.21.15.94:6801/37466","cluster_addr":"172.21.15.94:6803/37466","heartbeat_back_addr":"172.21.15.94:6807/37466","heartbeat_front_addr":"172.21.15.94:6805/37466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.327217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.186966+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.419986+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.150585+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.120621+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.121576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.181257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.293188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:20:11.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.274+0000 7f56cf200640 1 -- 172.21.15.17:0/1837095422 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f56ac06ac00 msgr2=0x7f56ac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:11.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.274+0000 7f56cf200640 1 --2- 172.21.15.17:0/1837095422 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f56ac06ac00 0x7f56ac06d0c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f56c0005880 tx=0x7f56c0009040 comp rx=0 tx=0).stop 2024-03-12T17:20:11.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.274+0000 7f56cf200640 1 -- 172.21.15.17:0/1837095422 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56d015caa0 msgr2=0x7f56d00b3640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:11.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.274+0000 7f56cf200640 1 --2- 172.21.15.17:0/1837095422 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56d015caa0 0x7f56d00b3640 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f56b8000c00 tx=0x7f56b80046c0 comp rx=0 tx=0).stop 2024-03-12T17:20:11.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.274+0000 7f56cf200640 1 -- 172.21.15.17:0/1837095422 shutdown_connections 2024-03-12T17:20:11.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.274+0000 7f56cf200640 1 --2- 172.21.15.17:0/1837095422 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f56ac06ac00 0x7f56ac06d0c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:11.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.274+0000 7f56cf200640 1 --2- 172.21.15.17:0/1837095422 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f56d015ce80 0x7f56d00b3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:11.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.274+0000 7f56cf200640 1 --2- 172.21.15.17:0/1837095422 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f56d015caa0 0x7f56d00b3640 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:11.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.274+0000 7f56cf200640 1 --2- 172.21.15.17:0/1837095422 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f56d00b85f0 0x7f56d015adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:11.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.274+0000 7f56cf200640 1 -- 172.21.15.17:0/1837095422 >> 172.21.15.17:0/1837095422 conn(0x7f56d006b160 msgr2=0x7f56d015be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:11.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.274+0000 7f56cf200640 1 -- 172.21.15.17:0/1837095422 shutdown_connections 2024-03-12T17:20:11.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.274+0000 7f56cf200640 1 -- 172.21.15.17:0/1837095422 wait complete. 2024-03-12T17:20:11.286 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-12T17:18:39.552910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-12T17:19:53.519967+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-12T17:19:54.546388+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-12T17:20:11.287 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-12T17:20:11.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.516+0000 7f399be00640 1 Processor -- start 2024-03-12T17:20:11.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.516+0000 7f399be00640 1 -- start start 2024-03-12T17:20:11.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.518+0000 7f399be00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3994144240 0x7f39940ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:11.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.518+0000 7f399be00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f39940cecf0 0x7f39940b2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:11.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.518+0000 7f399be00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39940ce320 con 0x7f39940b25b0 2024-03-12T17:20:11.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.518+0000 7f399be00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3994144620 con 0x7f39940cecf0 2024-03-12T17:20:11.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.518+0000 7f399be00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f399415f3d0 con 0x7f3994144240 2024-03-12T17:20:11.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.519+0000 7f3999400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3994144240 0x7f39940ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:11.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.519+0000 7f3999e00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f39940b25b0 0x7f39940cb970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.17:46206/0 (socket says 172.21.15.17:46206) 2024-03-12T17:20:11.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.519+0000 7f3999e00640 1 -- 172.21.15.17:0/2550922713 learned_addr learned my addr 172.21.15.17:0/2550922713 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:20:11.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.519+0000 7f3998a00640 1 --2- 172.21.15.17:0/2550922713 >> v2:172.21.15.94:3300/0 conn(0x7f39940cecf0 0x7f39940b2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:11.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.519+0000 7f3993e00640 1 -- 172.21.15.17:0/2550922713 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3681018461 0 0) 0x7f39940ce320 con 0x7f39940b25b0 2024-03-12T17:20:11.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.519+0000 7f3993e00640 1 -- 172.21.15.17:0/2550922713 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f397c003520 con 0x7f39940b25b0 2024-03-12T17:20:11.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.520+0000 7f3998a00640 1 -- 172.21.15.17:0/2550922713 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3994144240 msgr2=0x7f39940ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:11.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.520+0000 7f3998a00640 1 --2- 172.21.15.17:0/2550922713 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3994144240 0x7f39940ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:11.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.520+0000 7f3998a00640 1 -- 172.21.15.17:0/2550922713 >> v1:172.21.15.94:6789/0 conn(0x7f39940b25b0 legacy=0x7f39940cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:11.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.520+0000 7f3998a00640 1 -- 172.21.15.17:0/2550922713 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39940cd9f0 con 0x7f39940cecf0 2024-03-12T17:20:11.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.521+0000 7f3998a00640 1 --2- 172.21.15.17:0/2550922713 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39940cecf0 0x7f39940b2070 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f39800097d0 tx=0x7f398002b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=932cea4f86e4cbfd server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:11.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.522+0000 7f3993e00640 1 -- 172.21.15.17:0/2550922713 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3980031800 con 0x7f39940cecf0 2024-03-12T17:20:11.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.522+0000 7f3993e00640 1 -- 172.21.15.17:0/2550922713 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3980031960 con 0x7f39940cecf0 2024-03-12T17:20:11.516 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.522+0000 7f3993e00640 1 -- 172.21.15.17:0/2550922713 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3980031cf0 con 0x7f39940cecf0 2024-03-12T17:20:11.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.522+0000 7f399be00640 1 -- 172.21.15.17:0/2550922713 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39940cecf0 msgr2=0x7f39940b2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:11.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.522+0000 7f399be00640 1 --2- 172.21.15.17:0/2550922713 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39940cecf0 0x7f39940b2070 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f39800097d0 tx=0x7f398002b8a0 comp rx=0 tx=0).stop 2024-03-12T17:20:11.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.522+0000 7f399be00640 1 -- 172.21.15.17:0/2550922713 shutdown_connections 2024-03-12T17:20:11.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.522+0000 7f399be00640 1 --2- 172.21.15.17:0/2550922713 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39940cecf0 0x7f39940b2070 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:11.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.522+0000 7f399be00640 1 --2- 172.21.15.17:0/2550922713 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3994144240 0x7f39940ce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:11.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.522+0000 7f399be00640 1 -- 172.21.15.17:0/2550922713 >> 172.21.15.17:0/2550922713 conn(0x7f3994069ce0 msgr2=0x7f399406a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:11.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.523+0000 7f399be00640 1 -- 172.21.15.17:0/2550922713 shutdown_connections 2024-03-12T17:20:11.517 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.523+0000 7f399be00640 1 -- 172.21.15.17:0/2550922713 wait complete. 2024-03-12T17:20:11.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.524+0000 7f399be00640 1 Processor -- start 2024-03-12T17:20:11.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.525+0000 7f399be00640 1 -- start start 2024-03-12T17:20:11.520 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.525+0000 7f399be00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39940b25b0 0x7f39940c42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:11.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.525+0000 7f399be00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f39940cecf0 0x7f3994140270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:11.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.526+0000 7f399be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3994144240 0x7f399406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:11.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.526+0000 7f399be00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39941f6590 con 0x7f3994144240 2024-03-12T17:20:11.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.526+0000 7f399be00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39941f62b0 con 0x7f39940b25b0 2024-03-12T17:20:11.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.526+0000 7f399be00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39940c3800 con 0x7f39940cecf0 2024-03-12T17:20:11.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.526+0000 7f3999e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3994144240 0x7f399406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:11.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.526+0000 7f3999e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3994144240 0x7f399406d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48118/0 (socket says 172.21.15.17:48118) 2024-03-12T17:20:11.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.526+0000 7f3999e00640 1 -- 172.21.15.17:0/347368409 learned_addr learned my addr 172.21.15.17:0/347368409 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:11.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.526+0000 7f3998a00640 1 --2- 172.21.15.17:0/347368409 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f39940cecf0 0x7f3994140270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:11.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.526+0000 7f3999400640 1 --2- 172.21.15.17:0/347368409 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39940b25b0 0x7f39940c42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:11.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.526+0000 7f3999e00640 1 -- 172.21.15.17:0/347368409 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f39940cecf0 msgr2=0x7f3994140270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:11.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.526+0000 7f3999e00640 1 --2- 172.21.15.17:0/347368409 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f39940cecf0 0x7f3994140270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:11.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.526+0000 7f3999e00640 1 -- 172.21.15.17:0/347368409 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39940b25b0 msgr2=0x7f39940c42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:11.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.526+0000 7f3999e00640 1 --2- 172.21.15.17:0/347368409 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39940b25b0 0x7f39940c42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:11.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.526+0000 7f3999e00640 1 -- 172.21.15.17:0/347368409 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3980009400 con 0x7f3994144240 2024-03-12T17:20:11.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.527+0000 7f3999e00640 1 --2- 172.21.15.17:0/347368409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3994144240 0x7f399406d7b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f398c00cb40 tx=0x7f398c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:11.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.527+0000 7f3991600640 1 -- 172.21.15.17:0/347368409 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398c00aca0 con 0x7f3994144240 2024-03-12T17:20:11.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.527+0000 7f3991600640 1 -- 172.21.15.17:0/347368409 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398c00ae00 con 0x7f3994144240 2024-03-12T17:20:11.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.527+0000 7f399be00640 1 -- 172.21.15.17:0/347368409 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39940c3ae0 con 0x7f3994144240 2024-03-12T17:20:11.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.527+0000 7f3991600640 1 -- 172.21.15.17:0/347368409 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398c012620 con 0x7f3994144240 2024-03-12T17:20:11.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.527+0000 7f399be00640 1 -- 172.21.15.17:0/347368409 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39941407b0 con 0x7f3994144240 2024-03-12T17:20:11.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.528+0000 7f399be00640 1 -- 172.21.15.17:0/347368409 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39940c4000 con 0x7f3994144240 2024-03-12T17:20:11.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.529+0000 7f3991600640 1 -- 172.21.15.17:0/347368409 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f398c007070 con 0x7f3994144240 2024-03-12T17:20:11.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.530+0000 7f3991600640 1 --2- 172.21.15.17:0/347368409 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f397406ac00 0x7f397406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:11.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.530+0000 7f3991600640 1 -- 172.21.15.17:0/347368409 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f398c0893e0 con 0x7f3994144240 2024-03-12T17:20:11.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.530+0000 7f3999400640 1 --2- 172.21.15.17:0/347368409 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f397406ac00 0x7f397406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:11.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.531+0000 7f3999400640 1 --2- 172.21.15.17:0/347368409 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f397406ac00 0x7f397406d0c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3988009a30 tx=0x7f3988008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:11.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.535+0000 7f3991600640 1 -- 172.21.15.17:0/347368409 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f39940c4000 con 0x7f3994144240 2024-03-12T17:20:11.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.736+0000 7f399be00640 1 -- 172.21.15.17:0/347368409 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f39940c4000 con 0x7f3994144240 2024-03-12T17:20:11.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.737+0000 7f3991600640 1 -- 172.21.15.17:0/347368409 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f39940c4000 con 0x7f3994144240 2024-03-12T17:20:11.731 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-03-12T17:20:11.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.740+0000 7f399be00640 1 -- 172.21.15.17:0/347368409 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f397406ac00 msgr2=0x7f397406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:11.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.740+0000 7f399be00640 1 --2- 172.21.15.17:0/347368409 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f397406ac00 0x7f397406d0c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3988009a30 tx=0x7f3988008040 comp rx=0 tx=0).stop 2024-03-12T17:20:11.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.740+0000 7f399be00640 1 -- 172.21.15.17:0/347368409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3994144240 msgr2=0x7f399406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:11.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.740+0000 7f399be00640 1 --2- 172.21.15.17:0/347368409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3994144240 0x7f399406d7b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f398c00cb40 tx=0x7f398c00a060 comp rx=0 tx=0).stop 2024-03-12T17:20:11.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.740+0000 7f399be00640 1 -- 172.21.15.17:0/347368409 shutdown_connections 2024-03-12T17:20:11.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.740+0000 7f399be00640 1 --2- 172.21.15.17:0/347368409 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f397406ac00 0x7f397406d0c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:11.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.740+0000 7f399be00640 1 --2- 172.21.15.17:0/347368409 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3994144240 0x7f399406d7b0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:11.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.740+0000 7f399be00640 1 --2- 172.21.15.17:0/347368409 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f39940cecf0 0x7f3994140270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:11.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.740+0000 7f399be00640 1 --2- 172.21.15.17:0/347368409 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f39940b25b0 0x7f39940c42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:11.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.740+0000 7f399be00640 1 -- 172.21.15.17:0/347368409 >> 172.21.15.17:0/347368409 conn(0x7f3994069ce0 msgr2=0x7f39941434e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:11.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.740+0000 7f399be00640 1 -- 172.21.15.17:0/347368409 shutdown_connections 2024-03-12T17:20:11.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.740+0000 7f399be00640 1 -- 172.21.15.17:0/347368409 wait complete. 2024-03-12T17:20:11.753 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-12T17:20:11.982 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.988+0000 7fbd6b200640 1 Processor -- start 2024-03-12T17:20:11.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.988+0000 7fbd6b200640 1 -- start start 2024-03-12T17:20:11.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.990+0000 7fbd6b200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbd6c0ccea0 0x7fbd6c13fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:11.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.990+0000 7fbd6b200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbd6c1403a0 0x7fbd6c140850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:11.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.990+0000 7fbd6b200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd6c15bd70 con 0x7fbd6c070ba0 2024-03-12T17:20:11.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.990+0000 7fbd6b200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd6c140e80 con 0x7fbd6c0ccea0 2024-03-12T17:20:11.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.990+0000 7fbd6b200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c15adc0 con 0x7fbd6c1403a0 2024-03-12T17:20:11.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.990+0000 7fbd69400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbd6c0ccea0 0x7fbd6c13fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:11.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.990+0000 7fbd69400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fbd6c0ccea0 0x7fbd6c13fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55368/0 (socket says 172.21.15.17:55368) 2024-03-12T17:20:11.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.990+0000 7fbd69400640 1 -- 172.21.15.17:0/2837463961 learned_addr learned my addr 172.21.15.17:0/2837463961 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:11.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.990+0000 7fbd6a800640 1 --2- 172.21.15.17:0/2837463961 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbd6c1403a0 0x7fbd6c140850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:11.985 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.991+0000 7fbd69400640 1 -- 172.21.15.17:0/2837463961 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbd6c1403a0 msgr2=0x7fbd6c140850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:11.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.991+0000 7fbd69400640 1 --2- 172.21.15.17:0/2837463961 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbd6c1403a0 0x7fbd6c140850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:11.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.991+0000 7fbd69400640 1 -- 172.21.15.17:0/2837463961 >> v1:172.21.15.94:6789/0 conn(0x7fbd6c070ba0 legacy=0x7fbd6c0cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:11.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.991+0000 7fbd69400640 1 -- 172.21.15.17:0/2837463961 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd6c070f80 con 0x7fbd6c0ccea0 2024-03-12T17:20:11.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.992+0000 7fbd69400640 1 --2- 172.21.15.17:0/2837463961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd6c0ccea0 0x7fbd6c13fe60 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbd58009870 tx=0x7fbd5802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca7f42d0a7fd61f8 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:11.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.992+0000 7fbd68a00640 1 -- 172.21.15.17:0/2837463961 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd58031640 con 0x7fbd6c0ccea0 2024-03-12T17:20:11.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.992+0000 7fbd68a00640 1 -- 172.21.15.17:0/2837463961 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd580317a0 con 0x7fbd6c0ccea0 2024-03-12T17:20:11.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.992+0000 7fbd68a00640 1 -- 172.21.15.17:0/2837463961 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd58031b30 con 0x7fbd6c0ccea0 2024-03-12T17:20:11.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.993+0000 7fbd6b200640 1 -- 172.21.15.17:0/2837463961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd6c0ccea0 msgr2=0x7fbd6c13fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:11.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.993+0000 7fbd6b200640 1 --2- 172.21.15.17:0/2837463961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd6c0ccea0 0x7fbd6c13fe60 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbd58009870 tx=0x7fbd5802b8f0 comp rx=0 tx=0).stop 2024-03-12T17:20:11.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.993+0000 7fbd6b200640 1 -- 172.21.15.17:0/2837463961 shutdown_connections 2024-03-12T17:20:11.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.993+0000 7fbd6b200640 1 --2- 172.21.15.17:0/2837463961 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbd6c1403a0 0x7fbd6c140850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:11.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.993+0000 7fbd6b200640 1 --2- 172.21.15.17:0/2837463961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd6c0ccea0 0x7fbd6c13fe60 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:11.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.993+0000 7fbd6b200640 1 -- 172.21.15.17:0/2837463961 >> 172.21.15.17:0/2837463961 conn(0x7fbd6c066000 msgr2=0x7fbd6c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:11.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.993+0000 7fbd6b200640 1 -- 172.21.15.17:0/2837463961 shutdown_connections 2024-03-12T17:20:11.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.993+0000 7fbd6b200640 1 -- 172.21.15.17:0/2837463961 wait complete. 2024-03-12T17:20:11.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.995+0000 7fbd6b200640 1 Processor -- start 2024-03-12T17:20:11.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.995+0000 7fbd6b200640 1 -- start start 2024-03-12T17:20:11.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.996+0000 7fbd6b200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd6c070ba0 0x7fbd6c151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:11.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.996+0000 7fbd6b200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbd6c0ccea0 0x7fbd6c13c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:11.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.996+0000 7fbd6b200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd6c1403a0 0x7fbd6c137cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:11.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.996+0000 7fbd6b200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c13f370 con 0x7fbd6c1403a0 2024-03-12T17:20:11.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.996+0000 7fbd6b200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c13e760 con 0x7fbd6c070ba0 2024-03-12T17:20:11.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.996+0000 7fbd6b200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6c13ea40 con 0x7fbd6c0ccea0 2024-03-12T17:20:11.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.996+0000 7fbd6a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd6c1403a0 0x7fbd6c137cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:11.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.996+0000 7fbd6a800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd6c1403a0 0x7fbd6c137cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55376/0 (socket says 172.21.15.17:55376) 2024-03-12T17:20:11.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.996+0000 7fbd6a800640 1 -- 172.21.15.17:0/4058155016 learned_addr learned my addr 172.21.15.17:0/4058155016 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:11.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.996+0000 7fbd69400640 1 --2- 172.21.15.17:0/4058155016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbd6c0ccea0 0x7fbd6c13c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:11.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.997+0000 7fbd6a800640 1 -- 172.21.15.17:0/4058155016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbd6c0ccea0 msgr2=0x7fbd6c13c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:11.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.997+0000 7fbd69e00640 1 --2- 172.21.15.17:0/4058155016 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd6c070ba0 0x7fbd6c151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:11.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.997+0000 7fbd6a800640 1 --2- 172.21.15.17:0/4058155016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbd6c0ccea0 0x7fbd6c13c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:11.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.997+0000 7fbd6a800640 1 -- 172.21.15.17:0/4058155016 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd6c070ba0 msgr2=0x7fbd6c151020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:11.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.997+0000 7fbd6a800640 1 --2- 172.21.15.17:0/4058155016 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd6c070ba0 0x7fbd6c151020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:11.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.997+0000 7fbd6a800640 1 -- 172.21.15.17:0/4058155016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd580094d0 con 0x7fbd6c1403a0 2024-03-12T17:20:11.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.997+0000 7fbd69e00640 1 --2- 172.21.15.17:0/4058155016 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd6c070ba0 0x7fbd6c151020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:11.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.997+0000 7fbd69400640 1 --2- 172.21.15.17:0/4058155016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbd6c0ccea0 0x7fbd6c13c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:11.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.997+0000 7fbd6a800640 1 --2- 172.21.15.17:0/4058155016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd6c1403a0 0x7fbd6c137cd0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fbd6400cc30 tx=0x7fbd6400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:11.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.997+0000 7fbd62000640 1 -- 172.21.15.17:0/4058155016 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6400ce40 con 0x7fbd6c1403a0 2024-03-12T17:20:11.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.997+0000 7fbd62000640 1 -- 172.21.15.17:0/4058155016 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd64003990 con 0x7fbd6c1403a0 2024-03-12T17:20:11.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.997+0000 7fbd62000640 1 -- 172.21.15.17:0/4058155016 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd64003d20 con 0x7fbd6c1403a0 2024-03-12T17:20:11.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.997+0000 7fbd6b200640 1 -- 172.21.15.17:0/4058155016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd6c13ed20 con 0x7fbd6c1403a0 2024-03-12T17:20:11.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.997+0000 7fbd6b200640 1 -- 172.21.15.17:0/4058155016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd6c151560 con 0x7fbd6c1403a0 2024-03-12T17:20:11.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:11.998+0000 7fbd6b200640 1 -- 172.21.15.17:0/4058155016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd6c13f4e0 con 0x7fbd6c1403a0 2024-03-12T17:20:11.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.000+0000 7fbd62000640 1 -- 172.21.15.17:0/4058155016 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fbd64003e80 con 0x7fbd6c1403a0 2024-03-12T17:20:11.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.000+0000 7fbd62000640 1 --2- 172.21.15.17:0/4058155016 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fbd4c06ac00 0x7fbd4c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:11.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.001+0000 7fbd62000640 1 -- 172.21.15.17:0/4058155016 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbd640897c0 con 0x7fbd6c1403a0 2024-03-12T17:20:11.995 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.001+0000 7fbd69e00640 1 --2- 172.21.15.17:0/4058155016 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fbd4c06ac00 0x7fbd4c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:11.996 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.002+0000 7fbd69e00640 1 --2- 172.21.15.17:0/4058155016 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fbd4c06ac00 0x7fbd4c06d0c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c003eb0 tx=0x7fbd5c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:12.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.005+0000 7fbd62000640 1 -- 172.21.15.17:0/4058155016 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fbd64054900 con 0x7fbd6c1403a0 2024-03-12T17:20:12.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.202+0000 7fbd6b200640 1 -- 172.21.15.17:0/4058155016 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbd6c04e030 con 0x7fbd6c1403a0 2024-03-12T17:20:12.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.203+0000 7fbd62000640 1 -- 172.21.15.17:0/4058155016 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbd6401d0a0 con 0x7fbd6c1403a0 2024-03-12T17:20:12.197 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-03-12T17:20:12.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.205+0000 7fbd6b200640 1 -- 172.21.15.17:0/4058155016 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fbd4c06ac00 msgr2=0x7fbd4c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:12.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.205+0000 7fbd6b200640 1 --2- 172.21.15.17:0/4058155016 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fbd4c06ac00 0x7fbd4c06d0c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c003eb0 tx=0x7fbd5c009040 comp rx=0 tx=0).stop 2024-03-12T17:20:12.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.205+0000 7fbd6b200640 1 -- 172.21.15.17:0/4058155016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd6c1403a0 msgr2=0x7fbd6c137cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:12.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.205+0000 7fbd6b200640 1 --2- 172.21.15.17:0/4058155016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd6c1403a0 0x7fbd6c137cd0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fbd6400cc30 tx=0x7fbd6400a5c0 comp rx=0 tx=0).stop 2024-03-12T17:20:12.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.206+0000 7fbd6b200640 1 -- 172.21.15.17:0/4058155016 shutdown_connections 2024-03-12T17:20:12.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.206+0000 7fbd6b200640 1 --2- 172.21.15.17:0/4058155016 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fbd4c06ac00 0x7fbd4c06d0c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:12.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.206+0000 7fbd6b200640 1 --2- 172.21.15.17:0/4058155016 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbd6c1403a0 0x7fbd6c137cd0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:12.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.206+0000 7fbd6b200640 1 --2- 172.21.15.17:0/4058155016 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbd6c0ccea0 0x7fbd6c13c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:12.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.206+0000 7fbd6b200640 1 --2- 172.21.15.17:0/4058155016 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbd6c070ba0 0x7fbd6c151020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:12.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.206+0000 7fbd6b200640 1 -- 172.21.15.17:0/4058155016 >> 172.21.15.17:0/4058155016 conn(0x7fbd6c066000 msgr2=0x7fbd6c1390d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:12.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.206+0000 7fbd6b200640 1 -- 172.21.15.17:0/4058155016 shutdown_connections 2024-03-12T17:20:12.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.206+0000 7fbd6b200640 1 -- 172.21.15.17:0/4058155016 wait complete. 2024-03-12T17:20:12.219 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-12T17:20:12.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.455+0000 7fd893200640 1 Processor -- start 2024-03-12T17:20:12.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.455+0000 7fd893200640 1 -- start start 2024-03-12T17:20:12.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.456+0000 7fd893200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd8940cf460 0x7fd8940cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:12.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.457+0000 7fd893200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd8940ce430 0x7fd8940ac640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:12.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.457+0000 7fd893200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd89415d060 con 0x7fd89415cc80 2024-03-12T17:20:12.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.457+0000 7fd893200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd89406f250 con 0x7fd8940ce430 2024-03-12T17:20:12.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.457+0000 7fd893200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8940ce8c0 con 0x7fd8940cf460 2024-03-12T17:20:12.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.457+0000 7fd892800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd8940ce430 0x7fd8940ac640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:12.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.457+0000 7fd892800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd8940ce430 0x7fd8940ac640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55380/0 (socket says 172.21.15.17:55380) 2024-03-12T17:20:12.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.457+0000 7fd892800640 1 -- 172.21.15.17:0/3386028255 learned_addr learned my addr 172.21.15.17:0/3386028255 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:12.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.457+0000 7fd891400640 1 --2- 172.21.15.17:0/3386028255 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd8940cf460 0x7fd8940cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:12.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.457+0000 7fd892800640 1 -- 172.21.15.17:0/3386028255 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd8940cf460 msgr2=0x7fd8940cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:12.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.457+0000 7fd892800640 1 --2- 172.21.15.17:0/3386028255 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd8940cf460 0x7fd8940cdef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:12.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.457+0000 7fd892800640 1 -- 172.21.15.17:0/3386028255 >> v1:172.21.15.94:6789/0 conn(0x7fd89415cc80 legacy=0x7fd89406dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:12.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.457+0000 7fd892800640 1 -- 172.21.15.17:0/3386028255 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89406e5d0 con 0x7fd8940ce430 2024-03-12T17:20:12.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.459+0000 7fd892800640 1 --2- 172.21.15.17:0/3386028255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8940ce430 0x7fd8940ac640 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fd88c009e80 tx=0x7fd88c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e505d86db1745535 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:12.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.459+0000 7fd890a00640 1 -- 172.21.15.17:0/3386028255 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c02ca50 con 0x7fd8940ce430 2024-03-12T17:20:12.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.459+0000 7fd890a00640 1 -- 172.21.15.17:0/3386028255 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd88c02cbb0 con 0x7fd8940ce430 2024-03-12T17:20:12.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.459+0000 7fd890a00640 1 -- 172.21.15.17:0/3386028255 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c0343f0 con 0x7fd8940ce430 2024-03-12T17:20:12.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.460+0000 7fd893200640 1 -- 172.21.15.17:0/3386028255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8940ce430 msgr2=0x7fd8940ac640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:12.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.460+0000 7fd893200640 1 --2- 172.21.15.17:0/3386028255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8940ce430 0x7fd8940ac640 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fd88c009e80 tx=0x7fd88c02beb0 comp rx=0 tx=0).stop 2024-03-12T17:20:12.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.460+0000 7fd893200640 1 -- 172.21.15.17:0/3386028255 shutdown_connections 2024-03-12T17:20:12.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.460+0000 7fd893200640 1 --2- 172.21.15.17:0/3386028255 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8940ce430 0x7fd8940ac640 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:12.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.460+0000 7fd893200640 1 --2- 172.21.15.17:0/3386028255 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd8940cf460 0x7fd8940cdef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:12.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.460+0000 7fd893200640 1 -- 172.21.15.17:0/3386028255 >> 172.21.15.17:0/3386028255 conn(0x7fd89406bae0 msgr2=0x7fd894098a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:12.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.460+0000 7fd893200640 1 -- 172.21.15.17:0/3386028255 shutdown_connections 2024-03-12T17:20:12.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.460+0000 7fd893200640 1 -- 172.21.15.17:0/3386028255 wait complete. 2024-03-12T17:20:12.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.462+0000 7fd893200640 1 Processor -- start 2024-03-12T17:20:12.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.462+0000 7fd893200640 1 -- start start 2024-03-12T17:20:12.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.463+0000 7fd893200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd8940ce430 0x7fd8941521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:12.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.463+0000 7fd893200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8940cf460 0x7fd894156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:12.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.463+0000 7fd893200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd89415cc80 0x7fd8941545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:12.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.463+0000 7fd893200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89415d370 con 0x7fd8940cf460 2024-03-12T17:20:12.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.463+0000 7fd893200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89415d650 con 0x7fd8940ce430 2024-03-12T17:20:12.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.463+0000 7fd893200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd89415d930 con 0x7fd89415cc80 2024-03-12T17:20:12.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.463+0000 7fd891400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8940cf460 0x7fd894156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:12.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.463+0000 7fd891400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8940cf460 0x7fd894156b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55392/0 (socket says 172.21.15.17:55392) 2024-03-12T17:20:12.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.463+0000 7fd891400640 1 -- 172.21.15.17:0/4910475 learned_addr learned my addr 172.21.15.17:0/4910475 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:12.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.464+0000 7fd892800640 1 --2- 172.21.15.17:0/4910475 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd89415cc80 0x7fd8941545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:12.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.464+0000 7fd891e00640 1 --2- 172.21.15.17:0/4910475 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd8940ce430 0x7fd8941521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:12.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.464+0000 7fd891400640 1 -- 172.21.15.17:0/4910475 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd89415cc80 msgr2=0x7fd8941545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:12.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.464+0000 7fd891400640 1 --2- 172.21.15.17:0/4910475 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd89415cc80 0x7fd8941545e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:12.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.464+0000 7fd891400640 1 -- 172.21.15.17:0/4910475 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd8940ce430 msgr2=0x7fd8941521b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:12.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.464+0000 7fd891400640 1 --2- 172.21.15.17:0/4910475 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd8940ce430 0x7fd8941521b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:12.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.464+0000 7fd891400640 1 -- 172.21.15.17:0/4910475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd88c009b30 con 0x7fd8940cf460 2024-03-12T17:20:12.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.464+0000 7fd891400640 1 --2- 172.21.15.17:0/4910475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8940cf460 0x7fd894156b60 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd87c00d800 tx=0x7fd87c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:12.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.464+0000 7fd88a000640 1 -- 172.21.15.17:0/4910475 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87c00b6c0 con 0x7fd8940cf460 2024-03-12T17:20:12.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.464+0000 7fd88a000640 1 -- 172.21.15.17:0/4910475 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87c00b820 con 0x7fd8940cf460 2024-03-12T17:20:12.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.464+0000 7fd88a000640 1 -- 172.21.15.17:0/4910475 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87c00bbb0 con 0x7fd8940cf460 2024-03-12T17:20:12.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.464+0000 7fd893200640 1 -- 172.21.15.17:0/4910475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd89415dc10 con 0x7fd8940cf460 2024-03-12T17:20:12.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.465+0000 7fd893200640 1 -- 172.21.15.17:0/4910475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd894154b20 con 0x7fd8940cf460 2024-03-12T17:20:12.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.466+0000 7fd893200640 1 -- 172.21.15.17:0/4910475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd89415d4b0 con 0x7fd8940cf460 2024-03-12T17:20:12.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.467+0000 7fd88a000640 1 -- 172.21.15.17:0/4910475 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fd87c00bd10 con 0x7fd8940cf460 2024-03-12T17:20:12.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.468+0000 7fd88a000640 1 --2- 172.21.15.17:0/4910475 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd87006ac00 0x7fd87006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:12.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.468+0000 7fd88a000640 1 -- 172.21.15.17:0/4910475 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd87c089910 con 0x7fd8940cf460 2024-03-12T17:20:12.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.468+0000 7fd891e00640 1 --2- 172.21.15.17:0/4910475 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd87006ac00 0x7fd87006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:12.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.469+0000 7fd891e00640 1 --2- 172.21.15.17:0/4910475 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd87006ac00 0x7fd87006d0c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd88400a750 tx=0x7fd884008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:12.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.472+0000 7fd88a000640 1 -- 172.21.15.17:0/4910475 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fd89415d4b0 con 0x7fd8940cf460 2024-03-12T17:20:12.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.671+0000 7fd893200640 1 -- 172.21.15.17:0/4910475 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd89415d4b0 con 0x7fd8940cf460 2024-03-12T17:20:12.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.672+0000 7fd88a000640 1 -- 172.21.15.17:0/4910475 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd89415d4b0 con 0x7fd8940cf460 2024-03-12T17:20:12.667 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-03-12T17:20:12.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.675+0000 7fd893200640 1 -- 172.21.15.17:0/4910475 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd87006ac00 msgr2=0x7fd87006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:12.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.675+0000 7fd893200640 1 --2- 172.21.15.17:0/4910475 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd87006ac00 0x7fd87006d0c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd88400a750 tx=0x7fd884008040 comp rx=0 tx=0).stop 2024-03-12T17:20:12.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.675+0000 7fd893200640 1 -- 172.21.15.17:0/4910475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8940cf460 msgr2=0x7fd894156b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:12.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.675+0000 7fd893200640 1 --2- 172.21.15.17:0/4910475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8940cf460 0x7fd894156b60 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd87c00d800 tx=0x7fd87c00dcc0 comp rx=0 tx=0).stop 2024-03-12T17:20:12.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.675+0000 7fd893200640 1 -- 172.21.15.17:0/4910475 shutdown_connections 2024-03-12T17:20:12.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.675+0000 7fd893200640 1 --2- 172.21.15.17:0/4910475 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd87006ac00 0x7fd87006d0c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:12.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.675+0000 7fd893200640 1 --2- 172.21.15.17:0/4910475 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd89415cc80 0x7fd8941545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:12.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.675+0000 7fd893200640 1 --2- 172.21.15.17:0/4910475 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd8940cf460 0x7fd894156b60 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:12.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.675+0000 7fd893200640 1 --2- 172.21.15.17:0/4910475 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd8940ce430 0x7fd8941521b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:12.670 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.675+0000 7fd893200640 1 -- 172.21.15.17:0/4910475 >> 172.21.15.17:0/4910475 conn(0x7fd89406bae0 msgr2=0x7fd8940af6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:12.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.676+0000 7fd893200640 1 -- 172.21.15.17:0/4910475 shutdown_connections 2024-03-12T17:20:12.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.676+0000 7fd893200640 1 -- 172.21.15.17:0/4910475 wait complete. 2024-03-12T17:20:12.689 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-12T17:20:12.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.907+0000 7f42f8a00640 1 Processor -- start 2024-03-12T17:20:12.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.907+0000 7f42f8a00640 1 -- start start 2024-03-12T17:20:12.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.909+0000 7f42f8a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f42f40ced90 0x7f42f40b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:12.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.909+0000 7f42f8a00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f42f40b3950 0x7f42f40ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:12.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.909+0000 7f42f8a00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f40cb340 con 0x7f42f406c3f0 2024-03-12T17:20:12.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.909+0000 7f42f8a00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42f4159d50 con 0x7f42f40ced90 2024-03-12T17:20:12.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.909+0000 7f42f8a00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42f40b1c50 con 0x7f42f40b3950 2024-03-12T17:20:12.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.909+0000 7f42f1e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f42f40ced90 0x7f42f40b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:12.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.909+0000 7f42f1e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f42f40ced90 0x7f42f40b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55398/0 (socket says 172.21.15.17:55398) 2024-03-12T17:20:12.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.909+0000 7f42f1e00640 1 -- 172.21.15.17:0/2561925319 learned_addr learned my addr 172.21.15.17:0/2561925319 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:12.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.909+0000 7f42f1e00640 1 -- 172.21.15.17:0/2561925319 >> v2:172.21.15.94:3300/0 conn(0x7f42f40b3950 msgr2=0x7f42f40ccd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:12.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.909+0000 7f42f1e00640 1 --2- 172.21.15.17:0/2561925319 >> v2:172.21.15.94:3300/0 conn(0x7f42f40b3950 0x7f42f40ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:12.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.909+0000 7f42f1e00640 1 -- 172.21.15.17:0/2561925319 >> v1:172.21.15.94:6789/0 conn(0x7f42f406c3f0 legacy=0x7f42f40b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:12.904 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.909+0000 7f42f1e00640 1 -- 172.21.15.17:0/2561925319 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f40b1ef0 con 0x7f42f40ced90 2024-03-12T17:20:12.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.911+0000 7f42f1e00640 1 --2- 172.21.15.17:0/2561925319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42f40ced90 0x7f42f40b1710 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f42f415e4e0 tx=0x7f42e402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f408b0c0fd20603 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:12.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.911+0000 7f42f1400640 1 -- 172.21.15.17:0/2561925319 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e4031870 con 0x7f42f40ced90 2024-03-12T17:20:12.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.911+0000 7f42f1400640 1 -- 172.21.15.17:0/2561925319 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e40319d0 con 0x7f42f40ced90 2024-03-12T17:20:12.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.911+0000 7f42f1400640 1 -- 172.21.15.17:0/2561925319 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e4031d60 con 0x7f42f40ced90 2024-03-12T17:20:12.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.912+0000 7f42f8a00640 1 -- 172.21.15.17:0/2561925319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42f40ced90 msgr2=0x7f42f40b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:12.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.912+0000 7f42f8a00640 1 --2- 172.21.15.17:0/2561925319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42f40ced90 0x7f42f40b1710 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f42f415e4e0 tx=0x7f42e402b910 comp rx=0 tx=0).stop 2024-03-12T17:20:12.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.912+0000 7f42f8a00640 1 -- 172.21.15.17:0/2561925319 shutdown_connections 2024-03-12T17:20:12.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.912+0000 7f42f8a00640 1 --2- 172.21.15.17:0/2561925319 >> v2:172.21.15.94:3300/0 conn(0x7f42f40b3950 0x7f42f40ccd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:12.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.912+0000 7f42f8a00640 1 --2- 172.21.15.17:0/2561925319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42f40ced90 0x7f42f40b1710 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:12.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.912+0000 7f42f8a00640 1 -- 172.21.15.17:0/2561925319 >> 172.21.15.17:0/2561925319 conn(0x7f42f4069ce0 msgr2=0x7f42f406a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:12.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.912+0000 7f42f8a00640 1 -- 172.21.15.17:0/2561925319 shutdown_connections 2024-03-12T17:20:12.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.912+0000 7f42f8a00640 1 -- 172.21.15.17:0/2561925319 wait complete. 2024-03-12T17:20:12.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.914+0000 7f42f8a00640 1 Processor -- start 2024-03-12T17:20:12.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.914+0000 7f42f8a00640 1 -- start start 2024-03-12T17:20:12.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.915+0000 7f42f8a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42f406c3f0 0x7f42f4155660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:12.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.915+0000 7f42f8a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f42f40b3950 0x7f42f40b00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:12.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.915+0000 7f42f8a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f42f40ced90 0x7f42f4152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:12.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.915+0000 7f42f8a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f40a7e20 con 0x7f42f406c3f0 2024-03-12T17:20:12.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.915+0000 7f42f8a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f40b0620 con 0x7f42f40ced90 2024-03-12T17:20:12.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.915+0000 7f42f8a00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f40a7560 con 0x7f42f40b3950 2024-03-12T17:20:12.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.915+0000 7f42f1e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42f406c3f0 0x7f42f4155660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:12.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.915+0000 7f42f1e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42f406c3f0 0x7f42f4155660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55408/0 (socket says 172.21.15.17:55408) 2024-03-12T17:20:12.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.915+0000 7f42f1e00640 1 -- 172.21.15.17:0/1698551640 learned_addr learned my addr 172.21.15.17:0/1698551640 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:12.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.916+0000 7f42ebe00640 1 --2- 172.21.15.17:0/1698551640 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f42f40b3950 0x7f42f40b00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:12.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.916+0000 7f42f2800640 1 --2- 172.21.15.17:0/1698551640 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f42f40ced90 0x7f42f4152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:12.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.916+0000 7f42f1e00640 1 -- 172.21.15.17:0/1698551640 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f42f40b3950 msgr2=0x7f42f40b00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:12.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.916+0000 7f42f1e00640 1 --2- 172.21.15.17:0/1698551640 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f42f40b3950 0x7f42f40b00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:12.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.916+0000 7f42f1e00640 1 -- 172.21.15.17:0/1698551640 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f42f40ced90 msgr2=0x7f42f4152170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:12.911 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.916+0000 7f42f1e00640 1 --2- 172.21.15.17:0/1698551640 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f42f40ced90 0x7f42f4152170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:12.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.916+0000 7f42f1e00640 1 -- 172.21.15.17:0/1698551640 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e40094d0 con 0x7f42f406c3f0 2024-03-12T17:20:12.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.916+0000 7f42ebe00640 1 --2- 172.21.15.17:0/1698551640 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f42f40b3950 0x7f42f40b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:12.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.916+0000 7f42f2800640 1 --2- 172.21.15.17:0/1698551640 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f42f40ced90 0x7f42f4152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:12.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.916+0000 7f42f1e00640 1 --2- 172.21.15.17:0/1698551640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42f406c3f0 0x7f42f4155660 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f42e4009960 tx=0x7f42e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:12.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.916+0000 7f42ea000640 1 -- 172.21.15.17:0/1698551640 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e403ad10 con 0x7f42f406c3f0 2024-03-12T17:20:12.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.916+0000 7f42ea000640 1 -- 172.21.15.17:0/1698551640 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e403ae70 con 0x7f42f406c3f0 2024-03-12T17:20:12.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.916+0000 7f42f8a00640 1 -- 172.21.15.17:0/1698551640 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f40a77d0 con 0x7f42f406c3f0 2024-03-12T17:20:12.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.917+0000 7f42ea000640 1 -- 172.21.15.17:0/1698551640 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e4044610 con 0x7f42f406c3f0 2024-03-12T17:20:12.912 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.917+0000 7f42f8a00640 1 -- 172.21.15.17:0/1698551640 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f4155cf0 con 0x7f42f406c3f0 2024-03-12T17:20:12.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.918+0000 7f42f8a00640 1 -- 172.21.15.17:0/1698551640 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42f40736c0 con 0x7f42f406c3f0 2024-03-12T17:20:12.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.919+0000 7f42ea000640 1 -- 172.21.15.17:0/1698551640 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f42e4044770 con 0x7f42f406c3f0 2024-03-12T17:20:12.914 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.920+0000 7f42ea000640 1 --2- 172.21.15.17:0/1698551640 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f42d006ac30 0x7f42d006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:12.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.920+0000 7f42ea000640 1 -- 172.21.15.17:0/1698551640 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f42e402d040 con 0x7f42f406c3f0 2024-03-12T17:20:12.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.920+0000 7f42ebe00640 1 --2- 172.21.15.17:0/1698551640 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f42d006ac30 0x7f42d006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:12.915 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.921+0000 7f42ebe00640 1 --2- 172.21.15.17:0/1698551640 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f42d006ac30 0x7f42d006d0f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f42f415be20 tx=0x7f42dc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:12.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:12.925+0000 7f42ea000640 1 -- 172.21.15.17:0/1698551640 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f42e4076c80 con 0x7f42f406c3f0 2024-03-12T17:20:13.157 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.163+0000 7f42f8a00640 1 -- 172.21.15.17:0/1698551640 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42f406dc10 con 0x7f42f406c3f0 2024-03-12T17:20:13.158 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.164+0000 7f42ea000640 1 -- 172.21.15.17:0/1698551640 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4728 (secure 0 0 0) 0x7f42e407a2a0 con 0x7f42f406c3f0 2024-03-12T17:20:13.159 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:20:13.159 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6834/934570591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":934570591},{"type":"v1","addr":"172.21.15.94:6834","nonce":934570591}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/2007868406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6833","nonce":2007868406},{"type":"v1","addr":"172.21.15.94:6835","nonce":2007868406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4768,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6836/2733057827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2733057827},{"type":"v1","addr":"172.21.15.17:6836","nonce":2733057827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T17:19:55.522204+0000","modified":"2024-03-12T17:19:58.531800+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5058},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5058":{"gid":5058,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6837/672288094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6835","nonce":672288094},{"type":"v1","addr":"172.21.15.17:6837","nonce":672288094}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-03-12T17:20:13.159 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 14 2024-03-12T17:20:13.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.167+0000 7f42f8a00640 1 -- 172.21.15.17:0/1698551640 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f42d006ac30 msgr2=0x7f42d006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:13.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.167+0000 7f42f8a00640 1 --2- 172.21.15.17:0/1698551640 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f42d006ac30 0x7f42d006d0f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f42f415be20 tx=0x7f42dc008040 comp rx=0 tx=0).stop 2024-03-12T17:20:13.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.167+0000 7f42f8a00640 1 -- 172.21.15.17:0/1698551640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42f406c3f0 msgr2=0x7f42f4155660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:13.161 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.167+0000 7f42f8a00640 1 --2- 172.21.15.17:0/1698551640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42f406c3f0 0x7f42f4155660 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f42e4009960 tx=0x7f42e40046c0 comp rx=0 tx=0).stop 2024-03-12T17:20:13.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.167+0000 7f42f8a00640 1 -- 172.21.15.17:0/1698551640 shutdown_connections 2024-03-12T17:20:13.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.167+0000 7f42f8a00640 1 --2- 172.21.15.17:0/1698551640 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f42d006ac30 0x7f42d006d0f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:13.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.167+0000 7f42f8a00640 1 --2- 172.21.15.17:0/1698551640 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f42f40ced90 0x7f42f4152170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:13.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.167+0000 7f42f8a00640 1 --2- 172.21.15.17:0/1698551640 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f42f40b3950 0x7f42f40b00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:13.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.167+0000 7f42f8a00640 1 --2- 172.21.15.17:0/1698551640 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f42f406c3f0 0x7f42f4155660 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:13.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.167+0000 7f42f8a00640 1 -- 172.21.15.17:0/1698551640 >> 172.21.15.17:0/1698551640 conn(0x7f42f4069ce0 msgr2=0x7f42f4159220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:13.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.167+0000 7f42f8a00640 1 -- 172.21.15.17:0/1698551640 shutdown_connections 2024-03-12T17:20:13.162 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.167+0000 7f42f8a00640 1 -- 172.21.15.17:0/1698551640 wait complete. 2024-03-12T17:20:13.180 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T17:20:13.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.407+0000 7f29fe600640 1 Processor -- start 2024-03-12T17:20:13.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.407+0000 7f29fe600640 1 -- start start 2024-03-12T17:20:13.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.408+0000 7f29fe600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f29f8144240 0x7f29f80ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:13.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.408+0000 7f29fe600640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f29f80cb970 0x7f29f80cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:13.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.408+0000 7f29fe600640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29f80ce320 con 0x7f29f80cecf0 2024-03-12T17:20:13.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.408+0000 7f29fe600640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29f80cc340 con 0x7f29f80cb970 2024-03-12T17:20:13.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.408+0000 7f29fe600640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29f8144620 con 0x7f29f8144240 2024-03-12T17:20:13.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.409+0000 7f29f6a00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f29f80cecf0 0x7f29f80b2070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53136/0 (socket says 172.21.15.17:53136) 2024-03-12T17:20:13.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.409+0000 7f29f6a00640 1 -- 172.21.15.17:0/2500355824 learned_addr learned my addr 172.21.15.17:0/2500355824 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:20:13.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.409+0000 7f29f7400640 1 --2- 172.21.15.17:0/2500355824 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f29f8144240 0x7f29f80ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:13.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.409+0000 7f29f7e00640 1 --2- 172.21.15.17:0/2500355824 >> v2:172.21.15.94:3300/0 conn(0x7f29f80cb970 0x7f29f80cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:13.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.409+0000 7f29f6000640 1 -- 172.21.15.17:0/2500355824 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2188060791 0 0) 0x7f29f80ce320 con 0x7f29f80cecf0 2024-03-12T17:20:13.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.409+0000 7f29f6000640 1 -- 172.21.15.17:0/2500355824 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29dc003520 con 0x7f29f80cecf0 2024-03-12T17:20:13.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.410+0000 7f29f6000640 1 -- 172.21.15.17:0/2500355824 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4070888872 0 0) 0x7f29dc003520 con 0x7f29f80cecf0 2024-03-12T17:20:13.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.410+0000 7f29f6000640 1 -- 172.21.15.17:0/2500355824 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f29f8144240 msgr2=0x7f29f80ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:13.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.410+0000 7f29f6000640 1 --2- 172.21.15.17:0/2500355824 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f29f8144240 0x7f29f80ce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:13.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.410+0000 7f29f6000640 1 -- 172.21.15.17:0/2500355824 >> v2:172.21.15.94:3300/0 conn(0x7f29f80cb970 msgr2=0x7f29f80cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:13.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.410+0000 7f29f6000640 1 --2- 172.21.15.17:0/2500355824 >> v2:172.21.15.94:3300/0 conn(0x7f29f80cb970 0x7f29f80cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:13.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.410+0000 7f29f6000640 1 -- 172.21.15.17:0/2500355824 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f815f3d0 con 0x7f29f80cecf0 2024-03-12T17:20:13.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.410+0000 7f29f6000640 1 -- 172.21.15.17:0/2500355824 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7f29e0001670 con 0x7f29f80cecf0 2024-03-12T17:20:13.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.410+0000 7f29f6000640 1 -- 172.21.15.17:0/2500355824 >> v1:172.21.15.17:6789/0 conn(0x7f29f80cecf0 legacy=0x7f29f80b2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:13.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.410+0000 7f29f6000640 1 --2- 172.21.15.17:0/2500355824 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f29f8144240 0x7f29dc003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:13.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.410+0000 7f29f6000640 1 --2- 172.21.15.17:0/2500355824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29dc003ef0 0x7f29dc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:13.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.410+0000 7f29f6000640 1 --2- 172.21.15.17:0/2500355824 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29dc004d00 0x7f29dc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:13.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.410+0000 7f29f6000640 1 -- 172.21.15.17:0/2500355824 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f80cc340 con 0x7f29dc003ef0 2024-03-12T17:20:13.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.410+0000 7f29f6000640 1 -- 172.21.15.17:0/2500355824 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f8144620 con 0x7f29dc004d00 2024-03-12T17:20:13.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.410+0000 7f29f6000640 1 -- 172.21.15.17:0/2500355824 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29dc00b980 con 0x7f29f8144240 2024-03-12T17:20:13.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.410+0000 7f29f6a00640 1 --2- 172.21.15.17:0/2500355824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29dc003ef0 0x7f29dc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:13.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.411+0000 7f29f7400640 1 --2- 172.21.15.17:0/2500355824 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f29f8144240 0x7f29dc003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:13.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.411+0000 7f29f7e00640 1 --2- 172.21.15.17:0/2500355824 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29dc004d00 0x7f29dc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:13.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.411+0000 7f29f6a00640 1 -- 172.21.15.17:0/2500355824 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f29f8144240 msgr2=0x7f29dc003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:13.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.411+0000 7f29f6a00640 1 --2- 172.21.15.17:0/2500355824 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f29f8144240 0x7f29dc003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:13.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.411+0000 7f29f6a00640 1 -- 172.21.15.17:0/2500355824 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29dc004d00 msgr2=0x7f29dc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:13.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.411+0000 7f29f6a00640 1 --2- 172.21.15.17:0/2500355824 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29dc004d00 0x7f29dc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:13.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.411+0000 7f29f6a00640 1 -- 172.21.15.17:0/2500355824 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29dc003520 con 0x7f29dc003ef0 2024-03-12T17:20:13.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.412+0000 7f29f6a00640 1 --2- 172.21.15.17:0/2500355824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29dc003ef0 0x7f29dc0047c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f29e000c240 tx=0x7f29dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec8da28b5b22239b server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:13.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.412+0000 7f29f6000640 1 -- 172.21.15.17:0/2500355824 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e0005ad0 con 0x7f29dc003ef0 2024-03-12T17:20:13.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.412+0000 7f29f6000640 1 -- 172.21.15.17:0/2500355824 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e0005c30 con 0x7f29dc003ef0 2024-03-12T17:20:13.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.412+0000 7f29f6000640 1 -- 172.21.15.17:0/2500355824 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e002cae0 con 0x7f29dc003ef0 2024-03-12T17:20:13.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.413+0000 7f29fe600640 1 -- 172.21.15.17:0/2500355824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29dc003ef0 msgr2=0x7f29dc0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:13.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.413+0000 7f29fe600640 1 --2- 172.21.15.17:0/2500355824 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29dc003ef0 0x7f29dc0047c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f29e000c240 tx=0x7f29dc0057f0 comp rx=0 tx=0).stop 2024-03-12T17:20:13.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.413+0000 7f29f7e00640 1 -- 172.21.15.17:0/2500355824 reap_dead start 2024-03-12T17:20:13.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.413+0000 7f29fe600640 1 -- 172.21.15.17:0/2500355824 shutdown_connections 2024-03-12T17:20:13.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.413+0000 7f29fe600640 1 -- 172.21.15.17:0/2500355824 >> 172.21.15.17:0/2500355824 conn(0x7f29f8069ce0 msgr2=0x7f29f806a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:13.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.413+0000 7f29fe600640 1 -- 172.21.15.17:0/2500355824 shutdown_connections 2024-03-12T17:20:13.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.413+0000 7f29fe600640 1 -- 172.21.15.17:0/2500355824 wait complete. 2024-03-12T17:20:13.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.415+0000 7f29fe600640 1 Processor -- start 2024-03-12T17:20:13.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.415+0000 7f29fe600640 1 -- start start 2024-03-12T17:20:13.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.416+0000 7f29fe600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29dc003ef0 0x7f29f813d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:13.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.416+0000 7f29fe600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f29f80aef70 0x7f29f81f1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:13.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.416+0000 7f29fe600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29f806c3f0 0x7f29f806c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:13.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.416+0000 7f29fe600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f806cdb0 con 0x7f29dc003ef0 2024-03-12T17:20:13.412 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.416+0000 7f29fe600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29f80b0b10 con 0x7f29f806c3f0 2024-03-12T17:20:13.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.416+0000 7f29fe600640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29f813dab0 con 0x7f29f80aef70 2024-03-12T17:20:13.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.416+0000 7f29f7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29dc003ef0 0x7f29f813d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:13.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.416+0000 7f29f7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29dc003ef0 0x7f29f813d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55422/0 (socket says 172.21.15.17:55422) 2024-03-12T17:20:13.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.416+0000 7f29f7400640 1 -- 172.21.15.17:0/3139869912 learned_addr learned my addr 172.21.15.17:0/3139869912 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:13.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.417+0000 7f29f6a00640 1 --2- 172.21.15.17:0/3139869912 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f29f80aef70 0x7f29f81f1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:13.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.417+0000 7f29f7e00640 1 --2- 172.21.15.17:0/3139869912 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29f806c3f0 0x7f29f806c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:13.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.417+0000 7f29f7400640 1 -- 172.21.15.17:0/3139869912 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f29f80aef70 msgr2=0x7f29f81f1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:13.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.417+0000 7f29f7400640 1 --2- 172.21.15.17:0/3139869912 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f29f80aef70 0x7f29f81f1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:13.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.417+0000 7f29f7400640 1 -- 172.21.15.17:0/3139869912 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29f806c3f0 msgr2=0x7f29f806c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:13.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.417+0000 7f29f7400640 1 --2- 172.21.15.17:0/3139869912 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29f806c3f0 0x7f29f806c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:13.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.417+0000 7f29f7400640 1 -- 172.21.15.17:0/3139869912 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29f80af4a0 con 0x7f29dc003ef0 2024-03-12T17:20:13.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.417+0000 7f29f7e00640 1 --2- 172.21.15.17:0/3139869912 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29f806c3f0 0x7f29f806c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:13.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.417+0000 7f29f7400640 1 --2- 172.21.15.17:0/3139869912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29dc003ef0 0x7f29f813d570 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f29e8011630 tx=0x7f29e8011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:13.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.418+0000 7f29ef400640 1 -- 172.21.15.17:0/3139869912 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e800f920 con 0x7f29dc003ef0 2024-03-12T17:20:13.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.418+0000 7f29ef400640 1 -- 172.21.15.17:0/3139869912 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29e800fa80 con 0x7f29dc003ef0 2024-03-12T17:20:13.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.418+0000 7f29ef400640 1 -- 172.21.15.17:0/3139869912 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29e800fdf0 con 0x7f29dc003ef0 2024-03-12T17:20:13.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.418+0000 7f29fe600640 1 -- 172.21.15.17:0/3139869912 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29f80af780 con 0x7f29dc003ef0 2024-03-12T17:20:13.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.418+0000 7f29fe600640 1 -- 172.21.15.17:0/3139869912 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29f80afd40 con 0x7f29dc003ef0 2024-03-12T17:20:13.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.419+0000 7f29fe600640 1 -- 172.21.15.17:0/3139869912 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29f80736c0 con 0x7f29dc003ef0 2024-03-12T17:20:13.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.420+0000 7f29ef400640 1 -- 172.21.15.17:0/3139869912 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f29e8015460 con 0x7f29dc003ef0 2024-03-12T17:20:13.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.421+0000 7f29ef400640 1 --2- 172.21.15.17:0/3139869912 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f29d406ac30 0x7f29d406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:13.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.421+0000 7f29ef400640 1 -- 172.21.15.17:0/3139869912 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f29e80897c0 con 0x7f29dc003ef0 2024-03-12T17:20:13.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.421+0000 7f29f6a00640 1 --2- 172.21.15.17:0/3139869912 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f29d406ac30 0x7f29d406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:13.416 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.422+0000 7f29f6a00640 1 --2- 172.21.15.17:0/3139869912 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f29d406ac30 0x7f29d406d0f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f29e0034000 tx=0x7f29e0009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:13.419 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.425+0000 7f29ef400640 1 -- 172.21.15.17:0/3139869912 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f29e8054990 con 0x7f29dc003ef0 2024-03-12T17:20:13.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.627+0000 7f29fe600640 1 -- 172.21.15.17:0/3139869912 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29f80670a0 con 0x7f29dc003ef0 2024-03-12T17:20:13.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.629+0000 7f29ef400640 1 -- 172.21.15.17:0/3139869912 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16053 (secure 0 0 0) 0x7f29e8057fb0 con 0x7f29dc003ef0 2024-03-12T17:20:13.624 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:20:13.624 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":35,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:19:56.525877+0000","last_up_change":"2024-03-12T17:18:38.144756+0000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-12T17:18:39.552910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-12T17:19:53.519967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-12T17:19:54.546388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":37305},{"type":"v1","addr":"172.21.15.17:6801","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":37305},{"type":"v1","addr":"172.21.15.17:6803","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":37305},{"type":"v1","addr":"172.21.15.17:6807","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":37305},{"type":"v1","addr":"172.21.15.17:6805","nonce":37305}]},"public_addr":"172.21.15.17:6801/37305","cluster_addr":"172.21.15.17:6803/37305","heartbeat_back_addr":"172.21.15.17:6807/37305","heartbeat_front_addr":"172.21.15.17:6805/37305","state":["exists","up"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":37307},{"type":"v1","addr":"172.21.15.17:6814","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":37307},{"type":"v1","addr":"172.21.15.17:6818","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":37307},{"type":"v1","addr":"172.21.15.17:6827","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":37307},{"type":"v1","addr":"172.21.15.17:6823","nonce":37307}]},"public_addr":"172.21.15.17:6814/37307","cluster_addr":"172.21.15.17:6818/37307","heartbeat_back_addr":"172.21.15.17:6827/37307","heartbeat_front_addr":"172.21.15.17:6823/37307","state":["exists","up"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":37303},{"type":"v1","addr":"172.21.15.17:6809","nonce":37303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":37303},{"type":"v1","addr":"172.21.15.17:6811","nonce":37303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":37303},{"type":"v1","addr":"172.21.15.17:6819","nonce":37303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":37303},{"type":"v1","addr":"172.21.15.17:6815","nonce":37303}]},"public_addr":"172.21.15.17:6809/37303","cluster_addr":"172.21.15.17:6811/37303","heartbeat_back_addr":"172.21.15.17:6819/37303","heartbeat_front_addr":"172.21.15.17:6815/37303","state":["exists","up"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":37308},{"type":"v1","addr":"172.21.15.17:6822","nonce":37308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":37308},{"type":"v1","addr":"172.21.15.17:6826","nonce":37308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":37308},{"type":"v1","addr":"172.21.15.17:6831","nonce":37308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":37308},{"type":"v1","addr":"172.21.15.17:6829","nonce":37308}]},"public_addr":"172.21.15.17:6822/37308","cluster_addr":"172.21.15.17:6826/37308","heartbeat_back_addr":"172.21.15.17:6831/37308","heartbeat_front_addr":"172.21.15.17:6829/37308","state":["exists","up"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":37465},{"type":"v1","addr":"172.21.15.94:6809","nonce":37465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6811","nonce":37465},{"type":"v1","addr":"172.21.15.94:6813","nonce":37465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6819","nonce":37465},{"type":"v1","addr":"172.21.15.94:6822","nonce":37465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6815","nonce":37465},{"type":"v1","addr":"172.21.15.94:6817","nonce":37465}]},"public_addr":"172.21.15.94:6809/37465","cluster_addr":"172.21.15.94:6813/37465","heartbeat_back_addr":"172.21.15.94:6822/37465","heartbeat_front_addr":"172.21.15.94:6817/37465","state":["exists","up"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":37464},{"type":"v1","addr":"172.21.15.94:6812","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":37464},{"type":"v1","addr":"172.21.15.94:6816","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":37464},{"type":"v1","addr":"172.21.15.94:6823","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":37464},{"type":"v1","addr":"172.21.15.94:6820","nonce":37464}]},"public_addr":"172.21.15.94:6812/37464","cluster_addr":"172.21.15.94:6816/37464","heartbeat_back_addr":"172.21.15.94:6823/37464","heartbeat_front_addr":"172.21.15.94:6820/37464","state":["exists","up"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":37467},{"type":"v1","addr":"172.21.15.94:6825","nonce":37467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":37467},{"type":"v1","addr":"172.21.15.94:6827","nonce":37467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":37467},{"type":"v1","addr":"172.21.15.94:6831","nonce":37467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":37467},{"type":"v1","addr":"172.21.15.94:6829","nonce":37467}]},"public_addr":"172.21.15.94:6825/37467","cluster_addr":"172.21.15.94:6827/37467","heartbeat_back_addr":"172.21.15.94:6831/37467","heartbeat_front_addr":"172.21.15.94:6829/37467","state":["exists","up"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":37466},{"type":"v1","addr":"172.21.15.94:6801","nonce":37466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":37466},{"type":"v1","addr":"172.21.15.94:6803","nonce":37466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":37466},{"type":"v1","addr":"172.21.15.94:6807","nonce":37466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":37466},{"type":"v1","addr":"172.21.15.94:6805","nonce":37466}]},"public_addr":"172.21.15.94:6801/37466","cluster_addr":"172.21.15.94:6803/37466","heartbeat_back_addr":"172.21.15.94:6807/37466","heartbeat_front_addr":"172.21.15.94:6805/37466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.327217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.186966+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.419986+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.150585+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.120621+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.121576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.181257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.293188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:20:13.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.632+0000 7f29fe600640 1 -- 172.21.15.17:0/3139869912 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f29d406ac30 msgr2=0x7f29d406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:13.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.632+0000 7f29fe600640 1 --2- 172.21.15.17:0/3139869912 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f29d406ac30 0x7f29d406d0f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f29e0034000 tx=0x7f29e0009030 comp rx=0 tx=0).stop 2024-03-12T17:20:13.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.632+0000 7f29fe600640 1 -- 172.21.15.17:0/3139869912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29dc003ef0 msgr2=0x7f29f813d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:13.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.632+0000 7f29fe600640 1 --2- 172.21.15.17:0/3139869912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29dc003ef0 0x7f29f813d570 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f29e8011630 tx=0x7f29e8011af0 comp rx=0 tx=0).stop 2024-03-12T17:20:13.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.632+0000 7f29fe600640 1 -- 172.21.15.17:0/3139869912 shutdown_connections 2024-03-12T17:20:13.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.632+0000 7f29fe600640 1 --2- 172.21.15.17:0/3139869912 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f29d406ac30 0x7f29d406d0f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:13.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.632+0000 7f29fe600640 1 --2- 172.21.15.17:0/3139869912 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f29f806c3f0 0x7f29f806c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:13.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.632+0000 7f29fe600640 1 --2- 172.21.15.17:0/3139869912 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f29f80aef70 0x7f29f81f1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:13.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.632+0000 7f29fe600640 1 --2- 172.21.15.17:0/3139869912 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f29dc003ef0 0x7f29f813d570 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:13.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.632+0000 7f29fe600640 1 -- 172.21.15.17:0/3139869912 >> 172.21.15.17:0/3139869912 conn(0x7f29f8069ce0 msgr2=0x7f29f80ab8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:13.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.633+0000 7f29fe600640 1 -- 172.21.15.17:0/3139869912 shutdown_connections 2024-03-12T17:20:13.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.633+0000 7f29fe600640 1 -- 172.21.15.17:0/3139869912 wait complete. 2024-03-12T17:20:13.646 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-12T17:20:13.646 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-12T17:20:13.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.871+0000 7f9e00a00640 1 Processor -- start 2024-03-12T17:20:13.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.871+0000 7f9e00a00640 1 -- start start 2024-03-12T17:20:13.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.873+0000 7f9e00a00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9dfc0cb930 0x7f9dfc0b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:13.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.873+0000 7f9e00a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9dfc0b23e0 0x7f9dfc0cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:13.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.873+0000 7f9e00a00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dfc0cc250 con 0x7f9dfc0cd850 2024-03-12T17:20:13.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.873+0000 7f9e00a00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dfc0ce1a0 con 0x7f9dfc0cb930 2024-03-12T17:20:13.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.873+0000 7f9e00a00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc0b1900 con 0x7f9dfc0b23e0 2024-03-12T17:20:13.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.874+0000 7f9df2a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9dfc0b23e0 0x7f9dfc0cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:13.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.874+0000 7f9df2a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9dfc0b23e0 0x7f9dfc0cbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.17:54144/0 (socket says 172.21.15.17:54144) 2024-03-12T17:20:13.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.874+0000 7f9df2a00640 1 -- 172.21.15.17:0/1835810459 learned_addr learned my addr 172.21.15.17:0/1835810459 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:13.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.874+0000 7f9dfb400640 1 --2- 172.21.15.17:0/1835810459 >> v2:172.21.15.94:3300/0 conn(0x7f9dfc0cb930 0x7f9dfc0b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:13.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.874+0000 7f9df2a00640 1 -- 172.21.15.17:0/1835810459 >> v2:172.21.15.94:3300/0 conn(0x7f9dfc0cb930 msgr2=0x7f9dfc0b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:13.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.874+0000 7f9df2a00640 1 --2- 172.21.15.17:0/1835810459 >> v2:172.21.15.94:3300/0 conn(0x7f9dfc0cb930 0x7f9dfc0b45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:13.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.874+0000 7f9df2a00640 1 -- 172.21.15.17:0/1835810459 >> v1:172.21.15.94:6789/0 conn(0x7f9dfc0cd850 legacy=0x7f9dfc0b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:13.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.874+0000 7f9df2a00640 1 -- 172.21.15.17:0/1835810459 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dfc0b1be0 con 0x7f9dfc0b23e0 2024-03-12T17:20:13.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.876+0000 7f9df2a00640 1 --2- 172.21.15.17:0/1835810459 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9dfc0b23e0 0x7f9dfc0cbd10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9de4009870 tx=0x7f9de402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ea06c19f1b0ee95 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:13.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.876+0000 7f9dfaa00640 1 -- 172.21.15.17:0/1835810459 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de4030840 con 0x7f9dfc0b23e0 2024-03-12T17:20:13.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.876+0000 7f9dfaa00640 1 -- 172.21.15.17:0/1835810459 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de40309a0 con 0x7f9dfc0b23e0 2024-03-12T17:20:13.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.876+0000 7f9dfaa00640 1 -- 172.21.15.17:0/1835810459 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de4030d30 con 0x7f9dfc0b23e0 2024-03-12T17:20:13.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.877+0000 7f9e00a00640 1 -- 172.21.15.17:0/1835810459 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9dfc0b23e0 msgr2=0x7f9dfc0cbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:13.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.877+0000 7f9e00a00640 1 --2- 172.21.15.17:0/1835810459 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9dfc0b23e0 0x7f9dfc0cbd10 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9de4009870 tx=0x7f9de402b980 comp rx=0 tx=0).stop 2024-03-12T17:20:13.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.877+0000 7f9e00a00640 1 -- 172.21.15.17:0/1835810459 shutdown_connections 2024-03-12T17:20:13.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.877+0000 7f9e00a00640 1 --2- 172.21.15.17:0/1835810459 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9dfc0b23e0 0x7f9dfc0cbd10 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:13.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.877+0000 7f9e00a00640 1 --2- 172.21.15.17:0/1835810459 >> v2:172.21.15.94:3300/0 conn(0x7f9dfc0cb930 0x7f9dfc0b45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:13.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.877+0000 7f9e00a00640 1 -- 172.21.15.17:0/1835810459 >> 172.21.15.17:0/1835810459 conn(0x7f9dfc069ce0 msgr2=0x7f9dfc06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:13.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.877+0000 7f9e00a00640 1 -- 172.21.15.17:0/1835810459 shutdown_connections 2024-03-12T17:20:13.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.877+0000 7f9e00a00640 1 -- 172.21.15.17:0/1835810459 wait complete. 2024-03-12T17:20:13.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.879+0000 7f9e00a00640 1 Processor -- start 2024-03-12T17:20:13.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.879+0000 7f9e00a00640 1 -- start start 2024-03-12T17:20:13.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.880+0000 7f9e00a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9dfc0b23e0 0x7f9dfc0a7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:13.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.880+0000 7f9e00a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9dfc0cb930 0x7f9dfc0acaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:13.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.880+0000 7f9e00a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dfc0cd850 0x7f9dfc141ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:13.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.880+0000 7f9e00a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc141690 con 0x7f9dfc0cd850 2024-03-12T17:20:13.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.880+0000 7f9e00a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc140a10 con 0x7f9dfc0b23e0 2024-03-12T17:20:13.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.880+0000 7f9e00a00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc140cf0 con 0x7f9dfc0cb930 2024-03-12T17:20:13.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.881+0000 7f9dfb400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9dfc0b23e0 0x7f9dfc0a7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:13.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.881+0000 7f9df2a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9dfc0cb930 0x7f9dfc0acaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:13.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.881+0000 7f9df2a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9dfc0cb930 0x7f9dfc0acaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.17:54160/0 (socket says 172.21.15.17:54160) 2024-03-12T17:20:13.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.881+0000 7f9dfb400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9dfc0b23e0 0x7f9dfc0a7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.17:51420/0 (socket says 172.21.15.17:51420) 2024-03-12T17:20:13.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.881+0000 7f9df2a00640 1 -- 172.21.15.17:0/2206812192 learned_addr learned my addr 172.21.15.17:0/2206812192 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:13.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.881+0000 7f9dfbe00640 1 --2- 172.21.15.17:0/2206812192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dfc0cd850 0x7f9dfc141ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:13.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.881+0000 7f9dfbe00640 1 -- 172.21.15.17:0/2206812192 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9dfc0cb930 msgr2=0x7f9dfc0acaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:13.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.881+0000 7f9dfbe00640 1 --2- 172.21.15.17:0/2206812192 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9dfc0cb930 0x7f9dfc0acaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:13.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.881+0000 7f9dfbe00640 1 -- 172.21.15.17:0/2206812192 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9dfc0b23e0 msgr2=0x7f9dfc0a7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:13.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.881+0000 7f9dfbe00640 1 --2- 172.21.15.17:0/2206812192 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9dfc0b23e0 0x7f9dfc0a7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:13.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.881+0000 7f9dfbe00640 1 -- 172.21.15.17:0/2206812192 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9de40094d0 con 0x7f9dfc0cd850 2024-03-12T17:20:13.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.882+0000 7f9dfbe00640 1 --2- 172.21.15.17:0/2206812192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dfc0cd850 0x7f9dfc141ab0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9df400c700 tx=0x7f9df400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:13.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.882+0000 7f9df3e00640 1 -- 172.21.15.17:0/2206812192 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df4003b70 con 0x7f9dfc0cd850 2024-03-12T17:20:13.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.882+0000 7f9df3e00640 1 -- 172.21.15.17:0/2206812192 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df4003cd0 con 0x7f9dfc0cd850 2024-03-12T17:20:13.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.882+0000 7f9e00a00640 1 -- 172.21.15.17:0/2206812192 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dfc0ce600 con 0x7f9dfc0cd850 2024-03-12T17:20:13.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.882+0000 7f9df3e00640 1 -- 172.21.15.17:0/2206812192 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df4005310 con 0x7f9dfc0cd850 2024-03-12T17:20:13.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.882+0000 7f9e00a00640 1 -- 172.21.15.17:0/2206812192 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dfc1412b0 con 0x7f9dfc0cd850 2024-03-12T17:20:13.878 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.883+0000 7f9e00a00640 1 -- 172.21.15.17:0/2206812192 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dfc1417d0 con 0x7f9dfc0cd850 2024-03-12T17:20:13.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.884+0000 7f9df3e00640 1 -- 172.21.15.17:0/2206812192 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f9df4005470 con 0x7f9dfc0cd850 2024-03-12T17:20:13.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.885+0000 7f9df3e00640 1 --2- 172.21.15.17:0/2206812192 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f9dd806ac00 0x7f9dd806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:13.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.885+0000 7f9df3e00640 1 -- 172.21.15.17:0/2206812192 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9df4088fa0 con 0x7f9dfc0cd850 2024-03-12T17:20:13.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.886+0000 7f9dfb400640 1 --2- 172.21.15.17:0/2206812192 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f9dd806ac00 0x7f9dd806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:13.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.886+0000 7f9dfb400640 1 --2- 172.21.15.17:0/2206812192 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f9dd806ac00 0x7f9dd806d0c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9dec010c00 tx=0x7f9dec012040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:13.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:13.889+0000 7f9df3e00640 1 -- 172.21.15.17:0/2206812192 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f9dfc1417d0 con 0x7f9dfc0cd850 2024-03-12T17:20:14.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.126+0000 7f9e00a00640 1 -- 172.21.15.17:0/2206812192 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9dfc1417d0 con 0x7f9dfc0cd850 2024-03-12T17:20:14.121 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.127+0000 7f9df3e00640 1 -- 172.21.15.17:0/2206812192 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4728 (secure 0 0 0) 0x7f9dfc1417d0 con 0x7f9dfc0cd850 2024-03-12T17:20:14.122 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:20:14.122 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6834/934570591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":934570591},{"type":"v1","addr":"172.21.15.94:6834","nonce":934570591}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/2007868406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6833","nonce":2007868406},{"type":"v1","addr":"172.21.15.94:6835","nonce":2007868406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4768,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6836/2733057827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2733057827},{"type":"v1","addr":"172.21.15.17:6836","nonce":2733057827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T17:19:55.522204+0000","modified":"2024-03-12T17:19:58.531800+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5058},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5058":{"gid":5058,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6837/672288094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6835","nonce":672288094},{"type":"v1","addr":"172.21.15.17:6837","nonce":672288094}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-03-12T17:20:14.122 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 14 2024-03-12T17:20:14.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.130+0000 7f9e00a00640 1 -- 172.21.15.17:0/2206812192 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f9dd806ac00 msgr2=0x7f9dd806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:14.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.130+0000 7f9e00a00640 1 --2- 172.21.15.17:0/2206812192 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f9dd806ac00 0x7f9dd806d0c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9dec010c00 tx=0x7f9dec012040 comp rx=0 tx=0).stop 2024-03-12T17:20:14.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.130+0000 7f9e00a00640 1 -- 172.21.15.17:0/2206812192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dfc0cd850 msgr2=0x7f9dfc141ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:14.124 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.130+0000 7f9e00a00640 1 --2- 172.21.15.17:0/2206812192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dfc0cd850 0x7f9dfc141ab0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9df400c700 tx=0x7f9df400cbc0 comp rx=0 tx=0).stop 2024-03-12T17:20:14.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.130+0000 7f9e00a00640 1 -- 172.21.15.17:0/2206812192 shutdown_connections 2024-03-12T17:20:14.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.130+0000 7f9e00a00640 1 --2- 172.21.15.17:0/2206812192 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f9dd806ac00 0x7f9dd806d0c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:14.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.130+0000 7f9e00a00640 1 --2- 172.21.15.17:0/2206812192 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9dfc0cd850 0x7f9dfc141ab0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:14.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.130+0000 7f9e00a00640 1 --2- 172.21.15.17:0/2206812192 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9dfc0cb930 0x7f9dfc0acaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:14.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.130+0000 7f9e00a00640 1 --2- 172.21.15.17:0/2206812192 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9dfc0b23e0 0x7f9dfc0a7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:14.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.130+0000 7f9e00a00640 1 -- 172.21.15.17:0/2206812192 >> 172.21.15.17:0/2206812192 conn(0x7f9dfc069ce0 msgr2=0x7f9dfc142680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:14.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.130+0000 7f9e00a00640 1 -- 172.21.15.17:0/2206812192 shutdown_connections 2024-03-12T17:20:14.125 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.130+0000 7f9e00a00640 1 -- 172.21.15.17:0/2206812192 wait complete. 2024-03-12T17:20:14.144 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-12T17:20:14.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.369+0000 7f1d06400640 1 Processor -- start 2024-03-12T17:20:14.363 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.369+0000 7f1d06400640 1 -- start start 2024-03-12T17:20:14.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.370+0000 7f1d06400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1d000b5b50 0x7f1d000b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:14.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.370+0000 7f1d06400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f1d000cd840 0x7f1d000cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:14.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.371+0000 7f1d06400640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d000d14e0 con 0x7f1d000d2fa0 2024-03-12T17:20:14.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.371+0000 7f1d06400640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d000b59e0 con 0x7f1d000cd840 2024-03-12T17:20:14.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.371+0000 7f1d06400640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d000b85b0 con 0x7f1d000b5b50 2024-03-12T17:20:14.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.371+0000 7f1cff400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f1d000d2fa0 0x7f1d000d3380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53152/0 (socket says 172.21.15.17:53152) 2024-03-12T17:20:14.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.371+0000 7f1cff400640 1 -- 172.21.15.17:0/2550241050 learned_addr learned my addr 172.21.15.17:0/2550241050 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:20:14.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.371+0000 7f1cffe00640 1 --2- 172.21.15.17:0/2550241050 >> v2:172.21.15.17:3300/0 conn(0x7f1d000cd840 0x7f1d000cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:14.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.371+0000 7f1cfea00640 1 --2- 172.21.15.17:0/2550241050 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1d000b5b50 0x7f1d000b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:14.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.372+0000 7f1cfe000640 1 -- 172.21.15.17:0/2550241050 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2946747112 0 0) 0x7f1d000d14e0 con 0x7f1d000d2fa0 2024-03-12T17:20:14.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.372+0000 7f1cfe000640 1 -- 172.21.15.17:0/2550241050 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ce4003520 con 0x7f1d000d2fa0 2024-03-12T17:20:14.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.372+0000 7f1cffe00640 1 -- 172.21.15.17:0/2550241050 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1d000b5b50 msgr2=0x7f1d000b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:14.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.372+0000 7f1cffe00640 1 --2- 172.21.15.17:0/2550241050 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1d000b5b50 0x7f1d000b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:14.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.372+0000 7f1cffe00640 1 -- 172.21.15.17:0/2550241050 >> v1:172.21.15.17:6789/0 conn(0x7f1d000d2fa0 legacy=0x7f1d000d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:14.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.372+0000 7f1cffe00640 1 -- 172.21.15.17:0/2550241050 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d000b8890 con 0x7f1d000cd840 2024-03-12T17:20:14.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.373+0000 7f1cffe00640 1 --2- 172.21.15.17:0/2550241050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d000cd840 0x7f1d000cdcd0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1cf80097a0 tx=0x7f1cf802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=930c342040361546 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:14.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.373+0000 7f1cfe000640 1 -- 172.21.15.17:0/2550241050 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf8031830 con 0x7f1d000cd840 2024-03-12T17:20:14.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.373+0000 7f1cfe000640 1 -- 172.21.15.17:0/2550241050 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf8031990 con 0x7f1d000cd840 2024-03-12T17:20:14.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.373+0000 7f1cfe000640 1 -- 172.21.15.17:0/2550241050 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf8031d00 con 0x7f1d000cd840 2024-03-12T17:20:14.368 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.374+0000 7f1d06400640 1 -- 172.21.15.17:0/2550241050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d000cd840 msgr2=0x7f1d000cdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:14.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.374+0000 7f1d06400640 1 --2- 172.21.15.17:0/2550241050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d000cd840 0x7f1d000cdcd0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f1cf80097a0 tx=0x7f1cf802b8d0 comp rx=0 tx=0).stop 2024-03-12T17:20:14.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.374+0000 7f1d06400640 1 -- 172.21.15.17:0/2550241050 shutdown_connections 2024-03-12T17:20:14.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.374+0000 7f1d06400640 1 --2- 172.21.15.17:0/2550241050 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d000cd840 0x7f1d000cdcd0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:14.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.374+0000 7f1d06400640 1 --2- 172.21.15.17:0/2550241050 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1d000b5b50 0x7f1d000b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:14.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.374+0000 7f1d06400640 1 -- 172.21.15.17:0/2550241050 >> 172.21.15.17:0/2550241050 conn(0x7f1d00065df0 msgr2=0x7f1d00066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:14.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.374+0000 7f1d06400640 1 -- 172.21.15.17:0/2550241050 shutdown_connections 2024-03-12T17:20:14.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.374+0000 7f1d06400640 1 -- 172.21.15.17:0/2550241050 wait complete. 2024-03-12T17:20:14.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.376+0000 7f1d06400640 1 Processor -- start 2024-03-12T17:20:14.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.376+0000 7f1d06400640 1 -- start start 2024-03-12T17:20:14.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.377+0000 7f1d06400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1d000b5b50 0x7f1d001f4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:14.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.377+0000 7f1d06400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d000cd840 0x7f1d0015d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:14.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.377+0000 7f1d06400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d000d2fa0 0x7f1d0015a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:14.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.377+0000 7f1d06400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d001f53b0 con 0x7f1d000d2fa0 2024-03-12T17:20:14.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.377+0000 7f1d06400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d001f2c90 con 0x7f1d000cd840 2024-03-12T17:20:14.372 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.377+0000 7f1d06400640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d001f20c0 con 0x7f1d000b5b50 2024-03-12T17:20:14.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.377+0000 7f1cffe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d000d2fa0 0x7f1d0015a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:14.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.377+0000 7f1cffe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d000d2fa0 0x7f1d0015a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55458/0 (socket says 172.21.15.17:55458) 2024-03-12T17:20:14.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.377+0000 7f1cffe00640 1 -- 172.21.15.17:0/4232717301 learned_addr learned my addr 172.21.15.17:0/4232717301 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:14.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.378+0000 7f1cff400640 1 --2- 172.21.15.17:0/4232717301 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1d000b5b50 0x7f1d001f4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:14.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.378+0000 7f1cfea00640 1 --2- 172.21.15.17:0/4232717301 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d000cd840 0x7f1d0015d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:14.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.378+0000 7f1cffe00640 1 -- 172.21.15.17:0/4232717301 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1d000b5b50 msgr2=0x7f1d001f4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:14.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.378+0000 7f1cffe00640 1 --2- 172.21.15.17:0/4232717301 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1d000b5b50 0x7f1d001f4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:14.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.378+0000 7f1cffe00640 1 -- 172.21.15.17:0/4232717301 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d000cd840 msgr2=0x7f1d0015d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:14.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.378+0000 7f1cffe00640 1 --2- 172.21.15.17:0/4232717301 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d000cd840 0x7f1d0015d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:14.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.378+0000 7f1cffe00640 1 -- 172.21.15.17:0/4232717301 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf8009400 con 0x7f1d000d2fa0 2024-03-12T17:20:14.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.378+0000 7f1cffe00640 1 --2- 172.21.15.17:0/4232717301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d000d2fa0 0x7f1d0015a440 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1cf802b910 tx=0x7f1cf80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:14.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.379+0000 7f1cf7400640 1 -- 172.21.15.17:0/4232717301 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf803a630 con 0x7f1d000d2fa0 2024-03-12T17:20:14.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.379+0000 7f1cf7400640 1 -- 172.21.15.17:0/4232717301 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf803a7b0 con 0x7f1d000d2fa0 2024-03-12T17:20:14.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.379+0000 7f1cf7400640 1 -- 172.21.15.17:0/4232717301 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf803ab60 con 0x7f1d000d2fa0 2024-03-12T17:20:14.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.379+0000 7f1d06400640 1 -- 172.21.15.17:0/4232717301 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d001f3120 con 0x7f1d000d2fa0 2024-03-12T17:20:14.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.379+0000 7f1d06400640 1 -- 172.21.15.17:0/4232717301 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d001f2640 con 0x7f1d000d2fa0 2024-03-12T17:20:14.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.380+0000 7f1d06400640 1 -- 172.21.15.17:0/4232717301 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d001f2e00 con 0x7f1d000d2fa0 2024-03-12T17:20:14.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.381+0000 7f1cf7400640 1 -- 172.21.15.17:0/4232717301 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f1cf803acc0 con 0x7f1d000d2fa0 2024-03-12T17:20:14.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.382+0000 7f1cf7400640 1 --2- 172.21.15.17:0/4232717301 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f1cdc06ac00 0x7f1cdc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:14.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.382+0000 7f1cf7400640 1 -- 172.21.15.17:0/4232717301 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1cf80ab0f0 con 0x7f1d000d2fa0 2024-03-12T17:20:14.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.382+0000 7f1cff400640 1 --2- 172.21.15.17:0/4232717301 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f1cdc06ac00 0x7f1cdc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:14.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.383+0000 7f1cff400640 1 --2- 172.21.15.17:0/4232717301 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f1cdc06ac00 0x7f1cdc06d0c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8000f60 tx=0x7f1ce8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:14.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.386+0000 7f1cf7400640 1 -- 172.21.15.17:0/4232717301 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f1cf8076230 con 0x7f1d000d2fa0 2024-03-12T17:20:14.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.623+0000 7f1d06400640 1 -- 172.21.15.17:0/4232717301 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d000736c0 con 0x7f1d000d2fa0 2024-03-12T17:20:14.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.624+0000 7f1cf7400640 1 -- 172.21.15.17:0/4232717301 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) v1 ==== 94+0+4728 (secure 0 0 0) 0x7f1cf8079850 con 0x7f1d000d2fa0 2024-03-12T17:20:14.618 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:20:14.619 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6834/934570591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":934570591},{"type":"v1","addr":"172.21.15.94:6834","nonce":934570591}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/2007868406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6833","nonce":2007868406},{"type":"v1","addr":"172.21.15.94:6835","nonce":2007868406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4768,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6836/2733057827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2733057827},{"type":"v1","addr":"172.21.15.17:6836","nonce":2733057827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T17:19:55.522204+0000","modified":"2024-03-12T17:19:58.531800+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5058},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5058":{"gid":5058,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":4,"addr":"172.21.15.17:6837/672288094","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6835","nonce":672288094},{"type":"v1","addr":"172.21.15.17:6837","nonce":672288094}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-03-12T17:20:14.619 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 14 2024-03-12T17:20:14.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.627+0000 7f1d06400640 1 -- 172.21.15.17:0/4232717301 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f1cdc06ac00 msgr2=0x7f1cdc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:14.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.627+0000 7f1d06400640 1 --2- 172.21.15.17:0/4232717301 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f1cdc06ac00 0x7f1cdc06d0c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1ce8000f60 tx=0x7f1ce8009040 comp rx=0 tx=0).stop 2024-03-12T17:20:14.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.627+0000 7f1d06400640 1 -- 172.21.15.17:0/4232717301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d000d2fa0 msgr2=0x7f1d0015a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:14.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.627+0000 7f1d06400640 1 --2- 172.21.15.17:0/4232717301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d000d2fa0 0x7f1d0015a440 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f1cf802b910 tx=0x7f1cf80046c0 comp rx=0 tx=0).stop 2024-03-12T17:20:14.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.627+0000 7f1d06400640 1 -- 172.21.15.17:0/4232717301 shutdown_connections 2024-03-12T17:20:14.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.627+0000 7f1d06400640 1 --2- 172.21.15.17:0/4232717301 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f1cdc06ac00 0x7f1cdc06d0c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:14.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.627+0000 7f1d06400640 1 --2- 172.21.15.17:0/4232717301 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d000d2fa0 0x7f1d0015a440 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:14.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.627+0000 7f1d06400640 1 --2- 172.21.15.17:0/4232717301 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d000cd840 0x7f1d0015d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:14.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.627+0000 7f1d06400640 1 --2- 172.21.15.17:0/4232717301 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1d000b5b50 0x7f1d001f4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:14.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.627+0000 7f1d06400640 1 -- 172.21.15.17:0/4232717301 >> 172.21.15.17:0/4232717301 conn(0x7f1d00065df0 msgr2=0x7f1d000cf7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:14.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.627+0000 7f1d06400640 1 -- 172.21.15.17:0/4232717301 shutdown_connections 2024-03-12T17:20:14.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.627+0000 7f1d06400640 1 -- 172.21.15.17:0/4232717301 wait complete. 2024-03-12T17:20:14.640 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T17:20:14.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.866+0000 7faba5400640 1 Processor -- start 2024-03-12T17:20:14.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.867+0000 7faba5400640 1 -- start start 2024-03-12T17:20:14.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.868+0000 7faba5400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7faba015caa0 0x7faba0160790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:14.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.868+0000 7faba5400640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faba0161650 con 0x7faba00cfa40 2024-03-12T17:20:14.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.868+0000 7faba5400640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faba0161090 con 0x7faba015ce80 2024-03-12T17:20:14.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.868+0000 7faba5400640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faba0161370 con 0x7faba015caa0 2024-03-12T17:20:14.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.869+0000 7fab9fe00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7faba015caa0 0x7faba0160790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:14.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.869+0000 7fab9fe00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7faba015caa0 0x7faba0160790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55474/0 (socket says 172.21.15.17:55474) 2024-03-12T17:20:14.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.869+0000 7fab9fe00640 1 -- 172.21.15.17:0/1015949073 learned_addr learned my addr 172.21.15.17:0/1015949073 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:14.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.869+0000 7fab9fe00640 1 -- 172.21.15.17:0/1015949073 >> v1:172.21.15.94:6789/0 conn(0x7faba015ce80 legacy=0x7faba00cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:14.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.869+0000 7fab9fe00640 1 -- 172.21.15.17:0/1015949073 >> v1:172.21.15.17:6789/0 conn(0x7faba00cfa40 legacy=0x7faba00d12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:14.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.869+0000 7fab9fe00640 1 -- 172.21.15.17:0/1015949073 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba00d0ad0 con 0x7faba015caa0 2024-03-12T17:20:14.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.871+0000 7fab9fe00640 1 --2- 172.21.15.17:0/1015949073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faba015caa0 0x7faba0160790 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fab90009870 tx=0x7fab9002b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ced30117c6207 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:14.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.871+0000 7fab9ea00640 1 -- 172.21.15.17:0/1015949073 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab90030850 con 0x7faba015caa0 2024-03-12T17:20:14.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.871+0000 7fab9ea00640 1 -- 172.21.15.17:0/1015949073 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab900309b0 con 0x7faba015caa0 2024-03-12T17:20:14.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.871+0000 7fab9ea00640 1 -- 172.21.15.17:0/1015949073 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab90030d40 con 0x7faba015caa0 2024-03-12T17:20:14.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.872+0000 7faba5400640 1 -- 172.21.15.17:0/1015949073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faba015caa0 msgr2=0x7faba0160790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:14.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.872+0000 7faba5400640 1 --2- 172.21.15.17:0/1015949073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faba015caa0 0x7faba0160790 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fab90009870 tx=0x7fab9002b990 comp rx=0 tx=0).stop 2024-03-12T17:20:14.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.872+0000 7faba5400640 1 -- 172.21.15.17:0/1015949073 shutdown_connections 2024-03-12T17:20:14.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.872+0000 7faba5400640 1 --2- 172.21.15.17:0/1015949073 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faba015caa0 0x7faba0160790 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:14.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.872+0000 7faba5400640 1 -- 172.21.15.17:0/1015949073 >> 172.21.15.17:0/1015949073 conn(0x7faba006b160 msgr2=0x7faba006b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:14.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.872+0000 7faba5400640 1 -- 172.21.15.17:0/1015949073 shutdown_connections 2024-03-12T17:20:14.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.872+0000 7faba5400640 1 -- 172.21.15.17:0/1015949073 wait complete. 2024-03-12T17:20:14.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.874+0000 7faba5400640 1 Processor -- start 2024-03-12T17:20:14.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.874+0000 7faba5400640 1 -- start start 2024-03-12T17:20:14.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.875+0000 7faba5400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faba00cfa40 0x7faba0150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:14.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.875+0000 7faba5400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faba015caa0 0x7faba00caa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:14.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.875+0000 7faba5400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faba015ce80 0x7faba00caf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:14.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.875+0000 7faba5400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba00b6190 con 0x7faba015caa0 2024-03-12T17:20:14.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.875+0000 7faba5400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faba00cb5e0 con 0x7faba00cfa40 2024-03-12T17:20:14.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.875+0000 7faba5400640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faba00cb8c0 con 0x7faba015ce80 2024-03-12T17:20:14.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.875+0000 7fab9f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faba015caa0 0x7faba00caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:14.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.875+0000 7fab9f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faba015caa0 0x7faba00caa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55482/0 (socket says 172.21.15.17:55482) 2024-03-12T17:20:14.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.875+0000 7fab9f400640 1 -- 172.21.15.17:0/127637456 learned_addr learned my addr 172.21.15.17:0/127637456 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:14.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.875+0000 7fab9f400640 1 -- 172.21.15.17:0/127637456 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faba015ce80 msgr2=0x7faba00caf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:14.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.875+0000 7fab9f400640 1 --2- 172.21.15.17:0/127637456 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faba015ce80 0x7faba00caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:14.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.875+0000 7fab9f400640 1 -- 172.21.15.17:0/127637456 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faba00cfa40 msgr2=0x7faba0150d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:14.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.875+0000 7fab9f400640 1 --2- 172.21.15.17:0/127637456 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faba00cfa40 0x7faba0150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:14.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.875+0000 7fab9f400640 1 -- 172.21.15.17:0/127637456 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab900094d0 con 0x7faba015caa0 2024-03-12T17:20:14.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.876+0000 7fab9f400640 1 --2- 172.21.15.17:0/127637456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faba015caa0 0x7faba00caa40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fab8800b9e0 tx=0x7fab8800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:14.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.876+0000 7fab97e00640 1 -- 172.21.15.17:0/127637456 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8800cba0 con 0x7faba015caa0 2024-03-12T17:20:14.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.876+0000 7fab97e00640 1 -- 172.21.15.17:0/127637456 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8800cd00 con 0x7faba015caa0 2024-03-12T17:20:14.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.876+0000 7fab97e00640 1 -- 172.21.15.17:0/127637456 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab88014680 con 0x7faba015caa0 2024-03-12T17:20:14.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.876+0000 7faba5400640 1 -- 172.21.15.17:0/127637456 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faba00cbba0 con 0x7faba015caa0 2024-03-12T17:20:14.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.876+0000 7faba5400640 1 -- 172.21.15.17:0/127637456 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faba00cc160 con 0x7faba015caa0 2024-03-12T17:20:14.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.877+0000 7faba5400640 1 -- 172.21.15.17:0/127637456 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faba0072360 con 0x7faba015caa0 2024-03-12T17:20:14.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.878+0000 7fab97e00640 1 -- 172.21.15.17:0/127637456 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fab880147e0 con 0x7faba015caa0 2024-03-12T17:20:14.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.879+0000 7fab97e00640 1 --2- 172.21.15.17:0/127637456 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fab7c06ac00 0x7fab7c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:14.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.879+0000 7fab97e00640 1 -- 172.21.15.17:0/127637456 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab88089260 con 0x7faba015caa0 2024-03-12T17:20:14.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.879+0000 7fab9fe00640 1 --2- 172.21.15.17:0/127637456 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fab7c06ac00 0x7fab7c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:14.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.880+0000 7fab9fe00640 1 --2- 172.21.15.17:0/127637456 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fab7c06ac00 0x7fab7c06d0c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fab90036000 tx=0x7fab9003b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:14.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:14.883+0000 7fab97e00640 1 -- 172.21.15.17:0/127637456 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fab88054450 con 0x7faba015caa0 2024-03-12T17:20:15.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.081+0000 7faba5400640 1 -- 172.21.15.17:0/127637456 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faba00cd010 con 0x7faba015caa0 2024-03-12T17:20:15.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.083+0000 7fab97e00640 1 -- 172.21.15.17:0/127637456 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16053 (secure 0 0 0) 0x7fab88057a70 con 0x7faba015caa0 2024-03-12T17:20:15.078 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:20:15.078 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":35,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:19:56.525877+0000","last_up_change":"2024-03-12T17:18:38.144756+0000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-12T17:18:39.552910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-12T17:19:53.519967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-12T17:19:54.546388+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":37305},{"type":"v1","addr":"172.21.15.17:6801","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":37305},{"type":"v1","addr":"172.21.15.17:6803","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":37305},{"type":"v1","addr":"172.21.15.17:6807","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":37305},{"type":"v1","addr":"172.21.15.17:6805","nonce":37305}]},"public_addr":"172.21.15.17:6801/37305","cluster_addr":"172.21.15.17:6803/37305","heartbeat_back_addr":"172.21.15.17:6807/37305","heartbeat_front_addr":"172.21.15.17:6805/37305","state":["exists","up"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":37307},{"type":"v1","addr":"172.21.15.17:6814","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":37307},{"type":"v1","addr":"172.21.15.17:6818","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":37307},{"type":"v1","addr":"172.21.15.17:6827","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":37307},{"type":"v1","addr":"172.21.15.17:6823","nonce":37307}]},"public_addr":"172.21.15.17:6814/37307","cluster_addr":"172.21.15.17:6818/37307","heartbeat_back_addr":"172.21.15.17:6827/37307","heartbeat_front_addr":"172.21.15.17:6823/37307","state":["exists","up"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":37303},{"type":"v1","addr":"172.21.15.17:6809","nonce":37303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":37303},{"type":"v1","addr":"172.21.15.17:6811","nonce":37303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":37303},{"type":"v1","addr":"172.21.15.17:6819","nonce":37303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":37303},{"type":"v1","addr":"172.21.15.17:6815","nonce":37303}]},"public_addr":"172.21.15.17:6809/37303","cluster_addr":"172.21.15.17:6811/37303","heartbeat_back_addr":"172.21.15.17:6819/37303","heartbeat_front_addr":"172.21.15.17:6815/37303","state":["exists","up"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":37308},{"type":"v1","addr":"172.21.15.17:6822","nonce":37308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":37308},{"type":"v1","addr":"172.21.15.17:6826","nonce":37308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":37308},{"type":"v1","addr":"172.21.15.17:6831","nonce":37308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":37308},{"type":"v1","addr":"172.21.15.17:6829","nonce":37308}]},"public_addr":"172.21.15.17:6822/37308","cluster_addr":"172.21.15.17:6826/37308","heartbeat_back_addr":"172.21.15.17:6831/37308","heartbeat_front_addr":"172.21.15.17:6829/37308","state":["exists","up"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":37465},{"type":"v1","addr":"172.21.15.94:6809","nonce":37465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6811","nonce":37465},{"type":"v1","addr":"172.21.15.94:6813","nonce":37465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6819","nonce":37465},{"type":"v1","addr":"172.21.15.94:6822","nonce":37465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6815","nonce":37465},{"type":"v1","addr":"172.21.15.94:6817","nonce":37465}]},"public_addr":"172.21.15.94:6809/37465","cluster_addr":"172.21.15.94:6813/37465","heartbeat_back_addr":"172.21.15.94:6822/37465","heartbeat_front_addr":"172.21.15.94:6817/37465","state":["exists","up"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":37464},{"type":"v1","addr":"172.21.15.94:6812","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":37464},{"type":"v1","addr":"172.21.15.94:6816","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":37464},{"type":"v1","addr":"172.21.15.94:6823","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":37464},{"type":"v1","addr":"172.21.15.94:6820","nonce":37464}]},"public_addr":"172.21.15.94:6812/37464","cluster_addr":"172.21.15.94:6816/37464","heartbeat_back_addr":"172.21.15.94:6823/37464","heartbeat_front_addr":"172.21.15.94:6820/37464","state":["exists","up"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":37467},{"type":"v1","addr":"172.21.15.94:6825","nonce":37467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":37467},{"type":"v1","addr":"172.21.15.94:6827","nonce":37467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":37467},{"type":"v1","addr":"172.21.15.94:6831","nonce":37467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":37467},{"type":"v1","addr":"172.21.15.94:6829","nonce":37467}]},"public_addr":"172.21.15.94:6825/37467","cluster_addr":"172.21.15.94:6827/37467","heartbeat_back_addr":"172.21.15.94:6831/37467","heartbeat_front_addr":"172.21.15.94:6829/37467","state":["exists","up"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":37466},{"type":"v1","addr":"172.21.15.94:6801","nonce":37466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":37466},{"type":"v1","addr":"172.21.15.94:6803","nonce":37466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":37466},{"type":"v1","addr":"172.21.15.94:6807","nonce":37466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":37466},{"type":"v1","addr":"172.21.15.94:6805","nonce":37466}]},"public_addr":"172.21.15.94:6801/37466","cluster_addr":"172.21.15.94:6803/37466","heartbeat_back_addr":"172.21.15.94:6807/37466","heartbeat_front_addr":"172.21.15.94:6805/37466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.327217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.186966+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.419986+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.150585+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.120621+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.121576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.181257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.293188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:20:15.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.086+0000 7faba5400640 1 -- 172.21.15.17:0/127637456 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fab7c06ac00 msgr2=0x7fab7c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:15.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.086+0000 7faba5400640 1 --2- 172.21.15.17:0/127637456 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fab7c06ac00 0x7fab7c06d0c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fab90036000 tx=0x7fab9003b040 comp rx=0 tx=0).stop 2024-03-12T17:20:15.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.086+0000 7faba5400640 1 -- 172.21.15.17:0/127637456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faba015caa0 msgr2=0x7faba00caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:15.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.086+0000 7faba5400640 1 --2- 172.21.15.17:0/127637456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faba015caa0 0x7faba00caa40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fab8800b9e0 tx=0x7fab8800bea0 comp rx=0 tx=0).stop 2024-03-12T17:20:15.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.086+0000 7faba5400640 1 -- 172.21.15.17:0/127637456 shutdown_connections 2024-03-12T17:20:15.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.086+0000 7faba5400640 1 --2- 172.21.15.17:0/127637456 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fab7c06ac00 0x7fab7c06d0c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:15.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.086+0000 7faba5400640 1 --2- 172.21.15.17:0/127637456 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faba015ce80 0x7faba00caf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:15.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.086+0000 7faba5400640 1 --2- 172.21.15.17:0/127637456 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faba015caa0 0x7faba00caa40 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:15.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.086+0000 7faba5400640 1 --2- 172.21.15.17:0/127637456 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faba00cfa40 0x7faba0150d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:15.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.086+0000 7faba5400640 1 -- 172.21.15.17:0/127637456 >> 172.21.15.17:0/127637456 conn(0x7faba006b160 msgr2=0x7faba006b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:15.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.086+0000 7faba5400640 1 -- 172.21.15.17:0/127637456 shutdown_connections 2024-03-12T17:20:15.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.086+0000 7faba5400640 1 -- 172.21.15.17:0/127637456 wait complete. 2024-03-12T17:20:15.099 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-12T17:20:15.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.328+0000 7feb53000640 1 Processor -- start 2024-03-12T17:20:15.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.328+0000 7feb53000640 1 -- start start 2024-03-12T17:20:15.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.330+0000 7feb53000640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7feb4c160430 0x7feb4c160910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:15.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.330+0000 7feb53000640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb4c0d0150 con 0x7feb4c099500 2024-03-12T17:20:15.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.330+0000 7feb53000640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb4c0b1db0 con 0x7feb4c0b0000 2024-03-12T17:20:15.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.330+0000 7feb53000640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb4c0d0680 con 0x7feb4c160430 2024-03-12T17:20:15.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.330+0000 7feb4b400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7feb4c099500 0x7feb4c160e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53174/0 (socket says 172.21.15.17:53174) 2024-03-12T17:20:15.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.330+0000 7feb4b400640 1 -- 172.21.15.17:0/1856880332 learned_addr learned my addr 172.21.15.17:0/1856880332 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:20:15.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.330+0000 7feb4be00640 1 --2- 172.21.15.17:0/1856880332 >> v2:172.21.15.94:3300/0 conn(0x7feb4c160430 0x7feb4c160910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:15.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.331+0000 7feb4aa00640 1 -- 172.21.15.17:0/1856880332 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 917402880 0 0) 0x7feb4c0d0150 con 0x7feb4c099500 2024-03-12T17:20:15.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.331+0000 7feb4aa00640 1 -- 172.21.15.17:0/1856880332 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb30003520 con 0x7feb4c099500 2024-03-12T17:20:15.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.331+0000 7feb4aa00640 1 -- 172.21.15.17:0/1856880332 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 559046555 0 0) 0x7feb30003520 con 0x7feb4c099500 2024-03-12T17:20:15.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.331+0000 7feb4aa00640 1 -- 172.21.15.17:0/1856880332 >> v2:172.21.15.94:3300/0 conn(0x7feb4c160430 msgr2=0x7feb4c160910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:15.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.331+0000 7feb4aa00640 1 --2- 172.21.15.17:0/1856880332 >> v2:172.21.15.94:3300/0 conn(0x7feb4c160430 0x7feb4c160910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:15.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.331+0000 7feb4aa00640 1 -- 172.21.15.17:0/1856880332 >> v1:172.21.15.94:6789/0 conn(0x7feb4c0b0000 legacy=0x7feb4c0b0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:15.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.331+0000 7feb4aa00640 1 -- 172.21.15.17:0/1856880332 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb4c0ce970 con 0x7feb4c099500 2024-03-12T17:20:15.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.331+0000 7feb4aa00640 1 -- 172.21.15.17:0/1856880332 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7feb38001670 con 0x7feb4c099500 2024-03-12T17:20:15.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.331+0000 7feb4aa00640 1 -- 172.21.15.17:0/1856880332 >> v1:172.21.15.17:6789/0 conn(0x7feb4c099500 legacy=0x7feb4c160e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:15.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.331+0000 7feb4aa00640 1 --2- 172.21.15.17:0/1856880332 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb30003970 0x7feb30003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:15.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.331+0000 7feb4aa00640 1 --2- 172.21.15.17:0/1856880332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb300047c0 0x7feb30004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:15.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.331+0000 7feb4aa00640 1 --2- 172.21.15.17:0/1856880332 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feb300052a0 0x7feb3000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:15.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.331+0000 7feb4aa00640 1 -- 172.21.15.17:0/1856880332 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4c0d0680 con 0x7feb300047c0 2024-03-12T17:20:15.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.331+0000 7feb4aa00640 1 -- 172.21.15.17:0/1856880332 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3000c170 con 0x7feb30003970 2024-03-12T17:20:15.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.331+0000 7feb4aa00640 1 -- 172.21.15.17:0/1856880332 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb3000c330 con 0x7feb300052a0 2024-03-12T17:20:15.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.332+0000 7feb4b400640 1 --2- 172.21.15.17:0/1856880332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb300047c0 0x7feb30004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:15.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.332+0000 7feb4be00640 1 --2- 172.21.15.17:0/1856880332 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb30003970 0x7feb30003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:15.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.332+0000 7feb51000640 1 --2- 172.21.15.17:0/1856880332 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feb300052a0 0x7feb3000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:15.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.332+0000 7feb4b400640 1 -- 172.21.15.17:0/1856880332 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feb300052a0 msgr2=0x7feb3000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:15.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.332+0000 7feb4b400640 1 --2- 172.21.15.17:0/1856880332 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feb300052a0 0x7feb3000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:15.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.332+0000 7feb4b400640 1 -- 172.21.15.17:0/1856880332 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb30003970 msgr2=0x7feb30003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:15.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.332+0000 7feb4b400640 1 --2- 172.21.15.17:0/1856880332 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb30003970 0x7feb30003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:15.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.332+0000 7feb4b400640 1 -- 172.21.15.17:0/1856880332 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb30003520 con 0x7feb300047c0 2024-03-12T17:20:15.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.332+0000 7feb51000640 1 -- 172.21.15.17:0/1856880332 reap_dead start 2024-03-12T17:20:15.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.333+0000 7feb4b400640 1 --2- 172.21.15.17:0/1856880332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb300047c0 0x7feb30004c40 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7feb3800c210 tx=0x7feb300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b344b86dfc405edf server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:15.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.334+0000 7feb4aa00640 1 -- 172.21.15.17:0/1856880332 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb38005ad0 con 0x7feb300047c0 2024-03-12T17:20:15.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.334+0000 7feb4aa00640 1 -- 172.21.15.17:0/1856880332 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb38005c30 con 0x7feb300047c0 2024-03-12T17:20:15.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.334+0000 7feb4aa00640 1 -- 172.21.15.17:0/1856880332 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3802cab0 con 0x7feb300047c0 2024-03-12T17:20:15.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.334+0000 7feb53000640 1 -- 172.21.15.17:0/1856880332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb300047c0 msgr2=0x7feb30004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:15.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.334+0000 7feb53000640 1 --2- 172.21.15.17:0/1856880332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb300047c0 0x7feb30004c40 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7feb3800c210 tx=0x7feb300057f0 comp rx=0 tx=0).stop 2024-03-12T17:20:15.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.334+0000 7feb53000640 1 -- 172.21.15.17:0/1856880332 shutdown_connections 2024-03-12T17:20:15.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.334+0000 7feb53000640 1 --2- 172.21.15.17:0/1856880332 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb300047c0 0x7feb30004c40 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:15.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.334+0000 7feb53000640 1 -- 172.21.15.17:0/1856880332 >> 172.21.15.17:0/1856880332 conn(0x7feb4c0b23d0 msgr2=0x7feb4c0b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:15.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.334+0000 7feb53000640 1 -- 172.21.15.17:0/1856880332 shutdown_connections 2024-03-12T17:20:15.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.334+0000 7feb53000640 1 -- 172.21.15.17:0/1856880332 wait complete. 2024-03-12T17:20:15.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.336+0000 7feb53000640 1 Processor -- start 2024-03-12T17:20:15.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.336+0000 7feb53000640 1 -- start start 2024-03-12T17:20:15.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.337+0000 7feb53000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feb300047c0 0x7feb4c0ce260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:15.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.337+0000 7feb53000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb4c149be0 0x7feb4c0cef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:15.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.338+0000 7feb4b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb4c149be0 0x7feb4c0cef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:15.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.338+0000 7feb4b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb4c149be0 0x7feb4c0cef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55498/0 (socket says 172.21.15.17:55498) 2024-03-12T17:20:15.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.338+0000 7feb53000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb4c14a020 0x7feb4c0cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:15.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.338+0000 7feb53000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4c1f5b40 con 0x7feb4c149be0 2024-03-12T17:20:15.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.338+0000 7feb4b400640 1 -- 172.21.15.17:0/4209080319 learned_addr learned my addr 172.21.15.17:0/4209080319 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:15.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.338+0000 7feb53000640 1 -- 172.21.15.17:0/4209080319 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4c1f5e20 con 0x7feb4c14a020 2024-03-12T17:20:15.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.338+0000 7feb53000640 1 -- 172.21.15.17:0/4209080319 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb4c1f6100 con 0x7feb300047c0 2024-03-12T17:20:15.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.338+0000 7feb4be00640 1 --2- 172.21.15.17:0/4209080319 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feb300047c0 0x7feb4c0ce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:15.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.339+0000 7feb4b400640 1 -- 172.21.15.17:0/4209080319 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feb300047c0 msgr2=0x7feb4c0ce260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:15.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.339+0000 7feb4b400640 1 --2- 172.21.15.17:0/4209080319 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feb300047c0 0x7feb4c0ce260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:15.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.339+0000 7feb51000640 1 --2- 172.21.15.17:0/4209080319 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb4c14a020 0x7feb4c0cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:15.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.339+0000 7feb4b400640 1 -- 172.21.15.17:0/4209080319 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb4c14a020 msgr2=0x7feb4c0cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:15.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.339+0000 7feb4b400640 1 --2- 172.21.15.17:0/4209080319 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb4c14a020 0x7feb4c0cf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:15.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.339+0000 7feb4b400640 1 -- 172.21.15.17:0/4209080319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb4c1f63e0 con 0x7feb4c149be0 2024-03-12T17:20:15.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.339+0000 7feb51000640 1 --2- 172.21.15.17:0/4209080319 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb4c14a020 0x7feb4c0cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:15.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.339+0000 7feb4b400640 1 --2- 172.21.15.17:0/4209080319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb4c149be0 0x7feb4c0cef90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7feb38001930 tx=0x7feb3802e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:15.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.339+0000 7feb43e00640 1 -- 172.21.15.17:0/4209080319 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb3803c040 con 0x7feb4c149be0 2024-03-12T17:20:15.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.339+0000 7feb43e00640 1 -- 172.21.15.17:0/4209080319 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb3802cc80 con 0x7feb4c149be0 2024-03-12T17:20:15.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.339+0000 7feb43e00640 1 -- 172.21.15.17:0/4209080319 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb38001670 con 0x7feb4c149be0 2024-03-12T17:20:15.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.339+0000 7feb53000640 1 -- 172.21.15.17:0/4209080319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb4c15f040 con 0x7feb4c149be0 2024-03-12T17:20:15.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.340+0000 7feb53000640 1 -- 172.21.15.17:0/4209080319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb4c1f58b0 con 0x7feb4c149be0 2024-03-12T17:20:15.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.341+0000 7feb53000640 1 -- 172.21.15.17:0/4209080319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb4c0736c0 con 0x7feb4c149be0 2024-03-12T17:20:15.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.343+0000 7feb43e00640 1 -- 172.21.15.17:0/4209080319 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7feb38032070 con 0x7feb4c149be0 2024-03-12T17:20:15.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.344+0000 7feb43e00640 1 --2- 172.21.15.17:0/4209080319 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7feb2c06ac00 0x7feb2c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:15.338 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.344+0000 7feb43e00640 1 -- 172.21.15.17:0/4209080319 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb380aa990 con 0x7feb4c149be0 2024-03-12T17:20:15.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.344+0000 7feb4be00640 1 --2- 172.21.15.17:0/4209080319 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7feb2c06ac00 0x7feb2c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:15.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.345+0000 7feb4be00640 1 --2- 172.21.15.17:0/4209080319 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7feb2c06ac00 0x7feb2c06d0c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7feb3c009b40 tx=0x7feb3c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:15.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.347+0000 7feb43e00640 1 -- 172.21.15.17:0/4209080319 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7feb38075e00 con 0x7feb4c149be0 2024-03-12T17:20:15.582 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.588+0000 7feb53000640 1 -- 172.21.15.17:0/4209080319 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7feb4c1f6240 con 0x7feb4c149be0 2024-03-12T17:20:15.583 INFO:tasks.ceph.mon.a.smithi017.stderr:2024-03-12T17:20:15.589+0000 7f30e5800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-12T17:20:15.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.603+0000 7feb43e00640 1 -- 172.21.15.17:0/4209080319 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v15) v1 ==== 161+0+0 (secure 0 0 0) 0x7feb4c1f6240 con 0x7feb4c149be0 2024-03-12T17:20:15.597 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-12T17:20:15.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.605+0000 7feb53000640 1 -- 172.21.15.17:0/4209080319 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7feb2c06ac00 msgr2=0x7feb2c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:15.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.605+0000 7feb53000640 1 --2- 172.21.15.17:0/4209080319 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7feb2c06ac00 0x7feb2c06d0c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7feb3c009b40 tx=0x7feb3c008040 comp rx=0 tx=0).stop 2024-03-12T17:20:15.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.605+0000 7feb53000640 1 -- 172.21.15.17:0/4209080319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb4c149be0 msgr2=0x7feb4c0cef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:15.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.605+0000 7feb53000640 1 --2- 172.21.15.17:0/4209080319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb4c149be0 0x7feb4c0cef90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7feb38001930 tx=0x7feb3802e070 comp rx=0 tx=0).stop 2024-03-12T17:20:15.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.606+0000 7feb53000640 1 -- 172.21.15.17:0/4209080319 shutdown_connections 2024-03-12T17:20:15.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.606+0000 7feb53000640 1 --2- 172.21.15.17:0/4209080319 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7feb2c06ac00 0x7feb2c06d0c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:15.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.606+0000 7feb53000640 1 --2- 172.21.15.17:0/4209080319 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb4c14a020 0x7feb4c0cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:15.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.606+0000 7feb53000640 1 --2- 172.21.15.17:0/4209080319 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb4c149be0 0x7feb4c0cef90 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:15.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.606+0000 7feb53000640 1 --2- 172.21.15.17:0/4209080319 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feb300047c0 0x7feb4c0ce260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:15.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.606+0000 7feb53000640 1 -- 172.21.15.17:0/4209080319 >> 172.21.15.17:0/4209080319 conn(0x7feb4c0b23d0 msgr2=0x7feb4c06e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:15.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.606+0000 7feb53000640 1 -- 172.21.15.17:0/4209080319 shutdown_connections 2024-03-12T17:20:15.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.606+0000 7feb53000640 1 -- 172.21.15.17:0/4209080319 wait complete. 2024-03-12T17:20:15.607 INFO:tasks.ceph.mds.c.smithi017.stderr: -5757> 2024-03-12T17:19:57.627+0000 7f380b800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-12T17:20:15.619 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-12T17:20:15.663 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2024-03-12T17:20:15.799 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.805+0000 7f6bf9200640 1 Processor -- start 2024-03-12T17:20:15.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.805+0000 7f6bf9200640 1 -- start start 2024-03-12T17:20:15.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.807+0000 7f6bf9200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6bf40d2fa0 0x7f6bf40d3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:15.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.807+0000 7f6bf9200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bf40d14e0 con 0x7f6bf40b5b50 2024-03-12T17:20:15.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.807+0000 7f6bf9200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bf40d38c0 con 0x7f6bf40b5f70 2024-03-12T17:20:15.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.807+0000 7f6bf9200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf40b59e0 con 0x7f6bf40d2fa0 2024-03-12T17:20:15.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.807+0000 7f6bf1400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f6bf40b5b50 0x7f6bf40cd840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53192/0 (socket says 172.21.15.17:53192) 2024-03-12T17:20:15.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.807+0000 7f6bf1400640 1 -- 172.21.15.17:0/3730144152 learned_addr learned my addr 172.21.15.17:0/3730144152 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:20:15.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.807+0000 7f6bf1e00640 1 --2- 172.21.15.17:0/3730144152 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6bf40d2fa0 0x7f6bf40d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:15.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.807+0000 7f6bf0a00640 1 -- 172.21.15.17:0/3730144152 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1788489954 0 0) 0x7f6bf40d14e0 con 0x7f6bf40b5b50 2024-03-12T17:20:15.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.807+0000 7f6bf0a00640 1 -- 172.21.15.17:0/3730144152 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bd8003520 con 0x7f6bf40b5b50 2024-03-12T17:20:15.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.808+0000 7f6bf0a00640 1 -- 172.21.15.17:0/3730144152 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3890726921 0 0) 0x7f6bd8003520 con 0x7f6bf40b5b50 2024-03-12T17:20:15.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.808+0000 7f6bf0a00640 1 -- 172.21.15.17:0/3730144152 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6bf40d2fa0 msgr2=0x7f6bf40d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:15.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.808+0000 7f6bf0a00640 1 --2- 172.21.15.17:0/3730144152 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6bf40d2fa0 0x7f6bf40d3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:15.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.808+0000 7f6bf0a00640 1 -- 172.21.15.17:0/3730144152 >> v1:172.21.15.94:6789/0 conn(0x7f6bf40b5f70 legacy=0x7f6bf40d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:15.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.808+0000 7f6bf0a00640 1 -- 172.21.15.17:0/3730144152 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf40b85b0 con 0x7f6bf40b5b50 2024-03-12T17:20:15.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.808+0000 7f6bf0a00640 1 -- 172.21.15.17:0/3730144152 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7f6bdc001670 con 0x7f6bf40b5b50 2024-03-12T17:20:15.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.808+0000 7f6bf0a00640 1 -- 172.21.15.17:0/3730144152 >> v1:172.21.15.17:6789/0 conn(0x7f6bf40b5b50 legacy=0x7f6bf40cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:15.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.808+0000 7f6bf0a00640 1 --2- 172.21.15.17:0/3730144152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bd80039a0 0x7f6bd8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:15.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.808+0000 7f6bf0a00640 1 --2- 172.21.15.17:0/3730144152 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bd80047c0 0x7f6bd8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:15.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.808+0000 7f6bf0a00640 1 --2- 172.21.15.17:0/3730144152 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6bd8005180 0x7f6bd800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:15.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.808+0000 7f6bf0a00640 1 -- 172.21.15.17:0/3730144152 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd800bff0 con 0x7f6bd80039a0 2024-03-12T17:20:15.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.808+0000 7f6bf0a00640 1 -- 172.21.15.17:0/3730144152 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd800c160 con 0x7f6bd80047c0 2024-03-12T17:20:15.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.808+0000 7f6bf0a00640 1 -- 172.21.15.17:0/3730144152 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bd800c320 con 0x7f6bd8005180 2024-03-12T17:20:15.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.808+0000 7f6bf1e00640 1 --2- 172.21.15.17:0/3730144152 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6bf40d2fa0 0x7f6bf40d3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:20:15.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.808+0000 7f6bf1e00640 1 --2- 172.21.15.17:0/3730144152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bd80039a0 0x7f6bd8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:15.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.809+0000 7f6bf1400640 1 --2- 172.21.15.17:0/3730144152 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bd80047c0 0x7f6bd8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:15.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.809+0000 7f6bf2800640 1 --2- 172.21.15.17:0/3730144152 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6bd8005180 0x7f6bd800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:15.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.809+0000 7f6bf1e00640 1 -- 172.21.15.17:0/3730144152 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6bd8005180 msgr2=0x7f6bd800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:15.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.809+0000 7f6bf1e00640 1 --2- 172.21.15.17:0/3730144152 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6bd8005180 0x7f6bd800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:15.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.809+0000 7f6bf1e00640 1 -- 172.21.15.17:0/3730144152 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bd80047c0 msgr2=0x7f6bd8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:15.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.809+0000 7f6bf1e00640 1 --2- 172.21.15.17:0/3730144152 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bd80047c0 0x7f6bd8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:15.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.809+0000 7f6bf1e00640 1 -- 172.21.15.17:0/3730144152 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd8003520 con 0x7f6bd80039a0 2024-03-12T17:20:15.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.810+0000 7f6bf1e00640 1 --2- 172.21.15.17:0/3730144152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bd80039a0 0x7f6bd8003dc0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6be4006fd0 tx=0x7f6bd80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d926d97aa6883dca server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:15.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.811+0000 7f6bf0a00640 1 -- 172.21.15.17:0/3730144152 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be4033600 con 0x7f6bd80039a0 2024-03-12T17:20:15.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.811+0000 7f6bf0a00640 1 -- 172.21.15.17:0/3730144152 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be402f050 con 0x7f6bd80039a0 2024-03-12T17:20:15.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.811+0000 7f6bf0a00640 1 -- 172.21.15.17:0/3730144152 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be4033980 con 0x7f6bd80039a0 2024-03-12T17:20:15.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.811+0000 7f6bf9200640 1 -- 172.21.15.17:0/3730144152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bd80039a0 msgr2=0x7f6bd8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:15.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.811+0000 7f6bf9200640 1 --2- 172.21.15.17:0/3730144152 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bd80039a0 0x7f6bd8003dc0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6be4006fd0 tx=0x7f6bd80057f0 comp rx=0 tx=0).stop 2024-03-12T17:20:15.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.811+0000 7f6bf2800640 1 -- 172.21.15.17:0/3730144152 reap_dead start 2024-03-12T17:20:15.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.812+0000 7f6bf9200640 1 -- 172.21.15.17:0/3730144152 shutdown_connections 2024-03-12T17:20:15.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.812+0000 7f6bf9200640 1 -- 172.21.15.17:0/3730144152 >> 172.21.15.17:0/3730144152 conn(0x7f6bf4065df0 msgr2=0x7f6bf4066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:15.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.812+0000 7f6bf9200640 1 -- 172.21.15.17:0/3730144152 shutdown_connections 2024-03-12T17:20:15.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.812+0000 7f6bf9200640 1 -- 172.21.15.17:0/3730144152 wait complete. 2024-03-12T17:20:15.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.813+0000 7f6bf9200640 1 Processor -- start 2024-03-12T17:20:15.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.813+0000 7f6bf9200640 1 -- start start 2024-03-12T17:20:15.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.814+0000 7f6bf9200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bd80039a0 0x7f6bf4158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:15.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.814+0000 7f6bf9200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6bf41590b0 0x7f6bf40ca350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:15.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.814+0000 7f6bf9200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bf40ca890 0x7f6bf415d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:15.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.814+0000 7f6bf9200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf41f52c0 con 0x7f6bf40ca890 2024-03-12T17:20:15.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.814+0000 7f6bf9200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf40b1590 con 0x7f6bd80039a0 2024-03-12T17:20:15.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.814+0000 7f6bf9200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf40cad10 con 0x7f6bf41590b0 2024-03-12T17:20:15.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.815+0000 7f6bf2800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bf40ca890 0x7f6bf415d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:15.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.815+0000 7f6bf2800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bf40ca890 0x7f6bf415d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55522/0 (socket says 172.21.15.17:55522) 2024-03-12T17:20:15.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.815+0000 7f6bf2800640 1 -- 172.21.15.17:0/1538014575 learned_addr learned my addr 172.21.15.17:0/1538014575 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:15.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.815+0000 7f6bf1400640 1 --2- 172.21.15.17:0/1538014575 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6bf41590b0 0x7f6bf40ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:15.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.815+0000 7f6bf1e00640 1 --2- 172.21.15.17:0/1538014575 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bd80039a0 0x7f6bf4158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:15.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.815+0000 7f6bf2800640 1 -- 172.21.15.17:0/1538014575 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6bf41590b0 msgr2=0x7f6bf40ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:15.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.815+0000 7f6bf2800640 1 --2- 172.21.15.17:0/1538014575 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6bf41590b0 0x7f6bf40ca350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:15.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.815+0000 7f6bf2800640 1 -- 172.21.15.17:0/1538014575 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bd80039a0 msgr2=0x7f6bf4158b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:15.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.815+0000 7f6bf2800640 1 --2- 172.21.15.17:0/1538014575 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bd80039a0 0x7f6bf4158b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:15.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.815+0000 7f6bf2800640 1 -- 172.21.15.17:0/1538014575 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf40b12b0 con 0x7f6bf40ca890 2024-03-12T17:20:15.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.815+0000 7f6bf2800640 1 --2- 172.21.15.17:0/1538014575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bf40ca890 0x7f6bf415d340 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f6bf40b6350 tx=0x7f6bec00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:15.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.816+0000 7f6bea000640 1 -- 172.21.15.17:0/1538014575 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bec003970 con 0x7f6bf40ca890 2024-03-12T17:20:15.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.816+0000 7f6bea000640 1 -- 172.21.15.17:0/1538014575 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bec003af0 con 0x7f6bf40ca890 2024-03-12T17:20:15.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.816+0000 7f6bea000640 1 -- 172.21.15.17:0/1538014575 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bec003ea0 con 0x7f6bf40ca890 2024-03-12T17:20:15.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.816+0000 7f6bf9200640 1 -- 172.21.15.17:0/1538014575 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bf40c8ea0 con 0x7f6bf40ca890 2024-03-12T17:20:15.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.816+0000 7f6bf9200640 1 -- 172.21.15.17:0/1538014575 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bf40b0f30 con 0x7f6bf40ca890 2024-03-12T17:20:15.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.817+0000 7f6bf9200640 1 -- 172.21.15.17:0/1538014575 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bf40c8d00 con 0x7f6bf40ca890 2024-03-12T17:20:15.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.819+0000 7f6bea000640 1 -- 172.21.15.17:0/1538014575 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f6bec0050d0 con 0x7f6bf40ca890 2024-03-12T17:20:15.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.820+0000 7f6bea000640 1 --2- 172.21.15.17:0/1538014575 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f6bd006ac00 0x7f6bd006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:15.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.820+0000 7f6bea000640 1 -- 172.21.15.17:0/1538014575 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f6bec089240 con 0x7f6bf40ca890 2024-03-12T17:20:15.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.820+0000 7f6bf1e00640 1 --2- 172.21.15.17:0/1538014575 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f6bd006ac00 0x7f6bd006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:15.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.821+0000 7f6bf1e00640 1 --2- 172.21.15.17:0/1538014575 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f6bd006ac00 0x7f6bd006d0c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6be4036000 tx=0x7f6be4031000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:15.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:15.824+0000 7f6bea000640 1 -- 172.21.15.17:0/1538014575 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f6bf40c8d00 con 0x7f6bf40ca890 2024-03-12T17:20:16.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.055+0000 7f6bf9200640 1 -- 172.21.15.17:0/1538014575 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6bf40c8d00 con 0x7f6bf40ca890 2024-03-12T17:20:16.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.608+0000 7f6bea000640 1 -- 172.21.15.17:0/1538014575 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v16) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6bf40c8d00 con 0x7f6bf40ca890 2024-03-12T17:20:16.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.612+0000 7f6bf9200640 1 -- 172.21.15.17:0/1538014575 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f6bd006ac00 msgr2=0x7f6bd006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:16.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.612+0000 7f6bf9200640 1 --2- 172.21.15.17:0/1538014575 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f6bd006ac00 0x7f6bd006d0c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6be4036000 tx=0x7f6be4031000 comp rx=0 tx=0).stop 2024-03-12T17:20:16.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.612+0000 7f6bf9200640 1 -- 172.21.15.17:0/1538014575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bf40ca890 msgr2=0x7f6bf415d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:16.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.612+0000 7f6bf9200640 1 --2- 172.21.15.17:0/1538014575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bf40ca890 0x7f6bf415d340 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f6bf40b6350 tx=0x7f6bec00ec10 comp rx=0 tx=0).stop 2024-03-12T17:20:16.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.612+0000 7f6bf9200640 1 -- 172.21.15.17:0/1538014575 shutdown_connections 2024-03-12T17:20:16.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.612+0000 7f6bf9200640 1 --2- 172.21.15.17:0/1538014575 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f6bd006ac00 0x7f6bd006d0c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:16.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.612+0000 7f6bf9200640 1 --2- 172.21.15.17:0/1538014575 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bf40ca890 0x7f6bf415d340 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:16.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.612+0000 7f6bf9200640 1 --2- 172.21.15.17:0/1538014575 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6bf41590b0 0x7f6bf40ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:16.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.612+0000 7f6bf9200640 1 --2- 172.21.15.17:0/1538014575 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bd80039a0 0x7f6bf4158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:16.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.612+0000 7f6bf9200640 1 -- 172.21.15.17:0/1538014575 >> 172.21.15.17:0/1538014575 conn(0x7f6bf4065df0 msgr2=0x7f6bf40d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:16.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.612+0000 7f6bf9200640 1 -- 172.21.15.17:0/1538014575 shutdown_connections 2024-03-12T17:20:16.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.613+0000 7f6bf9200640 1 -- 172.21.15.17:0/1538014575 wait complete. 2024-03-12T17:20:16.628 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-12T17:20:16.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.902+0000 7fe18f200640 1 Processor -- start 2024-03-12T17:20:16.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.903+0000 7fe18f200640 1 -- start start 2024-03-12T17:20:16.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.904+0000 7fe18f200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe19015cb60 0x7fe1900cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:16.899 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.904+0000 7fe18f200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe190161140 0x7fe1900b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:16.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.904+0000 7fe18f200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1900b86a0 con 0x7fe1900b4910 2024-03-12T17:20:16.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.904+0000 7fe18f200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1900b8980 con 0x7fe19015cb60 2024-03-12T17:20:16.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.904+0000 7fe18f200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1900b4da0 con 0x7fe190161140 2024-03-12T17:20:16.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.905+0000 7fe18de00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe19015cb60 0x7fe1900cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:16.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.905+0000 7fe18e800640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fe1900b4910 0x7fe1900d0520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53198/0 (socket says 172.21.15.17:53198) 2024-03-12T17:20:16.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.905+0000 7fe18e800640 1 -- 172.21.15.17:0/3618803352 learned_addr learned my addr 172.21.15.17:0/3618803352 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:20:16.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.905+0000 7fe187e00640 1 --2- 172.21.15.17:0/3618803352 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe190161140 0x7fe1900b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:16.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.905+0000 7fe18de00640 1 -- 172.21.15.17:0/3618803352 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe190161140 msgr2=0x7fe1900b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:16.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.905+0000 7fe18de00640 1 --2- 172.21.15.17:0/3618803352 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe190161140 0x7fe1900b43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:16.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.905+0000 7fe18de00640 1 -- 172.21.15.17:0/3618803352 >> v1:172.21.15.17:6789/0 conn(0x7fe1900b4910 legacy=0x7fe1900d0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:16.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.905+0000 7fe18d400640 1 -- 172.21.15.17:0/3618803352 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1175824868 0 0) 0x7fe1900b86a0 con 0x7fe1900b4910 2024-03-12T17:20:16.900 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.905+0000 7fe18de00640 1 -- 172.21.15.17:0/3618803352 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1900cd140 con 0x7fe19015cb60 2024-03-12T17:20:16.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.906+0000 7fe18de00640 1 --2- 172.21.15.17:0/3618803352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe19015cb60 0x7fe1900cdc20 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe1800097a0 tx=0x7fe18002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef19f48165a85da server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:16.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.907+0000 7fe18d400640 1 -- 172.21.15.17:0/3618803352 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18002d040 con 0x7fe19015cb60 2024-03-12T17:20:16.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.907+0000 7fe18d400640 1 -- 172.21.15.17:0/3618803352 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe180031810 con 0x7fe19015cb60 2024-03-12T17:20:16.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.907+0000 7fe18d400640 1 -- 172.21.15.17:0/3618803352 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe180031ba0 con 0x7fe19015cb60 2024-03-12T17:20:16.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.907+0000 7fe18f200640 1 -- 172.21.15.17:0/3618803352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe19015cb60 msgr2=0x7fe1900cdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:16.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.907+0000 7fe18f200640 1 --2- 172.21.15.17:0/3618803352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe19015cb60 0x7fe1900cdc20 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe1800097a0 tx=0x7fe18002b8b0 comp rx=0 tx=0).stop 2024-03-12T17:20:16.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.907+0000 7fe18f200640 1 -- 172.21.15.17:0/3618803352 shutdown_connections 2024-03-12T17:20:16.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.907+0000 7fe18f200640 1 --2- 172.21.15.17:0/3618803352 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe190161140 0x7fe1900b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:16.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.907+0000 7fe18f200640 1 --2- 172.21.15.17:0/3618803352 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe19015cb60 0x7fe1900cdc20 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:16.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.907+0000 7fe18f200640 1 -- 172.21.15.17:0/3618803352 >> 172.21.15.17:0/3618803352 conn(0x7fe1900cf5b0 msgr2=0x7fe1900cf9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:16.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.908+0000 7fe18f200640 1 -- 172.21.15.17:0/3618803352 shutdown_connections 2024-03-12T17:20:16.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.908+0000 7fe18f200640 1 -- 172.21.15.17:0/3618803352 wait complete. 2024-03-12T17:20:16.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.909+0000 7fe18f200640 1 Processor -- start 2024-03-12T17:20:16.903 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.909+0000 7fe18f200640 1 -- start start 2024-03-12T17:20:16.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.910+0000 7fe18f200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe1900b4910 0x7fe1900cb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:16.905 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.910+0000 7fe18f200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe19015cb60 0x7fe1900ca550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:16.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.910+0000 7fe18f200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe190161140 0x7fe1901f1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:16.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.910+0000 7fe18f200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1900caa90 con 0x7fe190161140 2024-03-12T17:20:16.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.910+0000 7fe18f200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1900cb770 con 0x7fe19015cb60 2024-03-12T17:20:16.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.910+0000 7fe18f200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1900cba50 con 0x7fe1900b4910 2024-03-12T17:20:16.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.911+0000 7fe18e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe190161140 0x7fe1901f1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:16.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.911+0000 7fe18e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe190161140 0x7fe1901f1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55536/0 (socket says 172.21.15.17:55536) 2024-03-12T17:20:16.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.911+0000 7fe18e800640 1 -- 172.21.15.17:0/1510934420 learned_addr learned my addr 172.21.15.17:0/1510934420 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:16.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.911+0000 7fe18de00640 1 --2- 172.21.15.17:0/1510934420 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe1900b4910 0x7fe1900cb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:16.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.911+0000 7fe187e00640 1 --2- 172.21.15.17:0/1510934420 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe19015cb60 0x7fe1900ca550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:16.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.911+0000 7fe18e800640 1 -- 172.21.15.17:0/1510934420 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe1900b4910 msgr2=0x7fe1900cb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:16.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.911+0000 7fe18e800640 1 --2- 172.21.15.17:0/1510934420 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe1900b4910 0x7fe1900cb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:16.906 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.911+0000 7fe18e800640 1 -- 172.21.15.17:0/1510934420 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe19015cb60 msgr2=0x7fe1900ca550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:16.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.911+0000 7fe18e800640 1 --2- 172.21.15.17:0/1510934420 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe19015cb60 0x7fe1900ca550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:16.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.911+0000 7fe18e800640 1 -- 172.21.15.17:0/1510934420 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe180009400 con 0x7fe190161140 2024-03-12T17:20:16.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.912+0000 7fe18e800640 1 --2- 172.21.15.17:0/1510934420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe190161140 0x7fe1901f1bc0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe18800c7e0 tx=0x7fe18800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:16.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.912+0000 7fe186000640 1 -- 172.21.15.17:0/1510934420 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18800a640 con 0x7fe190161140 2024-03-12T17:20:16.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.912+0000 7fe186000640 1 -- 172.21.15.17:0/1510934420 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18800a7c0 con 0x7fe190161140 2024-03-12T17:20:16.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.912+0000 7fe186000640 1 -- 172.21.15.17:0/1510934420 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18800ab70 con 0x7fe190161140 2024-03-12T17:20:16.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.912+0000 7fe18f200640 1 -- 172.21.15.17:0/1510934420 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1900cbd30 con 0x7fe190161140 2024-03-12T17:20:16.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.912+0000 7fe18f200640 1 -- 172.21.15.17:0/1510934420 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1900cc2f0 con 0x7fe190161140 2024-03-12T17:20:16.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.913+0000 7fe18f200640 1 -- 172.21.15.17:0/1510934420 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe190067120 con 0x7fe190161140 2024-03-12T17:20:16.908 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.914+0000 7fe186000640 1 -- 172.21.15.17:0/1510934420 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fe18800acd0 con 0x7fe190161140 2024-03-12T17:20:16.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.915+0000 7fe186000640 1 --2- 172.21.15.17:0/1510934420 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe16c06ac00 0x7fe16c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:16.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.915+0000 7fe186000640 1 -- 172.21.15.17:0/1510934420 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe188088990 con 0x7fe190161140 2024-03-12T17:20:16.909 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.915+0000 7fe18de00640 1 --2- 172.21.15.17:0/1510934420 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe16c06ac00 0x7fe16c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:16.910 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.916+0000 7fe18de00640 1 --2- 172.21.15.17:0/1510934420 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe16c06ac00 0x7fe16c06d0c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe180036000 tx=0x7fe18003d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:16.913 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:16.919+0000 7fe186000640 1 -- 172.21.15.17:0/1510934420 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fe188053b20 con 0x7fe190161140 2024-03-12T17:20:17.108 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.113+0000 7fe18f200640 1 -- 172.21.15.17:0/1510934420 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe190072360 con 0x7fe190161140 2024-03-12T17:20:17.607 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.613+0000 7fe186000640 1 -- 172.21.15.17:0/1510934420 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v37) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe188018070 con 0x7fe190161140 2024-03-12T17:20:17.608 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2024-03-12T17:20:17.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.618+0000 7fe18f200640 1 -- 172.21.15.17:0/1510934420 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe16c06ac00 msgr2=0x7fe16c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:17.612 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.618+0000 7fe18f200640 1 --2- 172.21.15.17:0/1510934420 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe16c06ac00 0x7fe16c06d0c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe180036000 tx=0x7fe18003d040 comp rx=0 tx=0).stop 2024-03-12T17:20:17.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.618+0000 7fe18f200640 1 -- 172.21.15.17:0/1510934420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe190161140 msgr2=0x7fe1901f1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:17.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.618+0000 7fe18f200640 1 --2- 172.21.15.17:0/1510934420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe190161140 0x7fe1901f1bc0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe18800c7e0 tx=0x7fe18800cca0 comp rx=0 tx=0).stop 2024-03-12T17:20:17.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.619+0000 7fe18f200640 1 -- 172.21.15.17:0/1510934420 shutdown_connections 2024-03-12T17:20:17.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.619+0000 7fe18f200640 1 --2- 172.21.15.17:0/1510934420 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe16c06ac00 0x7fe16c06d0c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:17.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.619+0000 7fe18f200640 1 --2- 172.21.15.17:0/1510934420 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe190161140 0x7fe1901f1bc0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:17.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.619+0000 7fe18f200640 1 --2- 172.21.15.17:0/1510934420 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe19015cb60 0x7fe1900ca550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:17.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.619+0000 7fe18f200640 1 --2- 172.21.15.17:0/1510934420 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe1900b4910 0x7fe1900cb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:17.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.619+0000 7fe18f200640 1 -- 172.21.15.17:0/1510934420 >> 172.21.15.17:0/1510934420 conn(0x7fe1900cf5b0 msgr2=0x7fe1900b70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:17.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.619+0000 7fe18f200640 1 -- 172.21.15.17:0/1510934420 shutdown_connections 2024-03-12T17:20:17.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.619+0000 7fe18f200640 1 -- 172.21.15.17:0/1510934420 wait complete. 2024-03-12T17:20:17.637 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-12T17:20:17.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.874+0000 7ff08f200640 1 Processor -- start 2024-03-12T17:20:17.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.874+0000 7ff08f200640 1 -- start start 2024-03-12T17:20:17.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.876+0000 7ff08f200640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff0900cb2b0 0x7ff0900702d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:17.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.876+0000 7ff08f200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff090070c60 con 0x7ff0900cd0b0 2024-03-12T17:20:17.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.876+0000 7ff08f200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff09015f160 con 0x7ff090070810 2024-03-12T17:20:17.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.876+0000 7ff08f200640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0900cd490 con 0x7ff0900cb2b0 2024-03-12T17:20:17.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.876+0000 7ff08de00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7ff0900cd0b0 0x7ff09015ea50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53202/0 (socket says 172.21.15.17:53202) 2024-03-12T17:20:17.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.876+0000 7ff08de00640 1 -- 172.21.15.17:0/3517538958 learned_addr learned my addr 172.21.15.17:0/3517538958 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:20:17.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.877+0000 7ff08ca00640 1 -- 172.21.15.17:0/3517538958 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2326965664 0 0) 0x7ff080001110 con 0x7ff0900cd0b0 2024-03-12T17:20:17.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.877+0000 7ff08d400640 1 --2- 172.21.15.17:0/3517538958 >> v2:172.21.15.94:3300/0 conn(0x7ff0900cb2b0 0x7ff0900702d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:17.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.877+0000 7ff08ca00640 1 -- 172.21.15.17:0/3517538958 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff074003520 con 0x7ff0900cd0b0 2024-03-12T17:20:17.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.877+0000 7ff08ca00640 1 -- 172.21.15.17:0/3517538958 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3464031353 0 0) 0x7ff074003520 con 0x7ff0900cd0b0 2024-03-12T17:20:17.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.877+0000 7ff08ca00640 1 -- 172.21.15.17:0/3517538958 >> v2:172.21.15.94:3300/0 conn(0x7ff0900cb2b0 msgr2=0x7ff0900702d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:17.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.877+0000 7ff08ca00640 1 --2- 172.21.15.17:0/3517538958 >> v2:172.21.15.94:3300/0 conn(0x7ff0900cb2b0 0x7ff0900702d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:17.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.877+0000 7ff08ca00640 1 -- 172.21.15.17:0/3517538958 >> v1:172.21.15.94:6789/0 conn(0x7ff090070810 legacy=0x7ff09013ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:17.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.877+0000 7ff08ca00640 1 -- 172.21.15.17:0/3517538958 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09013dce0 con 0x7ff0900cd0b0 2024-03-12T17:20:17.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.877+0000 7ff08ca00640 1 -- 172.21.15.17:0/3517538958 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7ff080001800 con 0x7ff0900cd0b0 2024-03-12T17:20:17.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.877+0000 7ff08ca00640 1 -- 172.21.15.17:0/3517538958 >> v1:172.21.15.17:6789/0 conn(0x7ff0900cd0b0 legacy=0x7ff09015ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:17.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.877+0000 7ff08ca00640 1 --2- 172.21.15.17:0/3517538958 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff074003970 0x7ff074003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:17.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.877+0000 7ff08ca00640 1 --2- 172.21.15.17:0/3517538958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0740047c0 0x7ff074004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:17.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.877+0000 7ff08ca00640 1 --2- 172.21.15.17:0/3517538958 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff074005180 0x7ff07400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:17.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.877+0000 7ff08ca00640 1 -- 172.21.15.17:0/3517538958 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0900cd490 con 0x7ff0740047c0 2024-03-12T17:20:17.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.877+0000 7ff08ca00640 1 -- 172.21.15.17:0/3517538958 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff07400c0d0 con 0x7ff074003970 2024-03-12T17:20:17.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.877+0000 7ff08ca00640 1 -- 172.21.15.17:0/3517538958 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff07400c290 con 0x7ff074005180 2024-03-12T17:20:17.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.878+0000 7ff08d400640 1 --2- 172.21.15.17:0/3517538958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0740047c0 0x7ff074004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:17.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.878+0000 7ff08de00640 1 --2- 172.21.15.17:0/3517538958 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff074003970 0x7ff074003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:17.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.878+0000 7ff08e800640 1 --2- 172.21.15.17:0/3517538958 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff074005180 0x7ff07400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:17.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.878+0000 7ff08d400640 1 -- 172.21.15.17:0/3517538958 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff074005180 msgr2=0x7ff07400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:17.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.878+0000 7ff08d400640 1 --2- 172.21.15.17:0/3517538958 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff074005180 0x7ff07400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:17.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.878+0000 7ff08d400640 1 -- 172.21.15.17:0/3517538958 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff074003970 msgr2=0x7ff074003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:17.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.878+0000 7ff08d400640 1 --2- 172.21.15.17:0/3517538958 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff074003970 0x7ff074003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:17.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.878+0000 7ff08d400640 1 -- 172.21.15.17:0/3517538958 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff074003520 con 0x7ff0740047c0 2024-03-12T17:20:17.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.878+0000 7ff08e800640 1 -- 172.21.15.17:0/3517538958 reap_dead start 2024-03-12T17:20:17.875 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.879+0000 7ff08d400640 1 --2- 172.21.15.17:0/3517538958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0740047c0 0x7ff074004c40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff07800ba00 tx=0x7ff0740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86b72c102c81425a server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:17.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.880+0000 7ff08ca00640 1 -- 172.21.15.17:0/3517538958 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff078032620 con 0x7ff0740047c0 2024-03-12T17:20:17.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.880+0000 7ff08ca00640 1 -- 172.21.15.17:0/3517538958 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff078032780 con 0x7ff0740047c0 2024-03-12T17:20:17.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.880+0000 7ff08ca00640 1 -- 172.21.15.17:0/3517538958 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff078032b10 con 0x7ff0740047c0 2024-03-12T17:20:17.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.880+0000 7ff08f200640 1 -- 172.21.15.17:0/3517538958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0740047c0 msgr2=0x7ff074004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:17.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.880+0000 7ff08f200640 1 --2- 172.21.15.17:0/3517538958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0740047c0 0x7ff074004c40 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7ff07800ba00 tx=0x7ff0740057f0 comp rx=0 tx=0).stop 2024-03-12T17:20:17.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.880+0000 7ff08f200640 1 -- 172.21.15.17:0/3517538958 shutdown_connections 2024-03-12T17:20:17.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.880+0000 7ff08f200640 1 --2- 172.21.15.17:0/3517538958 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0740047c0 0x7ff074004c40 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:17.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.880+0000 7ff08f200640 1 -- 172.21.15.17:0/3517538958 >> 172.21.15.17:0/3517538958 conn(0x7ff090069ce0 msgr2=0x7ff09006a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:17.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.881+0000 7ff08f200640 1 -- 172.21.15.17:0/3517538958 shutdown_connections 2024-03-12T17:20:17.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.881+0000 7ff08f200640 1 -- 172.21.15.17:0/3517538958 wait complete. 2024-03-12T17:20:17.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.882+0000 7ff08f200640 1 Processor -- start 2024-03-12T17:20:17.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.882+0000 7ff08f200640 1 -- start start 2024-03-12T17:20:17.879 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.883+0000 7ff08f200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0740047c0 0x7ff0900ca320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:17.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.883+0000 7ff08f200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff0900c4c50 0x7ff0901f1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:17.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.883+0000 7ff08f200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0901f23d0 0x7ff0900c3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:17.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.883+0000 7ff08f200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0900ca860 con 0x7ff0901f23d0 2024-03-12T17:20:17.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.883+0000 7ff08f200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0900acd80 con 0x7ff0740047c0 2024-03-12T17:20:17.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.883+0000 7ff08f200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0900af950 con 0x7ff0900c4c50 2024-03-12T17:20:17.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.884+0000 7ff08e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0901f23d0 0x7ff0900c3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:17.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.884+0000 7ff08d400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff0900c4c50 0x7ff0901f1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:17.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.884+0000 7ff08e800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0901f23d0 0x7ff0900c3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55542/0 (socket says 172.21.15.17:55542) 2024-03-12T17:20:17.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.884+0000 7ff08e800640 1 -- 172.21.15.17:0/3443460606 learned_addr learned my addr 172.21.15.17:0/3443460606 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:17.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.884+0000 7ff08de00640 1 --2- 172.21.15.17:0/3443460606 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0740047c0 0x7ff0900ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:17.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.884+0000 7ff08e800640 1 -- 172.21.15.17:0/3443460606 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff0900c4c50 msgr2=0x7ff0901f1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:17.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.885+0000 7ff08e800640 1 --2- 172.21.15.17:0/3443460606 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff0900c4c50 0x7ff0901f1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:17.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.885+0000 7ff08e800640 1 -- 172.21.15.17:0/3443460606 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0740047c0 msgr2=0x7ff0900ca320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:17.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.885+0000 7ff08e800640 1 --2- 172.21.15.17:0/3443460606 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0740047c0 0x7ff0900ca320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:17.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.885+0000 7ff08e800640 1 -- 172.21.15.17:0/3443460606 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0900afc30 con 0x7ff0901f23d0 2024-03-12T17:20:17.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.885+0000 7ff08d400640 1 --2- 172.21.15.17:0/3443460606 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff0900c4c50 0x7ff0901f1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:20:17.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.885+0000 7ff08e800640 1 --2- 172.21.15.17:0/3443460606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0901f23d0 0x7ff0900c3840 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff09013dbb0 tx=0x7ff08800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:17.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.885+0000 7ff086000640 1 -- 172.21.15.17:0/3443460606 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff088003b70 con 0x7ff0901f23d0 2024-03-12T17:20:17.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.885+0000 7ff086000640 1 -- 172.21.15.17:0/3443460606 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff088003cd0 con 0x7ff0901f23d0 2024-03-12T17:20:17.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.885+0000 7ff08f200640 1 -- 172.21.15.17:0/3443460606 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0900aff10 con 0x7ff0901f23d0 2024-03-12T17:20:17.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.885+0000 7ff086000640 1 -- 172.21.15.17:0/3443460606 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0880052b0 con 0x7ff0901f23d0 2024-03-12T17:20:17.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.885+0000 7ff08f200640 1 -- 172.21.15.17:0/3443460606 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0900b04d0 con 0x7ff0901f23d0 2024-03-12T17:20:17.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.887+0000 7ff08f200640 1 -- 172.21.15.17:0/3443460606 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0900b06f0 con 0x7ff0901f23d0 2024-03-12T17:20:17.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.888+0000 7ff086000640 1 -- 172.21.15.17:0/3443460606 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7ff088005410 con 0x7ff0901f23d0 2024-03-12T17:20:17.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.889+0000 7ff086000640 1 --2- 172.21.15.17:0/3443460606 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ff06c06ac30 0x7ff06c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:17.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.889+0000 7ff086000640 1 -- 172.21.15.17:0/3443460606 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5357+0+0 (secure 0 0 0) 0x7ff088088b20 con 0x7ff0901f23d0 2024-03-12T17:20:17.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.889+0000 7ff08de00640 1 --2- 172.21.15.17:0/3443460606 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ff06c06ac30 0x7ff06c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:17.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.890+0000 7ff08de00640 1 --2- 172.21.15.17:0/3443460606 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ff06c06ac30 0x7ff06c06d0f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff080001050 tx=0x7ff080007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:17.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:17.894+0000 7ff086000640 1 -- 172.21.15.17:0/3443460606 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7ff088053e70 con 0x7ff0901f23d0 2024-03-12T17:20:18.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.103+0000 7ff08f200640 1 -- 172.21.15.17:0/3443460606 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff09004e030 con 0x7ff0901f23d0 2024-03-12T17:20:18.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.616+0000 7ff086000640 1 -- 172.21.15.17:0/3443460606 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v38) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff088018070 con 0x7ff0901f23d0 2024-03-12T17:20:18.612 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2024-03-12T17:20:18.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.621+0000 7ff08f200640 1 -- 172.21.15.17:0/3443460606 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ff06c06ac30 msgr2=0x7ff06c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:18.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.621+0000 7ff08f200640 1 --2- 172.21.15.17:0/3443460606 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ff06c06ac30 0x7ff06c06d0f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff080001050 tx=0x7ff080007040 comp rx=0 tx=0).stop 2024-03-12T17:20:18.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.621+0000 7ff08f200640 1 -- 172.21.15.17:0/3443460606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0901f23d0 msgr2=0x7ff0900c3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:18.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.621+0000 7ff08f200640 1 --2- 172.21.15.17:0/3443460606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0901f23d0 0x7ff0900c3840 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff09013dbb0 tx=0x7ff08800dc00 comp rx=0 tx=0).stop 2024-03-12T17:20:18.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.622+0000 7ff08f200640 1 -- 172.21.15.17:0/3443460606 shutdown_connections 2024-03-12T17:20:18.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.622+0000 7ff08f200640 1 --2- 172.21.15.17:0/3443460606 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ff06c06ac30 0x7ff06c06d0f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:18.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.622+0000 7ff08f200640 1 --2- 172.21.15.17:0/3443460606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff0901f23d0 0x7ff0900c3840 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:18.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.622+0000 7ff08f200640 1 --2- 172.21.15.17:0/3443460606 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff0900c4c50 0x7ff0901f1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:18.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.622+0000 7ff08f200640 1 --2- 172.21.15.17:0/3443460606 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff0740047c0 0x7ff0900ca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:18.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.622+0000 7ff08f200640 1 -- 172.21.15.17:0/3443460606 >> 172.21.15.17:0/3443460606 conn(0x7ff090069ce0 msgr2=0x7ff09006c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:18.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.622+0000 7ff08f200640 1 -- 172.21.15.17:0/3443460606 shutdown_connections 2024-03-12T17:20:18.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.622+0000 7ff08f200640 1 -- 172.21.15.17:0/3443460606 wait complete. 2024-03-12T17:20:18.641 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-03-12T17:20:18.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.861+0000 7f5ab7200640 1 Processor -- start 2024-03-12T17:20:18.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.861+0000 7f5ab7200640 1 -- start start 2024-03-12T17:20:18.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.863+0000 7f5ab7200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5ab80b86c0 0x7f5ab80b4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:18.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.863+0000 7f5ab7200640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5ab80b4950 0x7f5ab80d1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:18.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.863+0000 7f5ab7200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ab80b4da0 con 0x7f5ab8160090 2024-03-12T17:20:18.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.863+0000 7f5ab7200640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ab80d0e40 con 0x7f5ab80b4950 2024-03-12T17:20:18.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.863+0000 7f5ab7200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab8160470 con 0x7f5ab80b86c0 2024-03-12T17:20:18.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.863+0000 7f5ab5e00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f5ab8160090 0x7f5ab806b130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53206/0 (socket says 172.21.15.17:53206) 2024-03-12T17:20:18.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.863+0000 7f5ab5e00640 1 -- 172.21.15.17:0/3677146587 learned_addr learned my addr 172.21.15.17:0/3677146587 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:20:18.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.864+0000 7f5ab4a00640 1 -- 172.21.15.17:0/3677146587 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 266868499 0 0) 0x7f5aa8001110 con 0x7f5ab8160090 2024-03-12T17:20:18.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.864+0000 7f5ab5400640 1 --2- 172.21.15.17:0/3677146587 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5ab80b86c0 0x7f5ab80b4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:18.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.864+0000 7f5ab4a00640 1 -- 172.21.15.17:0/3677146587 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a9c003520 con 0x7f5ab8160090 2024-03-12T17:20:18.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.864+0000 7f5ab6800640 1 --2- 172.21.15.17:0/3677146587 >> v2:172.21.15.94:3300/0 conn(0x7f5ab80b4950 0x7f5ab80d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:18.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.865+0000 7f5ab4a00640 1 -- 172.21.15.17:0/3677146587 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1534877135 0 0) 0x7f5a9c003520 con 0x7f5ab8160090 2024-03-12T17:20:18.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.865+0000 7f5ab4a00640 1 -- 172.21.15.17:0/3677146587 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5ab80b86c0 msgr2=0x7f5ab80b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:18.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.865+0000 7f5ab4a00640 1 --2- 172.21.15.17:0/3677146587 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5ab80b86c0 0x7f5ab80b4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:18.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.866+0000 7f5ab4a00640 1 -- 172.21.15.17:0/3677146587 >> v2:172.21.15.94:3300/0 conn(0x7f5ab80b4950 msgr2=0x7f5ab80d1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:18.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.866+0000 7f5ab4a00640 1 --2- 172.21.15.17:0/3677146587 >> v2:172.21.15.94:3300/0 conn(0x7f5ab80b4950 0x7f5ab80d1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:18.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.866+0000 7f5ab4a00640 1 -- 172.21.15.17:0/3677146587 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab806b840 con 0x7f5ab8160090 2024-03-12T17:20:18.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.866+0000 7f5ab4a00640 1 -- 172.21.15.17:0/3677146587 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7f5aa8001800 con 0x7f5ab8160090 2024-03-12T17:20:18.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.866+0000 7f5ab4a00640 1 -- 172.21.15.17:0/3677146587 >> v1:172.21.15.17:6789/0 conn(0x7f5ab8160090 legacy=0x7f5ab806b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:18.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.866+0000 7f5ab4a00640 1 --2- 172.21.15.17:0/3677146587 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5a9c003970 0x7f5a9c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:18.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.866+0000 7f5ab4a00640 1 --2- 172.21.15.17:0/3677146587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a9c004360 0x7f5a9c004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:18.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.866+0000 7f5ab4a00640 1 --2- 172.21.15.17:0/3677146587 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a9c005000 0x7f5a9c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:18.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.866+0000 7f5ab4a00640 1 -- 172.21.15.17:0/3677146587 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab80d0e40 con 0x7f5a9c004360 2024-03-12T17:20:18.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.866+0000 7f5ab4a00640 1 -- 172.21.15.17:0/3677146587 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab8160470 con 0x7f5a9c005000 2024-03-12T17:20:18.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.866+0000 7f5ab4a00640 1 -- 172.21.15.17:0/3677146587 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9c00bfa0 con 0x7f5a9c003970 2024-03-12T17:20:18.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.867+0000 7f5ab5e00640 1 --2- 172.21.15.17:0/3677146587 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5a9c003970 0x7f5a9c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:18.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.867+0000 7f5ab6800640 1 --2- 172.21.15.17:0/3677146587 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a9c005000 0x7f5a9c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:18.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.869+0000 7f5ab5e00640 1 -- 172.21.15.17:0/3677146587 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a9c005000 msgr2=0x7f5a9c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:18.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.869+0000 7f5ab5e00640 1 --2- 172.21.15.17:0/3677146587 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5a9c005000 0x7f5a9c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:18.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.869+0000 7f5ab5e00640 1 -- 172.21.15.17:0/3677146587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a9c004360 msgr2=0x7f5a9c004840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:18.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.869+0000 7f5ab5e00640 1 --2- 172.21.15.17:0/3677146587 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5a9c004360 0x7f5a9c004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:18.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.869+0000 7f5ab5e00640 1 -- 172.21.15.17:0/3677146587 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab806b840 con 0x7f5a9c003970 2024-03-12T17:20:18.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.873+0000 7f5ab5e00640 1 --2- 172.21.15.17:0/3677146587 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5a9c003970 0x7f5a9c003d90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5aa800c210 tx=0x7f5a9c0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b0616bdad67935c server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:18.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.876+0000 7f5ab4a00640 1 -- 172.21.15.17:0/3677146587 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa8005ad0 con 0x7f5a9c003970 2024-03-12T17:20:18.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.876+0000 7f5ab4a00640 1 -- 172.21.15.17:0/3677146587 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa8005c50 con 0x7f5a9c003970 2024-03-12T17:20:18.871 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.876+0000 7f5ab4a00640 1 -- 172.21.15.17:0/3677146587 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa802c8a0 con 0x7f5a9c003970 2024-03-12T17:20:18.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.878+0000 7f5ab7200640 1 -- 172.21.15.17:0/3677146587 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5a9c003970 msgr2=0x7f5a9c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:18.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.878+0000 7f5ab7200640 1 --2- 172.21.15.17:0/3677146587 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5a9c003970 0x7f5a9c003d90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5aa800c210 tx=0x7f5a9c0057f0 comp rx=0 tx=0).stop 2024-03-12T17:20:18.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.879+0000 7f5ab6800640 1 -- 172.21.15.17:0/3677146587 reap_dead start 2024-03-12T17:20:18.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.879+0000 7f5ab7200640 1 -- 172.21.15.17:0/3677146587 shutdown_connections 2024-03-12T17:20:18.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.879+0000 7f5ab7200640 1 -- 172.21.15.17:0/3677146587 >> 172.21.15.17:0/3677146587 conn(0x7f5ab80cf5f0 msgr2=0x7f5ab80cfa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:18.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.880+0000 7f5ab7200640 1 -- 172.21.15.17:0/3677146587 shutdown_connections 2024-03-12T17:20:18.876 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.881+0000 7f5ab7200640 1 -- 172.21.15.17:0/3677146587 wait complete. 2024-03-12T17:20:18.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.883+0000 7f5ab7200640 1 Processor -- start 2024-03-12T17:20:18.877 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.883+0000 7f5ab7200640 1 -- start start 2024-03-12T17:20:18.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.884+0000 7f5ab7200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5a9c003970 0x7f5ab80cc080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:18.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.884+0000 7f5ab7200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ab8070f60 0x7f5ab8202110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:18.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.885+0000 7f5ab7200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ab80d1160 0x7f5ab80d15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:18.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.885+0000 7f5ab7200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab80d1b20 con 0x7f5ab8070f60 2024-03-12T17:20:18.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.885+0000 7f5ab7200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab82000e0 con 0x7f5ab80d1160 2024-03-12T17:20:18.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.885+0000 7f5ab7200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ab81ff7b0 con 0x7f5a9c003970 2024-03-12T17:20:18.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.885+0000 7f5ab5400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ab8070f60 0x7f5ab8202110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:18.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.885+0000 7f5ab5400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ab8070f60 0x7f5ab8202110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55556/0 (socket says 172.21.15.17:55556) 2024-03-12T17:20:18.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.885+0000 7f5ab5400640 1 -- 172.21.15.17:0/2779749967 learned_addr learned my addr 172.21.15.17:0/2779749967 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:18.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.885+0000 7f5ab5e00640 1 --2- 172.21.15.17:0/2779749967 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5a9c003970 0x7f5ab80cc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:18.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.885+0000 7f5ab6800640 1 --2- 172.21.15.17:0/2779749967 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ab80d1160 0x7f5ab80d15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:18.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.885+0000 7f5ab5400640 1 -- 172.21.15.17:0/2779749967 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5a9c003970 msgr2=0x7f5ab80cc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:18.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.885+0000 7f5ab5400640 1 --2- 172.21.15.17:0/2779749967 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5a9c003970 0x7f5ab80cc080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:18.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.885+0000 7f5ab5400640 1 -- 172.21.15.17:0/2779749967 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ab80d1160 msgr2=0x7f5ab80d15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:18.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.885+0000 7f5ab5400640 1 --2- 172.21.15.17:0/2779749967 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ab80d1160 0x7f5ab80d15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:18.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.885+0000 7f5ab5400640 1 -- 172.21.15.17:0/2779749967 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab81ffa90 con 0x7f5ab8070f60 2024-03-12T17:20:18.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.886+0000 7f5ab5400640 1 --2- 172.21.15.17:0/2779749967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ab8070f60 0x7f5ab8202110 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5aa400d4a0 tx=0x7f5aa400d960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:18.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.886+0000 7f5aae000640 1 -- 172.21.15.17:0/2779749967 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa40125f0 con 0x7f5ab8070f60 2024-03-12T17:20:18.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.886+0000 7f5aae000640 1 -- 172.21.15.17:0/2779749967 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aa4012750 con 0x7f5ab8070f60 2024-03-12T17:20:18.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.886+0000 7f5aae000640 1 -- 172.21.15.17:0/2779749967 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5aa4012b00 con 0x7f5ab8070f60 2024-03-12T17:20:18.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.886+0000 7f5ab7200640 1 -- 172.21.15.17:0/2779749967 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ab81ffd70 con 0x7f5ab8070f60 2024-03-12T17:20:18.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.886+0000 7f5ab7200640 1 -- 172.21.15.17:0/2779749967 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ab80cc5c0 con 0x7f5ab8070f60 2024-03-12T17:20:18.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.887+0000 7f5ab7200640 1 -- 172.21.15.17:0/2779749967 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ab8067120 con 0x7f5ab8070f60 2024-03-12T17:20:18.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.888+0000 7f5aae000640 1 -- 172.21.15.17:0/2779749967 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f5aa4012c60 con 0x7f5ab8070f60 2024-03-12T17:20:18.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.889+0000 7f5aae000640 1 --2- 172.21.15.17:0/2779749967 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f5a9806ac00 0x7f5a9806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:18.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.889+0000 7f5aae000640 1 -- 172.21.15.17:0/2779749967 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5aa40894a0 con 0x7f5ab8070f60 2024-03-12T17:20:18.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.889+0000 7f5ab5e00640 1 --2- 172.21.15.17:0/2779749967 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f5a9806ac00 0x7f5a9806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:18.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.890+0000 7f5ab5e00640 1 --2- 172.21.15.17:0/2779749967 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f5a9806ac00 0x7f5a9806d0c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8034000 tx=0x7f5aa8037040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:18.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:18.894+0000 7f5aae000640 1 -- 172.21.15.17:0/2779749967 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f5aa40548e0 con 0x7f5ab8070f60 2024-03-12T17:20:19.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.091+0000 7f5ab7200640 1 -- 172.21.15.17:0/2779749967 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f5ab8072360 con 0x7f5ab8070f60 2024-03-12T17:20:19.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.098+0000 7f5aae000640 1 -- 172.21.15.17:0/2779749967 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5aa4057f00 con 0x7f5ab8070f60 2024-03-12T17:20:19.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.101+0000 7f5ab7200640 1 -- 172.21.15.17:0/2779749967 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f5a9806ac00 msgr2=0x7f5a9806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:19.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.101+0000 7f5ab7200640 1 --2- 172.21.15.17:0/2779749967 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f5a9806ac00 0x7f5a9806d0c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8034000 tx=0x7f5aa8037040 comp rx=0 tx=0).stop 2024-03-12T17:20:19.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.101+0000 7f5ab7200640 1 -- 172.21.15.17:0/2779749967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ab8070f60 msgr2=0x7f5ab8202110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:19.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.101+0000 7f5ab7200640 1 --2- 172.21.15.17:0/2779749967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ab8070f60 0x7f5ab8202110 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5aa400d4a0 tx=0x7f5aa400d960 comp rx=0 tx=0).stop 2024-03-12T17:20:19.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.101+0000 7f5ab7200640 1 -- 172.21.15.17:0/2779749967 shutdown_connections 2024-03-12T17:20:19.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.101+0000 7f5ab7200640 1 --2- 172.21.15.17:0/2779749967 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f5a9806ac00 0x7f5a9806d0c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:19.096 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.101+0000 7f5ab7200640 1 --2- 172.21.15.17:0/2779749967 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5ab80d1160 0x7f5ab80d15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:19.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.101+0000 7f5ab7200640 1 --2- 172.21.15.17:0/2779749967 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5ab8070f60 0x7f5ab8202110 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:19.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.101+0000 7f5ab7200640 1 --2- 172.21.15.17:0/2779749967 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5a9c003970 0x7f5ab80cc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:19.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.102+0000 7f5ab7200640 1 -- 172.21.15.17:0/2779749967 >> 172.21.15.17:0/2779749967 conn(0x7f5ab80cf5f0 msgr2=0x7f5ab806b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:19.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.102+0000 7f5ab7200640 1 -- 172.21.15.17:0/2779749967 shutdown_connections 2024-03-12T17:20:19.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.102+0000 7f5ab7200640 1 -- 172.21.15.17:0/2779749967 wait complete. 2024-03-12T17:20:19.117 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_dump_tree.TestDumpTree.test_basic' 2024-03-12T17:20:19.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.341+0000 7f48b3000640 1 Processor -- start 2024-03-12T17:20:19.335 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.341+0000 7f48b3000640 1 -- start start 2024-03-12T17:20:19.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.342+0000 7f48b3000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f48ac0b1860 0x7f48ac0b4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:19.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.343+0000 7f48b3000640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48ac1461a0 con 0x7f48ac145dc0 2024-03-12T17:20:19.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.343+0000 7f48b3000640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48ac0b3db0 con 0x7f48ac070240 2024-03-12T17:20:19.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.343+0000 7f48b3000640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac0b2000 con 0x7f48ac0b1860 2024-03-12T17:20:19.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.343+0000 7f48b1c00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f48ac145dc0 0x7f48ac160ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53212/0 (socket says 172.21.15.17:53212) 2024-03-12T17:20:19.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.343+0000 7f48b1c00640 1 -- 172.21.15.17:0/1835585150 learned_addr learned my addr 172.21.15.17:0/1835585150 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:20:19.339 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.343+0000 7f48abe00640 1 -- 172.21.15.17:0/1835585150 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1828669712 0 0) 0x7f48ac1461a0 con 0x7f48ac145dc0 2024-03-12T17:20:19.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.343+0000 7f48abe00640 1 -- 172.21.15.17:0/1835585150 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4894003520 con 0x7f48ac145dc0 2024-03-12T17:20:19.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.343+0000 7f48b1200640 1 --2- 172.21.15.17:0/1835585150 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f48ac0b1860 0x7f48ac0b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:19.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.344+0000 7f48abe00640 1 -- 172.21.15.17:0/1835585150 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1826092702 0 0) 0x7f4894003520 con 0x7f48ac145dc0 2024-03-12T17:20:19.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.344+0000 7f48abe00640 1 -- 172.21.15.17:0/1835585150 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f48ac0b1860 msgr2=0x7f48ac0b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:19.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.344+0000 7f48abe00640 1 --2- 172.21.15.17:0/1835585150 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f48ac0b1860 0x7f48ac0b4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:19.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.344+0000 7f48abe00640 1 -- 172.21.15.17:0/1835585150 >> v1:172.21.15.94:6789/0 conn(0x7f48ac070240 legacy=0x7f48ac0abb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:19.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.344+0000 7f48abe00640 1 -- 172.21.15.17:0/1835585150 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ac146680 con 0x7f48ac145dc0 2024-03-12T17:20:19.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.344+0000 7f48abe00640 1 -- 172.21.15.17:0/1835585150 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7f48a0001670 con 0x7f48ac145dc0 2024-03-12T17:20:19.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.344+0000 7f48abe00640 1 -- 172.21.15.17:0/1835585150 >> v1:172.21.15.17:6789/0 conn(0x7f48ac145dc0 legacy=0x7f48ac160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:19.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.344+0000 7f48abe00640 1 --2- 172.21.15.17:0/1835585150 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f48940039a0 0x7f4894003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:19.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.344+0000 7f48abe00640 1 --2- 172.21.15.17:0/1835585150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48940047c0 0x7f4894004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:19.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.344+0000 7f48abe00640 1 --2- 172.21.15.17:0/1835585150 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4894005180 0x7f489400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:19.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.344+0000 7f48abe00640 1 -- 172.21.15.17:0/1835585150 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac0b2000 con 0x7f48940047c0 2024-03-12T17:20:19.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.344+0000 7f48abe00640 1 -- 172.21.15.17:0/1835585150 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489400c080 con 0x7f4894005180 2024-03-12T17:20:19.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.344+0000 7f48abe00640 1 -- 172.21.15.17:0/1835585150 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f489400c240 con 0x7f48940039a0 2024-03-12T17:20:19.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.344+0000 7f48b1200640 1 --2- 172.21.15.17:0/1835585150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48940047c0 0x7f4894004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:19.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.344+0000 7f48b1c00640 1 --2- 172.21.15.17:0/1835585150 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f48940039a0 0x7f4894003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:19.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.345+0000 7f48b2600640 1 --2- 172.21.15.17:0/1835585150 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4894005180 0x7f489400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:19.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.345+0000 7f48b1200640 1 -- 172.21.15.17:0/1835585150 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f48940039a0 msgr2=0x7f4894003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:19.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.345+0000 7f48b1200640 1 --2- 172.21.15.17:0/1835585150 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f48940039a0 0x7f4894003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:19.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.345+0000 7f48b1200640 1 -- 172.21.15.17:0/1835585150 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4894005180 msgr2=0x7f489400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:19.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.345+0000 7f48b1200640 1 --2- 172.21.15.17:0/1835585150 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4894005180 0x7f489400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:19.341 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.345+0000 7f48b1200640 1 -- 172.21.15.17:0/1835585150 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4894003520 con 0x7f48940047c0 2024-03-12T17:20:19.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.346+0000 7f48b1200640 1 --2- 172.21.15.17:0/1835585150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48940047c0 0x7f4894004c40 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f48ac0ada50 tx=0x7f48940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ab0b5ee244a34d server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:19.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.346+0000 7f48abe00640 1 -- 172.21.15.17:0/1835585150 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4898034610 con 0x7f48940047c0 2024-03-12T17:20:19.342 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.346+0000 7f48abe00640 1 -- 172.21.15.17:0/1835585150 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489802e070 con 0x7f48940047c0 2024-03-12T17:20:19.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.346+0000 7f48abe00640 1 -- 172.21.15.17:0/1835585150 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4898034990 con 0x7f48940047c0 2024-03-12T17:20:19.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.347+0000 7f48b3000640 1 -- 172.21.15.17:0/1835585150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48940047c0 msgr2=0x7f4894004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:19.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.347+0000 7f48b3000640 1 --2- 172.21.15.17:0/1835585150 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48940047c0 0x7f4894004c40 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f48ac0ada50 tx=0x7f48940057f0 comp rx=0 tx=0).stop 2024-03-12T17:20:19.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.347+0000 7f48b2600640 1 -- 172.21.15.17:0/1835585150 reap_dead start 2024-03-12T17:20:19.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.347+0000 7f48b3000640 1 -- 172.21.15.17:0/1835585150 shutdown_connections 2024-03-12T17:20:19.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.347+0000 7f48b3000640 1 -- 172.21.15.17:0/1835585150 >> 172.21.15.17:0/1835585150 conn(0x7f48ac069ce0 msgr2=0x7f48ac06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:19.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.347+0000 7f48b3000640 1 -- 172.21.15.17:0/1835585150 shutdown_connections 2024-03-12T17:20:19.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.347+0000 7f48b3000640 1 -- 172.21.15.17:0/1835585150 wait complete. 2024-03-12T17:20:19.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.349+0000 7f48b3000640 1 Processor -- start 2024-03-12T17:20:19.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.349+0000 7f48b3000640 1 -- start start 2024-03-12T17:20:19.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.350+0000 7f48b3000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f48940047c0 0x7f48ac143530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:19.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.350+0000 7f48b3000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48ac0c4b60 0x7f48ac0c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:19.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.350+0000 7f48b3000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48ac0c7cd0 0x7f48ac133530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:19.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.350+0000 7f48b3000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac0c8150 con 0x7f48ac0c4b60 2024-03-12T17:20:19.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.350+0000 7f48b3000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac131120 con 0x7f48ac0c7cd0 2024-03-12T17:20:19.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.350+0000 7f48b3000640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac1313c0 con 0x7f48940047c0 2024-03-12T17:20:19.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.350+0000 7f48b1200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48ac0c4b60 0x7f48ac0c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:19.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.350+0000 7f48b1200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48ac0c4b60 0x7f48ac0c7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55562/0 (socket says 172.21.15.17:55562) 2024-03-12T17:20:19.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.350+0000 7f48b1200640 1 -- 172.21.15.17:0/2943147505 learned_addr learned my addr 172.21.15.17:0/2943147505 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:19.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.350+0000 7f48b1c00640 1 --2- 172.21.15.17:0/2943147505 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f48940047c0 0x7f48ac143530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:19.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.351+0000 7f48b2600640 1 --2- 172.21.15.17:0/2943147505 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48ac0c7cd0 0x7f48ac133530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:19.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.351+0000 7f48b1200640 1 -- 172.21.15.17:0/2943147505 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f48940047c0 msgr2=0x7f48ac143530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:19.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.351+0000 7f48b1200640 1 --2- 172.21.15.17:0/2943147505 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f48940047c0 0x7f48ac143530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:19.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.351+0000 7f48b1200640 1 -- 172.21.15.17:0/2943147505 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48ac0c7cd0 msgr2=0x7f48ac133530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:19.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.351+0000 7f48b1200640 1 --2- 172.21.15.17:0/2943147505 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48ac0c7cd0 0x7f48ac133530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:19.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.351+0000 7f48b1200640 1 -- 172.21.15.17:0/2943147505 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ac1316a0 con 0x7f48ac0c4b60 2024-03-12T17:20:19.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.351+0000 7f48b1200640 1 --2- 172.21.15.17:0/2943147505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48ac0c4b60 0x7f48ac0c7790 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f489800b9f0 tx=0x7f4898004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:19.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.351+0000 7f48a9600640 1 -- 172.21.15.17:0/2943147505 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4898003dd0 con 0x7f48ac0c4b60 2024-03-12T17:20:19.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.352+0000 7f48a9600640 1 -- 172.21.15.17:0/2943147505 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489803d430 con 0x7f48ac0c4b60 2024-03-12T17:20:19.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.352+0000 7f48a9600640 1 -- 172.21.15.17:0/2943147505 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489803d7e0 con 0x7f48ac0c4b60 2024-03-12T17:20:19.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.352+0000 7f48b3000640 1 -- 172.21.15.17:0/2943147505 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48ac131980 con 0x7f48ac0c4b60 2024-03-12T17:20:19.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.352+0000 7f48b3000640 1 -- 172.21.15.17:0/2943147505 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48ac143a70 con 0x7f48ac0c4b60 2024-03-12T17:20:19.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.353+0000 7f48b3000640 1 -- 172.21.15.17:0/2943147505 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48ac0c80b0 con 0x7f48ac0c4b60 2024-03-12T17:20:19.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.354+0000 7f48a9600640 1 -- 172.21.15.17:0/2943147505 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f489803d940 con 0x7f48ac0c4b60 2024-03-12T17:20:19.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.355+0000 7f48a9600640 1 --2- 172.21.15.17:0/2943147505 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f488c06ac30 0x7f488c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:19.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.355+0000 7f48a9600640 1 -- 172.21.15.17:0/2943147505 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f48980ab070 con 0x7f48ac0c4b60 2024-03-12T17:20:19.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.355+0000 7f48b1c00640 1 --2- 172.21.15.17:0/2943147505 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f488c06ac30 0x7f488c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:19.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.356+0000 7f48b1c00640 1 --2- 172.21.15.17:0/2943147505 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f488c06ac30 0x7f488c06d0f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f48a0001eb0 tx=0x7f48a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:19.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.359+0000 7f48a9600640 1 -- 172.21.15.17:0/2943147505 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f48980764b0 con 0x7f48ac0c4b60 2024-03-12T17:20:19.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:19.632+0000 7f48b3000640 1 -- 172.21.15.17:0/2943147505 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_dump_tree.TestDumpTree.test_basic"]} v 0) v1 -- 0x7f48ac04e030 con 0x7f48ac0c4b60 2024-03-12T17:20:20.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.634+0000 7f48a9600640 1 -- 172.21.15.17:0/2943147505 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_dump_tree.TestDumpTree.test_basic"]}]=0 v107) v1 ==== 130+0+0 (secure 0 0 0) 0x7f4898079ad0 con 0x7f48ac0c4b60 2024-03-12T17:20:20.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.638+0000 7f48b3000640 1 -- 172.21.15.17:0/2943147505 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f488c06ac30 msgr2=0x7f488c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:20.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.638+0000 7f48b3000640 1 --2- 172.21.15.17:0/2943147505 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f488c06ac30 0x7f488c06d0f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f48a0001eb0 tx=0x7f48a0009040 comp rx=0 tx=0).stop 2024-03-12T17:20:20.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.638+0000 7f48b3000640 1 -- 172.21.15.17:0/2943147505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48ac0c4b60 msgr2=0x7f48ac0c7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:20.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.638+0000 7f48b3000640 1 --2- 172.21.15.17:0/2943147505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48ac0c4b60 0x7f48ac0c7790 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f489800b9f0 tx=0x7f4898004730 comp rx=0 tx=0).stop 2024-03-12T17:20:20.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.638+0000 7f48b3000640 1 -- 172.21.15.17:0/2943147505 shutdown_connections 2024-03-12T17:20:20.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.638+0000 7f48b3000640 1 --2- 172.21.15.17:0/2943147505 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f488c06ac30 0x7f488c06d0f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:20.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.638+0000 7f48b3000640 1 --2- 172.21.15.17:0/2943147505 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f48ac0c7cd0 0x7f48ac133530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:20.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.638+0000 7f48b3000640 1 --2- 172.21.15.17:0/2943147505 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f48ac0c4b60 0x7f48ac0c7790 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:20.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.638+0000 7f48b3000640 1 --2- 172.21.15.17:0/2943147505 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f48940047c0 0x7f48ac143530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:20.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.638+0000 7f48b3000640 1 -- 172.21.15.17:0/2943147505 >> 172.21.15.17:0/2943147505 conn(0x7f48ac069ce0 msgr2=0x7f48ac15d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:20.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.638+0000 7f48b3000640 1 -- 172.21.15.17:0/2943147505 shutdown_connections 2024-03-12T17:20:20.633 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.638+0000 7f48b3000640 1 -- 172.21.15.17:0/2943147505 wait complete. 2024-03-12T17:20:20.656 INFO:tasks.cephfs_test_runner:test_basic (tasks.cephfs.test_dump_tree.TestDumpTree) ... ok 2024-03-12T17:20:20.656 INFO:tasks.cephfs_test_runner:Starting test: test_random (tasks.cephfs.test_dump_tree.TestDumpTree) 2024-03-12T17:20:20.657 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_dump_tree.TestDumpTree.test_random' 2024-03-12T17:20:20.883 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.889+0000 7f702d800640 1 Processor -- start 2024-03-12T17:20:20.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.889+0000 7f702d800640 1 -- start start 2024-03-12T17:20:20.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.891+0000 7f702d800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f70280cb930 0x7f70280b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:20.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.891+0000 7f702d800640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f70280cd850 0x7f70280b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:20.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.891+0000 7f702d800640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70280ce1a0 con 0x7f70280b23e0 2024-03-12T17:20:20.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.891+0000 7f702d800640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70280b1900 con 0x7f70280cb930 2024-03-12T17:20:20.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.891+0000 7f702d800640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70280b1be0 con 0x7f70280cd850 2024-03-12T17:20:20.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.891+0000 7f7027e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f70280cb930 0x7f70280b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:20.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.891+0000 7f7027e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f70280cb930 0x7f70280b45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55572/0 (socket says 172.21.15.17:55572) 2024-03-12T17:20:20.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.891+0000 7f7027e00640 1 -- 172.21.15.17:0/3128449560 learned_addr learned my addr 172.21.15.17:0/3128449560 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:20.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.892+0000 7f7027e00640 1 -- 172.21.15.17:0/3128449560 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f70280cd850 msgr2=0x7f70280b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:20.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.892+0000 7f702ce00640 1 --2- 172.21.15.17:0/3128449560 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f70280cd850 0x7f70280b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:20.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.892+0000 7f7027e00640 1 --2- 172.21.15.17:0/3128449560 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f70280cd850 0x7f70280b2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:20.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.892+0000 7f7027e00640 1 -- 172.21.15.17:0/3128449560 >> v1:172.21.15.94:6789/0 conn(0x7f70280b23e0 legacy=0x7f70280cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:20.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.892+0000 7f7027e00640 1 -- 172.21.15.17:0/3128449560 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70280b1ec0 con 0x7f70280cb930 2024-03-12T17:20:20.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.893+0000 7f7027e00640 1 --2- 172.21.15.17:0/3128449560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70280cb930 0x7f70280b45d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7018009870 tx=0x7f701802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62f2b50eccd4069 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:20.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.893+0000 7f7026a00640 1 -- 172.21.15.17:0/3128449560 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7018031640 con 0x7f70280cb930 2024-03-12T17:20:20.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.893+0000 7f7026a00640 1 -- 172.21.15.17:0/3128449560 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70180317a0 con 0x7f70280cb930 2024-03-12T17:20:20.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.893+0000 7f7026a00640 1 -- 172.21.15.17:0/3128449560 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7018031b30 con 0x7f70280cb930 2024-03-12T17:20:20.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.894+0000 7f702d800640 1 -- 172.21.15.17:0/3128449560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70280cb930 msgr2=0x7f70280b45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:20.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.894+0000 7f702d800640 1 --2- 172.21.15.17:0/3128449560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70280cb930 0x7f70280b45d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f7018009870 tx=0x7f701802b8f0 comp rx=0 tx=0).stop 2024-03-12T17:20:20.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.894+0000 7f702d800640 1 -- 172.21.15.17:0/3128449560 shutdown_connections 2024-03-12T17:20:20.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.894+0000 7f702d800640 1 --2- 172.21.15.17:0/3128449560 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f70280cd850 0x7f70280b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:20.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.894+0000 7f702d800640 1 --2- 172.21.15.17:0/3128449560 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70280cb930 0x7f70280b45d0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:20.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.894+0000 7f702d800640 1 -- 172.21.15.17:0/3128449560 >> 172.21.15.17:0/3128449560 conn(0x7f7028069ce0 msgr2=0x7f702806a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:20.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.894+0000 7f702d800640 1 -- 172.21.15.17:0/3128449560 shutdown_connections 2024-03-12T17:20:20.889 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.894+0000 7f702d800640 1 -- 172.21.15.17:0/3128449560 wait complete. 2024-03-12T17:20:20.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.896+0000 7f702d800640 1 Processor -- start 2024-03-12T17:20:20.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.896+0000 7f702d800640 1 -- start start 2024-03-12T17:20:20.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.897+0000 7f702d800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70280b23e0 0x7f70280ac040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:20.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.897+0000 7f702d800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70280cb930 0x7f70280ad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:20.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.897+0000 7f702d800640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f70280cd850 0x7f70280b0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:20.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.897+0000 7f702d800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70280ac900 con 0x7f70280b23e0 2024-03-12T17:20:20.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.897+0000 7f702d800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70280acbe0 con 0x7f70280cb930 2024-03-12T17:20:20.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.897+0000 7f702d800640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70280acec0 con 0x7f70280cd850 2024-03-12T17:20:20.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.897+0000 7f7027e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70280b23e0 0x7f70280ac040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:20.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.897+0000 7f7027e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70280b23e0 0x7f70280ac040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55584/0 (socket says 172.21.15.17:55584) 2024-03-12T17:20:20.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.897+0000 7f7027e00640 1 -- 172.21.15.17:0/1047744325 learned_addr learned my addr 172.21.15.17:0/1047744325 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:20.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.897+0000 7f7027e00640 1 -- 172.21.15.17:0/1047744325 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f70280cd850 msgr2=0x7f70280b0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:20.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.897+0000 7f7027e00640 1 --2- 172.21.15.17:0/1047744325 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f70280cd850 0x7f70280b0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:20.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.897+0000 7f7027e00640 1 -- 172.21.15.17:0/1047744325 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70280cb930 msgr2=0x7f70280ad9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:20.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.897+0000 7f7027e00640 1 --2- 172.21.15.17:0/1047744325 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70280cb930 0x7f70280ad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:20.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.898+0000 7f7027e00640 1 -- 172.21.15.17:0/1047744325 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70180094d0 con 0x7f70280b23e0 2024-03-12T17:20:20.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.898+0000 7f7027e00640 1 --2- 172.21.15.17:0/1047744325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70280b23e0 0x7f70280ac040 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7018009870 tx=0x7f70180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:20.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.898+0000 7f701fe00640 1 -- 172.21.15.17:0/1047744325 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701803ac60 con 0x7f70280b23e0 2024-03-12T17:20:20.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.898+0000 7f701fe00640 1 -- 172.21.15.17:0/1047744325 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f701803ade0 con 0x7f70280b23e0 2024-03-12T17:20:20.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.898+0000 7f701fe00640 1 -- 172.21.15.17:0/1047744325 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7018044630 con 0x7f70280b23e0 2024-03-12T17:20:20.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.898+0000 7f702d800640 1 -- 172.21.15.17:0/1047744325 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70280ce600 con 0x7f70280b23e0 2024-03-12T17:20:20.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.898+0000 7f702d800640 1 -- 172.21.15.17:0/1047744325 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70280ad480 con 0x7f70280b23e0 2024-03-12T17:20:20.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.900+0000 7f702d800640 1 -- 172.21.15.17:0/1047744325 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70280ad670 con 0x7f70280b23e0 2024-03-12T17:20:20.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.900+0000 7f701fe00640 1 -- 172.21.15.17:0/1047744325 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f701802f050 con 0x7f70280b23e0 2024-03-12T17:20:20.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.901+0000 7f701fe00640 1 --2- 172.21.15.17:0/1047744325 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f700806ac50 0x7f700806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:20.895 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.901+0000 7f701fe00640 1 -- 172.21.15.17:0/1047744325 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f70180ab260 con 0x7f70280b23e0 2024-03-12T17:20:20.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.901+0000 7f7027400640 1 --2- 172.21.15.17:0/1047744325 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f700806ac50 0x7f700806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:20.896 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.902+0000 7f7027400640 1 --2- 172.21.15.17:0/1047744325 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f700806ac50 0x7f700806d110 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f70280b1370 tx=0x7f70140079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:20.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:20.907+0000 7f701fe00640 1 -- 172.21.15.17:0/1047744325 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f7018076720 con 0x7f70280b23e0 2024-03-12T17:20:21.170 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.176+0000 7f702d800640 1 -- 172.21.15.17:0/1047744325 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_dump_tree.TestDumpTree.test_random"]} v 0) v1 -- 0x7f702804e030 con 0x7f70280b23e0 2024-03-12T17:20:21.632 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.637+0000 7f701fe00640 1 -- 172.21.15.17:0/1047744325 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_dump_tree.TestDumpTree.test_random"]}]=0 v108) v1 ==== 134+0+0 (secure 0 0 0) 0x7f7018032040 con 0x7f70280b23e0 2024-03-12T17:20:21.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.641+0000 7f702d800640 1 -- 172.21.15.17:0/1047744325 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f700806ac50 msgr2=0x7f700806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:21.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.641+0000 7f702d800640 1 --2- 172.21.15.17:0/1047744325 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f700806ac50 0x7f700806d110 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f70280b1370 tx=0x7f70140079b0 comp rx=0 tx=0).stop 2024-03-12T17:20:21.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.641+0000 7f702d800640 1 -- 172.21.15.17:0/1047744325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70280b23e0 msgr2=0x7f70280ac040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:21.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.641+0000 7f702d800640 1 --2- 172.21.15.17:0/1047744325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70280b23e0 0x7f70280ac040 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f7018009870 tx=0x7f70180046c0 comp rx=0 tx=0).stop 2024-03-12T17:20:21.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.641+0000 7f702d800640 1 -- 172.21.15.17:0/1047744325 shutdown_connections 2024-03-12T17:20:21.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.641+0000 7f702d800640 1 --2- 172.21.15.17:0/1047744325 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f700806ac50 0x7f700806d110 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:21.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.641+0000 7f702d800640 1 --2- 172.21.15.17:0/1047744325 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f70280cd850 0x7f70280b0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:21.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.641+0000 7f702d800640 1 --2- 172.21.15.17:0/1047744325 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f70280cb930 0x7f70280ad9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:21.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.641+0000 7f702d800640 1 --2- 172.21.15.17:0/1047744325 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f70280b23e0 0x7f70280ac040 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:21.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.641+0000 7f702d800640 1 -- 172.21.15.17:0/1047744325 >> 172.21.15.17:0/1047744325 conn(0x7f7028069ce0 msgr2=0x7f702806a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:21.636 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.641+0000 7f702d800640 1 -- 172.21.15.17:0/1047744325 shutdown_connections 2024-03-12T17:20:21.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.641+0000 7f702d800640 1 -- 172.21.15.17:0/1047744325 wait complete. 2024-03-12T17:20:21.657 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-03-12T17:20:21.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.885+0000 7fe493200640 1 Processor -- start 2024-03-12T17:20:21.880 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.885+0000 7fe493200640 1 -- start start 2024-03-12T17:20:21.881 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.887+0000 7fe493200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe4940b3b70 0x7fe4940b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:21.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.887+0000 7fe493200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4940a7660 con 0x7fe49415ae20 2024-03-12T17:20:21.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.887+0000 7fe493200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4940b44e0 con 0x7fe4941441f0 2024-03-12T17:20:21.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.887+0000 7fe493200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49415e460 con 0x7fe4940b3b70 2024-03-12T17:20:21.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.887+0000 7fe48be00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fe49415ae20 0x7fe49406d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:53218/0 (socket says 172.21.15.17:53218) 2024-03-12T17:20:21.882 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.888+0000 7fe48be00640 1 -- 172.21.15.17:0/2838934800 learned_addr learned my addr 172.21.15.17:0/2838934800 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:20:21.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.888+0000 7fe492800640 1 --2- 172.21.15.17:0/2838934800 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe4940b3b70 0x7fe4940b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:21.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.888+0000 7fe491400640 1 -- 172.21.15.17:0/2838934800 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2951960627 0 0) 0x7fe4940a7660 con 0x7fe49415ae20 2024-03-12T17:20:21.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.888+0000 7fe491400640 1 -- 172.21.15.17:0/2838934800 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe478003520 con 0x7fe49415ae20 2024-03-12T17:20:21.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.888+0000 7fe491400640 1 -- 172.21.15.17:0/2838934800 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3893824740 0 0) 0x7fe4940b44e0 con 0x7fe4941441f0 2024-03-12T17:20:21.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.888+0000 7fe491400640 1 -- 172.21.15.17:0/2838934800 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4940a7660 con 0x7fe4941441f0 2024-03-12T17:20:21.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.888+0000 7fe491400640 1 -- 172.21.15.17:0/2838934800 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4080885491 0 0) 0x7fe478003520 con 0x7fe49415ae20 2024-03-12T17:20:21.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.888+0000 7fe491400640 1 -- 172.21.15.17:0/2838934800 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe4940b3b70 msgr2=0x7fe4940b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:21.884 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.889+0000 7fe491400640 1 --2- 172.21.15.17:0/2838934800 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe4940b3b70 0x7fe4940b3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:21.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.889+0000 7fe491400640 1 -- 172.21.15.17:0/2838934800 >> v1:172.21.15.94:6789/0 conn(0x7fe4941441f0 legacy=0x7fe494070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:21.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.889+0000 7fe491400640 1 -- 172.21.15.17:0/2838934800 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4941445d0 con 0x7fe49415ae20 2024-03-12T17:20:21.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.889+0000 7fe491400640 1 -- 172.21.15.17:0/2838934800 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7fe47c001670 con 0x7fe49415ae20 2024-03-12T17:20:21.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.889+0000 7fe491400640 1 -- 172.21.15.17:0/2838934800 >> v1:172.21.15.17:6789/0 conn(0x7fe49415ae20 legacy=0x7fe49406d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:21.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.889+0000 7fe491400640 1 --2- 172.21.15.17:0/2838934800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe478003b30 0x7fe478003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:21.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.889+0000 7fe491400640 1 --2- 172.21.15.17:0/2838934800 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4780047c0 0x7fe478004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:21.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.889+0000 7fe491400640 1 --2- 172.21.15.17:0/2838934800 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe4940b3b70 0x7fe478005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:21.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.889+0000 7fe491400640 1 -- 172.21.15.17:0/2838934800 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49415e460 con 0x7fe478003b30 2024-03-12T17:20:21.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.889+0000 7fe491400640 1 -- 172.21.15.17:0/2838934800 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47800ba60 con 0x7fe4780047c0 2024-03-12T17:20:21.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.889+0000 7fe491400640 1 -- 172.21.15.17:0/2838934800 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe47800bc20 con 0x7fe4940b3b70 2024-03-12T17:20:21.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.889+0000 7fe491e00640 1 --2- 172.21.15.17:0/2838934800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe478003b30 0x7fe478003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:21.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.889+0000 7fe492800640 1 --2- 172.21.15.17:0/2838934800 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe4940b3b70 0x7fe478005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:21.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.889+0000 7fe48be00640 1 --2- 172.21.15.17:0/2838934800 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4780047c0 0x7fe478004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:21.885 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.889+0000 7fe491e00640 1 -- 172.21.15.17:0/2838934800 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe4940b3b70 msgr2=0x7fe478005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:21.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.890+0000 7fe491e00640 1 --2- 172.21.15.17:0/2838934800 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe4940b3b70 0x7fe478005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:21.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.890+0000 7fe491e00640 1 -- 172.21.15.17:0/2838934800 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4780047c0 msgr2=0x7fe478004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:21.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.890+0000 7fe491e00640 1 --2- 172.21.15.17:0/2838934800 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4780047c0 0x7fe478004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:21.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.890+0000 7fe491e00640 1 -- 172.21.15.17:0/2838934800 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe478003520 con 0x7fe478003b30 2024-03-12T17:20:21.886 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.890+0000 7fe48be00640 1 --2- 172.21.15.17:0/2838934800 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe4780047c0 0x7fe478004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:21.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.891+0000 7fe491e00640 1 --2- 172.21.15.17:0/2838934800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe478003b30 0x7fe478003f50 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe4840018a0 tx=0x7fe4780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f15f13f76cbfedd server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:21.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.891+0000 7fe491400640 1 -- 172.21.15.17:0/2838934800 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4840052d0 con 0x7fe478003b30 2024-03-12T17:20:21.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.891+0000 7fe491400640 1 -- 172.21.15.17:0/2838934800 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe484005430 con 0x7fe478003b30 2024-03-12T17:20:21.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.891+0000 7fe491400640 1 -- 172.21.15.17:0/2838934800 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe484003810 con 0x7fe478003b30 2024-03-12T17:20:21.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.892+0000 7fe493200640 1 -- 172.21.15.17:0/2838934800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe478003b30 msgr2=0x7fe478003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:21.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.892+0000 7fe493200640 1 --2- 172.21.15.17:0/2838934800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe478003b30 0x7fe478003f50 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe4840018a0 tx=0x7fe4780057f0 comp rx=0 tx=0).stop 2024-03-12T17:20:21.887 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.892+0000 7fe492800640 1 -- 172.21.15.17:0/2838934800 reap_dead start 2024-03-12T17:20:21.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.892+0000 7fe493200640 1 -- 172.21.15.17:0/2838934800 shutdown_connections 2024-03-12T17:20:21.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.892+0000 7fe493200640 1 -- 172.21.15.17:0/2838934800 >> 172.21.15.17:0/2838934800 conn(0x7fe494069ce0 msgr2=0x7fe49406a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:21.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.892+0000 7fe493200640 1 -- 172.21.15.17:0/2838934800 shutdown_connections 2024-03-12T17:20:21.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.892+0000 7fe493200640 1 -- 172.21.15.17:0/2838934800 wait complete. 2024-03-12T17:20:21.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.894+0000 7fe493200640 1 Processor -- start 2024-03-12T17:20:21.888 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.894+0000 7fe493200640 1 -- start start 2024-03-12T17:20:21.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.895+0000 7fe493200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe478003b30 0x7fe4941f64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:21.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.895+0000 7fe493200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe494159190 0x7fe494159610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:21.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.895+0000 7fe493200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe494140c80 0x7fe494141100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:21.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.895+0000 7fe493200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe494159b50 con 0x7fe494140c80 2024-03-12T17:20:21.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.895+0000 7fe493200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49415cf70 con 0x7fe494159190 2024-03-12T17:20:21.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.895+0000 7fe493200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49415c360 con 0x7fe478003b30 2024-03-12T17:20:21.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.895+0000 7fe492800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe494140c80 0x7fe494141100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:21.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.895+0000 7fe492800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe494140c80 0x7fe494141100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:55604/0 (socket says 172.21.15.17:55604) 2024-03-12T17:20:21.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.895+0000 7fe492800640 1 -- 172.21.15.17:0/2003674561 learned_addr learned my addr 172.21.15.17:0/2003674561 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:21.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.895+0000 7fe48be00640 1 --2- 172.21.15.17:0/2003674561 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe494159190 0x7fe494159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:21.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.895+0000 7fe491e00640 1 --2- 172.21.15.17:0/2003674561 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe478003b30 0x7fe4941f64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:21.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.896+0000 7fe492800640 1 -- 172.21.15.17:0/2003674561 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe478003b30 msgr2=0x7fe4941f64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:21.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.896+0000 7fe492800640 1 --2- 172.21.15.17:0/2003674561 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe478003b30 0x7fe4941f64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:21.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.896+0000 7fe492800640 1 -- 172.21.15.17:0/2003674561 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe494159190 msgr2=0x7fe494159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:21.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.896+0000 7fe492800640 1 --2- 172.21.15.17:0/2003674561 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe494159190 0x7fe494159610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:21.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.896+0000 7fe492800640 1 -- 172.21.15.17:0/2003674561 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49415c640 con 0x7fe494140c80 2024-03-12T17:20:21.891 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.896+0000 7fe48be00640 1 --2- 172.21.15.17:0/2003674561 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe494159190 0x7fe494159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:20:21.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.896+0000 7fe492800640 1 --2- 172.21.15.17:0/2003674561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe494140c80 0x7fe494141100 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe494070090 tx=0x7fe48c0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:21.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.896+0000 7fe48a000640 1 -- 172.21.15.17:0/2003674561 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c00e070 con 0x7fe494140c80 2024-03-12T17:20:21.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.896+0000 7fe48a000640 1 -- 172.21.15.17:0/2003674561 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48c011e10 con 0x7fe494140c80 2024-03-12T17:20:21.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.896+0000 7fe48a000640 1 -- 172.21.15.17:0/2003674561 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c003990 con 0x7fe494140c80 2024-03-12T17:20:21.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.896+0000 7fe493200640 1 -- 172.21.15.17:0/2003674561 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe49415c920 con 0x7fe494140c80 2024-03-12T17:20:21.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.897+0000 7fe493200640 1 -- 172.21.15.17:0/2003674561 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4941f6a30 con 0x7fe494140c80 2024-03-12T17:20:21.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.898+0000 7fe493200640 1 -- 172.21.15.17:0/2003674561 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe49415d120 con 0x7fe494140c80 2024-03-12T17:20:21.892 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.898+0000 7fe48a000640 1 -- 172.21.15.17:0/2003674561 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fe48c003af0 con 0x7fe494140c80 2024-03-12T17:20:21.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.899+0000 7fe48a000640 1 --2- 172.21.15.17:0/2003674561 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe47006ac30 0x7fe47006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:21.893 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.899+0000 7fe48a000640 1 -- 172.21.15.17:0/2003674561 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe48c0897b0 con 0x7fe494140c80 2024-03-12T17:20:21.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.900+0000 7fe491e00640 1 --2- 172.21.15.17:0/2003674561 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe47006ac30 0x7fe47006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:21.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.900+0000 7fe491e00640 1 --2- 172.21.15.17:0/2003674561 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe47006ac30 0x7fe47006d0f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe484034000 tx=0x7fe484031000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:21.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:21.904+0000 7fe48a000640 1 -- 172.21.15.17:0/2003674561 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fe49415d120 con 0x7fe494140c80 2024-03-12T17:20:22.101 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.107+0000 7fe493200640 1 -- 172.21.15.17:0/2003674561 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe49415d0e0 con 0x7fe494140c80 2024-03-12T17:20:22.107 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.112+0000 7fe48a000640 1 -- 172.21.15.17:0/2003674561 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe48c054c90 con 0x7fe494140c80 2024-03-12T17:20:22.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.115+0000 7fe493200640 1 -- 172.21.15.17:0/2003674561 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe47006ac30 msgr2=0x7fe47006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:22.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.115+0000 7fe493200640 1 --2- 172.21.15.17:0/2003674561 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe47006ac30 0x7fe47006d0f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe484034000 tx=0x7fe484031000 comp rx=0 tx=0).stop 2024-03-12T17:20:22.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.115+0000 7fe493200640 1 -- 172.21.15.17:0/2003674561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe494140c80 msgr2=0x7fe494141100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:22.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.115+0000 7fe493200640 1 --2- 172.21.15.17:0/2003674561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe494140c80 0x7fe494141100 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe494070090 tx=0x7fe48c0115a0 comp rx=0 tx=0).stop 2024-03-12T17:20:22.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.115+0000 7fe493200640 1 -- 172.21.15.17:0/2003674561 shutdown_connections 2024-03-12T17:20:22.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.115+0000 7fe493200640 1 --2- 172.21.15.17:0/2003674561 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe47006ac30 0x7fe47006d0f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:22.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.115+0000 7fe493200640 1 --2- 172.21.15.17:0/2003674561 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe494140c80 0x7fe494141100 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:22.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.115+0000 7fe493200640 1 --2- 172.21.15.17:0/2003674561 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe494159190 0x7fe494159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:22.110 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.115+0000 7fe493200640 1 --2- 172.21.15.17:0/2003674561 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe478003b30 0x7fe4941f64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:22.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.116+0000 7fe493200640 1 -- 172.21.15.17:0/2003674561 >> 172.21.15.17:0/2003674561 conn(0x7fe494069ce0 msgr2=0x7fe49415a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:22.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.116+0000 7fe493200640 1 -- 172.21.15.17:0/2003674561 shutdown_connections 2024-03-12T17:20:22.111 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.116+0000 7fe493200640 1 -- 172.21.15.17:0/2003674561 wait complete. 2024-03-12T17:20:22.130 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-12T17:20:22.130 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-12T17:20:22.247 DEBUG:teuthology.orchestra.run.smithi094:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-12T17:20:22.350 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-12T17:20:22.350 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:20:22.351 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-12T17:20:22.411 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054202,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249800k,nr_inodes=812450,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-12T17:20:22.411 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-12T17:20:22.411 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-12T17:20:22.468 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053417,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498348k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249172k,nr_inodes=812293,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498348k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-12T17:20:22.468 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:20:22.468 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-12T17:20:22.529 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054202,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249800k,nr_inodes=812450,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-12T17:20:22.529 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-12T17:20:22.529 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-12T17:20:22.586 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053417,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498348k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249172k,nr_inodes=812293,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498348k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-12T17:20:22.586 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-03-12T17:20:22.586 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-12T17:20:22.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.813+0000 7fba9d600640 1 Processor -- start 2024-03-12T17:20:22.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.813+0000 7fba9d600640 1 -- start start 2024-03-12T17:20:22.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.815+0000 7fba9d600640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fba980b1860 0x7fba980b4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:22.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.815+0000 7fba9d600640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba981461a0 con 0x7fba98070240 2024-03-12T17:20:22.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.815+0000 7fba9d600640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba980b3db0 con 0x7fba98145dc0 2024-03-12T17:20:22.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.815+0000 7fba9d600640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba980b2000 con 0x7fba980b1860 2024-03-12T17:20:22.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.815+0000 7fba9cc00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fba98070240 0x7fba980abb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:56610/0 (socket says 172.21.15.17:56610) 2024-03-12T17:20:22.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.815+0000 7fba9cc00640 1 -- 172.21.15.17:0/746196671 learned_addr learned my addr 172.21.15.17:0/746196671 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:20:22.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.815+0000 7fba97400640 1 --2- 172.21.15.17:0/746196671 >> v2:172.21.15.17:3300/0 conn(0x7fba980b1860 0x7fba980b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:22.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.816+0000 7fba96a00640 1 -- 172.21.15.17:0/746196671 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 20101706 0 0) 0x7fba981461a0 con 0x7fba98070240 2024-03-12T17:20:22.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.816+0000 7fba96a00640 1 -- 172.21.15.17:0/746196671 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba7c003520 con 0x7fba98070240 2024-03-12T17:20:22.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.816+0000 7fba97400640 1 -- 172.21.15.17:0/746196671 >> v1:172.21.15.94:6789/0 conn(0x7fba98145dc0 legacy=0x7fba98160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:22.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.816+0000 7fba97400640 1 -- 172.21.15.17:0/746196671 >> v1:172.21.15.17:6789/0 conn(0x7fba98070240 legacy=0x7fba980abb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:22.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.816+0000 7fba97400640 1 -- 172.21.15.17:0/746196671 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba98146680 con 0x7fba980b1860 2024-03-12T17:20:22.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.817+0000 7fba97400640 1 --2- 172.21.15.17:0/746196671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba980b1860 0x7fba980b4240 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fba840097a0 tx=0x7fba8402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f731888fcd6ea0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:22.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.817+0000 7fba96a00640 1 -- 172.21.15.17:0/746196671 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba84030610 con 0x7fba980b1860 2024-03-12T17:20:22.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.817+0000 7fba96a00640 1 -- 172.21.15.17:0/746196671 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba84030770 con 0x7fba980b1860 2024-03-12T17:20:22.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.817+0000 7fba96a00640 1 -- 172.21.15.17:0/746196671 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba84030b00 con 0x7fba980b1860 2024-03-12T17:20:22.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.818+0000 7fba9d600640 1 -- 172.21.15.17:0/746196671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba980b1860 msgr2=0x7fba980b4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:22.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.818+0000 7fba9d600640 1 --2- 172.21.15.17:0/746196671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba980b1860 0x7fba980b4240 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fba840097a0 tx=0x7fba8402b960 comp rx=0 tx=0).stop 2024-03-12T17:20:22.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.818+0000 7fba9d600640 1 -- 172.21.15.17:0/746196671 shutdown_connections 2024-03-12T17:20:22.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.818+0000 7fba9d600640 1 --2- 172.21.15.17:0/746196671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba980b1860 0x7fba980b4240 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:22.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.818+0000 7fba9d600640 1 -- 172.21.15.17:0/746196671 >> 172.21.15.17:0/746196671 conn(0x7fba98069ce0 msgr2=0x7fba9806a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:22.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.818+0000 7fba9d600640 1 -- 172.21.15.17:0/746196671 shutdown_connections 2024-03-12T17:20:22.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.818+0000 7fba9d600640 1 -- 172.21.15.17:0/746196671 wait complete. 2024-03-12T17:20:22.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.820+0000 7fba9d600640 1 Processor -- start 2024-03-12T17:20:22.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.820+0000 7fba9d600640 1 -- start start 2024-03-12T17:20:22.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.821+0000 7fba9d600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fba98070240 0x7fba9813b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:22.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.821+0000 7fba9d600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba980b1860 0x7fba9813ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:22.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.821+0000 7fba9d600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba98145dc0 0x7fba98140520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:22.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.821+0000 7fba9d600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9813c3e0 con 0x7fba98145dc0 2024-03-12T17:20:22.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.821+0000 7fba9d600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9813b610 con 0x7fba980b1860 2024-03-12T17:20:22.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.821+0000 7fba9d600640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba9813bab0 con 0x7fba98070240 2024-03-12T17:20:22.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.822+0000 7fba9cc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba98145dc0 0x7fba98140520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:22.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.822+0000 7fba9cc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba98145dc0 0x7fba98140520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47248/0 (socket says 172.21.15.17:47248) 2024-03-12T17:20:22.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.822+0000 7fba9cc00640 1 -- 172.21.15.17:0/930594207 learned_addr learned my addr 172.21.15.17:0/930594207 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:22.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.822+0000 7fba97400640 1 --2- 172.21.15.17:0/930594207 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba980b1860 0x7fba9813ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:22.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.822+0000 7fba97e00640 1 --2- 172.21.15.17:0/930594207 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fba98070240 0x7fba9813b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:22.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.822+0000 7fba9cc00640 1 -- 172.21.15.17:0/930594207 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fba98070240 msgr2=0x7fba9813b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:22.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.822+0000 7fba9cc00640 1 --2- 172.21.15.17:0/930594207 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fba98070240 0x7fba9813b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:22.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.822+0000 7fba9cc00640 1 -- 172.21.15.17:0/930594207 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba980b1860 msgr2=0x7fba9813ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:22.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.822+0000 7fba9cc00640 1 --2- 172.21.15.17:0/930594207 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba980b1860 0x7fba9813ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:22.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.822+0000 7fba9cc00640 1 -- 172.21.15.17:0/930594207 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba84009400 con 0x7fba98145dc0 2024-03-12T17:20:22.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.822+0000 7fba9cc00640 1 --2- 172.21.15.17:0/930594207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba98145dc0 0x7fba98140520 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fba9000cb40 tx=0x7fba9000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:22.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.823+0000 7fba8fe00640 1 -- 172.21.15.17:0/930594207 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9000aca0 con 0x7fba98145dc0 2024-03-12T17:20:22.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.823+0000 7fba8fe00640 1 -- 172.21.15.17:0/930594207 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9000ae00 con 0x7fba98145dc0 2024-03-12T17:20:22.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.823+0000 7fba8fe00640 1 -- 172.21.15.17:0/930594207 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba90012620 con 0x7fba98145dc0 2024-03-12T17:20:22.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.823+0000 7fba9d600640 1 -- 172.21.15.17:0/930594207 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba9813bd20 con 0x7fba98145dc0 2024-03-12T17:20:22.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.823+0000 7fba9d600640 1 -- 172.21.15.17:0/930594207 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba981448c0 con 0x7fba98145dc0 2024-03-12T17:20:22.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.824+0000 7fba9d600640 1 -- 172.21.15.17:0/930594207 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba9813c520 con 0x7fba98145dc0 2024-03-12T17:20:22.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.825+0000 7fba8fe00640 1 -- 172.21.15.17:0/930594207 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fba90007070 con 0x7fba98145dc0 2024-03-12T17:20:22.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.826+0000 7fba8fe00640 1 --2- 172.21.15.17:0/930594207 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fba7806ac00 0x7fba7806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:22.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.827+0000 7fba8fe00640 1 -- 172.21.15.17:0/930594207 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fba900890d0 con 0x7fba98145dc0 2024-03-12T17:20:22.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.827+0000 7fba97e00640 1 --2- 172.21.15.17:0/930594207 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fba7806ac00 0x7fba7806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:22.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.827+0000 7fba97e00640 1 --2- 172.21.15.17:0/930594207 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fba7806ac00 0x7fba7806d0c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fba88000f60 tx=0x7fba88009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:22.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:22.831+0000 7fba8fe00640 1 -- 172.21.15.17:0/930594207 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fba9813c520 con 0x7fba98145dc0 2024-03-12T17:20:23.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.067+0000 7fba9d600640 1 -- 172.21.15.17:0/930594207 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba9813c520 con 0x7fba98145dc0 2024-03-12T17:20:23.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.068+0000 7fba8fe00640 1 -- 172.21.15.17:0/930594207 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+3526 (secure 0 0 0) 0x7fba90017de0 con 0x7fba98145dc0 2024-03-12T17:20:23.062 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:20:23.063 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":16,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6834/934570591","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":934570591},{"type":"v1","addr":"172.21.15.94:6834","nonce":934570591}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4640,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/2007868406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6833","nonce":2007868406},{"type":"v1","addr":"172.21.15.94:6835","nonce":2007868406}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4768,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6836/2733057827","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":2733057827},{"type":"v1","addr":"172.21.15.17:6836","nonce":2733057827}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":5367,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/1646172292","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6835","nonce":1646172292},{"type":"v1","addr":"172.21.15.17:6837","nonce":1646172292}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[]} 2024-03-12T17:20:23.063 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 16 2024-03-12T17:20:23.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.071+0000 7fba9d600640 1 -- 172.21.15.17:0/930594207 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fba7806ac00 msgr2=0x7fba7806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:23.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.071+0000 7fba9d600640 1 --2- 172.21.15.17:0/930594207 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fba7806ac00 0x7fba7806d0c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fba88000f60 tx=0x7fba88009040 comp rx=0 tx=0).stop 2024-03-12T17:20:23.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.071+0000 7fba9d600640 1 -- 172.21.15.17:0/930594207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba98145dc0 msgr2=0x7fba98140520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:23.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.071+0000 7fba9d600640 1 --2- 172.21.15.17:0/930594207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba98145dc0 0x7fba98140520 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fba9000cb40 tx=0x7fba9000a060 comp rx=0 tx=0).stop 2024-03-12T17:20:23.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.071+0000 7fba9d600640 1 -- 172.21.15.17:0/930594207 shutdown_connections 2024-03-12T17:20:23.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.071+0000 7fba9d600640 1 --2- 172.21.15.17:0/930594207 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fba7806ac00 0x7fba7806d0c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:23.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.071+0000 7fba9d600640 1 --2- 172.21.15.17:0/930594207 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fba98145dc0 0x7fba98140520 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:23.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.071+0000 7fba9d600640 1 --2- 172.21.15.17:0/930594207 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fba980b1860 0x7fba9813ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:23.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.071+0000 7fba9d600640 1 --2- 172.21.15.17:0/930594207 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fba98070240 0x7fba9813b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:23.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.071+0000 7fba9d600640 1 -- 172.21.15.17:0/930594207 >> 172.21.15.17:0/930594207 conn(0x7fba98069ce0 msgr2=0x7fba980acc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:23.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.071+0000 7fba9d600640 1 -- 172.21.15.17:0/930594207 shutdown_connections 2024-03-12T17:20:23.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.071+0000 7fba9d600640 1 -- 172.21.15.17:0/930594207 wait complete. 2024-03-12T17:20:23.084 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-12T17:20:23.084 INFO:tasks.ceph.mds.a:Stopping old one... 2024-03-12T17:20:23.084 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-12T17:20:23.085 INFO:teuthology.orchestra.run:waiting for 300 2024-03-12T17:20:23.085 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-12T17:20:23.085 INFO:tasks.ceph.mds.c:Stopping old one... 2024-03-12T17:20:23.085 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-12T17:20:23.085 INFO:teuthology.orchestra.run:waiting for 300 2024-03-12T17:20:23.085 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-12T17:20:23.085 INFO:tasks.ceph.mds.b:Stopping old one... 2024-03-12T17:20:23.086 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-12T17:20:23.086 INFO:teuthology.orchestra.run:waiting for 300 2024-03-12T17:20:23.086 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-12T17:20:23.086 INFO:tasks.ceph.mds.d:Stopping old one... 2024-03-12T17:20:23.086 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-12T17:20:23.086 INFO:teuthology.orchestra.run:waiting for 300 2024-03-12T17:20:23.102 INFO:tasks.ceph.mds.a:Stopped 2024-03-12T17:20:23.102 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-12T17:20:23.104 INFO:tasks.ceph.mds.c:Stopped 2024-03-12T17:20:23.105 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-12T17:20:23.116 INFO:tasks.ceph.mds.b:Stopped 2024-03-12T17:20:23.116 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-12T17:20:23.123 INFO:tasks.ceph.mds.d:Stopped 2024-03-12T17:20:23.123 DEBUG:teuthology.orchestra.run.smithi094:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-12T17:20:23.153 INFO:tasks.ceph.mds.a:Started 2024-03-12T17:20:23.153 DEBUG:teuthology.parallel:result is None 2024-03-12T17:20:23.159 INFO:tasks.ceph.mds.c:Started 2024-03-12T17:20:23.160 DEBUG:teuthology.parallel:result is None 2024-03-12T17:20:23.170 INFO:tasks.ceph.mds.b:Started 2024-03-12T17:20:23.171 DEBUG:teuthology.parallel:result is None 2024-03-12T17:20:23.176 INFO:tasks.ceph.mds.d:Started 2024-03-12T17:20:23.176 DEBUG:teuthology.parallel:result is None 2024-03-12T17:20:23.177 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-03-12T17:20:23.313 INFO:tasks.ceph.mds.a.smithi017.stdout:starting mds.a at 2024-03-12T17:20:23.318 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2024-03-12T17:20:23.330 INFO:tasks.ceph.mds.b.smithi094.stdout:starting mds.b at 2024-03-12T17:20:23.332 INFO:tasks.ceph.mds.d.smithi094.stdout:starting mds.d at 2024-03-12T17:20:23.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.379+0000 7f57e3000640 1 Processor -- start 2024-03-12T17:20:23.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.379+0000 7f57e3000640 1 -- start start 2024-03-12T17:20:23.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.380+0000 7f57e3000640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f57dc15cbd0 0x7f57dc0d0de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:23.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.380+0000 7f57e3000640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57dc0b6e00 con 0x7f57dc0b5aa0 2024-03-12T17:20:23.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.380+0000 7f57e3000640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57dc0b61f0 con 0x7f57dc0cfa70 2024-03-12T17:20:23.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.380+0000 7f57e3000640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57dc0b64d0 con 0x7f57dc15cbd0 2024-03-12T17:20:23.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.381+0000 7f57db400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f57dc0b5aa0 0x7f57dc0b84b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:56638/0 (socket says 172.21.15.17:56638) 2024-03-12T17:20:23.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.381+0000 7f57db400640 1 -- 172.21.15.17:0/98481410 learned_addr learned my addr 172.21.15.17:0/98481410 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:20:23.375 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.381+0000 7f57dbe00640 1 --2- 172.21.15.17:0/98481410 >> v2:172.21.15.94:3300/0 conn(0x7f57dc15cbd0 0x7f57dc0d0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:23.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.381+0000 7f57daa00640 1 -- 172.21.15.17:0/98481410 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3288123693 0 0) 0x7f57dc0b6e00 con 0x7f57dc0b5aa0 2024-03-12T17:20:23.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.381+0000 7f57daa00640 1 -- 172.21.15.17:0/98481410 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57c0003520 con 0x7f57dc0b5aa0 2024-03-12T17:20:23.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.381+0000 7f57daa00640 1 -- 172.21.15.17:0/98481410 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2243284075 0 0) 0x7f57dc0b61f0 con 0x7f57dc0cfa70 2024-03-12T17:20:23.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.381+0000 7f57daa00640 1 -- 172.21.15.17:0/98481410 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57dc0b6e00 con 0x7f57dc0cfa70 2024-03-12T17:20:23.376 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.381+0000 7f57dbe00640 1 -- 172.21.15.17:0/98481410 >> v1:172.21.15.94:6789/0 conn(0x7f57dc0cfa70 legacy=0x7f57dc0b7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:23.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.381+0000 7f57dbe00640 1 -- 172.21.15.17:0/98481410 >> v1:172.21.15.17:6789/0 conn(0x7f57dc0b5aa0 legacy=0x7f57dc0b84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:23.377 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.381+0000 7f57dbe00640 1 -- 172.21.15.17:0/98481410 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57dc0b67b0 con 0x7f57dc15cbd0 2024-03-12T17:20:23.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.383+0000 7f57dbe00640 1 --2- 172.21.15.17:0/98481410 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57dc15cbd0 0x7f57dc0d0de0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f57cc0097a0 tx=0x7f57cc02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e822d5fcedb9b79 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:23.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.383+0000 7f57daa00640 1 -- 172.21.15.17:0/98481410 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc030610 con 0x7f57dc15cbd0 2024-03-12T17:20:23.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.383+0000 7f57daa00640 1 -- 172.21.15.17:0/98481410 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57cc030770 con 0x7f57dc15cbd0 2024-03-12T17:20:23.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.383+0000 7f57daa00640 1 -- 172.21.15.17:0/98481410 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc030b00 con 0x7f57dc15cbd0 2024-03-12T17:20:23.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.383+0000 7f57e3000640 1 -- 172.21.15.17:0/98481410 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57dc15cbd0 msgr2=0x7f57dc0d0de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:23.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.383+0000 7f57e3000640 1 --2- 172.21.15.17:0/98481410 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57dc15cbd0 0x7f57dc0d0de0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f57cc0097a0 tx=0x7f57cc02b960 comp rx=0 tx=0).stop 2024-03-12T17:20:23.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.383+0000 7f57e3000640 1 -- 172.21.15.17:0/98481410 shutdown_connections 2024-03-12T17:20:23.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.383+0000 7f57e3000640 1 --2- 172.21.15.17:0/98481410 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57dc15cbd0 0x7f57dc0d0de0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:23.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.383+0000 7f57e3000640 1 -- 172.21.15.17:0/98481410 >> 172.21.15.17:0/98481410 conn(0x7f57dc065df0 msgr2=0x7f57dc066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:23.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.384+0000 7f57e3000640 1 -- 172.21.15.17:0/98481410 shutdown_connections 2024-03-12T17:20:23.378 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.384+0000 7f57e3000640 1 -- 172.21.15.17:0/98481410 wait complete. 2024-03-12T17:20:23.379 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.385+0000 7f57e3000640 1 Processor -- start 2024-03-12T17:20:23.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.385+0000 7f57e3000640 1 -- start start 2024-03-12T17:20:23.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.386+0000 7f57e3000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57dc0b5aa0 0x7f57dc1592c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:23.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.386+0000 7f57e3000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57dc0cfa70 0x7f57dc0c6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:23.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.386+0000 7f57e3000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f57dc15cbd0 0x7f57dc0b2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:23.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.386+0000 7f57e3000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc15dd50 con 0x7f57dc0cfa70 2024-03-12T17:20:23.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.386+0000 7f57e3000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc0a94f0 con 0x7f57dc0b5aa0 2024-03-12T17:20:23.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.386+0000 7f57e3000640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57dc15df60 con 0x7f57dc15cbd0 2024-03-12T17:20:23.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.387+0000 7f57db400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57dc0cfa70 0x7f57dc0c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:23.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.387+0000 7f57db400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57dc0cfa70 0x7f57dc0c6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47272/0 (socket says 172.21.15.17:47272) 2024-03-12T17:20:23.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.387+0000 7f57dbe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57dc0b5aa0 0x7f57dc1592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:23.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.387+0000 7f57db400640 1 -- 172.21.15.17:0/449657184 learned_addr learned my addr 172.21.15.17:0/449657184 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:23.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.387+0000 7f57e1000640 1 --2- 172.21.15.17:0/449657184 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f57dc15cbd0 0x7f57dc0b2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:23.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.387+0000 7f57db400640 1 -- 172.21.15.17:0/449657184 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f57dc15cbd0 msgr2=0x7f57dc0b2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:23.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.387+0000 7f57db400640 1 --2- 172.21.15.17:0/449657184 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f57dc15cbd0 0x7f57dc0b2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:23.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.387+0000 7f57db400640 1 -- 172.21.15.17:0/449657184 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57dc0b5aa0 msgr2=0x7f57dc1592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:23.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.387+0000 7f57db400640 1 --2- 172.21.15.17:0/449657184 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57dc0b5aa0 0x7f57dc1592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:23.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.387+0000 7f57db400640 1 -- 172.21.15.17:0/449657184 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57cc009400 con 0x7f57dc0cfa70 2024-03-12T17:20:23.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.387+0000 7f57e1000640 1 --2- 172.21.15.17:0/449657184 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f57dc15cbd0 0x7f57dc0b2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:20:23.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.388+0000 7f57db400640 1 --2- 172.21.15.17:0/449657184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57dc0cfa70 0x7f57dc0c6170 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f57c800c500 tx=0x7f57c800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:23.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.388+0000 7f57d3e00640 1 -- 172.21.15.17:0/449657184 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c8005ce0 con 0x7f57dc0cfa70 2024-03-12T17:20:23.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.388+0000 7f57d3e00640 1 -- 172.21.15.17:0/449657184 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c8005e40 con 0x7f57dc0cfa70 2024-03-12T17:20:23.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.388+0000 7f57d3e00640 1 -- 172.21.15.17:0/449657184 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c80072f0 con 0x7f57dc0cfa70 2024-03-12T17:20:23.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.388+0000 7f57e3000640 1 -- 172.21.15.17:0/449657184 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57dc15e240 con 0x7f57dc0cfa70 2024-03-12T17:20:23.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.388+0000 7f57e3000640 1 -- 172.21.15.17:0/449657184 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57dc15e800 con 0x7f57dc0cfa70 2024-03-12T17:20:23.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.389+0000 7f57e3000640 1 -- 172.21.15.17:0/449657184 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57dc0736c0 con 0x7f57dc0cfa70 2024-03-12T17:20:23.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.390+0000 7f57d3e00640 1 -- 172.21.15.17:0/449657184 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f57c8007450 con 0x7f57dc0cfa70 2024-03-12T17:20:23.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.391+0000 7f57d3e00640 1 --2- 172.21.15.17:0/449657184 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f57bc06ac50 0x7f57bc06d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:23.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.391+0000 7f57d3e00640 1 -- 172.21.15.17:0/449657184 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f57c80885b0 con 0x7f57dc0cfa70 2024-03-12T17:20:23.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.391+0000 7f57dbe00640 1 --2- 172.21.15.17:0/449657184 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f57bc06ac50 0x7f57bc06d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:23.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.392+0000 7f57dbe00640 1 --2- 172.21.15.17:0/449657184 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f57bc06ac50 0x7f57bc06d110 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f57cc036000 tx=0x7f57cc03b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:23.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.395+0000 7f57d3e00640 1 -- 172.21.15.17:0/449657184 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f57c8053bb0 con 0x7f57dc0cfa70 2024-03-12T17:20:23.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:23.610+0000 7f57e3000640 1 -- 172.21.15.17:0/449657184 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f57dc066550 con 0x7f57dc0cfa70 2024-03-12T17:20:24.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.371+0000 7f57d3e00640 1 -- 172.21.15.17:0/449657184 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v43) v1 ==== 97+0+0 (secure 0 0 0) 0x7f57c80571d0 con 0x7f57dc0cfa70 2024-03-12T17:20:24.367 INFO:teuthology.orchestra.run.smithi017.stderr: removed all blocklist entries 2024-03-12T17:20:24.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.375+0000 7f57e3000640 1 -- 172.21.15.17:0/449657184 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f57bc06ac50 msgr2=0x7f57bc06d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:24.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.375+0000 7f57e3000640 1 --2- 172.21.15.17:0/449657184 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f57bc06ac50 0x7f57bc06d110 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f57cc036000 tx=0x7f57cc03b040 comp rx=0 tx=0).stop 2024-03-12T17:20:24.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.375+0000 7f57e3000640 1 -- 172.21.15.17:0/449657184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57dc0cfa70 msgr2=0x7f57dc0c6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:24.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.375+0000 7f57e3000640 1 --2- 172.21.15.17:0/449657184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57dc0cfa70 0x7f57dc0c6170 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f57c800c500 tx=0x7f57c800c9c0 comp rx=0 tx=0).stop 2024-03-12T17:20:24.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.375+0000 7f57e3000640 1 -- 172.21.15.17:0/449657184 shutdown_connections 2024-03-12T17:20:24.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.375+0000 7f57e3000640 1 --2- 172.21.15.17:0/449657184 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f57bc06ac50 0x7f57bc06d110 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:24.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.375+0000 7f57e3000640 1 --2- 172.21.15.17:0/449657184 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f57dc15cbd0 0x7f57dc0b2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:24.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.375+0000 7f57e3000640 1 --2- 172.21.15.17:0/449657184 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f57dc0cfa70 0x7f57dc0c6170 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:24.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.375+0000 7f57e3000640 1 --2- 172.21.15.17:0/449657184 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f57dc0b5aa0 0x7f57dc1592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:24.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.375+0000 7f57e3000640 1 -- 172.21.15.17:0/449657184 >> 172.21.15.17:0/449657184 conn(0x7f57dc065df0 msgr2=0x7f57dc15c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:24.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.375+0000 7f57e3000640 1 -- 172.21.15.17:0/449657184 shutdown_connections 2024-03-12T17:20:24.371 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.375+0000 7f57e3000640 1 -- 172.21.15.17:0/449657184 wait complete. 2024-03-12T17:20:24.390 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-03-12T17:20:24.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.615+0000 7f8694200640 1 Processor -- start 2024-03-12T17:20:24.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.616+0000 7f8694200640 1 -- start start 2024-03-12T17:20:24.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.617+0000 7f8694200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f868c15ca10 0x7f868c0abd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:24.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.617+0000 7f8694200640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f868c0b2830 0x7f868c0cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:24.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.617+0000 7f8694200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f868c15dee0 con 0x7f868c15cdf0 2024-03-12T17:20:24.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.617+0000 7f8694200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f868c15d2d0 con 0x7f868c15ca10 2024-03-12T17:20:24.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.617+0000 7f8694200640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f868c15d5b0 con 0x7f868c0b2830 2024-03-12T17:20:24.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.618+0000 7f8691800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f868c15ca10 0x7f868c0abd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:24.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.618+0000 7f8691800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f868c15ca10 0x7f868c0abd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47286/0 (socket says 172.21.15.17:47286) 2024-03-12T17:20:24.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.618+0000 7f8691800640 1 -- 172.21.15.17:0/3370001925 learned_addr learned my addr 172.21.15.17:0/3370001925 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:24.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.618+0000 7f8692200640 1 --2- 172.21.15.17:0/3370001925 >> v2:172.21.15.94:3300/0 conn(0x7f868c0b2830 0x7f868c0cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:24.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.618+0000 7f8691800640 1 -- 172.21.15.17:0/3370001925 >> v2:172.21.15.94:3300/0 conn(0x7f868c0b2830 msgr2=0x7f868c0cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:24.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.618+0000 7f8691800640 1 --2- 172.21.15.17:0/3370001925 >> v2:172.21.15.94:3300/0 conn(0x7f868c0b2830 0x7f868c0cee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:24.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.618+0000 7f8691800640 1 -- 172.21.15.17:0/3370001925 >> v1:172.21.15.94:6789/0 conn(0x7f868c15cdf0 legacy=0x7f868c0b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.618+0000 7f8691800640 1 -- 172.21.15.17:0/3370001925 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f868c15d890 con 0x7f868c15ca10 2024-03-12T17:20:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.618+0000 7f8692200640 1 --2- 172.21.15.17:0/3370001925 >> v2:172.21.15.94:3300/0 conn(0x7f868c0b2830 0x7f868c0cee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.620+0000 7f8691800640 1 --2- 172.21.15.17:0/3370001925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f868c15ca10 0x7f868c0abd90 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f868c071890 tx=0x7f868002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e6991e8b0308454 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:24.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.620+0000 7f868be00640 1 -- 172.21.15.17:0/3370001925 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8680031870 con 0x7f868c15ca10 2024-03-12T17:20:24.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.620+0000 7f868be00640 1 -- 172.21.15.17:0/3370001925 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86800319d0 con 0x7f868c15ca10 2024-03-12T17:20:24.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.620+0000 7f868be00640 1 -- 172.21.15.17:0/3370001925 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8680031d60 con 0x7f868c15ca10 2024-03-12T17:20:24.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.621+0000 7f8694200640 1 -- 172.21.15.17:0/3370001925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f868c15ca10 msgr2=0x7f868c0abd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:24.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.621+0000 7f8694200640 1 --2- 172.21.15.17:0/3370001925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f868c15ca10 0x7f868c0abd90 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f868c071890 tx=0x7f868002b910 comp rx=0 tx=0).stop 2024-03-12T17:20:24.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.621+0000 7f8694200640 1 -- 172.21.15.17:0/3370001925 shutdown_connections 2024-03-12T17:20:24.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.621+0000 7f8694200640 1 --2- 172.21.15.17:0/3370001925 >> v2:172.21.15.94:3300/0 conn(0x7f868c0b2830 0x7f868c0cee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:24.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.621+0000 7f8694200640 1 --2- 172.21.15.17:0/3370001925 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f868c15ca10 0x7f868c0abd90 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:24.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.621+0000 7f8694200640 1 -- 172.21.15.17:0/3370001925 >> 172.21.15.17:0/3370001925 conn(0x7f868c069ce0 msgr2=0x7f868c06a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:24.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.621+0000 7f8694200640 1 -- 172.21.15.17:0/3370001925 shutdown_connections 2024-03-12T17:20:24.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.621+0000 7f8694200640 1 -- 172.21.15.17:0/3370001925 wait complete. 2024-03-12T17:20:24.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.623+0000 7f8694200640 1 Processor -- start 2024-03-12T17:20:24.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.623+0000 7f8694200640 1 -- start start 2024-03-12T17:20:24.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.624+0000 7f8694200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f868c0b2830 0x7f868c156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:24.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.624+0000 7f8694200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f868c15ca10 0x7f868c152f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:24.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.624+0000 7f8694200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f868c15cdf0 0x7f868c153450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:24.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.624+0000 7f8694200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868c151e90 con 0x7f868c15ca10 2024-03-12T17:20:24.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.624+0000 7f8694200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868c157af0 con 0x7f868c0b2830 2024-03-12T17:20:24.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.624+0000 7f8694200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868c156a50 con 0x7f868c15cdf0 2024-03-12T17:20:24.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.625+0000 7f8690e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f868c15ca10 0x7f868c152f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:24.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.625+0000 7f8690e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f868c15ca10 0x7f868c152f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47290/0 (socket says 172.21.15.17:47290) 2024-03-12T17:20:24.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.625+0000 7f8690e00640 1 -- 172.21.15.17:0/7360231 learned_addr learned my addr 172.21.15.17:0/7360231 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:24.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.625+0000 7f8691800640 1 --2- 172.21.15.17:0/7360231 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f868c0b2830 0x7f868c156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:24.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.625+0000 7f8690e00640 1 -- 172.21.15.17:0/7360231 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f868c15cdf0 msgr2=0x7f868c153450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:24.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.625+0000 7f8692200640 1 --2- 172.21.15.17:0/7360231 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f868c15cdf0 0x7f868c153450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:24.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.625+0000 7f8690e00640 1 --2- 172.21.15.17:0/7360231 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f868c15cdf0 0x7f868c153450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:24.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.625+0000 7f8690e00640 1 -- 172.21.15.17:0/7360231 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f868c0b2830 msgr2=0x7f868c156090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:24.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.625+0000 7f8690e00640 1 --2- 172.21.15.17:0/7360231 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f868c0b2830 0x7f868c156090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:24.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.625+0000 7f8690e00640 1 -- 172.21.15.17:0/7360231 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86800094d0 con 0x7f868c15ca10 2024-03-12T17:20:24.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.626+0000 7f8690e00640 1 --2- 172.21.15.17:0/7360231 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f868c15ca10 0x7f868c152f10 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f867800b3e0 tx=0x7f867800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:24.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.626+0000 7f8689600640 1 -- 172.21.15.17:0/7360231 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8678011830 con 0x7f868c15ca10 2024-03-12T17:20:24.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.626+0000 7f8689600640 1 -- 172.21.15.17:0/7360231 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86780119b0 con 0x7f868c15ca10 2024-03-12T17:20:24.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.626+0000 7f8689600640 1 -- 172.21.15.17:0/7360231 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8678011d60 con 0x7f868c15ca10 2024-03-12T17:20:24.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.626+0000 7f8694200640 1 -- 172.21.15.17:0/7360231 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f868c156d30 con 0x7f868c15ca10 2024-03-12T17:20:24.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.626+0000 7f8694200640 1 -- 172.21.15.17:0/7360231 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f868c1572f0 con 0x7f868c15ca10 2024-03-12T17:20:24.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.627+0000 7f8694200640 1 -- 172.21.15.17:0/7360231 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f868c0b2c10 con 0x7f868c15ca10 2024-03-12T17:20:24.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.628+0000 7f8689600640 1 -- 172.21.15.17:0/7360231 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f867801a400 con 0x7f868c15ca10 2024-03-12T17:20:24.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.629+0000 7f8689600640 1 --2- 172.21.15.17:0/7360231 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f866c06ac30 0x7f866c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:24.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.629+0000 7f8689600640 1 -- 172.21.15.17:0/7360231 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f86780891c0 con 0x7f868c15ca10 2024-03-12T17:20:24.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.629+0000 7f8691800640 1 --2- 172.21.15.17:0/7360231 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f866c06ac30 0x7f866c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:24.625 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.630+0000 7f8691800640 1 --2- 172.21.15.17:0/7360231 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f866c06ac30 0x7f866c06d0f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8680036000 tx=0x7f868003c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:24.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.634+0000 7f8689600640 1 -- 172.21.15.17:0/7360231 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f8678054650 con 0x7f868c15ca10 2024-03-12T17:20:24.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.906+0000 7f8694200640 1 -- 172.21.15.17:0/7360231 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f868c0736c0 con 0x7f868c15ca10 2024-03-12T17:20:24.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.907+0000 7f8689600640 1 -- 172.21.15.17:0/7360231 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v9) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f8678057c70 con 0x7f868c15ca10 2024-03-12T17:20:24.906 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:20:24.906 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-12T17:20:24.906 INFO:teuthology.orchestra.run.smithi017.stdout: "auth_dump": [ 2024-03-12T17:20:24.906 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:20:24.906 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.a", 2024-03-12T17:20:24.906 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQA3jvBl8pscOhAAg7cRCKubs0xJHi6+fzHsQg==", 2024-03-12T17:20:24.906 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:20:24.906 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-03-12T17:20:24.906 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-03-12T17:20:24.906 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-03-12T17:20:24.907 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-03-12T17:20:24.907 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:20:24.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:20:24.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:20:24.907 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.b", 2024-03-12T17:20:24.907 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQA4jvBl7BmXIBAARcXGpnsnW07RmdLKxAOtDw==", 2024-03-12T17:20:24.907 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:20:24.907 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-03-12T17:20:24.907 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-03-12T17:20:24.907 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-03-12T17:20:24.907 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-03-12T17:20:24.907 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:20:24.907 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:20:24.907 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:20:24.908 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.c", 2024-03-12T17:20:24.908 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQA4jvBlyF62EBAALdtfnD6arVS4lYylDoyb3Q==", 2024-03-12T17:20:24.908 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:20:24.908 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-03-12T17:20:24.908 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-03-12T17:20:24.908 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-03-12T17:20:24.908 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-03-12T17:20:24.908 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:20:24.908 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:20:24.908 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:20:24.908 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mds.d", 2024-03-12T17:20:24.908 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQA4jvBl/AJwLxAApE9bwTCmJJE4MkW6U0wg/A==", 2024-03-12T17:20:24.908 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:20:24.908 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-03-12T17:20:24.908 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-03-12T17:20:24.909 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-03-12T17:20:24.909 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-03-12T17:20:24.909 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:20:24.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:20:24.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:20:24.909 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.0", 2024-03-12T17:20:24.909 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQA7jvBl3giDExAAnT30pG7fp2lHalG8evhA3g==", 2024-03-12T17:20:24.909 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:20:24.909 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-03-12T17:20:24.909 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-03-12T17:20:24.909 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-03-12T17:20:24.909 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:20:24.909 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:20:24.909 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:20:24.909 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.1", 2024-03-12T17:20:24.910 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQA+jvBlKrEqHhAA40NN4MDLV0Rsncz9gUNSoA==", 2024-03-12T17:20:24.910 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:20:24.910 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-03-12T17:20:24.910 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-03-12T17:20:24.910 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-03-12T17:20:24.910 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:20:24.910 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:20:24.910 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:20:24.910 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.2", 2024-03-12T17:20:24.910 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQBBjvBlgfKmNxAAAQJBRIwNzLm66Vqi/jsgsQ==", 2024-03-12T17:20:24.910 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:20:24.910 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-03-12T17:20:24.910 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-03-12T17:20:24.910 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-03-12T17:20:24.911 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:20:24.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:20:24.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:20:24.911 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.3", 2024-03-12T17:20:24.911 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQBFjvBl24MrFhAA0EmYMPLOZFvtCbfZeENu7g==", 2024-03-12T17:20:24.911 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:20:24.911 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-03-12T17:20:24.911 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-03-12T17:20:24.911 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-03-12T17:20:24.911 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:20:24.911 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:20:24.911 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:20:24.911 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.4", 2024-03-12T17:20:24.911 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQBKjvBlIPL1EBAAS1B1kQhpHAn4PM9TvJnmqQ==", 2024-03-12T17:20:24.911 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:20:24.912 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-03-12T17:20:24.912 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-03-12T17:20:24.912 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-03-12T17:20:24.912 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:20:24.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:20:24.912 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:20:24.912 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.5", 2024-03-12T17:20:24.912 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQBNjvBl4ncdGhAAQuU1o+s7FbgWGzWk1vgRjQ==", 2024-03-12T17:20:24.912 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:20:24.912 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-03-12T17:20:24.912 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-03-12T17:20:24.912 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-03-12T17:20:24.912 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:20:24.912 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:20:24.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:20:24.913 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.6", 2024-03-12T17:20:24.913 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQBQjvBlSJ0wMRAA1+44GX7lMpXP/5xPWlaC9w==", 2024-03-12T17:20:24.913 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:20:24.913 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-03-12T17:20:24.913 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-03-12T17:20:24.913 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-03-12T17:20:24.913 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:20:24.913 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:20:24.913 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:20:24.913 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "osd.7", 2024-03-12T17:20:24.913 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQBUjvBlt2qZDRAA5cpkAXcTcN+xMt0tz2imDg==", 2024-03-12T17:20:24.913 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:20:24.913 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow profile osd", 2024-03-12T17:20:24.913 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile osd", 2024-03-12T17:20:24.914 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-03-12T17:20:24.914 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:20:24.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:20:24.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:20:24.914 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.0", 2024-03-12T17:20:24.914 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQA5jvBl3EtgARAAMO0rXhwCHTQ4455DuyFa6w==", 2024-03-12T17:20:24.914 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:20:24.914 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-03-12T17:20:24.914 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow r", 2024-03-12T17:20:24.914 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-03-12T17:20:24.914 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:20:24.914 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:20:24.914 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:20:24.914 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.1", 2024-03-12T17:20:24.914 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQA5jvBlM7qcFxAA4v58amLyydfK80N6/pBSFA==", 2024-03-12T17:20:24.915 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:20:24.915 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-03-12T17:20:24.915 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-03-12T17:20:24.915 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-03-12T17:20:24.915 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-03-12T17:20:24.915 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:20:24.915 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:20:24.915 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:20:24.915 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.2", 2024-03-12T17:20:24.915 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQA5jvBlZNi5DBAAmWJzui0X1LNEF2McslvhEw==", 2024-03-12T17:20:24.915 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:20:24.915 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-03-12T17:20:24.915 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-03-12T17:20:24.915 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-03-12T17:20:24.915 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-03-12T17:20:24.916 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:20:24.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:20:24.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:20:24.916 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.3", 2024-03-12T17:20:24.916 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQA5jvBlwlx1IhAADR44dr9HHJeiLyqM9ji0UA==", 2024-03-12T17:20:24.916 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:20:24.916 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow", 2024-03-12T17:20:24.916 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow r", 2024-03-12T17:20:24.916 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow rw", 2024-03-12T17:20:24.916 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow rwx" 2024-03-12T17:20:24.916 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:20:24.916 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:20:24.916 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:20:24.916 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "client.admin", 2024-03-12T17:20:24.917 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQA2jvBl/VptLRAAFA32BiOjQTTr5eqi+b9M7A==", 2024-03-12T17:20:24.917 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:20:24.917 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-03-12T17:20:24.917 INFO:teuthology.orchestra.run.smithi017.stdout: "mgr": "allow *", 2024-03-12T17:20:24.917 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow *", 2024-03-12T17:20:24.917 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-03-12T17:20:24.917 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:20:24.917 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:20:24.917 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:20:24.917 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.x", 2024-03-12T17:20:24.917 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQA3jvBl2xQ7LhAAmqFemeo/+3y+6TFvK2W6mw==", 2024-03-12T17:20:24.917 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:20:24.917 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-03-12T17:20:24.917 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2024-03-12T17:20:24.917 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-03-12T17:20:24.918 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:20:24.918 INFO:teuthology.orchestra.run.smithi017.stdout: }, 2024-03-12T17:20:24.918 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:20:24.918 INFO:teuthology.orchestra.run.smithi017.stdout: "entity": "mgr.y", 2024-03-12T17:20:24.918 INFO:teuthology.orchestra.run.smithi017.stdout: "key": "AQA3jvBl52J0IRAAlXujYfGNQsCxv2mWN0a3Gg==", 2024-03-12T17:20:24.918 INFO:teuthology.orchestra.run.smithi017.stdout: "caps": { 2024-03-12T17:20:24.918 INFO:teuthology.orchestra.run.smithi017.stdout: "mds": "allow *", 2024-03-12T17:20:24.918 INFO:teuthology.orchestra.run.smithi017.stdout: "mon": "allow profile mgr", 2024-03-12T17:20:24.918 INFO:teuthology.orchestra.run.smithi017.stdout: "osd": "allow *" 2024-03-12T17:20:24.918 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:20:24.918 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:20:24.918 INFO:teuthology.orchestra.run.smithi017.stdout: ] 2024-03-12T17:20:24.918 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-12T17:20:24.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.910+0000 7f8694200640 1 -- 172.21.15.17:0/7360231 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f866c06ac30 msgr2=0x7f866c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:24.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.910+0000 7f8694200640 1 --2- 172.21.15.17:0/7360231 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f866c06ac30 0x7f866c06d0f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8680036000 tx=0x7f868003c040 comp rx=0 tx=0).stop 2024-03-12T17:20:24.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.910+0000 7f8694200640 1 -- 172.21.15.17:0/7360231 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f868c15ca10 msgr2=0x7f868c152f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:24.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.910+0000 7f8694200640 1 --2- 172.21.15.17:0/7360231 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f868c15ca10 0x7f868c152f10 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f867800b3e0 tx=0x7f867800b8a0 comp rx=0 tx=0).stop 2024-03-12T17:20:24.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.910+0000 7f8694200640 1 -- 172.21.15.17:0/7360231 shutdown_connections 2024-03-12T17:20:24.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.910+0000 7f8694200640 1 --2- 172.21.15.17:0/7360231 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f866c06ac30 0x7f866c06d0f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:24.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.910+0000 7f8694200640 1 --2- 172.21.15.17:0/7360231 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f868c15cdf0 0x7f868c153450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:24.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.910+0000 7f8694200640 1 --2- 172.21.15.17:0/7360231 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f868c15ca10 0x7f868c152f10 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:24.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.910+0000 7f8694200640 1 --2- 172.21.15.17:0/7360231 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f868c0b2830 0x7f868c156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:24.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.910+0000 7f8694200640 1 -- 172.21.15.17:0/7360231 >> 172.21.15.17:0/7360231 conn(0x7f868c069ce0 msgr2=0x7f868c15bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:24.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.910+0000 7f8694200640 1 -- 172.21.15.17:0/7360231 shutdown_connections 2024-03-12T17:20:24.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:24.910+0000 7f8694200640 1 -- 172.21.15.17:0/7360231 wait complete. 2024-03-12T17:20:24.923 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T17:20:25.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.146+0000 7f1871800640 1 Processor -- start 2024-03-12T17:20:25.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.146+0000 7f1871800640 1 -- start start 2024-03-12T17:20:25.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.148+0000 7f1871800640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f186c15ff10 0x7f186c0cda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:25.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.148+0000 7f1871800640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f186c06b780 con 0x7f186c06b280 2024-03-12T17:20:25.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.148+0000 7f1871800640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f186c06ba60 con 0x7f186c0b4420 2024-03-12T17:20:25.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.148+0000 7f1871800640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f186c06bd40 con 0x7f186c15ff10 2024-03-12T17:20:25.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.148+0000 7f1863e00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f186c06b280 0x7f186c0b5bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:56642/0 (socket says 172.21.15.17:56642) 2024-03-12T17:20:25.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.148+0000 7f1863e00640 1 -- 172.21.15.17:0/2986477944 learned_addr learned my addr 172.21.15.17:0/2986477944 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:20:25.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.149+0000 7f186be00640 1 --2- 172.21.15.17:0/2986477944 >> v2:172.21.15.94:3300/0 conn(0x7f186c15ff10 0x7f186c0cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:25.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.149+0000 7f186b400640 1 -- 172.21.15.17:0/2986477944 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1929023372 0 0) 0x7f186c06b780 con 0x7f186c06b280 2024-03-12T17:20:25.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.149+0000 7f186b400640 1 -- 172.21.15.17:0/2986477944 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1850003520 con 0x7f186c06b280 2024-03-12T17:20:25.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.149+0000 7f186b400640 1 -- 172.21.15.17:0/2986477944 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1965205745 0 0) 0x7f1850003520 con 0x7f186c06b280 2024-03-12T17:20:25.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.149+0000 7f186b400640 1 -- 172.21.15.17:0/2986477944 >> v2:172.21.15.94:3300/0 conn(0x7f186c15ff10 msgr2=0x7f186c0cda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:25.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.149+0000 7f186b400640 1 --2- 172.21.15.17:0/2986477944 >> v2:172.21.15.94:3300/0 conn(0x7f186c15ff10 0x7f186c0cda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:25.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.149+0000 7f186b400640 1 -- 172.21.15.17:0/2986477944 >> v1:172.21.15.94:6789/0 conn(0x7f186c0b4420 legacy=0x7f186c160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:25.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.149+0000 7f186b400640 1 -- 172.21.15.17:0/2986477944 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186c06c020 con 0x7f186c06b280 2024-03-12T17:20:25.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.149+0000 7f186b400640 1 -- 172.21.15.17:0/2986477944 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7f1854001670 con 0x7f186c06b280 2024-03-12T17:20:25.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.149+0000 7f186b400640 1 -- 172.21.15.17:0/2986477944 >> v1:172.21.15.17:6789/0 conn(0x7f186c06b280 legacy=0x7f186c0b5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:25.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.149+0000 7f186b400640 1 --2- 172.21.15.17:0/2986477944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1850003970 0x7f1850003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:25.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.149+0000 7f186b400640 1 --2- 172.21.15.17:0/2986477944 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18500047c0 0x7f1850004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:25.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.149+0000 7f186b400640 1 --2- 172.21.15.17:0/2986477944 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1850005180 0x7f185000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:25.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.149+0000 7f186b400640 1 -- 172.21.15.17:0/2986477944 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186c06bd40 con 0x7f1850003970 2024-03-12T17:20:25.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.149+0000 7f186b400640 1 -- 172.21.15.17:0/2986477944 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185000c020 con 0x7f18500047c0 2024-03-12T17:20:25.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.149+0000 7f186b400640 1 -- 172.21.15.17:0/2986477944 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185000c1e0 con 0x7f1850005180 2024-03-12T17:20:25.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.149+0000 7f186be00640 1 --2- 172.21.15.17:0/2986477944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1850003970 0x7f1850003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:25.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.150+0000 7f186be00640 1 -- 172.21.15.17:0/2986477944 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1850005180 msgr2=0x7f185000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:25.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.150+0000 7f186be00640 1 --2- 172.21.15.17:0/2986477944 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1850005180 0x7f185000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:25.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.150+0000 7f186be00640 1 -- 172.21.15.17:0/2986477944 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18500047c0 msgr2=0x7f1850004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:25.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.150+0000 7f186be00640 1 --2- 172.21.15.17:0/2986477944 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f18500047c0 0x7f1850004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:25.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.150+0000 7f186be00640 1 -- 172.21.15.17:0/2986477944 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1850003520 con 0x7f1850003970 2024-03-12T17:20:25.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.150+0000 7f1870e00640 1 -- 172.21.15.17:0/2986477944 reap_dead start 2024-03-12T17:20:25.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.151+0000 7f186be00640 1 --2- 172.21.15.17:0/2986477944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1850003970 0x7f1850003d90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f185c009ac0 tx=0x7f18500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42117ebe8ceb68ef server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:25.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.151+0000 7f186b400640 1 -- 172.21.15.17:0/2986477944 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185c02c710 con 0x7f1850003970 2024-03-12T17:20:25.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.151+0000 7f186b400640 1 -- 172.21.15.17:0/2986477944 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185c02c870 con 0x7f1850003970 2024-03-12T17:20:25.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.151+0000 7f186b400640 1 -- 172.21.15.17:0/2986477944 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185c02cc00 con 0x7f1850003970 2024-03-12T17:20:25.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.152+0000 7f1871800640 1 -- 172.21.15.17:0/2986477944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1850003970 msgr2=0x7f1850003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:25.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.152+0000 7f1871800640 1 --2- 172.21.15.17:0/2986477944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1850003970 0x7f1850003d90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f185c009ac0 tx=0x7f18500057f0 comp rx=0 tx=0).stop 2024-03-12T17:20:25.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.152+0000 7f1871800640 1 -- 172.21.15.17:0/2986477944 shutdown_connections 2024-03-12T17:20:25.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.152+0000 7f1871800640 1 --2- 172.21.15.17:0/2986477944 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1850003970 0x7f1850003d90 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:25.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.152+0000 7f1871800640 1 -- 172.21.15.17:0/2986477944 >> 172.21.15.17:0/2986477944 conn(0x7f186c0cf420 msgr2=0x7f186c0cf830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:25.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.152+0000 7f1871800640 1 -- 172.21.15.17:0/2986477944 shutdown_connections 2024-03-12T17:20:25.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.152+0000 7f1871800640 1 -- 172.21.15.17:0/2986477944 wait complete. 2024-03-12T17:20:25.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.154+0000 7f1871800640 1 Processor -- start 2024-03-12T17:20:25.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.154+0000 7f1871800640 1 -- start start 2024-03-12T17:20:25.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.155+0000 7f1871800640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1850003970 0x7f186c153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:25.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.155+0000 7f1871800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f186c0aa1d0 0x7f186c0aaef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:25.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.155+0000 7f1871800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f186c0aa650 0x7f186c0ab430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:25.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.155+0000 7f1871800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186c1546c0 con 0x7f186c0aa1d0 2024-03-12T17:20:25.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.155+0000 7f1871800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186c0ccdf0 con 0x7f186c0aa650 2024-03-12T17:20:25.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.155+0000 7f1871800640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f186c0a9410 con 0x7f1850003970 2024-03-12T17:20:25.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.155+0000 7f1863e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f186c0aa1d0 0x7f186c0aaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:25.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.156+0000 7f1863e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f186c0aa1d0 0x7f186c0aaef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47302/0 (socket says 172.21.15.17:47302) 2024-03-12T17:20:25.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.156+0000 7f1863e00640 1 -- 172.21.15.17:0/1051370729 learned_addr learned my addr 172.21.15.17:0/1051370729 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:25.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.156+0000 7f186be00640 1 --2- 172.21.15.17:0/1051370729 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1850003970 0x7f186c153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:25.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.156+0000 7f1870e00640 1 --2- 172.21.15.17:0/1051370729 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f186c0aa650 0x7f186c0ab430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:25.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.156+0000 7f1863e00640 1 -- 172.21.15.17:0/1051370729 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1850003970 msgr2=0x7f186c153b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:25.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.156+0000 7f1863e00640 1 --2- 172.21.15.17:0/1051370729 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1850003970 0x7f186c153b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:25.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.156+0000 7f1863e00640 1 -- 172.21.15.17:0/1051370729 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f186c0aa650 msgr2=0x7f186c0ab430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:25.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.156+0000 7f1863e00640 1 --2- 172.21.15.17:0/1051370729 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f186c0aa650 0x7f186c0ab430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:25.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.156+0000 7f1863e00640 1 -- 172.21.15.17:0/1051370729 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f186c160470 con 0x7f186c0aa1d0 2024-03-12T17:20:25.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.156+0000 7f1863e00640 1 --2- 172.21.15.17:0/1051370729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f186c0aa1d0 0x7f186c0aaef0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f185400c7a0 tx=0x7f185400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:25.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.157+0000 7f1868c00640 1 -- 172.21.15.17:0/1051370729 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18540074e0 con 0x7f186c0aa1d0 2024-03-12T17:20:25.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.157+0000 7f1868c00640 1 -- 172.21.15.17:0/1051370729 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1854007640 con 0x7f186c0aa1d0 2024-03-12T17:20:25.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.157+0000 7f1868c00640 1 -- 172.21.15.17:0/1051370729 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18540049e0 con 0x7f186c0aa1d0 2024-03-12T17:20:25.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.157+0000 7f1871800640 1 -- 172.21.15.17:0/1051370729 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f186c0a96f0 con 0x7f186c0aa1d0 2024-03-12T17:20:25.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.157+0000 7f1871800640 1 -- 172.21.15.17:0/1051370729 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f186c0a9cb0 con 0x7f186c0aa1d0 2024-03-12T17:20:25.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.158+0000 7f1871800640 1 -- 172.21.15.17:0/1051370729 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f186c072360 con 0x7f186c0aa1d0 2024-03-12T17:20:25.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.159+0000 7f1868c00640 1 -- 172.21.15.17:0/1051370729 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f1854004b40 con 0x7f186c0aa1d0 2024-03-12T17:20:25.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.160+0000 7f1868c00640 1 --2- 172.21.15.17:0/1051370729 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f184806ac30 0x7f184806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:25.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.160+0000 7f1868c00640 1 -- 172.21.15.17:0/1051370729 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1854088490 con 0x7f186c0aa1d0 2024-03-12T17:20:25.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.160+0000 7f186be00640 1 --2- 172.21.15.17:0/1051370729 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f184806ac30 0x7f184806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:25.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.161+0000 7f186be00640 1 --2- 172.21.15.17:0/1051370729 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f184806ac30 0x7f184806d0f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f185c036000 tx=0x7f185c030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:25.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.165+0000 7f1868c00640 1 -- 172.21.15.17:0/1051370729 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f18540539b0 con 0x7f186c0aa1d0 2024-03-12T17:20:25.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.365+0000 7f1871800640 1 -- 172.21.15.17:0/1051370729 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f186c04e030 con 0x7f186c0aa1d0 2024-03-12T17:20:25.362 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.366+0000 7f1868c00640 1 -- 172.21.15.17:0/1051370729 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+12341 (secure 0 0 0) 0x7f1854018090 con 0x7f186c0aa1d0 2024-03-12T17:20:25.362 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:20:25.362 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":43,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:20:24.359003+0000","last_up_change":"2024-03-12T17:18:38.144756+0000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-12T17:18:39.552910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":37305},{"type":"v1","addr":"172.21.15.17:6801","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":37305},{"type":"v1","addr":"172.21.15.17:6803","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":37305},{"type":"v1","addr":"172.21.15.17:6807","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":37305},{"type":"v1","addr":"172.21.15.17:6805","nonce":37305}]},"public_addr":"172.21.15.17:6801/37305","cluster_addr":"172.21.15.17:6803/37305","heartbeat_back_addr":"172.21.15.17:6807/37305","heartbeat_front_addr":"172.21.15.17:6805/37305","state":["exists","up"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":37307},{"type":"v1","addr":"172.21.15.17:6814","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":37307},{"type":"v1","addr":"172.21.15.17:6818","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":37307},{"type":"v1","addr":"172.21.15.17:6827","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":37307},{"type":"v1","addr":"172.21.15.17:6823","nonce":37307}]},"public_addr":"172.21.15.17:6814/37307","cluster_addr":"172.21.15.17:6818/37307","heartbeat_back_addr":"172.21.15.17:6827/37307","heartbeat_front_addr":"172.21.15.17:6823/37307","state":["exists","up"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":37303},{"type":"v1","addr":"172.21.15.17:6809","nonce":37303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":37303},{"type":"v1","addr":"172.21.15.17:6811","nonce":37303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":37303},{"type":"v1","addr":"172.21.15.17:6819","nonce":37303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":37303},{"type":"v1","addr":"172.21.15.17:6815","nonce":37303}]},"public_addr":"172.21.15.17:6809/37303","cluster_addr":"172.21.15.17:6811/37303","heartbeat_back_addr":"172.21.15.17:6819/37303","heartbeat_front_addr":"172.21.15.17:6815/37303","state":["exists","up"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":37308},{"type":"v1","addr":"172.21.15.17:6822","nonce":37308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":37308},{"type":"v1","addr":"172.21.15.17:6826","nonce":37308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":37308},{"type":"v1","addr":"172.21.15.17:6831","nonce":37308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":37308},{"type":"v1","addr":"172.21.15.17:6829","nonce":37308}]},"public_addr":"172.21.15.17:6822/37308","cluster_addr":"172.21.15.17:6826/37308","heartbeat_back_addr":"172.21.15.17:6831/37308","heartbeat_front_addr":"172.21.15.17:6829/37308","state":["exists","up"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":37465},{"type":"v1","addr":"172.21.15.94:6809","nonce":37465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6811","nonce":37465},{"type":"v1","addr":"172.21.15.94:6813","nonce":37465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6819","nonce":37465},{"type":"v1","addr":"172.21.15.94:6822","nonce":37465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6815","nonce":37465},{"type":"v1","addr":"172.21.15.94:6817","nonce":37465}]},"public_addr":"172.21.15.94:6809/37465","cluster_addr":"172.21.15.94:6813/37465","heartbeat_back_addr":"172.21.15.94:6822/37465","heartbeat_front_addr":"172.21.15.94:6817/37465","state":["exists","up"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":37464},{"type":"v1","addr":"172.21.15.94:6812","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":37464},{"type":"v1","addr":"172.21.15.94:6816","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":37464},{"type":"v1","addr":"172.21.15.94:6823","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":37464},{"type":"v1","addr":"172.21.15.94:6820","nonce":37464}]},"public_addr":"172.21.15.94:6812/37464","cluster_addr":"172.21.15.94:6816/37464","heartbeat_back_addr":"172.21.15.94:6823/37464","heartbeat_front_addr":"172.21.15.94:6820/37464","state":["exists","up"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":37467},{"type":"v1","addr":"172.21.15.94:6825","nonce":37467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":37467},{"type":"v1","addr":"172.21.15.94:6827","nonce":37467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":37467},{"type":"v1","addr":"172.21.15.94:6831","nonce":37467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":37467},{"type":"v1","addr":"172.21.15.94:6829","nonce":37467}]},"public_addr":"172.21.15.94:6825/37467","cluster_addr":"172.21.15.94:6827/37467","heartbeat_back_addr":"172.21.15.94:6831/37467","heartbeat_front_addr":"172.21.15.94:6829/37467","state":["exists","up"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":37466},{"type":"v1","addr":"172.21.15.94:6801","nonce":37466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":37466},{"type":"v1","addr":"172.21.15.94:6803","nonce":37466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":37466},{"type":"v1","addr":"172.21.15.94:6807","nonce":37466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":37466},{"type":"v1","addr":"172.21.15.94:6805","nonce":37466}]},"public_addr":"172.21.15.94:6801/37466","cluster_addr":"172.21.15.94:6803/37466","heartbeat_back_addr":"172.21.15.94:6807/37466","heartbeat_front_addr":"172.21.15.94:6805/37466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.327217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.186966+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.419986+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.150585+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.120621+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.121576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.181257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.293188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:20:25.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.369+0000 7f1871800640 1 -- 172.21.15.17:0/1051370729 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f184806ac30 msgr2=0x7f184806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:25.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.369+0000 7f1871800640 1 --2- 172.21.15.17:0/1051370729 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f184806ac30 0x7f184806d0f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f185c036000 tx=0x7f185c030000 comp rx=0 tx=0).stop 2024-03-12T17:20:25.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.369+0000 7f1871800640 1 -- 172.21.15.17:0/1051370729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f186c0aa1d0 msgr2=0x7f186c0aaef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:25.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.370+0000 7f1871800640 1 --2- 172.21.15.17:0/1051370729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f186c0aa1d0 0x7f186c0aaef0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f185400c7a0 tx=0x7f185400cc60 comp rx=0 tx=0).stop 2024-03-12T17:20:25.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.370+0000 7f1871800640 1 -- 172.21.15.17:0/1051370729 shutdown_connections 2024-03-12T17:20:25.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.370+0000 7f1871800640 1 --2- 172.21.15.17:0/1051370729 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f184806ac30 0x7f184806d0f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:25.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.370+0000 7f1871800640 1 --2- 172.21.15.17:0/1051370729 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f186c0aa650 0x7f186c0ab430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:25.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.370+0000 7f1871800640 1 --2- 172.21.15.17:0/1051370729 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f186c0aa1d0 0x7f186c0aaef0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:25.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.370+0000 7f1871800640 1 --2- 172.21.15.17:0/1051370729 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1850003970 0x7f186c153b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:25.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.370+0000 7f1871800640 1 -- 172.21.15.17:0/1051370729 >> 172.21.15.17:0/1051370729 conn(0x7f186c0cf420 msgr2=0x7f186c0d0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:25.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.370+0000 7f1871800640 1 -- 172.21.15.17:0/1051370729 shutdown_connections 2024-03-12T17:20:25.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.370+0000 7f1871800640 1 -- 172.21.15.17:0/1051370729 wait complete. 2024-03-12T17:20:25.386 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-12T17:18:39.552910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-12T17:20:25.386 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-12T17:20:25.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.621+0000 7f24a6200640 1 Processor -- start 2024-03-12T17:20:25.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.621+0000 7f24a6200640 1 -- start start 2024-03-12T17:20:25.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.623+0000 7f24a6200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f24a00b5f70 0x7f24a00d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:25.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.623+0000 7f24a6200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a00d14e0 con 0x7f24a00d2fa0 2024-03-12T17:20:25.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.623+0000 7f24a6200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24a00b85b0 con 0x7f24a00b5b50 2024-03-12T17:20:25.618 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.623+0000 7f24a6200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a00b59e0 con 0x7f24a00b5f70 2024-03-12T17:20:25.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.623+0000 7f249f400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f24a00d2fa0 0x7f24a00d3380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:56656/0 (socket says 172.21.15.17:56656) 2024-03-12T17:20:25.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.623+0000 7f249f400640 1 -- 172.21.15.17:0/1319292115 learned_addr learned my addr 172.21.15.17:0/1319292115 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:20:25.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.623+0000 7f249fe00640 1 --2- 172.21.15.17:0/1319292115 >> v2:172.21.15.17:3300/0 conn(0x7f24a00b5f70 0x7f24a00d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:25.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.624+0000 7f249fe00640 1 -- 172.21.15.17:0/1319292115 >> v1:172.21.15.94:6789/0 conn(0x7f24a00b5b50 legacy=0x7f24a00cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:25.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.624+0000 7f249fe00640 1 -- 172.21.15.17:0/1319292115 >> v1:172.21.15.17:6789/0 conn(0x7f24a00d2fa0 legacy=0x7f24a00d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:25.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.624+0000 7f249fe00640 1 -- 172.21.15.17:0/1319292115 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a00b8890 con 0x7f24a00b5f70 2024-03-12T17:20:25.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.625+0000 7f249fe00640 1 --2- 172.21.15.17:0/1319292115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24a00b5f70 0x7f24a00d1f30 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2498009d90 tx=0x7f249802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b2271d79836de56 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:25.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.625+0000 7f249e000640 1 -- 172.21.15.17:0/1319292115 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249802cd00 con 0x7f24a00b5f70 2024-03-12T17:20:25.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.626+0000 7f249e000640 1 -- 172.21.15.17:0/1319292115 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249802ce60 con 0x7f24a00b5f70 2024-03-12T17:20:25.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.626+0000 7f249e000640 1 -- 172.21.15.17:0/1319292115 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2498034660 con 0x7f24a00b5f70 2024-03-12T17:20:25.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.626+0000 7f24a6200640 1 -- 172.21.15.17:0/1319292115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24a00b5f70 msgr2=0x7f24a00d1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:25.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.626+0000 7f24a6200640 1 --2- 172.21.15.17:0/1319292115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24a00b5f70 0x7f24a00d1f30 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2498009d90 tx=0x7f249802bf50 comp rx=0 tx=0).stop 2024-03-12T17:20:25.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.626+0000 7f24a6200640 1 -- 172.21.15.17:0/1319292115 shutdown_connections 2024-03-12T17:20:25.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.626+0000 7f24a6200640 1 --2- 172.21.15.17:0/1319292115 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24a00b5f70 0x7f24a00d1f30 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:25.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.626+0000 7f24a6200640 1 -- 172.21.15.17:0/1319292115 >> 172.21.15.17:0/1319292115 conn(0x7f24a0065df0 msgr2=0x7f24a0066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:25.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.626+0000 7f24a6200640 1 -- 172.21.15.17:0/1319292115 shutdown_connections 2024-03-12T17:20:25.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.626+0000 7f24a6200640 1 -- 172.21.15.17:0/1319292115 wait complete. 2024-03-12T17:20:25.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.628+0000 7f24a6200640 1 Processor -- start 2024-03-12T17:20:25.624 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.629+0000 7f24a6200640 1 -- start start 2024-03-12T17:20:25.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.630+0000 7f24a6200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24a00b5b50 0x7f24a00cab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:25.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.630+0000 7f24a6200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f24a00b5f70 0x7f24a015a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:25.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.630+0000 7f24a6200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f24a00d2fa0 0x7f24a00b7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:25.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.630+0000 7f24a6200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a00c9ad0 con 0x7f24a00b5b50 2024-03-12T17:20:25.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.630+0000 7f24a6200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a00c9d70 con 0x7f24a00b5f70 2024-03-12T17:20:25.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.630+0000 7f24a6200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a00ca050 con 0x7f24a00d2fa0 2024-03-12T17:20:25.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.630+0000 7f249f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24a00b5b50 0x7f24a00cab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:25.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.630+0000 7f249f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24a00b5b50 0x7f24a00cab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47308/0 (socket says 172.21.15.17:47308) 2024-03-12T17:20:25.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.630+0000 7f249f400640 1 -- 172.21.15.17:0/1720290396 learned_addr learned my addr 172.21.15.17:0/1720290396 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:25.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.630+0000 7f249ea00640 1 --2- 172.21.15.17:0/1720290396 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f24a00b5f70 0x7f24a015a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:25.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.630+0000 7f249fe00640 1 --2- 172.21.15.17:0/1720290396 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f24a00d2fa0 0x7f24a00b7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:25.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.630+0000 7f249f400640 1 -- 172.21.15.17:0/1720290396 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f24a00d2fa0 msgr2=0x7f24a00b7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:25.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.631+0000 7f249f400640 1 --2- 172.21.15.17:0/1720290396 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f24a00d2fa0 0x7f24a00b7450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:25.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.631+0000 7f249f400640 1 -- 172.21.15.17:0/1720290396 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f24a00b5f70 msgr2=0x7f24a015a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:25.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.631+0000 7f249f400640 1 --2- 172.21.15.17:0/1720290396 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f24a00b5f70 0x7f24a015a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:25.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.631+0000 7f249f400640 1 -- 172.21.15.17:0/1720290396 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2498009a70 con 0x7f24a00b5b50 2024-03-12T17:20:25.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.631+0000 7f249fe00640 1 --2- 172.21.15.17:0/1720290396 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f24a00d2fa0 0x7f24a00b7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:25.627 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.631+0000 7f249f400640 1 --2- 172.21.15.17:0/1720290396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24a00b5b50 0x7f24a00cab30 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f249000c4a0 tx=0x7f249000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:25.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.631+0000 7f2497400640 1 -- 172.21.15.17:0/1720290396 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2490005ce0 con 0x7f24a00b5b50 2024-03-12T17:20:25.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.631+0000 7f2497400640 1 -- 172.21.15.17:0/1720290396 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2490005e40 con 0x7f24a00b5b50 2024-03-12T17:20:25.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.631+0000 7f2497400640 1 -- 172.21.15.17:0/1720290396 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2490007270 con 0x7f24a00b5b50 2024-03-12T17:20:25.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.631+0000 7f24a6200640 1 -- 172.21.15.17:0/1720290396 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a00ca330 con 0x7f24a00b5b50 2024-03-12T17:20:25.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.631+0000 7f24a6200640 1 -- 172.21.15.17:0/1720290396 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a015a6e0 con 0x7f24a00b5b50 2024-03-12T17:20:25.628 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.633+0000 7f24a6200640 1 -- 172.21.15.17:0/1720290396 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24a00ca850 con 0x7f24a00b5b50 2024-03-12T17:20:25.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.633+0000 7f2497400640 1 -- 172.21.15.17:0/1720290396 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f2490007490 con 0x7f24a00b5b50 2024-03-12T17:20:25.629 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.634+0000 7f2497400640 1 --2- 172.21.15.17:0/1720290396 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f248006ac00 0x7f248006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:25.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.634+0000 7f2497400640 1 -- 172.21.15.17:0/1720290396 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2490088550 con 0x7f24a00b5b50 2024-03-12T17:20:25.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.634+0000 7f249ea00640 1 --2- 172.21.15.17:0/1720290396 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f248006ac00 0x7f248006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:25.630 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.635+0000 7f249ea00640 1 --2- 172.21.15.17:0/1720290396 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f248006ac00 0x7f248006d0c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f24a00b3610 tx=0x7f248c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:25.634 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.638+0000 7f2497400640 1 -- 172.21.15.17:0/1720290396 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f24a00ca850 con 0x7f24a00b5b50 2024-03-12T17:20:25.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.834+0000 7f24a6200640 1 -- 172.21.15.17:0/1720290396 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f24a00ca850 con 0x7f24a00b5b50 2024-03-12T17:20:25.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.835+0000 7f2497400640 1 -- 172.21.15.17:0/1720290396 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f24a00ca850 con 0x7f24a00b5b50 2024-03-12T17:20:25.830 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-03-12T17:20:25.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.837+0000 7f24a6200640 1 -- 172.21.15.17:0/1720290396 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f248006ac00 msgr2=0x7f248006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:25.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.837+0000 7f24a6200640 1 --2- 172.21.15.17:0/1720290396 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f248006ac00 0x7f248006d0c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f24a00b3610 tx=0x7f248c009040 comp rx=0 tx=0).stop 2024-03-12T17:20:25.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.837+0000 7f24a6200640 1 -- 172.21.15.17:0/1720290396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24a00b5b50 msgr2=0x7f24a00cab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:25.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.837+0000 7f24a6200640 1 --2- 172.21.15.17:0/1720290396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24a00b5b50 0x7f24a00cab30 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f249000c4a0 tx=0x7f249000c960 comp rx=0 tx=0).stop 2024-03-12T17:20:25.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.837+0000 7f24a6200640 1 -- 172.21.15.17:0/1720290396 shutdown_connections 2024-03-12T17:20:25.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.837+0000 7f24a6200640 1 --2- 172.21.15.17:0/1720290396 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f248006ac00 0x7f248006d0c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:25.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.837+0000 7f24a6200640 1 --2- 172.21.15.17:0/1720290396 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f24a00d2fa0 0x7f24a00b7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:25.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.837+0000 7f24a6200640 1 --2- 172.21.15.17:0/1720290396 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f24a00b5f70 0x7f24a015a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:25.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.837+0000 7f24a6200640 1 --2- 172.21.15.17:0/1720290396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f24a00b5b50 0x7f24a00cab30 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:25.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.837+0000 7f24a6200640 1 -- 172.21.15.17:0/1720290396 >> 172.21.15.17:0/1720290396 conn(0x7f24a0065df0 msgr2=0x7f24a00b6350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:25.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.837+0000 7f24a6200640 1 -- 172.21.15.17:0/1720290396 shutdown_connections 2024-03-12T17:20:25.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:25.837+0000 7f24a6200640 1 -- 172.21.15.17:0/1720290396 wait complete. 2024-03-12T17:20:25.850 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-12T17:20:26.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.075+0000 7fb976200640 1 Processor -- start 2024-03-12T17:20:26.070 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.075+0000 7fb976200640 1 -- start start 2024-03-12T17:20:26.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.076+0000 7fb976200640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb9700d2fa0 0x7fb9700d3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:26.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.076+0000 7fb976200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb9700b5b50 0x7fb9700b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:26.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.076+0000 7fb976200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9700d14e0 con 0x7fb9700cd840 2024-03-12T17:20:26.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.076+0000 7fb976200640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9700b59e0 con 0x7fb9700d2fa0 2024-03-12T17:20:26.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.076+0000 7fb976200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9700d38c0 con 0x7fb9700b5b50 2024-03-12T17:20:26.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.077+0000 7fb96ea00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb9700b5b50 0x7fb9700b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:26.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.077+0000 7fb96f400640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb9700d2fa0 0x7fb9700d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:26.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.077+0000 7fb96f400640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb9700d2fa0 0x7fb9700d3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.17:37196/0 (socket says 172.21.15.17:37196) 2024-03-12T17:20:26.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.077+0000 7fb96f400640 1 -- 172.21.15.17:0/1563951341 learned_addr learned my addr 172.21.15.17:0/1563951341 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:26.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.078+0000 7fb96f400640 1 -- 172.21.15.17:0/1563951341 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb9700b5b50 msgr2=0x7fb9700b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:26.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.078+0000 7fb96f400640 1 --2- 172.21.15.17:0/1563951341 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb9700b5b50 0x7fb9700b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:26.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.078+0000 7fb96f400640 1 -- 172.21.15.17:0/1563951341 >> v1:172.21.15.94:6789/0 conn(0x7fb9700cd840 legacy=0x7fb9700d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:26.074 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.078+0000 7fb96f400640 1 -- 172.21.15.17:0/1563951341 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9700b85b0 con 0x7fb9700d2fa0 2024-03-12T17:20:26.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.079+0000 7fb96f400640 1 --2- 172.21.15.17:0/1563951341 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9700d2fa0 0x7fb9700d3380 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb960009870 tx=0x7fb96002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d4e6869f819c289 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:26.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.080+0000 7fb96e000640 1 -- 172.21.15.17:0/1563951341 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb960030840 con 0x7fb9700d2fa0 2024-03-12T17:20:26.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.080+0000 7fb96e000640 1 -- 172.21.15.17:0/1563951341 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9600309a0 con 0x7fb9700d2fa0 2024-03-12T17:20:26.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.080+0000 7fb96e000640 1 -- 172.21.15.17:0/1563951341 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb960030d30 con 0x7fb9700d2fa0 2024-03-12T17:20:26.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.080+0000 7fb976200640 1 -- 172.21.15.17:0/1563951341 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9700d2fa0 msgr2=0x7fb9700d3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:26.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.080+0000 7fb976200640 1 --2- 172.21.15.17:0/1563951341 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9700d2fa0 0x7fb9700d3380 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb960009870 tx=0x7fb96002b980 comp rx=0 tx=0).stop 2024-03-12T17:20:26.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.081+0000 7fb976200640 1 -- 172.21.15.17:0/1563951341 shutdown_connections 2024-03-12T17:20:26.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.081+0000 7fb976200640 1 --2- 172.21.15.17:0/1563951341 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb9700b5b50 0x7fb9700b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:26.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.081+0000 7fb976200640 1 --2- 172.21.15.17:0/1563951341 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9700d2fa0 0x7fb9700d3380 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:26.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.081+0000 7fb976200640 1 -- 172.21.15.17:0/1563951341 >> 172.21.15.17:0/1563951341 conn(0x7fb970065df0 msgr2=0x7fb970066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:26.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.081+0000 7fb976200640 1 -- 172.21.15.17:0/1563951341 shutdown_connections 2024-03-12T17:20:26.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.081+0000 7fb976200640 1 -- 172.21.15.17:0/1563951341 wait complete. 2024-03-12T17:20:26.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.082+0000 7fb976200640 1 Processor -- start 2024-03-12T17:20:26.078 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.083+0000 7fb976200640 1 -- start start 2024-03-12T17:20:26.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.083+0000 7fb976200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb9700b5b50 0x7fb9701f1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:26.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.083+0000 7fb976200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9700cd840 0x7fb97015d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:26.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.084+0000 7fb976200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9700d2fa0 0x7fb97015d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:26.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.084+0000 7fb976200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9700c9ad0 con 0x7fb9700cd840 2024-03-12T17:20:26.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.084+0000 7fb976200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9700a9850 con 0x7fb9700d2fa0 2024-03-12T17:20:26.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.084+0000 7fb976200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9700cc4e0 con 0x7fb9700b5b50 2024-03-12T17:20:26.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.084+0000 7fb96ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9700cd840 0x7fb97015d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:26.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.084+0000 7fb96ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9700cd840 0x7fb97015d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47324/0 (socket says 172.21.15.17:47324) 2024-03-12T17:20:26.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.084+0000 7fb96ea00640 1 -- 172.21.15.17:0/4150841299 learned_addr learned my addr 172.21.15.17:0/4150841299 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:26.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.084+0000 7fb96fe00640 1 --2- 172.21.15.17:0/4150841299 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9700d2fa0 0x7fb97015d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:26.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.084+0000 7fb96f400640 1 --2- 172.21.15.17:0/4150841299 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb9700b5b50 0x7fb9701f1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:26.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.084+0000 7fb96ea00640 1 -- 172.21.15.17:0/4150841299 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb9700b5b50 msgr2=0x7fb9701f1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:26.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.084+0000 7fb96ea00640 1 --2- 172.21.15.17:0/4150841299 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb9700b5b50 0x7fb9701f1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:26.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.084+0000 7fb96ea00640 1 -- 172.21.15.17:0/4150841299 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9700d2fa0 msgr2=0x7fb97015d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:26.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.084+0000 7fb96ea00640 1 --2- 172.21.15.17:0/4150841299 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9700d2fa0 0x7fb97015d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:26.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.085+0000 7fb96ea00640 1 -- 172.21.15.17:0/4150841299 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9600094d0 con 0x7fb9700cd840 2024-03-12T17:20:26.081 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.085+0000 7fb96ea00640 1 --2- 172.21.15.17:0/4150841299 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9700cd840 0x7fb97015d1a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb95800e870 tx=0x7fb95800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:26.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.085+0000 7fb967400640 1 -- 172.21.15.17:0/4150841299 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9580094f0 con 0x7fb9700cd840 2024-03-12T17:20:26.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.085+0000 7fb976200640 1 -- 172.21.15.17:0/4150841299 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9700cc7c0 con 0x7fb9700cd840 2024-03-12T17:20:26.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.085+0000 7fb967400640 1 -- 172.21.15.17:0/4150841299 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95800c940 con 0x7fb9700cd840 2024-03-12T17:20:26.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.085+0000 7fb967400640 1 -- 172.21.15.17:0/4150841299 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95800ccf0 con 0x7fb9700cd840 2024-03-12T17:20:26.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.085+0000 7fb976200640 1 -- 172.21.15.17:0/4150841299 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9700c9fc0 con 0x7fb9700cd840 2024-03-12T17:20:26.082 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.087+0000 7fb976200640 1 -- 172.21.15.17:0/4150841299 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9700736c0 con 0x7fb9700cd840 2024-03-12T17:20:26.083 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.088+0000 7fb967400640 1 -- 172.21.15.17:0/4150841299 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fb958013470 con 0x7fb9700cd840 2024-03-12T17:20:26.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.088+0000 7fb967400640 1 --2- 172.21.15.17:0/4150841299 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb94c06ac00 0x7fb94c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:26.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.089+0000 7fb967400640 1 -- 172.21.15.17:0/4150841299 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb958089080 con 0x7fb9700cd840 2024-03-12T17:20:26.084 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.089+0000 7fb96f400640 1 --2- 172.21.15.17:0/4150841299 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb94c06ac00 0x7fb94c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:26.085 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.090+0000 7fb96f400640 1 --2- 172.21.15.17:0/4150841299 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb94c06ac00 0x7fb94c06d0c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb960036000 tx=0x7fb96003b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:26.088 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.093+0000 7fb967400640 1 -- 172.21.15.17:0/4150841299 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fb9580545c0 con 0x7fb9700cd840 2024-03-12T17:20:26.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.299+0000 7fb976200640 1 -- 172.21.15.17:0/4150841299 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb9700c9020 con 0x7fb9700cd840 2024-03-12T17:20:26.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.300+0000 7fb967400640 1 -- 172.21.15.17:0/4150841299 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v43) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb958057be0 con 0x7fb9700cd840 2024-03-12T17:20:26.295 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:20:26.295 INFO:teuthology.orchestra.run.smithi017.stdout:[ 2024-03-12T17:20:26.295 INFO:teuthology.orchestra.run.smithi017.stdout: { 2024-03-12T17:20:26.295 INFO:teuthology.orchestra.run.smithi017.stdout: "poolnum": 1, 2024-03-12T17:20:26.295 INFO:teuthology.orchestra.run.smithi017.stdout: "poolname": ".mgr" 2024-03-12T17:20:26.295 INFO:teuthology.orchestra.run.smithi017.stdout: } 2024-03-12T17:20:26.296 INFO:teuthology.orchestra.run.smithi017.stdout:] 2024-03-12T17:20:26.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.303+0000 7fb976200640 1 -- 172.21.15.17:0/4150841299 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb94c06ac00 msgr2=0x7fb94c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:26.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.303+0000 7fb976200640 1 --2- 172.21.15.17:0/4150841299 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb94c06ac00 0x7fb94c06d0c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb960036000 tx=0x7fb96003b040 comp rx=0 tx=0).stop 2024-03-12T17:20:26.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.303+0000 7fb976200640 1 -- 172.21.15.17:0/4150841299 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9700cd840 msgr2=0x7fb97015d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:26.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.303+0000 7fb976200640 1 --2- 172.21.15.17:0/4150841299 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9700cd840 0x7fb97015d1a0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb95800e870 tx=0x7fb95800ed30 comp rx=0 tx=0).stop 2024-03-12T17:20:26.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.303+0000 7fb976200640 1 -- 172.21.15.17:0/4150841299 shutdown_connections 2024-03-12T17:20:26.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.303+0000 7fb976200640 1 --2- 172.21.15.17:0/4150841299 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb94c06ac00 0x7fb94c06d0c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:26.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.303+0000 7fb976200640 1 --2- 172.21.15.17:0/4150841299 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb9700d2fa0 0x7fb97015d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:26.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.303+0000 7fb976200640 1 --2- 172.21.15.17:0/4150841299 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb9700cd840 0x7fb97015d1a0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:26.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.303+0000 7fb976200640 1 --2- 172.21.15.17:0/4150841299 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb9700b5b50 0x7fb9701f1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:26.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.303+0000 7fb976200640 1 -- 172.21.15.17:0/4150841299 >> 172.21.15.17:0/4150841299 conn(0x7fb970065df0 msgr2=0x7fb9700b2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:26.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.303+0000 7fb976200640 1 -- 172.21.15.17:0/4150841299 shutdown_connections 2024-03-12T17:20:26.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.303+0000 7fb976200640 1 -- 172.21.15.17:0/4150841299 wait complete. 2024-03-12T17:20:26.319 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-12T17:20:26.319 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-12T17:20:26.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.549+0000 7faf50600640 1 Processor -- start 2024-03-12T17:20:26.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.549+0000 7faf50600640 1 -- start start 2024-03-12T17:20:26.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.551+0000 7faf50600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf4815cbb0 0x7faf4806c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:26.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.551+0000 7faf50600640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7faf480cb6c0 0x7faf480cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:26.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.551+0000 7faf50600640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf480b1970 con 0x7faf480cdb80 2024-03-12T17:20:26.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.551+0000 7faf50600640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf480ce5b0 con 0x7faf480cb6c0 2024-03-12T17:20:26.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.551+0000 7faf50600640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4815cf90 con 0x7faf4815cbb0 2024-03-12T17:20:26.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.551+0000 7faf4d200640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7faf480cdb80 0x7faf480cafb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:56666/0 (socket says 172.21.15.17:56666) 2024-03-12T17:20:26.547 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.551+0000 7faf4d200640 1 -- 172.21.15.17:0/2726927506 learned_addr learned my addr 172.21.15.17:0/2726927506 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:20:26.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.552+0000 7faf4dc00640 1 --2- 172.21.15.17:0/2726927506 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf4815cbb0 0x7faf4806c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:26.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.552+0000 7faf4e600640 1 --2- 172.21.15.17:0/2726927506 >> v2:172.21.15.94:3300/0 conn(0x7faf480cb6c0 0x7faf480cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:26.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.552+0000 7faf47e00640 1 -- 172.21.15.17:0/2726927506 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610338542 0 0) 0x7faf480b1970 con 0x7faf480cdb80 2024-03-12T17:20:26.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.552+0000 7faf47e00640 1 -- 172.21.15.17:0/2726927506 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf30003520 con 0x7faf480cdb80 2024-03-12T17:20:26.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.552+0000 7faf47e00640 1 -- 172.21.15.17:0/2726927506 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3311385037 0 0) 0x7faf30003520 con 0x7faf480cdb80 2024-03-12T17:20:26.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.552+0000 7faf47e00640 1 -- 172.21.15.17:0/2726927506 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf4815cbb0 msgr2=0x7faf4806c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:26.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.552+0000 7faf47e00640 1 --2- 172.21.15.17:0/2726927506 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf4815cbb0 0x7faf4806c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:26.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.552+0000 7faf47e00640 1 -- 172.21.15.17:0/2726927506 >> v2:172.21.15.94:3300/0 conn(0x7faf480cb6c0 msgr2=0x7faf480cdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:26.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.552+0000 7faf47e00640 1 --2- 172.21.15.17:0/2726927506 >> v2:172.21.15.94:3300/0 conn(0x7faf480cb6c0 0x7faf480cdfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:26.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.552+0000 7faf47e00640 1 -- 172.21.15.17:0/2726927506 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf480ce7c0 con 0x7faf480cdb80 2024-03-12T17:20:26.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.552+0000 7faf47e00640 1 -- 172.21.15.17:0/2726927506 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7faf3c001670 con 0x7faf480cdb80 2024-03-12T17:20:26.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.552+0000 7faf47e00640 1 -- 172.21.15.17:0/2726927506 >> v1:172.21.15.17:6789/0 conn(0x7faf480cdb80 legacy=0x7faf480cafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:26.549 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.552+0000 7faf47e00640 1 --2- 172.21.15.17:0/2726927506 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf30003970 0x7faf30003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:26.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.552+0000 7faf47e00640 1 --2- 172.21.15.17:0/2726927506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf30004360 0x7faf30004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:26.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.553+0000 7faf47e00640 1 --2- 172.21.15.17:0/2726927506 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf30004eb0 0x7faf3000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:26.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.553+0000 7faf47e00640 1 -- 172.21.15.17:0/2726927506 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf480ce5b0 con 0x7faf30004360 2024-03-12T17:20:26.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.553+0000 7faf47e00640 1 -- 172.21.15.17:0/2726927506 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4815cf90 con 0x7faf30004eb0 2024-03-12T17:20:26.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.553+0000 7faf47e00640 1 -- 172.21.15.17:0/2726927506 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3000bec0 con 0x7faf30003970 2024-03-12T17:20:26.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.553+0000 7faf4d200640 1 --2- 172.21.15.17:0/2726927506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf30004360 0x7faf30004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:26.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.553+0000 7faf4dc00640 1 --2- 172.21.15.17:0/2726927506 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf30003970 0x7faf30003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:26.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.553+0000 7faf4e600640 1 --2- 172.21.15.17:0/2726927506 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf30004eb0 0x7faf3000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:26.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.553+0000 7faf4d200640 1 -- 172.21.15.17:0/2726927506 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf30003970 msgr2=0x7faf30003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:26.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.553+0000 7faf4d200640 1 --2- 172.21.15.17:0/2726927506 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf30003970 0x7faf30003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:26.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.553+0000 7faf4d200640 1 -- 172.21.15.17:0/2726927506 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf30004eb0 msgr2=0x7faf3000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:26.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.553+0000 7faf4d200640 1 --2- 172.21.15.17:0/2726927506 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf30004eb0 0x7faf3000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:26.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.553+0000 7faf4d200640 1 -- 172.21.15.17:0/2726927506 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf30003520 con 0x7faf30004360 2024-03-12T17:20:26.550 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.553+0000 7faf4e600640 1 --2- 172.21.15.17:0/2726927506 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf30004eb0 0x7faf3000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:26.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.555+0000 7faf4d200640 1 --2- 172.21.15.17:0/2726927506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf30004360 0x7faf30004840 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7faf3c00c240 tx=0x7faf300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ed33f67c2845666 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:26.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.555+0000 7faf47e00640 1 -- 172.21.15.17:0/2726927506 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c02cb00 con 0x7faf30004360 2024-03-12T17:20:26.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.555+0000 7faf47e00640 1 -- 172.21.15.17:0/2726927506 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3c02cc60 con 0x7faf30004360 2024-03-12T17:20:26.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.555+0000 7faf47e00640 1 -- 172.21.15.17:0/2726927506 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c005af0 con 0x7faf30004360 2024-03-12T17:20:26.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.555+0000 7faf50600640 1 -- 172.21.15.17:0/2726927506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf30004360 msgr2=0x7faf30004840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:26.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.555+0000 7faf50600640 1 --2- 172.21.15.17:0/2726927506 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf30004360 0x7faf30004840 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7faf3c00c240 tx=0x7faf300057f0 comp rx=0 tx=0).stop 2024-03-12T17:20:26.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.556+0000 7faf4e600640 1 -- 172.21.15.17:0/2726927506 reap_dead start 2024-03-12T17:20:26.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.556+0000 7faf50600640 1 -- 172.21.15.17:0/2726927506 shutdown_connections 2024-03-12T17:20:26.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.556+0000 7faf50600640 1 -- 172.21.15.17:0/2726927506 >> 172.21.15.17:0/2726927506 conn(0x7faf48069ce0 msgr2=0x7faf4806a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:26.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.556+0000 7faf50600640 1 -- 172.21.15.17:0/2726927506 shutdown_connections 2024-03-12T17:20:26.552 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.556+0000 7faf50600640 1 -- 172.21.15.17:0/2726927506 wait complete. 2024-03-12T17:20:26.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.558+0000 7faf50600640 1 Processor -- start 2024-03-12T17:20:26.553 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.558+0000 7faf50600640 1 -- start start 2024-03-12T17:20:26.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.559+0000 7faf50600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf30004360 0x7faf481557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:26.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.559+0000 7faf50600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf48154200 0x7faf48141070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:26.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.559+0000 7faf50600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf4815d170 0x7faf480ac920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:26.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.559+0000 7faf50600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf48155310 con 0x7faf48154200 2024-03-12T17:20:26.554 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.559+0000 7faf50600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf481415b0 con 0x7faf4815d170 2024-03-12T17:20:26.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.559+0000 7faf50600640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf48154700 con 0x7faf30004360 2024-03-12T17:20:26.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.559+0000 7faf4d200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf48154200 0x7faf48141070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:26.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.559+0000 7faf4d200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf48154200 0x7faf48141070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47342/0 (socket says 172.21.15.17:47342) 2024-03-12T17:20:26.555 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.559+0000 7faf4d200640 1 -- 172.21.15.17:0/943923381 learned_addr learned my addr 172.21.15.17:0/943923381 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:26.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.559+0000 7faf4dc00640 1 --2- 172.21.15.17:0/943923381 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf30004360 0x7faf481557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:26.556 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.559+0000 7faf4d200640 1 -- 172.21.15.17:0/943923381 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf30004360 msgr2=0x7faf481557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:26.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.559+0000 7faf4e600640 1 --2- 172.21.15.17:0/943923381 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf4815d170 0x7faf480ac920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:26.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.560+0000 7faf4d200640 1 --2- 172.21.15.17:0/943923381 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf30004360 0x7faf481557a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:26.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.560+0000 7faf4d200640 1 -- 172.21.15.17:0/943923381 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf4815d170 msgr2=0x7faf480ac920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:26.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.560+0000 7faf4d200640 1 --2- 172.21.15.17:0/943923381 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf4815d170 0x7faf480ac920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:26.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.560+0000 7faf4d200640 1 -- 172.21.15.17:0/943923381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf481549e0 con 0x7faf48154200 2024-03-12T17:20:26.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.560+0000 7faf4e600640 1 --2- 172.21.15.17:0/943923381 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf4815d170 0x7faf480ac920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:26.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.560+0000 7faf4d200640 1 --2- 172.21.15.17:0/943923381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf48154200 0x7faf48141070 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7faf3c00c360 tx=0x7faf3c001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:26.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.560+0000 7faf45600640 1 -- 172.21.15.17:0/943923381 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c039030 con 0x7faf48154200 2024-03-12T17:20:26.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.560+0000 7faf45600640 1 -- 172.21.15.17:0/943923381 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3c004bf0 con 0x7faf48154200 2024-03-12T17:20:26.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.560+0000 7faf45600640 1 -- 172.21.15.17:0/943923381 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c03c040 con 0x7faf48154200 2024-03-12T17:20:26.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.560+0000 7faf50600640 1 -- 172.21.15.17:0/943923381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf48154cc0 con 0x7faf48154200 2024-03-12T17:20:26.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.560+0000 7faf50600640 1 -- 172.21.15.17:0/943923381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf4814d5b0 con 0x7faf48154200 2024-03-12T17:20:26.557 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.561+0000 7faf50600640 1 -- 172.21.15.17:0/943923381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf4806ac70 con 0x7faf48154200 2024-03-12T17:20:26.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.562+0000 7faf45600640 1 -- 172.21.15.17:0/943923381 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7faf3c032070 con 0x7faf48154200 2024-03-12T17:20:26.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.563+0000 7faf45600640 1 --2- 172.21.15.17:0/943923381 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faf2806ac30 0x7faf2806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:26.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.564+0000 7faf45600640 1 -- 172.21.15.17:0/943923381 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4857+0+0 (secure 0 0 0) 0x7faf3c0aa400 con 0x7faf48154200 2024-03-12T17:20:26.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.564+0000 7faf4dc00640 1 --2- 172.21.15.17:0/943923381 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faf2806ac30 0x7faf2806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:26.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.564+0000 7faf4dc00640 1 --2- 172.21.15.17:0/943923381 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faf2806ac30 0x7faf2806d0f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7faf480b13c0 tx=0x7faf34008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:26.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.568+0000 7faf45600640 1 -- 172.21.15.17:0/943923381 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7faf3c075890 con 0x7faf48154200 2024-03-12T17:20:26.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:26.768+0000 7faf50600640 1 -- 172.21.15.17:0/943923381 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7faf4814d770 con 0x7faf48154200 2024-03-12T17:20:27.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.678+0000 7faf45600640 1 -- 172.21.15.17:0/943923381 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v44) v1 ==== 138+0+0 (secure 0 0 0) 0x7faf3c078eb0 con 0x7faf48154200 2024-03-12T17:20:27.674 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' created 2024-03-12T17:20:27.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.683+0000 7faf50600640 1 -- 172.21.15.17:0/943923381 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faf2806ac30 msgr2=0x7faf2806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:27.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.683+0000 7faf50600640 1 --2- 172.21.15.17:0/943923381 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faf2806ac30 0x7faf2806d0f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7faf480b13c0 tx=0x7faf34008040 comp rx=0 tx=0).stop 2024-03-12T17:20:27.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.683+0000 7faf50600640 1 -- 172.21.15.17:0/943923381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf48154200 msgr2=0x7faf48141070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:27.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.683+0000 7faf50600640 1 --2- 172.21.15.17:0/943923381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf48154200 0x7faf48141070 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7faf3c00c360 tx=0x7faf3c001a00 comp rx=0 tx=0).stop 2024-03-12T17:20:27.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.683+0000 7faf50600640 1 -- 172.21.15.17:0/943923381 shutdown_connections 2024-03-12T17:20:27.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.683+0000 7faf50600640 1 --2- 172.21.15.17:0/943923381 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faf2806ac30 0x7faf2806d0f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:27.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.683+0000 7faf50600640 1 --2- 172.21.15.17:0/943923381 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf4815d170 0x7faf480ac920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:27.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.683+0000 7faf50600640 1 --2- 172.21.15.17:0/943923381 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf48154200 0x7faf48141070 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:27.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.683+0000 7faf50600640 1 --2- 172.21.15.17:0/943923381 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf30004360 0x7faf481557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:27.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.683+0000 7faf50600640 1 -- 172.21.15.17:0/943923381 >> 172.21.15.17:0/943923381 conn(0x7faf48069ce0 msgr2=0x7faf4806c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:27.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.684+0000 7faf50600640 1 -- 172.21.15.17:0/943923381 shutdown_connections 2024-03-12T17:20:27.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.684+0000 7faf50600640 1 -- 172.21.15.17:0/943923381 wait complete. 2024-03-12T17:20:27.707 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-12T17:20:27.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.933+0000 7fe315200640 1 Processor -- start 2024-03-12T17:20:27.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.933+0000 7fe315200640 1 -- start start 2024-03-12T17:20:27.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.935+0000 7fe315200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe31006c3f0 0x7fe3100b3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:27.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.935+0000 7fe315200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe3100b3780 0x7fe3100ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:27.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.935+0000 7fe315200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3100cb340 con 0x7fe3100ced90 2024-03-12T17:20:27.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.935+0000 7fe315200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3100b3c10 con 0x7fe3100b3780 2024-03-12T17:20:27.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.935+0000 7fe315200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe310159d50 con 0x7fe31006c3f0 2024-03-12T17:20:27.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.935+0000 7fe30e800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe3100b3780 0x7fe3100ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:27.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.935+0000 7fe30e800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe3100b3780 0x7fe3100ccd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47346/0 (socket says 172.21.15.17:47346) 2024-03-12T17:20:27.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.935+0000 7fe30e800640 1 -- 172.21.15.17:0/1298796563 learned_addr learned my addr 172.21.15.17:0/1298796563 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:27.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.936+0000 7fe305400640 1 --2- 172.21.15.17:0/1298796563 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe31006c3f0 0x7fe3100b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:27.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.936+0000 7fe30e800640 1 -- 172.21.15.17:0/1298796563 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe31006c3f0 msgr2=0x7fe3100b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:27.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.936+0000 7fe30e800640 1 --2- 172.21.15.17:0/1298796563 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe31006c3f0 0x7fe3100b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:27.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.936+0000 7fe30e800640 1 -- 172.21.15.17:0/1298796563 >> v1:172.21.15.17:6789/0 conn(0x7fe3100ced90 legacy=0x7fe3100b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:27.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.936+0000 7fe30e800640 1 -- 172.21.15.17:0/1298796563 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3100b1ef0 con 0x7fe3100b3780 2024-03-12T17:20:27.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.937+0000 7fe30e800640 1 --2- 172.21.15.17:0/1298796563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3100b3780 0x7fe3100ccd40 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe308009e50 tx=0x7fe30802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b88d84324390d898 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:27.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.937+0000 7fe30d400640 1 -- 172.21.15.17:0/1298796563 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30802cb00 con 0x7fe3100b3780 2024-03-12T17:20:27.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.938+0000 7fe30d400640 1 -- 172.21.15.17:0/1298796563 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30802cc60 con 0x7fe3100b3780 2024-03-12T17:20:27.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.938+0000 7fe30d400640 1 -- 172.21.15.17:0/1298796563 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3080343f0 con 0x7fe3100b3780 2024-03-12T17:20:27.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.938+0000 7fe315200640 1 -- 172.21.15.17:0/1298796563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3100b3780 msgr2=0x7fe3100ccd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:27.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.938+0000 7fe315200640 1 --2- 172.21.15.17:0/1298796563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3100b3780 0x7fe3100ccd40 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fe308009e50 tx=0x7fe30802bf60 comp rx=0 tx=0).stop 2024-03-12T17:20:27.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.938+0000 7fe315200640 1 -- 172.21.15.17:0/1298796563 shutdown_connections 2024-03-12T17:20:27.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.938+0000 7fe315200640 1 --2- 172.21.15.17:0/1298796563 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3100b3780 0x7fe3100ccd40 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:27.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.938+0000 7fe315200640 1 --2- 172.21.15.17:0/1298796563 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe31006c3f0 0x7fe3100b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:27.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.938+0000 7fe315200640 1 -- 172.21.15.17:0/1298796563 >> 172.21.15.17:0/1298796563 conn(0x7fe310069ce0 msgr2=0x7fe31006a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:27.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.938+0000 7fe315200640 1 -- 172.21.15.17:0/1298796563 shutdown_connections 2024-03-12T17:20:27.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.938+0000 7fe315200640 1 -- 172.21.15.17:0/1298796563 wait complete. 2024-03-12T17:20:27.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.940+0000 7fe315200640 1 Processor -- start 2024-03-12T17:20:27.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.940+0000 7fe315200640 1 -- start start 2024-03-12T17:20:27.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.941+0000 7fe315200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe31006c3f0 0x7fe310152a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:27.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.941+0000 7fe315200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3100b3780 0x7fe310150ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:27.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.941+0000 7fe315200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3100ced90 0x7fe310150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:27.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.941+0000 7fe315200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe310153460 con 0x7fe3100b3780 2024-03-12T17:20:27.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.941+0000 7fe315200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe310153740 con 0x7fe3100ced90 2024-03-12T17:20:27.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.941+0000 7fe315200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe310153a20 con 0x7fe31006c3f0 2024-03-12T17:20:27.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.941+0000 7fe305400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3100b3780 0x7fe310150ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:27.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.942+0000 7fe305400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3100b3780 0x7fe310150ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47352/0 (socket says 172.21.15.17:47352) 2024-03-12T17:20:27.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.942+0000 7fe305400640 1 -- 172.21.15.17:0/4118411581 learned_addr learned my addr 172.21.15.17:0/4118411581 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:27.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.942+0000 7fe30de00640 1 --2- 172.21.15.17:0/4118411581 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe31006c3f0 0x7fe310152a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:27.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.942+0000 7fe30e800640 1 --2- 172.21.15.17:0/4118411581 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3100ced90 0x7fe310150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:27.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.942+0000 7fe305400640 1 -- 172.21.15.17:0/4118411581 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe31006c3f0 msgr2=0x7fe310152a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:27.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.942+0000 7fe305400640 1 --2- 172.21.15.17:0/4118411581 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe31006c3f0 0x7fe310152a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:27.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.942+0000 7fe305400640 1 -- 172.21.15.17:0/4118411581 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3100ced90 msgr2=0x7fe310150ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:27.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.942+0000 7fe305400640 1 --2- 172.21.15.17:0/4118411581 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3100ced90 0x7fe310150ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:27.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.942+0000 7fe305400640 1 -- 172.21.15.17:0/4118411581 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe308009b30 con 0x7fe3100b3780 2024-03-12T17:20:27.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.942+0000 7fe305400640 1 --2- 172.21.15.17:0/4118411581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3100b3780 0x7fe310150ab0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe2f800d5f0 tx=0x7fe2f800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:27.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.943+0000 7fe306a00640 1 -- 172.21.15.17:0/4118411581 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f80125f0 con 0x7fe3100b3780 2024-03-12T17:20:27.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.943+0000 7fe306a00640 1 -- 172.21.15.17:0/4118411581 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2f8012750 con 0x7fe3100b3780 2024-03-12T17:20:27.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.943+0000 7fe306a00640 1 -- 172.21.15.17:0/4118411581 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f8012b00 con 0x7fe3100b3780 2024-03-12T17:20:27.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.943+0000 7fe315200640 1 -- 172.21.15.17:0/4118411581 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe310153d00 con 0x7fe3100b3780 2024-03-12T17:20:27.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.943+0000 7fe315200640 1 -- 172.21.15.17:0/4118411581 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe310152f50 con 0x7fe3100b3780 2024-03-12T17:20:27.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.944+0000 7fe315200640 1 -- 172.21.15.17:0/4118411581 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3100736c0 con 0x7fe3100b3780 2024-03-12T17:20:27.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.945+0000 7fe306a00640 1 -- 172.21.15.17:0/4118411581 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fe2f8012c60 con 0x7fe3100b3780 2024-03-12T17:20:27.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.946+0000 7fe306a00640 1 --2- 172.21.15.17:0/4118411581 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe2ec06ac00 0x7fe2ec06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:27.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.946+0000 7fe306a00640 1 -- 172.21.15.17:0/4118411581 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fe2f8089660 con 0x7fe3100b3780 2024-03-12T17:20:27.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.946+0000 7fe30de00640 1 --2- 172.21.15.17:0/4118411581 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe2ec06ac00 0x7fe2ec06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:27.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.947+0000 7fe30de00640 1 --2- 172.21.15.17:0/4118411581 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe2ec06ac00 0x7fe2ec06d0c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe3000015a0 tx=0x7fe300009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:27.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:27.951+0000 7fe306a00640 1 -- 172.21.15.17:0/4118411581 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fe2f8054a20 con 0x7fe3100b3780 2024-03-12T17:20:28.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.152+0000 7fe315200640 1 -- 172.21.15.17:0/4118411581 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe31006dc10 con 0x7fe3100b3780 2024-03-12T17:20:28.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.695+0000 7fe306a00640 1 -- 172.21.15.17:0/4118411581 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v45) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe2f8058040 con 0x7fe3100b3780 2024-03-12T17:20:28.691 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' created 2024-03-12T17:20:28.698 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.703+0000 7fe315200640 1 -- 172.21.15.17:0/4118411581 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe2ec06ac00 msgr2=0x7fe2ec06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:28.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.703+0000 7fe315200640 1 --2- 172.21.15.17:0/4118411581 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe2ec06ac00 0x7fe2ec06d0c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fe3000015a0 tx=0x7fe300009040 comp rx=0 tx=0).stop 2024-03-12T17:20:28.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.703+0000 7fe315200640 1 -- 172.21.15.17:0/4118411581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3100b3780 msgr2=0x7fe310150ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:28.699 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.703+0000 7fe315200640 1 --2- 172.21.15.17:0/4118411581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3100b3780 0x7fe310150ab0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fe2f800d5f0 tx=0x7fe2f800dab0 comp rx=0 tx=0).stop 2024-03-12T17:20:28.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.707+0000 7fe315200640 1 -- 172.21.15.17:0/4118411581 shutdown_connections 2024-03-12T17:20:28.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.707+0000 7fe315200640 1 --2- 172.21.15.17:0/4118411581 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe2ec06ac00 0x7fe2ec06d0c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:28.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.707+0000 7fe315200640 1 --2- 172.21.15.17:0/4118411581 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe3100ced90 0x7fe310150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:28.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.707+0000 7fe315200640 1 --2- 172.21.15.17:0/4118411581 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe3100b3780 0x7fe310150ab0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:28.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.707+0000 7fe315200640 1 --2- 172.21.15.17:0/4118411581 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe31006c3f0 0x7fe310152a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:28.702 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.707+0000 7fe315200640 1 -- 172.21.15.17:0/4118411581 >> 172.21.15.17:0/4118411581 conn(0x7fe310069ce0 msgr2=0x7fe310070840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:28.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.707+0000 7fe315200640 1 -- 172.21.15.17:0/4118411581 shutdown_connections 2024-03-12T17:20:28.703 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.707+0000 7fe315200640 1 -- 172.21.15.17:0/4118411581 wait complete. 2024-03-12T17:20:28.734 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-12T17:20:28.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.923+0000 7f27c5000640 1 Processor -- start 2024-03-12T17:20:28.919 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.923+0000 7f27c5000640 1 -- start start 2024-03-12T17:20:28.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.925+0000 7f27c5000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f27c00b3950 0x7f27c01647b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:28.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.925+0000 7f27c5000640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27c00cb340 con 0x7f27c006c3f0 2024-03-12T17:20:28.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.925+0000 7f27c5000640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27c0159d50 con 0x7f27c00ced90 2024-03-12T17:20:28.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.925+0000 7f27c5000640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c00b1ef0 con 0x7f27c00b3950 2024-03-12T17:20:28.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.925+0000 7f27bd400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f27c006c3f0 0x7f27c00b3240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:56684/0 (socket says 172.21.15.17:56684) 2024-03-12T17:20:28.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.925+0000 7f27bd400640 1 -- 172.21.15.17:0/3166694674 learned_addr learned my addr 172.21.15.17:0/3166694674 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:20:28.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.926+0000 7f27be800640 1 --2- 172.21.15.17:0/3166694674 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f27c00b3950 0x7f27c01647b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:28.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.926+0000 7f27bca00640 1 -- 172.21.15.17:0/3166694674 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1379693407 0 0) 0x7f27c00cb340 con 0x7f27c006c3f0 2024-03-12T17:20:28.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.926+0000 7f27bca00640 1 -- 172.21.15.17:0/3166694674 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27a4003520 con 0x7f27c006c3f0 2024-03-12T17:20:28.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.926+0000 7f27bca00640 1 -- 172.21.15.17:0/3166694674 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3635090317 0 0) 0x7f27a4003520 con 0x7f27c006c3f0 2024-03-12T17:20:28.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.926+0000 7f27bca00640 1 -- 172.21.15.17:0/3166694674 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f27c00b3950 msgr2=0x7f27c01647b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:28.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.926+0000 7f27bca00640 1 --2- 172.21.15.17:0/3166694674 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f27c00b3950 0x7f27c01647b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:28.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.926+0000 7f27bca00640 1 -- 172.21.15.17:0/3166694674 >> v1:172.21.15.94:6789/0 conn(0x7f27c00ced90 legacy=0x7f27c00b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:28.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.926+0000 7f27bca00640 1 -- 172.21.15.17:0/3166694674 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c00b21d0 con 0x7f27c006c3f0 2024-03-12T17:20:28.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.926+0000 7f27bca00640 1 -- 172.21.15.17:0/3166694674 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7f27ac001670 con 0x7f27c006c3f0 2024-03-12T17:20:28.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.926+0000 7f27bca00640 1 -- 172.21.15.17:0/3166694674 >> v1:172.21.15.17:6789/0 conn(0x7f27c006c3f0 legacy=0x7f27c00b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:28.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.926+0000 7f27bca00640 1 --2- 172.21.15.17:0/3166694674 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f27c00b3950 0x7f27a40039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:28.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.926+0000 7f27bca00640 1 --2- 172.21.15.17:0/3166694674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27a4003f70 0x7f27a40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:28.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.927+0000 7f27bca00640 1 --2- 172.21.15.17:0/3166694674 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27a4004d00 0x7f27a4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:28.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.927+0000 7f27bca00640 1 -- 172.21.15.17:0/3166694674 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c00b1ef0 con 0x7f27a4003f70 2024-03-12T17:20:28.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.927+0000 7f27bca00640 1 -- 172.21.15.17:0/3166694674 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a400bac0 con 0x7f27a4004d00 2024-03-12T17:20:28.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.927+0000 7f27bca00640 1 -- 172.21.15.17:0/3166694674 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27a400bc80 con 0x7f27c00b3950 2024-03-12T17:20:28.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.927+0000 7f27bd400640 1 --2- 172.21.15.17:0/3166694674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27a4003f70 0x7f27a40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:28.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.927+0000 7f27bd400640 1 -- 172.21.15.17:0/3166694674 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f27c00b3950 msgr2=0x7f27a40039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:28.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.927+0000 7f27bde00640 1 --2- 172.21.15.17:0/3166694674 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f27c00b3950 0x7f27a40039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:28.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.927+0000 7f27be800640 1 --2- 172.21.15.17:0/3166694674 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27a4004d00 0x7f27a4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:28.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.927+0000 7f27bd400640 1 --2- 172.21.15.17:0/3166694674 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f27c00b3950 0x7f27a40039a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:28.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.927+0000 7f27bd400640 1 -- 172.21.15.17:0/3166694674 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27a4004d00 msgr2=0x7f27a4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:28.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.927+0000 7f27bd400640 1 --2- 172.21.15.17:0/3166694674 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27a4004d00 0x7f27a4005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:28.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.927+0000 7f27bd400640 1 -- 172.21.15.17:0/3166694674 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a4003520 con 0x7f27a4003f70 2024-03-12T17:20:28.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.928+0000 7f27bd400640 1 --2- 172.21.15.17:0/3166694674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27a4003f70 0x7f27a40047c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f27ac00c0e0 tx=0x7f27a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c793d978d908e389 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:28.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.929+0000 7f27bca00640 1 -- 172.21.15.17:0/3166694674 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac005ad0 con 0x7f27a4003f70 2024-03-12T17:20:28.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.929+0000 7f27bca00640 1 -- 172.21.15.17:0/3166694674 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27ac005c30 con 0x7f27a4003f70 2024-03-12T17:20:28.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.929+0000 7f27bca00640 1 -- 172.21.15.17:0/3166694674 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac0072b0 con 0x7f27a4003f70 2024-03-12T17:20:28.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.929+0000 7f27c5000640 1 -- 172.21.15.17:0/3166694674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27a4003f70 msgr2=0x7f27a40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:28.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.929+0000 7f27c5000640 1 --2- 172.21.15.17:0/3166694674 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27a4003f70 0x7f27a40047c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f27ac00c0e0 tx=0x7f27a40057f0 comp rx=0 tx=0).stop 2024-03-12T17:20:28.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.929+0000 7f27be800640 1 -- 172.21.15.17:0/3166694674 reap_dead start 2024-03-12T17:20:28.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.929+0000 7f27c5000640 1 -- 172.21.15.17:0/3166694674 shutdown_connections 2024-03-12T17:20:28.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.929+0000 7f27c5000640 1 -- 172.21.15.17:0/3166694674 >> 172.21.15.17:0/3166694674 conn(0x7f27c0069ce0 msgr2=0x7f27c006a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:28.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.929+0000 7f27c5000640 1 -- 172.21.15.17:0/3166694674 shutdown_connections 2024-03-12T17:20:28.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.929+0000 7f27c5000640 1 -- 172.21.15.17:0/3166694674 wait complete. 2024-03-12T17:20:28.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.931+0000 7f27c5000640 1 Processor -- start 2024-03-12T17:20:28.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.931+0000 7f27c5000640 1 -- start start 2024-03-12T17:20:28.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.932+0000 7f27c5000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f27a4003f70 0x7f27c0157510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:28.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.932+0000 7f27c5000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27c0147020 0x7f27c0154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:28.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.932+0000 7f27c5000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27c0154c70 0x7f27c0155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:28.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.932+0000 7f27c5000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c01550d0 con 0x7f27c0147020 2024-03-12T17:20:28.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.932+0000 7f27c5000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c0150e90 con 0x7f27c0154c70 2024-03-12T17:20:28.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.932+0000 7f27c5000640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c0151170 con 0x7f27a4003f70 2024-03-12T17:20:28.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.933+0000 7f27bd400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27c0147020 0x7f27c0154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:28.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.933+0000 7f27bd400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27c0147020 0x7f27c0154730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47374/0 (socket says 172.21.15.17:47374) 2024-03-12T17:20:28.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.933+0000 7f27bd400640 1 -- 172.21.15.17:0/2473532777 learned_addr learned my addr 172.21.15.17:0/2473532777 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:28.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.933+0000 7f27be800640 1 --2- 172.21.15.17:0/2473532777 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27c0154c70 0x7f27c0155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:28.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.933+0000 7f27bde00640 1 --2- 172.21.15.17:0/2473532777 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f27a4003f70 0x7f27c0157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:28.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.933+0000 7f27bd400640 1 -- 172.21.15.17:0/2473532777 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f27a4003f70 msgr2=0x7f27c0157510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:28.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.933+0000 7f27bd400640 1 --2- 172.21.15.17:0/2473532777 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f27a4003f70 0x7f27c0157510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:28.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.933+0000 7f27bd400640 1 -- 172.21.15.17:0/2473532777 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27c0154c70 msgr2=0x7f27c0155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:28.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.933+0000 7f27bd400640 1 --2- 172.21.15.17:0/2473532777 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27c0154c70 0x7f27c0155a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:28.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.933+0000 7f27bd400640 1 -- 172.21.15.17:0/2473532777 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c0151450 con 0x7f27c0147020 2024-03-12T17:20:28.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.933+0000 7f27be800640 1 --2- 172.21.15.17:0/2473532777 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27c0154c70 0x7f27c0155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:28.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.934+0000 7f27bd400640 1 --2- 172.21.15.17:0/2473532777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27c0147020 0x7f27c0154730 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f27ac00c0e0 tx=0x7f27ac001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:28.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.934+0000 7f27b6000640 1 -- 172.21.15.17:0/2473532777 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac03c040 con 0x7f27c0147020 2024-03-12T17:20:28.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.934+0000 7f27b6000640 1 -- 172.21.15.17:0/2473532777 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27ac007500 con 0x7f27c0147020 2024-03-12T17:20:28.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.934+0000 7f27b6000640 1 -- 172.21.15.17:0/2473532777 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac02c740 con 0x7f27c0147020 2024-03-12T17:20:28.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.934+0000 7f27c5000640 1 -- 172.21.15.17:0/2473532777 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27c0151730 con 0x7f27c0147020 2024-03-12T17:20:28.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.934+0000 7f27c5000640 1 -- 172.21.15.17:0/2473532777 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27c01474a0 con 0x7f27c0147020 2024-03-12T17:20:28.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.935+0000 7f27c5000640 1 -- 172.21.15.17:0/2473532777 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27c00736c0 con 0x7f27c0147020 2024-03-12T17:20:28.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.937+0000 7f27b6000640 1 -- 172.21.15.17:0/2473532777 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f27ac032070 con 0x7f27c0147020 2024-03-12T17:20:28.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.937+0000 7f27b6000640 1 --2- 172.21.15.17:0/2473532777 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f27a006ac00 0x7f27a006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:28.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.937+0000 7f27b6000640 1 -- 172.21.15.17:0/2473532777 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f27ac0aabc0 con 0x7f27c0147020 2024-03-12T17:20:28.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.938+0000 7f27bde00640 1 --2- 172.21.15.17:0/2473532777 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f27a006ac00 0x7f27a006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:28.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.939+0000 7f27bde00640 1 --2- 172.21.15.17:0/2473532777 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f27a006ac00 0x7f27a006d0c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f27b0001710 tx=0x7f27b0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:28.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:28.942+0000 7f27b6000640 1 -- 172.21.15.17:0/2473532777 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f27ac075e70 con 0x7f27c0147020 2024-03-12T17:20:29.172 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.177+0000 7f27c5000640 1 -- 172.21.15.17:0/2473532777 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f27c006dc10 con 0x7f27c0147020 2024-03-12T17:20:29.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.186+0000 7f27b6000640 1 -- 172.21.15.17:0/2473532777 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v18) v1 ==== 172+0+0 (secure 0 0 0) 0x7f27ac046020 con 0x7f27c0147020 2024-03-12T17:20:29.182 INFO:teuthology.orchestra.run.smithi017.stderr:new fs with metadata pool 6 and data pool 7 2024-03-12T17:20:29.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.190+0000 7f27c5000640 1 -- 172.21.15.17:0/2473532777 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f27a006ac00 msgr2=0x7f27a006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:29.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.190+0000 7f27c5000640 1 --2- 172.21.15.17:0/2473532777 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f27a006ac00 0x7f27a006d0c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f27b0001710 tx=0x7f27b0009040 comp rx=0 tx=0).stop 2024-03-12T17:20:29.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.190+0000 7f27c5000640 1 -- 172.21.15.17:0/2473532777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27c0147020 msgr2=0x7f27c0154730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:29.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.190+0000 7f27c5000640 1 --2- 172.21.15.17:0/2473532777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27c0147020 0x7f27c0154730 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f27ac00c0e0 tx=0x7f27ac001930 comp rx=0 tx=0).stop 2024-03-12T17:20:29.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.191+0000 7f27c5000640 1 -- 172.21.15.17:0/2473532777 shutdown_connections 2024-03-12T17:20:29.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.191+0000 7f27c5000640 1 --2- 172.21.15.17:0/2473532777 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f27a006ac00 0x7f27a006d0c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:29.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.191+0000 7f27c5000640 1 --2- 172.21.15.17:0/2473532777 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f27c0154c70 0x7f27c0155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:29.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.191+0000 7f27c5000640 1 --2- 172.21.15.17:0/2473532777 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f27c0147020 0x7f27c0154730 secure :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f27ac00c0e0 tx=0x7f27ac001930 comp rx=0 tx=0).stop 2024-03-12T17:20:29.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.191+0000 7f27c5000640 1 --2- 172.21.15.17:0/2473532777 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f27a4003f70 0x7f27c0157510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:29.187 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.191+0000 7f27c5000640 1 -- 172.21.15.17:0/2473532777 >> 172.21.15.17:0/2473532777 conn(0x7f27c0069ce0 msgr2=0x7f27c015a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:29.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.193+0000 7f27c5000640 1 -- 172.21.15.17:0/2473532777 shutdown_connections 2024-03-12T17:20:29.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.194+0000 7f27c5000640 1 -- 172.21.15.17:0/2473532777 wait complete. 2024-03-12T17:20:29.223 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T17:20:29.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.403+0000 7f38fc800640 1 Processor -- start 2024-03-12T17:20:29.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.403+0000 7f38fc800640 1 -- start start 2024-03-12T17:20:29.399 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.404+0000 7f38fc800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f38f40cc080 0x7f38f40b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:29.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.404+0000 7f38fc800640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38f40ce320 con 0x7f38f4144240 2024-03-12T17:20:29.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.404+0000 7f38fc800640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38f4144620 con 0x7f38f40b2070 2024-03-12T17:20:29.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.404+0000 7f38fc800640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38f415f3d0 con 0x7f38f40cc080 2024-03-12T17:20:29.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.405+0000 7f38fa800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f38f40cc080 0x7f38f40b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:29.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.405+0000 7f38fa800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f38f40cc080 0x7f38f40b2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47382/0 (socket says 172.21.15.17:47382) 2024-03-12T17:20:29.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.405+0000 7f38fa800640 1 -- 172.21.15.17:0/4007879019 learned_addr learned my addr 172.21.15.17:0/4007879019 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:29.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.405+0000 7f38fa800640 1 -- 172.21.15.17:0/4007879019 >> v1:172.21.15.94:6789/0 conn(0x7f38f40b2070 legacy=0x7f38f40cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:29.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.405+0000 7f38fa800640 1 -- 172.21.15.17:0/4007879019 >> v1:172.21.15.17:6789/0 conn(0x7f38f4144240 legacy=0x7f38f40ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:29.401 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.405+0000 7f38fa800640 1 -- 172.21.15.17:0/4007879019 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f40cd9f0 con 0x7f38f40cc080 2024-03-12T17:20:29.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.406+0000 7f38fa800640 1 --2- 172.21.15.17:0/4007879019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38f40cc080 0x7f38f40b2500 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f38f0009e50 tx=0x7f38f002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f8c2580f5b594f4 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:29.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.407+0000 7f38f8a00640 1 -- 172.21.15.17:0/4007879019 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f002cb00 con 0x7f38f40cc080 2024-03-12T17:20:29.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.407+0000 7f38f8a00640 1 -- 172.21.15.17:0/4007879019 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f002cc60 con 0x7f38f40cc080 2024-03-12T17:20:29.402 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.407+0000 7f38f8a00640 1 -- 172.21.15.17:0/4007879019 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f00343f0 con 0x7f38f40cc080 2024-03-12T17:20:29.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.407+0000 7f38fc800640 1 -- 172.21.15.17:0/4007879019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38f40cc080 msgr2=0x7f38f40b2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:29.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.407+0000 7f38fc800640 1 --2- 172.21.15.17:0/4007879019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38f40cc080 0x7f38f40b2500 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f38f0009e50 tx=0x7f38f002bf60 comp rx=0 tx=0).stop 2024-03-12T17:20:29.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.408+0000 7f38fc800640 1 -- 172.21.15.17:0/4007879019 shutdown_connections 2024-03-12T17:20:29.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.408+0000 7f38fc800640 1 --2- 172.21.15.17:0/4007879019 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38f40cc080 0x7f38f40b2500 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:29.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.408+0000 7f38fc800640 1 -- 172.21.15.17:0/4007879019 >> 172.21.15.17:0/4007879019 conn(0x7f38f4069ce0 msgr2=0x7f38f406a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:29.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.408+0000 7f38fc800640 1 -- 172.21.15.17:0/4007879019 shutdown_connections 2024-03-12T17:20:29.403 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.408+0000 7f38fc800640 1 -- 172.21.15.17:0/4007879019 wait complete. 2024-03-12T17:20:29.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.409+0000 7f38fc800640 1 Processor -- start 2024-03-12T17:20:29.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.409+0000 7f38fc800640 1 -- start start 2024-03-12T17:20:29.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.410+0000 7f38fc800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38f40b2070 0x7f38f413c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:29.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.410+0000 7f38fc800640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f38f40cc080 0x7f38f4156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:29.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.410+0000 7f38fc800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f38f4144240 0x7f38f413a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:29.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.410+0000 7f38fc800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f413dc10 con 0x7f38f40b2070 2024-03-12T17:20:29.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.410+0000 7f38fc800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f413d2e0 con 0x7f38f4144240 2024-03-12T17:20:29.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.410+0000 7f38fc800640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f413d5c0 con 0x7f38f40cc080 2024-03-12T17:20:29.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.411+0000 7f38f9e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38f40b2070 0x7f38f413c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:29.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.411+0000 7f38f9e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38f40b2070 0x7f38f413c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47398/0 (socket says 172.21.15.17:47398) 2024-03-12T17:20:29.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.411+0000 7f38f9e00640 1 -- 172.21.15.17:0/436782564 learned_addr learned my addr 172.21.15.17:0/436782564 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:29.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.411+0000 7f38f9400640 1 --2- 172.21.15.17:0/436782564 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f38f40cc080 0x7f38f4156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:29.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.411+0000 7f38f9e00640 1 -- 172.21.15.17:0/436782564 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f38f40cc080 msgr2=0x7f38f4156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:29.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.411+0000 7f38f9e00640 1 --2- 172.21.15.17:0/436782564 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f38f40cc080 0x7f38f4156e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:29.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.411+0000 7f38f9e00640 1 -- 172.21.15.17:0/436782564 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f38f4144240 msgr2=0x7f38f413a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:29.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.411+0000 7f38f9e00640 1 --2- 172.21.15.17:0/436782564 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f38f4144240 0x7f38f413a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:29.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.411+0000 7f38f9e00640 1 -- 172.21.15.17:0/436782564 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f0009b30 con 0x7f38f40b2070 2024-03-12T17:20:29.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.412+0000 7f38f9e00640 1 --2- 172.21.15.17:0/436782564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38f40b2070 0x7f38f413c220 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f38e800c450 tx=0x7f38e800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:29.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.412+0000 7f38ee000640 1 -- 172.21.15.17:0/436782564 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e80052d0 con 0x7f38f40b2070 2024-03-12T17:20:29.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.412+0000 7f38ee000640 1 -- 172.21.15.17:0/436782564 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e8005430 con 0x7f38f40b2070 2024-03-12T17:20:29.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.412+0000 7f38ee000640 1 -- 172.21.15.17:0/436782564 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e8012870 con 0x7f38f40b2070 2024-03-12T17:20:29.408 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.412+0000 7f38fc800640 1 -- 172.21.15.17:0/436782564 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38f413d8a0 con 0x7f38f40b2070 2024-03-12T17:20:29.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.412+0000 7f38fc800640 1 -- 172.21.15.17:0/436782564 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38f41f1560 con 0x7f38f40b2070 2024-03-12T17:20:29.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.413+0000 7f38fc800640 1 -- 172.21.15.17:0/436782564 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38f40736c0 con 0x7f38f40b2070 2024-03-12T17:20:29.409 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.414+0000 7f38ee000640 1 -- 172.21.15.17:0/436782564 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f38e80129d0 con 0x7f38f40b2070 2024-03-12T17:20:29.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.415+0000 7f38ee000640 1 --2- 172.21.15.17:0/436782564 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f38d806ac30 0x7f38d806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:29.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.415+0000 7f38ee000640 1 -- 172.21.15.17:0/436782564 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f38e8088e50 con 0x7f38f40b2070 2024-03-12T17:20:29.413 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.416+0000 7f38f9400640 1 --2- 172.21.15.17:0/436782564 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f38d806ac30 0x7f38d806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:29.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.416+0000 7f38f9400640 1 --2- 172.21.15.17:0/436782564 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f38d806ac30 0x7f38d806d0f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f38f40b0ed0 tx=0x7f38e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:29.415 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.420+0000 7f38ee000640 1 -- 172.21.15.17:0/436782564 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f38e8054020 con 0x7f38f40b2070 2024-03-12T17:20:29.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.620+0000 7f38fc800640 1 -- 172.21.15.17:0/436782564 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38f40b35c0 con 0x7f38f40b2070 2024-03-12T17:20:29.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.621+0000 7f38ee000640 1 -- 172.21.15.17:0/436782564 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16010 (secure 0 0 0) 0x7f38e8057640 con 0x7f38f40b2070 2024-03-12T17:20:29.617 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:20:29.617 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":46,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:20:29.179948+0000","last_up_change":"2024-03-12T17:18:38.144756+0000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-12T17:18:39.552910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-03-12T17:20:26.824841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-03-12T17:20:28.205468+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":37305},{"type":"v1","addr":"172.21.15.17:6801","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":37305},{"type":"v1","addr":"172.21.15.17:6803","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":37305},{"type":"v1","addr":"172.21.15.17:6807","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":37305},{"type":"v1","addr":"172.21.15.17:6805","nonce":37305}]},"public_addr":"172.21.15.17:6801/37305","cluster_addr":"172.21.15.17:6803/37305","heartbeat_back_addr":"172.21.15.17:6807/37305","heartbeat_front_addr":"172.21.15.17:6805/37305","state":["exists","up"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":37307},{"type":"v1","addr":"172.21.15.17:6814","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":37307},{"type":"v1","addr":"172.21.15.17:6818","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":37307},{"type":"v1","addr":"172.21.15.17:6827","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":37307},{"type":"v1","addr":"172.21.15.17:6823","nonce":37307}]},"public_addr":"172.21.15.17:6814/37307","cluster_addr":"172.21.15.17:6818/37307","heartbeat_back_addr":"172.21.15.17:6827/37307","heartbeat_front_addr":"172.21.15.17:6823/37307","state":["exists","up"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":37303},{"type":"v1","addr":"172.21.15.17:6809","nonce":37303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":37303},{"type":"v1","addr":"172.21.15.17:6811","nonce":37303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":37303},{"type":"v1","addr":"172.21.15.17:6819","nonce":37303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":37303},{"type":"v1","addr":"172.21.15.17:6815","nonce":37303}]},"public_addr":"172.21.15.17:6809/37303","cluster_addr":"172.21.15.17:6811/37303","heartbeat_back_addr":"172.21.15.17:6819/37303","heartbeat_front_addr":"172.21.15.17:6815/37303","state":["exists","up"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":37308},{"type":"v1","addr":"172.21.15.17:6822","nonce":37308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":37308},{"type":"v1","addr":"172.21.15.17:6826","nonce":37308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":37308},{"type":"v1","addr":"172.21.15.17:6831","nonce":37308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":37308},{"type":"v1","addr":"172.21.15.17:6829","nonce":37308}]},"public_addr":"172.21.15.17:6822/37308","cluster_addr":"172.21.15.17:6826/37308","heartbeat_back_addr":"172.21.15.17:6831/37308","heartbeat_front_addr":"172.21.15.17:6829/37308","state":["exists","up"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":37465},{"type":"v1","addr":"172.21.15.94:6809","nonce":37465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6811","nonce":37465},{"type":"v1","addr":"172.21.15.94:6813","nonce":37465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6819","nonce":37465},{"type":"v1","addr":"172.21.15.94:6822","nonce":37465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6815","nonce":37465},{"type":"v1","addr":"172.21.15.94:6817","nonce":37465}]},"public_addr":"172.21.15.94:6809/37465","cluster_addr":"172.21.15.94:6813/37465","heartbeat_back_addr":"172.21.15.94:6822/37465","heartbeat_front_addr":"172.21.15.94:6817/37465","state":["exists","up"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":37464},{"type":"v1","addr":"172.21.15.94:6812","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":37464},{"type":"v1","addr":"172.21.15.94:6816","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":37464},{"type":"v1","addr":"172.21.15.94:6823","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":37464},{"type":"v1","addr":"172.21.15.94:6820","nonce":37464}]},"public_addr":"172.21.15.94:6812/37464","cluster_addr":"172.21.15.94:6816/37464","heartbeat_back_addr":"172.21.15.94:6823/37464","heartbeat_front_addr":"172.21.15.94:6820/37464","state":["exists","up"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":37467},{"type":"v1","addr":"172.21.15.94:6825","nonce":37467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":37467},{"type":"v1","addr":"172.21.15.94:6827","nonce":37467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":37467},{"type":"v1","addr":"172.21.15.94:6831","nonce":37467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":37467},{"type":"v1","addr":"172.21.15.94:6829","nonce":37467}]},"public_addr":"172.21.15.94:6825/37467","cluster_addr":"172.21.15.94:6827/37467","heartbeat_back_addr":"172.21.15.94:6831/37467","heartbeat_front_addr":"172.21.15.94:6829/37467","state":["exists","up"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":37466},{"type":"v1","addr":"172.21.15.94:6801","nonce":37466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":37466},{"type":"v1","addr":"172.21.15.94:6803","nonce":37466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":37466},{"type":"v1","addr":"172.21.15.94:6807","nonce":37466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":37466},{"type":"v1","addr":"172.21.15.94:6805","nonce":37466}]},"public_addr":"172.21.15.94:6801/37466","cluster_addr":"172.21.15.94:6803/37466","heartbeat_back_addr":"172.21.15.94:6807/37466","heartbeat_front_addr":"172.21.15.94:6805/37466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.327217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.186966+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.419986+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.150585+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.120621+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.121576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.181257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.293188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:20:29.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.624+0000 7f38fc800640 1 -- 172.21.15.17:0/436782564 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f38d806ac30 msgr2=0x7f38d806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:29.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.624+0000 7f38fc800640 1 --2- 172.21.15.17:0/436782564 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f38d806ac30 0x7f38d806d0f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f38f40b0ed0 tx=0x7f38e4008040 comp rx=0 tx=0).stop 2024-03-12T17:20:29.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.624+0000 7f38fc800640 1 -- 172.21.15.17:0/436782564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38f40b2070 msgr2=0x7f38f413c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:29.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.624+0000 7f38fc800640 1 --2- 172.21.15.17:0/436782564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38f40b2070 0x7f38f413c220 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f38e800c450 tx=0x7f38e800c910 comp rx=0 tx=0).stop 2024-03-12T17:20:29.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.624+0000 7f38fc800640 1 -- 172.21.15.17:0/436782564 shutdown_connections 2024-03-12T17:20:29.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.624+0000 7f38fc800640 1 --2- 172.21.15.17:0/436782564 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f38d806ac30 0x7f38d806d0f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:29.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.624+0000 7f38fc800640 1 --2- 172.21.15.17:0/436782564 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f38f4144240 0x7f38f413a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:29.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.624+0000 7f38fc800640 1 --2- 172.21.15.17:0/436782564 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f38f40cc080 0x7f38f4156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:29.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.624+0000 7f38fc800640 1 --2- 172.21.15.17:0/436782564 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f38f40b2070 0x7f38f413c220 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:29.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.624+0000 7f38fc800640 1 -- 172.21.15.17:0/436782564 >> 172.21.15.17:0/436782564 conn(0x7f38f4069ce0 msgr2=0x7f38f415c090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:29.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.625+0000 7f38fc800640 1 -- 172.21.15.17:0/436782564 shutdown_connections 2024-03-12T17:20:29.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.625+0000 7f38fc800640 1 -- 172.21.15.17:0/436782564 wait complete. 2024-03-12T17:20:29.639 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T17:20:29.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.860+0000 7f9ed5200640 1 Processor -- start 2024-03-12T17:20:29.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.860+0000 7f9ed5200640 1 -- start start 2024-03-12T17:20:29.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.862+0000 7f9ed5200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ed01441f0 0x7f9ed0070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:29.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.862+0000 7f9ed5200640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f9ed015ae20 0x7f9ed006d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:29.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.862+0000 7f9ed5200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ed00a7660 con 0x7f9ed00b3b70 2024-03-12T17:20:29.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.862+0000 7f9ed5200640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ed015e460 con 0x7f9ed015ae20 2024-03-12T17:20:29.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.862+0000 7f9ed5200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed01445d0 con 0x7f9ed01441f0 2024-03-12T17:20:29.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.863+0000 7f9ecfe00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f9ed00b3b70 0x7f9ed015e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:56708/0 (socket says 172.21.15.17:56708) 2024-03-12T17:20:29.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.863+0000 7f9ecfe00640 1 -- 172.21.15.17:0/321930264 learned_addr learned my addr 172.21.15.17:0/321930264 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:20:29.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.863+0000 7f9ecea00640 1 --2- 172.21.15.17:0/321930264 >> v2:172.21.15.94:3300/0 conn(0x7f9ed015ae20 0x7f9ed006d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:29.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.863+0000 7f9ecf400640 1 --2- 172.21.15.17:0/321930264 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ed01441f0 0x7f9ed0070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:29.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.863+0000 7f9ece000640 1 -- 172.21.15.17:0/321930264 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1487243936 0 0) 0x7f9ed00a7660 con 0x7f9ed00b3b70 2024-03-12T17:20:29.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.863+0000 7f9ece000640 1 -- 172.21.15.17:0/321930264 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9eb4003520 con 0x7f9ed00b3b70 2024-03-12T17:20:29.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.864+0000 7f9ece000640 1 -- 172.21.15.17:0/321930264 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2870324543 0 0) 0x7f9eb4003520 con 0x7f9ed00b3b70 2024-03-12T17:20:29.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.864+0000 7f9ece000640 1 -- 172.21.15.17:0/321930264 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ed01441f0 msgr2=0x7f9ed0070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:29.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.864+0000 7f9ece000640 1 --2- 172.21.15.17:0/321930264 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ed01441f0 0x7f9ed0070240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:29.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.864+0000 7f9ece000640 1 -- 172.21.15.17:0/321930264 >> v2:172.21.15.94:3300/0 conn(0x7f9ed015ae20 msgr2=0x7f9ed006d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:29.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.864+0000 7f9ece000640 1 --2- 172.21.15.17:0/321930264 >> v2:172.21.15.94:3300/0 conn(0x7f9ed015ae20 0x7f9ed006d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:29.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.864+0000 7f9ece000640 1 -- 172.21.15.17:0/321930264 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed015b3e0 con 0x7f9ed00b3b70 2024-03-12T17:20:29.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.864+0000 7f9ece000640 1 -- 172.21.15.17:0/321930264 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7f9ec80019f0 con 0x7f9ed00b3b70 2024-03-12T17:20:29.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.864+0000 7f9ece000640 1 -- 172.21.15.17:0/321930264 >> v1:172.21.15.17:6789/0 conn(0x7f9ed00b3b70 legacy=0x7f9ed015e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:29.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.864+0000 7f9ece000640 1 --2- 172.21.15.17:0/321930264 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9eb4003970 0x7f9eb4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:29.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.864+0000 7f9ece000640 1 --2- 172.21.15.17:0/321930264 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ed01441f0 0x7f9eb40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:29.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.864+0000 7f9ece000640 1 --2- 172.21.15.17:0/321930264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9eb4004d00 0x7f9eb4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:29.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.864+0000 7f9ece000640 1 -- 172.21.15.17:0/321930264 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed015e460 con 0x7f9eb4004d00 2024-03-12T17:20:29.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.864+0000 7f9ece000640 1 -- 172.21.15.17:0/321930264 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed01445d0 con 0x7f9eb4003970 2024-03-12T17:20:29.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.864+0000 7f9ece000640 1 -- 172.21.15.17:0/321930264 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb400fd90 con 0x7f9ed01441f0 2024-03-12T17:20:29.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.864+0000 7f9ecfe00640 1 --2- 172.21.15.17:0/321930264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9eb4004d00 0x7f9eb4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:29.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.864+0000 7f9ecf400640 1 --2- 172.21.15.17:0/321930264 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9eb4003970 0x7f9eb4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:29.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.864+0000 7f9ecea00640 1 --2- 172.21.15.17:0/321930264 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ed01441f0 0x7f9eb40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:29.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.865+0000 7f9ecfe00640 1 -- 172.21.15.17:0/321930264 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ed01441f0 msgr2=0x7f9eb40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:29.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.865+0000 7f9ecfe00640 1 --2- 172.21.15.17:0/321930264 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ed01441f0 0x7f9eb40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:29.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.865+0000 7f9ecfe00640 1 -- 172.21.15.17:0/321930264 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9eb4003970 msgr2=0x7f9eb4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:29.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.865+0000 7f9ecfe00640 1 --2- 172.21.15.17:0/321930264 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9eb4003970 0x7f9eb4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:29.862 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.865+0000 7f9ecfe00640 1 -- 172.21.15.17:0/321930264 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb4003520 con 0x7f9eb4004d00 2024-03-12T17:20:29.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.866+0000 7f9ecfe00640 1 --2- 172.21.15.17:0/321930264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9eb4004d00 0x7f9eb4005180 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f9ec800a860 tx=0x7f9eb40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51fe00ccadd63b50 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:29.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.866+0000 7f9ece000640 1 -- 172.21.15.17:0/321930264 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec8034630 con 0x7f9eb4004d00 2024-03-12T17:20:29.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.866+0000 7f9ece000640 1 -- 172.21.15.17:0/321930264 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec802f070 con 0x7f9eb4004d00 2024-03-12T17:20:29.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.866+0000 7f9ece000640 1 -- 172.21.15.17:0/321930264 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec80349f0 con 0x7f9eb4004d00 2024-03-12T17:20:29.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.867+0000 7f9ed5200640 1 -- 172.21.15.17:0/321930264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9eb4004d00 msgr2=0x7f9eb4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:29.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.867+0000 7f9ed5200640 1 --2- 172.21.15.17:0/321930264 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9eb4004d00 0x7f9eb4005180 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f9ec800a860 tx=0x7f9eb40057f0 comp rx=0 tx=0).stop 2024-03-12T17:20:29.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.867+0000 7f9ecfe00640 1 -- 172.21.15.17:0/321930264 reap_dead start 2024-03-12T17:20:29.863 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.867+0000 7f9ed5200640 1 -- 172.21.15.17:0/321930264 shutdown_connections 2024-03-12T17:20:29.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.867+0000 7f9ed5200640 1 -- 172.21.15.17:0/321930264 >> 172.21.15.17:0/321930264 conn(0x7f9ed0069ce0 msgr2=0x7f9ed006a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:29.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.867+0000 7f9ed5200640 1 -- 172.21.15.17:0/321930264 shutdown_connections 2024-03-12T17:20:29.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.867+0000 7f9ed5200640 1 -- 172.21.15.17:0/321930264 wait complete. 2024-03-12T17:20:29.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.869+0000 7f9ed5200640 1 Processor -- start 2024-03-12T17:20:29.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.869+0000 7f9ed5200640 1 -- start start 2024-03-12T17:20:29.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.870+0000 7f9ed5200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9eb4004d00 0x7f9ed00ae540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:29.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.870+0000 7f9ed5200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ed00cb230 0x7f9ed014e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:29.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.870+0000 7f9ed5200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ed01377d0 0x7f9ed0137c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:29.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.870+0000 7f9ed5200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed0138190 con 0x7f9eb4004d00 2024-03-12T17:20:29.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.870+0000 7f9ed5200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed014ea60 con 0x7f9ed01377d0 2024-03-12T17:20:29.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.870+0000 7f9ed5200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed00af470 con 0x7f9ed00cb230 2024-03-12T17:20:29.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.870+0000 7f9ecf400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9eb4004d00 0x7f9ed00ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:29.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.870+0000 7f9ecf400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9eb4004d00 0x7f9ed00ae540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47412/0 (socket says 172.21.15.17:47412) 2024-03-12T17:20:29.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.870+0000 7f9ecf400640 1 -- 172.21.15.17:0/2787431384 learned_addr learned my addr 172.21.15.17:0/2787431384 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:29.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.870+0000 7f9ecf400640 1 -- 172.21.15.17:0/2787431384 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ed00cb230 msgr2=0x7f9ed014e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:29.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.870+0000 7f9ecf400640 1 --2- 172.21.15.17:0/2787431384 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ed00cb230 0x7f9ed014e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:29.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.870+0000 7f9ecf400640 1 -- 172.21.15.17:0/2787431384 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ed01377d0 msgr2=0x7f9ed0137c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:29.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.870+0000 7f9ecfe00640 1 --2- 172.21.15.17:0/2787431384 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ed01377d0 0x7f9ed0137c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:29.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.871+0000 7f9ecf400640 1 --2- 172.21.15.17:0/2787431384 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ed01377d0 0x7f9ed0137c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:29.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.871+0000 7f9ecf400640 1 -- 172.21.15.17:0/2787431384 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed00cb6b0 con 0x7f9eb4004d00 2024-03-12T17:20:29.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.871+0000 7f9ecfe00640 1 --2- 172.21.15.17:0/2787431384 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ed01377d0 0x7f9ed0137c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:29.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.871+0000 7f9ecf400640 1 --2- 172.21.15.17:0/2787431384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9eb4004d00 0x7f9ed00ae540 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f9ec00119a0 tx=0x7f9ec0011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:29.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.871+0000 7f9ec7400640 1 -- 172.21.15.17:0/2787431384 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec000faf0 con 0x7f9eb4004d00 2024-03-12T17:20:29.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.871+0000 7f9ec7400640 1 -- 172.21.15.17:0/2787431384 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec000fc50 con 0x7f9eb4004d00 2024-03-12T17:20:29.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.871+0000 7f9ec7400640 1 -- 172.21.15.17:0/2787431384 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ec0014440 con 0x7f9eb4004d00 2024-03-12T17:20:29.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.871+0000 7f9ed5200640 1 -- 172.21.15.17:0/2787431384 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ed00aebd0 con 0x7f9eb4004d00 2024-03-12T17:20:29.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.871+0000 7f9ed5200640 1 -- 172.21.15.17:0/2787431384 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ed00af190 con 0x7f9eb4004d00 2024-03-12T17:20:29.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.872+0000 7f9ed5200640 1 -- 172.21.15.17:0/2787431384 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ed004e030 con 0x7f9eb4004d00 2024-03-12T17:20:29.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.873+0000 7f9ec7400640 1 -- 172.21.15.17:0/2787431384 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f9ec00145a0 con 0x7f9eb4004d00 2024-03-12T17:20:29.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.874+0000 7f9ec7400640 1 --2- 172.21.15.17:0/2787431384 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f9eb006ac30 0x7f9eb006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:29.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.874+0000 7f9ec7400640 1 -- 172.21.15.17:0/2787431384 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ec0089b10 con 0x7f9eb4004d00 2024-03-12T17:20:29.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.875+0000 7f9ecea00640 1 --2- 172.21.15.17:0/2787431384 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f9eb006ac30 0x7f9eb006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:29.870 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.875+0000 7f9ecea00640 1 --2- 172.21.15.17:0/2787431384 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f9eb006ac30 0x7f9eb006d0f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc006e80 tx=0x7f9ebc006df0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:29.874 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:29.879+0000 7f9ec7400640 1 -- 172.21.15.17:0/2787431384 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f9ec0054d80 con 0x7f9eb4004d00 2024-03-12T17:20:30.073 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.078+0000 7f9ed5200640 1 -- 172.21.15.17:0/2787431384 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ed006c990 con 0x7f9eb4004d00 2024-03-12T17:20:30.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.081+0000 7f9ec7400640 1 -- 172.21.15.17:0/2787431384 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16010 (secure 0 0 0) 0x7f9ec0022020 con 0x7f9eb4004d00 2024-03-12T17:20:30.077 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:20:30.077 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":46,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:20:29.179948+0000","last_up_change":"2024-03-12T17:18:38.144756+0000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-12T17:18:39.552910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-03-12T17:20:26.824841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-03-12T17:20:28.205468+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":37305},{"type":"v1","addr":"172.21.15.17:6801","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":37305},{"type":"v1","addr":"172.21.15.17:6803","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":37305},{"type":"v1","addr":"172.21.15.17:6807","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":37305},{"type":"v1","addr":"172.21.15.17:6805","nonce":37305}]},"public_addr":"172.21.15.17:6801/37305","cluster_addr":"172.21.15.17:6803/37305","heartbeat_back_addr":"172.21.15.17:6807/37305","heartbeat_front_addr":"172.21.15.17:6805/37305","state":["exists","up"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":37307},{"type":"v1","addr":"172.21.15.17:6814","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":37307},{"type":"v1","addr":"172.21.15.17:6818","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":37307},{"type":"v1","addr":"172.21.15.17:6827","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":37307},{"type":"v1","addr":"172.21.15.17:6823","nonce":37307}]},"public_addr":"172.21.15.17:6814/37307","cluster_addr":"172.21.15.17:6818/37307","heartbeat_back_addr":"172.21.15.17:6827/37307","heartbeat_front_addr":"172.21.15.17:6823/37307","state":["exists","up"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":37303},{"type":"v1","addr":"172.21.15.17:6809","nonce":37303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":37303},{"type":"v1","addr":"172.21.15.17:6811","nonce":37303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":37303},{"type":"v1","addr":"172.21.15.17:6819","nonce":37303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":37303},{"type":"v1","addr":"172.21.15.17:6815","nonce":37303}]},"public_addr":"172.21.15.17:6809/37303","cluster_addr":"172.21.15.17:6811/37303","heartbeat_back_addr":"172.21.15.17:6819/37303","heartbeat_front_addr":"172.21.15.17:6815/37303","state":["exists","up"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":37308},{"type":"v1","addr":"172.21.15.17:6822","nonce":37308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":37308},{"type":"v1","addr":"172.21.15.17:6826","nonce":37308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":37308},{"type":"v1","addr":"172.21.15.17:6831","nonce":37308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":37308},{"type":"v1","addr":"172.21.15.17:6829","nonce":37308}]},"public_addr":"172.21.15.17:6822/37308","cluster_addr":"172.21.15.17:6826/37308","heartbeat_back_addr":"172.21.15.17:6831/37308","heartbeat_front_addr":"172.21.15.17:6829/37308","state":["exists","up"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":37465},{"type":"v1","addr":"172.21.15.94:6809","nonce":37465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6811","nonce":37465},{"type":"v1","addr":"172.21.15.94:6813","nonce":37465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6819","nonce":37465},{"type":"v1","addr":"172.21.15.94:6822","nonce":37465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6815","nonce":37465},{"type":"v1","addr":"172.21.15.94:6817","nonce":37465}]},"public_addr":"172.21.15.94:6809/37465","cluster_addr":"172.21.15.94:6813/37465","heartbeat_back_addr":"172.21.15.94:6822/37465","heartbeat_front_addr":"172.21.15.94:6817/37465","state":["exists","up"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":37464},{"type":"v1","addr":"172.21.15.94:6812","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":37464},{"type":"v1","addr":"172.21.15.94:6816","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":37464},{"type":"v1","addr":"172.21.15.94:6823","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":37464},{"type":"v1","addr":"172.21.15.94:6820","nonce":37464}]},"public_addr":"172.21.15.94:6812/37464","cluster_addr":"172.21.15.94:6816/37464","heartbeat_back_addr":"172.21.15.94:6823/37464","heartbeat_front_addr":"172.21.15.94:6820/37464","state":["exists","up"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":37467},{"type":"v1","addr":"172.21.15.94:6825","nonce":37467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":37467},{"type":"v1","addr":"172.21.15.94:6827","nonce":37467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":37467},{"type":"v1","addr":"172.21.15.94:6831","nonce":37467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":37467},{"type":"v1","addr":"172.21.15.94:6829","nonce":37467}]},"public_addr":"172.21.15.94:6825/37467","cluster_addr":"172.21.15.94:6827/37467","heartbeat_back_addr":"172.21.15.94:6831/37467","heartbeat_front_addr":"172.21.15.94:6829/37467","state":["exists","up"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":37466},{"type":"v1","addr":"172.21.15.94:6801","nonce":37466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":37466},{"type":"v1","addr":"172.21.15.94:6803","nonce":37466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":37466},{"type":"v1","addr":"172.21.15.94:6807","nonce":37466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":37466},{"type":"v1","addr":"172.21.15.94:6805","nonce":37466}]},"public_addr":"172.21.15.94:6801/37466","cluster_addr":"172.21.15.94:6803/37466","heartbeat_back_addr":"172.21.15.94:6807/37466","heartbeat_front_addr":"172.21.15.94:6805/37466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.327217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.186966+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.419986+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.150585+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.120621+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.121576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.181257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.293188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:20:30.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.083+0000 7f9ed5200640 1 -- 172.21.15.17:0/2787431384 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f9eb006ac30 msgr2=0x7f9eb006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:30.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.083+0000 7f9ed5200640 1 --2- 172.21.15.17:0/2787431384 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f9eb006ac30 0x7f9eb006d0f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc006e80 tx=0x7f9ebc006df0 comp rx=0 tx=0).stop 2024-03-12T17:20:30.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.084+0000 7f9ed5200640 1 -- 172.21.15.17:0/2787431384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9eb4004d00 msgr2=0x7f9ed00ae540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:30.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.084+0000 7f9ed5200640 1 --2- 172.21.15.17:0/2787431384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9eb4004d00 0x7f9ed00ae540 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f9ec00119a0 tx=0x7f9ec0011e60 comp rx=0 tx=0).stop 2024-03-12T17:20:30.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.084+0000 7f9ed5200640 1 -- 172.21.15.17:0/2787431384 shutdown_connections 2024-03-12T17:20:30.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.084+0000 7f9ed5200640 1 --2- 172.21.15.17:0/2787431384 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f9eb006ac30 0x7f9eb006d0f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:30.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.084+0000 7f9ed5200640 1 --2- 172.21.15.17:0/2787431384 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ed01377d0 0x7f9ed0137c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:30.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.084+0000 7f9ed5200640 1 --2- 172.21.15.17:0/2787431384 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9ed00cb230 0x7f9ed014e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:30.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.084+0000 7f9ed5200640 1 --2- 172.21.15.17:0/2787431384 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9eb4004d00 0x7f9ed00ae540 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:30.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.084+0000 7f9ed5200640 1 -- 172.21.15.17:0/2787431384 >> 172.21.15.17:0/2787431384 conn(0x7f9ed0069ce0 msgr2=0x7f9ed00adb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:30.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.084+0000 7f9ed5200640 1 -- 172.21.15.17:0/2787431384 shutdown_connections 2024-03-12T17:20:30.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.084+0000 7f9ed5200640 1 -- 172.21.15.17:0/2787431384 wait complete. 2024-03-12T17:20:30.099 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-12T17:20:30.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.325+0000 7fac32e00640 1 Processor -- start 2024-03-12T17:20:30.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.325+0000 7fac32e00640 1 -- start start 2024-03-12T17:20:30.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.327+0000 7fac32e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fac2c159260 0x7fac2c06a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:30.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.327+0000 7fac32e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fac2c15d2c0 0x7fac2c071110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:30.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.327+0000 7fac32e00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac2c071650 con 0x7fac2c070cb0 2024-03-12T17:20:30.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.327+0000 7fac32e00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac2c071db0 con 0x7fac2c15d2c0 2024-03-12T17:20:30.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.327+0000 7fac32e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c15db10 con 0x7fac2c159260 2024-03-12T17:20:30.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.328+0000 7fac30e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fac2c15d2c0 0x7fac2c071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:30.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.328+0000 7fac30e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fac2c15d2c0 0x7fac2c071110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47426/0 (socket says 172.21.15.17:47426) 2024-03-12T17:20:30.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.328+0000 7fac30e00640 1 -- 172.21.15.17:0/3502794841 learned_addr learned my addr 172.21.15.17:0/3502794841 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:30.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.328+0000 7fac2be00640 1 --2- 172.21.15.17:0/3502794841 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fac2c159260 0x7fac2c06a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:30.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.328+0000 7fac30e00640 1 -- 172.21.15.17:0/3502794841 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fac2c159260 msgr2=0x7fac2c06a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:30.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.328+0000 7fac30e00640 1 --2- 172.21.15.17:0/3502794841 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fac2c159260 0x7fac2c06a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:30.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.328+0000 7fac30e00640 1 -- 172.21.15.17:0/3502794841 >> v1:172.21.15.17:6789/0 conn(0x7fac2c070cb0 legacy=0x7fac2c15cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:30.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.328+0000 7fac30e00640 1 -- 172.21.15.17:0/3502794841 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac2c15d830 con 0x7fac2c15d2c0 2024-03-12T17:20:30.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.328+0000 7fac2be00640 1 --2- 172.21.15.17:0/3502794841 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fac2c159260 0x7fac2c06a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:30.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.329+0000 7fac30e00640 1 --2- 172.21.15.17:0/3502794841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac2c15d2c0 0x7fac2c071110 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fac24009e50 tx=0x7fac2402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a5740bf235ccda8 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:30.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.330+0000 7fac2aa00640 1 -- 172.21.15.17:0/3502794841 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2402c9f0 con 0x7fac2c15d2c0 2024-03-12T17:20:30.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.330+0000 7fac2aa00640 1 -- 172.21.15.17:0/3502794841 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2402cb50 con 0x7fac2c15d2c0 2024-03-12T17:20:30.325 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.330+0000 7fac2aa00640 1 -- 172.21.15.17:0/3502794841 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac240343f0 con 0x7fac2c15d2c0 2024-03-12T17:20:30.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.330+0000 7fac32e00640 1 -- 172.21.15.17:0/3502794841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac2c15d2c0 msgr2=0x7fac2c071110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:30.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.330+0000 7fac32e00640 1 --2- 172.21.15.17:0/3502794841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac2c15d2c0 0x7fac2c071110 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fac24009e50 tx=0x7fac2402be50 comp rx=0 tx=0).stop 2024-03-12T17:20:30.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.330+0000 7fac32e00640 1 -- 172.21.15.17:0/3502794841 shutdown_connections 2024-03-12T17:20:30.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.330+0000 7fac32e00640 1 --2- 172.21.15.17:0/3502794841 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac2c15d2c0 0x7fac2c071110 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:30.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.330+0000 7fac32e00640 1 --2- 172.21.15.17:0/3502794841 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fac2c159260 0x7fac2c06a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:30.326 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.330+0000 7fac32e00640 1 -- 172.21.15.17:0/3502794841 >> 172.21.15.17:0/3502794841 conn(0x7fac2c0cef40 msgr2=0x7fac2c0cf320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:30.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.331+0000 7fac32e00640 1 -- 172.21.15.17:0/3502794841 shutdown_connections 2024-03-12T17:20:30.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.331+0000 7fac32e00640 1 -- 172.21.15.17:0/3502794841 wait complete. 2024-03-12T17:20:30.327 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.332+0000 7fac32e00640 1 Processor -- start 2024-03-12T17:20:30.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.332+0000 7fac32e00640 1 -- start start 2024-03-12T17:20:30.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.333+0000 7fac32e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac2c070cb0 0x7fac2c155620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:30.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.333+0000 7fac32e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fac2c159260 0x7fac2c13edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:30.329 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.333+0000 7fac32e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac2c15d2c0 0x7fac2c15c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:30.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.333+0000 7fac32e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c13c370 con 0x7fac2c070cb0 2024-03-12T17:20:30.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.333+0000 7fac32e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c15c970 con 0x7fac2c15d2c0 2024-03-12T17:20:30.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.333+0000 7fac32e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c13c580 con 0x7fac2c159260 2024-03-12T17:20:30.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.334+0000 7fac2be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac2c070cb0 0x7fac2c155620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:30.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.334+0000 7fac2be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac2c070cb0 0x7fac2c155620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47432/0 (socket says 172.21.15.17:47432) 2024-03-12T17:20:30.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.334+0000 7fac2be00640 1 -- 172.21.15.17:0/847147723 learned_addr learned my addr 172.21.15.17:0/847147723 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:30.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.334+0000 7fac2be00640 1 -- 172.21.15.17:0/847147723 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fac2c159260 msgr2=0x7fac2c13edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:30.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.334+0000 7fac2be00640 1 --2- 172.21.15.17:0/847147723 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fac2c159260 0x7fac2c13edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:30.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.334+0000 7fac2be00640 1 -- 172.21.15.17:0/847147723 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac2c15d2c0 msgr2=0x7fac2c15c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:30.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.334+0000 7fac2be00640 1 --2- 172.21.15.17:0/847147723 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac2c15d2c0 0x7fac2c15c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:30.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.334+0000 7fac2be00640 1 -- 172.21.15.17:0/847147723 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac24009b30 con 0x7fac2c070cb0 2024-03-12T17:20:30.330 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.334+0000 7fac2be00640 1 --2- 172.21.15.17:0/847147723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac2c070cb0 0x7fac2c155620 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fac1c00c7f0 tx=0x7fac1c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:30.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.335+0000 7fac23e00640 1 -- 172.21.15.17:0/847147723 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c007a30 con 0x7fac2c070cb0 2024-03-12T17:20:30.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.335+0000 7fac23e00640 1 -- 172.21.15.17:0/847147723 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1c007b90 con 0x7fac2c070cb0 2024-03-12T17:20:30.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.335+0000 7fac23e00640 1 -- 172.21.15.17:0/847147723 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c00ce40 con 0x7fac2c070cb0 2024-03-12T17:20:30.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.335+0000 7fac32e00640 1 -- 172.21.15.17:0/847147723 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac2c13c860 con 0x7fac2c070cb0 2024-03-12T17:20:30.331 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.335+0000 7fac32e00640 1 -- 172.21.15.17:0/847147723 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac2c13ce20 con 0x7fac2c070cb0 2024-03-12T17:20:30.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.336+0000 7fac32e00640 1 -- 172.21.15.17:0/847147723 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac2c13d040 con 0x7fac2c070cb0 2024-03-12T17:20:30.332 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.337+0000 7fac23e00640 1 -- 172.21.15.17:0/847147723 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fac1c0113f0 con 0x7fac2c070cb0 2024-03-12T17:20:30.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.338+0000 7fac23e00640 1 --2- 172.21.15.17:0/847147723 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fac0c06ac00 0x7fac0c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:30.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.338+0000 7fac23e00640 1 -- 172.21.15.17:0/847147723 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fac1c0895d0 con 0x7fac2c070cb0 2024-03-12T17:20:30.333 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.338+0000 7fac2b400640 1 --2- 172.21.15.17:0/847147723 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fac0c06ac00 0x7fac0c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:30.334 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.339+0000 7fac2b400640 1 --2- 172.21.15.17:0/847147723 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fac0c06ac00 0x7fac0c06d0c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fac18000f60 tx=0x7fac180079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:30.337 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.342+0000 7fac23e00640 1 -- 172.21.15.17:0/847147723 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fac1c054710 con 0x7fac2c070cb0 2024-03-12T17:20:30.581 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:30.586+0000 7fac32e00640 1 -- 172.21.15.17:0/847147723 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fac2c0736c0 con 0x7fac2c070cb0 2024-03-12T17:20:31.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.199+0000 7fac23e00640 1 -- 172.21.15.17:0/847147723 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v21) v1 ==== 118+0+0 (secure 0 0 0) 0x7fac1c057d30 con 0x7fac2c070cb0 2024-03-12T17:20:31.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.203+0000 7fac32e00640 1 -- 172.21.15.17:0/847147723 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fac0c06ac00 msgr2=0x7fac0c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:31.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.203+0000 7fac32e00640 1 --2- 172.21.15.17:0/847147723 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fac0c06ac00 0x7fac0c06d0c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fac18000f60 tx=0x7fac180079b0 comp rx=0 tx=0).stop 2024-03-12T17:20:31.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.203+0000 7fac32e00640 1 -- 172.21.15.17:0/847147723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac2c070cb0 msgr2=0x7fac2c155620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:31.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.203+0000 7fac32e00640 1 --2- 172.21.15.17:0/847147723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac2c070cb0 0x7fac2c155620 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fac1c00c7f0 tx=0x7fac1c00cbf0 comp rx=0 tx=0).stop 2024-03-12T17:20:31.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.203+0000 7fac32e00640 1 -- 172.21.15.17:0/847147723 shutdown_connections 2024-03-12T17:20:31.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.203+0000 7fac32e00640 1 --2- 172.21.15.17:0/847147723 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fac0c06ac00 0x7fac0c06d0c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:31.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.203+0000 7fac32e00640 1 --2- 172.21.15.17:0/847147723 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fac2c15d2c0 0x7fac2c15c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:31.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.203+0000 7fac32e00640 1 --2- 172.21.15.17:0/847147723 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fac2c159260 0x7fac2c13edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:31.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.203+0000 7fac32e00640 1 --2- 172.21.15.17:0/847147723 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fac2c070cb0 0x7fac2c155620 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:31.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.203+0000 7fac32e00640 1 -- 172.21.15.17:0/847147723 >> 172.21.15.17:0/847147723 conn(0x7fac2c0cef40 msgr2=0x7fac2c158270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:31.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.203+0000 7fac32e00640 1 -- 172.21.15.17:0/847147723 shutdown_connections 2024-03-12T17:20:31.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.203+0000 7fac32e00640 1 -- 172.21.15.17:0/847147723 wait complete. 2024-03-12T17:20:31.220 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-12T17:20:31.220 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-12T17:20:31.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.452+0000 7f16e3200640 1 Processor -- start 2024-03-12T17:20:31.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.452+0000 7f16e3200640 1 -- start start 2024-03-12T17:20:31.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.453+0000 7f16e3200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f16e415ce80 0x7f16e40cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:31.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.453+0000 7f16e3200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16e4161650 con 0x7f16e415caa0 2024-03-12T17:20:31.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.453+0000 7f16e3200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16e4161090 con 0x7f16e40b85f0 2024-03-12T17:20:31.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.453+0000 7f16e3200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16e4160ea0 con 0x7f16e415ce80 2024-03-12T17:20:31.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.453+0000 7f16e1e00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f16e415caa0 0x7f16e4160790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:56722/0 (socket says 172.21.15.17:56722) 2024-03-12T17:20:31.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.454+0000 7f16e1e00640 1 -- 172.21.15.17:0/765316104 learned_addr learned my addr 172.21.15.17:0/765316104 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:20:31.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.454+0000 7f16d9400640 1 --2- 172.21.15.17:0/765316104 >> v2:172.21.15.17:3300/0 conn(0x7f16e415ce80 0x7f16e40cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:31.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.454+0000 7f16d9400640 1 -- 172.21.15.17:0/765316104 >> v1:172.21.15.94:6789/0 conn(0x7f16e40b85f0 legacy=0x7f16e40d12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:31.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.454+0000 7f16d9400640 1 -- 172.21.15.17:0/765316104 >> v1:172.21.15.17:6789/0 conn(0x7f16e415caa0 legacy=0x7f16e4160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:31.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.454+0000 7f16d9400640 1 -- 172.21.15.17:0/765316104 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e4161370 con 0x7f16e415ce80 2024-03-12T17:20:31.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.455+0000 7f16d9400640 1 --2- 172.21.15.17:0/765316104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16e415ce80 0x7f16e40cf330 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f16cc0097a0 tx=0x7f16cc02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95b803c1f11fc132 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:31.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.456+0000 7f16e1400640 1 -- 172.21.15.17:0/765316104 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc030610 con 0x7f16e415ce80 2024-03-12T17:20:31.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.456+0000 7f16e1400640 1 -- 172.21.15.17:0/765316104 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16cc030770 con 0x7f16e415ce80 2024-03-12T17:20:31.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.456+0000 7f16e1400640 1 -- 172.21.15.17:0/765316104 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc030b00 con 0x7f16e415ce80 2024-03-12T17:20:31.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.456+0000 7f16e3200640 1 -- 172.21.15.17:0/765316104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16e415ce80 msgr2=0x7f16e40cf330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:31.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.456+0000 7f16e3200640 1 --2- 172.21.15.17:0/765316104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16e415ce80 0x7f16e40cf330 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f16cc0097a0 tx=0x7f16cc02b960 comp rx=0 tx=0).stop 2024-03-12T17:20:31.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.456+0000 7f16e3200640 1 -- 172.21.15.17:0/765316104 shutdown_connections 2024-03-12T17:20:31.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.456+0000 7f16e3200640 1 --2- 172.21.15.17:0/765316104 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16e415ce80 0x7f16e40cf330 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:31.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.456+0000 7f16e3200640 1 -- 172.21.15.17:0/765316104 >> 172.21.15.17:0/765316104 conn(0x7f16e406b160 msgr2=0x7f16e406b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:31.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.457+0000 7f16e3200640 1 -- 172.21.15.17:0/765316104 shutdown_connections 2024-03-12T17:20:31.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.457+0000 7f16e3200640 1 -- 172.21.15.17:0/765316104 wait complete. 2024-03-12T17:20:31.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.458+0000 7f16e3200640 1 Processor -- start 2024-03-12T17:20:31.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.459+0000 7f16e3200640 1 -- start start 2024-03-12T17:20:31.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.459+0000 7f16e3200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16e40b85f0 0x7f16e40b2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:31.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.459+0000 7f16e3200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f16e415caa0 0x7f16e414b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:31.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.460+0000 7f16e3200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16e415ce80 0x7f16e414b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:31.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.460+0000 7f16e3200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e40ca240 con 0x7f16e415ce80 2024-03-12T17:20:31.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.460+0000 7f16e3200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e40c8680 con 0x7f16e40b85f0 2024-03-12T17:20:31.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.460+0000 7f16e3200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e40cca90 con 0x7f16e415caa0 2024-03-12T17:20:31.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.460+0000 7f16e2800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16e415ce80 0x7f16e414b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:31.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.460+0000 7f16e2800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16e415ce80 0x7f16e414b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:47456/0 (socket says 172.21.15.17:47456) 2024-03-12T17:20:31.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.460+0000 7f16e2800640 1 -- 172.21.15.17:0/1692033153 learned_addr learned my addr 172.21.15.17:0/1692033153 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:31.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.460+0000 7f16d9400640 1 --2- 172.21.15.17:0/1692033153 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f16e415caa0 0x7f16e414b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:31.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.460+0000 7f16e1e00640 1 --2- 172.21.15.17:0/1692033153 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16e40b85f0 0x7f16e40b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:31.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.460+0000 7f16e2800640 1 -- 172.21.15.17:0/1692033153 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f16e415caa0 msgr2=0x7f16e414b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:31.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.460+0000 7f16e2800640 1 --2- 172.21.15.17:0/1692033153 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f16e415caa0 0x7f16e414b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:31.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.460+0000 7f16e2800640 1 -- 172.21.15.17:0/1692033153 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16e40b85f0 msgr2=0x7f16e40b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:31.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.460+0000 7f16e2800640 1 --2- 172.21.15.17:0/1692033153 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16e40b85f0 0x7f16e40b2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:31.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.460+0000 7f16e2800640 1 -- 172.21.15.17:0/1692033153 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16cc009400 con 0x7f16e415ce80 2024-03-12T17:20:31.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.460+0000 7f16e1e00640 1 --2- 172.21.15.17:0/1692033153 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16e40b85f0 0x7f16e40b2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:31.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.461+0000 7f16e2800640 1 --2- 172.21.15.17:0/1692033153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16e415ce80 0x7f16e414b790 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f16dc00c7a0 tx=0x7f16dc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:31.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.461+0000 7f16daa00640 1 -- 172.21.15.17:0/1692033153 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc003b70 con 0x7f16e415ce80 2024-03-12T17:20:31.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.461+0000 7f16daa00640 1 -- 172.21.15.17:0/1692033153 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16dc003cf0 con 0x7f16e415ce80 2024-03-12T17:20:31.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.461+0000 7f16daa00640 1 -- 172.21.15.17:0/1692033153 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc003ea0 con 0x7f16e415ce80 2024-03-12T17:20:31.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.461+0000 7f16e3200640 1 -- 172.21.15.17:0/1692033153 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16e40c9f60 con 0x7f16e415ce80 2024-03-12T17:20:31.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.461+0000 7f16e3200640 1 -- 172.21.15.17:0/1692033153 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e40c8310 con 0x7f16e415ce80 2024-03-12T17:20:31.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.463+0000 7f16e3200640 1 -- 172.21.15.17:0/1692033153 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16e4072360 con 0x7f16e415ce80 2024-03-12T17:20:31.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.463+0000 7f16daa00640 1 -- 172.21.15.17:0/1692033153 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f16dc00aa90 con 0x7f16e415ce80 2024-03-12T17:20:31.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.464+0000 7f16daa00640 1 --2- 172.21.15.17:0/1692033153 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f16c006ac00 0x7f16c006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:31.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.465+0000 7f16daa00640 1 -- 172.21.15.17:0/1692033153 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16dc0892b0 con 0x7f16e415ce80 2024-03-12T17:20:31.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.465+0000 7f16e1e00640 1 --2- 172.21.15.17:0/1692033153 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f16c006ac00 0x7f16c006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:31.460 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.465+0000 7f16e1e00640 1 --2- 172.21.15.17:0/1692033153 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f16c006ac00 0x7f16c006d0c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f16d4005880 tx=0x7f16d4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:31.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.469+0000 7f16daa00640 1 -- 172.21.15.17:0/1692033153 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f16dc0543f0 con 0x7f16e415ce80 2024-03-12T17:20:31.706 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:31.710+0000 7f16e3200640 1 -- 172.21.15.17:0/1692033153 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f16e404e030 con 0x7f16e415ce80 2024-03-12T17:20:32.400 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.405+0000 7f16daa00640 1 -- 172.21.15.17:0/1692033153 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f16dc057a10 con 0x7f16e415ce80 2024-03-12T17:20:32.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.408+0000 7f16e3200640 1 -- 172.21.15.17:0/1692033153 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f16c006ac00 msgr2=0x7f16c006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:32.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.408+0000 7f16e3200640 1 --2- 172.21.15.17:0/1692033153 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f16c006ac00 0x7f16c006d0c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f16d4005880 tx=0x7f16d4009040 comp rx=0 tx=0).stop 2024-03-12T17:20:32.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.408+0000 7f16e3200640 1 -- 172.21.15.17:0/1692033153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16e415ce80 msgr2=0x7f16e414b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:32.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.408+0000 7f16e3200640 1 --2- 172.21.15.17:0/1692033153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16e415ce80 0x7f16e414b790 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f16dc00c7a0 tx=0x7f16dc00cc60 comp rx=0 tx=0).stop 2024-03-12T17:20:32.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.409+0000 7f16e3200640 1 -- 172.21.15.17:0/1692033153 shutdown_connections 2024-03-12T17:20:32.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.409+0000 7f16e3200640 1 --2- 172.21.15.17:0/1692033153 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f16c006ac00 0x7f16c006d0c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:32.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.409+0000 7f16e3200640 1 --2- 172.21.15.17:0/1692033153 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f16e415ce80 0x7f16e414b790 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:32.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.409+0000 7f16e3200640 1 --2- 172.21.15.17:0/1692033153 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f16e415caa0 0x7f16e414b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:32.404 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.409+0000 7f16e3200640 1 --2- 172.21.15.17:0/1692033153 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f16e40b85f0 0x7f16e40b2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:32.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.409+0000 7f16e3200640 1 -- 172.21.15.17:0/1692033153 >> 172.21.15.17:0/1692033153 conn(0x7f16e406b160 msgr2=0x7f16e415f970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:32.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.409+0000 7f16e3200640 1 -- 172.21.15.17:0/1692033153 shutdown_connections 2024-03-12T17:20:32.405 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.409+0000 7f16e3200640 1 -- 172.21.15.17:0/1692033153 wait complete. 2024-03-12T17:20:32.424 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-12T17:20:32.424 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-12T17:20:32.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.650+0000 7f1835c00640 1 Processor -- start 2024-03-12T17:20:32.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.651+0000 7f1835c00640 1 -- start start 2024-03-12T17:20:32.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.652+0000 7f1835c00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1830144240 0x7f18300ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:32.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.652+0000 7f1835c00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18300ce320 con 0x7f18300cecf0 2024-03-12T17:20:32.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.652+0000 7f1835c00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1830144620 con 0x7f18300cb970 2024-03-12T17:20:32.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.652+0000 7f1835c00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f183015f3d0 con 0x7f1830144240 2024-03-12T17:20:32.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.653+0000 7f182e000640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f18300cecf0 0x7f18300b2070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:43398/0 (socket says 172.21.15.17:43398) 2024-03-12T17:20:32.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.653+0000 7f182e000640 1 -- 172.21.15.17:0/2746011550 learned_addr learned my addr 172.21.15.17:0/2746011550 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:20:32.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.653+0000 7f182ea00640 1 --2- 172.21.15.17:0/2746011550 >> v2:172.21.15.94:3300/0 conn(0x7f1830144240 0x7f18300ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:32.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.654+0000 7f182d600640 1 -- 172.21.15.17:0/2746011550 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 420709186 0 0) 0x7f18300ce320 con 0x7f18300cecf0 2024-03-12T17:20:32.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.654+0000 7f182d600640 1 -- 172.21.15.17:0/2746011550 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1814003520 con 0x7f18300cecf0 2024-03-12T17:20:32.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.654+0000 7f182d600640 1 -- 172.21.15.17:0/2746011550 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1155866481 0 0) 0x7f1830144620 con 0x7f18300cb970 2024-03-12T17:20:32.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.654+0000 7f182d600640 1 -- 172.21.15.17:0/2746011550 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18300ce320 con 0x7f18300cb970 2024-03-12T17:20:32.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.654+0000 7f182ea00640 1 -- 172.21.15.17:0/2746011550 >> v1:172.21.15.94:6789/0 conn(0x7f18300cb970 legacy=0x7f183015e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:32.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.654+0000 7f182ea00640 1 -- 172.21.15.17:0/2746011550 >> v1:172.21.15.17:6789/0 conn(0x7f18300cecf0 legacy=0x7f18300b2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:32.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.654+0000 7f182d600640 1 -- 172.21.15.17:0/2746011550 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3763036480 0 0) 0x7f1814003520 con 0x7f18300cecf0 2024-03-12T17:20:32.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.654+0000 7f182ea00640 1 -- 172.21.15.17:0/2746011550 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18300cd9f0 con 0x7f1830144240 2024-03-12T17:20:32.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.656+0000 7f182ea00640 1 --2- 172.21.15.17:0/2746011550 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1830144240 0x7f18300ce7b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f18200097a0 tx=0x7f182002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cac14fd587e3607 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:32.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.656+0000 7f182d600640 1 -- 172.21.15.17:0/2746011550 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182002f050 con 0x7f1830144240 2024-03-12T17:20:32.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.656+0000 7f182d600640 1 -- 172.21.15.17:0/2746011550 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1820031500 con 0x7f1830144240 2024-03-12T17:20:32.651 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.656+0000 7f182d600640 1 -- 172.21.15.17:0/2746011550 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c001670 con 0x7f1830144240 2024-03-12T17:20:32.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.656+0000 7f1835c00640 1 -- 172.21.15.17:0/2746011550 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1830144240 msgr2=0x7f18300ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:32.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.656+0000 7f1835c00640 1 --2- 172.21.15.17:0/2746011550 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1830144240 0x7f18300ce7b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f18200097a0 tx=0x7f182002b820 comp rx=0 tx=0).stop 2024-03-12T17:20:32.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.657+0000 7f1835c00640 1 -- 172.21.15.17:0/2746011550 shutdown_connections 2024-03-12T17:20:32.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.657+0000 7f1835c00640 1 --2- 172.21.15.17:0/2746011550 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1830144240 0x7f18300ce7b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:32.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.657+0000 7f1835c00640 1 -- 172.21.15.17:0/2746011550 >> 172.21.15.17:0/2746011550 conn(0x7f1830069ce0 msgr2=0x7f183006a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:32.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.657+0000 7f1835c00640 1 -- 172.21.15.17:0/2746011550 shutdown_connections 2024-03-12T17:20:32.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.657+0000 7f1835c00640 1 -- 172.21.15.17:0/2746011550 wait complete. 2024-03-12T17:20:32.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.658+0000 7f1835c00640 1 Processor -- start 2024-03-12T17:20:32.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.659+0000 7f1835c00640 1 -- start start 2024-03-12T17:20:32.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.659+0000 7f1835c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18300cb970 0x7f18301402d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:32.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.659+0000 7f1835c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18300cecf0 0x7f18300b2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:32.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.659+0000 7f1835c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1830144240 0x7f1830159bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:32.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.659+0000 7f1835c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183006d240 con 0x7f18300cb970 2024-03-12T17:20:32.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.659+0000 7f1835c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18301f6650 con 0x7f1830144240 2024-03-12T17:20:32.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.659+0000 7f1835c00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f183006c910 con 0x7f18300cecf0 2024-03-12T17:20:32.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.660+0000 7f182ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18300cb970 0x7f18301402d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:32.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.660+0000 7f182ea00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18300cb970 0x7f18301402d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58646/0 (socket says 172.21.15.17:58646) 2024-03-12T17:20:32.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.660+0000 7f182ea00640 1 -- 172.21.15.17:0/1931333929 learned_addr learned my addr 172.21.15.17:0/1931333929 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:32.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.660+0000 7f182e000640 1 --2- 172.21.15.17:0/1931333929 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18300cecf0 0x7f18300b2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:32.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.660+0000 7f182f400640 1 --2- 172.21.15.17:0/1931333929 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1830144240 0x7f1830159bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:32.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.660+0000 7f182ea00640 1 -- 172.21.15.17:0/1931333929 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18300cecf0 msgr2=0x7f18300b2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:32.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.660+0000 7f182ea00640 1 --2- 172.21.15.17:0/1931333929 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18300cecf0 0x7f18300b2e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:32.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.660+0000 7f182ea00640 1 -- 172.21.15.17:0/1931333929 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1830144240 msgr2=0x7f1830159bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:32.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.660+0000 7f182ea00640 1 --2- 172.21.15.17:0/1931333929 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1830144240 0x7f1830159bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:32.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.660+0000 7f182ea00640 1 -- 172.21.15.17:0/1931333929 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1820009400 con 0x7f18300cb970 2024-03-12T17:20:32.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.660+0000 7f182f400640 1 --2- 172.21.15.17:0/1931333929 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1830144240 0x7f1830159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:32.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.661+0000 7f182ea00640 1 --2- 172.21.15.17:0/1931333929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18300cb970 0x7f18301402d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f1820036040 tx=0x7f18200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:32.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.661+0000 7f1826a00640 1 -- 172.21.15.17:0/1931333929 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182003c8d0 con 0x7f18300cb970 2024-03-12T17:20:32.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.661+0000 7f1826a00640 1 -- 172.21.15.17:0/1931333929 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f182003ca30 con 0x7f18300cb970 2024-03-12T17:20:32.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.661+0000 7f1835c00640 1 -- 172.21.15.17:0/1931333929 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f183006cbf0 con 0x7f18300cb970 2024-03-12T17:20:32.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.661+0000 7f1826a00640 1 -- 172.21.15.17:0/1931333929 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182003cdc0 con 0x7f18300cb970 2024-03-12T17:20:32.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.661+0000 7f1835c00640 1 -- 172.21.15.17:0/1931333929 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1830140810 con 0x7f18300cb970 2024-03-12T17:20:32.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.662+0000 7f1835c00640 1 -- 172.21.15.17:0/1931333929 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18300736c0 con 0x7f18300cb970 2024-03-12T17:20:32.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.663+0000 7f1826a00640 1 -- 172.21.15.17:0/1931333929 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f182003a040 con 0x7f18300cb970 2024-03-12T17:20:32.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.664+0000 7f1826a00640 1 --2- 172.21.15.17:0/1931333929 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f181006ac00 0x7f181006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:32.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.664+0000 7f1826a00640 1 -- 172.21.15.17:0/1931333929 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f18200aab50 con 0x7f18300cb970 2024-03-12T17:20:32.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.665+0000 7f182e000640 1 --2- 172.21.15.17:0/1931333929 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f181006ac00 0x7f181006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:32.660 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.665+0000 7f182e000640 1 --2- 172.21.15.17:0/1931333929 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f181006ac00 0x7f181006d0c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f183015bf90 tx=0x7f181c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:32.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.669+0000 7f1826a00640 1 -- 172.21.15.17:0/1931333929 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f1820075db0 con 0x7f18300cb970 2024-03-12T17:20:32.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.905+0000 7f1835c00640 1 -- 172.21.15.17:0/1931333929 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18300b2360 con 0x7f18300cb970 2024-03-12T17:20:32.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.907+0000 7f1826a00640 1 -- 172.21.15.17:0/1931333929 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4731 (secure 0 0 0) 0x7f1820038090 con 0x7f18300cb970 2024-03-12T17:20:32.902 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:20:32.902 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4808,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6834/3175855266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3175855266},{"type":"v1","addr":"172.21.15.94:6834","nonce":3175855266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":4927,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/1725537585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1725537585},{"type":"v1","addr":"172.21.15.17:6835","nonce":1725537585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":4939,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/630541950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6833","nonce":630541950},{"type":"v1","addr":"172.21.15.94:6835","nonce":630541950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T17:20:29.180386+0000","modified":"2024-03-12T17:20:32.399146+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5433":{"gid":5433,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6837/2711965846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":2711965846},{"type":"v1","addr":"172.21.15.17:6837","nonce":2711965846}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-03-12T17:20:32.906 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 22 2024-03-12T17:20:32.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.909+0000 7f1835c00640 1 -- 172.21.15.17:0/1931333929 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f181006ac00 msgr2=0x7f181006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:32.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.909+0000 7f1835c00640 1 --2- 172.21.15.17:0/1931333929 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f181006ac00 0x7f181006d0c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f183015bf90 tx=0x7f181c009040 comp rx=0 tx=0).stop 2024-03-12T17:20:32.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.909+0000 7f1835c00640 1 -- 172.21.15.17:0/1931333929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18300cb970 msgr2=0x7f18301402d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:32.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.909+0000 7f1835c00640 1 --2- 172.21.15.17:0/1931333929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18300cb970 0x7f18301402d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f1820036040 tx=0x7f18200046c0 comp rx=0 tx=0).stop 2024-03-12T17:20:32.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.909+0000 7f1835c00640 1 -- 172.21.15.17:0/1931333929 shutdown_connections 2024-03-12T17:20:32.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.909+0000 7f1835c00640 1 --2- 172.21.15.17:0/1931333929 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f181006ac00 0x7f181006d0c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:32.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.909+0000 7f1835c00640 1 --2- 172.21.15.17:0/1931333929 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1830144240 0x7f1830159bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:32.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.909+0000 7f1835c00640 1 --2- 172.21.15.17:0/1931333929 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f18300cecf0 0x7f18300b2e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:32.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.909+0000 7f1835c00640 1 --2- 172.21.15.17:0/1931333929 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f18300cb970 0x7f18301402d0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:32.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.909+0000 7f1835c00640 1 -- 172.21.15.17:0/1931333929 >> 172.21.15.17:0/1931333929 conn(0x7f1830069ce0 msgr2=0x7f183013f190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:32.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.909+0000 7f1835c00640 1 -- 172.21.15.17:0/1931333929 shutdown_connections 2024-03-12T17:20:32.907 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:32.910+0000 7f1835c00640 1 -- 172.21.15.17:0/1931333929 wait complete. 2024-03-12T17:20:32.925 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T17:20:33.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.145+0000 7f70a0e00640 1 Processor -- start 2024-03-12T17:20:33.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.145+0000 7f70a0e00640 1 -- start start 2024-03-12T17:20:33.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.147+0000 7f70a0e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f709c15ae20 0x7f709c06d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:33.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.147+0000 7f70a0e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f709c0b3b70 0x7f709c0b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:33.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.147+0000 7f70a0e00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f709c0a7660 con 0x7f709c1441f0 2024-03-12T17:20:33.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.147+0000 7f70a0e00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f709c15e460 con 0x7f709c15ae20 2024-03-12T17:20:33.142 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.147+0000 7f70a0e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f709c0b44e0 con 0x7f709c0b3b70 2024-03-12T17:20:33.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.147+0000 7f7093e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f709c15ae20 0x7f709c06d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:33.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.147+0000 7f709be00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f709c0b3b70 0x7f709c0b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:33.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.147+0000 7f7093e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f709c15ae20 0x7f709c06d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.17:38066/0 (socket says 172.21.15.17:38066) 2024-03-12T17:20:33.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.147+0000 7f7093e00640 1 -- 172.21.15.17:0/1308395268 learned_addr learned my addr 172.21.15.17:0/1308395268 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:33.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.148+0000 7f7093e00640 1 -- 172.21.15.17:0/1308395268 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f709c0b3b70 msgr2=0x7f709c0b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:33.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.148+0000 7f7093e00640 1 --2- 172.21.15.17:0/1308395268 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f709c0b3b70 0x7f709c0b3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:33.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.148+0000 7f7093e00640 1 -- 172.21.15.17:0/1308395268 >> v1:172.21.15.94:6789/0 conn(0x7f709c1441f0 legacy=0x7f709c070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:33.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.148+0000 7f7093e00640 1 -- 172.21.15.17:0/1308395268 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f709c1445d0 con 0x7f709c15ae20 2024-03-12T17:20:33.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.149+0000 7f7093e00640 1 --2- 172.21.15.17:0/1308395268 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f709c15ae20 0x7f709c06d130 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7084009870 tx=0x7f708402ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b12221f5ab5c217 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:33.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.150+0000 7f709aa00640 1 -- 172.21.15.17:0/1308395268 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708402f830 con 0x7f709c15ae20 2024-03-12T17:20:33.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.150+0000 7f709aa00640 1 -- 172.21.15.17:0/1308395268 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708402f990 con 0x7f709c15ae20 2024-03-12T17:20:33.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.150+0000 7f709aa00640 1 -- 172.21.15.17:0/1308395268 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708402fd20 con 0x7f709c15ae20 2024-03-12T17:20:33.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.150+0000 7f70a0e00640 1 -- 172.21.15.17:0/1308395268 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f709c15ae20 msgr2=0x7f709c06d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:33.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.150+0000 7f70a0e00640 1 --2- 172.21.15.17:0/1308395268 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f709c15ae20 0x7f709c06d130 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7084009870 tx=0x7f708402ba10 comp rx=0 tx=0).stop 2024-03-12T17:20:33.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.151+0000 7f70a0e00640 1 -- 172.21.15.17:0/1308395268 shutdown_connections 2024-03-12T17:20:33.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.151+0000 7f70a0e00640 1 --2- 172.21.15.17:0/1308395268 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f709c0b3b70 0x7f709c0b3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:33.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.151+0000 7f70a0e00640 1 --2- 172.21.15.17:0/1308395268 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f709c15ae20 0x7f709c06d130 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:33.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.151+0000 7f70a0e00640 1 -- 172.21.15.17:0/1308395268 >> 172.21.15.17:0/1308395268 conn(0x7f709c069ce0 msgr2=0x7f709c06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:33.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.151+0000 7f70a0e00640 1 -- 172.21.15.17:0/1308395268 shutdown_connections 2024-03-12T17:20:33.147 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.151+0000 7f70a0e00640 1 -- 172.21.15.17:0/1308395268 wait complete. 2024-03-12T17:20:33.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.153+0000 7f70a0e00640 1 Processor -- start 2024-03-12T17:20:33.148 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.153+0000 7f70a0e00640 1 -- start start 2024-03-12T17:20:33.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.154+0000 7f70a0e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f709c0b3b70 0x7f709c158330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:33.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.154+0000 7f70a0e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f709c1441f0 0x7f709c141490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:33.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.154+0000 7f70a0e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f709c15ae20 0x7f709c1e6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:33.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.154+0000 7f70a0e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c12cf40 con 0x7f709c0b3b70 2024-03-12T17:20:33.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.154+0000 7f70a0e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c1426a0 con 0x7f709c15ae20 2024-03-12T17:20:33.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.154+0000 7f70a0e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f709c158870 con 0x7f709c1441f0 2024-03-12T17:20:33.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.155+0000 7f709b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f709c0b3b70 0x7f709c158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:33.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.155+0000 7f709b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f709c0b3b70 0x7f709c158330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58660/0 (socket says 172.21.15.17:58660) 2024-03-12T17:20:33.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.155+0000 7f709b400640 1 -- 172.21.15.17:0/601277228 learned_addr learned my addr 172.21.15.17:0/601277228 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:33.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.155+0000 7f7093e00640 1 --2- 172.21.15.17:0/601277228 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f709c1441f0 0x7f709c141490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:33.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.155+0000 7f709be00640 1 --2- 172.21.15.17:0/601277228 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f709c15ae20 0x7f709c1e6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:33.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.155+0000 7f709b400640 1 -- 172.21.15.17:0/601277228 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f709c1441f0 msgr2=0x7f709c141490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:33.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.155+0000 7f709b400640 1 --2- 172.21.15.17:0/601277228 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f709c1441f0 0x7f709c141490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:33.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.155+0000 7f709b400640 1 -- 172.21.15.17:0/601277228 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f709c15ae20 msgr2=0x7f709c1e6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:33.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.155+0000 7f709b400640 1 --2- 172.21.15.17:0/601277228 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f709c15ae20 0x7f709c1e6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:33.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.155+0000 7f709b400640 1 -- 172.21.15.17:0/601277228 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70840094d0 con 0x7f709c0b3b70 2024-03-12T17:20:33.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.156+0000 7f709b400640 1 --2- 172.21.15.17:0/601277228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f709c0b3b70 0x7f709c158330 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f708c00c480 tx=0x7f708c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:33.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.156+0000 7f7093400640 1 -- 172.21.15.17:0/601277228 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c0052d0 con 0x7f709c0b3b70 2024-03-12T17:20:33.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.156+0000 7f7093400640 1 -- 172.21.15.17:0/601277228 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708c005430 con 0x7f709c0b3b70 2024-03-12T17:20:33.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.156+0000 7f7093400640 1 -- 172.21.15.17:0/601277228 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c012870 con 0x7f709c0b3b70 2024-03-12T17:20:33.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.156+0000 7f70a0e00640 1 -- 172.21.15.17:0/601277228 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f709c141e00 con 0x7f709c0b3b70 2024-03-12T17:20:33.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.156+0000 7f70a0e00640 1 -- 172.21.15.17:0/601277228 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f709c1423c0 con 0x7f709c0b3b70 2024-03-12T17:20:33.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.157+0000 7f70a0e00640 1 -- 172.21.15.17:0/601277228 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f709c04e030 con 0x7f709c0b3b70 2024-03-12T17:20:33.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.158+0000 7f7093400640 1 -- 172.21.15.17:0/601277228 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f708c0129d0 con 0x7f709c0b3b70 2024-03-12T17:20:33.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.159+0000 7f7093400640 1 --2- 172.21.15.17:0/601277228 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f707806ac00 0x7f707806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:33.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.159+0000 7f7093400640 1 -- 172.21.15.17:0/601277228 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f708c088f70 con 0x7f709c0b3b70 2024-03-12T17:20:33.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.159+0000 7f7093e00640 1 --2- 172.21.15.17:0/601277228 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f707806ac00 0x7f707806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:33.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.160+0000 7f7093e00640 1 --2- 172.21.15.17:0/601277228 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f707806ac00 0x7f707806d0c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7084036000 tx=0x7f7084008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:33.159 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.164+0000 7f7093400640 1 -- 172.21.15.17:0/601277228 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f708c054140 con 0x7f709c0b3b70 2024-03-12T17:20:33.367 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.372+0000 7f70a0e00640 1 -- 172.21.15.17:0/601277228 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f709c12cd10 con 0x7f709c0b3b70 2024-03-12T17:20:33.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.375+0000 7f7093400640 1 -- 172.21.15.17:0/601277228 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+15997 (secure 0 0 0) 0x7f708c057760 con 0x7f709c0b3b70 2024-03-12T17:20:33.370 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:20:33.370 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":47,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:20:30.184616+0000","last_up_change":"2024-03-12T17:18:38.144756+0000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-12T17:18:39.552910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-03-12T17:20:26.824841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-03-12T17:20:28.205468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":37305},{"type":"v1","addr":"172.21.15.17:6801","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":37305},{"type":"v1","addr":"172.21.15.17:6803","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":37305},{"type":"v1","addr":"172.21.15.17:6807","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":37305},{"type":"v1","addr":"172.21.15.17:6805","nonce":37305}]},"public_addr":"172.21.15.17:6801/37305","cluster_addr":"172.21.15.17:6803/37305","heartbeat_back_addr":"172.21.15.17:6807/37305","heartbeat_front_addr":"172.21.15.17:6805/37305","state":["exists","up"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":37307},{"type":"v1","addr":"172.21.15.17:6814","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":37307},{"type":"v1","addr":"172.21.15.17:6818","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":37307},{"type":"v1","addr":"172.21.15.17:6827","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":37307},{"type":"v1","addr":"172.21.15.17:6823","nonce":37307}]},"public_addr":"172.21.15.17:6814/37307","cluster_addr":"172.21.15.17:6818/37307","heartbeat_back_addr":"172.21.15.17:6827/37307","heartbeat_front_addr":"172.21.15.17:6823/37307","state":["exists","up"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":37303},{"type":"v1","addr":"172.21.15.17:6809","nonce":37303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":37303},{"type":"v1","addr":"172.21.15.17:6811","nonce":37303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":37303},{"type":"v1","addr":"172.21.15.17:6819","nonce":37303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":37303},{"type":"v1","addr":"172.21.15.17:6815","nonce":37303}]},"public_addr":"172.21.15.17:6809/37303","cluster_addr":"172.21.15.17:6811/37303","heartbeat_back_addr":"172.21.15.17:6819/37303","heartbeat_front_addr":"172.21.15.17:6815/37303","state":["exists","up"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":37308},{"type":"v1","addr":"172.21.15.17:6822","nonce":37308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":37308},{"type":"v1","addr":"172.21.15.17:6826","nonce":37308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":37308},{"type":"v1","addr":"172.21.15.17:6831","nonce":37308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":37308},{"type":"v1","addr":"172.21.15.17:6829","nonce":37308}]},"public_addr":"172.21.15.17:6822/37308","cluster_addr":"172.21.15.17:6826/37308","heartbeat_back_addr":"172.21.15.17:6831/37308","heartbeat_front_addr":"172.21.15.17:6829/37308","state":["exists","up"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":37465},{"type":"v1","addr":"172.21.15.94:6809","nonce":37465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6811","nonce":37465},{"type":"v1","addr":"172.21.15.94:6813","nonce":37465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6819","nonce":37465},{"type":"v1","addr":"172.21.15.94:6822","nonce":37465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6815","nonce":37465},{"type":"v1","addr":"172.21.15.94:6817","nonce":37465}]},"public_addr":"172.21.15.94:6809/37465","cluster_addr":"172.21.15.94:6813/37465","heartbeat_back_addr":"172.21.15.94:6822/37465","heartbeat_front_addr":"172.21.15.94:6817/37465","state":["exists","up"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":37464},{"type":"v1","addr":"172.21.15.94:6812","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":37464},{"type":"v1","addr":"172.21.15.94:6816","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":37464},{"type":"v1","addr":"172.21.15.94:6823","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":37464},{"type":"v1","addr":"172.21.15.94:6820","nonce":37464}]},"public_addr":"172.21.15.94:6812/37464","cluster_addr":"172.21.15.94:6816/37464","heartbeat_back_addr":"172.21.15.94:6823/37464","heartbeat_front_addr":"172.21.15.94:6820/37464","state":["exists","up"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":37467},{"type":"v1","addr":"172.21.15.94:6825","nonce":37467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":37467},{"type":"v1","addr":"172.21.15.94:6827","nonce":37467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":37467},{"type":"v1","addr":"172.21.15.94:6831","nonce":37467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":37467},{"type":"v1","addr":"172.21.15.94:6829","nonce":37467}]},"public_addr":"172.21.15.94:6825/37467","cluster_addr":"172.21.15.94:6827/37467","heartbeat_back_addr":"172.21.15.94:6831/37467","heartbeat_front_addr":"172.21.15.94:6829/37467","state":["exists","up"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":37466},{"type":"v1","addr":"172.21.15.94:6801","nonce":37466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":37466},{"type":"v1","addr":"172.21.15.94:6803","nonce":37466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":37466},{"type":"v1","addr":"172.21.15.94:6807","nonce":37466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":37466},{"type":"v1","addr":"172.21.15.94:6805","nonce":37466}]},"public_addr":"172.21.15.94:6801/37466","cluster_addr":"172.21.15.94:6803/37466","heartbeat_back_addr":"172.21.15.94:6807/37466","heartbeat_front_addr":"172.21.15.94:6805/37466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.327217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.186966+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.419986+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.150585+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.120621+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.121576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.181257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.293188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:20:33.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.377+0000 7f70a0e00640 1 -- 172.21.15.17:0/601277228 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f707806ac00 msgr2=0x7f707806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:33.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.377+0000 7f70a0e00640 1 --2- 172.21.15.17:0/601277228 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f707806ac00 0x7f707806d0c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7084036000 tx=0x7f7084008030 comp rx=0 tx=0).stop 2024-03-12T17:20:33.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.377+0000 7f70a0e00640 1 -- 172.21.15.17:0/601277228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f709c0b3b70 msgr2=0x7f709c158330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:33.373 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.377+0000 7f70a0e00640 1 --2- 172.21.15.17:0/601277228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f709c0b3b70 0x7f709c158330 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f708c00c480 tx=0x7f708c00c940 comp rx=0 tx=0).stop 2024-03-12T17:20:33.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.378+0000 7f70a0e00640 1 -- 172.21.15.17:0/601277228 shutdown_connections 2024-03-12T17:20:33.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.378+0000 7f70a0e00640 1 --2- 172.21.15.17:0/601277228 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f707806ac00 0x7f707806d0c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:33.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.378+0000 7f70a0e00640 1 --2- 172.21.15.17:0/601277228 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f709c15ae20 0x7f709c1e6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:33.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.378+0000 7f70a0e00640 1 --2- 172.21.15.17:0/601277228 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f709c1441f0 0x7f709c141490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:33.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.378+0000 7f70a0e00640 1 --2- 172.21.15.17:0/601277228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f709c0b3b70 0x7f709c158330 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:33.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.378+0000 7f70a0e00640 1 -- 172.21.15.17:0/601277228 >> 172.21.15.17:0/601277228 conn(0x7f709c069ce0 msgr2=0x7f709c0709e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:33.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.378+0000 7f70a0e00640 1 -- 172.21.15.17:0/601277228 shutdown_connections 2024-03-12T17:20:33.374 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.378+0000 7f70a0e00640 1 -- 172.21.15.17:0/601277228 wait complete. 2024-03-12T17:20:33.393 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-12T17:20:33.393 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-12T17:20:33.608 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.613+0000 7fae82c00640 1 Processor -- start 2024-03-12T17:20:33.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.613+0000 7fae82c00640 1 -- start start 2024-03-12T17:20:33.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.615+0000 7fae82c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae7c0b1860 0x7fae7c0b4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:33.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.615+0000 7fae82c00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fae7c070240 0x7fae7c0706a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:33.610 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.615+0000 7fae82c00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae7c1461a0 con 0x7fae7c145dc0 2024-03-12T17:20:33.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.615+0000 7fae82c00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae7c0b2000 con 0x7fae7c070240 2024-03-12T17:20:33.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.615+0000 7fae82c00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c0b3db0 con 0x7fae7c0b1860 2024-03-12T17:20:33.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.615+0000 7fae81800640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fae7c145dc0 0x7fae7c160ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:43400/0 (socket says 172.21.15.17:43400) 2024-03-12T17:20:33.611 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.615+0000 7fae81800640 1 -- 172.21.15.17:0/1409542690 learned_addr learned my addr 172.21.15.17:0/1409542690 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:20:33.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.616+0000 7fae7be00640 1 -- 172.21.15.17:0/1409542690 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2155296216 0 0) 0x7fae7c1461a0 con 0x7fae7c145dc0 2024-03-12T17:20:33.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.616+0000 7fae80e00640 1 --2- 172.21.15.17:0/1409542690 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae7c0b1860 0x7fae7c0b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:33.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.616+0000 7fae7be00640 1 -- 172.21.15.17:0/1409542690 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae64003520 con 0x7fae7c145dc0 2024-03-12T17:20:33.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.616+0000 7fae82200640 1 --2- 172.21.15.17:0/1409542690 >> v2:172.21.15.94:3300/0 conn(0x7fae7c070240 0x7fae7c0706a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:33.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.616+0000 7fae7be00640 1 -- 172.21.15.17:0/1409542690 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 621490092 0 0) 0x7fae64003520 con 0x7fae7c145dc0 2024-03-12T17:20:33.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.616+0000 7fae7be00640 1 -- 172.21.15.17:0/1409542690 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae7c0b1860 msgr2=0x7fae7c0b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:33.613 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.616+0000 7fae7be00640 1 --2- 172.21.15.17:0/1409542690 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae7c0b1860 0x7fae7c0b4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:33.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.616+0000 7fae7be00640 1 -- 172.21.15.17:0/1409542690 >> v2:172.21.15.94:3300/0 conn(0x7fae7c070240 msgr2=0x7fae7c0706a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:33.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.616+0000 7fae7be00640 1 --2- 172.21.15.17:0/1409542690 >> v2:172.21.15.94:3300/0 conn(0x7fae7c070240 0x7fae7c0706a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:33.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.616+0000 7fae7be00640 1 -- 172.21.15.17:0/1409542690 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7c070be0 con 0x7fae7c145dc0 2024-03-12T17:20:33.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.616+0000 7fae7be00640 1 -- 172.21.15.17:0/1409542690 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7fae70001670 con 0x7fae7c145dc0 2024-03-12T17:20:33.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.616+0000 7fae7be00640 1 -- 172.21.15.17:0/1409542690 >> v1:172.21.15.17:6789/0 conn(0x7fae7c145dc0 legacy=0x7fae7c160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:33.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.616+0000 7fae7be00640 1 --2- 172.21.15.17:0/1409542690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae64003970 0x7fae64003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:33.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.616+0000 7fae7be00640 1 --2- 172.21.15.17:0/1409542690 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae7c0b1860 0x7fae640047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:33.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.616+0000 7fae7be00640 1 --2- 172.21.15.17:0/1409542690 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae64004d00 0x7fae64005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:33.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.616+0000 7fae7be00640 1 -- 172.21.15.17:0/1409542690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c0b2000 con 0x7fae64003970 2024-03-12T17:20:33.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.616+0000 7fae7be00640 1 -- 172.21.15.17:0/1409542690 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c0b3db0 con 0x7fae64004d00 2024-03-12T17:20:33.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.616+0000 7fae7be00640 1 -- 172.21.15.17:0/1409542690 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae6400ba30 con 0x7fae7c0b1860 2024-03-12T17:20:33.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.617+0000 7fae81800640 1 --2- 172.21.15.17:0/1409542690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae64003970 0x7fae64003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:33.614 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.617+0000 7fae81800640 1 -- 172.21.15.17:0/1409542690 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae7c0b1860 msgr2=0x7fae640047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:33.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.617+0000 7fae82200640 1 --2- 172.21.15.17:0/1409542690 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae64004d00 0x7fae64005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:33.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.617+0000 7fae80e00640 1 --2- 172.21.15.17:0/1409542690 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae7c0b1860 0x7fae640047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:33.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.617+0000 7fae81800640 1 --2- 172.21.15.17:0/1409542690 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae7c0b1860 0x7fae640047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:33.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.617+0000 7fae81800640 1 -- 172.21.15.17:0/1409542690 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae64004d00 msgr2=0x7fae64005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:33.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.617+0000 7fae81800640 1 --2- 172.21.15.17:0/1409542690 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae64004d00 0x7fae64005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:33.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.617+0000 7fae81800640 1 -- 172.21.15.17:0/1409542690 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae64003520 con 0x7fae64003970 2024-03-12T17:20:33.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.617+0000 7fae80e00640 1 --2- 172.21.15.17:0/1409542690 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae7c0b1860 0x7fae640047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:33.615 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.618+0000 7fae81800640 1 --2- 172.21.15.17:0/1409542690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae64003970 0x7fae64003d90 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fae7000c270 tx=0x7fae640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f2d2b79c051438 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:33.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.618+0000 7fae7be00640 1 -- 172.21.15.17:0/1409542690 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7002cae0 con 0x7fae64003970 2024-03-12T17:20:33.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.618+0000 7fae7be00640 1 -- 172.21.15.17:0/1409542690 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7002cc40 con 0x7fae64003970 2024-03-12T17:20:33.616 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.618+0000 7fae7be00640 1 -- 172.21.15.17:0/1409542690 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae700058d0 con 0x7fae64003970 2024-03-12T17:20:33.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.619+0000 7fae82c00640 1 -- 172.21.15.17:0/1409542690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae64003970 msgr2=0x7fae64003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:33.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.619+0000 7fae82c00640 1 --2- 172.21.15.17:0/1409542690 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae64003970 0x7fae64003d90 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fae7000c270 tx=0x7fae640057f0 comp rx=0 tx=0).stop 2024-03-12T17:20:33.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.619+0000 7fae82200640 1 -- 172.21.15.17:0/1409542690 reap_dead start 2024-03-12T17:20:33.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.619+0000 7fae82c00640 1 -- 172.21.15.17:0/1409542690 shutdown_connections 2024-03-12T17:20:33.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.619+0000 7fae82c00640 1 -- 172.21.15.17:0/1409542690 >> 172.21.15.17:0/1409542690 conn(0x7fae7c069ce0 msgr2=0x7fae7c06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:33.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.619+0000 7fae82c00640 1 -- 172.21.15.17:0/1409542690 shutdown_connections 2024-03-12T17:20:33.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.619+0000 7fae82c00640 1 -- 172.21.15.17:0/1409542690 wait complete. 2024-03-12T17:20:33.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.621+0000 7fae82c00640 1 Processor -- start 2024-03-12T17:20:33.617 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.621+0000 7fae82c00640 1 -- start start 2024-03-12T17:20:33.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.622+0000 7fae82c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae64003970 0x7fae7c13aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:33.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.622+0000 7fae82c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae7c1efb90 0x7fae7c0b07f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:33.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.622+0000 7fae82c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae7c0b0d30 0x7fae7c14eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:33.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.622+0000 7fae82c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c0b11b0 con 0x7fae64003970 2024-03-12T17:20:33.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.622+0000 7fae82c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c14f880 con 0x7fae7c0b0d30 2024-03-12T17:20:33.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.622+0000 7fae82c00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c13d610 con 0x7fae7c1efb90 2024-03-12T17:20:33.619 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.622+0000 7fae81800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae64003970 0x7fae7c13aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:33.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.622+0000 7fae81800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae64003970 0x7fae7c13aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58680/0 (socket says 172.21.15.17:58680) 2024-03-12T17:20:33.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.622+0000 7fae81800640 1 -- 172.21.15.17:0/3799358615 learned_addr learned my addr 172.21.15.17:0/3799358615 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:33.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.623+0000 7fae81800640 1 -- 172.21.15.17:0/3799358615 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae7c1efb90 msgr2=0x7fae7c0b07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:33.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.623+0000 7fae81800640 1 --2- 172.21.15.17:0/3799358615 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae7c1efb90 0x7fae7c0b07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:33.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.623+0000 7fae81800640 1 -- 172.21.15.17:0/3799358615 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae7c0b0d30 msgr2=0x7fae7c14eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:33.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.623+0000 7fae81800640 1 --2- 172.21.15.17:0/3799358615 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae7c0b0d30 0x7fae7c14eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:33.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.623+0000 7fae81800640 1 -- 172.21.15.17:0/3799358615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7c13cce0 con 0x7fae64003970 2024-03-12T17:20:33.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.623+0000 7fae81800640 1 --2- 172.21.15.17:0/3799358615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae64003970 0x7fae7c13aff0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fae7000c210 tx=0x7fae70001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:33.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.623+0000 7fae79600640 1 -- 172.21.15.17:0/3799358615 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae70039070 con 0x7fae64003970 2024-03-12T17:20:33.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.623+0000 7fae79600640 1 -- 172.21.15.17:0/3799358615 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae70001630 con 0x7fae64003970 2024-03-12T17:20:33.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.623+0000 7fae82c00640 1 -- 172.21.15.17:0/3799358615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae7c13cfc0 con 0x7fae64003970 2024-03-12T17:20:33.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.623+0000 7fae79600640 1 -- 172.21.15.17:0/3799358615 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7003c040 con 0x7fae64003970 2024-03-12T17:20:33.620 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.624+0000 7fae82c00640 1 -- 172.21.15.17:0/3799358615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae7c13b530 con 0x7fae64003970 2024-03-12T17:20:33.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.625+0000 7fae82c00640 1 -- 172.21.15.17:0/3799358615 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae7c145530 con 0x7fae64003970 2024-03-12T17:20:33.621 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.626+0000 7fae79600640 1 -- 172.21.15.17:0/3799358615 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fae70032070 con 0x7fae64003970 2024-03-12T17:20:33.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.627+0000 7fae79600640 1 --2- 172.21.15.17:0/3799358615 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fae5c06ac30 0x7fae5c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:33.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.627+0000 7fae79600640 1 -- 172.21.15.17:0/3799358615 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fae700aa8b0 con 0x7fae64003970 2024-03-12T17:20:33.622 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.627+0000 7fae80e00640 1 --2- 172.21.15.17:0/3799358615 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fae5c06ac30 0x7fae5c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:33.623 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.628+0000 7fae80e00640 1 --2- 172.21.15.17:0/3799358615 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fae5c06ac30 0x7fae5c06d0f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fae7c15ea90 tx=0x7fae68009350 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:33.626 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.631+0000 7fae79600640 1 -- 172.21.15.17:0/3799358615 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fae70075ac0 con 0x7fae64003970 2024-03-12T17:20:33.645 INFO:tasks.ceph.mds.c.smithi017.stderr:2024-03-12T17:20:33.650+0000 7fb7d4800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-12T17:20:33.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.825+0000 7fae82c00640 1 -- 172.21.15.17:0/3799358615 --> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fae7c0b34c0 con 0x7fae5c06ac30 2024-03-12T17:20:33.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.839+0000 7fae79600640 1 -- 172.21.15.17:0/3799358615 <== mgr.4104 v2:172.21.15.17:6832/37052 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276450 (secure 0 0 0) 0x7fae6800e510 con 0x7fae5c06ac30 2024-03-12T17:20:33.838 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:20:33.840 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-03-12T17:20:33.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.846+0000 7fae82c00640 1 -- 172.21.15.17:0/3799358615 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fae5c06ac30 msgr2=0x7fae5c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:33.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.846+0000 7fae82c00640 1 --2- 172.21.15.17:0/3799358615 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fae5c06ac30 0x7fae5c06d0f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fae7c15ea90 tx=0x7fae68009350 comp rx=0 tx=0).stop 2024-03-12T17:20:33.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.846+0000 7fae82c00640 1 -- 172.21.15.17:0/3799358615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae64003970 msgr2=0x7fae7c13aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:33.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.846+0000 7fae82c00640 1 --2- 172.21.15.17:0/3799358615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae64003970 0x7fae7c13aff0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fae7000c210 tx=0x7fae70001a00 comp rx=0 tx=0).stop 2024-03-12T17:20:33.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.846+0000 7fae82c00640 1 -- 172.21.15.17:0/3799358615 shutdown_connections 2024-03-12T17:20:33.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.846+0000 7fae82c00640 1 --2- 172.21.15.17:0/3799358615 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fae5c06ac30 0x7fae5c06d0f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:33.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.846+0000 7fae82c00640 1 --2- 172.21.15.17:0/3799358615 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fae7c0b0d30 0x7fae7c14eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:33.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.846+0000 7fae82c00640 1 --2- 172.21.15.17:0/3799358615 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fae7c1efb90 0x7fae7c0b07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:33.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.846+0000 7fae82c00640 1 --2- 172.21.15.17:0/3799358615 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fae64003970 0x7fae7c13aff0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:33.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.846+0000 7fae82c00640 1 -- 172.21.15.17:0/3799358615 >> 172.21.15.17:0/3799358615 conn(0x7fae7c069ce0 msgr2=0x7fae7c140db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:33.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.846+0000 7fae82c00640 1 -- 172.21.15.17:0/3799358615 shutdown_connections 2024-03-12T17:20:33.842 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:33.846+0000 7fae82c00640 1 -- 172.21.15.17:0/3799358615 wait complete. 2024-03-12T17:20:33.860 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2024-03-12T17:20:33.513258+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":254108,"kb_used_data":5168,"kb_used_omap":13,"kb_used_meta":248818,"kb_avail":754720612,"statfs":{"total":773094113280,"available":772833906688,"internally_reserved":0,"allocated":5292032,"data_stored":2814950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":254789720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.835104"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.686610+0000","last_change":"2024-03-12T17:20:27.686610+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.686610+0000","last_undegraded":"2024-03-12T17:20:27.686610+0000","last_fullsized":"2024-03-12T17:20:27.686610+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:42:22.845646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.694409+0000","last_change":"2024-03-12T17:20:27.694409+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.694409+0000","last_undegraded":"2024-03-12T17:20:27.694409+0000","last_fullsized":"2024-03-12T17:20:27.694409+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:19:01.645685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.688814+0000","last_change":"2024-03-12T17:20:27.688814+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.688814+0000","last_undegraded":"2024-03-12T17:20:27.688814+0000","last_fullsized":"2024-03-12T17:20:27.688814+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:15:48.029418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.687409+0000","last_change":"2024-03-12T17:20:27.687409+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.687409+0000","last_undegraded":"2024-03-12T17:20:27.687409+0000","last_fullsized":"2024-03-12T17:20:27.687409+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:42:33.917307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.689853+0000","last_change":"2024-03-12T17:20:27.689853+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.689853+0000","last_undegraded":"2024-03-12T17:20:27.689853+0000","last_fullsized":"2024-03-12T17:20:27.689853+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:42:33.917307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.690064+0000","last_change":"2024-03-12T17:20:27.690064+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.690064+0000","last_undegraded":"2024-03-12T17:20:27.690064+0000","last_fullsized":"2024-03-12T17:20:27.690064+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:51:07.459439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.683279+0000","last_change":"2024-03-12T17:20:27.683279+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.683279+0000","last_undegraded":"2024-03-12T17:20:27.683279+0000","last_fullsized":"2024-03-12T17:20:27.683279+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:54:05.658055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.694408+0000","last_change":"2024-03-12T17:20:27.694408+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.694408+0000","last_undegraded":"2024-03-12T17:20:27.694408+0000","last_fullsized":"2024-03-12T17:20:27.694408+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:35:34.872460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.689370+0000","last_change":"2024-03-12T17:20:27.689370+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.689370+0000","last_undegraded":"2024-03-12T17:20:27.689370+0000","last_fullsized":"2024-03-12T17:20:27.689370+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:40:40.199608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.693268+0000","last_change":"2024-03-12T17:20:27.693268+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.693268+0000","last_undegraded":"2024-03-12T17:20:27.693268+0000","last_fullsized":"2024-03-12T17:20:27.693268+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:40:40.199608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.685548+0000","last_change":"2024-03-12T17:20:27.685548+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.685548+0000","last_undegraded":"2024-03-12T17:20:27.685548+0000","last_fullsized":"2024-03-12T17:20:27.685548+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:42:22.845646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.681627+0000","last_change":"2024-03-12T17:20:27.681627+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.681627+0000","last_undegraded":"2024-03-12T17:20:27.681627+0000","last_fullsized":"2024-03-12T17:20:27.681627+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:40:33.340106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.688302+0000","last_change":"2024-03-12T17:20:27.688302+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.688302+0000","last_undegraded":"2024-03-12T17:20:27.688302+0000","last_fullsized":"2024-03-12T17:20:27.688302+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:24:31.966644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.684908+0000","last_change":"2024-03-12T17:20:27.684908+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.684908+0000","last_undegraded":"2024-03-12T17:20:27.684908+0000","last_fullsized":"2024-03-12T17:20:27.684908+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:40:12.017364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.686527+0000","last_change":"2024-03-12T17:20:27.686527+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.686527+0000","last_undegraded":"2024-03-12T17:20:27.686527+0000","last_fullsized":"2024-03-12T17:20:27.686527+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:25:11.954612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.693799+0000","last_change":"2024-03-12T17:20:27.693799+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.693799+0000","last_undegraded":"2024-03-12T17:20:27.693799+0000","last_fullsized":"2024-03-12T17:20:27.693799+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:22:18.771024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.681889+0000","last_change":"2024-03-12T17:20:27.681889+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.681889+0000","last_undegraded":"2024-03-12T17:20:27.681889+0000","last_fullsized":"2024-03-12T17:20:27.681889+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:20:16.591031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.693468+0000","last_change":"2024-03-12T17:20:27.693468+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.693468+0000","last_undegraded":"2024-03-12T17:20:27.693468+0000","last_fullsized":"2024-03-12T17:20:27.693468+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T05:01:55.583589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.683603+0000","last_change":"2024-03-12T17:20:27.683603+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.683603+0000","last_undegraded":"2024-03-12T17:20:27.683603+0000","last_fullsized":"2024-03-12T17:20:27.683603+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:37:31.324559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.687434+0000","last_change":"2024-03-12T17:20:27.687434+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.687434+0000","last_undegraded":"2024-03-12T17:20:27.687434+0000","last_fullsized":"2024-03-12T17:20:27.687434+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:33:00.215462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.685717+0000","last_change":"2024-03-12T17:20:27.685717+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.685717+0000","last_undegraded":"2024-03-12T17:20:27.685717+0000","last_fullsized":"2024-03-12T17:20:27.685717+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:40:12.017364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.686042+0000","last_change":"2024-03-12T17:20:27.686042+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.686042+0000","last_undegraded":"2024-03-12T17:20:27.686042+0000","last_fullsized":"2024-03-12T17:20:27.686042+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:22:45.140874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.692924+0000","last_change":"2024-03-12T17:20:27.692924+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.692924+0000","last_undegraded":"2024-03-12T17:20:27.692924+0000","last_fullsized":"2024-03-12T17:20:27.692924+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:09:46.909429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.684627+0000","last_change":"2024-03-12T17:20:27.684627+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.684627+0000","last_undegraded":"2024-03-12T17:20:27.684627+0000","last_fullsized":"2024-03-12T17:20:27.684627+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T00:25:46.901152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.686574+0000","last_change":"2024-03-12T17:20:27.686574+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.686574+0000","last_undegraded":"2024-03-12T17:20:27.686574+0000","last_fullsized":"2024-03-12T17:20:27.686574+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:44:37.644079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.684090+0000","last_change":"2024-03-12T17:20:27.684090+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.684090+0000","last_undegraded":"2024-03-12T17:20:27.684090+0000","last_fullsized":"2024-03-12T17:20:27.684090+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:25:11.954612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.688707+0000","last_change":"2024-03-12T17:20:27.688707+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.688707+0000","last_undegraded":"2024-03-12T17:20:27.688707+0000","last_fullsized":"2024-03-12T17:20:27.688707+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:22:45.140874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.685645+0000","last_change":"2024-03-12T17:20:27.685645+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.685645+0000","last_undegraded":"2024-03-12T17:20:27.685645+0000","last_fullsized":"2024-03-12T17:20:27.685645+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:24:31.966644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.688805+0000","last_change":"2024-03-12T17:20:27.688805+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.688805+0000","last_undegraded":"2024-03-12T17:20:27.688805+0000","last_fullsized":"2024-03-12T17:20:27.688805+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:49:16.580593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.688604+0000","last_change":"2024-03-12T17:20:27.688604+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.688604+0000","last_undegraded":"2024-03-12T17:20:27.688604+0000","last_fullsized":"2024-03-12T17:20:27.688604+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:06:42.471948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.692862+0000","last_change":"2024-03-12T17:20:27.692862+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.692862+0000","last_undegraded":"2024-03-12T17:20:27.692862+0000","last_fullsized":"2024-03-12T17:20:27.692862+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:23:16.616382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.684620+0000","last_change":"2024-03-12T17:20:27.684620+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.684620+0000","last_undegraded":"2024-03-12T17:20:27.684620+0000","last_fullsized":"2024-03-12T17:20:27.684620+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:34:52.559454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":181,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-03-12T17:20:24.776206+0000","last_change":"2024-03-12T17:18:41.331756+0000","last_active":"2024-03-12T17:20:24.776206+0000","last_peered":"2024-03-12T17:20:24.776206+0000","last_clean":"2024-03-12T17:20:24.776206+0000","last_became_active":"2024-03-12T17:18:41.329237+0000","last_became_peered":"2024-03-12T17:18:41.329237+0000","last_unstale":"2024-03-12T17:20:24.776206+0000","last_undegraded":"2024-03-12T17:20:24.776206+0000","last_fullsized":"2024-03-12T17:20:24.776206+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:40.152422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:40.152422+0000","last_clean_scrub_stamp":"2024-03-12T17:18:40.152422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:35:43.664403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1097728,"data_stored":790282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.85099999999999998}]},{"osd":1,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":1.3},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.0509999999999999}]},{"osd":2,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":1.101},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":1.4510000000000001}]},{"osd":3,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":1.2210000000000001}]},{"osd":4,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":2.2490000000000001,"5min":2.2490000000000001,"15min":2.2490000000000001},"last":1.341}]},{"osd":5,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.1909999999999998,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.393},{"interface":"front","average":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":3.9689999999999999,"5min":3.9689999999999999,"15min":3.9689999999999999},"last":1.262}]},{"osd":6,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":3.8319999999999999,"5min":3.8319999999999999,"15min":3.8319999999999999},"last":1.157},{"interface":"front","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":0.89000000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31620,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":516096,"data_stored":205731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.5390000000000001,"5min":3.5390000000000001,"15min":3.5390000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.79500000000000004}]},{"osd":1,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.85199999999999998}]},{"osd":2,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.9689999999999999,"5min":2.9689999999999999,"15min":2.9689999999999999},"last":1.1970000000000001}]},{"osd":3,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.399},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":1.1120000000000001}]},{"osd":4,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.4750000000000001}]},{"osd":5,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.8660000000000001,"5min":2.8660000000000001,"15min":2.8660000000000001},"last":1.522},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.931,"5min":2.931,"15min":2.931},"last":1.657}]},{"osd":7,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":1.591},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":1.98,"5min":1.98,"15min":1.98},"last":1.7330000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":503808,"data_stored":199914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.8149999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.76900000000000002}]},{"osd":1,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":2.5699999999999998,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":1.6859999999999999}]},{"osd":2,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.613,"5min":2.613,"15min":2.613},"last":1.385},{"interface":"front","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.359,"5min":2.359,"15min":2.359},"last":0.93700000000000006}]},{"osd":3,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":1.5660000000000001},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":2.0670000000000002,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":1.1859999999999999}]},{"osd":4,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.7809999999999999}]},{"osd":6,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":2.4609999999999999,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":2.4449999999999998},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":2.2759999999999998}]},{"osd":7,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"min":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"max":{"1min":2.8700000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.8939999999999999},{"interface":"front","average":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"min":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"max":{"1min":2.722,"5min":2.722,"15min":2.722},"last":1.7210000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":516096,"data_stored":205731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":4.8979999999999997,"5min":4.8979999999999997,"15min":4.8979999999999997},"last":1.27},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":4.8300000000000001,"5min":4.8300000000000001,"15min":4.8300000000000001},"last":1.1779999999999999}]},{"osd":1,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":4.7779999999999996,"5min":4.7779999999999996,"15min":4.7779999999999996},"last":1.218},{"interface":"front","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":1.0269999999999999}]},{"osd":2,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.6240000000000001},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.3220000000000001,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":1.365}]},{"osd":3,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":1.5620000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.3340000000000001}]},{"osd":5,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.431},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":1.5840000000000001}]},{"osd":6,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.405},{"interface":"front","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":2.4750000000000001,"5min":2.4750000000000001,"15min":2.4750000000000001},"last":1.4950000000000001}]},{"osd":7,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.728},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.4260000000000002,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":1.5269999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":516096,"data_stored":205731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.9580000000000002,"5min":2.9580000000000002,"15min":2.9580000000000002},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":3.9940000000000002,"5min":3.9940000000000002,"15min":3.9940000000000002},"last":0.71799999999999997}]},{"osd":1,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":4.774,"5min":4.774,"15min":4.774},"last":1.034},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":5.0069999999999997,"5min":5.0069999999999997,"15min":5.0069999999999997},"last":1.1679999999999999}]},{"osd":2,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":2.4660000000000002,"5min":2.4660000000000002,"15min":2.4660000000000002},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":4.5650000000000004,"5min":4.5650000000000004,"15min":4.5650000000000004},"last":1.458}]},{"osd":4,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.482,"15min":1.482},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":2.8860000000000001,"5min":2.8860000000000001,"15min":2.8860000000000001},"last":0.997},{"interface":"front","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":4.3520000000000003,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":1.3169999999999999}]},{"osd":5,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":2.843,"5min":2.843,"15min":2.843},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.8149999999999999,"5min":2.8149999999999999,"15min":2.8149999999999999},"last":1.2350000000000001}]},{"osd":6,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":2.9199999999999999,"5min":2.9199999999999999,"15min":2.9199999999999999},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":2.6589999999999998,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":0.88400000000000001}]},{"osd":7,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"min":{"1min":1.006,"5min":1.006,"15min":1.006},"max":{"1min":4.6600000000000001,"5min":4.6600000000000001,"15min":4.6600000000000001},"last":1.202},{"interface":"front","average":{"1min":1.599,"5min":1.599,"15min":1.599},"min":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"max":{"1min":4.4720000000000004,"5min":4.4720000000000004,"15min":4.4720000000000004},"last":1.556}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":516096,"data_stored":205731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":3.1829999999999998,"5min":3.1829999999999998,"15min":3.1829999999999998},"last":0.80400000000000005},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.0369999999999999}]},{"osd":1,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":0.749},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":3.1019999999999999,"5min":3.1019999999999999,"15min":3.1019999999999999},"last":1.2869999999999999}]},{"osd":3,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":2.7810000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":1.004},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":3.1419999999999999,"5min":3.1419999999999999,"15min":3.1419999999999999},"last":1.425}]},{"osd":4,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.643,"5min":1.643,"15min":1.643},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":7.96,"5min":7.96,"15min":7.96},"last":1.5269999999999999},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":3.3780000000000001,"5min":3.3780000000000001,"15min":3.3780000000000001},"last":1.181}]},{"osd":5,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":4.0659999999999998,"5min":4.0659999999999998,"15min":4.0659999999999998},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":3.012,"5min":3.012,"15min":3.012},"last":1.1479999999999999}]},{"osd":6,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":3.2330000000000001,"5min":3.2330000000000001,"15min":3.2330000000000001},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.804,"5min":1.804,"15min":1.804},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":7.9059999999999997,"5min":7.9059999999999997,"15min":7.9059999999999997},"last":1.591}]},{"osd":7,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":4.0229999999999997,"5min":4.0229999999999997,"15min":4.0229999999999997},"last":1.341},{"interface":"front","average":{"1min":1.506,"5min":1.506,"15min":1.506},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":3.27,"5min":3.27,"15min":3.27},"last":1.2569999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":516096,"data_stored":205731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.581,"5min":2.581,"15min":2.581},"last":0.96399999999999997}]},{"osd":2,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.5720000000000001,"5min":2.5720000000000001,"15min":2.5720000000000001},"last":0.66200000000000003}]},{"osd":3,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.4580000000000002,"5min":2.4580000000000002,"15min":2.4580000000000002},"last":0.75600000000000001},{"interface":"front","average":{"1min":1.208,"5min":1.208,"15min":1.208},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.9609999999999999,"5min":2.9609999999999999,"15min":2.9609999999999999},"last":1.0449999999999999}]},{"osd":4,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":2.4580000000000002,"5min":2.4580000000000002,"15min":2.4580000000000002},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.6909999999999998,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":0.70999999999999996}]},{"osd":5,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":3.0609999999999999,"5min":3.0609999999999999,"15min":3.0609999999999999},"last":1.004},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.84599999999999997}]},{"osd":6,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":3.1030000000000002,"5min":3.1030000000000002,"15min":3.1030000000000002},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.395,"5min":1.395,"15min":1.395},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.274,"5min":2.274,"15min":2.274},"last":0.90300000000000002}]},{"osd":7,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.7959999999999998,"5min":2.7959999999999998,"15min":2.7959999999999998},"last":0.877},{"interface":"front","average":{"1min":1.55,"5min":1.55,"15min":1.55},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":3.1440000000000001,"5min":3.1440000000000001,"15min":3.1440000000000001},"last":0.85799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1110016,"data_stored":796099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.879},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.2729999999999999}]},{"osd":2,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.99,"5min":1.99,"15min":1.99},"last":0.75},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":1.353}]},{"osd":3,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":1.3779999999999999}]},{"osd":4,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":3.2349999999999999,"5min":3.2349999999999999,"15min":3.2349999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":2.5369999999999999,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":1.194}]},{"osd":5,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.988,"5min":2.988,"15min":2.988},"last":1.4970000000000001},{"interface":"front","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.843,"5min":2.843,"15min":2.843},"last":1.016}]},{"osd":6,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":2.431,"5min":2.431,"15min":2.431},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.589,"5min":2.589,"15min":2.589},"last":1.671}]},{"osd":7,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.637,"5min":1.637,"15min":1.637},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":1.607},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":2.8929999999999998,"5min":2.8929999999999998,"15min":2.8929999999999998},"last":1.1439999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-12T17:20:33.864 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-12T17:20:34.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.131+0000 7f8112e00640 1 Processor -- start 2024-03-12T17:20:34.127 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.132+0000 7f8112e00640 1 -- start start 2024-03-12T17:20:34.129 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.133+0000 7f8112e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f810c1441f0 0x7f810c070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:34.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.133+0000 7f8112e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f810c0b3b70 0x7f810c0b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:34.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.133+0000 7f8112e00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f810c0a7660 con 0x7f810c15ae20 2024-03-12T17:20:34.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.133+0000 7f8112e00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f810c15e460 con 0x7f810c1441f0 2024-03-12T17:20:34.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.133+0000 7f8112e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810c06d840 con 0x7f810c0b3b70 2024-03-12T17:20:34.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.134+0000 7f8111a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f810c1441f0 0x7f810c070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:34.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.134+0000 7f8111a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f810c1441f0 0x7f810c070240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58692/0 (socket says 172.21.15.17:58692) 2024-03-12T17:20:34.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.134+0000 7f8111a00640 1 -- 172.21.15.17:0/241674011 learned_addr learned my addr 172.21.15.17:0/241674011 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:34.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.134+0000 7f8111a00640 1 -- 172.21.15.17:0/241674011 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f810c0b3b70 msgr2=0x7f810c0b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:34.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.134+0000 7f8112400640 1 --2- 172.21.15.17:0/241674011 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f810c0b3b70 0x7f810c0b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:34.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.134+0000 7f8111a00640 1 --2- 172.21.15.17:0/241674011 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f810c0b3b70 0x7f810c0b3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:34.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.134+0000 7f8111a00640 1 -- 172.21.15.17:0/241674011 >> v1:172.21.15.94:6789/0 conn(0x7f810c15ae20 legacy=0x7f810c06d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:34.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.134+0000 7f8111a00640 1 -- 172.21.15.17:0/241674011 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810c0b44e0 con 0x7f810c1441f0 2024-03-12T17:20:34.130 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.134+0000 7f8112400640 1 --2- 172.21.15.17:0/241674011 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f810c0b3b70 0x7f810c0b3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:34.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.135+0000 7f8111a00640 1 --2- 172.21.15.17:0/241674011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f810c1441f0 0x7f810c070240 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8100009870 tx=0x7f810002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9735b2382ff445c server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:34.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.136+0000 7f810be00640 1 -- 172.21.15.17:0/241674011 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8100030840 con 0x7f810c1441f0 2024-03-12T17:20:34.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.136+0000 7f810be00640 1 -- 172.21.15.17:0/241674011 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81000309a0 con 0x7f810c1441f0 2024-03-12T17:20:34.131 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.136+0000 7f810be00640 1 -- 172.21.15.17:0/241674011 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8100030d30 con 0x7f810c1441f0 2024-03-12T17:20:34.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.137+0000 7f8112e00640 1 -- 172.21.15.17:0/241674011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f810c1441f0 msgr2=0x7f810c070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:34.132 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.137+0000 7f8112e00640 1 --2- 172.21.15.17:0/241674011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f810c1441f0 0x7f810c070240 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f8100009870 tx=0x7f810002b980 comp rx=0 tx=0).stop 2024-03-12T17:20:34.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.137+0000 7f8112e00640 1 -- 172.21.15.17:0/241674011 shutdown_connections 2024-03-12T17:20:34.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.137+0000 7f8112e00640 1 --2- 172.21.15.17:0/241674011 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f810c0b3b70 0x7f810c0b3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:34.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.137+0000 7f8112e00640 1 --2- 172.21.15.17:0/241674011 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f810c1441f0 0x7f810c070240 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:34.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.137+0000 7f8112e00640 1 -- 172.21.15.17:0/241674011 >> 172.21.15.17:0/241674011 conn(0x7f810c069ce0 msgr2=0x7f810c06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:34.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.137+0000 7f8112e00640 1 -- 172.21.15.17:0/241674011 shutdown_connections 2024-03-12T17:20:34.133 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.137+0000 7f8112e00640 1 -- 172.21.15.17:0/241674011 wait complete. 2024-03-12T17:20:34.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.139+0000 7f8112e00640 1 Processor -- start 2024-03-12T17:20:34.134 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.139+0000 7f8112e00640 1 -- start start 2024-03-12T17:20:34.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.140+0000 7f8112e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f810c0b3b70 0x7f810c159e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:34.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.140+0000 7f8112e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f810c1441f0 0x7f810c1f4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:34.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.141+0000 7f8112e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f810c15ae20 0x7f810c13fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:34.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.141+0000 7f8112e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810c13d8b0 con 0x7f810c0b3b70 2024-03-12T17:20:34.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.141+0000 7f8112e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810c1f47a0 con 0x7f810c15ae20 2024-03-12T17:20:34.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.141+0000 7f8112e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f810c13afc0 con 0x7f810c1441f0 2024-03-12T17:20:34.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.141+0000 7f8111a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f810c0b3b70 0x7f810c159e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:34.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.141+0000 7f8111a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f810c0b3b70 0x7f810c159e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58704/0 (socket says 172.21.15.17:58704) 2024-03-12T17:20:34.137 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.141+0000 7f8111a00640 1 -- 172.21.15.17:0/3569162833 learned_addr learned my addr 172.21.15.17:0/3569162833 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:34.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.141+0000 7f8112400640 1 --2- 172.21.15.17:0/3569162833 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f810c15ae20 0x7f810c13fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:34.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.141+0000 7f8111000640 1 --2- 172.21.15.17:0/3569162833 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f810c1441f0 0x7f810c1f4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:34.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.141+0000 7f8111a00640 1 -- 172.21.15.17:0/3569162833 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f810c1441f0 msgr2=0x7f810c1f4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:34.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.141+0000 7f8111a00640 1 --2- 172.21.15.17:0/3569162833 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f810c1441f0 0x7f810c1f4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:34.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.141+0000 7f8111a00640 1 -- 172.21.15.17:0/3569162833 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f810c15ae20 msgr2=0x7f810c13fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:34.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.141+0000 7f8111a00640 1 --2- 172.21.15.17:0/3569162833 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f810c15ae20 0x7f810c13fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:34.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.141+0000 7f8111a00640 1 -- 172.21.15.17:0/3569162833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81000094d0 con 0x7f810c0b3b70 2024-03-12T17:20:34.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.141+0000 7f8112400640 1 --2- 172.21.15.17:0/3569162833 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f810c15ae20 0x7f810c13fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:34.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.141+0000 7f8111000640 1 --2- 172.21.15.17:0/3569162833 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f810c1441f0 0x7f810c1f4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:34.138 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.142+0000 7f8111a00640 1 --2- 172.21.15.17:0/3569162833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f810c0b3b70 0x7f810c159e90 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8100009870 tx=0x7f8100004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:34.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.142+0000 7f8109600640 1 -- 172.21.15.17:0/3569162833 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81000307f0 con 0x7f810c0b3b70 2024-03-12T17:20:34.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.142+0000 7f8109600640 1 -- 172.21.15.17:0/3569162833 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8100043400 con 0x7f810c0b3b70 2024-03-12T17:20:34.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.142+0000 7f8109600640 1 -- 172.21.15.17:0/3569162833 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81000437b0 con 0x7f810c0b3b70 2024-03-12T17:20:34.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.142+0000 7f8112e00640 1 -- 172.21.15.17:0/3569162833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f810c13dac0 con 0x7f810c0b3b70 2024-03-12T17:20:34.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.142+0000 7f8112e00640 1 -- 172.21.15.17:0/3569162833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f810c13b540 con 0x7f810c0b3b70 2024-03-12T17:20:34.139 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.144+0000 7f8112e00640 1 -- 172.21.15.17:0/3569162833 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f810c15ac00 con 0x7f810c0b3b70 2024-03-12T17:20:34.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.144+0000 7f8109600640 1 -- 172.21.15.17:0/3569162833 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f8100043910 con 0x7f810c0b3b70 2024-03-12T17:20:34.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.145+0000 7f8109600640 1 --2- 172.21.15.17:0/3569162833 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f80ec06ac00 0x7f80ec06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:34.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.145+0000 7f8109600640 1 -- 172.21.15.17:0/3569162833 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f810003e070 con 0x7f810c0b3b70 2024-03-12T17:20:34.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.146+0000 7f8111000640 1 --2- 172.21.15.17:0/3569162833 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f80ec06ac00 0x7f80ec06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:34.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.146+0000 7f8111000640 1 --2- 172.21.15.17:0/3569162833 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f80ec06ac00 0x7f80ec06d0c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f810c0ae080 tx=0x7f80f8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:34.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.150+0000 7f8109600640 1 -- 172.21.15.17:0/3569162833 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f8100077960 con 0x7f810c0b3b70 2024-03-12T17:20:34.340 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.345+0000 7f8112e00640 1 -- 172.21.15.17:0/3569162833 --> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f810c15b6c0 con 0x7f80ec06ac00 2024-03-12T17:20:34.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.366+0000 7f8109600640 1 -- 172.21.15.17:0/3569162833 <== mgr.4104 v2:172.21.15.17:6832/37052 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276450 (secure 0 0 0) 0x7f80f800ad80 con 0x7f80ec06ac00 2024-03-12T17:20:34.366 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:20:34.367 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-03-12T17:20:34.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.371+0000 7f8112e00640 1 -- 172.21.15.17:0/3569162833 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f80ec06ac00 msgr2=0x7f80ec06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:34.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.371+0000 7f8112e00640 1 --2- 172.21.15.17:0/3569162833 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f80ec06ac00 0x7f80ec06d0c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f810c0ae080 tx=0x7f80f8008040 comp rx=0 tx=0).stop 2024-03-12T17:20:34.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.371+0000 7f8112e00640 1 -- 172.21.15.17:0/3569162833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f810c0b3b70 msgr2=0x7f810c159e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:34.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.371+0000 7f8112e00640 1 --2- 172.21.15.17:0/3569162833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f810c0b3b70 0x7f810c159e90 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8100009870 tx=0x7f8100004730 comp rx=0 tx=0).stop 2024-03-12T17:20:34.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.371+0000 7f8112e00640 1 -- 172.21.15.17:0/3569162833 shutdown_connections 2024-03-12T17:20:34.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.371+0000 7f8112e00640 1 --2- 172.21.15.17:0/3569162833 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f80ec06ac00 0x7f80ec06d0c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:34.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.371+0000 7f8112e00640 1 --2- 172.21.15.17:0/3569162833 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f810c15ae20 0x7f810c13fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:34.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.371+0000 7f8112e00640 1 --2- 172.21.15.17:0/3569162833 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f810c1441f0 0x7f810c1f4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:34.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.371+0000 7f8112e00640 1 --2- 172.21.15.17:0/3569162833 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f810c0b3b70 0x7f810c159e90 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:34.369 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.371+0000 7f8112e00640 1 -- 172.21.15.17:0/3569162833 >> 172.21.15.17:0/3569162833 conn(0x7f810c069ce0 msgr2=0x7f810c0ae630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:34.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.372+0000 7f8112e00640 1 -- 172.21.15.17:0/3569162833 shutdown_connections 2024-03-12T17:20:34.370 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.372+0000 7f8112e00640 1 -- 172.21.15.17:0/3569162833 wait complete. 2024-03-12T17:20:34.388 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2024-03-12T17:20:33.513258+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":254108,"kb_used_data":5168,"kb_used_omap":13,"kb_used_meta":248818,"kb_avail":754720612,"statfs":{"total":773094113280,"available":772833906688,"internally_reserved":0,"allocated":5292032,"data_stored":2814950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":254789720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.835104"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.686610+0000","last_change":"2024-03-12T17:20:27.686610+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.686610+0000","last_undegraded":"2024-03-12T17:20:27.686610+0000","last_fullsized":"2024-03-12T17:20:27.686610+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:42:22.845646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.694409+0000","last_change":"2024-03-12T17:20:27.694409+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.694409+0000","last_undegraded":"2024-03-12T17:20:27.694409+0000","last_fullsized":"2024-03-12T17:20:27.694409+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:19:01.645685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.688814+0000","last_change":"2024-03-12T17:20:27.688814+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.688814+0000","last_undegraded":"2024-03-12T17:20:27.688814+0000","last_fullsized":"2024-03-12T17:20:27.688814+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:15:48.029418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.687409+0000","last_change":"2024-03-12T17:20:27.687409+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.687409+0000","last_undegraded":"2024-03-12T17:20:27.687409+0000","last_fullsized":"2024-03-12T17:20:27.687409+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:42:33.917307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.689853+0000","last_change":"2024-03-12T17:20:27.689853+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.689853+0000","last_undegraded":"2024-03-12T17:20:27.689853+0000","last_fullsized":"2024-03-12T17:20:27.689853+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:42:33.917307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.690064+0000","last_change":"2024-03-12T17:20:27.690064+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.690064+0000","last_undegraded":"2024-03-12T17:20:27.690064+0000","last_fullsized":"2024-03-12T17:20:27.690064+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:51:07.459439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.683279+0000","last_change":"2024-03-12T17:20:27.683279+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.683279+0000","last_undegraded":"2024-03-12T17:20:27.683279+0000","last_fullsized":"2024-03-12T17:20:27.683279+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:54:05.658055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.694408+0000","last_change":"2024-03-12T17:20:27.694408+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.694408+0000","last_undegraded":"2024-03-12T17:20:27.694408+0000","last_fullsized":"2024-03-12T17:20:27.694408+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:35:34.872460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.689370+0000","last_change":"2024-03-12T17:20:27.689370+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.689370+0000","last_undegraded":"2024-03-12T17:20:27.689370+0000","last_fullsized":"2024-03-12T17:20:27.689370+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:40:40.199608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.693268+0000","last_change":"2024-03-12T17:20:27.693268+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.693268+0000","last_undegraded":"2024-03-12T17:20:27.693268+0000","last_fullsized":"2024-03-12T17:20:27.693268+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:40:40.199608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.685548+0000","last_change":"2024-03-12T17:20:27.685548+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.685548+0000","last_undegraded":"2024-03-12T17:20:27.685548+0000","last_fullsized":"2024-03-12T17:20:27.685548+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:42:22.845646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.681627+0000","last_change":"2024-03-12T17:20:27.681627+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.681627+0000","last_undegraded":"2024-03-12T17:20:27.681627+0000","last_fullsized":"2024-03-12T17:20:27.681627+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:40:33.340106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.688302+0000","last_change":"2024-03-12T17:20:27.688302+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.688302+0000","last_undegraded":"2024-03-12T17:20:27.688302+0000","last_fullsized":"2024-03-12T17:20:27.688302+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:24:31.966644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.684908+0000","last_change":"2024-03-12T17:20:27.684908+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.684908+0000","last_undegraded":"2024-03-12T17:20:27.684908+0000","last_fullsized":"2024-03-12T17:20:27.684908+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:40:12.017364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.686527+0000","last_change":"2024-03-12T17:20:27.686527+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.686527+0000","last_undegraded":"2024-03-12T17:20:27.686527+0000","last_fullsized":"2024-03-12T17:20:27.686527+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:25:11.954612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.693799+0000","last_change":"2024-03-12T17:20:27.693799+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.693799+0000","last_undegraded":"2024-03-12T17:20:27.693799+0000","last_fullsized":"2024-03-12T17:20:27.693799+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:22:18.771024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.681889+0000","last_change":"2024-03-12T17:20:27.681889+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.681889+0000","last_undegraded":"2024-03-12T17:20:27.681889+0000","last_fullsized":"2024-03-12T17:20:27.681889+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:20:16.591031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.693468+0000","last_change":"2024-03-12T17:20:27.693468+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.693468+0000","last_undegraded":"2024-03-12T17:20:27.693468+0000","last_fullsized":"2024-03-12T17:20:27.693468+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T05:01:55.583589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.683603+0000","last_change":"2024-03-12T17:20:27.683603+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.683603+0000","last_undegraded":"2024-03-12T17:20:27.683603+0000","last_fullsized":"2024-03-12T17:20:27.683603+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:37:31.324559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.687434+0000","last_change":"2024-03-12T17:20:27.687434+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.687434+0000","last_undegraded":"2024-03-12T17:20:27.687434+0000","last_fullsized":"2024-03-12T17:20:27.687434+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:33:00.215462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.685717+0000","last_change":"2024-03-12T17:20:27.685717+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.685717+0000","last_undegraded":"2024-03-12T17:20:27.685717+0000","last_fullsized":"2024-03-12T17:20:27.685717+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:40:12.017364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.686042+0000","last_change":"2024-03-12T17:20:27.686042+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.686042+0000","last_undegraded":"2024-03-12T17:20:27.686042+0000","last_fullsized":"2024-03-12T17:20:27.686042+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:22:45.140874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.692924+0000","last_change":"2024-03-12T17:20:27.692924+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.692924+0000","last_undegraded":"2024-03-12T17:20:27.692924+0000","last_fullsized":"2024-03-12T17:20:27.692924+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:09:46.909429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.684627+0000","last_change":"2024-03-12T17:20:27.684627+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.684627+0000","last_undegraded":"2024-03-12T17:20:27.684627+0000","last_fullsized":"2024-03-12T17:20:27.684627+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T00:25:46.901152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.686574+0000","last_change":"2024-03-12T17:20:27.686574+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.686574+0000","last_undegraded":"2024-03-12T17:20:27.686574+0000","last_fullsized":"2024-03-12T17:20:27.686574+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:44:37.644079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.684090+0000","last_change":"2024-03-12T17:20:27.684090+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.684090+0000","last_undegraded":"2024-03-12T17:20:27.684090+0000","last_fullsized":"2024-03-12T17:20:27.684090+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:25:11.954612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.688707+0000","last_change":"2024-03-12T17:20:27.688707+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.688707+0000","last_undegraded":"2024-03-12T17:20:27.688707+0000","last_fullsized":"2024-03-12T17:20:27.688707+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:22:45.140874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.685645+0000","last_change":"2024-03-12T17:20:27.685645+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.685645+0000","last_undegraded":"2024-03-12T17:20:27.685645+0000","last_fullsized":"2024-03-12T17:20:27.685645+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:24:31.966644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.688805+0000","last_change":"2024-03-12T17:20:27.688805+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.688805+0000","last_undegraded":"2024-03-12T17:20:27.688805+0000","last_fullsized":"2024-03-12T17:20:27.688805+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:49:16.580593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.688604+0000","last_change":"2024-03-12T17:20:27.688604+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.688604+0000","last_undegraded":"2024-03-12T17:20:27.688604+0000","last_fullsized":"2024-03-12T17:20:27.688604+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:06:42.471948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.692862+0000","last_change":"2024-03-12T17:20:27.692862+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.692862+0000","last_undegraded":"2024-03-12T17:20:27.692862+0000","last_fullsized":"2024-03-12T17:20:27.692862+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:23:16.616382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.684620+0000","last_change":"2024-03-12T17:20:27.684620+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.684620+0000","last_undegraded":"2024-03-12T17:20:27.684620+0000","last_fullsized":"2024-03-12T17:20:27.684620+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:34:52.559454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":181,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-03-12T17:20:24.776206+0000","last_change":"2024-03-12T17:18:41.331756+0000","last_active":"2024-03-12T17:20:24.776206+0000","last_peered":"2024-03-12T17:20:24.776206+0000","last_clean":"2024-03-12T17:20:24.776206+0000","last_became_active":"2024-03-12T17:18:41.329237+0000","last_became_peered":"2024-03-12T17:18:41.329237+0000","last_unstale":"2024-03-12T17:20:24.776206+0000","last_undegraded":"2024-03-12T17:20:24.776206+0000","last_fullsized":"2024-03-12T17:20:24.776206+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:40.152422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:40.152422+0000","last_clean_scrub_stamp":"2024-03-12T17:18:40.152422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:35:43.664403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1097728,"data_stored":790282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.85099999999999998}]},{"osd":1,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":1.3},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.0509999999999999}]},{"osd":2,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":1.101},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":1.4510000000000001}]},{"osd":3,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":1.2210000000000001}]},{"osd":4,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":2.2490000000000001,"5min":2.2490000000000001,"15min":2.2490000000000001},"last":1.341}]},{"osd":5,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.1909999999999998,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.393},{"interface":"front","average":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":3.9689999999999999,"5min":3.9689999999999999,"15min":3.9689999999999999},"last":1.262}]},{"osd":6,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":3.8319999999999999,"5min":3.8319999999999999,"15min":3.8319999999999999},"last":1.157},{"interface":"front","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":0.89000000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31620,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":516096,"data_stored":205731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.5390000000000001,"5min":3.5390000000000001,"15min":3.5390000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.79500000000000004}]},{"osd":1,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.85199999999999998}]},{"osd":2,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.9689999999999999,"5min":2.9689999999999999,"15min":2.9689999999999999},"last":1.1970000000000001}]},{"osd":3,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.399},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":1.1120000000000001}]},{"osd":4,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.4750000000000001}]},{"osd":5,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.8660000000000001,"5min":2.8660000000000001,"15min":2.8660000000000001},"last":1.522},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.931,"5min":2.931,"15min":2.931},"last":1.657}]},{"osd":7,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":1.591},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":1.98,"5min":1.98,"15min":1.98},"last":1.7330000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":503808,"data_stored":199914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.8149999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.76900000000000002}]},{"osd":1,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":2.5699999999999998,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":1.6859999999999999}]},{"osd":2,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.613,"5min":2.613,"15min":2.613},"last":1.385},{"interface":"front","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.359,"5min":2.359,"15min":2.359},"last":0.93700000000000006}]},{"osd":3,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":1.5660000000000001},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":2.0670000000000002,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":1.1859999999999999}]},{"osd":4,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.7809999999999999}]},{"osd":6,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":2.4609999999999999,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":2.4449999999999998},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":2.2759999999999998}]},{"osd":7,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"min":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"max":{"1min":2.8700000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.8939999999999999},{"interface":"front","average":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"min":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"max":{"1min":2.722,"5min":2.722,"15min":2.722},"last":1.7210000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":516096,"data_stored":205731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":4.8979999999999997,"5min":4.8979999999999997,"15min":4.8979999999999997},"last":1.27},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":4.8300000000000001,"5min":4.8300000000000001,"15min":4.8300000000000001},"last":1.1779999999999999}]},{"osd":1,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":4.7779999999999996,"5min":4.7779999999999996,"15min":4.7779999999999996},"last":1.218},{"interface":"front","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":1.0269999999999999}]},{"osd":2,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.6240000000000001},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.3220000000000001,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":1.365}]},{"osd":3,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":1.5620000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.3340000000000001}]},{"osd":5,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.431},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":1.5840000000000001}]},{"osd":6,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.405},{"interface":"front","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":2.4750000000000001,"5min":2.4750000000000001,"15min":2.4750000000000001},"last":1.4950000000000001}]},{"osd":7,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.728},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.4260000000000002,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":1.5269999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":516096,"data_stored":205731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.9580000000000002,"5min":2.9580000000000002,"15min":2.9580000000000002},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":3.9940000000000002,"5min":3.9940000000000002,"15min":3.9940000000000002},"last":0.71799999999999997}]},{"osd":1,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":4.774,"5min":4.774,"15min":4.774},"last":1.034},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":5.0069999999999997,"5min":5.0069999999999997,"15min":5.0069999999999997},"last":1.1679999999999999}]},{"osd":2,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":2.4660000000000002,"5min":2.4660000000000002,"15min":2.4660000000000002},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":4.5650000000000004,"5min":4.5650000000000004,"15min":4.5650000000000004},"last":1.458}]},{"osd":4,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.482,"15min":1.482},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":2.8860000000000001,"5min":2.8860000000000001,"15min":2.8860000000000001},"last":0.997},{"interface":"front","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":4.3520000000000003,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":1.3169999999999999}]},{"osd":5,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":2.843,"5min":2.843,"15min":2.843},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.8149999999999999,"5min":2.8149999999999999,"15min":2.8149999999999999},"last":1.2350000000000001}]},{"osd":6,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":2.9199999999999999,"5min":2.9199999999999999,"15min":2.9199999999999999},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":2.6589999999999998,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":0.88400000000000001}]},{"osd":7,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"min":{"1min":1.006,"5min":1.006,"15min":1.006},"max":{"1min":4.6600000000000001,"5min":4.6600000000000001,"15min":4.6600000000000001},"last":1.202},{"interface":"front","average":{"1min":1.599,"5min":1.599,"15min":1.599},"min":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"max":{"1min":4.4720000000000004,"5min":4.4720000000000004,"15min":4.4720000000000004},"last":1.556}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":516096,"data_stored":205731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":3.1829999999999998,"5min":3.1829999999999998,"15min":3.1829999999999998},"last":0.80400000000000005},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.0369999999999999}]},{"osd":1,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":0.749},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":3.1019999999999999,"5min":3.1019999999999999,"15min":3.1019999999999999},"last":1.2869999999999999}]},{"osd":3,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":2.7810000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":1.004},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":3.1419999999999999,"5min":3.1419999999999999,"15min":3.1419999999999999},"last":1.425}]},{"osd":4,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.643,"5min":1.643,"15min":1.643},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":7.96,"5min":7.96,"15min":7.96},"last":1.5269999999999999},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":3.3780000000000001,"5min":3.3780000000000001,"15min":3.3780000000000001},"last":1.181}]},{"osd":5,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":4.0659999999999998,"5min":4.0659999999999998,"15min":4.0659999999999998},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":3.012,"5min":3.012,"15min":3.012},"last":1.1479999999999999}]},{"osd":6,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":3.2330000000000001,"5min":3.2330000000000001,"15min":3.2330000000000001},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.804,"5min":1.804,"15min":1.804},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":7.9059999999999997,"5min":7.9059999999999997,"15min":7.9059999999999997},"last":1.591}]},{"osd":7,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":4.0229999999999997,"5min":4.0229999999999997,"15min":4.0229999999999997},"last":1.341},{"interface":"front","average":{"1min":1.506,"5min":1.506,"15min":1.506},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":3.27,"5min":3.27,"15min":3.27},"last":1.2569999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":516096,"data_stored":205731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.581,"5min":2.581,"15min":2.581},"last":0.96399999999999997}]},{"osd":2,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.5720000000000001,"5min":2.5720000000000001,"15min":2.5720000000000001},"last":0.66200000000000003}]},{"osd":3,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.4580000000000002,"5min":2.4580000000000002,"15min":2.4580000000000002},"last":0.75600000000000001},{"interface":"front","average":{"1min":1.208,"5min":1.208,"15min":1.208},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.9609999999999999,"5min":2.9609999999999999,"15min":2.9609999999999999},"last":1.0449999999999999}]},{"osd":4,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":2.4580000000000002,"5min":2.4580000000000002,"15min":2.4580000000000002},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.6909999999999998,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":0.70999999999999996}]},{"osd":5,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":3.0609999999999999,"5min":3.0609999999999999,"15min":3.0609999999999999},"last":1.004},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.84599999999999997}]},{"osd":6,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":3.1030000000000002,"5min":3.1030000000000002,"15min":3.1030000000000002},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.395,"5min":1.395,"15min":1.395},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.274,"5min":2.274,"15min":2.274},"last":0.90300000000000002}]},{"osd":7,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.7959999999999998,"5min":2.7959999999999998,"15min":2.7959999999999998},"last":0.877},{"interface":"front","average":{"1min":1.55,"5min":1.55,"15min":1.55},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":3.1440000000000001,"5min":3.1440000000000001,"15min":3.1440000000000001},"last":0.85799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1110016,"data_stored":796099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.879},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.2729999999999999}]},{"osd":2,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.99,"5min":1.99,"15min":1.99},"last":0.75},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":1.353}]},{"osd":3,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":1.3779999999999999}]},{"osd":4,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":3.2349999999999999,"5min":3.2349999999999999,"15min":3.2349999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":2.5369999999999999,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":1.194}]},{"osd":5,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.988,"5min":2.988,"15min":2.988},"last":1.4970000000000001},{"interface":"front","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.843,"5min":2.843,"15min":2.843},"last":1.016}]},{"osd":6,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":2.431,"5min":2.431,"15min":2.431},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.589,"5min":2.589,"15min":2.589},"last":1.671}]},{"osd":7,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.637,"5min":1.637,"15min":1.637},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":1.607},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":2.8929999999999998,"5min":2.8929999999999998,"15min":2.8929999999999998},"last":1.1439999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-12T17:20:34.392 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-12T17:20:34.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.666+0000 7f3297e00640 1 Processor -- start 2024-03-12T17:20:34.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.666+0000 7f3297e00640 1 -- start start 2024-03-12T17:20:34.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.667+0000 7f3297e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3298098e70 0x7f3298160ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:34.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.667+0000 7f3297e00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32980cb930 con 0x7f32980ae600 2024-03-12T17:20:34.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.667+0000 7f3297e00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3298160650 con 0x7f32980cb550 2024-03-12T17:20:34.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.667+0000 7f3297e00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f329806a050 con 0x7f3298098e70 2024-03-12T17:20:34.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.668+0000 7f3296000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3298098e70 0x7f3298160ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:34.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.668+0000 7f3296000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3298098e70 0x7f3298160ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58718/0 (socket says 172.21.15.17:58718) 2024-03-12T17:20:34.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.668+0000 7f3296000640 1 -- 172.21.15.17:0/2212433525 learned_addr learned my addr 172.21.15.17:0/2212433525 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:34.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.668+0000 7f3296000640 1 -- 172.21.15.17:0/2212433525 >> v1:172.21.15.94:6789/0 conn(0x7f32980cb550 legacy=0x7f32980cbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:34.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.668+0000 7f3296000640 1 -- 172.21.15.17:0/2212433525 >> v1:172.21.15.17:6789/0 conn(0x7f32980ae600 legacy=0x7f329806e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:34.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.668+0000 7f3296000640 1 -- 172.21.15.17:0/2212433525 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f329806a330 con 0x7f3298098e70 2024-03-12T17:20:34.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.669+0000 7f3296000640 1 --2- 172.21.15.17:0/2212433525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3298098e70 0x7f3298160ae0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f3284009870 tx=0x7f328402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ddc8445196e3d49 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:34.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.670+0000 7f3295600640 1 -- 172.21.15.17:0/2212433525 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3284030860 con 0x7f3298098e70 2024-03-12T17:20:34.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.670+0000 7f3295600640 1 -- 172.21.15.17:0/2212433525 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32840309c0 con 0x7f3298098e70 2024-03-12T17:20:34.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.670+0000 7f3295600640 1 -- 172.21.15.17:0/2212433525 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3284030d50 con 0x7f3298098e70 2024-03-12T17:20:34.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.670+0000 7f3297e00640 1 -- 172.21.15.17:0/2212433525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3298098e70 msgr2=0x7f3298160ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:34.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.670+0000 7f3297e00640 1 --2- 172.21.15.17:0/2212433525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3298098e70 0x7f3298160ae0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f3284009870 tx=0x7f328402b9a0 comp rx=0 tx=0).stop 2024-03-12T17:20:34.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.671+0000 7f3297e00640 1 -- 172.21.15.17:0/2212433525 shutdown_connections 2024-03-12T17:20:34.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.671+0000 7f3297e00640 1 --2- 172.21.15.17:0/2212433525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3298098e70 0x7f3298160ae0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:34.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.671+0000 7f3297e00640 1 -- 172.21.15.17:0/2212433525 >> 172.21.15.17:0/2212433525 conn(0x7f3298098a60 msgr2=0x7f32980b10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:34.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.671+0000 7f3297e00640 1 -- 172.21.15.17:0/2212433525 shutdown_connections 2024-03-12T17:20:34.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.671+0000 7f3297e00640 1 -- 172.21.15.17:0/2212433525 wait complete. 2024-03-12T17:20:34.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.673+0000 7f3297e00640 1 Processor -- start 2024-03-12T17:20:34.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.673+0000 7f3297e00640 1 -- start start 2024-03-12T17:20:34.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.674+0000 7f3297e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3298098e70 0x7f32980c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:34.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.674+0000 7f3297e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32980ae600 0x7f3298154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:34.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.674+0000 7f3297e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f32980cb550 0x7f3298099550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:34.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.674+0000 7f3297e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329809a600 con 0x7f32980ae600 2024-03-12T17:20:34.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.674+0000 7f3297e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32980c3300 con 0x7f3298098e70 2024-03-12T17:20:34.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.674+0000 7f3297e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3298154fb0 con 0x7f32980cb550 2024-03-12T17:20:34.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.674+0000 7f3296000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32980ae600 0x7f3298154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:34.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.674+0000 7f3296000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32980ae600 0x7f3298154a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58730/0 (socket says 172.21.15.17:58730) 2024-03-12T17:20:34.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.674+0000 7f3296000640 1 -- 172.21.15.17:0/2632604800 learned_addr learned my addr 172.21.15.17:0/2632604800 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:34.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.675+0000 7f3296000640 1 -- 172.21.15.17:0/2632604800 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f32980cb550 msgr2=0x7f3298099550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:34.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.675+0000 7f3297400640 1 --2- 172.21.15.17:0/2632604800 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f32980cb550 0x7f3298099550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:34.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.675+0000 7f3296a00640 1 --2- 172.21.15.17:0/2632604800 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3298098e70 0x7f32980c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:34.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.675+0000 7f3296000640 1 --2- 172.21.15.17:0/2632604800 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f32980cb550 0x7f3298099550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:34.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.675+0000 7f3296000640 1 -- 172.21.15.17:0/2632604800 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3298098e70 msgr2=0x7f32980c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:34.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.675+0000 7f3296000640 1 --2- 172.21.15.17:0/2632604800 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3298098e70 0x7f32980c60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:34.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.675+0000 7f3296000640 1 -- 172.21.15.17:0/2632604800 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32840094d0 con 0x7f32980ae600 2024-03-12T17:20:34.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.675+0000 7f3297400640 1 --2- 172.21.15.17:0/2632604800 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f32980cb550 0x7f3298099550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:34.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.675+0000 7f3296a00640 1 --2- 172.21.15.17:0/2632604800 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3298098e70 0x7f32980c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:34.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.675+0000 7f3296000640 1 --2- 172.21.15.17:0/2632604800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32980ae600 0x7f3298154a70 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f3284000c00 tx=0x7f3284004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:34.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.675+0000 7f328f400640 1 -- 172.21.15.17:0/2632604800 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3284043400 con 0x7f32980ae600 2024-03-12T17:20:34.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.675+0000 7f328f400640 1 -- 172.21.15.17:0/2632604800 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3284043560 con 0x7f32980ae600 2024-03-12T17:20:34.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.675+0000 7f3297e00640 1 -- 172.21.15.17:0/2632604800 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3298099a90 con 0x7f32980ae600 2024-03-12T17:20:34.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.675+0000 7f328f400640 1 -- 172.21.15.17:0/2632604800 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3284043910 con 0x7f32980ae600 2024-03-12T17:20:34.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.676+0000 7f3297e00640 1 -- 172.21.15.17:0/2632604800 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f329809a040 con 0x7f32980ae600 2024-03-12T17:20:34.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.677+0000 7f3297e00640 1 -- 172.21.15.17:0/2632604800 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32980c30d0 con 0x7f32980ae600 2024-03-12T17:20:34.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.677+0000 7f328f400640 1 -- 172.21.15.17:0/2632604800 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f3284043a70 con 0x7f32980ae600 2024-03-12T17:20:34.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.678+0000 7f328f400640 1 --2- 172.21.15.17:0/2632604800 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f327806ac00 0x7f327806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:34.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.678+0000 7f328f400640 1 -- 172.21.15.17:0/2632604800 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f328403e070 con 0x7f32980ae600 2024-03-12T17:20:34.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.679+0000 7f3296a00640 1 --2- 172.21.15.17:0/2632604800 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f327806ac00 0x7f327806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:34.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.679+0000 7f3296a00640 1 --2- 172.21.15.17:0/2632604800 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f327806ac00 0x7f327806d0c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f328800a830 tx=0x7f3288008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:34.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.683+0000 7f328f400640 1 -- 172.21.15.17:0/2632604800 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f32980c30d0 con 0x7f32980ae600 2024-03-12T17:20:34.873 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.878+0000 7f3297e00640 1 -- 172.21.15.17:0/2632604800 --> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f32980cc200 con 0x7f327806ac00 2024-03-12T17:20:34.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.899+0000 7f328f400640 1 -- 172.21.15.17:0/2632604800 <== mgr.4104 v2:172.21.15.17:6832/37052 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276450 (secure 0 0 0) 0x7f328800adb0 con 0x7f327806ac00 2024-03-12T17:20:34.898 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:20:34.900 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-03-12T17:20:34.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.906+0000 7f3297e00640 1 -- 172.21.15.17:0/2632604800 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f327806ac00 msgr2=0x7f327806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:34.901 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.906+0000 7f3297e00640 1 --2- 172.21.15.17:0/2632604800 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f327806ac00 0x7f327806d0c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f328800a830 tx=0x7f3288008040 comp rx=0 tx=0).stop 2024-03-12T17:20:34.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.906+0000 7f3297e00640 1 -- 172.21.15.17:0/2632604800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32980ae600 msgr2=0x7f3298154a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:34.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.906+0000 7f3297e00640 1 --2- 172.21.15.17:0/2632604800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32980ae600 0x7f3298154a70 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f3284000c00 tx=0x7f3284004730 comp rx=0 tx=0).stop 2024-03-12T17:20:34.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.906+0000 7f3297e00640 1 -- 172.21.15.17:0/2632604800 shutdown_connections 2024-03-12T17:20:34.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.906+0000 7f3297e00640 1 --2- 172.21.15.17:0/2632604800 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f327806ac00 0x7f327806d0c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:34.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.906+0000 7f3297e00640 1 --2- 172.21.15.17:0/2632604800 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f32980cb550 0x7f3298099550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:34.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.906+0000 7f3297e00640 1 --2- 172.21.15.17:0/2632604800 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f32980ae600 0x7f3298154a70 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:34.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.906+0000 7f3297e00640 1 --2- 172.21.15.17:0/2632604800 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3298098e70 0x7f32980c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:34.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.906+0000 7f3297e00640 1 -- 172.21.15.17:0/2632604800 >> 172.21.15.17:0/2632604800 conn(0x7f3298098a60 msgr2=0x7f32980cc7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:34.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.906+0000 7f3297e00640 1 -- 172.21.15.17:0/2632604800 shutdown_connections 2024-03-12T17:20:34.902 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:34.906+0000 7f3297e00640 1 -- 172.21.15.17:0/2632604800 wait complete. 2024-03-12T17:20:34.919 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":98,"stamp":"2024-03-12T17:20:33.513258+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":254108,"kb_used_data":5168,"kb_used_omap":13,"kb_used_meta":248818,"kb_avail":754720612,"statfs":{"total":773094113280,"available":772833906688,"internally_reserved":0,"allocated":5292032,"data_stored":2814950,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":254789720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.835104"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.686610+0000","last_change":"2024-03-12T17:20:27.686610+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.686610+0000","last_undegraded":"2024-03-12T17:20:27.686610+0000","last_fullsized":"2024-03-12T17:20:27.686610+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:42:22.845646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.694409+0000","last_change":"2024-03-12T17:20:27.694409+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.694409+0000","last_undegraded":"2024-03-12T17:20:27.694409+0000","last_fullsized":"2024-03-12T17:20:27.694409+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:19:01.645685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.688814+0000","last_change":"2024-03-12T17:20:27.688814+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.688814+0000","last_undegraded":"2024-03-12T17:20:27.688814+0000","last_fullsized":"2024-03-12T17:20:27.688814+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:15:48.029418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.687409+0000","last_change":"2024-03-12T17:20:27.687409+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.687409+0000","last_undegraded":"2024-03-12T17:20:27.687409+0000","last_fullsized":"2024-03-12T17:20:27.687409+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:42:33.917307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.689853+0000","last_change":"2024-03-12T17:20:27.689853+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.689853+0000","last_undegraded":"2024-03-12T17:20:27.689853+0000","last_fullsized":"2024-03-12T17:20:27.689853+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:42:33.917307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.690064+0000","last_change":"2024-03-12T17:20:27.690064+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.690064+0000","last_undegraded":"2024-03-12T17:20:27.690064+0000","last_fullsized":"2024-03-12T17:20:27.690064+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:51:07.459439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.683279+0000","last_change":"2024-03-12T17:20:27.683279+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.683279+0000","last_undegraded":"2024-03-12T17:20:27.683279+0000","last_fullsized":"2024-03-12T17:20:27.683279+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:54:05.658055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.694408+0000","last_change":"2024-03-12T17:20:27.694408+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.694408+0000","last_undegraded":"2024-03-12T17:20:27.694408+0000","last_fullsized":"2024-03-12T17:20:27.694408+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:35:34.872460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.689370+0000","last_change":"2024-03-12T17:20:27.689370+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.689370+0000","last_undegraded":"2024-03-12T17:20:27.689370+0000","last_fullsized":"2024-03-12T17:20:27.689370+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:40:40.199608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.693268+0000","last_change":"2024-03-12T17:20:27.693268+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.693268+0000","last_undegraded":"2024-03-12T17:20:27.693268+0000","last_fullsized":"2024-03-12T17:20:27.693268+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:40:40.199608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.685548+0000","last_change":"2024-03-12T17:20:27.685548+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.685548+0000","last_undegraded":"2024-03-12T17:20:27.685548+0000","last_fullsized":"2024-03-12T17:20:27.685548+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:42:22.845646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.681627+0000","last_change":"2024-03-12T17:20:27.681627+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.681627+0000","last_undegraded":"2024-03-12T17:20:27.681627+0000","last_fullsized":"2024-03-12T17:20:27.681627+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:40:33.340106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.688302+0000","last_change":"2024-03-12T17:20:27.688302+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.688302+0000","last_undegraded":"2024-03-12T17:20:27.688302+0000","last_fullsized":"2024-03-12T17:20:27.688302+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:24:31.966644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.684908+0000","last_change":"2024-03-12T17:20:27.684908+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.684908+0000","last_undegraded":"2024-03-12T17:20:27.684908+0000","last_fullsized":"2024-03-12T17:20:27.684908+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:40:12.017364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.686527+0000","last_change":"2024-03-12T17:20:27.686527+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.686527+0000","last_undegraded":"2024-03-12T17:20:27.686527+0000","last_fullsized":"2024-03-12T17:20:27.686527+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:25:11.954612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.693799+0000","last_change":"2024-03-12T17:20:27.693799+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.693799+0000","last_undegraded":"2024-03-12T17:20:27.693799+0000","last_fullsized":"2024-03-12T17:20:27.693799+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:22:18.771024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.681889+0000","last_change":"2024-03-12T17:20:27.681889+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.681889+0000","last_undegraded":"2024-03-12T17:20:27.681889+0000","last_fullsized":"2024-03-12T17:20:27.681889+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:20:16.591031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.693468+0000","last_change":"2024-03-12T17:20:27.693468+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.693468+0000","last_undegraded":"2024-03-12T17:20:27.693468+0000","last_fullsized":"2024-03-12T17:20:27.693468+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T05:01:55.583589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.683603+0000","last_change":"2024-03-12T17:20:27.683603+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.683603+0000","last_undegraded":"2024-03-12T17:20:27.683603+0000","last_fullsized":"2024-03-12T17:20:27.683603+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:37:31.324559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.687434+0000","last_change":"2024-03-12T17:20:27.687434+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.687434+0000","last_undegraded":"2024-03-12T17:20:27.687434+0000","last_fullsized":"2024-03-12T17:20:27.687434+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:33:00.215462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.685717+0000","last_change":"2024-03-12T17:20:27.685717+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.685717+0000","last_undegraded":"2024-03-12T17:20:27.685717+0000","last_fullsized":"2024-03-12T17:20:27.685717+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:40:12.017364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.686042+0000","last_change":"2024-03-12T17:20:27.686042+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.686042+0000","last_undegraded":"2024-03-12T17:20:27.686042+0000","last_fullsized":"2024-03-12T17:20:27.686042+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:22:45.140874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.692924+0000","last_change":"2024-03-12T17:20:27.692924+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.692924+0000","last_undegraded":"2024-03-12T17:20:27.692924+0000","last_fullsized":"2024-03-12T17:20:27.692924+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:09:46.909429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.684627+0000","last_change":"2024-03-12T17:20:27.684627+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.684627+0000","last_undegraded":"2024-03-12T17:20:27.684627+0000","last_fullsized":"2024-03-12T17:20:27.684627+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T00:25:46.901152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.686574+0000","last_change":"2024-03-12T17:20:27.686574+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.686574+0000","last_undegraded":"2024-03-12T17:20:27.686574+0000","last_fullsized":"2024-03-12T17:20:27.686574+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:44:37.644079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.684090+0000","last_change":"2024-03-12T17:20:27.684090+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.684090+0000","last_undegraded":"2024-03-12T17:20:27.684090+0000","last_fullsized":"2024-03-12T17:20:27.684090+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:25:11.954612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.688707+0000","last_change":"2024-03-12T17:20:27.688707+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.688707+0000","last_undegraded":"2024-03-12T17:20:27.688707+0000","last_fullsized":"2024-03-12T17:20:27.688707+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:22:45.140874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.685645+0000","last_change":"2024-03-12T17:20:27.685645+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.685645+0000","last_undegraded":"2024-03-12T17:20:27.685645+0000","last_fullsized":"2024-03-12T17:20:27.685645+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:24:31.966644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.688805+0000","last_change":"2024-03-12T17:20:27.688805+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.688805+0000","last_undegraded":"2024-03-12T17:20:27.688805+0000","last_fullsized":"2024-03-12T17:20:27.688805+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:49:16.580593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.688604+0000","last_change":"2024-03-12T17:20:27.688604+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.688604+0000","last_undegraded":"2024-03-12T17:20:27.688604+0000","last_fullsized":"2024-03-12T17:20:27.688604+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:06:42.471948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.692862+0000","last_change":"2024-03-12T17:20:27.692862+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.692862+0000","last_undegraded":"2024-03-12T17:20:27.692862+0000","last_fullsized":"2024-03-12T17:20:27.692862+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:23:16.616382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-12T17:20:28.676366+0000","last_change":"2024-03-12T17:20:28.676366+0000","last_active":"2024-03-12T17:20:28.676366+0000","last_peered":"2024-03-12T17:20:28.676366+0000","last_clean":"2024-03-12T17:20:28.676366+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:28.676366+0000","last_undegraded":"2024-03-12T17:20:28.676366+0000","last_fullsized":"2024-03-12T17:20:28.676366+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2024-03-12T17:20:27.684620+0000","last_change":"2024-03-12T17:20:27.684620+0000","last_active":"2024-03-12T17:20:27.662672+0000","last_peered":"2024-03-12T17:20:27.662672+0000","last_clean":"2024-03-12T17:20:27.662672+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-12T17:20:27.684620+0000","last_undegraded":"2024-03-12T17:20:27.684620+0000","last_fullsized":"2024-03-12T17:20:27.684620+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:34:52.559454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":181,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-03-12T17:20:24.776206+0000","last_change":"2024-03-12T17:18:41.331756+0000","last_active":"2024-03-12T17:20:24.776206+0000","last_peered":"2024-03-12T17:20:24.776206+0000","last_clean":"2024-03-12T17:20:24.776206+0000","last_became_active":"2024-03-12T17:18:41.329237+0000","last_became_peered":"2024-03-12T17:18:41.329237+0000","last_unstale":"2024-03-12T17:20:24.776206+0000","last_undegraded":"2024-03-12T17:20:24.776206+0000","last_fullsized":"2024-03-12T17:20:24.776206+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:40.152422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:40.152422+0000","last_clean_scrub_stamp":"2024-03-12T17:18:40.152422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:35:43.664403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1097728,"data_stored":790282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.85099999999999998}]},{"osd":1,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":1.3},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":1.0509999999999999}]},{"osd":2,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":1.101},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":1.4510000000000001}]},{"osd":3,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":1.2210000000000001}]},{"osd":4,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":2.2490000000000001,"5min":2.2490000000000001,"15min":2.2490000000000001},"last":1.341}]},{"osd":5,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.1909999999999998,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.393},{"interface":"front","average":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":3.9689999999999999,"5min":3.9689999999999999,"15min":3.9689999999999999},"last":1.262}]},{"osd":6,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":3.8319999999999999,"5min":3.8319999999999999,"15min":3.8319999999999999},"last":1.157},{"interface":"front","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":0.89000000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31620,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":516096,"data_stored":205731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.5390000000000001,"5min":3.5390000000000001,"15min":3.5390000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":0.79500000000000004}]},{"osd":1,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.85199999999999998}]},{"osd":2,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.9689999999999999,"5min":2.9689999999999999,"15min":2.9689999999999999},"last":1.1970000000000001}]},{"osd":3,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":1.399},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":1.1120000000000001}]},{"osd":4,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.4750000000000001}]},{"osd":5,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.8660000000000001,"5min":2.8660000000000001,"15min":2.8660000000000001},"last":1.522},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.931,"5min":2.931,"15min":2.931},"last":1.657}]},{"osd":7,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":1.591},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":1.98,"5min":1.98,"15min":1.98},"last":1.7330000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":503808,"data_stored":199914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.8149999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":0.76900000000000002}]},{"osd":1,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":2.5699999999999998,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":1.6859999999999999}]},{"osd":2,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.613,"5min":2.613,"15min":2.613},"last":1.385},{"interface":"front","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.359,"5min":2.359,"15min":2.359},"last":0.93700000000000006}]},{"osd":3,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":1.5660000000000001},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":2.0670000000000002,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":1.1859999999999999}]},{"osd":4,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.7809999999999999}]},{"osd":6,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":2.4609999999999999,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":2.4449999999999998},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":2.2759999999999998}]},{"osd":7,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"min":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"max":{"1min":2.8700000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.8939999999999999},{"interface":"front","average":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"min":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"max":{"1min":2.722,"5min":2.722,"15min":2.722},"last":1.7210000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":516096,"data_stored":205731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":4.8979999999999997,"5min":4.8979999999999997,"15min":4.8979999999999997},"last":1.27},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":4.8300000000000001,"5min":4.8300000000000001,"15min":4.8300000000000001},"last":1.1779999999999999}]},{"osd":1,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":4.7779999999999996,"5min":4.7779999999999996,"15min":4.7779999999999996},"last":1.218},{"interface":"front","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":1.0269999999999999}]},{"osd":2,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.6240000000000001},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.3220000000000001,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":1.365}]},{"osd":3,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":1.5620000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.3340000000000001}]},{"osd":5,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.431},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":1.5840000000000001}]},{"osd":6,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.405},{"interface":"front","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":2.4750000000000001,"5min":2.4750000000000001,"15min":2.4750000000000001},"last":1.4950000000000001}]},{"osd":7,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.728},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.4260000000000002,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":1.5269999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":516096,"data_stored":205731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.9580000000000002,"5min":2.9580000000000002,"15min":2.9580000000000002},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":3.9940000000000002,"5min":3.9940000000000002,"15min":3.9940000000000002},"last":0.71799999999999997}]},{"osd":1,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":4.774,"5min":4.774,"15min":4.774},"last":1.034},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":5.0069999999999997,"5min":5.0069999999999997,"15min":5.0069999999999997},"last":1.1679999999999999}]},{"osd":2,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":2.4660000000000002,"5min":2.4660000000000002,"15min":2.4660000000000002},"last":1.1379999999999999},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":4.5650000000000004,"5min":4.5650000000000004,"15min":4.5650000000000004},"last":1.458}]},{"osd":4,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.482,"15min":1.482},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":2.8860000000000001,"5min":2.8860000000000001,"15min":2.8860000000000001},"last":0.997},{"interface":"front","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":4.3520000000000003,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":1.3169999999999999}]},{"osd":5,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":2.843,"5min":2.843,"15min":2.843},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.8149999999999999,"5min":2.8149999999999999,"15min":2.8149999999999999},"last":1.2350000000000001}]},{"osd":6,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":2.9199999999999999,"5min":2.9199999999999999,"15min":2.9199999999999999},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":2.6589999999999998,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":0.88400000000000001}]},{"osd":7,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"min":{"1min":1.006,"5min":1.006,"15min":1.006},"max":{"1min":4.6600000000000001,"5min":4.6600000000000001,"15min":4.6600000000000001},"last":1.202},{"interface":"front","average":{"1min":1.599,"5min":1.599,"15min":1.599},"min":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"max":{"1min":4.4720000000000004,"5min":4.4720000000000004,"15min":4.4720000000000004},"last":1.556}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":516096,"data_stored":205731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":3.1829999999999998,"5min":3.1829999999999998,"15min":3.1829999999999998},"last":0.80400000000000005},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":1.0369999999999999}]},{"osd":1,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":0.749},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":3.1019999999999999,"5min":3.1019999999999999,"15min":3.1019999999999999},"last":1.2869999999999999}]},{"osd":3,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":2.7810000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":1.004},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":3.1419999999999999,"5min":3.1419999999999999,"15min":3.1419999999999999},"last":1.425}]},{"osd":4,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.643,"5min":1.643,"15min":1.643},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":7.96,"5min":7.96,"15min":7.96},"last":1.5269999999999999},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":3.3780000000000001,"5min":3.3780000000000001,"15min":3.3780000000000001},"last":1.181}]},{"osd":5,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":4.0659999999999998,"5min":4.0659999999999998,"15min":4.0659999999999998},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":3.012,"5min":3.012,"15min":3.012},"last":1.1479999999999999}]},{"osd":6,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":3.2330000000000001,"5min":3.2330000000000001,"15min":3.2330000000000001},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.804,"5min":1.804,"15min":1.804},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":7.9059999999999997,"5min":7.9059999999999997,"15min":7.9059999999999997},"last":1.591}]},{"osd":7,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":4.0229999999999997,"5min":4.0229999999999997,"15min":4.0229999999999997},"last":1.341},{"interface":"front","average":{"1min":1.506,"5min":1.506,"15min":1.506},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":3.27,"5min":3.27,"15min":3.27},"last":1.2569999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31620,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340220,"statfs":{"total":96636764160,"available":96604385280,"internally_reserved":0,"allocated":516096,"data_stored":205731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.581,"5min":2.581,"15min":2.581},"last":0.96399999999999997}]},{"osd":2,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.5720000000000001,"5min":2.5720000000000001,"15min":2.5720000000000001},"last":0.66200000000000003}]},{"osd":3,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.4580000000000002,"5min":2.4580000000000002,"15min":2.4580000000000002},"last":0.75600000000000001},{"interface":"front","average":{"1min":1.208,"5min":1.208,"15min":1.208},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.9609999999999999,"5min":2.9609999999999999,"15min":2.9609999999999999},"last":1.0449999999999999}]},{"osd":4,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":2.4580000000000002,"5min":2.4580000000000002,"15min":2.4580000000000002},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.6909999999999998,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":0.70999999999999996}]},{"osd":5,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":3.0609999999999999,"5min":3.0609999999999999,"15min":3.0609999999999999},"last":1.004},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":0.84599999999999997}]},{"osd":6,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":3.1030000000000002,"5min":3.1030000000000002,"15min":3.1030000000000002},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.395,"5min":1.395,"15min":1.395},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.274,"5min":2.274,"15min":2.274},"last":0.90300000000000002}]},{"osd":7,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.7959999999999998,"5min":2.7959999999999998,"15min":2.7959999999999998},"last":0.877},{"interface":"front","average":{"1min":1.55,"5min":1.55,"15min":1.55},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":3.1440000000000001,"5min":3.1440000000000001,"15min":3.1440000000000001},"last":0.85799999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1084,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1110016,"data_stored":796099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.879},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.2729999999999999}]},{"osd":2,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.99,"5min":1.99,"15min":1.99},"last":0.75},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":1.353}]},{"osd":3,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":1.3779999999999999}]},{"osd":4,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":3.2349999999999999,"5min":3.2349999999999999,"15min":3.2349999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":2.5369999999999999,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":1.194}]},{"osd":5,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.988,"5min":2.988,"15min":2.988},"last":1.4970000000000001},{"interface":"front","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.843,"5min":2.843,"15min":2.843},"last":1.016}]},{"osd":6,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":2.431,"5min":2.431,"15min":2.431},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.589,"5min":2.589,"15min":2.589},"last":1.671}]},{"osd":7,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.637,"5min":1.637,"15min":1.637},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":1.607},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":2.8929999999999998,"5min":2.8929999999999998,"15min":2.8929999999999998},"last":1.1439999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-12T17:20:34.924 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3f is not active+clean 2024-03-12T17:20:34.924 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.924 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3e is not active+clean 2024-03-12T17:20:34.924 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.924 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3d is not active+clean 2024-03-12T17:20:34.924 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.924 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3c is not active+clean 2024-03-12T17:20:34.924 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.924 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3b is not active+clean 2024-03-12T17:20:34.924 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.925 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3a is not active+clean 2024-03-12T17:20:34.925 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.925 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.39 is not active+clean 2024-03-12T17:20:34.925 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.925 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.38 is not active+clean 2024-03-12T17:20:34.925 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.925 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.37 is not active+clean 2024-03-12T17:20:34.925 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.925 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.36 is not active+clean 2024-03-12T17:20:34.925 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.926 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.35 is not active+clean 2024-03-12T17:20:34.926 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.926 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.34 is not active+clean 2024-03-12T17:20:34.926 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.926 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.33 is not active+clean 2024-03-12T17:20:34.926 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.926 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.32 is not active+clean 2024-03-12T17:20:34.926 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.926 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.31 is not active+clean 2024-03-12T17:20:34.926 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.927 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.30 is not active+clean 2024-03-12T17:20:34.927 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.927 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2f is not active+clean 2024-03-12T17:20:34.927 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.927 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2e is not active+clean 2024-03-12T17:20:34.927 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.927 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2d is not active+clean 2024-03-12T17:20:34.927 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.927 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2c is not active+clean 2024-03-12T17:20:34.927 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.927 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2b is not active+clean 2024-03-12T17:20:34.928 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.928 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2a is not active+clean 2024-03-12T17:20:34.928 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.928 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.29 is not active+clean 2024-03-12T17:20:34.928 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.928 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.28 is not active+clean 2024-03-12T17:20:34.928 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.928 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.27 is not active+clean 2024-03-12T17:20:34.928 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.928 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.26 is not active+clean 2024-03-12T17:20:34.928 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.928 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.25 is not active+clean 2024-03-12T17:20:34.929 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.929 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.24 is not active+clean 2024-03-12T17:20:34.929 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.929 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.23 is not active+clean 2024-03-12T17:20:34.929 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.929 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.22 is not active+clean 2024-03-12T17:20:34.929 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.929 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.21 is not active+clean 2024-03-12T17:20:34.929 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.929 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.20 is not active+clean 2024-03-12T17:20:34.930 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.930 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1e is not active+clean 2024-03-12T17:20:34.930 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.930 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2024-03-12T17:20:34.930 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-03-12T17:20:27.686610+0000', 'last_change': '2024-03-12T17:20:27.686610+0000', 'last_active': '2024-03-12T17:20:27.662672+0000', 'last_peered': '2024-03-12T17:20:27.662672+0000', 'last_clean': '2024-03-12T17:20:27.662672+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:27.686610+0000', 'last_undegraded': '2024-03-12T17:20:27.686610+0000', 'last_fullsized': '2024-03-12T17:20:27.686610+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-13T20:42:22.845646+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-12T17:20:34.930 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2024-03-12T17:20:34.930 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.930 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2024-03-12T17:20:34.930 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-03-12T17:20:27.694409+0000', 'last_change': '2024-03-12T17:20:27.694409+0000', 'last_active': '2024-03-12T17:20:27.662672+0000', 'last_peered': '2024-03-12T17:20:27.662672+0000', 'last_clean': '2024-03-12T17:20:27.662672+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:27.694409+0000', 'last_undegraded': '2024-03-12T17:20:27.694409+0000', 'last_fullsized': '2024-03-12T17:20:27.694409+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-13T18:19:01.645685+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-12T17:20:34.930 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1c is not active+clean 2024-03-12T17:20:34.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.931 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2024-03-12T17:20:34.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-03-12T17:20:27.688814+0000', 'last_change': '2024-03-12T17:20:27.688814+0000', 'last_active': '2024-03-12T17:20:27.662672+0000', 'last_peered': '2024-03-12T17:20:27.662672+0000', 'last_clean': '2024-03-12T17:20:27.662672+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:27.688814+0000', 'last_undegraded': '2024-03-12T17:20:27.688814+0000', 'last_fullsized': '2024-03-12T17:20:27.688814+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-14T04:15:48.029418+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-12T17:20:34.931 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1d is not active+clean 2024-03-12T17:20:34.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.931 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2024-03-12T17:20:34.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-03-12T17:20:27.687409+0000', 'last_change': '2024-03-12T17:20:27.687409+0000', 'last_active': '2024-03-12T17:20:27.662672+0000', 'last_peered': '2024-03-12T17:20:27.662672+0000', 'last_clean': '2024-03-12T17:20:27.662672+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:27.687409+0000', 'last_undegraded': '2024-03-12T17:20:27.687409+0000', 'last_fullsized': '2024-03-12T17:20:27.687409+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-13T23:42:33.917307+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-12T17:20:34.931 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2024-03-12T17:20:34.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.931 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2024-03-12T17:20:34.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-03-12T17:20:27.689853+0000', 'last_change': '2024-03-12T17:20:27.689853+0000', 'last_active': '2024-03-12T17:20:27.662672+0000', 'last_peered': '2024-03-12T17:20:27.662672+0000', 'last_clean': '2024-03-12T17:20:27.662672+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:27.689853+0000', 'last_undegraded': '2024-03-12T17:20:27.689853+0000', 'last_fullsized': '2024-03-12T17:20:27.689853+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-13T23:42:33.917307+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-12T17:20:34.932 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1b is not active+clean 2024-03-12T17:20:34.932 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.932 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2024-03-12T17:20:34.932 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-03-12T17:20:27.690064+0000', 'last_change': '2024-03-12T17:20:27.690064+0000', 'last_active': '2024-03-12T17:20:27.662672+0000', 'last_peered': '2024-03-12T17:20:27.662672+0000', 'last_clean': '2024-03-12T17:20:27.662672+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:27.690064+0000', 'last_undegraded': '2024-03-12T17:20:27.690064+0000', 'last_fullsized': '2024-03-12T17:20:27.690064+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-14T01:51:07.459439+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-12T17:20:34.932 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.18 is not active+clean 2024-03-12T17:20:34.932 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.932 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2024-03-12T17:20:34.932 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-03-12T17:20:27.683279+0000', 'last_change': '2024-03-12T17:20:27.683279+0000', 'last_active': '2024-03-12T17:20:27.662672+0000', 'last_peered': '2024-03-12T17:20:27.662672+0000', 'last_clean': '2024-03-12T17:20:27.662672+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:27.683279+0000', 'last_undegraded': '2024-03-12T17:20:27.683279+0000', 'last_fullsized': '2024-03-12T17:20:27.683279+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-14T04:54:05.658055+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-12T17:20:34.932 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2024-03-12T17:20:34.932 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.933 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2024-03-12T17:20:34.933 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-03-12T17:20:27.694408+0000', 'last_change': '2024-03-12T17:20:27.694408+0000', 'last_active': '2024-03-12T17:20:27.662672+0000', 'last_peered': '2024-03-12T17:20:27.662672+0000', 'last_clean': '2024-03-12T17:20:27.662672+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:27.694408+0000', 'last_undegraded': '2024-03-12T17:20:27.694408+0000', 'last_fullsized': '2024-03-12T17:20:27.694408+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-14T03:35:34.872460+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-12T17:20:34.933 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2024-03-12T17:20:34.933 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.933 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2024-03-12T17:20:34.933 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-03-12T17:20:27.689370+0000', 'last_change': '2024-03-12T17:20:27.689370+0000', 'last_active': '2024-03-12T17:20:27.662672+0000', 'last_peered': '2024-03-12T17:20:27.662672+0000', 'last_clean': '2024-03-12T17:20:27.662672+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:27.689370+0000', 'last_undegraded': '2024-03-12T17:20:27.689370+0000', 'last_fullsized': '2024-03-12T17:20:27.689370+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-13T17:40:40.199608+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-12T17:20:34.933 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2024-03-12T17:20:34.933 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.933 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2024-03-12T17:20:34.933 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-03-12T17:20:27.693268+0000', 'last_change': '2024-03-12T17:20:27.693268+0000', 'last_active': '2024-03-12T17:20:27.662672+0000', 'last_peered': '2024-03-12T17:20:27.662672+0000', 'last_clean': '2024-03-12T17:20:27.662672+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:27.693268+0000', 'last_undegraded': '2024-03-12T17:20:27.693268+0000', 'last_fullsized': '2024-03-12T17:20:27.693268+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-13T17:40:40.199608+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-12T17:20:34.933 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.14 is not active+clean 2024-03-12T17:20:34.933 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.934 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2024-03-12T17:20:34.934 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-03-12T17:20:27.685548+0000', 'last_change': '2024-03-12T17:20:27.685548+0000', 'last_active': '2024-03-12T17:20:27.662672+0000', 'last_peered': '2024-03-12T17:20:27.662672+0000', 'last_clean': '2024-03-12T17:20:27.662672+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:27.685548+0000', 'last_undegraded': '2024-03-12T17:20:27.685548+0000', 'last_fullsized': '2024-03-12T17:20:27.685548+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-13T20:42:22.845646+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-12T17:20:34.934 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2024-03-12T17:20:34.934 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.934 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2024-03-12T17:20:34.934 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-03-12T17:20:27.681627+0000', 'last_change': '2024-03-12T17:20:27.681627+0000', 'last_active': '2024-03-12T17:20:27.662672+0000', 'last_peered': '2024-03-12T17:20:27.662672+0000', 'last_clean': '2024-03-12T17:20:27.662672+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:27.681627+0000', 'last_undegraded': '2024-03-12T17:20:27.681627+0000', 'last_fullsized': '2024-03-12T17:20:27.681627+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-14T01:40:33.340106+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-12T17:20:34.934 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2024-03-12T17:20:34.934 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.934 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2024-03-12T17:20:34.934 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-03-12T17:20:27.688302+0000', 'last_change': '2024-03-12T17:20:27.688302+0000', 'last_active': '2024-03-12T17:20:27.662672+0000', 'last_peered': '2024-03-12T17:20:27.662672+0000', 'last_clean': '2024-03-12T17:20:27.662672+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:27.688302+0000', 'last_undegraded': '2024-03-12T17:20:27.688302+0000', 'last_fullsized': '2024-03-12T17:20:27.688302+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-14T01:24:31.966644+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-12T17:20:34.935 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.13 is not active+clean 2024-03-12T17:20:34.935 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.935 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2024-03-12T17:20:34.935 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-03-12T17:20:27.684908+0000', 'last_change': '2024-03-12T17:20:27.684908+0000', 'last_active': '2024-03-12T17:20:27.662672+0000', 'last_peered': '2024-03-12T17:20:27.662672+0000', 'last_clean': '2024-03-12T17:20:27.662672+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:27.684908+0000', 'last_undegraded': '2024-03-12T17:20:27.684908+0000', 'last_fullsized': '2024-03-12T17:20:27.684908+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-13T22:40:12.017364+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-12T17:20:34.935 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.10 is not active+clean 2024-03-12T17:20:34.935 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.935 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2024-03-12T17:20:34.935 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-03-12T17:20:27.686527+0000', 'last_change': '2024-03-12T17:20:27.686527+0000', 'last_active': '2024-03-12T17:20:27.662672+0000', 'last_peered': '2024-03-12T17:20:27.662672+0000', 'last_clean': '2024-03-12T17:20:27.662672+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:27.686527+0000', 'last_undegraded': '2024-03-12T17:20:27.686527+0000', 'last_fullsized': '2024-03-12T17:20:27.686527+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-13T17:25:11.954612+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-12T17:20:34.935 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2024-03-12T17:20:34.935 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.935 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2024-03-12T17:20:34.935 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-03-12T17:20:27.693799+0000', 'last_change': '2024-03-12T17:20:27.693799+0000', 'last_active': '2024-03-12T17:20:27.662672+0000', 'last_peered': '2024-03-12T17:20:27.662672+0000', 'last_clean': '2024-03-12T17:20:27.662672+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:27.693799+0000', 'last_undegraded': '2024-03-12T17:20:27.693799+0000', 'last_fullsized': '2024-03-12T17:20:27.693799+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-14T03:22:18.771024+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-12T17:20:34.936 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.e is not active+clean 2024-03-12T17:20:34.936 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.936 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2024-03-12T17:20:34.936 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-03-12T17:20:27.681889+0000', 'last_change': '2024-03-12T17:20:27.681889+0000', 'last_active': '2024-03-12T17:20:27.662672+0000', 'last_peered': '2024-03-12T17:20:27.662672+0000', 'last_clean': '2024-03-12T17:20:27.662672+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:27.681889+0000', 'last_undegraded': '2024-03-12T17:20:27.681889+0000', 'last_fullsized': '2024-03-12T17:20:27.681889+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-14T02:20:16.591031+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-03-12T17:20:34.936 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.f is not active+clean 2024-03-12T17:20:34.936 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.936 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2024-03-12T17:20:34.936 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-03-12T17:20:27.693468+0000', 'last_change': '2024-03-12T17:20:27.693468+0000', 'last_active': '2024-03-12T17:20:27.662672+0000', 'last_peered': '2024-03-12T17:20:27.662672+0000', 'last_clean': '2024-03-12T17:20:27.662672+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:27.693468+0000', 'last_undegraded': '2024-03-12T17:20:27.693468+0000', 'last_fullsized': '2024-03-12T17:20:27.693468+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-14T05:01:55.583589+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-12T17:20:34.936 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2024-03-12T17:20:34.936 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.936 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2024-03-12T17:20:34.937 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-03-12T17:20:27.683603+0000', 'last_change': '2024-03-12T17:20:27.683603+0000', 'last_active': '2024-03-12T17:20:27.662672+0000', 'last_peered': '2024-03-12T17:20:27.662672+0000', 'last_clean': '2024-03-12T17:20:27.662672+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:27.683603+0000', 'last_undegraded': '2024-03-12T17:20:27.683603+0000', 'last_fullsized': '2024-03-12T17:20:27.683603+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-13T18:37:31.324559+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-12T17:20:34.937 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2024-03-12T17:20:34.937 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.937 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2024-03-12T17:20:34.937 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-03-12T17:20:27.687434+0000', 'last_change': '2024-03-12T17:20:27.687434+0000', 'last_active': '2024-03-12T17:20:27.662672+0000', 'last_peered': '2024-03-12T17:20:27.662672+0000', 'last_clean': '2024-03-12T17:20:27.662672+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:27.687434+0000', 'last_undegraded': '2024-03-12T17:20:27.687434+0000', 'last_fullsized': '2024-03-12T17:20:27.687434+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-13T22:33:00.215462+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-12T17:20:34.937 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.a is not active+clean 2024-03-12T17:20:34.937 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.937 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2024-03-12T17:20:34.937 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-03-12T17:20:27.685717+0000', 'last_change': '2024-03-12T17:20:27.685717+0000', 'last_active': '2024-03-12T17:20:27.662672+0000', 'last_peered': '2024-03-12T17:20:27.662672+0000', 'last_clean': '2024-03-12T17:20:27.662672+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:27.685717+0000', 'last_undegraded': '2024-03-12T17:20:27.685717+0000', 'last_fullsized': '2024-03-12T17:20:27.685717+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-13T22:40:12.017364+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-12T17:20:34.937 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.b is not active+clean 2024-03-12T17:20:34.937 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.938 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2024-03-12T17:20:34.938 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-03-12T17:20:27.686042+0000', 'last_change': '2024-03-12T17:20:27.686042+0000', 'last_active': '2024-03-12T17:20:27.662672+0000', 'last_peered': '2024-03-12T17:20:27.662672+0000', 'last_clean': '2024-03-12T17:20:27.662672+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:27.686042+0000', 'last_undegraded': '2024-03-12T17:20:27.686042+0000', 'last_fullsized': '2024-03-12T17:20:27.686042+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-13T23:22:45.140874+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-12T17:20:34.938 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.8 is not active+clean 2024-03-12T17:20:34.938 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.938 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2024-03-12T17:20:34.938 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-03-12T17:20:27.692924+0000', 'last_change': '2024-03-12T17:20:27.692924+0000', 'last_active': '2024-03-12T17:20:27.662672+0000', 'last_peered': '2024-03-12T17:20:27.662672+0000', 'last_clean': '2024-03-12T17:20:27.662672+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:27.692924+0000', 'last_undegraded': '2024-03-12T17:20:27.692924+0000', 'last_fullsized': '2024-03-12T17:20:27.692924+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-14T04:09:46.909429+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-12T17:20:34.938 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2024-03-12T17:20:34.938 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.938 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2024-03-12T17:20:34.938 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-03-12T17:20:27.684627+0000', 'last_change': '2024-03-12T17:20:27.684627+0000', 'last_active': '2024-03-12T17:20:27.662672+0000', 'last_peered': '2024-03-12T17:20:27.662672+0000', 'last_clean': '2024-03-12T17:20:27.662672+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:27.684627+0000', 'last_undegraded': '2024-03-12T17:20:27.684627+0000', 'last_fullsized': '2024-03-12T17:20:27.684627+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-14T00:25:46.901152+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-12T17:20:34.939 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2024-03-12T17:20:34.939 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.939 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2024-03-12T17:20:34.939 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-03-12T17:20:27.686574+0000', 'last_change': '2024-03-12T17:20:27.686574+0000', 'last_active': '2024-03-12T17:20:27.662672+0000', 'last_peered': '2024-03-12T17:20:27.662672+0000', 'last_clean': '2024-03-12T17:20:27.662672+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:27.686574+0000', 'last_undegraded': '2024-03-12T17:20:27.686574+0000', 'last_fullsized': '2024-03-12T17:20:27.686574+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-13T21:44:37.644079+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-03-12T17:20:34.939 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.4 is not active+clean 2024-03-12T17:20:34.939 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.939 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2024-03-12T17:20:34.939 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-03-12T17:20:27.684090+0000', 'last_change': '2024-03-12T17:20:27.684090+0000', 'last_active': '2024-03-12T17:20:27.662672+0000', 'last_peered': '2024-03-12T17:20:27.662672+0000', 'last_clean': '2024-03-12T17:20:27.662672+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:27.684090+0000', 'last_undegraded': '2024-03-12T17:20:27.684090+0000', 'last_fullsized': '2024-03-12T17:20:27.684090+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-13T17:25:11.954612+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-12T17:20:34.939 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2024-03-12T17:20:34.939 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.939 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2024-03-12T17:20:34.939 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-03-12T17:20:27.688707+0000', 'last_change': '2024-03-12T17:20:27.688707+0000', 'last_active': '2024-03-12T17:20:27.662672+0000', 'last_peered': '2024-03-12T17:20:27.662672+0000', 'last_clean': '2024-03-12T17:20:27.662672+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:27.688707+0000', 'last_undegraded': '2024-03-12T17:20:27.688707+0000', 'last_fullsized': '2024-03-12T17:20:27.688707+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-13T23:22:45.140874+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-12T17:20:34.940 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2 is not active+clean 2024-03-12T17:20:34.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.940 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2024-03-12T17:20:34.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-03-12T17:20:27.685645+0000', 'last_change': '2024-03-12T17:20:27.685645+0000', 'last_active': '2024-03-12T17:20:27.662672+0000', 'last_peered': '2024-03-12T17:20:27.662672+0000', 'last_clean': '2024-03-12T17:20:27.662672+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:27.685645+0000', 'last_undegraded': '2024-03-12T17:20:27.685645+0000', 'last_fullsized': '2024-03-12T17:20:27.685645+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-14T01:24:31.966644+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-12T17:20:34.940 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3 is not active+clean 2024-03-12T17:20:34.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.940 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2024-03-12T17:20:34.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-03-12T17:20:27.688805+0000', 'last_change': '2024-03-12T17:20:27.688805+0000', 'last_active': '2024-03-12T17:20:27.662672+0000', 'last_peered': '2024-03-12T17:20:27.662672+0000', 'last_clean': '2024-03-12T17:20:27.662672+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:27.688805+0000', 'last_undegraded': '2024-03-12T17:20:27.688805+0000', 'last_fullsized': '2024-03-12T17:20:27.688805+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-13T17:49:16.580593+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-12T17:20:34.940 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2024-03-12T17:20:34.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.940 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2024-03-12T17:20:34.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-03-12T17:20:27.688604+0000', 'last_change': '2024-03-12T17:20:27.688604+0000', 'last_active': '2024-03-12T17:20:27.662672+0000', 'last_peered': '2024-03-12T17:20:27.662672+0000', 'last_clean': '2024-03-12T17:20:27.662672+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:27.688604+0000', 'last_undegraded': '2024-03-12T17:20:27.688604+0000', 'last_fullsized': '2024-03-12T17:20:27.688604+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-13T21:06:42.471948+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-03-12T17:20:34.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2024-03-12T17:20:34.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2024-03-12T17:20:34.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-03-12T17:20:27.692862+0000', 'last_change': '2024-03-12T17:20:27.692862+0000', 'last_active': '2024-03-12T17:20:27.662672+0000', 'last_peered': '2024-03-12T17:20:27.662672+0000', 'last_clean': '2024-03-12T17:20:27.662672+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:27.692862+0000', 'last_undegraded': '2024-03-12T17:20:27.692862+0000', 'last_fullsized': '2024-03-12T17:20:27.692862+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-13T23:23:16.616382+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-12T17:20:34.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.6 is not active+clean 2024-03-12T17:20:34.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-12T17:20:28.676366+0000', 'last_change': '2024-03-12T17:20:28.676366+0000', 'last_active': '2024-03-12T17:20:28.676366+0000', 'last_peered': '2024-03-12T17:20:28.676366+0000', 'last_clean': '2024-03-12T17:20:28.676366+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:28.676366+0000', 'last_undegraded': '2024-03-12T17:20:28.676366+0000', 'last_fullsized': '2024-03-12T17:20:28.676366+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:28.676366+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-12T17:20:34.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2024-03-12T17:20:34.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2024-03-12T17:20:27.684620+0000', 'last_change': '2024-03-12T17:20:27.684620+0000', 'last_active': '2024-03-12T17:20:27.662672+0000', 'last_peered': '2024-03-12T17:20:27.662672+0000', 'last_clean': '2024-03-12T17:20:27.662672+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-12T17:20:27.684620+0000', 'last_undegraded': '2024-03-12T17:20:27.684620+0000', 'last_fullsized': '2024-03-12T17:20:27.684620+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'last_clean_scrub_stamp': '2024-03-12T17:20:27.662672+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-03-13T20:34:52.559454+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-12T17:20:34.942 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-03-12T17:20:35.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.193+0000 7f1d9f000640 1 Processor -- start 2024-03-12T17:20:35.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.193+0000 7f1d9f000640 1 -- start start 2024-03-12T17:20:35.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.195+0000 7f1d9f000640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1d981441f0 0x7f1d98070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:35.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.195+0000 7f1d9f000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1d980b3b70 0x7f1d980b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:35.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.195+0000 7f1d9f000640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d980a7660 con 0x7f1d9815ae20 2024-03-12T17:20:35.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.195+0000 7f1d9f000640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d9815e460 con 0x7f1d981441f0 2024-03-12T17:20:35.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.195+0000 7f1d9f000640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9806d840 con 0x7f1d980b3b70 2024-03-12T17:20:35.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.195+0000 7f1d9d200640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f1d9815ae20 0x7f1d9806d130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:43422/0 (socket says 172.21.15.17:43422) 2024-03-12T17:20:35.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.195+0000 7f1d9d200640 1 -- 172.21.15.17:0/2279232034 learned_addr learned my addr 172.21.15.17:0/2279232034 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:20:35.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.195+0000 7f1d9e600640 1 --2- 172.21.15.17:0/2279232034 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1d980b3b70 0x7f1d980b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:35.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.196+0000 7f1d9dc00640 1 --2- 172.21.15.17:0/2279232034 >> v2:172.21.15.94:3300/0 conn(0x7f1d981441f0 0x7f1d98070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:35.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.196+0000 7f1d97e00640 1 -- 172.21.15.17:0/2279232034 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3662806367 0 0) 0x7f1d980a7660 con 0x7f1d9815ae20 2024-03-12T17:20:35.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.196+0000 7f1d97e00640 1 -- 172.21.15.17:0/2279232034 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d80003520 con 0x7f1d9815ae20 2024-03-12T17:20:35.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.196+0000 7f1d97e00640 1 -- 172.21.15.17:0/2279232034 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1700272276 0 0) 0x7f1d80003520 con 0x7f1d9815ae20 2024-03-12T17:20:35.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.196+0000 7f1d97e00640 1 -- 172.21.15.17:0/2279232034 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1d980b3b70 msgr2=0x7f1d980b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:35.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.196+0000 7f1d97e00640 1 --2- 172.21.15.17:0/2279232034 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1d980b3b70 0x7f1d980b3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:35.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.196+0000 7f1d97e00640 1 -- 172.21.15.17:0/2279232034 >> v2:172.21.15.94:3300/0 conn(0x7f1d981441f0 msgr2=0x7f1d98070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:35.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.196+0000 7f1d97e00640 1 --2- 172.21.15.17:0/2279232034 >> v2:172.21.15.94:3300/0 conn(0x7f1d981441f0 0x7f1d98070240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:35.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.196+0000 7f1d97e00640 1 -- 172.21.15.17:0/2279232034 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d980b44e0 con 0x7f1d9815ae20 2024-03-12T17:20:35.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.196+0000 7f1d97e00640 1 -- 172.21.15.17:0/2279232034 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7f1d84001670 con 0x7f1d9815ae20 2024-03-12T17:20:35.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.196+0000 7f1d97e00640 1 -- 172.21.15.17:0/2279232034 >> v1:172.21.15.17:6789/0 conn(0x7f1d9815ae20 legacy=0x7f1d9806d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:35.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.196+0000 7f1d97e00640 1 --2- 172.21.15.17:0/2279232034 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d80003970 0x7f1d80003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:35.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.196+0000 7f1d97e00640 1 --2- 172.21.15.17:0/2279232034 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1d980b3b70 0x7f1d800047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:35.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.196+0000 7f1d97e00640 1 --2- 172.21.15.17:0/2279232034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d80004d00 0x7f1d80005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:35.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.196+0000 7f1d97e00640 1 -- 172.21.15.17:0/2279232034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9815e460 con 0x7f1d80004d00 2024-03-12T17:20:35.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.196+0000 7f1d97e00640 1 -- 172.21.15.17:0/2279232034 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9806d840 con 0x7f1d80003970 2024-03-12T17:20:35.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.196+0000 7f1d97e00640 1 -- 172.21.15.17:0/2279232034 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8000fdc0 con 0x7f1d980b3b70 2024-03-12T17:20:35.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.197+0000 7f1d9e600640 1 --2- 172.21.15.17:0/2279232034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d80004d00 0x7f1d80005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:35.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.197+0000 7f1d9d200640 1 --2- 172.21.15.17:0/2279232034 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1d980b3b70 0x7f1d800047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:35.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.197+0000 7f1d9dc00640 1 --2- 172.21.15.17:0/2279232034 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d80003970 0x7f1d80003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:35.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.197+0000 7f1d9e600640 1 -- 172.21.15.17:0/2279232034 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1d980b3b70 msgr2=0x7f1d800047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:35.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.197+0000 7f1d9e600640 1 --2- 172.21.15.17:0/2279232034 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1d980b3b70 0x7f1d800047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:35.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.197+0000 7f1d9e600640 1 -- 172.21.15.17:0/2279232034 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d80003970 msgr2=0x7f1d80003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:35.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.197+0000 7f1d9e600640 1 --2- 172.21.15.17:0/2279232034 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d80003970 0x7f1d80003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:35.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.197+0000 7f1d9e600640 1 -- 172.21.15.17:0/2279232034 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d80003520 con 0x7f1d80004d00 2024-03-12T17:20:35.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.197+0000 7f1d9dc00640 1 --2- 172.21.15.17:0/2279232034 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d80003970 0x7f1d80003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:20:35.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.198+0000 7f1d9e600640 1 --2- 172.21.15.17:0/2279232034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d80004d00 0x7f1d80005180 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f1d90009fc0 tx=0x7f1d800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e630b67f778eb7a server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:35.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.199+0000 7f1d97e00640 1 -- 172.21.15.17:0/2279232034 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9002cc20 con 0x7f1d80004d00 2024-03-12T17:20:35.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.199+0000 7f1d97e00640 1 -- 172.21.15.17:0/2279232034 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9000f040 con 0x7f1d80004d00 2024-03-12T17:20:35.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.199+0000 7f1d97e00640 1 -- 172.21.15.17:0/2279232034 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d90034440 con 0x7f1d80004d00 2024-03-12T17:20:35.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.199+0000 7f1d9f000640 1 -- 172.21.15.17:0/2279232034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d80004d00 msgr2=0x7f1d80005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:35.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.199+0000 7f1d9f000640 1 --2- 172.21.15.17:0/2279232034 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d80004d00 0x7f1d80005180 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f1d90009fc0 tx=0x7f1d800057f0 comp rx=0 tx=0).stop 2024-03-12T17:20:35.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.199+0000 7f1d9e600640 1 -- 172.21.15.17:0/2279232034 reap_dead start 2024-03-12T17:20:35.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.200+0000 7f1d9f000640 1 -- 172.21.15.17:0/2279232034 shutdown_connections 2024-03-12T17:20:35.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.200+0000 7f1d9f000640 1 -- 172.21.15.17:0/2279232034 >> 172.21.15.17:0/2279232034 conn(0x7f1d98069ce0 msgr2=0x7f1d9806a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:35.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.200+0000 7f1d9f000640 1 -- 172.21.15.17:0/2279232034 shutdown_connections 2024-03-12T17:20:35.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.200+0000 7f1d9f000640 1 -- 172.21.15.17:0/2279232034 wait complete. 2024-03-12T17:20:35.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.201+0000 7f1d9f000640 1 Processor -- start 2024-03-12T17:20:35.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.202+0000 7f1d9f000640 1 -- start start 2024-03-12T17:20:35.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.203+0000 7f1d9f000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d80004d00 0x7f1d98159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:35.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.203+0000 7f1d9f000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d981f1220 0x7f1d980aed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:35.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.203+0000 7f1d9f000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1d98140720 0x7f1d98140ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:35.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.203+0000 7f1d9f000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d981410e0 con 0x7f1d981f1220 2024-03-12T17:20:35.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.203+0000 7f1d9f000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d981f19e0 con 0x7f1d80004d00 2024-03-12T17:20:35.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.203+0000 7f1d9f000640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d981f1cc0 con 0x7f1d98140720 2024-03-12T17:20:35.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.203+0000 7f1d9d200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d981f1220 0x7f1d980aed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:35.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.203+0000 7f1d9d200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d981f1220 0x7f1d980aed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58742/0 (socket says 172.21.15.17:58742) 2024-03-12T17:20:35.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.203+0000 7f1d9d200640 1 -- 172.21.15.17:0/3686709792 learned_addr learned my addr 172.21.15.17:0/3686709792 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:35.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.203+0000 7f1d9dc00640 1 --2- 172.21.15.17:0/3686709792 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d80004d00 0x7f1d98159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:35.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.203+0000 7f1d9e600640 1 --2- 172.21.15.17:0/3686709792 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1d98140720 0x7f1d98140ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:35.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.203+0000 7f1d9d200640 1 -- 172.21.15.17:0/3686709792 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1d98140720 msgr2=0x7f1d98140ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:35.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.203+0000 7f1d9d200640 1 --2- 172.21.15.17:0/3686709792 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1d98140720 0x7f1d98140ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:35.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.203+0000 7f1d9d200640 1 -- 172.21.15.17:0/3686709792 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d80004d00 msgr2=0x7f1d98159ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:35.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.203+0000 7f1d9d200640 1 --2- 172.21.15.17:0/3686709792 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d80004d00 0x7f1d98159ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:35.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.203+0000 7f1d9d200640 1 -- 172.21.15.17:0/3686709792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d981f1fa0 con 0x7f1d981f1220 2024-03-12T17:20:35.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.203+0000 7f1d9e600640 1 --2- 172.21.15.17:0/3686709792 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1d98140720 0x7f1d98140ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:35.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.203+0000 7f1d9dc00640 1 --2- 172.21.15.17:0/3686709792 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d80004d00 0x7f1d98159ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:35.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.204+0000 7f1d9d200640 1 --2- 172.21.15.17:0/3686709792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d981f1220 0x7f1d980aed40 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1d8400e780 tx=0x7f1d8400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:35.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.204+0000 7f1d95600640 1 -- 172.21.15.17:0/3686709792 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8400ee90 con 0x7f1d981f1220 2024-03-12T17:20:35.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.204+0000 7f1d95600640 1 -- 172.21.15.17:0/3686709792 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8400c870 con 0x7f1d981f1220 2024-03-12T17:20:35.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.204+0000 7f1d95600640 1 -- 172.21.15.17:0/3686709792 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8400cc00 con 0x7f1d981f1220 2024-03-12T17:20:35.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.204+0000 7f1d9f000640 1 -- 172.21.15.17:0/3686709792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d980ae540 con 0x7f1d981f1220 2024-03-12T17:20:35.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.204+0000 7f1d9f000640 1 -- 172.21.15.17:0/3686709792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d981f16a0 con 0x7f1d981f1220 2024-03-12T17:20:35.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.205+0000 7f1d9f000640 1 -- 172.21.15.17:0/3686709792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d980aea60 con 0x7f1d981f1220 2024-03-12T17:20:35.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.206+0000 7f1d95600640 1 -- 172.21.15.17:0/3686709792 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f1d8401d460 con 0x7f1d981f1220 2024-03-12T17:20:35.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.208+0000 7f1d95600640 1 --2- 172.21.15.17:0/3686709792 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f1d7806ac80 0x7f1d7806d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:35.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.208+0000 7f1d95600640 1 -- 172.21.15.17:0/3686709792 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d84089300 con 0x7f1d981f1220 2024-03-12T17:20:35.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.208+0000 7f1d9dc00640 1 --2- 172.21.15.17:0/3686709792 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f1d7806ac80 0x7f1d7806d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:35.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.209+0000 7f1d9dc00640 1 --2- 172.21.15.17:0/3686709792 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f1d7806ac80 0x7f1d7806d140 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c009a80 tx=0x7f1d8c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:35.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.212+0000 7f1d95600640 1 -- 172.21.15.17:0/3686709792 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f1d980aea60 con 0x7f1d981f1220 2024-03-12T17:20:35.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.481+0000 7f1d9f000640 1 -- 172.21.15.17:0/3686709792 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f1d980aea60 con 0x7f1d981f1220 2024-03-12T17:20:35.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.482+0000 7f1d95600640 1 -- 172.21.15.17:0/3686709792 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1108 (secure 0 0 0) 0x7f1d840544c0 con 0x7f1d981f1220 2024-03-12T17:20:35.478 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:20:35.478 INFO:teuthology.orchestra.run.smithi017.stdout:{"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":129,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":47,"num_osds":8,"num_up_osds":8,"osd_up_since":1710263918,"num_in_osds":8,"osd_in_since":1710263909,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":260206592,"bytes_avail":772833906688,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":22,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5433}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-03-12T17:19:43.494180+0000","services":{}},"progress_events":{}} 2024-03-12T17:20:35.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.484+0000 7f1d9f000640 1 -- 172.21.15.17:0/3686709792 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f1d7806ac80 msgr2=0x7f1d7806d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:35.480 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.484+0000 7f1d9f000640 1 --2- 172.21.15.17:0/3686709792 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f1d7806ac80 0x7f1d7806d140 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c009a80 tx=0x7f1d8c008040 comp rx=0 tx=0).stop 2024-03-12T17:20:35.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.484+0000 7f1d9f000640 1 -- 172.21.15.17:0/3686709792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d981f1220 msgr2=0x7f1d980aed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:35.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.484+0000 7f1d9f000640 1 --2- 172.21.15.17:0/3686709792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d981f1220 0x7f1d980aed40 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1d8400e780 tx=0x7f1d8400ec40 comp rx=0 tx=0).stop 2024-03-12T17:20:35.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.485+0000 7f1d9f000640 1 -- 172.21.15.17:0/3686709792 shutdown_connections 2024-03-12T17:20:35.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.485+0000 7f1d9f000640 1 --2- 172.21.15.17:0/3686709792 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f1d7806ac80 0x7f1d7806d140 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:35.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.485+0000 7f1d9f000640 1 --2- 172.21.15.17:0/3686709792 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1d98140720 0x7f1d98140ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:35.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.485+0000 7f1d9f000640 1 --2- 172.21.15.17:0/3686709792 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1d981f1220 0x7f1d980aed40 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:35.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.485+0000 7f1d9f000640 1 --2- 172.21.15.17:0/3686709792 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1d80004d00 0x7f1d98159ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:35.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.485+0000 7f1d9f000640 1 -- 172.21.15.17:0/3686709792 >> 172.21.15.17:0/3686709792 conn(0x7f1d98069ce0 msgr2=0x7f1d980b2100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:35.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.485+0000 7f1d9f000640 1 -- 172.21.15.17:0/3686709792 shutdown_connections 2024-03-12T17:20:35.481 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.485+0000 7f1d9f000640 1 -- 172.21.15.17:0/3686709792 wait complete. 2024-03-12T17:20:35.500 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-03-12T17:20:35.500 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-12T17:20:35.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.726+0000 7f13ca000640 1 Processor -- start 2024-03-12T17:20:35.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.726+0000 7f13ca000640 1 -- start start 2024-03-12T17:20:35.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.728+0000 7f13ca000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f13c415ae20 0x7f13c406d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:35.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.728+0000 7f13ca000640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13c40a7660 con 0x7f13c40b3b70 2024-03-12T17:20:35.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.728+0000 7f13ca000640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13c41445d0 con 0x7f13c41441f0 2024-03-12T17:20:35.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.728+0000 7f13ca000640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c415e460 con 0x7f13c415ae20 2024-03-12T17:20:35.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.728+0000 7f13c9600640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f13c40b3b70 0x7f13c415e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:43428/0 (socket says 172.21.15.17:43428) 2024-03-12T17:20:35.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.728+0000 7f13c9600640 1 -- 172.21.15.17:0/1623747684 learned_addr learned my addr 172.21.15.17:0/1623747684 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:20:35.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.729+0000 7f13bbe00640 1 --2- 172.21.15.17:0/1623747684 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f13c415ae20 0x7f13c406d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:35.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.729+0000 7f13c3e00640 1 -- 172.21.15.17:0/1623747684 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1340740725 0 0) 0x7f13c40a7660 con 0x7f13c40b3b70 2024-03-12T17:20:35.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.729+0000 7f13c3e00640 1 -- 172.21.15.17:0/1623747684 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13a8003520 con 0x7f13c40b3b70 2024-03-12T17:20:35.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.729+0000 7f13bbe00640 1 -- 172.21.15.17:0/1623747684 >> v1:172.21.15.94:6789/0 conn(0x7f13c41441f0 legacy=0x7f13c4070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:35.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.729+0000 7f13bbe00640 1 -- 172.21.15.17:0/1623747684 >> v1:172.21.15.17:6789/0 conn(0x7f13c40b3b70 legacy=0x7f13c415e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:35.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.729+0000 7f13c3e00640 1 -- 172.21.15.17:0/1623747684 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3030664673 0 0) 0x7f13a8003520 con 0x7f13c40b3b70 2024-03-12T17:20:35.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.729+0000 7f13bbe00640 1 -- 172.21.15.17:0/1623747684 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13c415b3e0 con 0x7f13c415ae20 2024-03-12T17:20:35.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.731+0000 7f13bbe00640 1 --2- 172.21.15.17:0/1623747684 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f13c415ae20 0x7f13c406d130 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f13ac0097d0 tx=0x7f13ac02b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=accaa506a508c5cf server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:35.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.731+0000 7f13c3e00640 1 -- 172.21.15.17:0/1623747684 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc0019f0 con 0x7f13c415ae20 2024-03-12T17:20:35.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.731+0000 7f13c3e00640 1 -- 172.21.15.17:0/1623747684 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13ac031580 con 0x7f13c415ae20 2024-03-12T17:20:35.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.731+0000 7f13c3e00640 1 -- 172.21.15.17:0/1623747684 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ac031910 con 0x7f13c415ae20 2024-03-12T17:20:35.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.732+0000 7f13ca000640 1 -- 172.21.15.17:0/1623747684 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f13c415ae20 msgr2=0x7f13c406d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:35.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.732+0000 7f13ca000640 1 --2- 172.21.15.17:0/1623747684 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f13c415ae20 0x7f13c406d130 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f13ac0097d0 tx=0x7f13ac02b8a0 comp rx=0 tx=0).stop 2024-03-12T17:20:35.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.732+0000 7f13ca000640 1 -- 172.21.15.17:0/1623747684 shutdown_connections 2024-03-12T17:20:35.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.732+0000 7f13ca000640 1 --2- 172.21.15.17:0/1623747684 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f13c415ae20 0x7f13c406d130 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:35.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.732+0000 7f13ca000640 1 -- 172.21.15.17:0/1623747684 >> 172.21.15.17:0/1623747684 conn(0x7f13c4069ce0 msgr2=0x7f13c406a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:35.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.732+0000 7f13ca000640 1 -- 172.21.15.17:0/1623747684 shutdown_connections 2024-03-12T17:20:35.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.732+0000 7f13ca000640 1 -- 172.21.15.17:0/1623747684 wait complete. 2024-03-12T17:20:35.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.734+0000 7f13ca000640 1 Processor -- start 2024-03-12T17:20:35.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.735+0000 7f13ca000640 1 -- start start 2024-03-12T17:20:35.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.736+0000 7f13ca000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f13c40b3b70 0x7f13c415a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:35.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.736+0000 7f13ca000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13c41441f0 0x7f13c40ac410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:35.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.736+0000 7f13ca000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13c415ae20 0x7f13c4159870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:35.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.736+0000 7f13ca000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c40ad870 con 0x7f13c415ae20 2024-03-12T17:20:35.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.736+0000 7f13ca000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13c40ac950 con 0x7f13c41441f0 2024-03-12T17:20:35.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.736+0000 7f13ca000640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13c40acbf0 con 0x7f13c40b3b70 2024-03-12T17:20:35.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.736+0000 7f13c9600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13c415ae20 0x7f13c4159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:35.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.736+0000 7f13c9600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13c415ae20 0x7f13c4159870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58748/0 (socket says 172.21.15.17:58748) 2024-03-12T17:20:35.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.736+0000 7f13c9600640 1 -- 172.21.15.17:0/832617239 learned_addr learned my addr 172.21.15.17:0/832617239 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:35.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.736+0000 7f13c8c00640 1 --2- 172.21.15.17:0/832617239 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f13c40b3b70 0x7f13c415a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:35.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.737+0000 7f13bbe00640 1 --2- 172.21.15.17:0/832617239 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13c41441f0 0x7f13c40ac410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:35.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.737+0000 7f13c9600640 1 -- 172.21.15.17:0/832617239 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f13c40b3b70 msgr2=0x7f13c415a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:35.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.737+0000 7f13c9600640 1 --2- 172.21.15.17:0/832617239 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f13c40b3b70 0x7f13c415a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:35.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.737+0000 7f13c9600640 1 -- 172.21.15.17:0/832617239 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13c41441f0 msgr2=0x7f13c40ac410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:35.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.737+0000 7f13c9600640 1 --2- 172.21.15.17:0/832617239 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13c41441f0 0x7f13c40ac410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:35.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.737+0000 7f13c9600640 1 -- 172.21.15.17:0/832617239 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13ac009400 con 0x7f13c415ae20 2024-03-12T17:20:35.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.737+0000 7f13c9600640 1 --2- 172.21.15.17:0/832617239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13c415ae20 0x7f13c4159870 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f13bc001890 tx=0x7f13bc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:35.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.737+0000 7f13c1600640 1 -- 172.21.15.17:0/832617239 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc012400 con 0x7f13c415ae20 2024-03-12T17:20:35.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.738+0000 7f13c1600640 1 -- 172.21.15.17:0/832617239 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13bc012560 con 0x7f13c415ae20 2024-03-12T17:20:35.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.738+0000 7f13c1600640 1 -- 172.21.15.17:0/832617239 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc012910 con 0x7f13c415ae20 2024-03-12T17:20:35.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.738+0000 7f13ca000640 1 -- 172.21.15.17:0/832617239 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13c40aced0 con 0x7f13c415ae20 2024-03-12T17:20:35.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.738+0000 7f13ca000640 1 -- 172.21.15.17:0/832617239 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13c40ad490 con 0x7f13c415ae20 2024-03-12T17:20:35.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.739+0000 7f13ca000640 1 -- 172.21.15.17:0/832617239 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13c40ad9b0 con 0x7f13c415ae20 2024-03-12T17:20:35.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.740+0000 7f13c1600640 1 -- 172.21.15.17:0/832617239 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f13bc012a70 con 0x7f13c415ae20 2024-03-12T17:20:35.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.741+0000 7f13c1600640 1 --2- 172.21.15.17:0/832617239 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f13a006ac00 0x7f13a006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:35.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.741+0000 7f13c1600640 1 -- 172.21.15.17:0/832617239 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f13bc089c10 con 0x7f13c415ae20 2024-03-12T17:20:35.742 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.741+0000 7f13c8c00640 1 --2- 172.21.15.17:0/832617239 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f13a006ac00 0x7f13a006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:35.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.742+0000 7f13c8c00640 1 --2- 172.21.15.17:0/832617239 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f13a006ac00 0x7f13a006d0c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f13c415c540 tx=0x7f13b4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:35.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.746+0000 7f13c1600640 1 -- 172.21.15.17:0/832617239 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f13c40ad9b0 con 0x7f13c415ae20 2024-03-12T17:20:35.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.942+0000 7f13ca000640 1 -- 172.21.15.17:0/832617239 --> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f13c415bc80 con 0x7f13a006ac00 2024-03-12T17:20:35.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.965+0000 7f13c1600640 1 -- 172.21.15.17:0/832617239 <== mgr.4104 v2:172.21.15.17:6832/37052 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287267 (secure 0 0 0) 0x7f13b4001c70 con 0x7f13a006ac00 2024-03-12T17:20:35.962 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:20:35.969 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-03-12T17:20:35.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.971+0000 7f13ca000640 1 -- 172.21.15.17:0/832617239 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f13a006ac00 msgr2=0x7f13a006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:35.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.971+0000 7f13ca000640 1 --2- 172.21.15.17:0/832617239 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f13a006ac00 0x7f13a006d0c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f13c415c540 tx=0x7f13b4009040 comp rx=0 tx=0).stop 2024-03-12T17:20:35.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.971+0000 7f13ca000640 1 -- 172.21.15.17:0/832617239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13c415ae20 msgr2=0x7f13c4159870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:35.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.971+0000 7f13ca000640 1 --2- 172.21.15.17:0/832617239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13c415ae20 0x7f13c4159870 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f13bc001890 tx=0x7f13bc00a430 comp rx=0 tx=0).stop 2024-03-12T17:20:35.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.971+0000 7f13ca000640 1 -- 172.21.15.17:0/832617239 shutdown_connections 2024-03-12T17:20:35.971 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.971+0000 7f13ca000640 1 --2- 172.21.15.17:0/832617239 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f13a006ac00 0x7f13a006d0c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:35.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.971+0000 7f13ca000640 1 --2- 172.21.15.17:0/832617239 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f13c415ae20 0x7f13c4159870 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:35.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.972+0000 7f13ca000640 1 --2- 172.21.15.17:0/832617239 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f13c41441f0 0x7f13c40ac410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:35.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.972+0000 7f13ca000640 1 --2- 172.21.15.17:0/832617239 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f13c40b3b70 0x7f13c415a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:35.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.972+0000 7f13ca000640 1 -- 172.21.15.17:0/832617239 >> 172.21.15.17:0/832617239 conn(0x7f13c4069ce0 msgr2=0x7f13c40cba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:35.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.972+0000 7f13ca000640 1 -- 172.21.15.17:0/832617239 shutdown_connections 2024-03-12T17:20:35.972 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:35.972+0000 7f13ca000640 1 -- 172.21.15.17:0/832617239 wait complete. 2024-03-12T17:20:35.986 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2024-03-12T17:20:35.513894+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254536,"kb_used_data":5544,"kb_used_omap":13,"kb_used_meta":248818,"kb_avail":754720184,"statfs":{"total":773094113280,"available":772833468416,"internally_reserved":0,"allocated":5677056,"data_stored":2986044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":254789720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.821201"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.202908+0000","last_change":"2024-03-12T17:20:29.220236+0000","last_active":"2024-03-12T17:20:30.202908+0000","last_peered":"2024-03-12T17:20:30.202908+0000","last_clean":"2024-03-12T17:20:30.202908+0000","last_became_active":"2024-03-12T17:20:29.219885+0000","last_became_peered":"2024-03-12T17:20:29.219885+0000","last_unstale":"2024-03-12T17:20:30.202908+0000","last_undegraded":"2024-03-12T17:20:30.202908+0000","last_fullsized":"2024-03-12T17:20:30.202908+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:36:53.928201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.204123+0000","last_change":"2024-03-12T17:20:29.213110+0000","last_active":"2024-03-12T17:20:30.204123+0000","last_peered":"2024-03-12T17:20:30.204123+0000","last_clean":"2024-03-12T17:20:30.204123+0000","last_became_active":"2024-03-12T17:20:29.209736+0000","last_became_peered":"2024-03-12T17:20:29.209736+0000","last_unstale":"2024-03-12T17:20:30.204123+0000","last_undegraded":"2024-03-12T17:20:30.204123+0000","last_fullsized":"2024-03-12T17:20:30.204123+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:25:12.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.569486+0000","last_change":"2024-03-12T17:20:29.221059+0000","last_active":"2024-03-12T17:20:30.569486+0000","last_peered":"2024-03-12T17:20:30.569486+0000","last_clean":"2024-03-12T17:20:30.569486+0000","last_became_active":"2024-03-12T17:20:29.218879+0000","last_became_peered":"2024-03-12T17:20:29.218879+0000","last_unstale":"2024-03-12T17:20:30.569486+0000","last_undegraded":"2024-03-12T17:20:30.569486+0000","last_fullsized":"2024-03-12T17:20:30.569486+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:16:26.689323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.570929+0000","last_change":"2024-03-12T17:20:29.219398+0000","last_active":"2024-03-12T17:20:30.570929+0000","last_peered":"2024-03-12T17:20:30.570929+0000","last_clean":"2024-03-12T17:20:30.570929+0000","last_became_active":"2024-03-12T17:20:29.218268+0000","last_became_peered":"2024-03-12T17:20:29.218268+0000","last_unstale":"2024-03-12T17:20:30.570929+0000","last_undegraded":"2024-03-12T17:20:30.570929+0000","last_fullsized":"2024-03-12T17:20:30.570929+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:04:47.239316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.202639+0000","last_change":"2024-03-12T17:20:29.221496+0000","last_active":"2024-03-12T17:20:30.202639+0000","last_peered":"2024-03-12T17:20:30.202639+0000","last_clean":"2024-03-12T17:20:30.202639+0000","last_became_active":"2024-03-12T17:20:29.221207+0000","last_became_peered":"2024-03-12T17:20:29.221207+0000","last_unstale":"2024-03-12T17:20:30.202639+0000","last_undegraded":"2024-03-12T17:20:30.202639+0000","last_fullsized":"2024-03-12T17:20:30.202639+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:42:23.859341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.198306+0000","last_change":"2024-03-12T17:20:29.216016+0000","last_active":"2024-03-12T17:20:30.198306+0000","last_peered":"2024-03-12T17:20:30.198306+0000","last_clean":"2024-03-12T17:20:30.198306+0000","last_became_active":"2024-03-12T17:20:29.215719+0000","last_became_peered":"2024-03-12T17:20:29.215719+0000","last_unstale":"2024-03-12T17:20:30.198306+0000","last_undegraded":"2024-03-12T17:20:30.198306+0000","last_fullsized":"2024-03-12T17:20:30.198306+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:18:47.978713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.202199+0000","last_change":"2024-03-12T17:20:29.218088+0000","last_active":"2024-03-12T17:20:30.202199+0000","last_peered":"2024-03-12T17:20:30.202199+0000","last_clean":"2024-03-12T17:20:30.202199+0000","last_became_active":"2024-03-12T17:20:29.215989+0000","last_became_peered":"2024-03-12T17:20:29.215989+0000","last_unstale":"2024-03-12T17:20:30.202199+0000","last_undegraded":"2024-03-12T17:20:30.202199+0000","last_fullsized":"2024-03-12T17:20:30.202199+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T00:38:19.945167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.569995+0000","last_change":"2024-03-12T17:20:29.227763+0000","last_active":"2024-03-12T17:20:30.569995+0000","last_peered":"2024-03-12T17:20:30.569995+0000","last_clean":"2024-03-12T17:20:30.569995+0000","last_became_active":"2024-03-12T17:20:29.227311+0000","last_became_peered":"2024-03-12T17:20:29.227311+0000","last_unstale":"2024-03-12T17:20:30.569995+0000","last_undegraded":"2024-03-12T17:20:30.569995+0000","last_fullsized":"2024-03-12T17:20:30.569995+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:19:54.449104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.571749+0000","last_change":"2024-03-12T17:20:29.215235+0000","last_active":"2024-03-12T17:20:30.571749+0000","last_peered":"2024-03-12T17:20:30.571749+0000","last_clean":"2024-03-12T17:20:30.571749+0000","last_became_active":"2024-03-12T17:20:29.213710+0000","last_became_peered":"2024-03-12T17:20:29.213710+0000","last_unstale":"2024-03-12T17:20:30.571749+0000","last_undegraded":"2024-03-12T17:20:30.571749+0000","last_fullsized":"2024-03-12T17:20:30.571749+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:24:32.980339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.571360+0000","last_change":"2024-03-12T17:20:29.230760+0000","last_active":"2024-03-12T17:20:30.571360+0000","last_peered":"2024-03-12T17:20:30.571360+0000","last_clean":"2024-03-12T17:20:30.571360+0000","last_became_active":"2024-03-12T17:20:29.230502+0000","last_became_peered":"2024-03-12T17:20:29.230502+0000","last_unstale":"2024-03-12T17:20:30.571360+0000","last_undegraded":"2024-03-12T17:20:30.571360+0000","last_fullsized":"2024-03-12T17:20:30.571360+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:47:27.611484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.572357+0000","last_change":"2024-03-12T17:20:29.222874+0000","last_active":"2024-03-12T17:20:30.572357+0000","last_peered":"2024-03-12T17:20:30.572357+0000","last_clean":"2024-03-12T17:20:30.572357+0000","last_became_active":"2024-03-12T17:20:29.222637+0000","last_became_peered":"2024-03-12T17:20:29.222637+0000","last_unstale":"2024-03-12T17:20:30.572357+0000","last_undegraded":"2024-03-12T17:20:30.572357+0000","last_fullsized":"2024-03-12T17:20:30.572357+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:42:23.859341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.203233+0000","last_change":"2024-03-12T17:20:29.203994+0000","last_active":"2024-03-12T17:20:30.203233+0000","last_peered":"2024-03-12T17:20:30.203233+0000","last_clean":"2024-03-12T17:20:30.203233+0000","last_became_active":"2024-03-12T17:20:29.203332+0000","last_became_peered":"2024-03-12T17:20:29.203332+0000","last_unstale":"2024-03-12T17:20:30.203233+0000","last_undegraded":"2024-03-12T17:20:30.203233+0000","last_fullsized":"2024-03-12T17:20:30.203233+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:24:32.980339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.570674+0000","last_change":"2024-03-12T17:20:29.202938+0000","last_active":"2024-03-12T17:20:30.570674+0000","last_peered":"2024-03-12T17:20:30.570674+0000","last_clean":"2024-03-12T17:20:30.570674+0000","last_became_active":"2024-03-12T17:20:29.202522+0000","last_became_peered":"2024-03-12T17:20:29.202522+0000","last_unstale":"2024-03-12T17:20:30.570674+0000","last_undegraded":"2024-03-12T17:20:30.570674+0000","last_fullsized":"2024-03-12T17:20:30.570674+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:19:02.659380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.571622+0000","last_change":"2024-03-12T17:20:29.208861+0000","last_active":"2024-03-12T17:20:30.571622+0000","last_peered":"2024-03-12T17:20:30.571622+0000","last_clean":"2024-03-12T17:20:30.571622+0000","last_became_active":"2024-03-12T17:20:29.208615+0000","last_became_peered":"2024-03-12T17:20:29.208615+0000","last_unstale":"2024-03-12T17:20:30.571622+0000","last_undegraded":"2024-03-12T17:20:30.571622+0000","last_fullsized":"2024-03-12T17:20:30.571622+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:40:13.031059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.197924+0000","last_change":"2024-03-12T17:20:29.219595+0000","last_active":"2024-03-12T17:20:30.197924+0000","last_peered":"2024-03-12T17:20:30.197924+0000","last_clean":"2024-03-12T17:20:30.197924+0000","last_became_active":"2024-03-12T17:20:29.219308+0000","last_became_peered":"2024-03-12T17:20:29.219308+0000","last_unstale":"2024-03-12T17:20:30.197924+0000","last_undegraded":"2024-03-12T17:20:30.197924+0000","last_fullsized":"2024-03-12T17:20:30.197924+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T00:05:52.290291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.471542+0000","last_change":"2024-03-12T17:20:29.226482+0000","last_active":"2024-03-12T17:20:30.471542+0000","last_peered":"2024-03-12T17:20:30.471542+0000","last_clean":"2024-03-12T17:20:30.471542+0000","last_became_active":"2024-03-12T17:20:29.223961+0000","last_became_peered":"2024-03-12T17:20:29.223961+0000","last_unstale":"2024-03-12T17:20:30.471542+0000","last_undegraded":"2024-03-12T17:20:30.471542+0000","last_fullsized":"2024-03-12T17:20:30.471542+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:40:13.031059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.569930+0000","last_change":"2024-03-12T17:20:29.225895+0000","last_active":"2024-03-12T17:20:30.569930+0000","last_peered":"2024-03-12T17:20:30.569930+0000","last_clean":"2024-03-12T17:20:30.569930+0000","last_became_active":"2024-03-12T17:20:29.225612+0000","last_became_peered":"2024-03-12T17:20:29.225612+0000","last_unstale":"2024-03-12T17:20:30.569930+0000","last_undegraded":"2024-03-12T17:20:30.569930+0000","last_fullsized":"2024-03-12T17:20:30.569930+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:28:56.981079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.569719+0000","last_change":"2024-03-12T17:20:29.220747+0000","last_active":"2024-03-12T17:20:30.569719+0000","last_peered":"2024-03-12T17:20:30.569719+0000","last_clean":"2024-03-12T17:20:30.569719+0000","last_became_active":"2024-03-12T17:20:29.218824+0000","last_became_peered":"2024-03-12T17:20:29.218824+0000","last_unstale":"2024-03-12T17:20:30.569719+0000","last_undegraded":"2024-03-12T17:20:30.569719+0000","last_fullsized":"2024-03-12T17:20:30.569719+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:25:12.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.472324+0000","last_change":"2024-03-12T17:20:29.229800+0000","last_active":"2024-03-12T17:20:30.472324+0000","last_peered":"2024-03-12T17:20:30.472324+0000","last_clean":"2024-03-12T17:20:30.472324+0000","last_became_active":"2024-03-12T17:20:29.229512+0000","last_became_peered":"2024-03-12T17:20:29.229512+0000","last_unstale":"2024-03-12T17:20:30.472324+0000","last_undegraded":"2024-03-12T17:20:30.472324+0000","last_fullsized":"2024-03-12T17:20:30.472324+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:28:56.981079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.571501+0000","last_change":"2024-03-12T17:20:29.212454+0000","last_active":"2024-03-12T17:20:30.571501+0000","last_peered":"2024-03-12T17:20:30.571501+0000","last_clean":"2024-03-12T17:20:30.571501+0000","last_became_active":"2024-03-12T17:20:29.212042+0000","last_became_peered":"2024-03-12T17:20:29.212042+0000","last_unstale":"2024-03-12T17:20:30.571501+0000","last_undegraded":"2024-03-12T17:20:30.571501+0000","last_fullsized":"2024-03-12T17:20:30.571501+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:46:16.152911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.198123+0000","last_change":"2024-03-12T17:20:29.224023+0000","last_active":"2024-03-12T17:20:30.198123+0000","last_peered":"2024-03-12T17:20:30.198123+0000","last_clean":"2024-03-12T17:20:30.198123+0000","last_became_active":"2024-03-12T17:20:29.223678+0000","last_became_peered":"2024-03-12T17:20:29.223678+0000","last_unstale":"2024-03-12T17:20:30.198123+0000","last_undegraded":"2024-03-12T17:20:30.198123+0000","last_fullsized":"2024-03-12T17:20:30.198123+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:22:06.449897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.571873+0000","last_change":"2024-03-12T17:20:29.229810+0000","last_active":"2024-03-12T17:20:30.571873+0000","last_peered":"2024-03-12T17:20:30.571873+0000","last_clean":"2024-03-12T17:20:30.571873+0000","last_became_active":"2024-03-12T17:20:29.229504+0000","last_became_peered":"2024-03-12T17:20:29.229504+0000","last_unstale":"2024-03-12T17:20:30.571873+0000","last_undegraded":"2024-03-12T17:20:30.571873+0000","last_fullsized":"2024-03-12T17:20:30.571873+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:33:01.229156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.471613+0000","last_change":"2024-03-12T17:20:29.221296+0000","last_active":"2024-03-12T17:20:30.471613+0000","last_peered":"2024-03-12T17:20:30.471613+0000","last_clean":"2024-03-12T17:20:30.471613+0000","last_became_active":"2024-03-12T17:20:29.221014+0000","last_became_peered":"2024-03-12T17:20:29.221014+0000","last_unstale":"2024-03-12T17:20:30.471613+0000","last_undegraded":"2024-03-12T17:20:30.471613+0000","last_fullsized":"2024-03-12T17:20:30.471613+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:19:02.659380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.471587+0000","last_change":"2024-03-12T17:20:29.227396+0000","last_active":"2024-03-12T17:20:30.471587+0000","last_peered":"2024-03-12T17:20:30.471587+0000","last_clean":"2024-03-12T17:20:30.471587+0000","last_became_active":"2024-03-12T17:20:29.226762+0000","last_became_peered":"2024-03-12T17:20:29.226762+0000","last_unstale":"2024-03-12T17:20:30.471587+0000","last_undegraded":"2024-03-12T17:20:30.471587+0000","last_fullsized":"2024-03-12T17:20:30.471587+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:06:43.485643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.472246+0000","last_change":"2024-03-12T17:20:29.227203+0000","last_active":"2024-03-12T17:20:30.472246+0000","last_peered":"2024-03-12T17:20:30.472246+0000","last_clean":"2024-03-12T17:20:30.472246+0000","last_became_active":"2024-03-12T17:20:29.226846+0000","last_became_peered":"2024-03-12T17:20:29.226846+0000","last_unstale":"2024-03-12T17:20:30.472246+0000","last_undegraded":"2024-03-12T17:20:30.472246+0000","last_fullsized":"2024-03-12T17:20:30.472246+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:31:05.712095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.571233+0000","last_change":"2024-03-12T17:20:29.199327+0000","last_active":"2024-03-12T17:20:30.571233+0000","last_peered":"2024-03-12T17:20:30.571233+0000","last_clean":"2024-03-12T17:20:30.571233+0000","last_became_active":"2024-03-12T17:20:29.198355+0000","last_became_peered":"2024-03-12T17:20:29.198355+0000","last_unstale":"2024-03-12T17:20:30.571233+0000","last_undegraded":"2024-03-12T17:20:30.571233+0000","last_fullsized":"2024-03-12T17:20:30.571233+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T05:01:56.597284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.569506+0000","last_change":"2024-03-12T17:20:29.227312+0000","last_active":"2024-03-12T17:20:30.569506+0000","last_peered":"2024-03-12T17:20:30.569506+0000","last_clean":"2024-03-12T17:20:30.569506+0000","last_became_active":"2024-03-12T17:20:29.227044+0000","last_became_peered":"2024-03-12T17:20:29.227044+0000","last_unstale":"2024-03-12T17:20:30.569506+0000","last_undegraded":"2024-03-12T17:20:30.569506+0000","last_fullsized":"2024-03-12T17:20:30.569506+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T00:25:47.914846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.203535+0000","last_change":"2024-03-12T17:20:29.203373+0000","last_active":"2024-03-12T17:20:30.203535+0000","last_peered":"2024-03-12T17:20:30.203535+0000","last_clean":"2024-03-12T17:20:30.203535+0000","last_became_active":"2024-03-12T17:20:29.202641+0000","last_became_peered":"2024-03-12T17:20:29.202641+0000","last_unstale":"2024-03-12T17:20:30.203535+0000","last_undegraded":"2024-03-12T17:20:30.203535+0000","last_fullsized":"2024-03-12T17:20:30.203535+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:42:15.956212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.472157+0000","last_change":"2024-03-12T17:20:29.227402+0000","last_active":"2024-03-12T17:20:30.472157+0000","last_peered":"2024-03-12T17:20:30.472157+0000","last_clean":"2024-03-12T17:20:30.472157+0000","last_became_active":"2024-03-12T17:20:29.227096+0000","last_became_peered":"2024-03-12T17:20:29.227096+0000","last_unstale":"2024-03-12T17:20:30.472157+0000","last_undegraded":"2024-03-12T17:20:30.472157+0000","last_fullsized":"2024-03-12T17:20:30.472157+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:16:26.689323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.569323+0000","last_change":"2024-03-12T17:20:29.223912+0000","last_active":"2024-03-12T17:20:30.569323+0000","last_peered":"2024-03-12T17:20:30.569323+0000","last_clean":"2024-03-12T17:20:30.569323+0000","last_became_active":"2024-03-12T17:20:29.223304+0000","last_became_peered":"2024-03-12T17:20:29.223304+0000","last_unstale":"2024-03-12T17:20:30.569323+0000","last_undegraded":"2024-03-12T17:20:30.569323+0000","last_fullsized":"2024-03-12T17:20:30.569323+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:42:15.956212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.197994+0000","last_change":"2024-03-12T17:20:29.203472+0000","last_active":"2024-03-12T17:20:30.197994+0000","last_peered":"2024-03-12T17:20:30.197994+0000","last_clean":"2024-03-12T17:20:30.197994+0000","last_became_active":"2024-03-12T17:20:29.203129+0000","last_became_peered":"2024-03-12T17:20:29.203129+0000","last_unstale":"2024-03-12T17:20:30.197994+0000","last_undegraded":"2024-03-12T17:20:30.197994+0000","last_fullsized":"2024-03-12T17:20:30.197994+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:36:53.928201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.570293+0000","last_change":"2024-03-12T17:20:29.208523+0000","last_active":"2024-03-12T17:20:30.570293+0000","last_peered":"2024-03-12T17:20:30.570293+0000","last_clean":"2024-03-12T17:20:30.570293+0000","last_became_active":"2024-03-12T17:20:29.208260+0000","last_became_peered":"2024-03-12T17:20:29.208260+0000","last_unstale":"2024-03-12T17:20:30.570293+0000","last_undegraded":"2024-03-12T17:20:30.570293+0000","last_fullsized":"2024-03-12T17:20:30.570293+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:51:08.473134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.573261+0000","last_change":"2024-03-12T17:20:29.212012+0000","last_active":"2024-03-12T17:20:30.573261+0000","last_peered":"2024-03-12T17:20:30.573261+0000","last_clean":"2024-03-12T17:20:30.573261+0000","last_became_active":"2024-03-12T17:20:29.211756+0000","last_became_peered":"2024-03-12T17:20:29.211756+0000","last_unstale":"2024-03-12T17:20:30.573261+0000","last_undegraded":"2024-03-12T17:20:30.573261+0000","last_fullsized":"2024-03-12T17:20:30.573261+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:42:34.931002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"46'4","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.230147+0000","last_change":"2024-03-12T17:20:28.724812+0000","last_active":"2024-03-12T17:20:29.230147+0000","last_peered":"2024-03-12T17:20:29.230147+0000","last_clean":"2024-03-12T17:20:29.230147+0000","last_became_active":"2024-03-12T17:20:28.724500+0000","last_became_peered":"2024-03-12T17:20:28.724500+0000","last_unstale":"2024-03-12T17:20:29.230147+0000","last_undegraded":"2024-03-12T17:20:29.230147+0000","last_fullsized":"2024-03-12T17:20:29.230147+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:42:22.845646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.472324+0000","last_change":"2024-03-12T17:20:29.225598+0000","last_active":"2024-03-12T17:20:30.472324+0000","last_peered":"2024-03-12T17:20:30.472324+0000","last_clean":"2024-03-12T17:20:30.472324+0000","last_became_active":"2024-03-12T17:20:29.225259+0000","last_became_peered":"2024-03-12T17:20:29.225259+0000","last_unstale":"2024-03-12T17:20:30.472324+0000","last_undegraded":"2024-03-12T17:20:30.472324+0000","last_fullsized":"2024-03-12T17:20:30.472324+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:27:01.862697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"46'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.229671+0000","last_change":"2024-03-12T17:20:28.725978+0000","last_active":"2024-03-12T17:20:29.229671+0000","last_peered":"2024-03-12T17:20:29.229671+0000","last_clean":"2024-03-12T17:20:29.229671+0000","last_became_active":"2024-03-12T17:20:28.724546+0000","last_became_peered":"2024-03-12T17:20:28.724546+0000","last_unstale":"2024-03-12T17:20:29.229671+0000","last_undegraded":"2024-03-12T17:20:29.229671+0000","last_fullsized":"2024-03-12T17:20:29.229671+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:19:01.645685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.203664+0000","last_change":"2024-03-12T17:20:29.214586+0000","last_active":"2024-03-12T17:20:30.203664+0000","last_peered":"2024-03-12T17:20:30.203664+0000","last_clean":"2024-03-12T17:20:30.203664+0000","last_became_active":"2024-03-12T17:20:29.214242+0000","last_became_peered":"2024-03-12T17:20:29.214242+0000","last_unstale":"2024-03-12T17:20:30.203664+0000","last_undegraded":"2024-03-12T17:20:30.203664+0000","last_fullsized":"2024-03-12T17:20:30.203664+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:40:13.031059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"46'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.220867+0000","last_change":"2024-03-12T17:20:28.727150+0000","last_active":"2024-03-12T17:20:29.220867+0000","last_peered":"2024-03-12T17:20:29.220867+0000","last_clean":"2024-03-12T17:20:29.220867+0000","last_became_active":"2024-03-12T17:20:28.726861+0000","last_became_peered":"2024-03-12T17:20:28.726861+0000","last_unstale":"2024-03-12T17:20:29.220867+0000","last_undegraded":"2024-03-12T17:20:29.220867+0000","last_fullsized":"2024-03-12T17:20:29.220867+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:15:48.029418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.573364+0000","last_change":"2024-03-12T17:20:29.226236+0000","last_active":"2024-03-12T17:20:30.573364+0000","last_peered":"2024-03-12T17:20:30.573364+0000","last_clean":"2024-03-12T17:20:30.573364+0000","last_became_active":"2024-03-12T17:20:29.225470+0000","last_became_peered":"2024-03-12T17:20:29.225470+0000","last_unstale":"2024-03-12T17:20:30.573364+0000","last_undegraded":"2024-03-12T17:20:30.573364+0000","last_fullsized":"2024-03-12T17:20:30.573364+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:40:13.031059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"46'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.223704+0000","last_change":"2024-03-12T17:20:28.729062+0000","last_active":"2024-03-12T17:20:29.223704+0000","last_peered":"2024-03-12T17:20:29.223704+0000","last_clean":"2024-03-12T17:20:29.223704+0000","last_became_active":"2024-03-12T17:20:28.728739+0000","last_became_peered":"2024-03-12T17:20:28.728739+0000","last_unstale":"2024-03-12T17:20:29.223704+0000","last_undegraded":"2024-03-12T17:20:29.223704+0000","last_fullsized":"2024-03-12T17:20:29.223704+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:42:33.917307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.569468+0000","last_change":"2024-03-12T17:20:29.229503+0000","last_active":"2024-03-12T17:20:30.569468+0000","last_peered":"2024-03-12T17:20:30.569468+0000","last_clean":"2024-03-12T17:20:30.569468+0000","last_became_active":"2024-03-12T17:20:29.229238+0000","last_became_peered":"2024-03-12T17:20:29.229238+0000","last_unstale":"2024-03-12T17:20:30.569468+0000","last_undegraded":"2024-03-12T17:20:30.569468+0000","last_fullsized":"2024-03-12T17:20:30.569468+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:42:34.931002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"46'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.224560+0000","last_change":"2024-03-12T17:20:28.721385+0000","last_active":"2024-03-12T17:20:29.224560+0000","last_peered":"2024-03-12T17:20:29.224560+0000","last_clean":"2024-03-12T17:20:29.224560+0000","last_became_active":"2024-03-12T17:20:28.719983+0000","last_became_peered":"2024-03-12T17:20:28.719983+0000","last_unstale":"2024-03-12T17:20:29.224560+0000","last_undegraded":"2024-03-12T17:20:29.224560+0000","last_fullsized":"2024-03-12T17:20:29.224560+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:42:33.917307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.571134+0000","last_change":"2024-03-12T17:20:29.206478+0000","last_active":"2024-03-12T17:20:30.571134+0000","last_peered":"2024-03-12T17:20:30.571134+0000","last_clean":"2024-03-12T17:20:30.571134+0000","last_became_active":"2024-03-12T17:20:29.206226+0000","last_became_peered":"2024-03-12T17:20:29.206226+0000","last_unstale":"2024-03-12T17:20:30.571134+0000","last_undegraded":"2024-03-12T17:20:30.571134+0000","last_fullsized":"2024-03-12T17:20:30.571134+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:42:34.931002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"46'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.226731+0000","last_change":"2024-03-12T17:20:28.723234+0000","last_active":"2024-03-12T17:20:29.226731+0000","last_peered":"2024-03-12T17:20:29.226731+0000","last_clean":"2024-03-12T17:20:29.226731+0000","last_became_active":"2024-03-12T17:20:28.722865+0000","last_became_peered":"2024-03-12T17:20:28.722865+0000","last_unstale":"2024-03-12T17:20:29.226731+0000","last_undegraded":"2024-03-12T17:20:29.226731+0000","last_fullsized":"2024-03-12T17:20:29.226731+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:51:07.459439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.570094+0000","last_change":"2024-03-12T17:20:29.227621+0000","last_active":"2024-03-12T17:20:30.570094+0000","last_peered":"2024-03-12T17:20:30.570094+0000","last_clean":"2024-03-12T17:20:30.570094+0000","last_became_active":"2024-03-12T17:20:29.227354+0000","last_became_peered":"2024-03-12T17:20:29.227354+0000","last_unstale":"2024-03-12T17:20:30.570094+0000","last_undegraded":"2024-03-12T17:20:30.570094+0000","last_fullsized":"2024-03-12T17:20:30.570094+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:34:52.337489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.197015+0000","last_change":"2024-03-12T17:20:28.721214+0000","last_active":"2024-03-12T17:20:29.197015+0000","last_peered":"2024-03-12T17:20:29.197015+0000","last_clean":"2024-03-12T17:20:29.197015+0000","last_became_active":"2024-03-12T17:20:28.720895+0000","last_became_peered":"2024-03-12T17:20:28.720895+0000","last_unstale":"2024-03-12T17:20:29.197015+0000","last_undegraded":"2024-03-12T17:20:29.197015+0000","last_fullsized":"2024-03-12T17:20:29.197015+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:54:05.658055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.471339+0000","last_change":"2024-03-12T17:20:29.225679+0000","last_active":"2024-03-12T17:20:30.471339+0000","last_peered":"2024-03-12T17:20:30.471339+0000","last_clean":"2024-03-12T17:20:30.471339+0000","last_became_active":"2024-03-12T17:20:29.225365+0000","last_became_peered":"2024-03-12T17:20:29.225365+0000","last_unstale":"2024-03-12T17:20:30.471339+0000","last_undegraded":"2024-03-12T17:20:30.471339+0000","last_fullsized":"2024-03-12T17:20:30.471339+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:15:49.043113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.196282+0000","last_change":"2024-03-12T17:20:28.728429+0000","last_active":"2024-03-12T17:20:29.196282+0000","last_peered":"2024-03-12T17:20:29.196282+0000","last_clean":"2024-03-12T17:20:29.196282+0000","last_became_active":"2024-03-12T17:20:28.728171+0000","last_became_peered":"2024-03-12T17:20:28.728171+0000","last_unstale":"2024-03-12T17:20:29.196282+0000","last_undegraded":"2024-03-12T17:20:29.196282+0000","last_fullsized":"2024-03-12T17:20:29.196282+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:35:34.872460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.569867+0000","last_change":"2024-03-12T17:20:29.220560+0000","last_active":"2024-03-12T17:20:30.569867+0000","last_peered":"2024-03-12T17:20:30.569867+0000","last_clean":"2024-03-12T17:20:30.569867+0000","last_became_active":"2024-03-12T17:20:29.218468+0000","last_became_peered":"2024-03-12T17:20:29.218468+0000","last_unstale":"2024-03-12T17:20:30.569867+0000","last_undegraded":"2024-03-12T17:20:30.569867+0000","last_fullsized":"2024-03-12T17:20:30.569867+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:24:32.980339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.209979+0000","last_change":"2024-03-12T17:20:28.711630+0000","last_active":"2024-03-12T17:20:29.209979+0000","last_peered":"2024-03-12T17:20:29.209979+0000","last_clean":"2024-03-12T17:20:29.209979+0000","last_became_active":"2024-03-12T17:20:28.711151+0000","last_became_peered":"2024-03-12T17:20:28.711151+0000","last_unstale":"2024-03-12T17:20:29.209979+0000","last_undegraded":"2024-03-12T17:20:29.209979+0000","last_fullsized":"2024-03-12T17:20:29.209979+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:40:40.199608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.203032+0000","last_change":"2024-03-12T17:20:29.217670+0000","last_active":"2024-03-12T17:20:30.203032+0000","last_peered":"2024-03-12T17:20:30.203032+0000","last_clean":"2024-03-12T17:20:30.203032+0000","last_became_active":"2024-03-12T17:20:29.217234+0000","last_became_peered":"2024-03-12T17:20:29.217234+0000","last_unstale":"2024-03-12T17:20:30.203032+0000","last_undegraded":"2024-03-12T17:20:30.203032+0000","last_fullsized":"2024-03-12T17:20:30.203032+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:24:11.584247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.203884+0000","last_change":"2024-03-12T17:20:28.725148+0000","last_active":"2024-03-12T17:20:29.203884+0000","last_peered":"2024-03-12T17:20:29.203884+0000","last_clean":"2024-03-12T17:20:29.203884+0000","last_became_active":"2024-03-12T17:20:28.724010+0000","last_became_peered":"2024-03-12T17:20:28.724010+0000","last_unstale":"2024-03-12T17:20:29.203884+0000","last_undegraded":"2024-03-12T17:20:29.203884+0000","last_fullsized":"2024-03-12T17:20:29.203884+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:40:40.199608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.198464+0000","last_change":"2024-03-12T17:20:29.200120+0000","last_active":"2024-03-12T17:20:30.198464+0000","last_peered":"2024-03-12T17:20:30.198464+0000","last_clean":"2024-03-12T17:20:30.198464+0000","last_became_active":"2024-03-12T17:20:29.199629+0000","last_became_peered":"2024-03-12T17:20:29.199629+0000","last_unstale":"2024-03-12T17:20:30.198464+0000","last_undegraded":"2024-03-12T17:20:30.198464+0000","last_fullsized":"2024-03-12T17:20:30.198464+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T00:35:51.640600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"46'3","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.229201+0000","last_change":"2024-03-12T17:20:28.733163+0000","last_active":"2024-03-12T17:20:29.229201+0000","last_peered":"2024-03-12T17:20:29.229201+0000","last_clean":"2024-03-12T17:20:29.229201+0000","last_became_active":"2024-03-12T17:20:28.732826+0000","last_became_peered":"2024-03-12T17:20:28.732826+0000","last_unstale":"2024-03-12T17:20:29.229201+0000","last_undegraded":"2024-03-12T17:20:29.229201+0000","last_fullsized":"2024-03-12T17:20:29.229201+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:42:22.845646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.203367+0000","last_change":"2024-03-12T17:20:29.221160+0000","last_active":"2024-03-12T17:20:30.203367+0000","last_peered":"2024-03-12T17:20:30.203367+0000","last_clean":"2024-03-12T17:20:30.203367+0000","last_became_active":"2024-03-12T17:20:29.220847+0000","last_became_peered":"2024-03-12T17:20:29.220847+0000","last_unstale":"2024-03-12T17:20:30.203367+0000","last_undegraded":"2024-03-12T17:20:30.203367+0000","last_fullsized":"2024-03-12T17:20:30.203367+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:53:00.502168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"46'6","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.231378+0000","last_change":"2024-03-12T17:20:28.712527+0000","last_active":"2024-03-12T17:20:29.231378+0000","last_peered":"2024-03-12T17:20:29.231378+0000","last_clean":"2024-03-12T17:20:29.231378+0000","last_became_active":"2024-03-12T17:20:28.712208+0000","last_became_peered":"2024-03-12T17:20:28.712208+0000","last_unstale":"2024-03-12T17:20:29.231378+0000","last_undegraded":"2024-03-12T17:20:29.231378+0000","last_fullsized":"2024-03-12T17:20:29.231378+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:40:33.340106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.471550+0000","last_change":"2024-03-12T17:20:29.223168+0000","last_active":"2024-03-12T17:20:30.471550+0000","last_peered":"2024-03-12T17:20:30.471550+0000","last_clean":"2024-03-12T17:20:30.471550+0000","last_became_active":"2024-03-12T17:20:29.222667+0000","last_became_peered":"2024-03-12T17:20:29.222667+0000","last_unstale":"2024-03-12T17:20:30.471550+0000","last_undegraded":"2024-03-12T17:20:30.471550+0000","last_fullsized":"2024-03-12T17:20:30.471550+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T00:25:47.914846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"46'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.222537+0000","last_change":"2024-03-12T17:20:28.721884+0000","last_active":"2024-03-12T17:20:29.222537+0000","last_peered":"2024-03-12T17:20:29.222537+0000","last_clean":"2024-03-12T17:20:29.222537+0000","last_became_active":"2024-03-12T17:20:28.721596+0000","last_became_peered":"2024-03-12T17:20:28.721596+0000","last_unstale":"2024-03-12T17:20:29.222537+0000","last_undegraded":"2024-03-12T17:20:29.222537+0000","last_fullsized":"2024-03-12T17:20:29.222537+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:24:31.966644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.571391+0000","last_change":"2024-03-12T17:20:29.212951+0000","last_active":"2024-03-12T17:20:30.571391+0000","last_peered":"2024-03-12T17:20:30.571391+0000","last_clean":"2024-03-12T17:20:30.571391+0000","last_became_active":"2024-03-12T17:20:29.212679+0000","last_became_peered":"2024-03-12T17:20:29.212679+0000","last_unstale":"2024-03-12T17:20:30.571391+0000","last_undegraded":"2024-03-12T17:20:30.571391+0000","last_fullsized":"2024-03-12T17:20:30.571391+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:44:38.657773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.193220+0000","last_change":"2024-03-12T17:20:28.731139+0000","last_active":"2024-03-12T17:20:29.193220+0000","last_peered":"2024-03-12T17:20:29.193220+0000","last_clean":"2024-03-12T17:20:29.193220+0000","last_became_active":"2024-03-12T17:20:28.730852+0000","last_became_peered":"2024-03-12T17:20:28.730852+0000","last_unstale":"2024-03-12T17:20:29.193220+0000","last_undegraded":"2024-03-12T17:20:29.193220+0000","last_fullsized":"2024-03-12T17:20:29.193220+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:40:12.017364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.197928+0000","last_change":"2024-03-12T17:20:29.196550+0000","last_active":"2024-03-12T17:20:30.197928+0000","last_peered":"2024-03-12T17:20:30.197928+0000","last_clean":"2024-03-12T17:20:30.197928+0000","last_became_active":"2024-03-12T17:20:29.195813+0000","last_became_peered":"2024-03-12T17:20:29.195813+0000","last_unstale":"2024-03-12T17:20:30.197928+0000","last_undegraded":"2024-03-12T17:20:30.197928+0000","last_fullsized":"2024-03-12T17:20:30.197928+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:05:07.450795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.191852+0000","last_change":"2024-03-12T17:20:28.723322+0000","last_active":"2024-03-12T17:20:29.191852+0000","last_peered":"2024-03-12T17:20:29.191852+0000","last_clean":"2024-03-12T17:20:29.191852+0000","last_became_active":"2024-03-12T17:20:28.721235+0000","last_became_peered":"2024-03-12T17:20:28.721235+0000","last_unstale":"2024-03-12T17:20:29.191852+0000","last_undegraded":"2024-03-12T17:20:29.191852+0000","last_fullsized":"2024-03-12T17:20:29.191852+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:25:11.954612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.202245+0000","last_change":"2024-03-12T17:20:29.219950+0000","last_active":"2024-03-12T17:20:30.202245+0000","last_peered":"2024-03-12T17:20:30.202245+0000","last_clean":"2024-03-12T17:20:30.202245+0000","last_became_active":"2024-03-12T17:20:29.219670+0000","last_became_peered":"2024-03-12T17:20:29.219670+0000","last_unstale":"2024-03-12T17:20:30.202245+0000","last_undegraded":"2024-03-12T17:20:30.202245+0000","last_fullsized":"2024-03-12T17:20:30.202245+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:48:25.075810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"46'8","reported_seq":19,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.229905+0000","last_change":"2024-03-12T17:20:28.725956+0000","last_active":"2024-03-12T17:20:29.229905+0000","last_peered":"2024-03-12T17:20:29.229905+0000","last_clean":"2024-03-12T17:20:29.229905+0000","last_became_active":"2024-03-12T17:20:28.724420+0000","last_became_peered":"2024-03-12T17:20:28.724420+0000","last_unstale":"2024-03-12T17:20:29.229905+0000","last_undegraded":"2024-03-12T17:20:29.229905+0000","last_fullsized":"2024-03-12T17:20:29.229905+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:22:18.771024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.571484+0000","last_change":"2024-03-12T17:20:29.217041+0000","last_active":"2024-03-12T17:20:30.571484+0000","last_peered":"2024-03-12T17:20:30.571484+0000","last_clean":"2024-03-12T17:20:30.571484+0000","last_became_active":"2024-03-12T17:20:29.216745+0000","last_became_peered":"2024-03-12T17:20:29.216745+0000","last_unstale":"2024-03-12T17:20:30.571484+0000","last_undegraded":"2024-03-12T17:20:30.571484+0000","last_fullsized":"2024-03-12T17:20:30.571484+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:07:31.382195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"46'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.212891+0000","last_change":"2024-03-12T17:20:28.719031+0000","last_active":"2024-03-12T17:20:29.212891+0000","last_peered":"2024-03-12T17:20:29.212891+0000","last_clean":"2024-03-12T17:20:29.212891+0000","last_became_active":"2024-03-12T17:20:28.718743+0000","last_became_peered":"2024-03-12T17:20:28.718743+0000","last_unstale":"2024-03-12T17:20:29.212891+0000","last_undegraded":"2024-03-12T17:20:29.212891+0000","last_fullsized":"2024-03-12T17:20:29.212891+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:20:16.591031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.571843+0000","last_change":"2024-03-12T17:20:29.217002+0000","last_active":"2024-03-12T17:20:30.571843+0000","last_peered":"2024-03-12T17:20:30.571843+0000","last_clean":"2024-03-12T17:20:30.571843+0000","last_became_active":"2024-03-12T17:20:29.216687+0000","last_became_peered":"2024-03-12T17:20:29.216687+0000","last_unstale":"2024-03-12T17:20:30.571843+0000","last_undegraded":"2024-03-12T17:20:30.571843+0000","last_fullsized":"2024-03-12T17:20:30.571843+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:42:15.956212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"46'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.226224+0000","last_change":"2024-03-12T17:20:28.723496+0000","last_active":"2024-03-12T17:20:29.226224+0000","last_peered":"2024-03-12T17:20:29.226224+0000","last_clean":"2024-03-12T17:20:29.226224+0000","last_became_active":"2024-03-12T17:20:28.723162+0000","last_became_peered":"2024-03-12T17:20:28.723162+0000","last_unstale":"2024-03-12T17:20:29.226224+0000","last_undegraded":"2024-03-12T17:20:29.226224+0000","last_fullsized":"2024-03-12T17:20:29.226224+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T05:01:55.583589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.471933+0000","last_change":"2024-03-12T17:20:29.217021+0000","last_active":"2024-03-12T17:20:30.471933+0000","last_peered":"2024-03-12T17:20:30.471933+0000","last_clean":"2024-03-12T17:20:30.471933+0000","last_became_active":"2024-03-12T17:20:29.216638+0000","last_became_peered":"2024-03-12T17:20:29.216638+0000","last_unstale":"2024-03-12T17:20:30.471933+0000","last_undegraded":"2024-03-12T17:20:30.471933+0000","last_fullsized":"2024-03-12T17:20:30.471933+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:42:34.931002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"46'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.226196+0000","last_change":"2024-03-12T17:20:28.727011+0000","last_active":"2024-03-12T17:20:29.226196+0000","last_peered":"2024-03-12T17:20:29.226196+0000","last_clean":"2024-03-12T17:20:29.226196+0000","last_became_active":"2024-03-12T17:20:28.726699+0000","last_became_peered":"2024-03-12T17:20:28.726699+0000","last_unstale":"2024-03-12T17:20:29.226196+0000","last_undegraded":"2024-03-12T17:20:29.226196+0000","last_fullsized":"2024-03-12T17:20:29.226196+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:37:31.324559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.472036+0000","last_change":"2024-03-12T17:20:29.227348+0000","last_active":"2024-03-12T17:20:30.472036+0000","last_peered":"2024-03-12T17:20:30.472036+0000","last_clean":"2024-03-12T17:20:30.472036+0000","last_became_active":"2024-03-12T17:20:29.226993+0000","last_became_peered":"2024-03-12T17:20:29.226993+0000","last_unstale":"2024-03-12T17:20:30.472036+0000","last_undegraded":"2024-03-12T17:20:30.472036+0000","last_fullsized":"2024-03-12T17:20:30.472036+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:22:46.154568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.192005+0000","last_change":"2024-03-12T17:20:28.727199+0000","last_active":"2024-03-12T17:20:29.192005+0000","last_peered":"2024-03-12T17:20:29.192005+0000","last_clean":"2024-03-12T17:20:29.192005+0000","last_became_active":"2024-03-12T17:20:28.726866+0000","last_became_peered":"2024-03-12T17:20:28.726866+0000","last_unstale":"2024-03-12T17:20:29.192005+0000","last_undegraded":"2024-03-12T17:20:29.192005+0000","last_fullsized":"2024-03-12T17:20:29.192005+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:33:00.215462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.198044+0000","last_change":"2024-03-12T17:20:29.201709+0000","last_active":"2024-03-12T17:20:30.198044+0000","last_peered":"2024-03-12T17:20:30.198044+0000","last_clean":"2024-03-12T17:20:30.198044+0000","last_became_active":"2024-03-12T17:20:29.201241+0000","last_became_peered":"2024-03-12T17:20:29.201241+0000","last_unstale":"2024-03-12T17:20:30.198044+0000","last_undegraded":"2024-03-12T17:20:30.198044+0000","last_fullsized":"2024-03-12T17:20:30.198044+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:10:31.923564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"46'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.224913+0000","last_change":"2024-03-12T17:20:28.725108+0000","last_active":"2024-03-12T17:20:29.224913+0000","last_peered":"2024-03-12T17:20:29.224913+0000","last_clean":"2024-03-12T17:20:29.224913+0000","last_became_active":"2024-03-12T17:20:28.724780+0000","last_became_peered":"2024-03-12T17:20:28.724780+0000","last_unstale":"2024-03-12T17:20:29.224913+0000","last_undegraded":"2024-03-12T17:20:29.224913+0000","last_fullsized":"2024-03-12T17:20:29.224913+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:40:12.017364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.572681+0000","last_change":"2024-03-12T17:20:29.223479+0000","last_active":"2024-03-12T17:20:30.572681+0000","last_peered":"2024-03-12T17:20:30.572681+0000","last_clean":"2024-03-12T17:20:30.572681+0000","last_became_active":"2024-03-12T17:20:29.223223+0000","last_became_peered":"2024-03-12T17:20:29.223223+0000","last_unstale":"2024-03-12T17:20:30.572681+0000","last_undegraded":"2024-03-12T17:20:30.572681+0000","last_fullsized":"2024-03-12T17:20:30.572681+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:42:15.956212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.197571+0000","last_change":"2024-03-12T17:20:28.729118+0000","last_active":"2024-03-12T17:20:29.197571+0000","last_peered":"2024-03-12T17:20:29.197571+0000","last_clean":"2024-03-12T17:20:29.197571+0000","last_became_active":"2024-03-12T17:20:28.728803+0000","last_became_peered":"2024-03-12T17:20:28.728803+0000","last_unstale":"2024-03-12T17:20:29.197571+0000","last_undegraded":"2024-03-12T17:20:29.197571+0000","last_fullsized":"2024-03-12T17:20:29.197571+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:22:45.140874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.570537+0000","last_change":"2024-03-12T17:20:29.213919+0000","last_active":"2024-03-12T17:20:30.570537+0000","last_peered":"2024-03-12T17:20:30.570537+0000","last_clean":"2024-03-12T17:20:30.570537+0000","last_became_active":"2024-03-12T17:20:29.213437+0000","last_became_peered":"2024-03-12T17:20:29.213437+0000","last_unstale":"2024-03-12T17:20:30.570537+0000","last_undegraded":"2024-03-12T17:20:30.570537+0000","last_fullsized":"2024-03-12T17:20:30.570537+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:49:17.594288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.200332+0000","last_change":"2024-03-12T17:20:28.724596+0000","last_active":"2024-03-12T17:20:29.200332+0000","last_peered":"2024-03-12T17:20:29.200332+0000","last_clean":"2024-03-12T17:20:29.200332+0000","last_became_active":"2024-03-12T17:20:28.724014+0000","last_became_peered":"2024-03-12T17:20:28.724014+0000","last_unstale":"2024-03-12T17:20:29.200332+0000","last_undegraded":"2024-03-12T17:20:29.200332+0000","last_fullsized":"2024-03-12T17:20:29.200332+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:09:46.909429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.570755+0000","last_change":"2024-03-12T17:20:29.207519+0000","last_active":"2024-03-12T17:20:30.570755+0000","last_peered":"2024-03-12T17:20:30.570755+0000","last_clean":"2024-03-12T17:20:30.570755+0000","last_became_active":"2024-03-12T17:20:29.207292+0000","last_became_peered":"2024-03-12T17:20:29.207292+0000","last_unstale":"2024-03-12T17:20:30.570755+0000","last_undegraded":"2024-03-12T17:20:30.570755+0000","last_fullsized":"2024-03-12T17:20:30.570755+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:25:12.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.193179+0000","last_change":"2024-03-12T17:20:28.732170+0000","last_active":"2024-03-12T17:20:29.193179+0000","last_peered":"2024-03-12T17:20:29.193179+0000","last_clean":"2024-03-12T17:20:29.193179+0000","last_became_active":"2024-03-12T17:20:28.731858+0000","last_became_peered":"2024-03-12T17:20:28.731858+0000","last_unstale":"2024-03-12T17:20:29.193179+0000","last_undegraded":"2024-03-12T17:20:29.193179+0000","last_fullsized":"2024-03-12T17:20:29.193179+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T00:25:46.901152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.472390+0000","last_change":"2024-03-12T17:20:29.224647+0000","last_active":"2024-03-12T17:20:30.472390+0000","last_peered":"2024-03-12T17:20:30.472390+0000","last_clean":"2024-03-12T17:20:30.472390+0000","last_became_active":"2024-03-12T17:20:29.222606+0000","last_became_peered":"2024-03-12T17:20:29.222606+0000","last_unstale":"2024-03-12T17:20:30.472390+0000","last_undegraded":"2024-03-12T17:20:30.472390+0000","last_fullsized":"2024-03-12T17:20:30.472390+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:42:15.956212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.198700+0000","last_change":"2024-03-12T17:20:28.726794+0000","last_active":"2024-03-12T17:20:30.198700+0000","last_peered":"2024-03-12T17:20:30.198700+0000","last_clean":"2024-03-12T17:20:30.198700+0000","last_became_active":"2024-03-12T17:20:28.726443+0000","last_became_peered":"2024-03-12T17:20:28.726443+0000","last_unstale":"2024-03-12T17:20:30.198700+0000","last_undegraded":"2024-03-12T17:20:30.198700+0000","last_fullsized":"2024-03-12T17:20:30.198700+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:44:37.644079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.571025+0000","last_change":"2024-03-12T17:20:29.219922+0000","last_active":"2024-03-12T17:20:30.571025+0000","last_peered":"2024-03-12T17:20:30.571025+0000","last_clean":"2024-03-12T17:20:30.571025+0000","last_became_active":"2024-03-12T17:20:29.219761+0000","last_became_peered":"2024-03-12T17:20:29.219761+0000","last_unstale":"2024-03-12T17:20:30.571025+0000","last_undegraded":"2024-03-12T17:20:30.571025+0000","last_fullsized":"2024-03-12T17:20:30.571025+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:07:40.148420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.195806+0000","last_change":"2024-03-12T17:20:28.731082+0000","last_active":"2024-03-12T17:20:29.195806+0000","last_peered":"2024-03-12T17:20:29.195806+0000","last_clean":"2024-03-12T17:20:29.195806+0000","last_became_active":"2024-03-12T17:20:28.730779+0000","last_became_peered":"2024-03-12T17:20:28.730779+0000","last_unstale":"2024-03-12T17:20:29.195806+0000","last_undegraded":"2024-03-12T17:20:29.195806+0000","last_fullsized":"2024-03-12T17:20:29.195806+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:25:11.954612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.203596+0000","last_change":"2024-03-12T17:20:29.210202+0000","last_active":"2024-03-12T17:20:30.203596+0000","last_peered":"2024-03-12T17:20:30.203596+0000","last_clean":"2024-03-12T17:20:30.203596+0000","last_became_active":"2024-03-12T17:20:29.208122+0000","last_became_peered":"2024-03-12T17:20:29.208122+0000","last_unstale":"2024-03-12T17:20:30.203596+0000","last_undegraded":"2024-03-12T17:20:30.203596+0000","last_fullsized":"2024-03-12T17:20:30.203596+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:06:57.154913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.203233+0000","last_change":"2024-03-12T17:20:28.725747+0000","last_active":"2024-03-12T17:20:29.203233+0000","last_peered":"2024-03-12T17:20:29.203233+0000","last_clean":"2024-03-12T17:20:29.203233+0000","last_became_active":"2024-03-12T17:20:28.725465+0000","last_became_peered":"2024-03-12T17:20:28.725465+0000","last_unstale":"2024-03-12T17:20:29.203233+0000","last_undegraded":"2024-03-12T17:20:29.203233+0000","last_fullsized":"2024-03-12T17:20:29.203233+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:22:45.140874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.198222+0000","last_change":"2024-03-12T17:20:29.215224+0000","last_active":"2024-03-12T17:20:30.198222+0000","last_peered":"2024-03-12T17:20:30.198222+0000","last_clean":"2024-03-12T17:20:30.198222+0000","last_became_active":"2024-03-12T17:20:29.214994+0000","last_became_peered":"2024-03-12T17:20:29.214994+0000","last_unstale":"2024-03-12T17:20:30.198222+0000","last_undegraded":"2024-03-12T17:20:30.198222+0000","last_fullsized":"2024-03-12T17:20:30.198222+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T05:11:40.637126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.193153+0000","last_change":"2024-03-12T17:20:28.732059+0000","last_active":"2024-03-12T17:20:29.193153+0000","last_peered":"2024-03-12T17:20:29.193153+0000","last_clean":"2024-03-12T17:20:29.193153+0000","last_became_active":"2024-03-12T17:20:28.731787+0000","last_became_peered":"2024-03-12T17:20:28.731787+0000","last_unstale":"2024-03-12T17:20:29.193153+0000","last_undegraded":"2024-03-12T17:20:29.193153+0000","last_fullsized":"2024-03-12T17:20:29.193153+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:24:31.966644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.198190+0000","last_change":"2024-03-12T17:20:29.202101+0000","last_active":"2024-03-12T17:20:30.198190+0000","last_peered":"2024-03-12T17:20:30.198190+0000","last_clean":"2024-03-12T17:20:30.198190+0000","last_became_active":"2024-03-12T17:20:29.201835+0000","last_became_peered":"2024-03-12T17:20:29.201835+0000","last_unstale":"2024-03-12T17:20:30.198190+0000","last_undegraded":"2024-03-12T17:20:30.198190+0000","last_fullsized":"2024-03-12T17:20:30.198190+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T05:02:49.972593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.211041+0000","last_change":"2024-03-12T17:20:28.725244+0000","last_active":"2024-03-12T17:20:29.211041+0000","last_peered":"2024-03-12T17:20:29.211041+0000","last_clean":"2024-03-12T17:20:29.211041+0000","last_became_active":"2024-03-12T17:20:28.720330+0000","last_became_peered":"2024-03-12T17:20:28.720330+0000","last_unstale":"2024-03-12T17:20:29.211041+0000","last_undegraded":"2024-03-12T17:20:29.211041+0000","last_fullsized":"2024-03-12T17:20:29.211041+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:49:16.580593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.201523+0000","last_change":"2024-03-12T17:20:29.215290+0000","last_active":"2024-03-12T17:20:30.201523+0000","last_peered":"2024-03-12T17:20:30.201523+0000","last_clean":"2024-03-12T17:20:30.201523+0000","last_became_active":"2024-03-12T17:20:29.211926+0000","last_became_peered":"2024-03-12T17:20:29.211926+0000","last_unstale":"2024-03-12T17:20:30.201523+0000","last_undegraded":"2024-03-12T17:20:30.201523+0000","last_fullsized":"2024-03-12T17:20:30.201523+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:42:34.931002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.203858+0000","last_change":"2024-03-12T17:20:28.724922+0000","last_active":"2024-03-12T17:20:29.203858+0000","last_peered":"2024-03-12T17:20:29.203858+0000","last_clean":"2024-03-12T17:20:29.203858+0000","last_became_active":"2024-03-12T17:20:28.724626+0000","last_became_peered":"2024-03-12T17:20:28.724626+0000","last_unstale":"2024-03-12T17:20:29.203858+0000","last_undegraded":"2024-03-12T17:20:29.203858+0000","last_fullsized":"2024-03-12T17:20:29.203858+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:06:42.471948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.569324+0000","last_change":"2024-03-12T17:20:29.221664+0000","last_active":"2024-03-12T17:20:30.569324+0000","last_peered":"2024-03-12T17:20:30.569324+0000","last_clean":"2024-03-12T17:20:30.569324+0000","last_became_active":"2024-03-12T17:20:29.220805+0000","last_became_peered":"2024-03-12T17:20:29.220805+0000","last_unstale":"2024-03-12T17:20:30.569324+0000","last_undegraded":"2024-03-12T17:20:30.569324+0000","last_fullsized":"2024-03-12T17:20:30.569324+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:40:13.031059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.196465+0000","last_change":"2024-03-12T17:20:28.718259+0000","last_active":"2024-03-12T17:20:29.196465+0000","last_peered":"2024-03-12T17:20:29.196465+0000","last_clean":"2024-03-12T17:20:29.196465+0000","last_became_active":"2024-03-12T17:20:28.717919+0000","last_became_peered":"2024-03-12T17:20:28.717919+0000","last_unstale":"2024-03-12T17:20:29.196465+0000","last_undegraded":"2024-03-12T17:20:29.196465+0000","last_fullsized":"2024-03-12T17:20:29.196465+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:23:16.616382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.571463+0000","last_change":"2024-03-12T17:20:29.214388+0000","last_active":"2024-03-12T17:20:30.571463+0000","last_peered":"2024-03-12T17:20:30.571463+0000","last_clean":"2024-03-12T17:20:30.571463+0000","last_became_active":"2024-03-12T17:20:29.214164+0000","last_became_peered":"2024-03-12T17:20:29.214164+0000","last_unstale":"2024-03-12T17:20:30.571463+0000","last_undegraded":"2024-03-12T17:20:30.571463+0000","last_fullsized":"2024-03-12T17:20:30.571463+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:28:56.981079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"46'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.220345+0000","last_change":"2024-03-12T17:20:28.718309+0000","last_active":"2024-03-12T17:20:29.220345+0000","last_peered":"2024-03-12T17:20:29.220345+0000","last_clean":"2024-03-12T17:20:29.220345+0000","last_became_active":"2024-03-12T17:20:28.716753+0000","last_became_peered":"2024-03-12T17:20:28.716753+0000","last_unstale":"2024-03-12T17:20:29.220345+0000","last_undegraded":"2024-03-12T17:20:29.220345+0000","last_fullsized":"2024-03-12T17:20:29.220345+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:34:52.559454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":184,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.193445+0000","last_change":"2024-03-12T17:18:41.331756+0000","last_active":"2024-03-12T17:20:29.193445+0000","last_peered":"2024-03-12T17:20:29.193445+0000","last_clean":"2024-03-12T17:20:29.193445+0000","last_became_active":"2024-03-12T17:18:41.329237+0000","last_became_peered":"2024-03-12T17:18:41.329237+0000","last_unstale":"2024-03-12T17:20:29.193445+0000","last_undegraded":"2024-03-12T17:20:29.193445+0000","last_fullsized":"2024-03-12T17:20:29.193445+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:40.152422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:40.152422+0000","last_clean_scrub_stamp":"2024-03-12T17:18:40.152422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:35:43.664403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32248,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1150976,"data_stored":815531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.66700000000000004}]},{"osd":1,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.60699999999999998},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":0.77300000000000002}]},{"osd":2,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":1.169},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.86699999999999999}]},{"osd":3,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":1.0329999999999999}]},{"osd":4,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.204},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":2.2490000000000001,"5min":2.2490000000000001,"15min":2.2490000000000001},"last":1.28}]},{"osd":5,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.1909999999999998,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":3.9689999999999999,"5min":3.9689999999999999,"15min":3.9689999999999999},"last":1.377}]},{"osd":6,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":3.8319999999999999,"5min":3.8319999999999999,"15min":3.8319999999999999},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":1.232}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31676,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340164,"statfs":{"total":96636764160,"available":96604327936,"internally_reserved":0,"allocated":561152,"data_stored":225745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.5390000000000001,"5min":3.5390000000000001,"15min":3.5390000000000001},"last":1.075},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.0249999999999999}]},{"osd":1,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":1.173}]},{"osd":2,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.212},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.9689999999999999,"5min":2.9689999999999999,"15min":2.9689999999999999},"last":1.254}]},{"osd":3,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.99099999999999999}]},{"osd":4,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.1160000000000001}]},{"osd":5,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.8660000000000001,"5min":2.8660000000000001,"15min":2.8660000000000001},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.931,"5min":2.931,"15min":2.931},"last":1.3740000000000001}]},{"osd":7,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":1.425},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":1.98,"5min":1.98,"15min":1.98},"last":1.298}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31672,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340168,"statfs":{"total":96636764160,"available":96604332032,"internally_reserved":0,"allocated":557056,"data_stored":225143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.8149999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.026}]},{"osd":1,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":1.081},{"interface":"front","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":2.5699999999999998,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":1.268}]},{"osd":2,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.613,"5min":2.613,"15min":2.613},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.359,"5min":2.359,"15min":2.359},"last":0.79000000000000004}]},{"osd":3,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":2.0670000000000002,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":1.512}]},{"osd":4,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.488}]},{"osd":6,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":2.4609999999999999,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.6279999999999999}]},{"osd":7,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"min":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"max":{"1min":2.8700000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.8380000000000001},{"interface":"front","average":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"min":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"max":{"1min":2.722,"5min":2.722,"15min":2.722},"last":1.6890000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31668,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340172,"statfs":{"total":96636764160,"available":96604336128,"internally_reserved":0,"allocated":565248,"data_stored":226637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":4.8979999999999997,"5min":4.8979999999999997,"15min":4.8979999999999997},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":4.8300000000000001,"5min":4.8300000000000001,"15min":4.8300000000000001},"last":0.86199999999999999}]},{"osd":1,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":4.7779999999999996,"5min":4.7779999999999996,"15min":4.7779999999999996},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":1.2529999999999999}]},{"osd":2,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.004},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.3220000000000001,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":1.3580000000000001}]},{"osd":3,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":1.296},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.216}]},{"osd":5,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":1.4630000000000001}]},{"osd":6,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.5},{"interface":"front","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":2.4750000000000001,"5min":2.4750000000000001,"15min":2.4750000000000001},"last":1.542}]},{"osd":7,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.446},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.4260000000000002,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":1.5609999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31680,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340160,"statfs":{"total":96636764160,"available":96604323840,"internally_reserved":0,"allocated":565248,"data_stored":225711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.9580000000000002,"5min":2.9580000000000002,"15min":2.9580000000000002},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":3.9940000000000002,"5min":3.9940000000000002,"15min":3.9940000000000002},"last":0.68400000000000005}]},{"osd":1,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":4.774,"5min":4.774,"15min":4.774},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":5.0069999999999997,"5min":5.0069999999999997,"15min":5.0069999999999997},"last":1.177}]},{"osd":2,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":2.4660000000000002,"5min":2.4660000000000002,"15min":2.4660000000000002},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":4.5650000000000004,"5min":4.5650000000000004,"15min":4.5650000000000004},"last":1.0469999999999999}]},{"osd":4,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.482,"15min":1.482},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":2.8860000000000001,"5min":2.8860000000000001,"15min":2.8860000000000001},"last":1.099},{"interface":"front","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":4.3520000000000003,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":1.226}]},{"osd":5,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":2.843,"5min":2.843,"15min":2.843},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.8149999999999999,"5min":2.8149999999999999,"15min":2.8149999999999999},"last":1.3220000000000001}]},{"osd":6,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":2.9199999999999999,"5min":2.9199999999999999,"15min":2.9199999999999999},"last":1.341},{"interface":"front","average":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":2.6589999999999998,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.25}]},{"osd":7,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"min":{"1min":1.006,"5min":1.006,"15min":1.006},"max":{"1min":4.6600000000000001,"5min":4.6600000000000001,"15min":4.6600000000000001},"last":1.454},{"interface":"front","average":{"1min":1.599,"5min":1.599,"15min":1.599},"min":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"max":{"1min":4.4720000000000004,"5min":4.4720000000000004,"15min":4.4720000000000004},"last":1.5349999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31680,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340160,"statfs":{"total":96636764160,"available":96604323840,"internally_reserved":0,"allocated":569344,"data_stored":226659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":3.1829999999999998,"5min":3.1829999999999998,"15min":3.1829999999999998},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":0.98799999999999999}]},{"osd":1,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":3.1019999999999999,"5min":3.1019999999999999,"15min":3.1019999999999999},"last":0.93400000000000005}]},{"osd":3,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":2.7810000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":1.349},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":3.1419999999999999,"5min":3.1419999999999999,"15min":3.1419999999999999},"last":1.2789999999999999}]},{"osd":4,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.643,"5min":1.643,"15min":1.643},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":7.96,"5min":7.96,"15min":7.96},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":3.3780000000000001,"5min":3.3780000000000001,"15min":3.3780000000000001},"last":1.7090000000000001}]},{"osd":5,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":4.0659999999999998,"5min":4.0659999999999998,"15min":4.0659999999999998},"last":1.7809999999999999},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":3.012,"5min":3.012,"15min":3.012},"last":1.6259999999999999}]},{"osd":6,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":3.2330000000000001,"5min":3.2330000000000001,"15min":3.2330000000000001},"last":1.821},{"interface":"front","average":{"1min":1.804,"5min":1.804,"15min":1.804},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":7.9059999999999997,"5min":7.9059999999999997,"15min":7.9059999999999997},"last":1.413}]},{"osd":7,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":4.0229999999999997,"5min":4.0229999999999997,"15min":4.0229999999999997},"last":1.8720000000000001},{"interface":"front","average":{"1min":1.506,"5min":1.506,"15min":1.506},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":3.27,"5min":3.27,"15min":3.27},"last":1.9350000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31660,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340180,"statfs":{"total":96636764160,"available":96604344320,"internally_reserved":0,"allocated":557056,"data_stored":225143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.581,"5min":2.581,"15min":2.581},"last":0.92700000000000005}]},{"osd":2,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":1.373},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.5720000000000001,"5min":2.5720000000000001,"15min":2.5720000000000001},"last":1.1299999999999999}]},{"osd":3,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.4580000000000002,"5min":2.4580000000000002,"15min":2.4580000000000002},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.208,"5min":1.208,"15min":1.208},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.9609999999999999,"5min":2.9609999999999999,"15min":2.9609999999999999},"last":1.262}]},{"osd":4,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":2.4580000000000002,"5min":2.4580000000000002,"15min":2.4580000000000002},"last":1.6220000000000001},{"interface":"front","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.6909999999999998,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":1.417}]},{"osd":5,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":3.0609999999999999,"5min":3.0609999999999999,"15min":3.0609999999999999},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":1.516}]},{"osd":6,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":3.1030000000000002,"5min":3.1030000000000002,"15min":3.1030000000000002},"last":1.569},{"interface":"front","average":{"1min":1.395,"5min":1.395,"15min":1.395},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.274,"5min":2.274,"15min":2.274},"last":1.722}]},{"osd":7,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.7959999999999998,"5min":2.7959999999999998,"15min":2.7959999999999998},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.55,"5min":1.55,"15min":1.55},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":3.1440000000000001,"5min":3.1440000000000001,"15min":3.1440000000000001},"last":1.663}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1150976,"data_stored":815475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.82799999999999996},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.04}]},{"osd":2,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.99,"5min":1.99,"15min":1.99},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":0.88}]},{"osd":3,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":1.232}]},{"osd":4,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":3.2349999999999999,"5min":3.2349999999999999,"15min":3.2349999999999999},"last":1.401},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":2.5369999999999999,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":1.4319999999999999}]},{"osd":5,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.988,"5min":2.988,"15min":2.988},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.843,"5min":2.843,"15min":2.843},"last":1.53}]},{"osd":6,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":2.431,"5min":2.431,"15min":2.431},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.589,"5min":2.589,"15min":2.589},"last":1.2789999999999999}]},{"osd":7,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.637,"5min":1.637,"15min":1.637},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":2.8929999999999998,"5min":2.8929999999999998,"15min":2.8929999999999998},"last":1.472}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-12T17:20:38.992 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-12T17:20:39.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.225+0000 7f7af1600640 1 Processor -- start 2024-03-12T17:20:39.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.225+0000 7f7af1600640 1 -- start start 2024-03-12T17:20:39.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.227+0000 7f7af1600640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7aec0cab30 0x7f7aec070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:39.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.227+0000 7f7af1600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7aec13f360 0x7f7aec071010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:39.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.227+0000 7f7af1600640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aec159780 con 0x7f7aec13ef80 2024-03-12T17:20:39.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.227+0000 7f7af1600640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aec0cbae0 con 0x7f7aec0cab30 2024-03-12T17:20:39.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.227+0000 7f7af1600640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec159a60 con 0x7f7aec13f360 2024-03-12T17:20:39.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.228+0000 7f7af0c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7aec13f360 0x7f7aec071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:39.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.228+0000 7f7aeb400640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7aec0cab30 0x7f7aec070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:39.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.228+0000 7f7aeb400640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f7aec0cab30 0x7f7aec070ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3300/0 says I am v2:172.21.15.17:38154/0 (socket says 172.21.15.17:38154) 2024-03-12T17:20:39.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.228+0000 7f7af0c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7aec13f360 0x7f7aec071010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.17:56202/0 (socket says 172.21.15.17:56202) 2024-03-12T17:20:39.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.228+0000 7f7aeb400640 1 -- 172.21.15.17:0/3137380698 learned_addr learned my addr 172.21.15.17:0/3137380698 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:39.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.228+0000 7f7af0c00640 1 -- 172.21.15.17:0/3137380698 >> v2:172.21.15.94:3300/0 conn(0x7f7aec0cab30 msgr2=0x7f7aec070ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:39.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.228+0000 7f7af0c00640 1 --2- 172.21.15.17:0/3137380698 >> v2:172.21.15.94:3300/0 conn(0x7f7aec0cab30 0x7f7aec070ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:39.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.228+0000 7f7af0c00640 1 -- 172.21.15.17:0/3137380698 >> v1:172.21.15.94:6789/0 conn(0x7f7aec13ef80 legacy=0x7f7aec0cb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:39.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.228+0000 7f7af0c00640 1 -- 172.21.15.17:0/3137380698 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aec159d40 con 0x7f7aec13f360 2024-03-12T17:20:39.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.230+0000 7f7af0c00640 1 --2- 172.21.15.17:0/3137380698 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7aec13f360 0x7f7aec071010 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4009d90 tx=0x7f7ae402beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6ae27e72cc66c1e server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:39.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.230+0000 7f7aeaa00640 1 -- 172.21.15.17:0/3137380698 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae402cc60 con 0x7f7aec13f360 2024-03-12T17:20:39.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.230+0000 7f7aeaa00640 1 -- 172.21.15.17:0/3137380698 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae402cdc0 con 0x7f7aec13f360 2024-03-12T17:20:39.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.230+0000 7f7aeaa00640 1 -- 172.21.15.17:0/3137380698 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae4034660 con 0x7f7aec13f360 2024-03-12T17:20:39.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.231+0000 7f7af1600640 1 -- 172.21.15.17:0/3137380698 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7aec13f360 msgr2=0x7f7aec071010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:39.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.231+0000 7f7af1600640 1 --2- 172.21.15.17:0/3137380698 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7aec13f360 0x7f7aec071010 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4009d90 tx=0x7f7ae402beb0 comp rx=0 tx=0).stop 2024-03-12T17:20:39.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.231+0000 7f7af1600640 1 -- 172.21.15.17:0/3137380698 shutdown_connections 2024-03-12T17:20:39.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.231+0000 7f7af1600640 1 --2- 172.21.15.17:0/3137380698 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7aec13f360 0x7f7aec071010 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:39.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.231+0000 7f7af1600640 1 --2- 172.21.15.17:0/3137380698 >> v2:172.21.15.94:3300/0 conn(0x7f7aec0cab30 0x7f7aec070ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:39.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.231+0000 7f7af1600640 1 -- 172.21.15.17:0/3137380698 >> 172.21.15.17:0/3137380698 conn(0x7f7aec069ce0 msgr2=0x7f7aec06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:39.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.231+0000 7f7af1600640 1 -- 172.21.15.17:0/3137380698 shutdown_connections 2024-03-12T17:20:39.227 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.231+0000 7f7af1600640 1 -- 172.21.15.17:0/3137380698 wait complete. 2024-03-12T17:20:39.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.233+0000 7f7af1600640 1 Processor -- start 2024-03-12T17:20:39.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.233+0000 7f7af1600640 1 -- start start 2024-03-12T17:20:39.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.234+0000 7f7af1600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7aec0cab30 0x7f7aec13e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:39.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.234+0000 7f7af1600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7aec13ef80 0x7f7aec0aeff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:39.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.234+0000 7f7af1600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7aec13f360 0x7f7aec1efa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:39.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.234+0000 7f7af1600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec13e870 con 0x7f7aec13f360 2024-03-12T17:20:39.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.234+0000 7f7af1600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec0af530 con 0x7f7aec0cab30 2024-03-12T17:20:39.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.234+0000 7f7af1600640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aec0af760 con 0x7f7aec13ef80 2024-03-12T17:20:39.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.234+0000 7f7af0c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7aec13f360 0x7f7aec1efa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:39.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.234+0000 7f7af0c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7aec13f360 0x7f7aec1efa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58752/0 (socket says 172.21.15.17:58752) 2024-03-12T17:20:39.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.234+0000 7f7af0c00640 1 -- 172.21.15.17:0/3922783483 learned_addr learned my addr 172.21.15.17:0/3922783483 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:39.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.235+0000 7f7aeb400640 1 --2- 172.21.15.17:0/3922783483 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7aec13ef80 0x7f7aec0aeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:39.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.235+0000 7f7aebe00640 1 --2- 172.21.15.17:0/3922783483 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7aec0cab30 0x7f7aec13e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:39.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.235+0000 7f7af0c00640 1 -- 172.21.15.17:0/3922783483 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7aec13ef80 msgr2=0x7f7aec0aeff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:39.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.235+0000 7f7af0c00640 1 --2- 172.21.15.17:0/3922783483 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7aec13ef80 0x7f7aec0aeff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:39.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.235+0000 7f7af0c00640 1 -- 172.21.15.17:0/3922783483 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7aec0cab30 msgr2=0x7f7aec13e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:39.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.235+0000 7f7af0c00640 1 --2- 172.21.15.17:0/3922783483 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7aec0cab30 0x7f7aec13e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:39.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.235+0000 7f7af0c00640 1 -- 172.21.15.17:0/3922783483 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae4009a70 con 0x7f7aec13f360 2024-03-12T17:20:39.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.235+0000 7f7af0c00640 1 --2- 172.21.15.17:0/3922783483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7aec13f360 0x7f7aec1efa50 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4009d90 tx=0x7f7ae4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:39.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.236+0000 7f7ae3e00640 1 -- 172.21.15.17:0/3922783483 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae4040650 con 0x7f7aec13f360 2024-03-12T17:20:39.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.236+0000 7f7ae3e00640 1 -- 172.21.15.17:0/3922783483 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae40407b0 con 0x7f7aec13f360 2024-03-12T17:20:39.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.236+0000 7f7ae3e00640 1 -- 172.21.15.17:0/3922783483 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae4040b60 con 0x7f7aec13f360 2024-03-12T17:20:39.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.236+0000 7f7af1600640 1 -- 172.21.15.17:0/3922783483 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aec0afa40 con 0x7f7aec13f360 2024-03-12T17:20:39.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.236+0000 7f7af1600640 1 -- 172.21.15.17:0/3922783483 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aec0b0000 con 0x7f7aec13f360 2024-03-12T17:20:39.232 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.237+0000 7f7af1600640 1 -- 172.21.15.17:0/3922783483 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aec04e030 con 0x7f7aec13f360 2024-03-12T17:20:39.233 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.238+0000 7f7ae3e00640 1 -- 172.21.15.17:0/3922783483 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f7ae4040cc0 con 0x7f7aec13f360 2024-03-12T17:20:39.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.239+0000 7f7ae3e00640 1 --2- 172.21.15.17:0/3922783483 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f7acc06ac00 0x7f7acc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:39.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.239+0000 7f7ae3e00640 1 -- 172.21.15.17:0/3922783483 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ae40ac190 con 0x7f7aec13f360 2024-03-12T17:20:39.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.239+0000 7f7aebe00640 1 --2- 172.21.15.17:0/3922783483 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f7acc06ac00 0x7f7acc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:39.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.240+0000 7f7aebe00640 1 --2- 172.21.15.17:0/3922783483 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f7acc06ac00 0x7f7acc06d0c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7adc000f60 tx=0x7f7adc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:39.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.244+0000 7f7ae3e00640 1 -- 172.21.15.17:0/3922783483 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f7ae40772d0 con 0x7f7aec13f360 2024-03-12T17:20:39.437 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.441+0000 7f7af1600640 1 -- 172.21.15.17:0/3922783483 --> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7aec159450 con 0x7f7acc06ac00 2024-03-12T17:20:39.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.454+0000 7f7ae3e00640 1 -- 172.21.15.17:0/3922783483 <== mgr.4104 v2:172.21.15.17:6832/37052 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287268 (secure 0 0 0) 0x7f7adc001c70 con 0x7f7acc06ac00 2024-03-12T17:20:39.454 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:20:39.455 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-03-12T17:20:39.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.460+0000 7f7af1600640 1 -- 172.21.15.17:0/3922783483 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f7acc06ac00 msgr2=0x7f7acc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:39.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.460+0000 7f7af1600640 1 --2- 172.21.15.17:0/3922783483 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f7acc06ac00 0x7f7acc06d0c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7adc000f60 tx=0x7f7adc009040 comp rx=0 tx=0).stop 2024-03-12T17:20:39.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.460+0000 7f7af1600640 1 -- 172.21.15.17:0/3922783483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7aec13f360 msgr2=0x7f7aec1efa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:39.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.460+0000 7f7af1600640 1 --2- 172.21.15.17:0/3922783483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7aec13f360 0x7f7aec1efa50 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4009d90 tx=0x7f7ae4004a40 comp rx=0 tx=0).stop 2024-03-12T17:20:39.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.461+0000 7f7af1600640 1 -- 172.21.15.17:0/3922783483 shutdown_connections 2024-03-12T17:20:39.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.461+0000 7f7af1600640 1 --2- 172.21.15.17:0/3922783483 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f7acc06ac00 0x7f7acc06d0c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:39.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.461+0000 7f7af1600640 1 --2- 172.21.15.17:0/3922783483 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7aec13f360 0x7f7aec1efa50 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:39.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.461+0000 7f7af1600640 1 --2- 172.21.15.17:0/3922783483 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f7aec13ef80 0x7f7aec0aeff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:39.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.461+0000 7f7af1600640 1 --2- 172.21.15.17:0/3922783483 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7aec0cab30 0x7f7aec13e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:39.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.461+0000 7f7af1600640 1 -- 172.21.15.17:0/3922783483 >> 172.21.15.17:0/3922783483 conn(0x7f7aec069ce0 msgr2=0x7f7aec157490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:39.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.461+0000 7f7af1600640 1 -- 172.21.15.17:0/3922783483 shutdown_connections 2024-03-12T17:20:39.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.461+0000 7f7af1600640 1 -- 172.21.15.17:0/3922783483 wait complete. 2024-03-12T17:20:39.475 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2024-03-12T17:20:37.514824+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254536,"kb_used_data":5544,"kb_used_omap":13,"kb_used_meta":248818,"kb_avail":754720184,"statfs":{"total":773094113280,"available":772833468416,"internally_reserved":0,"allocated":5677056,"data_stored":2986044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":254789720},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.328109"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.202908+0000","last_change":"2024-03-12T17:20:29.220236+0000","last_active":"2024-03-12T17:20:30.202908+0000","last_peered":"2024-03-12T17:20:30.202908+0000","last_clean":"2024-03-12T17:20:30.202908+0000","last_became_active":"2024-03-12T17:20:29.219885+0000","last_became_peered":"2024-03-12T17:20:29.219885+0000","last_unstale":"2024-03-12T17:20:30.202908+0000","last_undegraded":"2024-03-12T17:20:30.202908+0000","last_fullsized":"2024-03-12T17:20:30.202908+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:36:53.928201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.204123+0000","last_change":"2024-03-12T17:20:29.213110+0000","last_active":"2024-03-12T17:20:30.204123+0000","last_peered":"2024-03-12T17:20:30.204123+0000","last_clean":"2024-03-12T17:20:30.204123+0000","last_became_active":"2024-03-12T17:20:29.209736+0000","last_became_peered":"2024-03-12T17:20:29.209736+0000","last_unstale":"2024-03-12T17:20:30.204123+0000","last_undegraded":"2024-03-12T17:20:30.204123+0000","last_fullsized":"2024-03-12T17:20:30.204123+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:25:12.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.569486+0000","last_change":"2024-03-12T17:20:29.221059+0000","last_active":"2024-03-12T17:20:30.569486+0000","last_peered":"2024-03-12T17:20:30.569486+0000","last_clean":"2024-03-12T17:20:30.569486+0000","last_became_active":"2024-03-12T17:20:29.218879+0000","last_became_peered":"2024-03-12T17:20:29.218879+0000","last_unstale":"2024-03-12T17:20:30.569486+0000","last_undegraded":"2024-03-12T17:20:30.569486+0000","last_fullsized":"2024-03-12T17:20:30.569486+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:16:26.689323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.570929+0000","last_change":"2024-03-12T17:20:29.219398+0000","last_active":"2024-03-12T17:20:30.570929+0000","last_peered":"2024-03-12T17:20:30.570929+0000","last_clean":"2024-03-12T17:20:30.570929+0000","last_became_active":"2024-03-12T17:20:29.218268+0000","last_became_peered":"2024-03-12T17:20:29.218268+0000","last_unstale":"2024-03-12T17:20:30.570929+0000","last_undegraded":"2024-03-12T17:20:30.570929+0000","last_fullsized":"2024-03-12T17:20:30.570929+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:04:47.239316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.202639+0000","last_change":"2024-03-12T17:20:29.221496+0000","last_active":"2024-03-12T17:20:30.202639+0000","last_peered":"2024-03-12T17:20:30.202639+0000","last_clean":"2024-03-12T17:20:30.202639+0000","last_became_active":"2024-03-12T17:20:29.221207+0000","last_became_peered":"2024-03-12T17:20:29.221207+0000","last_unstale":"2024-03-12T17:20:30.202639+0000","last_undegraded":"2024-03-12T17:20:30.202639+0000","last_fullsized":"2024-03-12T17:20:30.202639+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:42:23.859341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.198306+0000","last_change":"2024-03-12T17:20:29.216016+0000","last_active":"2024-03-12T17:20:30.198306+0000","last_peered":"2024-03-12T17:20:30.198306+0000","last_clean":"2024-03-12T17:20:30.198306+0000","last_became_active":"2024-03-12T17:20:29.215719+0000","last_became_peered":"2024-03-12T17:20:29.215719+0000","last_unstale":"2024-03-12T17:20:30.198306+0000","last_undegraded":"2024-03-12T17:20:30.198306+0000","last_fullsized":"2024-03-12T17:20:30.198306+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:18:47.978713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.202199+0000","last_change":"2024-03-12T17:20:29.218088+0000","last_active":"2024-03-12T17:20:30.202199+0000","last_peered":"2024-03-12T17:20:30.202199+0000","last_clean":"2024-03-12T17:20:30.202199+0000","last_became_active":"2024-03-12T17:20:29.215989+0000","last_became_peered":"2024-03-12T17:20:29.215989+0000","last_unstale":"2024-03-12T17:20:30.202199+0000","last_undegraded":"2024-03-12T17:20:30.202199+0000","last_fullsized":"2024-03-12T17:20:30.202199+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T00:38:19.945167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.569995+0000","last_change":"2024-03-12T17:20:29.227763+0000","last_active":"2024-03-12T17:20:30.569995+0000","last_peered":"2024-03-12T17:20:30.569995+0000","last_clean":"2024-03-12T17:20:30.569995+0000","last_became_active":"2024-03-12T17:20:29.227311+0000","last_became_peered":"2024-03-12T17:20:29.227311+0000","last_unstale":"2024-03-12T17:20:30.569995+0000","last_undegraded":"2024-03-12T17:20:30.569995+0000","last_fullsized":"2024-03-12T17:20:30.569995+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:19:54.449104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.571749+0000","last_change":"2024-03-12T17:20:29.215235+0000","last_active":"2024-03-12T17:20:30.571749+0000","last_peered":"2024-03-12T17:20:30.571749+0000","last_clean":"2024-03-12T17:20:30.571749+0000","last_became_active":"2024-03-12T17:20:29.213710+0000","last_became_peered":"2024-03-12T17:20:29.213710+0000","last_unstale":"2024-03-12T17:20:30.571749+0000","last_undegraded":"2024-03-12T17:20:30.571749+0000","last_fullsized":"2024-03-12T17:20:30.571749+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:24:32.980339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.571360+0000","last_change":"2024-03-12T17:20:29.230760+0000","last_active":"2024-03-12T17:20:30.571360+0000","last_peered":"2024-03-12T17:20:30.571360+0000","last_clean":"2024-03-12T17:20:30.571360+0000","last_became_active":"2024-03-12T17:20:29.230502+0000","last_became_peered":"2024-03-12T17:20:29.230502+0000","last_unstale":"2024-03-12T17:20:30.571360+0000","last_undegraded":"2024-03-12T17:20:30.571360+0000","last_fullsized":"2024-03-12T17:20:30.571360+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:47:27.611484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.572357+0000","last_change":"2024-03-12T17:20:29.222874+0000","last_active":"2024-03-12T17:20:30.572357+0000","last_peered":"2024-03-12T17:20:30.572357+0000","last_clean":"2024-03-12T17:20:30.572357+0000","last_became_active":"2024-03-12T17:20:29.222637+0000","last_became_peered":"2024-03-12T17:20:29.222637+0000","last_unstale":"2024-03-12T17:20:30.572357+0000","last_undegraded":"2024-03-12T17:20:30.572357+0000","last_fullsized":"2024-03-12T17:20:30.572357+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:42:23.859341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.203233+0000","last_change":"2024-03-12T17:20:29.203994+0000","last_active":"2024-03-12T17:20:30.203233+0000","last_peered":"2024-03-12T17:20:30.203233+0000","last_clean":"2024-03-12T17:20:30.203233+0000","last_became_active":"2024-03-12T17:20:29.203332+0000","last_became_peered":"2024-03-12T17:20:29.203332+0000","last_unstale":"2024-03-12T17:20:30.203233+0000","last_undegraded":"2024-03-12T17:20:30.203233+0000","last_fullsized":"2024-03-12T17:20:30.203233+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:24:32.980339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.570674+0000","last_change":"2024-03-12T17:20:29.202938+0000","last_active":"2024-03-12T17:20:30.570674+0000","last_peered":"2024-03-12T17:20:30.570674+0000","last_clean":"2024-03-12T17:20:30.570674+0000","last_became_active":"2024-03-12T17:20:29.202522+0000","last_became_peered":"2024-03-12T17:20:29.202522+0000","last_unstale":"2024-03-12T17:20:30.570674+0000","last_undegraded":"2024-03-12T17:20:30.570674+0000","last_fullsized":"2024-03-12T17:20:30.570674+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:19:02.659380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.571622+0000","last_change":"2024-03-12T17:20:29.208861+0000","last_active":"2024-03-12T17:20:30.571622+0000","last_peered":"2024-03-12T17:20:30.571622+0000","last_clean":"2024-03-12T17:20:30.571622+0000","last_became_active":"2024-03-12T17:20:29.208615+0000","last_became_peered":"2024-03-12T17:20:29.208615+0000","last_unstale":"2024-03-12T17:20:30.571622+0000","last_undegraded":"2024-03-12T17:20:30.571622+0000","last_fullsized":"2024-03-12T17:20:30.571622+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:40:13.031059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.197924+0000","last_change":"2024-03-12T17:20:29.219595+0000","last_active":"2024-03-12T17:20:30.197924+0000","last_peered":"2024-03-12T17:20:30.197924+0000","last_clean":"2024-03-12T17:20:30.197924+0000","last_became_active":"2024-03-12T17:20:29.219308+0000","last_became_peered":"2024-03-12T17:20:29.219308+0000","last_unstale":"2024-03-12T17:20:30.197924+0000","last_undegraded":"2024-03-12T17:20:30.197924+0000","last_fullsized":"2024-03-12T17:20:30.197924+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T00:05:52.290291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.471542+0000","last_change":"2024-03-12T17:20:29.226482+0000","last_active":"2024-03-12T17:20:30.471542+0000","last_peered":"2024-03-12T17:20:30.471542+0000","last_clean":"2024-03-12T17:20:30.471542+0000","last_became_active":"2024-03-12T17:20:29.223961+0000","last_became_peered":"2024-03-12T17:20:29.223961+0000","last_unstale":"2024-03-12T17:20:30.471542+0000","last_undegraded":"2024-03-12T17:20:30.471542+0000","last_fullsized":"2024-03-12T17:20:30.471542+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:40:13.031059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.569930+0000","last_change":"2024-03-12T17:20:29.225895+0000","last_active":"2024-03-12T17:20:30.569930+0000","last_peered":"2024-03-12T17:20:30.569930+0000","last_clean":"2024-03-12T17:20:30.569930+0000","last_became_active":"2024-03-12T17:20:29.225612+0000","last_became_peered":"2024-03-12T17:20:29.225612+0000","last_unstale":"2024-03-12T17:20:30.569930+0000","last_undegraded":"2024-03-12T17:20:30.569930+0000","last_fullsized":"2024-03-12T17:20:30.569930+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:28:56.981079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.569719+0000","last_change":"2024-03-12T17:20:29.220747+0000","last_active":"2024-03-12T17:20:30.569719+0000","last_peered":"2024-03-12T17:20:30.569719+0000","last_clean":"2024-03-12T17:20:30.569719+0000","last_became_active":"2024-03-12T17:20:29.218824+0000","last_became_peered":"2024-03-12T17:20:29.218824+0000","last_unstale":"2024-03-12T17:20:30.569719+0000","last_undegraded":"2024-03-12T17:20:30.569719+0000","last_fullsized":"2024-03-12T17:20:30.569719+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:25:12.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.472324+0000","last_change":"2024-03-12T17:20:29.229800+0000","last_active":"2024-03-12T17:20:30.472324+0000","last_peered":"2024-03-12T17:20:30.472324+0000","last_clean":"2024-03-12T17:20:30.472324+0000","last_became_active":"2024-03-12T17:20:29.229512+0000","last_became_peered":"2024-03-12T17:20:29.229512+0000","last_unstale":"2024-03-12T17:20:30.472324+0000","last_undegraded":"2024-03-12T17:20:30.472324+0000","last_fullsized":"2024-03-12T17:20:30.472324+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:28:56.981079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.571501+0000","last_change":"2024-03-12T17:20:29.212454+0000","last_active":"2024-03-12T17:20:30.571501+0000","last_peered":"2024-03-12T17:20:30.571501+0000","last_clean":"2024-03-12T17:20:30.571501+0000","last_became_active":"2024-03-12T17:20:29.212042+0000","last_became_peered":"2024-03-12T17:20:29.212042+0000","last_unstale":"2024-03-12T17:20:30.571501+0000","last_undegraded":"2024-03-12T17:20:30.571501+0000","last_fullsized":"2024-03-12T17:20:30.571501+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:46:16.152911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.198123+0000","last_change":"2024-03-12T17:20:29.224023+0000","last_active":"2024-03-12T17:20:30.198123+0000","last_peered":"2024-03-12T17:20:30.198123+0000","last_clean":"2024-03-12T17:20:30.198123+0000","last_became_active":"2024-03-12T17:20:29.223678+0000","last_became_peered":"2024-03-12T17:20:29.223678+0000","last_unstale":"2024-03-12T17:20:30.198123+0000","last_undegraded":"2024-03-12T17:20:30.198123+0000","last_fullsized":"2024-03-12T17:20:30.198123+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:22:06.449897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.571873+0000","last_change":"2024-03-12T17:20:29.229810+0000","last_active":"2024-03-12T17:20:30.571873+0000","last_peered":"2024-03-12T17:20:30.571873+0000","last_clean":"2024-03-12T17:20:30.571873+0000","last_became_active":"2024-03-12T17:20:29.229504+0000","last_became_peered":"2024-03-12T17:20:29.229504+0000","last_unstale":"2024-03-12T17:20:30.571873+0000","last_undegraded":"2024-03-12T17:20:30.571873+0000","last_fullsized":"2024-03-12T17:20:30.571873+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:33:01.229156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.471613+0000","last_change":"2024-03-12T17:20:29.221296+0000","last_active":"2024-03-12T17:20:30.471613+0000","last_peered":"2024-03-12T17:20:30.471613+0000","last_clean":"2024-03-12T17:20:30.471613+0000","last_became_active":"2024-03-12T17:20:29.221014+0000","last_became_peered":"2024-03-12T17:20:29.221014+0000","last_unstale":"2024-03-12T17:20:30.471613+0000","last_undegraded":"2024-03-12T17:20:30.471613+0000","last_fullsized":"2024-03-12T17:20:30.471613+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:19:02.659380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.471587+0000","last_change":"2024-03-12T17:20:29.227396+0000","last_active":"2024-03-12T17:20:30.471587+0000","last_peered":"2024-03-12T17:20:30.471587+0000","last_clean":"2024-03-12T17:20:30.471587+0000","last_became_active":"2024-03-12T17:20:29.226762+0000","last_became_peered":"2024-03-12T17:20:29.226762+0000","last_unstale":"2024-03-12T17:20:30.471587+0000","last_undegraded":"2024-03-12T17:20:30.471587+0000","last_fullsized":"2024-03-12T17:20:30.471587+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:06:43.485643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.472246+0000","last_change":"2024-03-12T17:20:29.227203+0000","last_active":"2024-03-12T17:20:30.472246+0000","last_peered":"2024-03-12T17:20:30.472246+0000","last_clean":"2024-03-12T17:20:30.472246+0000","last_became_active":"2024-03-12T17:20:29.226846+0000","last_became_peered":"2024-03-12T17:20:29.226846+0000","last_unstale":"2024-03-12T17:20:30.472246+0000","last_undegraded":"2024-03-12T17:20:30.472246+0000","last_fullsized":"2024-03-12T17:20:30.472246+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:31:05.712095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.571233+0000","last_change":"2024-03-12T17:20:29.199327+0000","last_active":"2024-03-12T17:20:30.571233+0000","last_peered":"2024-03-12T17:20:30.571233+0000","last_clean":"2024-03-12T17:20:30.571233+0000","last_became_active":"2024-03-12T17:20:29.198355+0000","last_became_peered":"2024-03-12T17:20:29.198355+0000","last_unstale":"2024-03-12T17:20:30.571233+0000","last_undegraded":"2024-03-12T17:20:30.571233+0000","last_fullsized":"2024-03-12T17:20:30.571233+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T05:01:56.597284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.569506+0000","last_change":"2024-03-12T17:20:29.227312+0000","last_active":"2024-03-12T17:20:30.569506+0000","last_peered":"2024-03-12T17:20:30.569506+0000","last_clean":"2024-03-12T17:20:30.569506+0000","last_became_active":"2024-03-12T17:20:29.227044+0000","last_became_peered":"2024-03-12T17:20:29.227044+0000","last_unstale":"2024-03-12T17:20:30.569506+0000","last_undegraded":"2024-03-12T17:20:30.569506+0000","last_fullsized":"2024-03-12T17:20:30.569506+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T00:25:47.914846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.203535+0000","last_change":"2024-03-12T17:20:29.203373+0000","last_active":"2024-03-12T17:20:30.203535+0000","last_peered":"2024-03-12T17:20:30.203535+0000","last_clean":"2024-03-12T17:20:30.203535+0000","last_became_active":"2024-03-12T17:20:29.202641+0000","last_became_peered":"2024-03-12T17:20:29.202641+0000","last_unstale":"2024-03-12T17:20:30.203535+0000","last_undegraded":"2024-03-12T17:20:30.203535+0000","last_fullsized":"2024-03-12T17:20:30.203535+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:42:15.956212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.472157+0000","last_change":"2024-03-12T17:20:29.227402+0000","last_active":"2024-03-12T17:20:30.472157+0000","last_peered":"2024-03-12T17:20:30.472157+0000","last_clean":"2024-03-12T17:20:30.472157+0000","last_became_active":"2024-03-12T17:20:29.227096+0000","last_became_peered":"2024-03-12T17:20:29.227096+0000","last_unstale":"2024-03-12T17:20:30.472157+0000","last_undegraded":"2024-03-12T17:20:30.472157+0000","last_fullsized":"2024-03-12T17:20:30.472157+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:16:26.689323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.569323+0000","last_change":"2024-03-12T17:20:29.223912+0000","last_active":"2024-03-12T17:20:30.569323+0000","last_peered":"2024-03-12T17:20:30.569323+0000","last_clean":"2024-03-12T17:20:30.569323+0000","last_became_active":"2024-03-12T17:20:29.223304+0000","last_became_peered":"2024-03-12T17:20:29.223304+0000","last_unstale":"2024-03-12T17:20:30.569323+0000","last_undegraded":"2024-03-12T17:20:30.569323+0000","last_fullsized":"2024-03-12T17:20:30.569323+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:42:15.956212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.197994+0000","last_change":"2024-03-12T17:20:29.203472+0000","last_active":"2024-03-12T17:20:30.197994+0000","last_peered":"2024-03-12T17:20:30.197994+0000","last_clean":"2024-03-12T17:20:30.197994+0000","last_became_active":"2024-03-12T17:20:29.203129+0000","last_became_peered":"2024-03-12T17:20:29.203129+0000","last_unstale":"2024-03-12T17:20:30.197994+0000","last_undegraded":"2024-03-12T17:20:30.197994+0000","last_fullsized":"2024-03-12T17:20:30.197994+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:36:53.928201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.570293+0000","last_change":"2024-03-12T17:20:29.208523+0000","last_active":"2024-03-12T17:20:30.570293+0000","last_peered":"2024-03-12T17:20:30.570293+0000","last_clean":"2024-03-12T17:20:30.570293+0000","last_became_active":"2024-03-12T17:20:29.208260+0000","last_became_peered":"2024-03-12T17:20:29.208260+0000","last_unstale":"2024-03-12T17:20:30.570293+0000","last_undegraded":"2024-03-12T17:20:30.570293+0000","last_fullsized":"2024-03-12T17:20:30.570293+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:51:08.473134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.573261+0000","last_change":"2024-03-12T17:20:29.212012+0000","last_active":"2024-03-12T17:20:30.573261+0000","last_peered":"2024-03-12T17:20:30.573261+0000","last_clean":"2024-03-12T17:20:30.573261+0000","last_became_active":"2024-03-12T17:20:29.211756+0000","last_became_peered":"2024-03-12T17:20:29.211756+0000","last_unstale":"2024-03-12T17:20:30.573261+0000","last_undegraded":"2024-03-12T17:20:30.573261+0000","last_fullsized":"2024-03-12T17:20:30.573261+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:42:34.931002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"46'4","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.230147+0000","last_change":"2024-03-12T17:20:28.724812+0000","last_active":"2024-03-12T17:20:29.230147+0000","last_peered":"2024-03-12T17:20:29.230147+0000","last_clean":"2024-03-12T17:20:29.230147+0000","last_became_active":"2024-03-12T17:20:28.724500+0000","last_became_peered":"2024-03-12T17:20:28.724500+0000","last_unstale":"2024-03-12T17:20:29.230147+0000","last_undegraded":"2024-03-12T17:20:29.230147+0000","last_fullsized":"2024-03-12T17:20:29.230147+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:42:22.845646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.472324+0000","last_change":"2024-03-12T17:20:29.225598+0000","last_active":"2024-03-12T17:20:30.472324+0000","last_peered":"2024-03-12T17:20:30.472324+0000","last_clean":"2024-03-12T17:20:30.472324+0000","last_became_active":"2024-03-12T17:20:29.225259+0000","last_became_peered":"2024-03-12T17:20:29.225259+0000","last_unstale":"2024-03-12T17:20:30.472324+0000","last_undegraded":"2024-03-12T17:20:30.472324+0000","last_fullsized":"2024-03-12T17:20:30.472324+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:27:01.862697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"46'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.229671+0000","last_change":"2024-03-12T17:20:28.725978+0000","last_active":"2024-03-12T17:20:29.229671+0000","last_peered":"2024-03-12T17:20:29.229671+0000","last_clean":"2024-03-12T17:20:29.229671+0000","last_became_active":"2024-03-12T17:20:28.724546+0000","last_became_peered":"2024-03-12T17:20:28.724546+0000","last_unstale":"2024-03-12T17:20:29.229671+0000","last_undegraded":"2024-03-12T17:20:29.229671+0000","last_fullsized":"2024-03-12T17:20:29.229671+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:19:01.645685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.203664+0000","last_change":"2024-03-12T17:20:29.214586+0000","last_active":"2024-03-12T17:20:30.203664+0000","last_peered":"2024-03-12T17:20:30.203664+0000","last_clean":"2024-03-12T17:20:30.203664+0000","last_became_active":"2024-03-12T17:20:29.214242+0000","last_became_peered":"2024-03-12T17:20:29.214242+0000","last_unstale":"2024-03-12T17:20:30.203664+0000","last_undegraded":"2024-03-12T17:20:30.203664+0000","last_fullsized":"2024-03-12T17:20:30.203664+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:40:13.031059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"46'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.220867+0000","last_change":"2024-03-12T17:20:28.727150+0000","last_active":"2024-03-12T17:20:29.220867+0000","last_peered":"2024-03-12T17:20:29.220867+0000","last_clean":"2024-03-12T17:20:29.220867+0000","last_became_active":"2024-03-12T17:20:28.726861+0000","last_became_peered":"2024-03-12T17:20:28.726861+0000","last_unstale":"2024-03-12T17:20:29.220867+0000","last_undegraded":"2024-03-12T17:20:29.220867+0000","last_fullsized":"2024-03-12T17:20:29.220867+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:15:48.029418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.573364+0000","last_change":"2024-03-12T17:20:29.226236+0000","last_active":"2024-03-12T17:20:30.573364+0000","last_peered":"2024-03-12T17:20:30.573364+0000","last_clean":"2024-03-12T17:20:30.573364+0000","last_became_active":"2024-03-12T17:20:29.225470+0000","last_became_peered":"2024-03-12T17:20:29.225470+0000","last_unstale":"2024-03-12T17:20:30.573364+0000","last_undegraded":"2024-03-12T17:20:30.573364+0000","last_fullsized":"2024-03-12T17:20:30.573364+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:40:13.031059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"46'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.223704+0000","last_change":"2024-03-12T17:20:28.729062+0000","last_active":"2024-03-12T17:20:29.223704+0000","last_peered":"2024-03-12T17:20:29.223704+0000","last_clean":"2024-03-12T17:20:29.223704+0000","last_became_active":"2024-03-12T17:20:28.728739+0000","last_became_peered":"2024-03-12T17:20:28.728739+0000","last_unstale":"2024-03-12T17:20:29.223704+0000","last_undegraded":"2024-03-12T17:20:29.223704+0000","last_fullsized":"2024-03-12T17:20:29.223704+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:42:33.917307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.569468+0000","last_change":"2024-03-12T17:20:29.229503+0000","last_active":"2024-03-12T17:20:30.569468+0000","last_peered":"2024-03-12T17:20:30.569468+0000","last_clean":"2024-03-12T17:20:30.569468+0000","last_became_active":"2024-03-12T17:20:29.229238+0000","last_became_peered":"2024-03-12T17:20:29.229238+0000","last_unstale":"2024-03-12T17:20:30.569468+0000","last_undegraded":"2024-03-12T17:20:30.569468+0000","last_fullsized":"2024-03-12T17:20:30.569468+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:42:34.931002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"46'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.224560+0000","last_change":"2024-03-12T17:20:28.721385+0000","last_active":"2024-03-12T17:20:29.224560+0000","last_peered":"2024-03-12T17:20:29.224560+0000","last_clean":"2024-03-12T17:20:29.224560+0000","last_became_active":"2024-03-12T17:20:28.719983+0000","last_became_peered":"2024-03-12T17:20:28.719983+0000","last_unstale":"2024-03-12T17:20:29.224560+0000","last_undegraded":"2024-03-12T17:20:29.224560+0000","last_fullsized":"2024-03-12T17:20:29.224560+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:42:33.917307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.571134+0000","last_change":"2024-03-12T17:20:29.206478+0000","last_active":"2024-03-12T17:20:30.571134+0000","last_peered":"2024-03-12T17:20:30.571134+0000","last_clean":"2024-03-12T17:20:30.571134+0000","last_became_active":"2024-03-12T17:20:29.206226+0000","last_became_peered":"2024-03-12T17:20:29.206226+0000","last_unstale":"2024-03-12T17:20:30.571134+0000","last_undegraded":"2024-03-12T17:20:30.571134+0000","last_fullsized":"2024-03-12T17:20:30.571134+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:42:34.931002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"46'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.226731+0000","last_change":"2024-03-12T17:20:28.723234+0000","last_active":"2024-03-12T17:20:29.226731+0000","last_peered":"2024-03-12T17:20:29.226731+0000","last_clean":"2024-03-12T17:20:29.226731+0000","last_became_active":"2024-03-12T17:20:28.722865+0000","last_became_peered":"2024-03-12T17:20:28.722865+0000","last_unstale":"2024-03-12T17:20:29.226731+0000","last_undegraded":"2024-03-12T17:20:29.226731+0000","last_fullsized":"2024-03-12T17:20:29.226731+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:51:07.459439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.570094+0000","last_change":"2024-03-12T17:20:29.227621+0000","last_active":"2024-03-12T17:20:30.570094+0000","last_peered":"2024-03-12T17:20:30.570094+0000","last_clean":"2024-03-12T17:20:30.570094+0000","last_became_active":"2024-03-12T17:20:29.227354+0000","last_became_peered":"2024-03-12T17:20:29.227354+0000","last_unstale":"2024-03-12T17:20:30.570094+0000","last_undegraded":"2024-03-12T17:20:30.570094+0000","last_fullsized":"2024-03-12T17:20:30.570094+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:34:52.337489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.197015+0000","last_change":"2024-03-12T17:20:28.721214+0000","last_active":"2024-03-12T17:20:29.197015+0000","last_peered":"2024-03-12T17:20:29.197015+0000","last_clean":"2024-03-12T17:20:29.197015+0000","last_became_active":"2024-03-12T17:20:28.720895+0000","last_became_peered":"2024-03-12T17:20:28.720895+0000","last_unstale":"2024-03-12T17:20:29.197015+0000","last_undegraded":"2024-03-12T17:20:29.197015+0000","last_fullsized":"2024-03-12T17:20:29.197015+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:54:05.658055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.471339+0000","last_change":"2024-03-12T17:20:29.225679+0000","last_active":"2024-03-12T17:20:30.471339+0000","last_peered":"2024-03-12T17:20:30.471339+0000","last_clean":"2024-03-12T17:20:30.471339+0000","last_became_active":"2024-03-12T17:20:29.225365+0000","last_became_peered":"2024-03-12T17:20:29.225365+0000","last_unstale":"2024-03-12T17:20:30.471339+0000","last_undegraded":"2024-03-12T17:20:30.471339+0000","last_fullsized":"2024-03-12T17:20:30.471339+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:15:49.043113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.196282+0000","last_change":"2024-03-12T17:20:28.728429+0000","last_active":"2024-03-12T17:20:29.196282+0000","last_peered":"2024-03-12T17:20:29.196282+0000","last_clean":"2024-03-12T17:20:29.196282+0000","last_became_active":"2024-03-12T17:20:28.728171+0000","last_became_peered":"2024-03-12T17:20:28.728171+0000","last_unstale":"2024-03-12T17:20:29.196282+0000","last_undegraded":"2024-03-12T17:20:29.196282+0000","last_fullsized":"2024-03-12T17:20:29.196282+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:35:34.872460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.569867+0000","last_change":"2024-03-12T17:20:29.220560+0000","last_active":"2024-03-12T17:20:30.569867+0000","last_peered":"2024-03-12T17:20:30.569867+0000","last_clean":"2024-03-12T17:20:30.569867+0000","last_became_active":"2024-03-12T17:20:29.218468+0000","last_became_peered":"2024-03-12T17:20:29.218468+0000","last_unstale":"2024-03-12T17:20:30.569867+0000","last_undegraded":"2024-03-12T17:20:30.569867+0000","last_fullsized":"2024-03-12T17:20:30.569867+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:24:32.980339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.209979+0000","last_change":"2024-03-12T17:20:28.711630+0000","last_active":"2024-03-12T17:20:29.209979+0000","last_peered":"2024-03-12T17:20:29.209979+0000","last_clean":"2024-03-12T17:20:29.209979+0000","last_became_active":"2024-03-12T17:20:28.711151+0000","last_became_peered":"2024-03-12T17:20:28.711151+0000","last_unstale":"2024-03-12T17:20:29.209979+0000","last_undegraded":"2024-03-12T17:20:29.209979+0000","last_fullsized":"2024-03-12T17:20:29.209979+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:40:40.199608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.203032+0000","last_change":"2024-03-12T17:20:29.217670+0000","last_active":"2024-03-12T17:20:30.203032+0000","last_peered":"2024-03-12T17:20:30.203032+0000","last_clean":"2024-03-12T17:20:30.203032+0000","last_became_active":"2024-03-12T17:20:29.217234+0000","last_became_peered":"2024-03-12T17:20:29.217234+0000","last_unstale":"2024-03-12T17:20:30.203032+0000","last_undegraded":"2024-03-12T17:20:30.203032+0000","last_fullsized":"2024-03-12T17:20:30.203032+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:24:11.584247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.203884+0000","last_change":"2024-03-12T17:20:28.725148+0000","last_active":"2024-03-12T17:20:29.203884+0000","last_peered":"2024-03-12T17:20:29.203884+0000","last_clean":"2024-03-12T17:20:29.203884+0000","last_became_active":"2024-03-12T17:20:28.724010+0000","last_became_peered":"2024-03-12T17:20:28.724010+0000","last_unstale":"2024-03-12T17:20:29.203884+0000","last_undegraded":"2024-03-12T17:20:29.203884+0000","last_fullsized":"2024-03-12T17:20:29.203884+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:40:40.199608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.198464+0000","last_change":"2024-03-12T17:20:29.200120+0000","last_active":"2024-03-12T17:20:30.198464+0000","last_peered":"2024-03-12T17:20:30.198464+0000","last_clean":"2024-03-12T17:20:30.198464+0000","last_became_active":"2024-03-12T17:20:29.199629+0000","last_became_peered":"2024-03-12T17:20:29.199629+0000","last_unstale":"2024-03-12T17:20:30.198464+0000","last_undegraded":"2024-03-12T17:20:30.198464+0000","last_fullsized":"2024-03-12T17:20:30.198464+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T00:35:51.640600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"46'3","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.229201+0000","last_change":"2024-03-12T17:20:28.733163+0000","last_active":"2024-03-12T17:20:29.229201+0000","last_peered":"2024-03-12T17:20:29.229201+0000","last_clean":"2024-03-12T17:20:29.229201+0000","last_became_active":"2024-03-12T17:20:28.732826+0000","last_became_peered":"2024-03-12T17:20:28.732826+0000","last_unstale":"2024-03-12T17:20:29.229201+0000","last_undegraded":"2024-03-12T17:20:29.229201+0000","last_fullsized":"2024-03-12T17:20:29.229201+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:42:22.845646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.203367+0000","last_change":"2024-03-12T17:20:29.221160+0000","last_active":"2024-03-12T17:20:30.203367+0000","last_peered":"2024-03-12T17:20:30.203367+0000","last_clean":"2024-03-12T17:20:30.203367+0000","last_became_active":"2024-03-12T17:20:29.220847+0000","last_became_peered":"2024-03-12T17:20:29.220847+0000","last_unstale":"2024-03-12T17:20:30.203367+0000","last_undegraded":"2024-03-12T17:20:30.203367+0000","last_fullsized":"2024-03-12T17:20:30.203367+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T19:53:00.502168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"46'6","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.231378+0000","last_change":"2024-03-12T17:20:28.712527+0000","last_active":"2024-03-12T17:20:29.231378+0000","last_peered":"2024-03-12T17:20:29.231378+0000","last_clean":"2024-03-12T17:20:29.231378+0000","last_became_active":"2024-03-12T17:20:28.712208+0000","last_became_peered":"2024-03-12T17:20:28.712208+0000","last_unstale":"2024-03-12T17:20:29.231378+0000","last_undegraded":"2024-03-12T17:20:29.231378+0000","last_fullsized":"2024-03-12T17:20:29.231378+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:40:33.340106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.471550+0000","last_change":"2024-03-12T17:20:29.223168+0000","last_active":"2024-03-12T17:20:30.471550+0000","last_peered":"2024-03-12T17:20:30.471550+0000","last_clean":"2024-03-12T17:20:30.471550+0000","last_became_active":"2024-03-12T17:20:29.222667+0000","last_became_peered":"2024-03-12T17:20:29.222667+0000","last_unstale":"2024-03-12T17:20:30.471550+0000","last_undegraded":"2024-03-12T17:20:30.471550+0000","last_fullsized":"2024-03-12T17:20:30.471550+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T00:25:47.914846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"46'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.222537+0000","last_change":"2024-03-12T17:20:28.721884+0000","last_active":"2024-03-12T17:20:29.222537+0000","last_peered":"2024-03-12T17:20:29.222537+0000","last_clean":"2024-03-12T17:20:29.222537+0000","last_became_active":"2024-03-12T17:20:28.721596+0000","last_became_peered":"2024-03-12T17:20:28.721596+0000","last_unstale":"2024-03-12T17:20:29.222537+0000","last_undegraded":"2024-03-12T17:20:29.222537+0000","last_fullsized":"2024-03-12T17:20:29.222537+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:24:31.966644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.571391+0000","last_change":"2024-03-12T17:20:29.212951+0000","last_active":"2024-03-12T17:20:30.571391+0000","last_peered":"2024-03-12T17:20:30.571391+0000","last_clean":"2024-03-12T17:20:30.571391+0000","last_became_active":"2024-03-12T17:20:29.212679+0000","last_became_peered":"2024-03-12T17:20:29.212679+0000","last_unstale":"2024-03-12T17:20:30.571391+0000","last_undegraded":"2024-03-12T17:20:30.571391+0000","last_fullsized":"2024-03-12T17:20:30.571391+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:44:38.657773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.193220+0000","last_change":"2024-03-12T17:20:28.731139+0000","last_active":"2024-03-12T17:20:29.193220+0000","last_peered":"2024-03-12T17:20:29.193220+0000","last_clean":"2024-03-12T17:20:29.193220+0000","last_became_active":"2024-03-12T17:20:28.730852+0000","last_became_peered":"2024-03-12T17:20:28.730852+0000","last_unstale":"2024-03-12T17:20:29.193220+0000","last_undegraded":"2024-03-12T17:20:29.193220+0000","last_fullsized":"2024-03-12T17:20:29.193220+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:40:12.017364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.197928+0000","last_change":"2024-03-12T17:20:29.196550+0000","last_active":"2024-03-12T17:20:30.197928+0000","last_peered":"2024-03-12T17:20:30.197928+0000","last_clean":"2024-03-12T17:20:30.197928+0000","last_became_active":"2024-03-12T17:20:29.195813+0000","last_became_peered":"2024-03-12T17:20:29.195813+0000","last_unstale":"2024-03-12T17:20:30.197928+0000","last_undegraded":"2024-03-12T17:20:30.197928+0000","last_fullsized":"2024-03-12T17:20:30.197928+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:05:07.450795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.191852+0000","last_change":"2024-03-12T17:20:28.723322+0000","last_active":"2024-03-12T17:20:29.191852+0000","last_peered":"2024-03-12T17:20:29.191852+0000","last_clean":"2024-03-12T17:20:29.191852+0000","last_became_active":"2024-03-12T17:20:28.721235+0000","last_became_peered":"2024-03-12T17:20:28.721235+0000","last_unstale":"2024-03-12T17:20:29.191852+0000","last_undegraded":"2024-03-12T17:20:29.191852+0000","last_fullsized":"2024-03-12T17:20:29.191852+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:25:11.954612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.202245+0000","last_change":"2024-03-12T17:20:29.219950+0000","last_active":"2024-03-12T17:20:30.202245+0000","last_peered":"2024-03-12T17:20:30.202245+0000","last_clean":"2024-03-12T17:20:30.202245+0000","last_became_active":"2024-03-12T17:20:29.219670+0000","last_became_peered":"2024-03-12T17:20:29.219670+0000","last_unstale":"2024-03-12T17:20:30.202245+0000","last_undegraded":"2024-03-12T17:20:30.202245+0000","last_fullsized":"2024-03-12T17:20:30.202245+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:48:25.075810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"46'8","reported_seq":19,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.229905+0000","last_change":"2024-03-12T17:20:28.725956+0000","last_active":"2024-03-12T17:20:29.229905+0000","last_peered":"2024-03-12T17:20:29.229905+0000","last_clean":"2024-03-12T17:20:29.229905+0000","last_became_active":"2024-03-12T17:20:28.724420+0000","last_became_peered":"2024-03-12T17:20:28.724420+0000","last_unstale":"2024-03-12T17:20:29.229905+0000","last_undegraded":"2024-03-12T17:20:29.229905+0000","last_fullsized":"2024-03-12T17:20:29.229905+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:22:18.771024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.571484+0000","last_change":"2024-03-12T17:20:29.217041+0000","last_active":"2024-03-12T17:20:30.571484+0000","last_peered":"2024-03-12T17:20:30.571484+0000","last_clean":"2024-03-12T17:20:30.571484+0000","last_became_active":"2024-03-12T17:20:29.216745+0000","last_became_peered":"2024-03-12T17:20:29.216745+0000","last_unstale":"2024-03-12T17:20:30.571484+0000","last_undegraded":"2024-03-12T17:20:30.571484+0000","last_fullsized":"2024-03-12T17:20:30.571484+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T03:07:31.382195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"46'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.212891+0000","last_change":"2024-03-12T17:20:28.719031+0000","last_active":"2024-03-12T17:20:29.212891+0000","last_peered":"2024-03-12T17:20:29.212891+0000","last_clean":"2024-03-12T17:20:29.212891+0000","last_became_active":"2024-03-12T17:20:28.718743+0000","last_became_peered":"2024-03-12T17:20:28.718743+0000","last_unstale":"2024-03-12T17:20:29.212891+0000","last_undegraded":"2024-03-12T17:20:29.212891+0000","last_fullsized":"2024-03-12T17:20:29.212891+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:20:16.591031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.571843+0000","last_change":"2024-03-12T17:20:29.217002+0000","last_active":"2024-03-12T17:20:30.571843+0000","last_peered":"2024-03-12T17:20:30.571843+0000","last_clean":"2024-03-12T17:20:30.571843+0000","last_became_active":"2024-03-12T17:20:29.216687+0000","last_became_peered":"2024-03-12T17:20:29.216687+0000","last_unstale":"2024-03-12T17:20:30.571843+0000","last_undegraded":"2024-03-12T17:20:30.571843+0000","last_fullsized":"2024-03-12T17:20:30.571843+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:42:15.956212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"46'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.226224+0000","last_change":"2024-03-12T17:20:28.723496+0000","last_active":"2024-03-12T17:20:29.226224+0000","last_peered":"2024-03-12T17:20:29.226224+0000","last_clean":"2024-03-12T17:20:29.226224+0000","last_became_active":"2024-03-12T17:20:28.723162+0000","last_became_peered":"2024-03-12T17:20:28.723162+0000","last_unstale":"2024-03-12T17:20:29.226224+0000","last_undegraded":"2024-03-12T17:20:29.226224+0000","last_fullsized":"2024-03-12T17:20:29.226224+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T05:01:55.583589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.471933+0000","last_change":"2024-03-12T17:20:29.217021+0000","last_active":"2024-03-12T17:20:30.471933+0000","last_peered":"2024-03-12T17:20:30.471933+0000","last_clean":"2024-03-12T17:20:30.471933+0000","last_became_active":"2024-03-12T17:20:29.216638+0000","last_became_peered":"2024-03-12T17:20:29.216638+0000","last_unstale":"2024-03-12T17:20:30.471933+0000","last_undegraded":"2024-03-12T17:20:30.471933+0000","last_fullsized":"2024-03-12T17:20:30.471933+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:42:34.931002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"46'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.226196+0000","last_change":"2024-03-12T17:20:28.727011+0000","last_active":"2024-03-12T17:20:29.226196+0000","last_peered":"2024-03-12T17:20:29.226196+0000","last_clean":"2024-03-12T17:20:29.226196+0000","last_became_active":"2024-03-12T17:20:28.726699+0000","last_became_peered":"2024-03-12T17:20:28.726699+0000","last_unstale":"2024-03-12T17:20:29.226196+0000","last_undegraded":"2024-03-12T17:20:29.226196+0000","last_fullsized":"2024-03-12T17:20:29.226196+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T18:37:31.324559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.472036+0000","last_change":"2024-03-12T17:20:29.227348+0000","last_active":"2024-03-12T17:20:30.472036+0000","last_peered":"2024-03-12T17:20:30.472036+0000","last_clean":"2024-03-12T17:20:30.472036+0000","last_became_active":"2024-03-12T17:20:29.226993+0000","last_became_peered":"2024-03-12T17:20:29.226993+0000","last_unstale":"2024-03-12T17:20:30.472036+0000","last_undegraded":"2024-03-12T17:20:30.472036+0000","last_fullsized":"2024-03-12T17:20:30.472036+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:22:46.154568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.192005+0000","last_change":"2024-03-12T17:20:28.727199+0000","last_active":"2024-03-12T17:20:29.192005+0000","last_peered":"2024-03-12T17:20:29.192005+0000","last_clean":"2024-03-12T17:20:29.192005+0000","last_became_active":"2024-03-12T17:20:28.726866+0000","last_became_peered":"2024-03-12T17:20:28.726866+0000","last_unstale":"2024-03-12T17:20:29.192005+0000","last_undegraded":"2024-03-12T17:20:29.192005+0000","last_fullsized":"2024-03-12T17:20:29.192005+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:33:00.215462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.198044+0000","last_change":"2024-03-12T17:20:29.201709+0000","last_active":"2024-03-12T17:20:30.198044+0000","last_peered":"2024-03-12T17:20:30.198044+0000","last_clean":"2024-03-12T17:20:30.198044+0000","last_became_active":"2024-03-12T17:20:29.201241+0000","last_became_peered":"2024-03-12T17:20:29.201241+0000","last_unstale":"2024-03-12T17:20:30.198044+0000","last_undegraded":"2024-03-12T17:20:30.198044+0000","last_fullsized":"2024-03-12T17:20:30.198044+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:10:31.923564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"46'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.224913+0000","last_change":"2024-03-12T17:20:28.725108+0000","last_active":"2024-03-12T17:20:29.224913+0000","last_peered":"2024-03-12T17:20:29.224913+0000","last_clean":"2024-03-12T17:20:29.224913+0000","last_became_active":"2024-03-12T17:20:28.724780+0000","last_became_peered":"2024-03-12T17:20:28.724780+0000","last_unstale":"2024-03-12T17:20:29.224913+0000","last_undegraded":"2024-03-12T17:20:29.224913+0000","last_fullsized":"2024-03-12T17:20:29.224913+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:40:12.017364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.572681+0000","last_change":"2024-03-12T17:20:29.223479+0000","last_active":"2024-03-12T17:20:30.572681+0000","last_peered":"2024-03-12T17:20:30.572681+0000","last_clean":"2024-03-12T17:20:30.572681+0000","last_became_active":"2024-03-12T17:20:29.223223+0000","last_became_peered":"2024-03-12T17:20:29.223223+0000","last_unstale":"2024-03-12T17:20:30.572681+0000","last_undegraded":"2024-03-12T17:20:30.572681+0000","last_fullsized":"2024-03-12T17:20:30.572681+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:42:15.956212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.197571+0000","last_change":"2024-03-12T17:20:28.729118+0000","last_active":"2024-03-12T17:20:29.197571+0000","last_peered":"2024-03-12T17:20:29.197571+0000","last_clean":"2024-03-12T17:20:29.197571+0000","last_became_active":"2024-03-12T17:20:28.728803+0000","last_became_peered":"2024-03-12T17:20:28.728803+0000","last_unstale":"2024-03-12T17:20:29.197571+0000","last_undegraded":"2024-03-12T17:20:29.197571+0000","last_fullsized":"2024-03-12T17:20:29.197571+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:22:45.140874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.570537+0000","last_change":"2024-03-12T17:20:29.213919+0000","last_active":"2024-03-12T17:20:30.570537+0000","last_peered":"2024-03-12T17:20:30.570537+0000","last_clean":"2024-03-12T17:20:30.570537+0000","last_became_active":"2024-03-12T17:20:29.213437+0000","last_became_peered":"2024-03-12T17:20:29.213437+0000","last_unstale":"2024-03-12T17:20:30.570537+0000","last_undegraded":"2024-03-12T17:20:30.570537+0000","last_fullsized":"2024-03-12T17:20:30.570537+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:49:17.594288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.200332+0000","last_change":"2024-03-12T17:20:28.724596+0000","last_active":"2024-03-12T17:20:29.200332+0000","last_peered":"2024-03-12T17:20:29.200332+0000","last_clean":"2024-03-12T17:20:29.200332+0000","last_became_active":"2024-03-12T17:20:28.724014+0000","last_became_peered":"2024-03-12T17:20:28.724014+0000","last_unstale":"2024-03-12T17:20:29.200332+0000","last_undegraded":"2024-03-12T17:20:29.200332+0000","last_fullsized":"2024-03-12T17:20:29.200332+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:09:46.909429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.570755+0000","last_change":"2024-03-12T17:20:29.207519+0000","last_active":"2024-03-12T17:20:30.570755+0000","last_peered":"2024-03-12T17:20:30.570755+0000","last_clean":"2024-03-12T17:20:30.570755+0000","last_became_active":"2024-03-12T17:20:29.207292+0000","last_became_peered":"2024-03-12T17:20:29.207292+0000","last_unstale":"2024-03-12T17:20:30.570755+0000","last_undegraded":"2024-03-12T17:20:30.570755+0000","last_fullsized":"2024-03-12T17:20:30.570755+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:25:12.968306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.193179+0000","last_change":"2024-03-12T17:20:28.732170+0000","last_active":"2024-03-12T17:20:29.193179+0000","last_peered":"2024-03-12T17:20:29.193179+0000","last_clean":"2024-03-12T17:20:29.193179+0000","last_became_active":"2024-03-12T17:20:28.731858+0000","last_became_peered":"2024-03-12T17:20:28.731858+0000","last_unstale":"2024-03-12T17:20:29.193179+0000","last_undegraded":"2024-03-12T17:20:29.193179+0000","last_fullsized":"2024-03-12T17:20:29.193179+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T00:25:46.901152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.472390+0000","last_change":"2024-03-12T17:20:29.224647+0000","last_active":"2024-03-12T17:20:30.472390+0000","last_peered":"2024-03-12T17:20:30.472390+0000","last_clean":"2024-03-12T17:20:30.472390+0000","last_became_active":"2024-03-12T17:20:29.222606+0000","last_became_peered":"2024-03-12T17:20:29.222606+0000","last_unstale":"2024-03-12T17:20:30.472390+0000","last_undegraded":"2024-03-12T17:20:30.472390+0000","last_fullsized":"2024-03-12T17:20:30.472390+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:42:15.956212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"47'1","reported_seq":12,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.198700+0000","last_change":"2024-03-12T17:20:28.726794+0000","last_active":"2024-03-12T17:20:30.198700+0000","last_peered":"2024-03-12T17:20:30.198700+0000","last_clean":"2024-03-12T17:20:30.198700+0000","last_became_active":"2024-03-12T17:20:28.726443+0000","last_became_peered":"2024-03-12T17:20:28.726443+0000","last_unstale":"2024-03-12T17:20:30.198700+0000","last_undegraded":"2024-03-12T17:20:30.198700+0000","last_fullsized":"2024-03-12T17:20:30.198700+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:44:37.644079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.571025+0000","last_change":"2024-03-12T17:20:29.219922+0000","last_active":"2024-03-12T17:20:30.571025+0000","last_peered":"2024-03-12T17:20:30.571025+0000","last_clean":"2024-03-12T17:20:30.571025+0000","last_became_active":"2024-03-12T17:20:29.219761+0000","last_became_peered":"2024-03-12T17:20:29.219761+0000","last_unstale":"2024-03-12T17:20:30.571025+0000","last_undegraded":"2024-03-12T17:20:30.571025+0000","last_fullsized":"2024-03-12T17:20:30.571025+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T04:07:40.148420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.195806+0000","last_change":"2024-03-12T17:20:28.731082+0000","last_active":"2024-03-12T17:20:29.195806+0000","last_peered":"2024-03-12T17:20:29.195806+0000","last_clean":"2024-03-12T17:20:29.195806+0000","last_became_active":"2024-03-12T17:20:28.730779+0000","last_became_peered":"2024-03-12T17:20:28.730779+0000","last_unstale":"2024-03-12T17:20:29.195806+0000","last_undegraded":"2024-03-12T17:20:29.195806+0000","last_fullsized":"2024-03-12T17:20:29.195806+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:25:11.954612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.203596+0000","last_change":"2024-03-12T17:20:29.210202+0000","last_active":"2024-03-12T17:20:30.203596+0000","last_peered":"2024-03-12T17:20:30.203596+0000","last_clean":"2024-03-12T17:20:30.203596+0000","last_became_active":"2024-03-12T17:20:29.208122+0000","last_became_peered":"2024-03-12T17:20:29.208122+0000","last_unstale":"2024-03-12T17:20:30.203596+0000","last_undegraded":"2024-03-12T17:20:30.203596+0000","last_fullsized":"2024-03-12T17:20:30.203596+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T02:06:57.154913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.203233+0000","last_change":"2024-03-12T17:20:28.725747+0000","last_active":"2024-03-12T17:20:29.203233+0000","last_peered":"2024-03-12T17:20:29.203233+0000","last_clean":"2024-03-12T17:20:29.203233+0000","last_became_active":"2024-03-12T17:20:28.725465+0000","last_became_peered":"2024-03-12T17:20:28.725465+0000","last_unstale":"2024-03-12T17:20:29.203233+0000","last_undegraded":"2024-03-12T17:20:29.203233+0000","last_fullsized":"2024-03-12T17:20:29.203233+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:22:45.140874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.198222+0000","last_change":"2024-03-12T17:20:29.215224+0000","last_active":"2024-03-12T17:20:30.198222+0000","last_peered":"2024-03-12T17:20:30.198222+0000","last_clean":"2024-03-12T17:20:30.198222+0000","last_became_active":"2024-03-12T17:20:29.214994+0000","last_became_peered":"2024-03-12T17:20:29.214994+0000","last_unstale":"2024-03-12T17:20:30.198222+0000","last_undegraded":"2024-03-12T17:20:30.198222+0000","last_fullsized":"2024-03-12T17:20:30.198222+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T05:11:40.637126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.193153+0000","last_change":"2024-03-12T17:20:28.732059+0000","last_active":"2024-03-12T17:20:29.193153+0000","last_peered":"2024-03-12T17:20:29.193153+0000","last_clean":"2024-03-12T17:20:29.193153+0000","last_became_active":"2024-03-12T17:20:28.731787+0000","last_became_peered":"2024-03-12T17:20:28.731787+0000","last_unstale":"2024-03-12T17:20:29.193153+0000","last_undegraded":"2024-03-12T17:20:29.193153+0000","last_fullsized":"2024-03-12T17:20:29.193153+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:24:31.966644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.198190+0000","last_change":"2024-03-12T17:20:29.202101+0000","last_active":"2024-03-12T17:20:30.198190+0000","last_peered":"2024-03-12T17:20:30.198190+0000","last_clean":"2024-03-12T17:20:30.198190+0000","last_became_active":"2024-03-12T17:20:29.201835+0000","last_became_peered":"2024-03-12T17:20:29.201835+0000","last_unstale":"2024-03-12T17:20:30.198190+0000","last_undegraded":"2024-03-12T17:20:30.198190+0000","last_fullsized":"2024-03-12T17:20:30.198190+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T05:02:49.972593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.211041+0000","last_change":"2024-03-12T17:20:28.725244+0000","last_active":"2024-03-12T17:20:29.211041+0000","last_peered":"2024-03-12T17:20:29.211041+0000","last_clean":"2024-03-12T17:20:29.211041+0000","last_became_active":"2024-03-12T17:20:28.720330+0000","last_became_peered":"2024-03-12T17:20:28.720330+0000","last_unstale":"2024-03-12T17:20:29.211041+0000","last_undegraded":"2024-03-12T17:20:29.211041+0000","last_fullsized":"2024-03-12T17:20:29.211041+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T17:49:16.580593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.201523+0000","last_change":"2024-03-12T17:20:29.215290+0000","last_active":"2024-03-12T17:20:30.201523+0000","last_peered":"2024-03-12T17:20:30.201523+0000","last_clean":"2024-03-12T17:20:30.201523+0000","last_became_active":"2024-03-12T17:20:29.211926+0000","last_became_peered":"2024-03-12T17:20:29.211926+0000","last_unstale":"2024-03-12T17:20:30.201523+0000","last_undegraded":"2024-03-12T17:20:30.201523+0000","last_fullsized":"2024-03-12T17:20:30.201523+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:42:34.931002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.203858+0000","last_change":"2024-03-12T17:20:28.724922+0000","last_active":"2024-03-12T17:20:29.203858+0000","last_peered":"2024-03-12T17:20:29.203858+0000","last_clean":"2024-03-12T17:20:29.203858+0000","last_became_active":"2024-03-12T17:20:28.724626+0000","last_became_peered":"2024-03-12T17:20:28.724626+0000","last_unstale":"2024-03-12T17:20:29.203858+0000","last_undegraded":"2024-03-12T17:20:29.203858+0000","last_fullsized":"2024-03-12T17:20:29.203858+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T21:06:42.471948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.569324+0000","last_change":"2024-03-12T17:20:29.221664+0000","last_active":"2024-03-12T17:20:30.569324+0000","last_peered":"2024-03-12T17:20:30.569324+0000","last_clean":"2024-03-12T17:20:30.569324+0000","last_became_active":"2024-03-12T17:20:29.220805+0000","last_became_peered":"2024-03-12T17:20:29.220805+0000","last_unstale":"2024-03-12T17:20:30.569324+0000","last_undegraded":"2024-03-12T17:20:30.569324+0000","last_fullsized":"2024-03-12T17:20:30.569324+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T22:40:13.031059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.196465+0000","last_change":"2024-03-12T17:20:28.718259+0000","last_active":"2024-03-12T17:20:29.196465+0000","last_peered":"2024-03-12T17:20:29.196465+0000","last_clean":"2024-03-12T17:20:29.196465+0000","last_became_active":"2024-03-12T17:20:28.717919+0000","last_became_peered":"2024-03-12T17:20:28.717919+0000","last_unstale":"2024-03-12T17:20:29.196465+0000","last_undegraded":"2024-03-12T17:20:29.196465+0000","last_fullsized":"2024-03-12T17:20:29.196465+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:23:16.616382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-03-12T17:20:30.571463+0000","last_change":"2024-03-12T17:20:29.214388+0000","last_active":"2024-03-12T17:20:30.571463+0000","last_peered":"2024-03-12T17:20:30.571463+0000","last_clean":"2024-03-12T17:20:30.571463+0000","last_became_active":"2024-03-12T17:20:29.214164+0000","last_became_peered":"2024-03-12T17:20:29.214164+0000","last_unstale":"2024-03-12T17:20:30.571463+0000","last_undegraded":"2024-03-12T17:20:30.571463+0000","last_fullsized":"2024-03-12T17:20:30.571463+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:28.676366+0000","last_clean_scrub_stamp":"2024-03-12T17:20:28.676366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:28:56.981079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"46'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.220345+0000","last_change":"2024-03-12T17:20:28.718309+0000","last_active":"2024-03-12T17:20:29.220345+0000","last_peered":"2024-03-12T17:20:29.220345+0000","last_clean":"2024-03-12T17:20:29.220345+0000","last_became_active":"2024-03-12T17:20:28.716753+0000","last_became_peered":"2024-03-12T17:20:28.716753+0000","last_unstale":"2024-03-12T17:20:29.220345+0000","last_undegraded":"2024-03-12T17:20:29.220345+0000","last_fullsized":"2024-03-12T17:20:29.220345+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:20:27.662672+0000","last_clean_scrub_stamp":"2024-03-12T17:20:27.662672+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T20:34:52.559454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":184,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-03-12T17:20:29.193445+0000","last_change":"2024-03-12T17:18:41.331756+0000","last_active":"2024-03-12T17:20:29.193445+0000","last_peered":"2024-03-12T17:20:29.193445+0000","last_clean":"2024-03-12T17:20:29.193445+0000","last_became_active":"2024-03-12T17:18:41.329237+0000","last_became_peered":"2024-03-12T17:18:41.329237+0000","last_unstale":"2024-03-12T17:20:29.193445+0000","last_undegraded":"2024-03-12T17:20:29.193445+0000","last_fullsized":"2024-03-12T17:20:29.193445+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:40.152422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:40.152422+0000","last_clean_scrub_stamp":"2024-03-12T17:18:40.152422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:35:43.664403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32248,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339592,"statfs":{"total":96636764160,"available":96603742208,"internally_reserved":0,"allocated":1150976,"data_stored":815531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.66700000000000004}]},{"osd":1,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.60699999999999998},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.677,"5min":1.677,"15min":1.677},"last":0.77300000000000002}]},{"osd":2,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":1.169},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":2.0870000000000002,"5min":2.0870000000000002,"15min":2.0870000000000002},"last":0.86699999999999999}]},{"osd":3,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.244,"15min":1.244},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":1.0329999999999999}]},{"osd":4,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.8660000000000001,"5min":1.8660000000000001,"15min":1.8660000000000001},"last":1.204},{"interface":"front","average":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":2.2490000000000001,"5min":2.2490000000000001,"15min":2.2490000000000001},"last":1.28}]},{"osd":5,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.3009999999999999,"15min":1.3009999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.1909999999999998,"5min":2.1909999999999998,"15min":2.1909999999999998},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":3.9689999999999999,"5min":3.9689999999999999,"15min":3.9689999999999999},"last":1.377}]},{"osd":6,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":3.8319999999999999,"5min":3.8319999999999999,"15min":3.8319999999999999},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":1.232}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31676,"kb_used_data":548,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340164,"statfs":{"total":96636764160,"available":96604327936,"internally_reserved":0,"allocated":561152,"data_stored":225745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":3.5390000000000001,"5min":3.5390000000000001,"15min":3.5390000000000001},"last":1.075},{"interface":"front","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.0249999999999999}]},{"osd":1,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":1.173}]},{"osd":2,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.212},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.9689999999999999,"5min":2.9689999999999999,"15min":2.9689999999999999},"last":1.254}]},{"osd":3,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":1.099,"15min":1.099},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.579,"5min":1.579,"15min":1.579},"last":0.99099999999999999}]},{"osd":4,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.2130000000000001,"5min":2.2130000000000001,"15min":2.2130000000000001},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.1160000000000001}]},{"osd":5,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.8660000000000001,"5min":2.8660000000000001,"15min":2.8660000000000001},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.931,"5min":2.931,"15min":2.931},"last":1.3740000000000001}]},{"osd":7,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":1.425},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":1.98,"5min":1.98,"15min":1.98},"last":1.298}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31672,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340168,"statfs":{"total":96636764160,"available":96604332032,"internally_reserved":0,"allocated":557056,"data_stored":225143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.8149999999999999,"5min":1.8149999999999999,"15min":1.8149999999999999},"last":1.026}]},{"osd":1,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.706,"5min":1.706,"15min":1.706},"last":1.081},{"interface":"front","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":2.5699999999999998,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":1.268}]},{"osd":2,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.613,"5min":2.613,"15min":2.613},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.262,"5min":1.262,"15min":1.262},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":2.359,"5min":2.359,"15min":2.359},"last":0.79000000000000004}]},{"osd":3,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"min":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"max":{"1min":2.6829999999999998,"5min":2.6829999999999998,"15min":2.6829999999999998},"last":1.3919999999999999},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":2.0670000000000002,"5min":2.0670000000000002,"15min":2.0670000000000002},"last":1.512}]},{"osd":4,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.8999999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":1.2130000000000001},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.3999999999999999,"5min":2.3999999999999999,"15min":2.3999999999999999},"last":1.488}]},{"osd":6,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":2.4609999999999999,"5min":2.4609999999999999,"15min":2.4609999999999999},"last":1.4379999999999999},{"interface":"front","average":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":2.1930000000000001,"5min":2.1930000000000001,"15min":2.1930000000000001},"last":1.6279999999999999}]},{"osd":7,"last update":"Tue Mar 12 17:19:40 2024","interfaces":[{"interface":"back","average":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":1.7150000000000001},"min":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"max":{"1min":2.8700000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.8380000000000001},{"interface":"front","average":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"min":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"max":{"1min":2.722,"5min":2.722,"15min":2.722},"last":1.6890000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574874,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31668,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340172,"statfs":{"total":96636764160,"available":96604336128,"internally_reserved":0,"allocated":565248,"data_stored":226637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":4.8979999999999997,"5min":4.8979999999999997,"15min":4.8979999999999997},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":4.8300000000000001,"5min":4.8300000000000001,"15min":4.8300000000000001},"last":0.86199999999999999}]},{"osd":1,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.214,"15min":1.214},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":4.7779999999999996,"5min":4.7779999999999996,"15min":4.7779999999999996},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":1.2529999999999999}]},{"osd":2,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.004},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.3220000000000001,"5min":2.3220000000000001,"15min":2.3220000000000001},"last":1.3580000000000001}]},{"osd":3,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.248,"5min":1.248,"15min":1.248},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":1.296},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"last":1.216}]},{"osd":5,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":1.4630000000000001}]},{"osd":6,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.8720000000000001,"5min":1.8720000000000001,"15min":1.8720000000000001},"last":1.5},{"interface":"front","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":2.4750000000000001,"5min":2.4750000000000001,"15min":2.4750000000000001},"last":1.542}]},{"osd":7,"last update":"Tue Mar 12 17:19:42 2024","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":2.0550000000000002,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.446},{"interface":"front","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.4260000000000002,"5min":2.4260000000000002,"15min":2.4260000000000002},"last":1.5609999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31680,"kb_used_data":552,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340160,"statfs":{"total":96636764160,"available":96604323840,"internally_reserved":0,"allocated":565248,"data_stored":225711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.9580000000000002,"5min":2.9580000000000002,"15min":2.9580000000000002},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":3.9940000000000002,"5min":3.9940000000000002,"15min":3.9940000000000002},"last":0.68400000000000005}]},{"osd":1,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":4.774,"5min":4.774,"15min":4.774},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":5.0069999999999997,"5min":5.0069999999999997,"15min":5.0069999999999997},"last":1.177}]},{"osd":2,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.2649999999999999,"15min":1.2649999999999999},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":2.4660000000000002,"5min":2.4660000000000002,"15min":2.4660000000000002},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":4.5650000000000004,"5min":4.5650000000000004,"15min":4.5650000000000004},"last":1.0469999999999999}]},{"osd":4,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.482,"15min":1.482},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":2.8860000000000001,"5min":2.8860000000000001,"15min":2.8860000000000001},"last":1.099},{"interface":"front","average":{"1min":1.48,"5min":1.48,"15min":1.48},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":4.3520000000000003,"5min":4.3520000000000003,"15min":4.3520000000000003},"last":1.226}]},{"osd":5,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.492,"5min":1.492,"15min":1.492},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":2.843,"5min":2.843,"15min":2.843},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4610000000000001,"15min":1.4610000000000001},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.8149999999999999,"5min":2.8149999999999999,"15min":2.8149999999999999},"last":1.3220000000000001}]},{"osd":6,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":2.9199999999999999,"5min":2.9199999999999999,"15min":2.9199999999999999},"last":1.341},{"interface":"front","average":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":2.6589999999999998,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.25}]},{"osd":7,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.5860000000000001,"5min":1.5860000000000001,"15min":1.5860000000000001},"min":{"1min":1.006,"5min":1.006,"15min":1.006},"max":{"1min":4.6600000000000001,"5min":4.6600000000000001,"15min":4.6600000000000001},"last":1.454},{"interface":"front","average":{"1min":1.599,"5min":1.599,"15min":1.599},"min":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"max":{"1min":4.4720000000000004,"5min":4.4720000000000004,"15min":4.4720000000000004},"last":1.5349999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31680,"kb_used_data":556,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340160,"statfs":{"total":96636764160,"available":96604323840,"internally_reserved":0,"allocated":569344,"data_stored":226659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":3.1829999999999998,"5min":3.1829999999999998,"15min":3.1829999999999998},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.8199999999999998,"5min":2.8199999999999998,"15min":2.8199999999999998},"last":0.98799999999999999}]},{"osd":1,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":2.7360000000000002,"5min":2.7360000000000002,"15min":2.7360000000000002},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":3.1019999999999999,"5min":3.1019999999999999,"15min":3.1019999999999999},"last":0.93400000000000005}]},{"osd":3,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.127,"5min":1.127,"15min":1.127},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":2.7810000000000001,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":1.349},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":3.1419999999999999,"5min":3.1419999999999999,"15min":3.1419999999999999},"last":1.2789999999999999}]},{"osd":4,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.643,"5min":1.643,"15min":1.643},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":7.96,"5min":7.96,"15min":7.96},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":3.3780000000000001,"5min":3.3780000000000001,"15min":3.3780000000000001},"last":1.7090000000000001}]},{"osd":5,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":4.0659999999999998,"5min":4.0659999999999998,"15min":4.0659999999999998},"last":1.7809999999999999},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":3.012,"5min":3.012,"15min":3.012},"last":1.6259999999999999}]},{"osd":6,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":3.2330000000000001,"5min":3.2330000000000001,"15min":3.2330000000000001},"last":1.821},{"interface":"front","average":{"1min":1.804,"5min":1.804,"15min":1.804},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":7.9059999999999997,"5min":7.9059999999999997,"15min":7.9059999999999997},"last":1.413}]},{"osd":7,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.5149999999999999,"5min":1.5149999999999999,"15min":1.5149999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":4.0229999999999997,"5min":4.0229999999999997,"15min":4.0229999999999997},"last":1.8720000000000001},{"interface":"front","average":{"1min":1.506,"5min":1.506,"15min":1.506},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":3.27,"5min":3.27,"15min":3.27},"last":1.9350000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31660,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340180,"statfs":{"total":96636764160,"available":96604344320,"internally_reserved":0,"allocated":557056,"data_stored":225143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.581,"5min":2.581,"15min":2.581},"last":0.92700000000000005}]},{"osd":2,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":1.373},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":2.5720000000000001,"5min":2.5720000000000001,"15min":2.5720000000000001},"last":1.1299999999999999}]},{"osd":3,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":2.4580000000000002,"5min":2.4580000000000002,"15min":2.4580000000000002},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.208,"5min":1.208,"15min":1.208},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.9609999999999999,"5min":2.9609999999999999,"15min":2.9609999999999999},"last":1.262}]},{"osd":4,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":2.4580000000000002,"5min":2.4580000000000002,"15min":2.4580000000000002},"last":1.6220000000000001},{"interface":"front","average":{"1min":1.335,"5min":1.335,"15min":1.335},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.6909999999999998,"5min":2.6909999999999998,"15min":2.6909999999999998},"last":1.417}]},{"osd":5,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":3.0609999999999999,"5min":3.0609999999999999,"15min":3.0609999999999999},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":1.516}]},{"osd":6,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":3.1030000000000002,"5min":3.1030000000000002,"15min":3.1030000000000002},"last":1.569},{"interface":"front","average":{"1min":1.395,"5min":1.395,"15min":1.395},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":2.274,"5min":2.274,"15min":2.274},"last":1.722}]},{"osd":7,"last update":"Tue Mar 12 17:19:41 2024","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.7959999999999998,"5min":2.7959999999999998,"15min":2.7959999999999998},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.55,"5min":1.55,"15min":1.55},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":3.1440000000000001,"5min":3.1440000000000001,"15min":3.1440000000000001},"last":1.663}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32252,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339588,"statfs":{"total":96636764160,"available":96603738112,"internally_reserved":0,"allocated":1150976,"data_stored":815475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.732,"5min":1.732,"15min":1.732},"last":0.82799999999999996},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"last":1.04}]},{"osd":2,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.99,"5min":1.99,"15min":1.99},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":0.88}]},{"osd":3,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":1.232}]},{"osd":4,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":3.2349999999999999,"5min":3.2349999999999999,"15min":3.2349999999999999},"last":1.401},{"interface":"front","average":{"1min":1.4570000000000001,"5min":1.4570000000000001,"15min":1.4570000000000001},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":2.5369999999999999,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":1.4319999999999999}]},{"osd":5,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"max":{"1min":2.988,"5min":2.988,"15min":2.988},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":2.843,"5min":2.843,"15min":2.843},"last":1.53}]},{"osd":6,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":2.431,"5min":2.431,"15min":2.431},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.5169999999999999,"5min":1.5169999999999999,"15min":1.5169999999999999},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.589,"5min":2.589,"15min":2.589},"last":1.2789999999999999}]},{"osd":7,"last update":"Tue Mar 12 17:19:39 2024","interfaces":[{"interface":"back","average":{"1min":1.637,"5min":1.637,"15min":1.637},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":2.7410000000000001,"5min":2.7410000000000001,"15min":2.7410000000000001},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":2.8929999999999998,"5min":2.8929999999999998,"15min":2.8929999999999998},"last":1.472}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-12T17:20:39.480 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-12T17:20:39.480 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-03-12T17:20:39.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.752+0000 7fab27e00640 1 Processor -- start 2024-03-12T17:20:39.747 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.752+0000 7fab27e00640 1 -- start start 2024-03-12T17:20:39.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.753+0000 7fab27e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fab281441f0 0x7fab28070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:39.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.753+0000 7fab27e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fab2815ae20 0x7fab2806d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:39.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.753+0000 7fab27e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fab280b3b70 0x7fab280b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:39.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.753+0000 7fab27e00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab2815e460 con 0x7fab2815ae20 2024-03-12T17:20:39.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.753+0000 7fab27e00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab280b4520 con 0x7fab280b3b70 2024-03-12T17:20:39.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.753+0000 7fab27e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab280a7660 con 0x7fab281441f0 2024-03-12T17:20:39.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.753+0000 7fab26000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fab2815ae20 0x7fab2806d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:39.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.754+0000 7fab26000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fab2815ae20 0x7fab2806d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58754/0 (socket says 172.21.15.17:58754) 2024-03-12T17:20:39.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.754+0000 7fab26000640 1 -- 172.21.15.17:0/555061072 learned_addr learned my addr 172.21.15.17:0/555061072 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:39.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.754+0000 7fab26a00640 1 --2- 172.21.15.17:0/555061072 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fab281441f0 0x7fab28070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:39.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.754+0000 7fab27400640 1 --2- 172.21.15.17:0/555061072 >> v2:172.21.15.94:3300/0 conn(0x7fab280b3b70 0x7fab280b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:39.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.754+0000 7fab26000640 1 -- 172.21.15.17:0/555061072 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fab281441f0 msgr2=0x7fab28070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:39.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.754+0000 7fab26000640 1 --2- 172.21.15.17:0/555061072 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fab281441f0 0x7fab28070240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:39.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.754+0000 7fab26000640 1 -- 172.21.15.17:0/555061072 >> v2:172.21.15.94:3300/0 conn(0x7fab280b3b70 msgr2=0x7fab280b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:39.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.754+0000 7fab26000640 1 --2- 172.21.15.17:0/555061072 >> v2:172.21.15.94:3300/0 conn(0x7fab280b3b70 0x7fab280b3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:39.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.754+0000 7fab26000640 1 -- 172.21.15.17:0/555061072 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab281445d0 con 0x7fab2815ae20 2024-03-12T17:20:39.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.755+0000 7fab26000640 1 --2- 172.21.15.17:0/555061072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab2815ae20 0x7fab2806d130 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fab28070090 tx=0x7fab1402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e7ffdfdaff97ae5 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:39.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.756+0000 7fab25600640 1 -- 172.21.15.17:0/555061072 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab14030840 con 0x7fab2815ae20 2024-03-12T17:20:39.751 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.756+0000 7fab25600640 1 -- 172.21.15.17:0/555061072 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab140309a0 con 0x7fab2815ae20 2024-03-12T17:20:39.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.756+0000 7fab25600640 1 -- 172.21.15.17:0/555061072 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab14030d30 con 0x7fab2815ae20 2024-03-12T17:20:39.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.756+0000 7fab27e00640 1 -- 172.21.15.17:0/555061072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab2815ae20 msgr2=0x7fab2806d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:39.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.756+0000 7fab27e00640 1 --2- 172.21.15.17:0/555061072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab2815ae20 0x7fab2806d130 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fab28070090 tx=0x7fab1402b980 comp rx=0 tx=0).stop 2024-03-12T17:20:39.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.757+0000 7fab27e00640 1 -- 172.21.15.17:0/555061072 shutdown_connections 2024-03-12T17:20:39.752 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.757+0000 7fab27e00640 1 --2- 172.21.15.17:0/555061072 >> v2:172.21.15.94:3300/0 conn(0x7fab280b3b70 0x7fab280b3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:39.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.757+0000 7fab27e00640 1 --2- 172.21.15.17:0/555061072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab2815ae20 0x7fab2806d130 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:39.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.757+0000 7fab27e00640 1 --2- 172.21.15.17:0/555061072 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fab281441f0 0x7fab28070240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:39.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.757+0000 7fab27e00640 1 -- 172.21.15.17:0/555061072 >> 172.21.15.17:0/555061072 conn(0x7fab28069ce0 msgr2=0x7fab2806a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:39.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.757+0000 7fab27e00640 1 -- 172.21.15.17:0/555061072 shutdown_connections 2024-03-12T17:20:39.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.757+0000 7fab27e00640 1 -- 172.21.15.17:0/555061072 wait complete. 2024-03-12T17:20:39.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.758+0000 7fab27e00640 1 Processor -- start 2024-03-12T17:20:39.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.759+0000 7fab27e00640 1 -- start start 2024-03-12T17:20:39.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.759+0000 7fab27e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab280b3b70 0x7fab2814ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:39.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.760+0000 7fab27e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab281441f0 0x7fab2813e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:39.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.760+0000 7fab27e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fab2815ae20 0x7fab2813e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:39.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.760+0000 7fab27e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab280cb970 con 0x7fab281441f0 2024-03-12T17:20:39.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.760+0000 7fab27e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab28151610 con 0x7fab280b3b70 2024-03-12T17:20:39.755 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.760+0000 7fab27e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab2814f2c0 con 0x7fab2815ae20 2024-03-12T17:20:39.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.760+0000 7fab26000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab281441f0 0x7fab2813e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:39.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.760+0000 7fab26000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab281441f0 0x7fab2813e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58760/0 (socket says 172.21.15.17:58760) 2024-03-12T17:20:39.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.760+0000 7fab26000640 1 -- 172.21.15.17:0/1219783657 learned_addr learned my addr 172.21.15.17:0/1219783657 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:39.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.760+0000 7fab27400640 1 --2- 172.21.15.17:0/1219783657 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fab2815ae20 0x7fab2813e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:39.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.760+0000 7fab26a00640 1 --2- 172.21.15.17:0/1219783657 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab280b3b70 0x7fab2814ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:39.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.760+0000 7fab26000640 1 -- 172.21.15.17:0/1219783657 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fab2815ae20 msgr2=0x7fab2813e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:39.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.760+0000 7fab26000640 1 --2- 172.21.15.17:0/1219783657 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fab2815ae20 0x7fab2813e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:39.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.760+0000 7fab26000640 1 -- 172.21.15.17:0/1219783657 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab280b3b70 msgr2=0x7fab2814ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:39.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.761+0000 7fab26000640 1 --2- 172.21.15.17:0/1219783657 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab280b3b70 0x7fab2814ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:39.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.761+0000 7fab26000640 1 -- 172.21.15.17:0/1219783657 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab140094d0 con 0x7fab281441f0 2024-03-12T17:20:39.757 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.761+0000 7fab26000640 1 --2- 172.21.15.17:0/1219783657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab281441f0 0x7fab2813e120 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fab1402b9c0 tx=0x7fab14004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:39.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.761+0000 7fab1ea00640 1 -- 172.21.15.17:0/1219783657 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1403e040 con 0x7fab281441f0 2024-03-12T17:20:39.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.761+0000 7fab1ea00640 1 -- 172.21.15.17:0/1219783657 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab14039cb0 con 0x7fab281441f0 2024-03-12T17:20:39.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.761+0000 7fab1ea00640 1 -- 172.21.15.17:0/1219783657 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab14044630 con 0x7fab281441f0 2024-03-12T17:20:39.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.761+0000 7fab27e00640 1 -- 172.21.15.17:0/1219783657 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab2814f5a0 con 0x7fab281441f0 2024-03-12T17:20:39.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.761+0000 7fab27e00640 1 -- 172.21.15.17:0/1219783657 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab2814fb60 con 0x7fab281441f0 2024-03-12T17:20:39.758 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.763+0000 7fab27e00640 1 -- 172.21.15.17:0/1219783657 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab2804e030 con 0x7fab281441f0 2024-03-12T17:20:39.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.764+0000 7fab1ea00640 1 -- 172.21.15.17:0/1219783657 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fab14043390 con 0x7fab281441f0 2024-03-12T17:20:39.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.765+0000 7fab1ea00640 1 --2- 172.21.15.17:0/1219783657 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fab0806ac00 0x7fab0806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:39.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.765+0000 7fab1ea00640 1 -- 172.21.15.17:0/1219783657 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab140ab7e0 con 0x7fab281441f0 2024-03-12T17:20:39.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.765+0000 7fab26a00640 1 --2- 172.21.15.17:0/1219783657 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fab0806ac00 0x7fab0806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:39.761 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.766+0000 7fab26a00640 1 --2- 172.21.15.17:0/1219783657 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fab0806ac00 0x7fab0806d0c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fab18006fd0 tx=0x7fab18008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:39.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:39.769+0000 7fab1ea00640 1 -- 172.21.15.17:0/1219783657 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fab140769c0 con 0x7fab281441f0 2024-03-12T17:20:40.045 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.049+0000 7fab27e00640 1 -- 172.21.15.17:0/1219783657 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fab2806c990 con 0x7fab281441f0 2024-03-12T17:20:40.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.058+0000 7fab1ea00640 1 -- 172.21.15.17:0/1219783657 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v10) v1 ==== 190+0+0 (secure 0 0 0) 0x7fab14079fe0 con 0x7fab281441f0 2024-03-12T17:20:40.054 INFO:teuthology.orchestra.run.smithi017.stderr:updated caps for client.0 2024-03-12T17:20:40.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.061+0000 7fab27e00640 1 -- 172.21.15.17:0/1219783657 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fab0806ac00 msgr2=0x7fab0806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:40.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.061+0000 7fab27e00640 1 --2- 172.21.15.17:0/1219783657 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fab0806ac00 0x7fab0806d0c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fab18006fd0 tx=0x7fab18008040 comp rx=0 tx=0).stop 2024-03-12T17:20:40.057 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.061+0000 7fab27e00640 1 -- 172.21.15.17:0/1219783657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab281441f0 msgr2=0x7fab2813e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.061+0000 7fab27e00640 1 --2- 172.21.15.17:0/1219783657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab281441f0 0x7fab2813e120 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fab1402b9c0 tx=0x7fab14004730 comp rx=0 tx=0).stop 2024-03-12T17:20:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.062+0000 7fab27e00640 1 -- 172.21.15.17:0/1219783657 shutdown_connections 2024-03-12T17:20:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.062+0000 7fab27e00640 1 --2- 172.21.15.17:0/1219783657 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fab0806ac00 0x7fab0806d0c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.062+0000 7fab27e00640 1 --2- 172.21.15.17:0/1219783657 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fab2815ae20 0x7fab2813e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.062+0000 7fab27e00640 1 --2- 172.21.15.17:0/1219783657 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fab281441f0 0x7fab2813e120 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.062+0000 7fab27e00640 1 --2- 172.21.15.17:0/1219783657 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fab280b3b70 0x7fab2814ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.062+0000 7fab27e00640 1 -- 172.21.15.17:0/1219783657 >> 172.21.15.17:0/1219783657 conn(0x7fab28069ce0 msgr2=0x7fab280ada20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.062+0000 7fab27e00640 1 -- 172.21.15.17:0/1219783657 shutdown_connections 2024-03-12T17:20:40.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.062+0000 7fab27e00640 1 -- 172.21.15.17:0/1219783657 wait complete. 2024-03-12T17:20:40.077 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-12T17:20:40.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.303+0000 7fafa1200640 1 Processor -- start 2024-03-12T17:20:40.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.303+0000 7fafa1200640 1 -- start start 2024-03-12T17:20:40.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.305+0000 7fafa1200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7faf9c1441f0 0x7faf9c070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:40.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.305+0000 7fafa1200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf9c0a7660 con 0x7faf9c15ae20 2024-03-12T17:20:40.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.305+0000 7fafa1200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf9c1445d0 con 0x7faf9c0b3b70 2024-03-12T17:20:40.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.305+0000 7fafa1200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf9c15e460 con 0x7faf9c1441f0 2024-03-12T17:20:40.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.305+0000 7faf9b400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7faf9c1441f0 0x7faf9c070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:40.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.305+0000 7faf9b400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7faf9c1441f0 0x7faf9c070240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58766/0 (socket says 172.21.15.17:58766) 2024-03-12T17:20:40.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.305+0000 7faf9b400640 1 -- 172.21.15.17:0/1746720749 learned_addr learned my addr 172.21.15.17:0/1746720749 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:40.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.306+0000 7faf9b400640 1 -- 172.21.15.17:0/1746720749 >> v1:172.21.15.94:6789/0 conn(0x7faf9c0b3b70 legacy=0x7faf9c0b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:40.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.306+0000 7faf9b400640 1 -- 172.21.15.17:0/1746720749 >> v1:172.21.15.17:6789/0 conn(0x7faf9c15ae20 legacy=0x7faf9c06d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:40.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.306+0000 7faf9b400640 1 -- 172.21.15.17:0/1746720749 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf9c15b3e0 con 0x7faf9c1441f0 2024-03-12T17:20:40.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.307+0000 7faf9b400640 1 --2- 172.21.15.17:0/1746720749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf9c1441f0 0x7faf9c070240 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7faf8c009870 tx=0x7faf8c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61d50111c71ff027 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:40.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.307+0000 7faf9aa00640 1 -- 172.21.15.17:0/1746720749 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c02f840 con 0x7faf9c1441f0 2024-03-12T17:20:40.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.307+0000 7faf9aa00640 1 -- 172.21.15.17:0/1746720749 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8c02f9a0 con 0x7faf9c1441f0 2024-03-12T17:20:40.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.307+0000 7faf9aa00640 1 -- 172.21.15.17:0/1746720749 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c02fd30 con 0x7faf9c1441f0 2024-03-12T17:20:40.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.308+0000 7fafa1200640 1 -- 172.21.15.17:0/1746720749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf9c1441f0 msgr2=0x7faf9c070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:40.303 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.308+0000 7fafa1200640 1 --2- 172.21.15.17:0/1746720749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf9c1441f0 0x7faf9c070240 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7faf8c009870 tx=0x7faf8c02ba20 comp rx=0 tx=0).stop 2024-03-12T17:20:40.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.308+0000 7fafa1200640 1 -- 172.21.15.17:0/1746720749 shutdown_connections 2024-03-12T17:20:40.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.308+0000 7fafa1200640 1 --2- 172.21.15.17:0/1746720749 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf9c1441f0 0x7faf9c070240 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:40.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.308+0000 7fafa1200640 1 -- 172.21.15.17:0/1746720749 >> 172.21.15.17:0/1746720749 conn(0x7faf9c069ce0 msgr2=0x7faf9c06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:40.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.308+0000 7fafa1200640 1 -- 172.21.15.17:0/1746720749 shutdown_connections 2024-03-12T17:20:40.304 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.308+0000 7fafa1200640 1 -- 172.21.15.17:0/1746720749 wait complete. 2024-03-12T17:20:40.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.310+0000 7fafa1200640 1 Processor -- start 2024-03-12T17:20:40.305 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.310+0000 7fafa1200640 1 -- start start 2024-03-12T17:20:40.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.311+0000 7fafa1200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf9c0b3b70 0x7faf9c13cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:40.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.311+0000 7fafa1200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf9c1441f0 0x7faf9c1f3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:40.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.311+0000 7fafa1200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf9c15ae20 0x7faf9c0acec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:40.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.311+0000 7fafa1200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c1f3d90 con 0x7faf9c0b3b70 2024-03-12T17:20:40.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.311+0000 7fafa1200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c1f4030 con 0x7faf9c15ae20 2024-03-12T17:20:40.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.311+0000 7fafa1200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf9c1f4310 con 0x7faf9c1441f0 2024-03-12T17:20:40.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.311+0000 7faf9b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf9c0b3b70 0x7faf9c13cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:40.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.311+0000 7faf9b400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf9c0b3b70 0x7faf9c13cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58768/0 (socket says 172.21.15.17:58768) 2024-03-12T17:20:40.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.311+0000 7faf9b400640 1 -- 172.21.15.17:0/45604434 learned_addr learned my addr 172.21.15.17:0/45604434 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:40.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.312+0000 7faf93e00640 1 --2- 172.21.15.17:0/45604434 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf9c1441f0 0x7faf9c1f3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:40.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.312+0000 7faf9be00640 1 --2- 172.21.15.17:0/45604434 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf9c15ae20 0x7faf9c0acec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:40.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.312+0000 7faf9b400640 1 -- 172.21.15.17:0/45604434 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf9c1441f0 msgr2=0x7faf9c1f3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:40.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.312+0000 7faf9b400640 1 --2- 172.21.15.17:0/45604434 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf9c1441f0 0x7faf9c1f3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:40.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.312+0000 7faf9b400640 1 -- 172.21.15.17:0/45604434 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf9c15ae20 msgr2=0x7faf9c0acec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:40.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.312+0000 7faf9b400640 1 --2- 172.21.15.17:0/45604434 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf9c15ae20 0x7faf9c0acec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:40.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.312+0000 7faf9b400640 1 -- 172.21.15.17:0/45604434 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8c0094d0 con 0x7faf9c0b3b70 2024-03-12T17:20:40.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.312+0000 7faf9b400640 1 --2- 172.21.15.17:0/45604434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf9c0b3b70 0x7faf9c13cbc0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7faf8c009870 tx=0x7faf8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:40.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.313+0000 7faf93400640 1 -- 172.21.15.17:0/45604434 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c03b040 con 0x7faf9c0b3b70 2024-03-12T17:20:40.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.313+0000 7faf93400640 1 -- 172.21.15.17:0/45604434 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8c02f7d0 con 0x7faf9c0b3b70 2024-03-12T17:20:40.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.313+0000 7fafa1200640 1 -- 172.21.15.17:0/45604434 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf9c1f45f0 con 0x7faf9c0b3b70 2024-03-12T17:20:40.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.313+0000 7faf93400640 1 -- 172.21.15.17:0/45604434 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c0426c0 con 0x7faf9c0b3b70 2024-03-12T17:20:40.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.313+0000 7fafa1200640 1 -- 172.21.15.17:0/45604434 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf9c1f4bb0 con 0x7faf9c0b3b70 2024-03-12T17:20:40.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.314+0000 7fafa1200640 1 -- 172.21.15.17:0/45604434 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf9c04e030 con 0x7faf9c0b3b70 2024-03-12T17:20:40.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.315+0000 7faf93400640 1 -- 172.21.15.17:0/45604434 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7faf8c042820 con 0x7faf9c0b3b70 2024-03-12T17:20:40.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.316+0000 7faf93400640 1 --2- 172.21.15.17:0/45604434 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faf7806ac30 0x7faf7806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:40.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.317+0000 7faf93400640 1 -- 172.21.15.17:0/45604434 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf8c0ac790 con 0x7faf9c0b3b70 2024-03-12T17:20:40.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.317+0000 7faf93e00640 1 --2- 172.21.15.17:0/45604434 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faf7806ac30 0x7faf7806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:40.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.317+0000 7faf93e00640 1 --2- 172.21.15.17:0/45604434 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faf7806ac30 0x7faf7806d0f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7faf84007fd0 tx=0x7faf84009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:40.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.321+0000 7faf93400640 1 -- 172.21.15.17:0/45604434 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7faf8c0779f0 con 0x7faf9c0b3b70 2024-03-12T17:20:40.559 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.564+0000 7fafa1200640 1 -- 172.21.15.17:0/45604434 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf9c06c990 con 0x7faf9c0b3b70 2024-03-12T17:20:40.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.565+0000 7faf93400640 1 -- 172.21.15.17:0/45604434 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4731 (secure 0 0 0) 0x7faf8c07b010 con 0x7faf9c0b3b70 2024-03-12T17:20:40.560 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:20:40.560 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4808,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6834/3175855266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3175855266},{"type":"v1","addr":"172.21.15.94:6834","nonce":3175855266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":4927,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/1725537585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1725537585},{"type":"v1","addr":"172.21.15.17:6835","nonce":1725537585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":4939,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/630541950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6833","nonce":630541950},{"type":"v1","addr":"172.21.15.94:6835","nonce":630541950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T17:20:29.180386+0000","modified":"2024-03-12T17:20:32.399146+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5433":{"gid":5433,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6837/2711965846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":2711965846},{"type":"v1","addr":"172.21.15.17:6837","nonce":2711965846}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-03-12T17:20:40.560 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 22 2024-03-12T17:20:40.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.567+0000 7fafa1200640 1 -- 172.21.15.17:0/45604434 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faf7806ac30 msgr2=0x7faf7806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:40.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.567+0000 7fafa1200640 1 --2- 172.21.15.17:0/45604434 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faf7806ac30 0x7faf7806d0f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7faf84007fd0 tx=0x7faf84009040 comp rx=0 tx=0).stop 2024-03-12T17:20:40.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.567+0000 7fafa1200640 1 -- 172.21.15.17:0/45604434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf9c0b3b70 msgr2=0x7faf9c13cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:40.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.567+0000 7fafa1200640 1 --2- 172.21.15.17:0/45604434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf9c0b3b70 0x7faf9c13cbc0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7faf8c009870 tx=0x7faf8c0046c0 comp rx=0 tx=0).stop 2024-03-12T17:20:40.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.567+0000 7fafa1200640 1 -- 172.21.15.17:0/45604434 shutdown_connections 2024-03-12T17:20:40.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.567+0000 7fafa1200640 1 --2- 172.21.15.17:0/45604434 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faf7806ac30 0x7faf7806d0f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:40.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.567+0000 7fafa1200640 1 --2- 172.21.15.17:0/45604434 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7faf9c15ae20 0x7faf9c0acec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:40.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.567+0000 7fafa1200640 1 --2- 172.21.15.17:0/45604434 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7faf9c1441f0 0x7faf9c1f3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:40.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.567+0000 7fafa1200640 1 --2- 172.21.15.17:0/45604434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7faf9c0b3b70 0x7faf9c13cbc0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:40.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.567+0000 7fafa1200640 1 -- 172.21.15.17:0/45604434 >> 172.21.15.17:0/45604434 conn(0x7faf9c069ce0 msgr2=0x7faf9c06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:40.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.568+0000 7fafa1200640 1 -- 172.21.15.17:0/45604434 shutdown_connections 2024-03-12T17:20:40.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:40.568+0000 7fafa1200640 1 -- 172.21.15.17:0/45604434 wait complete. 2024-03-12T17:20:40.634 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:20:40.642 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:20:40.986 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-12T17:20:29.180386+0000', 'modified': '2024-03-12T17:20:32.399146+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5433}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5433': {'gid': 5433, 'name': 'c', 'rank': 0, 'incarnation': 18, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.17:6837/2711965846', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.17:6836', 'nonce': 2711965846}, {'type': 'v1', 'addr': '172.21.15.17:6837', 'nonce': 2711965846}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-03-12T17:20:40.986 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-12T17:20:40.987 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-03-12T17:20:41.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.214+0000 7fc24e000640 1 Processor -- start 2024-03-12T17:20:41.210 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.215+0000 7fc24e000640 1 -- start start 2024-03-12T17:20:41.211 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.216+0000 7fc24e000640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fc24815ca10 0x7fc2480abd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:41.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.216+0000 7fc24e000640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc24815dee0 con 0x7fc2480b2830 2024-03-12T17:20:41.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.216+0000 7fc24e000640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc24815d2d0 con 0x7fc24815cdf0 2024-03-12T17:20:41.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.216+0000 7fc24e000640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc24815d5b0 con 0x7fc24815ca10 2024-03-12T17:20:41.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.217+0000 7fc247e00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fc2480b2830 0x7fc2481607f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:43454/0 (socket says 172.21.15.17:43454) 2024-03-12T17:20:41.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.217+0000 7fc247e00640 1 -- 172.21.15.17:0/3834214139 learned_addr learned my addr 172.21.15.17:0/3834214139 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:20:41.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.217+0000 7fc247400640 1 --2- 172.21.15.17:0/3834214139 >> v2:172.21.15.94:3300/0 conn(0x7fc24815ca10 0x7fc2480abd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:41.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.217+0000 7fc246000640 1 -- 172.21.15.17:0/3834214139 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 654827705 0 0) 0x7fc24815dee0 con 0x7fc2480b2830 2024-03-12T17:20:41.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.217+0000 7fc246000640 1 -- 172.21.15.17:0/3834214139 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc22c003520 con 0x7fc2480b2830 2024-03-12T17:20:41.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.218+0000 7fc246000640 1 -- 172.21.15.17:0/3834214139 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2971776331 0 0) 0x7fc22c003520 con 0x7fc2480b2830 2024-03-12T17:20:41.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.218+0000 7fc247400640 1 -- 172.21.15.17:0/3834214139 >> v1:172.21.15.94:6789/0 conn(0x7fc24815cdf0 legacy=0x7fc2480b2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:41.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.218+0000 7fc247400640 1 -- 172.21.15.17:0/3834214139 >> v1:172.21.15.17:6789/0 conn(0x7fc2480b2830 legacy=0x7fc2481607f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:41.214 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.218+0000 7fc247400640 1 -- 172.21.15.17:0/3834214139 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc24815d890 con 0x7fc24815ca10 2024-03-12T17:20:41.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.219+0000 7fc247400640 1 --2- 172.21.15.17:0/3834214139 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc24815ca10 0x7fc2480abd90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc2380097a0 tx=0x7fc23802b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e0549dda255bdaf server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:41.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.220+0000 7fc246000640 1 -- 172.21.15.17:0/3834214139 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23802f050 con 0x7fc24815ca10 2024-03-12T17:20:41.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.220+0000 7fc246000640 1 -- 172.21.15.17:0/3834214139 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc238031500 con 0x7fc24815ca10 2024-03-12T17:20:41.215 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.220+0000 7fc246000640 1 -- 172.21.15.17:0/3834214139 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2400019f0 con 0x7fc24815ca10 2024-03-12T17:20:41.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.220+0000 7fc24e000640 1 -- 172.21.15.17:0/3834214139 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc24815ca10 msgr2=0x7fc2480abd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:41.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.221+0000 7fc24e000640 1 --2- 172.21.15.17:0/3834214139 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc24815ca10 0x7fc2480abd90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc2380097a0 tx=0x7fc23802b820 comp rx=0 tx=0).stop 2024-03-12T17:20:41.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.221+0000 7fc24e000640 1 -- 172.21.15.17:0/3834214139 shutdown_connections 2024-03-12T17:20:41.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.221+0000 7fc24e000640 1 --2- 172.21.15.17:0/3834214139 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc24815ca10 0x7fc2480abd90 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:41.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.221+0000 7fc24e000640 1 -- 172.21.15.17:0/3834214139 >> 172.21.15.17:0/3834214139 conn(0x7fc248069ce0 msgr2=0x7fc24806a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:41.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.221+0000 7fc24e000640 1 -- 172.21.15.17:0/3834214139 shutdown_connections 2024-03-12T17:20:41.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.221+0000 7fc24e000640 1 -- 172.21.15.17:0/3834214139 wait complete. 2024-03-12T17:20:41.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.223+0000 7fc24e000640 1 Processor -- start 2024-03-12T17:20:41.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.223+0000 7fc24e000640 1 -- start start 2024-03-12T17:20:41.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.224+0000 7fc24e000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc2480b2830 0x7fc248154060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:41.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.224+0000 7fc24e000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc24815ca10 0x7fc2481f2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:41.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.224+0000 7fc24e000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc24815cdf0 0x7fc24815f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:41.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.224+0000 7fc24e000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2481f2aa0 con 0x7fc24815cdf0 2024-03-12T17:20:41.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.224+0000 7fc24e000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc248158290 con 0x7fc24815ca10 2024-03-12T17:20:41.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.224+0000 7fc24e000640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc24815f930 con 0x7fc2480b2830 2024-03-12T17:20:41.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.224+0000 7fc247e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc24815cdf0 0x7fc24815f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:41.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.224+0000 7fc247e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc24815cdf0 0x7fc24815f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58782/0 (socket says 172.21.15.17:58782) 2024-03-12T17:20:41.220 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.224+0000 7fc247e00640 1 -- 172.21.15.17:0/1185815510 learned_addr learned my addr 172.21.15.17:0/1185815510 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:41.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.224+0000 7fc246a00640 1 --2- 172.21.15.17:0/1185815510 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc24815ca10 0x7fc2481f2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:41.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.224+0000 7fc247400640 1 --2- 172.21.15.17:0/1185815510 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc2480b2830 0x7fc248154060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:41.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.224+0000 7fc247e00640 1 -- 172.21.15.17:0/1185815510 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc2480b2830 msgr2=0x7fc248154060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:41.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.224+0000 7fc247e00640 1 --2- 172.21.15.17:0/1185815510 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc2480b2830 0x7fc248154060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:41.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.224+0000 7fc247e00640 1 -- 172.21.15.17:0/1185815510 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc24815ca10 msgr2=0x7fc2481f2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:41.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.224+0000 7fc247e00640 1 --2- 172.21.15.17:0/1185815510 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc24815ca10 0x7fc2481f2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:41.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.224+0000 7fc247e00640 1 -- 172.21.15.17:0/1185815510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc238009400 con 0x7fc24815cdf0 2024-03-12T17:20:41.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.224+0000 7fc246a00640 1 --2- 172.21.15.17:0/1185815510 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc24815ca10 0x7fc2481f2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:41.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.224+0000 7fc247400640 1 --2- 172.21.15.17:0/1185815510 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc2480b2830 0x7fc248154060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:41.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.225+0000 7fc247e00640 1 --2- 172.21.15.17:0/1185815510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc24815cdf0 0x7fc24815f080 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc2400018c0 tx=0x7fc24000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:41.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.225+0000 7fc23f400640 1 -- 172.21.15.17:0/1185815510 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc240012400 con 0x7fc24815cdf0 2024-03-12T17:20:41.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.225+0000 7fc23f400640 1 -- 172.21.15.17:0/1185815510 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc240012560 con 0x7fc24815cdf0 2024-03-12T17:20:41.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.225+0000 7fc23f400640 1 -- 172.21.15.17:0/1185815510 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc240012910 con 0x7fc24815cdf0 2024-03-12T17:20:41.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.225+0000 7fc24e000640 1 -- 172.21.15.17:0/1185815510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2481584e0 con 0x7fc24815cdf0 2024-03-12T17:20:41.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.225+0000 7fc24e000640 1 -- 172.21.15.17:0/1185815510 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc248158aa0 con 0x7fc24815cdf0 2024-03-12T17:20:41.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.228+0000 7fc23f400640 1 -- 172.21.15.17:0/1185815510 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fc240012a70 con 0x7fc24815cdf0 2024-03-12T17:20:41.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.229+0000 7fc23f400640 1 --2- 172.21.15.17:0/1185815510 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc22806ac00 0x7fc22806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:41.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.229+0000 7fc23f400640 1 -- 172.21.15.17:0/1185815510 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc240089bf0 con 0x7fc24815cdf0 2024-03-12T17:20:41.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.230+0000 7fc247400640 1 --2- 172.21.15.17:0/1185815510 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc22806ac00 0x7fc22806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:41.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.230+0000 7fc250bcc740 1 Processor -- start 2024-03-12T17:20:41.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.230+0000 7fc250bcc740 1 -- start start 2024-03-12T17:20:41.226 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.230+0000 7fc247400640 1 --2- 172.21.15.17:0/1185815510 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc22806ac00 0x7fc22806d0c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc238035000 tx=0x7fc238008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:41.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.231+0000 7fc250bcc740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0a9f1eff0 0x55f0a9ed6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:41.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.231+0000 7fc250bcc740 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55f0a9ed5070 0x55f0a9ed6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:41.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.231+0000 7fc250bcc740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f0a9ed1510 0x55f0a9f01300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:41.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.231+0000 7fc250bcc740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0a9eace40 con 0x55f0a9ed1510 2024-03-12T17:20:41.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.231+0000 7fc250bcc740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0a9e42090 con 0x55f0a9f1eff0 2024-03-12T17:20:41.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.231+0000 7fc250bcc740 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f0a9e3f820 con 0x55f0a9ed5070 2024-03-12T17:20:41.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.232+0000 7fc247e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f0a9ed1510 0x55f0a9f01300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:41.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.232+0000 7fc247e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f0a9ed1510 0x55f0a9f01300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58798/0 (socket says 172.21.15.17:58798) 2024-03-12T17:20:41.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.232+0000 7fc247e00640 1 -- 172.21.15.17:0/37149725 learned_addr learned my addr 172.21.15.17:0/37149725 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:41.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.232+0000 7fc246a00640 1 --2- 172.21.15.17:0/37149725 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55f0a9ed5070 0x55f0a9ed6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:41.228 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.232+0000 7fc247e00640 1 -- 172.21.15.17:0/37149725 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55f0a9ed5070 msgr2=0x55f0a9ed6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:41.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.232+0000 7fc247e00640 1 --2- 172.21.15.17:0/37149725 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55f0a9ed5070 0x55f0a9ed6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:41.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.232+0000 7fc247400640 1 --2- 172.21.15.17:0/37149725 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0a9f1eff0 0x55f0a9ed6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:41.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.232+0000 7fc247e00640 1 -- 172.21.15.17:0/37149725 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0a9f1eff0 msgr2=0x55f0a9ed6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:41.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.232+0000 7fc247e00640 1 --2- 172.21.15.17:0/37149725 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0a9f1eff0 0x55f0a9ed6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:41.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.232+0000 7fc247e00640 1 -- 172.21.15.17:0/37149725 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0a9e02780 con 0x55f0a9ed1510 2024-03-12T17:20:41.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.232+0000 7fc247e00640 1 --2- 172.21.15.17:0/37149725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f0a9ed1510 0x55f0a9f01300 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc2400586f0 tx=0x7fc240058660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db29cf673f3b5bb7 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:41.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.233+0000 7fc233e00640 1 -- 172.21.15.17:0/37149725 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24005c820 con 0x55f0a9ed1510 2024-03-12T17:20:41.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.233+0000 7fc233e00640 1 -- 172.21.15.17:0/37149725 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc240060de0 con 0x55f0a9ed1510 2024-03-12T17:20:41.229 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.233+0000 7fc233e00640 1 -- 172.21.15.17:0/37149725 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc240012d20 con 0x55f0a9ed1510 2024-03-12T17:20:41.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.233+0000 7fc250bcc740 1 -- 172.21.15.17:0/37149725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f0a9ed1510 msgr2=0x55f0a9f01300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:41.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.233+0000 7fc250bcc740 1 --2- 172.21.15.17:0/37149725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f0a9ed1510 0x55f0a9f01300 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fc2400586f0 tx=0x7fc240058660 comp rx=0 tx=0).stop 2024-03-12T17:20:41.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.233+0000 7fc250bcc740 1 -- 172.21.15.17:0/37149725 shutdown_connections 2024-03-12T17:20:41.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.233+0000 7fc250bcc740 1 --2- 172.21.15.17:0/37149725 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f0a9ed1510 0x55f0a9f01300 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:41.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.233+0000 7fc250bcc740 1 --2- 172.21.15.17:0/37149725 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55f0a9ed5070 0x55f0a9ed6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:41.230 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.233+0000 7fc250bcc740 1 --2- 172.21.15.17:0/37149725 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0a9f1eff0 0x55f0a9ed6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:41.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.233+0000 7fc250bcc740 1 -- 172.21.15.17:0/37149725 >> 172.21.15.17:0/37149725 conn(0x55f0a9ed3780 msgr2=0x55f0a9f1c300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:41.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.233+0000 7fc250bcc740 1 -- 172.21.15.17:0/37149725 shutdown_connections 2024-03-12T17:20:41.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.233+0000 7fc250bcc740 1 -- 172.21.15.17:0/37149725 wait complete. 2024-03-12T17:20:41.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.234+0000 7fc250bcc740 1 -- start start 2024-03-12T17:20:41.231 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.234+0000 7fc250bcc740 1 Processor -- start 2024-03-12T17:20:41.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.235+0000 7fc250bcc740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f0a9ed5070 0x55f0a9ee4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:41.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.235+0000 7fc250bcc740 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55f0a9f1eff0 0x55f0a9eff790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:41.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.235+0000 7fc250bcc740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0a9f209d0 0x55f0a9ef8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:41.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.235+0000 7fc250bcc740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0a9e3b110 con 0x55f0a9ed5070 2024-03-12T17:20:41.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.235+0000 7fc250bcc740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0a9ddc8c0 con 0x55f0a9f209d0 2024-03-12T17:20:41.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.235+0000 7fc250bcc740 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f0a9ddc560 con 0x55f0a9f1eff0 2024-03-12T17:20:41.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.235+0000 7fc250bcc740 10 client.0 _ll_register_callbacks cb 0x55f0a9e348d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-12T17:20:41.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.236+0000 7fc247400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f0a9ed5070 0x55f0a9ee4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:41.234 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.236+0000 7fc247400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f0a9ed5070 0x55f0a9ee4470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58806/0 (socket says 172.21.15.17:58806) 2024-03-12T17:20:41.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.236+0000 7fc247400640 1 -- 172.21.15.17:0/2469724900 learned_addr learned my addr 172.21.15.17:0/2469724900 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:41.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.236+0000 7fc247400640 1 -- 172.21.15.17:0/2469724900 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55f0a9f1eff0 msgr2=0x55f0a9eff790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:41.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.236+0000 7fc246a00640 1 --2- 172.21.15.17:0/2469724900 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55f0a9f1eff0 0x55f0a9eff790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:41.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.236+0000 7fc247e00640 1 --2- 172.21.15.17:0/2469724900 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0a9f209d0 0x55f0a9ef8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:41.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.236+0000 7fc247400640 1 --2- 172.21.15.17:0/2469724900 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55f0a9f1eff0 0x55f0a9eff790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:41.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.236+0000 7fc247400640 1 -- 172.21.15.17:0/2469724900 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0a9f209d0 msgr2=0x55f0a9ef8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:41.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.236+0000 7fc247400640 1 --2- 172.21.15.17:0/2469724900 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0a9f209d0 0x55f0a9ef8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:41.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.236+0000 7fc247400640 1 -- 172.21.15.17:0/2469724900 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc248158aa0 con 0x55f0a9ed5070 2024-03-12T17:20:41.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.237+0000 7fc247400640 1 --2- 172.21.15.17:0/2469724900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f0a9ed5070 0x55f0a9ee4470 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc238009890 tx=0x7fc238004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59e5cc3013eaf8af server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:41.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.237+0000 7fc230c00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-12T17:20:41.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.237+0000 7fc230c00640 1 -- 172.21.15.17:0/2469724900 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc238049830 con 0x55f0a9ed5070 2024-03-12T17:20:41.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.237+0000 7fc230c00640 1 -- 172.21.15.17:0/2469724900 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc238049990 con 0x55f0a9ed5070 2024-03-12T17:20:41.235 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.237+0000 7fc250bcc740 1 -- 172.21.15.17:0/2469724900 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f0a9e65660 con 0x55f0a9ed5070 2024-03-12T17:20:41.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.237+0000 7fc230c00640 1 -- 172.21.15.17:0/2469724900 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc238049b50 con 0x55f0a9ed5070 2024-03-12T17:20:41.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.237+0000 7fc250bcc740 10 client.5589 fetch_fsmap learned FSMap version 22 2024-03-12T17:20:41.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.237+0000 7fc250bcc740 1 -- 172.21.15.17:0/2469724900 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x55f0a9e39790 con 0x55f0a9ed5070 2024-03-12T17:20:41.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.237+0000 7fc230c00640 1 -- 172.21.15.17:0/2469724900 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f0a9e65660 con 0x55f0a9ed5070 2024-03-12T17:20:41.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.238+0000 7fc230c00640 1 -- 172.21.15.17:0/2469724900 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 22) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fc238045070 con 0x55f0a9ed5070 2024-03-12T17:20:41.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.238+0000 7fc250bcc740 10 client.5589 fetch_fsmap finished waiting for FSMap version 22 2024-03-12T17:20:41.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.238+0000 7fc250bcc740 10 client.5589 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-12T17:20:41.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.238+0000 7fc250bcc740 20 client.5589 populate_metadata read hostname 'smithi017' 2024-03-12T17:20:41.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.238+0000 7fc250bcc740 1 --2- 172.21.15.17:0/2469724900 >> [v2:172.21.15.17:6836/2711965846,v1:172.21.15.17:6837/2711965846] conn(0x55f0a9ee6500 0x55f0a9ee68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:41.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.238+0000 7fc250bcc740 4 client.5589 mds_command: new command op to 5433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-12T17:20:41.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.238+0000 7fc250bcc740 1 -- 172.21.15.17:0/2469724900 --> [v2:172.21.15.17:6836/2711965846,v1:172.21.15.17:6837/2711965846] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f0a9e2de50 con 0x55f0a9ee6500 2024-03-12T17:20:41.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.238+0000 7fc246a00640 1 --2- 172.21.15.17:0/2469724900 >> [v2:172.21.15.17:6836/2711965846,v1:172.21.15.17:6837/2711965846] conn(0x55f0a9ee6500 0x55f0a9ee68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:41.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.238+0000 7fc246a00640 1 --2- 172.21.15.17:0/2469724900 >> [v2:172.21.15.17:6836/2711965846,v1:172.21.15.17:6837/2711965846] conn(0x55f0a9ee6500 0x55f0a9ee68e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72603868ccafc6eb server_cookie=7d5b31a9e6c9ed9 in_seq=0 out_seq=0 2024-03-12T17:20:41.236 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.238+0000 7fc230c00640 10 client.5589 ms_handle_connect on v2:172.21.15.17:6836/2711965846 2024-03-12T17:20:41.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.239+0000 7fc230c00640 1 -- 172.21.15.17:0/2469724900 <== mds.0 v2:172.21.15.17:6836/2711965846 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f0a9e2de50 con 0x55f0a9ee6500 2024-03-12T17:20:41.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.239+0000 7fc230c00640 10 client.5589 handle_command_reply: tid=0 2024-03-12T17:20:41.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.239+0000 7fc250bcc740 1 client.5589 shutdown 2024-03-12T17:20:41.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.240+0000 7fc250bcc740 1 -- 172.21.15.17:0/2469724900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f0a9ed5070 msgr2=0x55f0a9ee4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:41.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.240+0000 7fc250bcc740 1 --2- 172.21.15.17:0/2469724900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f0a9ed5070 0x55f0a9ee4470 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fc238009890 tx=0x7fc238004730 comp rx=0 tx=0).stop 2024-03-12T17:20:41.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.240+0000 7fc250bcc740 1 -- 172.21.15.17:0/2469724900 shutdown_connections 2024-03-12T17:20:41.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.240+0000 7fc250bcc740 1 --2- 172.21.15.17:0/2469724900 >> [v2:172.21.15.17:6836/2711965846,v1:172.21.15.17:6837/2711965846] conn(0x55f0a9ee6500 0x55f0a9ee68e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:41.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.240+0000 7fc250bcc740 1 --2- 172.21.15.17:0/2469724900 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0a9f209d0 0x55f0a9ef8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:41.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.240+0000 7fc250bcc740 1 --2- 172.21.15.17:0/2469724900 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55f0a9f1eff0 0x55f0a9eff790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:41.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.240+0000 7fc230c00640 0 client.5589 ms_handle_reset on v2:172.21.15.17:6836/2711965846 2024-03-12T17:20:41.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.240+0000 7fc250bcc740 1 --2- 172.21.15.17:0/2469724900 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f0a9ed5070 0x55f0a9ee4470 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:41.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.240+0000 7fc250bcc740 1 -- 172.21.15.17:0/2469724900 >> 172.21.15.17:0/2469724900 conn(0x55f0a9ed1510 msgr2=0x55f0a9ed05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:41.238 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.240+0000 7fc250bcc740 1 -- 172.21.15.17:0/2469724900 shutdown_connections 2024-03-12T17:20:41.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.240+0000 7fc250bcc740 1 -- 172.21.15.17:0/2469724900 wait complete. 2024-03-12T17:20:41.239 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.240+0000 7fc250bcc740 20 client.5589 trim_cache size 0 max 16384 2024-03-12T17:20:41.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.257+0000 7fc250bcc740 1 Processor -- start 2024-03-12T17:20:41.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.257+0000 7fc250bcc740 1 -- start start 2024-03-12T17:20:41.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.258+0000 7fc250bcc740 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55f0a9ed5070 0x55f0a9ef8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:41.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.258+0000 7fc250bcc740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0a9f1eff0 0x55f0a9ed1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:41.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.258+0000 7fc250bcc740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f0a9f209d0 0x55f0a9eff790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:41.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.258+0000 7fc250bcc740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0a9ba2f20 con 0x55f0a9f209d0 2024-03-12T17:20:41.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.258+0000 7fc250bcc740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0a9f1cdc0 con 0x55f0a9f1eff0 2024-03-12T17:20:41.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.258+0000 7fc250bcc740 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f0a9ed81f0 con 0x55f0a9ed5070 2024-03-12T17:20:41.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.258+0000 7fc247e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f0a9f209d0 0x55f0a9eff790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:41.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.258+0000 7fc247e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f0a9f209d0 0x55f0a9eff790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58814/0 (socket says 172.21.15.17:58814) 2024-03-12T17:20:41.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.258+0000 7fc247e00640 1 -- 172.21.15.17:0/995393859 learned_addr learned my addr 172.21.15.17:0/995393859 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:41.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.258+0000 7fc247400640 1 --2- 172.21.15.17:0/995393859 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55f0a9ed5070 0x55f0a9ef8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:41.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.258+0000 7fc246a00640 1 --2- 172.21.15.17:0/995393859 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0a9f1eff0 0x55f0a9ed1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:41.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.259+0000 7fc247e00640 1 -- 172.21.15.17:0/995393859 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55f0a9ed5070 msgr2=0x55f0a9ef8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:41.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.259+0000 7fc247e00640 1 --2- 172.21.15.17:0/995393859 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55f0a9ed5070 0x55f0a9ef8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:41.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.259+0000 7fc247e00640 1 -- 172.21.15.17:0/995393859 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0a9f1eff0 msgr2=0x55f0a9ed1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:41.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.259+0000 7fc247e00640 1 --2- 172.21.15.17:0/995393859 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0a9f1eff0 0x55f0a9ed1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:41.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.259+0000 7fc247e00640 1 -- 172.21.15.17:0/995393859 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0a9ddbad0 con 0x55f0a9f209d0 2024-03-12T17:20:41.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.259+0000 7fc247e00640 1 --2- 172.21.15.17:0/995393859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f0a9f209d0 0x55f0a9eff790 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc240054ef0 tx=0x7fc240054e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdd453ac06350a38 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:41.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.259+0000 7fc23cc00640 1 -- 172.21.15.17:0/995393859 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24005c820 con 0x55f0a9f209d0 2024-03-12T17:20:41.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.259+0000 7fc23cc00640 1 -- 172.21.15.17:0/995393859 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc240056d90 con 0x55f0a9f209d0 2024-03-12T17:20:41.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.259+0000 7fc23cc00640 1 -- 172.21.15.17:0/995393859 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc240055100 con 0x55f0a9f209d0 2024-03-12T17:20:41.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.260+0000 7fc250bcc740 1 -- 172.21.15.17:0/995393859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f0a9f209d0 msgr2=0x55f0a9eff790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:41.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.260+0000 7fc250bcc740 1 --2- 172.21.15.17:0/995393859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f0a9f209d0 0x55f0a9eff790 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc240054ef0 tx=0x7fc240054e60 comp rx=0 tx=0).stop 2024-03-12T17:20:41.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.260+0000 7fc250bcc740 1 -- 172.21.15.17:0/995393859 shutdown_connections 2024-03-12T17:20:41.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.260+0000 7fc250bcc740 1 --2- 172.21.15.17:0/995393859 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f0a9f209d0 0x55f0a9eff790 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:41.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.260+0000 7fc250bcc740 1 --2- 172.21.15.17:0/995393859 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0a9f1eff0 0x55f0a9ed1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:41.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.260+0000 7fc250bcc740 1 --2- 172.21.15.17:0/995393859 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55f0a9ed5070 0x55f0a9ef8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:41.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.260+0000 7fc250bcc740 1 -- 172.21.15.17:0/995393859 >> 172.21.15.17:0/995393859 conn(0x55f0a9ed1510 msgr2=0x55f0a9f21c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:41.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.260+0000 7fc250bcc740 1 -- 172.21.15.17:0/995393859 shutdown_connections 2024-03-12T17:20:41.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.260+0000 7fc250bcc740 1 -- 172.21.15.17:0/995393859 wait complete. 2024-03-12T17:20:41.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.261+0000 7fc250bcc740 1 -- start start 2024-03-12T17:20:41.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.261+0000 7fc250bcc740 1 Processor -- start 2024-03-12T17:20:41.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.262+0000 7fc250bcc740 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0a9ed5070 0x55f0a9f87660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:41.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.262+0000 7fc250bcc740 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f0a9f1eff0 0x55f0a9ef72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:41.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.262+0000 7fc250bcc740 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55f0a9f209d0 0x55f0a9ee4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:41.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.262+0000 7fc250bcc740 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0a9ed2530 con 0x55f0a9f1eff0 2024-03-12T17:20:41.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.262+0000 7fc250bcc740 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0a9ed2270 con 0x55f0a9ed5070 2024-03-12T17:20:41.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.262+0000 7fc250bcc740 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f0a9ef6a70 con 0x55f0a9f209d0 2024-03-12T17:20:41.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.262+0000 7fc250bcc740 10 client.0 _ll_register_callbacks cb 0x55f0a9f1cf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-12T17:20:41.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.262+0000 7fc246a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f0a9f1eff0 0x55f0a9ef72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:41.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.262+0000 7fc246a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f0a9f1eff0 0x55f0a9ef72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58818/0 (socket says 172.21.15.17:58818) 2024-03-12T17:20:41.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.262+0000 7fc246a00640 1 -- 172.21.15.17:0/2735543085 learned_addr learned my addr 172.21.15.17:0/2735543085 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:41.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.262+0000 7fc247400640 1 --2- 172.21.15.17:0/2735543085 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0a9ed5070 0x55f0a9f87660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:41.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.262+0000 7fc247e00640 1 --2- 172.21.15.17:0/2735543085 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55f0a9f209d0 0x55f0a9ee4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:41.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.263+0000 7fc246a00640 1 -- 172.21.15.17:0/2735543085 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55f0a9f209d0 msgr2=0x55f0a9ee4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:41.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.263+0000 7fc246a00640 1 --2- 172.21.15.17:0/2735543085 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55f0a9f209d0 0x55f0a9ee4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:41.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.263+0000 7fc246a00640 1 -- 172.21.15.17:0/2735543085 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0a9ed5070 msgr2=0x55f0a9f87660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:41.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.263+0000 7fc246a00640 1 --2- 172.21.15.17:0/2735543085 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0a9ed5070 0x55f0a9f87660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:41.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.263+0000 7fc246a00640 1 -- 172.21.15.17:0/2735543085 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f0a9e02780 con 0x55f0a9f1eff0 2024-03-12T17:20:41.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.263+0000 7fc247400640 1 --2- 172.21.15.17:0/2735543085 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0a9ed5070 0x55f0a9f87660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:20:41.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.263+0000 7fc246a00640 1 --2- 172.21.15.17:0/2735543085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f0a9f1eff0 0x55f0a9ef72a0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc234007e10 tx=0x7fc234001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4291242383a253 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:41.262 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.263+0000 7fc230c00640 10 client.0 ms_handle_connect on v2:172.21.15.17:3300/0 2024-03-12T17:20:41.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.263+0000 7fc230c00640 1 -- 172.21.15.17:0/2735543085 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc234021650 con 0x55f0a9f1eff0 2024-03-12T17:20:41.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.263+0000 7fc230c00640 1 -- 172.21.15.17:0/2735543085 <== mon.0 v2:172.21.15.17:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc23400c070 con 0x55f0a9f1eff0 2024-03-12T17:20:41.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.263+0000 7fc250bcc740 1 -- 172.21.15.17:0/2735543085 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc240060de0 con 0x55f0a9f1eff0 2024-03-12T17:20:41.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.263+0000 7fc230c00640 1 -- 172.21.15.17:0/2735543085 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2340217b0 con 0x55f0a9f1eff0 2024-03-12T17:20:41.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.263+0000 7fc250bcc740 10 client.5595 fetch_fsmap learned FSMap version 22 2024-03-12T17:20:41.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.263+0000 7fc250bcc740 1 -- 172.21.15.17:0/2735543085 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) v3 -- 0x55f0a9e00fe0 con 0x55f0a9f1eff0 2024-03-12T17:20:41.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.264+0000 7fc230c00640 1 -- 172.21.15.17:0/2735543085 <== mon.0 v2:172.21.15.17:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc240060de0 con 0x55f0a9f1eff0 2024-03-12T17:20:41.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.264+0000 7fc230c00640 1 -- 172.21.15.17:0/2735543085 <== mon.0 v2:172.21.15.17:3300/0 5 ==== fsmap(e 22) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fc234003aa0 con 0x55f0a9f1eff0 2024-03-12T17:20:41.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.264+0000 7fc250bcc740 10 client.5595 fetch_fsmap finished waiting for FSMap version 22 2024-03-12T17:20:41.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.264+0000 7fc250bcc740 10 client.5595 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-12T17:20:41.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.264+0000 7fc250bcc740 20 client.5595 populate_metadata read hostname 'smithi017' 2024-03-12T17:20:41.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.264+0000 7fc250bcc740 1 --2- 172.21.15.17:0/2735543085 >> [v2:172.21.15.17:6836/2711965846,v1:172.21.15.17:6837/2711965846] conn(0x55f0a9f029f0 0x55f0a9f02dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:41.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.264+0000 7fc250bcc740 4 client.5595 mds_command: new command op to 5433 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-12T17:20:41.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.264+0000 7fc250bcc740 1 -- 172.21.15.17:0/2735543085 --> [v2:172.21.15.17:6836/2711965846,v1:172.21.15.17:6837/2711965846] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f0a9b2f3c0 con 0x55f0a9f029f0 2024-03-12T17:20:41.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.264+0000 7fc247400640 1 --2- 172.21.15.17:0/2735543085 >> [v2:172.21.15.17:6836/2711965846,v1:172.21.15.17:6837/2711965846] conn(0x55f0a9f029f0 0x55f0a9f02dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:41.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.265+0000 7fc247400640 1 --2- 172.21.15.17:0/2735543085 >> [v2:172.21.15.17:6836/2711965846,v1:172.21.15.17:6837/2711965846] conn(0x55f0a9f029f0 0x55f0a9f02dd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54a70774711a229b server_cookie=75e4d2e2ac10dfcb in_seq=0 out_seq=0 2024-03-12T17:20:41.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.265+0000 7fc230c00640 10 client.5595 ms_handle_connect on v2:172.21.15.17:6836/2711965846 2024-03-12T17:20:41.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.265+0000 7fc230c00640 1 -- 172.21.15.17:0/2735543085 <== mds.0 v2:172.21.15.17:6836/2711965846 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55f0a9b2f3c0 con 0x55f0a9f029f0 2024-03-12T17:20:41.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.265+0000 7fc230c00640 10 client.5595 handle_command_reply: tid=0 2024-03-12T17:20:41.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.265+0000 7fc250bcc740 1 client.5595 shutdown 2024-03-12T17:20:41.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.265+0000 7fc250bcc740 1 -- 172.21.15.17:0/2735543085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f0a9f1eff0 msgr2=0x55f0a9ef72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:41.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.265+0000 7fc250bcc740 1 --2- 172.21.15.17:0/2735543085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f0a9f1eff0 0x55f0a9ef72a0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fc234007e10 tx=0x7fc234001ae0 comp rx=0 tx=0).stop 2024-03-12T17:20:41.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.265+0000 7fc250bcc740 1 -- 172.21.15.17:0/2735543085 shutdown_connections 2024-03-12T17:20:41.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.265+0000 7fc250bcc740 1 --2- 172.21.15.17:0/2735543085 >> [v2:172.21.15.17:6836/2711965846,v1:172.21.15.17:6837/2711965846] conn(0x55f0a9f029f0 0x55f0a9f02dd0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:41.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.265+0000 7fc250bcc740 1 --2- 172.21.15.17:0/2735543085 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x55f0a9f209d0 0x55f0a9ee4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:41.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.265+0000 7fc250bcc740 1 --2- 172.21.15.17:0/2735543085 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x55f0a9f1eff0 0x55f0a9ef72a0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:41.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.265+0000 7fc250bcc740 1 --2- 172.21.15.17:0/2735543085 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x55f0a9ed5070 0x55f0a9f87660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:41.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.265+0000 7fc250bcc740 1 -- 172.21.15.17:0/2735543085 >> 172.21.15.17:0/2735543085 conn(0x55f0a9ed1510 msgr2=0x55f0a9ed05d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:41.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.265+0000 7fc230c00640 0 client.5595 ms_handle_reset on v2:172.21.15.17:6836/2711965846 2024-03-12T17:20:41.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.266+0000 7fc250bcc740 1 -- 172.21.15.17:0/2735543085 shutdown_connections 2024-03-12T17:20:41.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.266+0000 7fc250bcc740 1 -- 172.21.15.17:0/2735543085 wait complete. 2024-03-12T17:20:41.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.266+0000 7fc250bcc740 20 client.5595 trim_cache size 0 max 16384 2024-03-12T17:20:41.265 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-12T17:20:41.265 INFO:teuthology.orchestra.run.smithi017.stdout: "cluster_fsid": "73425bc1-630f-4bd2-8abb-716ed5d8ca29", 2024-03-12T17:20:41.265 INFO:teuthology.orchestra.run.smithi017.stdout: "whoami": 0, 2024-03-12T17:20:41.265 INFO:teuthology.orchestra.run.smithi017.stdout: "id": 5433, 2024-03-12T17:20:41.265 INFO:teuthology.orchestra.run.smithi017.stdout: "want_state": "up:active", 2024-03-12T17:20:41.265 INFO:teuthology.orchestra.run.smithi017.stdout: "state": "up:active", 2024-03-12T17:20:41.265 INFO:teuthology.orchestra.run.smithi017.stdout: "fs_name": "cephfs", 2024-03-12T17:20:41.266 INFO:teuthology.orchestra.run.smithi017.stdout: "rank_uptime": 12.081833846, 2024-03-12T17:20:41.266 INFO:teuthology.orchestra.run.smithi017.stdout: "mdsmap_epoch": 22, 2024-03-12T17:20:41.266 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch": 47, 2024-03-12T17:20:41.266 INFO:teuthology.orchestra.run.smithi017.stdout: "osdmap_epoch_barrier": 47, 2024-03-12T17:20:41.266 INFO:teuthology.orchestra.run.smithi017.stdout: "uptime": 17.935947841000001 2024-03-12T17:20:41.266 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-12T17:20:41.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.266+0000 7fc24e000640 1 -- 172.21.15.17:0/1185815510 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc22806ac00 msgr2=0x7fc22806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:41.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.266+0000 7fc24e000640 1 --2- 172.21.15.17:0/1185815510 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc22806ac00 0x7fc22806d0c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc238035000 tx=0x7fc238008030 comp rx=0 tx=0).stop 2024-03-12T17:20:41.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.266+0000 7fc24e000640 1 -- 172.21.15.17:0/1185815510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc24815cdf0 msgr2=0x7fc24815f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:41.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.266+0000 7fc24e000640 1 --2- 172.21.15.17:0/1185815510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc24815cdf0 0x7fc24815f080 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fc2400018c0 tx=0x7fc24000a430 comp rx=0 tx=0).stop 2024-03-12T17:20:41.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.266+0000 7fc24e000640 1 -- 172.21.15.17:0/1185815510 shutdown_connections 2024-03-12T17:20:41.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.266+0000 7fc24e000640 1 --2- 172.21.15.17:0/1185815510 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc22806ac00 0x7fc22806d0c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:41.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.266+0000 7fc24e000640 1 --2- 172.21.15.17:0/1185815510 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc24815cdf0 0x7fc24815f080 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:41.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.266+0000 7fc24e000640 1 --2- 172.21.15.17:0/1185815510 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc24815ca10 0x7fc2481f2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:41.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.266+0000 7fc24e000640 1 --2- 172.21.15.17:0/1185815510 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc2480b2830 0x7fc248154060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:41.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.266+0000 7fc24e000640 1 -- 172.21.15.17:0/1185815510 >> 172.21.15.17:0/1185815510 conn(0x7fc248069ce0 msgr2=0x7fc248157290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:41.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.267+0000 7fc24e000640 1 -- 172.21.15.17:0/1185815510 shutdown_connections 2024-03-12T17:20:41.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.267+0000 7fc24e000640 1 -- 172.21.15.17:0/1185815510 wait complete. 2024-03-12T17:20:41.281 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-12T17:20:41.490 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.495+0000 7f0081400640 1 Processor -- start 2024-03-12T17:20:41.491 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.495+0000 7f0081400640 1 -- start start 2024-03-12T17:20:41.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.496+0000 7f0081400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f007c0ced90 0x7f007c0b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:41.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.496+0000 7f0081400640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f007c0b3950 0x7f007c0ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:41.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.496+0000 7f0081400640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f007c0cb340 con 0x7f007c06c3f0 2024-03-12T17:20:41.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.496+0000 7f0081400640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f007c159d50 con 0x7f007c0b3950 2024-03-12T17:20:41.492 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.496+0000 7f0081400640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007c0b1c50 con 0x7f007c0ced90 2024-03-12T17:20:41.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.497+0000 7f007b200640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f007c0b3950 0x7f007c0ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:41.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.497+0000 7f007a800640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f007c0ced90 0x7f007c0b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:41.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.497+0000 7f007a800640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f007c0ced90 0x7f007c0b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.17:56282/0 (socket says 172.21.15.17:56282) 2024-03-12T17:20:41.493 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.497+0000 7f007a800640 1 -- 172.21.15.17:0/4252254013 learned_addr learned my addr 172.21.15.17:0/4252254013 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:41.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.498+0000 7f007a800640 1 -- 172.21.15.17:0/4252254013 >> v2:172.21.15.94:3300/0 conn(0x7f007c0b3950 msgr2=0x7f007c0ccd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:20:41.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.498+0000 7f007a800640 1 --2- 172.21.15.17:0/4252254013 >> v2:172.21.15.94:3300/0 conn(0x7f007c0b3950 0x7f007c0ccd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:41.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.498+0000 7f007a800640 1 -- 172.21.15.17:0/4252254013 >> v1:172.21.15.94:6789/0 conn(0x7f007c06c3f0 legacy=0x7f007c0b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:41.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.498+0000 7f007a800640 1 -- 172.21.15.17:0/4252254013 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f007c0b1ef0 con 0x7f007c0ced90 2024-03-12T17:20:41.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.498+0000 7f007b200640 1 --2- 172.21.15.17:0/4252254013 >> v2:172.21.15.94:3300/0 conn(0x7f007c0b3950 0x7f007c0ccd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-12T17:20:41.494 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.499+0000 7f007a800640 1 --2- 172.21.15.17:0/4252254013 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f007c0ced90 0x7f007c0b1710 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f006c009870 tx=0x7f006c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ca846c0a4dafee7 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:41.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.500+0000 7f0079400640 1 -- 172.21.15.17:0/4252254013 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c030840 con 0x7f007c0ced90 2024-03-12T17:20:41.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.500+0000 7f0079400640 1 -- 172.21.15.17:0/4252254013 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006c0309a0 con 0x7f007c0ced90 2024-03-12T17:20:41.495 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.500+0000 7f0079400640 1 -- 172.21.15.17:0/4252254013 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c030d30 con 0x7f007c0ced90 2024-03-12T17:20:41.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.500+0000 7f0081400640 1 -- 172.21.15.17:0/4252254013 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f007c0ced90 msgr2=0x7f007c0b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:41.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.500+0000 7f0081400640 1 --2- 172.21.15.17:0/4252254013 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f007c0ced90 0x7f007c0b1710 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f006c009870 tx=0x7f006c02b980 comp rx=0 tx=0).stop 2024-03-12T17:20:41.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.501+0000 7f0081400640 1 -- 172.21.15.17:0/4252254013 shutdown_connections 2024-03-12T17:20:41.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.501+0000 7f0081400640 1 --2- 172.21.15.17:0/4252254013 >> v2:172.21.15.94:3300/0 conn(0x7f007c0b3950 0x7f007c0ccd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:41.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.501+0000 7f0081400640 1 --2- 172.21.15.17:0/4252254013 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f007c0ced90 0x7f007c0b1710 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:41.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.501+0000 7f0081400640 1 -- 172.21.15.17:0/4252254013 >> 172.21.15.17:0/4252254013 conn(0x7f007c069ce0 msgr2=0x7f007c06a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:41.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.501+0000 7f0081400640 1 -- 172.21.15.17:0/4252254013 shutdown_connections 2024-03-12T17:20:41.496 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.501+0000 7f0081400640 1 -- 172.21.15.17:0/4252254013 wait complete. 2024-03-12T17:20:41.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.502+0000 7f0081400640 1 Processor -- start 2024-03-12T17:20:41.497 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.503+0000 7f0081400640 1 -- start start 2024-03-12T17:20:41.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.503+0000 7f0081400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f007c06c3f0 0x7f007c145ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:41.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.503+0000 7f0081400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f007c0b3950 0x7f007c15a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:41.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.503+0000 7f0081400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f007c0ced90 0x7f007c15ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:41.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.503+0000 7f0081400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007c156b40 con 0x7f007c0b3950 2024-03-12T17:20:41.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.503+0000 7f0081400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007c156e20 con 0x7f007c06c3f0 2024-03-12T17:20:41.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.503+0000 7f0081400640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007c157100 con 0x7f007c0ced90 2024-03-12T17:20:41.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.504+0000 7f0079e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f007c0b3950 0x7f007c15a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:41.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.504+0000 7f0079e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f007c0b3950 0x7f007c15a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58828/0 (socket says 172.21.15.17:58828) 2024-03-12T17:20:41.499 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.504+0000 7f0079e00640 1 -- 172.21.15.17:0/555663017 learned_addr learned my addr 172.21.15.17:0/555663017 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:20:41.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.504+0000 7f007a800640 1 --2- 172.21.15.17:0/555663017 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f007c06c3f0 0x7f007c145ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:41.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.504+0000 7f007b200640 1 --2- 172.21.15.17:0/555663017 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f007c0ced90 0x7f007c15ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.504+0000 7f0079e00640 1 -- 172.21.15.17:0/555663017 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f007c0ced90 msgr2=0x7f007c15ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.504+0000 7f0079e00640 1 --2- 172.21.15.17:0/555663017 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f007c0ced90 0x7f007c15ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.504+0000 7f0079e00640 1 -- 172.21.15.17:0/555663017 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f007c06c3f0 msgr2=0x7f007c145ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.504+0000 7f0079e00640 1 --2- 172.21.15.17:0/555663017 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f007c06c3f0 0x7f007c145ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.504+0000 7f0079e00640 1 -- 172.21.15.17:0/555663017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0074009a70 con 0x7f007c0b3950 2024-03-12T17:20:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.505+0000 7f0079e00640 1 --2- 172.21.15.17:0/555663017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f007c0b3950 0x7f007c15a8f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f006800c3c0 tx=0x7f006800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.505+0000 7f0072a00640 1 -- 172.21.15.17:0/555663017 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00680052d0 con 0x7f007c0b3950 2024-03-12T17:20:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.505+0000 7f0072a00640 1 -- 172.21.15.17:0/555663017 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0068005450 con 0x7f007c0b3950 2024-03-12T17:20:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.505+0000 7f0072a00640 1 -- 172.21.15.17:0/555663017 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0068007260 con 0x7f007c0b3950 2024-03-12T17:20:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.505+0000 7f0081400640 1 -- 172.21.15.17:0/555663017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f006c0094d0 con 0x7f007c0b3950 2024-03-12T17:20:41.501 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.505+0000 7f0081400640 1 -- 172.21.15.17:0/555663017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f007c1576c0 con 0x7f007c0b3950 2024-03-12T17:20:41.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.506+0000 7f0081400640 1 -- 172.21.15.17:0/555663017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f007c0736c0 con 0x7f007c0b3950 2024-03-12T17:20:41.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.507+0000 7f0072a00640 1 -- 172.21.15.17:0/555663017 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f00680073c0 con 0x7f007c0b3950 2024-03-12T17:20:41.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.509+0000 7f0072a00640 1 --2- 172.21.15.17:0/555663017 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f005c06ac00 0x7f005c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:20:41.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.509+0000 7f0072a00640 1 -- 172.21.15.17:0/555663017 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0068088840 con 0x7f007c0b3950 2024-03-12T17:20:41.504 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.509+0000 7f007a800640 1 --2- 172.21.15.17:0/555663017 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f005c06ac00 0x7f005c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:20:41.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.510+0000 7f007a800640 1 --2- 172.21.15.17:0/555663017 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f005c06ac00 0x7f005c06d0c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f006c009870 tx=0x7f006c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:20:41.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.514+0000 7f0072a00640 1 -- 172.21.15.17:0/555663017 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f00680538f0 con 0x7f007c0b3950 2024-03-12T17:20:41.749 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.754+0000 7f0081400640 1 -- 172.21.15.17:0/555663017 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f007c06dc10 con 0x7f007c0b3950 2024-03-12T17:20:41.750 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.755+0000 7f0072a00640 1 -- 172.21.15.17:0/555663017 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0068056f10 con 0x7f007c0b3950 2024-03-12T17:20:41.750 INFO:teuthology.orchestra.run.smithi017.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-12T17:20:41.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.758+0000 7f0081400640 1 -- 172.21.15.17:0/555663017 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f005c06ac00 msgr2=0x7f005c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:41.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.758+0000 7f0081400640 1 --2- 172.21.15.17:0/555663017 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f005c06ac00 0x7f005c06d0c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f006c009870 tx=0x7f006c008030 comp rx=0 tx=0).stop 2024-03-12T17:20:41.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.758+0000 7f0081400640 1 -- 172.21.15.17:0/555663017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f007c0b3950 msgr2=0x7f007c15a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:20:41.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.758+0000 7f0081400640 1 --2- 172.21.15.17:0/555663017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f007c0b3950 0x7f007c15a8f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f006800c3c0 tx=0x7f006800c880 comp rx=0 tx=0).stop 2024-03-12T17:20:41.753 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.758+0000 7f0081400640 1 -- 172.21.15.17:0/555663017 shutdown_connections 2024-03-12T17:20:41.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.758+0000 7f0081400640 1 --2- 172.21.15.17:0/555663017 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f005c06ac00 0x7f005c06d0c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:41.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.758+0000 7f0081400640 1 --2- 172.21.15.17:0/555663017 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f007c0ced90 0x7f007c15ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:41.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.758+0000 7f0081400640 1 --2- 172.21.15.17:0/555663017 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f007c0b3950 0x7f007c15a8f0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:41.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.758+0000 7f0081400640 1 --2- 172.21.15.17:0/555663017 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f007c06c3f0 0x7f007c145ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:20:41.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.758+0000 7f0081400640 1 -- 172.21.15.17:0/555663017 >> 172.21.15.17:0/555663017 conn(0x7f007c069ce0 msgr2=0x7f007c0abc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:20:41.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.758+0000 7f0081400640 1 -- 172.21.15.17:0/555663017 shutdown_connections 2024-03-12T17:20:41.754 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:20:41.758+0000 7f0081400640 1 -- 172.21.15.17:0/555663017 wait complete. 2024-03-12T17:20:41.774 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-03-12T17:20:41.774 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-12T17:20:41.774 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi017.front.sepia.ceph.com 2024-03-12T17:20:41.774 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-12T17:20:41.774 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-12T17:20:41.774 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-03-12T17:20:41.774 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-03-12T17:20:41.774 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-12T17:20:41.774 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-12T17:20:41.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:20:41.775 DEBUG:teuthology.orchestra.run.smithi017:> ip addr 2024-03-12T17:20:41.826 INFO:teuthology.orchestra.run.smithi017.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-12T17:20:41.826 INFO:teuthology.orchestra.run.smithi017.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-12T17:20:41.827 INFO:teuthology.orchestra.run.smithi017.stdout: inet 127.0.0.1/8 scope host lo 2024-03-12T17:20:41.827 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:20:41.827 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 ::1/128 scope host 2024-03-12T17:20:41.827 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:20:41.827 INFO:teuthology.orchestra.run.smithi017.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-12T17:20:41.827 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:00 brd ff:ff:ff:ff:ff:ff 2024-03-12T17:20:41.827 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f0 2024-03-12T17:20:41.827 INFO:teuthology.orchestra.run.smithi017.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-12T17:20:41.827 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:6b:fe:01 brd ff:ff:ff:ff:ff:ff 2024-03-12T17:20:41.827 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp7s0f1 2024-03-12T17:20:41.827 INFO:teuthology.orchestra.run.smithi017.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-12T17:20:41.827 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:92 brd ff:ff:ff:ff:ff:ff 2024-03-12T17:20:41.827 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f0 2024-03-12T17:20:41.827 INFO:teuthology.orchestra.run.smithi017.stdout: inet 172.21.15.17/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-12T17:20:41.828 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft 42469sec preferred_lft 42469sec 2024-03-12T17:20:41.828 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::ec4:7aff:fe59:d992/64 scope link noprefixroute 2024-03-12T17:20:41.828 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:20:41.828 INFO:teuthology.orchestra.run.smithi017.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-12T17:20:41.828 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 0c:c4:7a:59:d9:93 brd ff:ff:ff:ff:ff:ff 2024-03-12T17:20:41.828 INFO:teuthology.orchestra.run.smithi017.stdout: altname enp1s0f1 2024-03-12T17:20:41.828 INFO:teuthology.orchestra.run.smithi017.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-12T17:20:41.828 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 92:1b:ce:ee:d8:f5 brd ff:ff:ff:ff:ff:ff 2024-03-12T17:20:41.828 INFO:teuthology.orchestra.run.smithi017.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-12T17:20:41.828 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:20:41.828 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::2494:13ff:fe8b:62c9/64 scope link 2024-03-12T17:20:41.828 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:20:41.828 INFO:teuthology.orchestra.run.smithi017.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-12T17:20:41.828 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether ea:df:37:d7:69:8a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-12T17:20:41.828 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::e8df:37ff:fed7:698a/64 scope link 2024-03-12T17:20:41.828 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:20:41.829 INFO:teuthology.orchestra.run.smithi017.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-12T17:20:41.829 INFO:teuthology.orchestra.run.smithi017.stdout: link/ether 92:1b:ce:ee:d8:f5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-12T17:20:41.829 INFO:teuthology.orchestra.run.smithi017.stdout: inet6 fe80::901b:ceff:feee:d8f5/64 scope link 2024-03-12T17:20:41.829 INFO:teuthology.orchestra.run.smithi017.stdout: valid_lft forever preferred_lft forever 2024-03-12T17:20:41.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:20:41.830 DEBUG:teuthology.orchestra.run.smithi017:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-12T17:20:41.916 INFO:teuthology.orchestra.run.smithi017.stdout:1 2024-03-12T17:20:41.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:20:41.920 DEBUG:teuthology.orchestra.run.smithi017:> route 2024-03-12T17:20:41.974 INFO:teuthology.orchestra.run.smithi017.stdout:Kernel IP routing table 2024-03-12T17:20:41.974 INFO:teuthology.orchestra.run.smithi017.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-12T17:20:41.974 INFO:teuthology.orchestra.run.smithi017.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-12T17:20:41.974 INFO:teuthology.orchestra.run.smithi017.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-12T17:20:41.974 INFO:teuthology.orchestra.run.smithi017.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-12T17:20:41.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:20:41.975 DEBUG:teuthology.orchestra.run.smithi017:> (cd / && exec bash -c ' 2024-03-12T17:20:41.975 DEBUG:teuthology.orchestra.run.smithi017:> set -e 2024-03-12T17:20:41.975 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-12T17:20:41.975 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-12T17:20:41.975 DEBUG:teuthology.orchestra.run.smithi017:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-12T17:20:41.975 DEBUG:teuthology.orchestra.run.smithi017:> ') 2024-03-12T17:20:42.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:20:42.172 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-03-12T17:20:42.226 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-12T17:20:42.227 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-12T17:20:42.227 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-12T17:20:42.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:20:42.228 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link set brx.0 up 2024-03-12T17:20:42.329 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-12T17:20:42.329 DEBUG:teuthology.orchestra.run.smithi017:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-12T17:20:42.384 INFO:teuthology.orchestra.run.smithi017.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-12T17:20:42.385 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-12T17:20:42.385 DEBUG:teuthology.orchestra.run.smithi017:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-12T17:20:42.438 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-03-12T17:20:42.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:20:42.438 DEBUG:teuthology.orchestra.run.smithi017:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-12T17:20:42.587 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-12T17:20:42.587 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-12T17:20:42.620 INFO:teuthology.orchestra.run.smithi017.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-12T17:20:42.621 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-12T17:20:42.621 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: resolved to: "172.21.15.17:3300,172.21.15.94:3300,172.21.15.94:3301" 2024-03-12T17:20:42.621 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: trying mount with new device syntax: 0@73425bc1-630f-4bd2-8abb-716ed5d8ca29.cephfs=/ 2024-03-12T17:20:42.621 INFO:teuthology.orchestra.run.smithi017.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.17:3300/172.21.15.94:3300/172.21.15.94:3301" will pass to kernel 2024-03-12T17:20:42.622 INFO:teuthology.orchestra.run.smithi017.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-03-12T17:20:42.623 INFO:teuthology.orchestra.run.smithi017.stdout: You just mounted a file system that supports labels which does not 2024-03-12T17:20:42.623 INFO:teuthology.orchestra.run.smithi017.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-12T17:20:42.623 INFO:teuthology.orchestra.run.smithi017.stdout: applications will generate AVC messages and not be allowed access to 2024-03-12T17:20:42.623 INFO:teuthology.orchestra.run.smithi017.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-12T17:20:42.627 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-12T17:20:42.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:20:42.627 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-12T17:20:42.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:20:42.718 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-12T17:20:42.790 INFO:teuthology.orchestra.run.smithi017.stdout:client5601 2024-03-12T17:20:42.791 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:20:42.791 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-12T17:20:42.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:20:42.846 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://github.com/ceph/ceph-qa-suite) 2024-03-12T17:20:42.918 INFO:teuthology.orchestra.run.smithi017.stderr:Cloning into 'ceph-qa-suite'... 2024-03-12T17:20:51.681 INFO:teuthology.orchestra.run.smithi017.stderr:Updating files: 21% (294/1396) Updating files: 22% (308/1396) Updating files: 23% (322/1396) Updating files: 24% (336/1396) Updating files: 25% (349/1396) Updating files: 26% (363/1396) Updating files: 27% (377/1396) Updating files: 28% (391/1396) Updating files: 29% (405/1396) Updating files: 30% (419/1396) Updating files: 31% (433/1396) Updating files: 32% (447/1396) Updating files: 33% (461/1396) Updating files: 34% (475/1396) Updating files: 35% (489/1396) Updating files: 36% (503/1396) Updating files: 37% (517/1396) Updating files: 38% (531/1396) Updating files: 39% (545/1396) Updating files: 39% (546/1396) Updating files: 40% (559/1396) Updating files: 41% (573/1396) Updating files: 42% (587/1396) Updating files: 43% (601/1396) Updating files: 44% (615/1396) Updating files: 45% (629/1396) Updating files: 46% (643/1396) Updating files: 47% (657/1396) Updating files: 48% (671/1396) Updating files: 49% (685/1396) Updating files: 50% (698/1396) Updating files: 51% (712/1396) Updating files: 52% (726/1396) Updating files: 53% (740/1396) Updating files: 54% (754/1396) Updating files: 55% (768/1396) Updating files: 56% (782/1396) Updating files: 57% (796/1396) Updating files: 58% (810/1396) Updating files: 59% (824/1396) Updating files: 60% (838/1396) Updating files: 61% (852/1396) Updating files: 62% (866/1396) Updating files: 63% (880/1396) Updating files: 64% (894/1396) Updating files: 65% (908/1396) Updating files: 66% (922/1396) Updating files: 67% (936/1396) Updating files: 68% (950/1396) Updating files: 69% (964/1396) Updating files: 70% (978/1396) Updating files: 71% (992/1396) Updating files: 72% (1006/1396) Updating files: 72% (1014/1396) Updating files: 73% (1020/1396) Updating files: 74% (1034/1396) Updating files: 75% (1047/1396) Updating files: 76% (1061/1396) Updating files: 77% (1075/1396) Updating files: 78% (1089/1396) Updating files: 79% (1103/1396) Updating files: 80% (1117/1396) Updating files: 81% (1131/1396) Updating files: 82% (1145/1396) Updating files: 83% (1159/1396) Updating files: 84% (1173/1396) Updating files: 85% (1187/1396) Updating files: 86% (1201/1396) Updating files: 87% (1215/1396) Updating files: 88% (1229/1396) Updating files: 89% (1243/1396) Updating files: 90% (1257/1396) Updating files: 90% (1265/1396) Updating files: 91% (1271/1396) Updating files: 92% (1285/1396) Updating files: 93% (1299/1396) Updating files: 94% (1313/1396) Updating files: 95% (1327/1396) Updating files: 96% (1341/1396) Updating files: 97% (1355/1396) Updating files: 98% (1369/1396) Updating files: 99% (1383/1396) Updating files: 100% (1396/1396) Updating files: 100% (1396/1396), done. 2024-03-12T17:20:51.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:20:51.695 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-03-12T17:20:52.116 INFO:teuthology.orchestra.run.smithi017.stdout:./ 2024-03-12T17:20:52.117 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite 2024-03-12T17:20:52.117 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/erasure-code 2024-03-12T17:20:52.117 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/erasure-code/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml 2024-03-12T17:20:52.117 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/erasure-code/ec-rados-plugin=jerasure-k=3-m=1.yaml 2024-03-12T17:20:52.117 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/erasure-code/ec-rados-plugin=isa-k=2-m=1.yaml 2024-03-12T17:20:52.117 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/erasure-code/ec-rados-plugin=jerasure-k=2-m=1.yaml 2024-03-12T17:20:52.117 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/erasure-code/ec-rados-plugin=shec-k=4-m=3-c=2.yaml 2024-03-12T17:20:52.117 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/erasure-code/ec-feature-plugins-v3.yaml 2024-03-12T17:20:52.117 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/erasure-code/ec-rados-default.yaml 2024-03-12T17:20:52.117 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/erasure-code/ec-rados-sequential.yaml 2024-03-12T17:20:52.117 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/erasure-code/ec-rados-parallel.yaml 2024-03-12T17:20:52.117 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/erasure-code/ec-feature-plugins-v2.yaml 2024-03-12T17:20:52.117 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/releases 2024-03-12T17:20:52.117 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/releases/jewel.yaml 2024-03-12T17:20:52.118 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/releases/kraken.yaml 2024-03-12T17:20:52.118 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/releases/infernalis.yaml 2024-03-12T17:20:52.118 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tox.ini 2024-03-12T17:20:52.118 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/ceph-deploy-overrides 2024-03-12T17:20:52.118 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/ceph-deploy-overrides/enable_dmcrypt_diff_journal_disk.yaml 2024-03-12T17:20:52.118 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/ceph-deploy-overrides/ceph_deploy_dmcrypt.yaml 2024-03-12T17:20:52.118 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/ceph-deploy-overrides/enable_diff_journal_disk.yaml 2024-03-12T17:20:52.118 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/ceph-deploy-overrides/disable_diff_journal_disk.yaml 2024-03-12T17:20:52.118 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/nightlies 2024-03-12T17:20:52.118 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/nightlies/cron_wrapper 2024-03-12T17:20:52.118 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/overrides 2024-03-12T17:20:52.118 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/overrides/3-size-2-min-size.yaml 2024-03-12T17:20:52.118 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/overrides/whitelist_wrongly_marked_down.yaml 2024-03-12T17:20:52.118 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/overrides/2-size-2-min-size.yaml 2024-03-12T17:20:52.118 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/overrides/2-size-1-min-size.yaml 2024-03-12T17:20:52.119 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/overrides/short_pg_log.yaml 2024-03-12T17:20:52.119 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/packages 2024-03-12T17:20:52.119 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/packages/packages.yaml 2024-03-12T17:20:52.119 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/clusters 2024-03-12T17:20:52.119 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/clusters/extra-client.yaml 2024-03-12T17:20:52.119 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/clusters/fixed-2.yaml 2024-03-12T17:20:52.119 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/clusters/fixed-3.yaml 2024-03-12T17:20:52.119 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/clusters/fixed-3-cephfs.yaml 2024-03-12T17:20:52.119 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/clusters/fixed-4.yaml 2024-03-12T17:20:52.119 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/clusters/fixed-1.yaml 2024-03-12T17:20:52.119 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/cephfs 2024-03-12T17:20:52.119 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/cephfs/overrides 2024-03-12T17:20:52.119 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/cephfs/overrides/whitelist_wrongly_marked_down.yaml 2024-03-12T17:20:52.119 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/cephfs/overrides/debug.yaml 2024-03-12T17:20:52.120 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/cephfs/overrides/fuse 2024-03-12T17:20:52.120 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/cephfs/overrides/fuse/default-perm 2024-03-12T17:20:52.120 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/cephfs/overrides/fuse/default-perm/yes.yaml 2024-03-12T17:20:52.120 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/cephfs/overrides/fuse/default-perm/no.yaml 2024-03-12T17:20:52.120 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/cephfs/overrides/fuse/default-perm/% 2024-03-12T17:20:52.120 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/cephfs/overrides/frag_enable.yaml 2024-03-12T17:20:52.120 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/cephfs/clusters 2024-03-12T17:20:52.120 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/cephfs/clusters/9-mds.yaml 2024-03-12T17:20:52.120 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/cephfs/clusters/3-mds.yaml 2024-03-12T17:20:52.120 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/cephfs/clusters/fixed-2-ucephfs.yaml 2024-03-12T17:20:52.120 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/cephfs/mount 2024-03-12T17:20:52.120 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/cephfs/mount/kclient.yaml 2024-03-12T17:20:52.120 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/cephfs/mount/fuse.yaml 2024-03-12T17:20:52.120 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/cephfs/begin.yaml 2024-03-12T17:20:52.121 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/cephfs/tasks 2024-03-12T17:20:52.121 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/cephfs/tasks/libcephfs_interface_tests.yaml 2024-03-12T17:20:52.121 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/cephfs/tasks/cfuse_workunit_trivial_sync.yaml 2024-03-12T17:20:52.121 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/cephfs/tasks/cfuse_workunit_suites_ffsb.yaml 2024-03-12T17:20:52.121 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/cephfs/tasks/cfuse_workunit_suites_blogbench.yaml 2024-03-12T17:20:52.121 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/cephfs/tasks/cfuse_workunit_suites_fsstress.yaml 2024-03-12T17:20:52.121 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/cephfs/tasks/cfuse_workunit_suites_dbench.yaml 2024-03-12T17:20:52.122 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/objectstore 2024-03-12T17:20:52.122 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/objectstore/bluestore.yaml 2024-03-12T17:20:52.122 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/objectstore/filestore.yaml 2024-03-12T17:20:52.122 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/config 2024-03-12T17:20:52.122 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/config/rados.yaml 2024-03-12T17:20:52.123 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/archs 2024-03-12T17:20:52.123 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/archs/armv7.yaml 2024-03-12T17:20:52.123 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/archs/i686.yaml 2024-03-12T17:20:52.123 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/archs/aarch64.yaml 2024-03-12T17:20:52.123 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/archs/x86_64.yaml 2024-03-12T17:20:52.123 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/fs 2024-03-12T17:20:52.123 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/fs/btrfs.yaml 2024-03-12T17:20:52.123 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/fs/xfs.yaml 2024-03-12T17:20:52.123 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/fs/ext4.yaml 2024-03-12T17:20:52.123 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/rgw_pool_type 2024-03-12T17:20:52.123 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/rgw_pool_type/ec-profile.yaml 2024-03-12T17:20:52.123 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/rgw_pool_type/ec.yaml 2024-03-12T17:20:52.123 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/rgw_pool_type/ec-cache.yaml 2024-03-12T17:20:52.123 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/rgw_pool_type/replicated.yaml 2024-03-12T17:20:52.124 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git 2024-03-12T17:20:52.124 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/HEAD 2024-03-12T17:20:52.124 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/description 2024-03-12T17:20:52.124 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/index 2024-03-12T17:20:52.124 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/objects 2024-03-12T17:20:52.124 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/objects/info 2024-03-12T17:20:52.124 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/objects/pack 2024-03-12T17:20:52.124 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/objects/pack/pack-ac547ca4f300164f23b0bf1b8b1e66d5a7352309.idx 2024-03-12T17:20:52.124 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/objects/pack/pack-ac547ca4f300164f23b0bf1b8b1e66d5a7352309.pack 2024-03-12T17:20:52.124 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/hooks 2024-03-12T17:20:52.124 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/hooks/pre-merge-commit.sample 2024-03-12T17:20:52.170 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/hooks/pre-commit.sample 2024-03-12T17:20:52.170 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/hooks/fsmonitor-watchman.sample 2024-03-12T17:20:52.170 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/hooks/commit-msg.sample 2024-03-12T17:20:52.170 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/hooks/pre-rebase.sample 2024-03-12T17:20:52.170 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/hooks/pre-receive.sample 2024-03-12T17:20:52.170 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/hooks/prepare-commit-msg.sample 2024-03-12T17:20:52.170 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/hooks/update.sample 2024-03-12T17:20:52.170 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/hooks/pre-push.sample 2024-03-12T17:20:52.170 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/hooks/pre-applypatch.sample 2024-03-12T17:20:52.170 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/hooks/push-to-checkout.sample 2024-03-12T17:20:52.171 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/hooks/post-update.sample 2024-03-12T17:20:52.171 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/hooks/applypatch-msg.sample 2024-03-12T17:20:52.171 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/logs 2024-03-12T17:20:52.171 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/logs/HEAD 2024-03-12T17:20:52.171 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/logs/refs 2024-03-12T17:20:52.171 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/logs/refs/heads 2024-03-12T17:20:52.171 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/logs/refs/heads/master 2024-03-12T17:20:52.171 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/logs/refs/remotes 2024-03-12T17:20:52.171 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/logs/refs/remotes/origin 2024-03-12T17:20:52.171 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/logs/refs/remotes/origin/HEAD 2024-03-12T17:20:52.171 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/packed-refs 2024-03-12T17:20:52.171 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/config 2024-03-12T17:20:52.171 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/info 2024-03-12T17:20:52.171 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/info/exclude 2024-03-12T17:20:52.171 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/refs 2024-03-12T17:20:52.172 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/refs/tags 2024-03-12T17:20:52.172 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/refs/heads 2024-03-12T17:20:52.172 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/refs/heads/master 2024-03-12T17:20:52.172 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/refs/remotes 2024-03-12T17:20:52.172 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/refs/remotes/origin 2024-03-12T17:20:52.172 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/refs/remotes/origin/HEAD 2024-03-12T17:20:52.172 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.git/branches 2024-03-12T17:20:52.172 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/config_options 2024-03-12T17:20:52.172 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/config_options/cephdeploy_conf.yaml 2024-03-12T17:20:52.172 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/distros 2024-03-12T17:20:52.172 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/distros/a-supported-distro.yaml 2024-03-12T17:20:52.172 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/distros/supported 2024-03-12T17:20:52.172 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/distros/supported/ubuntu_16.04.yaml 2024-03-12T17:20:52.172 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/distros/supported/centos_7.2.yaml 2024-03-12T17:20:52.172 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/distros/supported/ubuntu_14.04.yaml 2024-03-12T17:20:52.173 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/distros/all 2024-03-12T17:20:52.173 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/distros/all/fedora_17.yaml 2024-03-12T17:20:52.173 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/distros/all/centos_6.4.yaml 2024-03-12T17:20:52.173 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/distros/all/debian_7.0.yaml 2024-03-12T17:20:52.173 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/distros/all/debian_6.0.yaml 2024-03-12T17:20:52.173 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/distros/all/fedora_19.yaml 2024-03-12T17:20:52.173 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/distros/all/ubuntu_16.04.yaml 2024-03-12T17:20:52.173 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/distros/all/opensuse_13.2.yaml 2024-03-12T17:20:52.173 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/distros/all/opensuse_12.2.yaml 2024-03-12T17:20:52.173 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/distros/all/rhel_6.3.yaml 2024-03-12T17:20:52.173 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/distros/all/sles_11-sp2.yaml 2024-03-12T17:20:52.173 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/distros/all/centos_7.2.yaml 2024-03-12T17:20:52.173 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/distros/all/rhel_6.4.yaml 2024-03-12T17:20:52.173 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/distros/all/centos_7.0.yaml 2024-03-12T17:20:52.173 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/distros/all/ubuntu_14.04_i686.yaml 2024-03-12T17:20:52.174 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/distros/all/opensuse_42.1.yaml 2024-03-12T17:20:52.174 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/distros/all/debian_8.0.yaml 2024-03-12T17:20:52.174 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/distros/all/fedora_18.yaml 2024-03-12T17:20:52.174 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/distros/all/rhel_7.0.yaml 2024-03-12T17:20:52.174 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/distros/all/ubuntu_14.04.yaml 2024-03-12T17:20:52.174 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/distros/all/centos_7.1.yaml 2024-03-12T17:20:52.174 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/distros/all/ubuntu_12.10.yaml 2024-03-12T17:20:52.174 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/distros/all/ubuntu_12.04.yaml 2024-03-12T17:20:52.174 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/distros/all/centos_6.3.yaml 2024-03-12T17:20:52.174 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/distros/all/rhel_6.5.yaml 2024-03-12T17:20:52.174 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/distros/all/ubuntu_14.04_aarch64.yaml 2024-03-12T17:20:52.174 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/distros/all/centos_6.5.yaml 2024-03-12T17:20:52.174 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites 2024-03-12T17:20:52.174 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/stress 2024-03-12T17:20:52.175 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/stress/bench 2024-03-12T17:20:52.175 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/stress/bench/clusters 2024-03-12T17:20:52.175 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/stress/bench/clusters/fixed-3-cephfs.yaml 2024-03-12T17:20:52.175 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/stress/bench/% 2024-03-12T17:20:52.175 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/stress/bench/tasks 2024-03-12T17:20:52.175 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/stress/bench/tasks/kclient_workunit_suites_fsx.yaml 2024-03-12T17:20:52.175 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/stress/bench/tasks/cfuse_workunit_snaps.yaml 2024-03-12T17:20:52.175 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/stress/thrash 2024-03-12T17:20:52.175 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/stress/thrash/clusters 2024-03-12T17:20:52.175 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/stress/thrash/clusters/16-osd.yaml 2024-03-12T17:20:52.175 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/stress/thrash/clusters/3-osd-1-machine.yaml 2024-03-12T17:20:52.175 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/stress/thrash/clusters/8-osd.yaml 2024-03-12T17:20:52.175 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/stress/thrash/fs 2024-03-12T17:20:52.175 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/stress/thrash/fs/none.yaml 2024-03-12T17:20:52.176 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/stress/thrash/fs/btrfs.yaml 2024-03-12T17:20:52.176 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/stress/thrash/fs/xfs.yaml 2024-03-12T17:20:52.176 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/stress/thrash/workloads 2024-03-12T17:20:52.176 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/stress/thrash/workloads/readwrite.yaml 2024-03-12T17:20:52.176 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/stress/thrash/workloads/radosbench.yaml 2024-03-12T17:20:52.176 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/stress/thrash/workloads/iozone_cfuse.yaml 2024-03-12T17:20:52.176 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/stress/thrash/workloads/bonnie_cfuse.yaml 2024-03-12T17:20:52.176 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/stress/thrash/% 2024-03-12T17:20:52.176 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/stress/thrash/thrashers 2024-03-12T17:20:52.222 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/stress/thrash/thrashers/default.yaml 2024-03-12T17:20:52.222 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/stress/thrash/thrashers/more-down.yaml 2024-03-12T17:20:52.222 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/stress/thrash/thrashers/fast.yaml 2024-03-12T17:20:52.222 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/mgr 2024-03-12T17:20:52.222 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/mgr/basic 2024-03-12T17:20:52.222 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/mgr/basic/clusters 2024-03-12T17:20:52.223 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/mgr/basic/clusters/2-node-mgr.yaml 2024-03-12T17:20:52.223 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/mgr/basic/fs 2024-03-12T17:20:52.223 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/mgr/basic/fs/xfs.yaml 2024-03-12T17:20:52.223 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/mgr/basic/% 2024-03-12T17:20:52.223 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/mgr/basic/tasks 2024-03-12T17:20:52.223 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/mgr/basic/tasks/failover.yaml 2024-03-12T17:20:52.223 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/mgr/basic/debug 2024-03-12T17:20:52.223 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/mgr/basic/debug/mgr.yaml 2024-03-12T17:20:52.223 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/powercycle 2024-03-12T17:20:52.223 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/powercycle/osd 2024-03-12T17:20:52.223 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/powercycle/osd/powercycle 2024-03-12T17:20:52.223 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/powercycle/osd/powercycle/default.yaml 2024-03-12T17:20:52.223 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/powercycle/osd/clusters 2024-03-12T17:20:52.224 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/powercycle/osd/clusters/3osd-1per-target.yaml 2024-03-12T17:20:52.224 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/powercycle/osd/objectstore 2024-03-12T17:20:52.224 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/powercycle/osd/fs 2024-03-12T17:20:52.224 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/powercycle/osd/fs/btrfs.yaml 2024-03-12T17:20:52.224 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/powercycle/osd/fs/xfs.yaml 2024-03-12T17:20:52.225 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/powercycle/osd/% 2024-03-12T17:20:52.225 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks 2024-03-12T17:20:52.225 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/readwrite.yaml 2024-03-12T17:20:52.225 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_suites_fsync.yaml 2024-03-12T17:20:52.225 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/radosbench.yaml 2024-03-12T17:20:52.225 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_suites_pjd.yaml 2024-03-12T17:20:52.225 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_suites_ffsb.yaml 2024-03-12T17:20:52.225 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_suites_fsx.yaml 2024-03-12T17:20:52.225 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/snaps-few-objects.yaml 2024-03-12T17:20:52.225 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_misc.yaml 2024-03-12T17:20:52.225 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/admin_socket_objecter_requests.yaml 2024-03-12T17:20:52.225 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_suites_truncate_delay.yaml 2024-03-12T17:20:52.226 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/snaps-many-objects.yaml 2024-03-12T17:20:52.226 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_kernel_untar_build.yaml 2024-03-12T17:20:52.226 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/rados_api_tests.yaml 2024-03-12T17:20:52.226 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_suites_fsstress.yaml 2024-03-12T17:20:52.226 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd 2024-03-12T17:20:52.226 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/cli 2024-03-12T17:20:52.226 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/cli/features 2024-03-12T17:20:52.226 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/cli/features/defaults.yaml 2024-03-12T17:20:52.226 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/cli/features/journaling.yaml 2024-03-12T17:20:52.226 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/cli/features/layering.yaml 2024-03-12T17:20:52.226 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/cli/features/format-1.yaml 2024-03-12T17:20:52.226 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/cli/base 2024-03-12T17:20:52.226 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/cli/base/install.yaml 2024-03-12T17:20:52.226 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/cli/pool 2024-03-12T17:20:52.227 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/cli/pool/small-cache-pool.yaml 2024-03-12T17:20:52.227 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/cli/pool/replicated-data-pool.yaml 2024-03-12T17:20:52.227 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/cli/pool/ec-data-pool.yaml 2024-03-12T17:20:52.227 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/cli/pool/none.yaml 2024-03-12T17:20:52.227 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/cli/clusters 2024-03-12T17:20:52.227 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/cli/msgr-failures 2024-03-12T17:20:52.227 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/cli/msgr-failures/many.yaml 2024-03-12T17:20:52.227 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/cli/msgr-failures/few.yaml 2024-03-12T17:20:52.227 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/cli/objectstore 2024-03-12T17:20:52.227 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/cli/fs 2024-03-12T17:20:52.227 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/cli/workloads 2024-03-12T17:20:52.227 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/cli/workloads/rbd_cli_import_export.yaml 2024-03-12T17:20:52.227 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/cli/workloads/rbd_cli_copy.yaml 2024-03-12T17:20:52.227 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/cli/% 2024-03-12T17:20:52.228 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/maintenance 2024-03-12T17:20:52.228 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/maintenance/base 2024-03-12T17:20:52.228 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/maintenance/base/install.yaml 2024-03-12T17:20:52.228 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/maintenance/clusters 2024-03-12T17:20:52.228 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/maintenance/clusters/openstack.yaml 2024-03-12T17:20:52.228 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/maintenance/clusters/+ 2024-03-12T17:20:52.228 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/maintenance/clusters/fixed-3.yaml 2024-03-12T17:20:52.228 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/maintenance/objectstore 2024-03-12T17:20:52.228 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/maintenance/workloads 2024-03-12T17:20:52.228 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/maintenance/workloads/dynamic_features.yaml 2024-03-12T17:20:52.228 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/maintenance/workloads/rebuild_object_map.yaml 2024-03-12T17:20:52.228 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/maintenance/% 2024-03-12T17:20:52.228 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/maintenance/xfs.yaml 2024-03-12T17:20:52.228 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/maintenance/qemu 2024-03-12T17:20:52.260 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/maintenance/qemu/xfstests.yaml 2024-03-12T17:20:52.260 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/singleton 2024-03-12T17:20:52.260 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/singleton/openstack.yaml 2024-03-12T17:20:52.260 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/singleton/objectstore 2024-03-12T17:20:52.260 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/singleton/% 2024-03-12T17:20:52.261 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/singleton/all 2024-03-12T17:20:52.261 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/singleton/all/rbd-vs-unmanaged-snaps.yaml 2024-03-12T17:20:52.261 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/singleton/all/rbd_mirror.yaml 2024-03-12T17:20:52.261 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/singleton/all/verify_pool.yaml 2024-03-12T17:20:52.261 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/singleton/all/formatted-output.yaml 2024-03-12T17:20:52.261 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/singleton/all/rbdmap_RBDMAPFILE.yaml 2024-03-12T17:20:52.261 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/singleton/all/qemu-iotests-writeback.yaml 2024-03-12T17:20:52.261 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/singleton/all/read-flags-writeback.yaml 2024-03-12T17:20:52.261 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/singleton/all/permissions.yaml 2024-03-12T17:20:52.261 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/singleton/all/read-flags-no-cache.yaml 2024-03-12T17:20:52.261 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/singleton/all/qemu-iotests-no-cache.yaml 2024-03-12T17:20:52.261 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/singleton/all/qemu-iotests-writethrough.yaml 2024-03-12T17:20:52.261 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/singleton/all/read-flags-writethrough.yaml 2024-03-12T17:20:52.262 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/singleton/all/admin_socket.yaml 2024-03-12T17:20:52.262 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/singleton/all/merge_diff.yaml 2024-03-12T17:20:52.262 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/basic 2024-03-12T17:20:52.262 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/basic/base 2024-03-12T17:20:52.262 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/basic/base/install.yaml 2024-03-12T17:20:52.262 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/basic/cachepool 2024-03-12T17:20:52.262 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/basic/cachepool/none.yaml 2024-03-12T17:20:52.262 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/basic/cachepool/small.yaml 2024-03-12T17:20:52.262 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/basic/clusters 2024-03-12T17:20:52.262 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/basic/clusters/openstack.yaml 2024-03-12T17:20:52.262 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/basic/clusters/+ 2024-03-12T17:20:52.262 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/basic/clusters/fixed-1.yaml 2024-03-12T17:20:52.262 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/basic/msgr-failures 2024-03-12T17:20:52.263 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/basic/msgr-failures/many.yaml 2024-03-12T17:20:52.263 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/basic/msgr-failures/few.yaml 2024-03-12T17:20:52.263 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/basic/objectstore 2024-03-12T17:20:52.263 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/basic/fs 2024-03-12T17:20:52.263 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/basic/fs/xfs.yaml 2024-03-12T17:20:52.263 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/basic/% 2024-03-12T17:20:52.263 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/basic/tasks 2024-03-12T17:20:52.263 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/basic/tasks/rbd_lock_and_fence.yaml 2024-03-12T17:20:52.263 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/basic/tasks/rbd_cli_tests.yaml 2024-03-12T17:20:52.263 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/basic/tasks/rbd_api_tests_old_format.yaml 2024-03-12T17:20:52.263 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/basic/tasks/rbd_cls_tests.yaml 2024-03-12T17:20:52.263 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/basic/tasks/rbd_python_api_tests_old_format.yaml 2024-03-12T17:20:52.263 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/librbd 2024-03-12T17:20:52.263 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/librbd/pool 2024-03-12T17:20:52.264 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/librbd/pool/small-cache-pool.yaml 2024-03-12T17:20:52.264 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/librbd/pool/replicated-data-pool.yaml 2024-03-12T17:20:52.264 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/librbd/pool/ec-data-pool.yaml 2024-03-12T17:20:52.264 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/librbd/pool/none.yaml 2024-03-12T17:20:52.264 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/librbd/clusters 2024-03-12T17:20:52.264 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/librbd/clusters/openstack.yaml 2024-03-12T17:20:52.264 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/librbd/clusters/+ 2024-03-12T17:20:52.264 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/librbd/clusters/fixed-3.yaml 2024-03-12T17:20:52.264 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/librbd/msgr-failures 2024-03-12T17:20:52.264 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/librbd/msgr-failures/few.yaml 2024-03-12T17:20:52.264 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/librbd/objectstore 2024-03-12T17:20:52.264 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/librbd/config 2024-03-12T17:20:52.264 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/librbd/config/skip-partial-discard.yaml 2024-03-12T17:20:52.264 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/librbd/config/none.yaml 2024-03-12T17:20:52.264 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/librbd/config/copy-on-read.yaml 2024-03-12T17:20:52.264 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/librbd/fs 2024-03-12T17:20:52.265 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/librbd/workloads 2024-03-12T17:20:52.265 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/librbd/workloads/c_api_tests.yaml 2024-03-12T17:20:52.265 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/librbd/workloads/rbd_fio.yaml 2024-03-12T17:20:52.265 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/librbd/workloads/c_api_tests_with_defaults.yaml 2024-03-12T17:20:52.265 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/librbd/workloads/python_api_tests.yaml 2024-03-12T17:20:52.265 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/librbd/workloads/fsx.yaml 2024-03-12T17:20:52.265 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/librbd/workloads/python_api_tests_with_journaling.yaml 2024-03-12T17:20:52.265 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/librbd/workloads/c_api_tests_with_journaling.yaml 2024-03-12T17:20:52.265 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/librbd/workloads/python_api_tests_with_defaults.yaml 2024-03-12T17:20:52.265 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/librbd/cache 2024-03-12T17:20:52.265 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/librbd/cache/writeback.yaml 2024-03-12T17:20:52.265 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/librbd/cache/writethrough.yaml 2024-03-12T17:20:52.265 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/librbd/cache/none.yaml 2024-03-12T17:20:52.265 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/librbd/% 2024-03-12T17:20:52.265 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/valgrind 2024-03-12T17:20:52.303 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/valgrind/base 2024-03-12T17:20:52.303 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/valgrind/base/install.yaml 2024-03-12T17:20:52.303 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/valgrind/clusters 2024-03-12T17:20:52.304 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/valgrind/objectstore 2024-03-12T17:20:52.304 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/valgrind/fs 2024-03-12T17:20:52.304 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/valgrind/workloads 2024-03-12T17:20:52.304 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/valgrind/workloads/rbd_mirror.yaml 2024-03-12T17:20:52.304 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/valgrind/workloads/c_api_tests.yaml 2024-03-12T17:20:52.304 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/valgrind/workloads/c_api_tests_with_defaults.yaml 2024-03-12T17:20:52.304 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/valgrind/workloads/python_api_tests.yaml 2024-03-12T17:20:52.304 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/valgrind/workloads/fsx.yaml 2024-03-12T17:20:52.304 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/valgrind/workloads/python_api_tests_with_journaling.yaml 2024-03-12T17:20:52.304 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/valgrind/workloads/c_api_tests_with_journaling.yaml 2024-03-12T17:20:52.304 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/valgrind/workloads/python_api_tests_with_defaults.yaml 2024-03-12T17:20:52.304 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/valgrind/validator 2024-03-12T17:20:52.304 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/valgrind/validator/memcheck.yaml 2024-03-12T17:20:52.304 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/valgrind/% 2024-03-12T17:20:52.304 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/nbd 2024-03-12T17:20:52.304 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/nbd/base 2024-03-12T17:20:52.305 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/nbd/cluster 2024-03-12T17:20:52.305 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/nbd/cluster/openstack.yaml 2024-03-12T17:20:52.305 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/nbd/cluster/+ 2024-03-12T17:20:52.305 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/nbd/cluster/fixed-3.yaml 2024-03-12T17:20:52.305 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/nbd/msgr-failures 2024-03-12T17:20:52.305 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/nbd/objectstore 2024-03-12T17:20:52.305 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/nbd/fs 2024-03-12T17:20:52.305 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/nbd/workloads 2024-03-12T17:20:52.305 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/nbd/workloads/rbd_nbd.yaml 2024-03-12T17:20:52.305 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/nbd/workloads/rbd_fsx_nbd.yaml 2024-03-12T17:20:52.305 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/nbd/% 2024-03-12T17:20:52.305 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/nbd/thrashers 2024-03-12T17:20:52.305 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/thrash 2024-03-12T17:20:52.305 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/thrash/base 2024-03-12T17:20:52.305 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/thrash/base/install.yaml 2024-03-12T17:20:52.306 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/thrash/clusters 2024-03-12T17:20:52.306 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/thrash/clusters/openstack.yaml 2024-03-12T17:20:52.306 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/thrash/clusters/fixed-2.yaml 2024-03-12T17:20:52.306 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/thrash/clusters/+ 2024-03-12T17:20:52.306 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/thrash/msgr-failures 2024-03-12T17:20:52.306 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/thrash/msgr-failures/few.yaml 2024-03-12T17:20:52.306 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/thrash/objectstore 2024-03-12T17:20:52.306 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/thrash/fs 2024-03-12T17:20:52.306 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/thrash/fs/xfs.yaml 2024-03-12T17:20:52.306 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/thrash/workloads 2024-03-12T17:20:52.306 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_fsx_cache_writeback.yaml 2024-03-12T17:20:52.306 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_fsx_copy_on_read.yaml 2024-03-12T17:20:52.306 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_fsx_journal.yaml 2024-03-12T17:20:52.307 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_api_tests_journaling.yaml 2024-03-12T17:20:52.307 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_fsx_nocache.yaml 2024-03-12T17:20:52.307 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_api_tests.yaml 2024-03-12T17:20:52.307 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/thrash/workloads/journal.yaml 2024-03-12T17:20:52.307 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_api_tests_copy_on_read.yaml 2024-03-12T17:20:52.307 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_api_tests_no_locking.yaml 2024-03-12T17:20:52.307 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_fsx_cache_writethrough.yaml 2024-03-12T17:20:52.307 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/thrash/% 2024-03-12T17:20:52.307 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/thrash/thrashers 2024-03-12T17:20:52.307 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/thrash/thrashers/default.yaml 2024-03-12T17:20:52.307 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/thrash/thrashers/cache.yaml 2024-03-12T17:20:52.307 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/mirror 2024-03-12T17:20:52.307 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/mirror/base 2024-03-12T17:20:52.307 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/mirror/base/install.yaml 2024-03-12T17:20:52.307 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/mirror/cluster 2024-03-12T17:20:52.308 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/mirror/cluster/openstack.yaml 2024-03-12T17:20:52.308 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/mirror/cluster/2-node.yaml 2024-03-12T17:20:52.308 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/mirror/cluster/+ 2024-03-12T17:20:52.308 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/mirror/msgr-failures 2024-03-12T17:20:52.308 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/mirror/objectstore 2024-03-12T17:20:52.308 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/mirror/fs 2024-03-12T17:20:52.308 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/mirror/workloads 2024-03-12T17:20:52.308 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/mirror/workloads/rbd-mirror-stress-workunit.yaml 2024-03-12T17:20:52.308 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/mirror/workloads/rbd-mirror-workunit.yaml 2024-03-12T17:20:52.308 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/mirror/% 2024-03-12T17:20:52.308 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/mirror/rbd-mirror 2024-03-12T17:20:52.308 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/mirror/rbd-mirror/one-per-cluster.yaml 2024-03-12T17:20:52.308 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/qemu 2024-03-12T17:20:52.308 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/qemu/features 2024-03-12T17:20:52.309 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/qemu/features/defaults.yaml 2024-03-12T17:20:52.309 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/qemu/features/journaling.yaml 2024-03-12T17:20:52.309 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/qemu/pool 2024-03-12T17:20:52.346 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/qemu/pool/small-cache-pool.yaml 2024-03-12T17:20:52.346 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/qemu/pool/replicated-data-pool.yaml 2024-03-12T17:20:52.346 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/qemu/pool/ec-cache-pool.yaml 2024-03-12T17:20:52.346 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/qemu/pool/ec-data-pool.yaml 2024-03-12T17:20:52.346 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/qemu/pool/none.yaml 2024-03-12T17:20:52.346 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/qemu/clusters 2024-03-12T17:20:52.346 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/qemu/clusters/openstack.yaml 2024-03-12T17:20:52.346 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/qemu/clusters/+ 2024-03-12T17:20:52.346 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/qemu/clusters/fixed-3.yaml 2024-03-12T17:20:52.347 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/qemu/msgr-failures 2024-03-12T17:20:52.347 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/qemu/msgr-failures/few.yaml 2024-03-12T17:20:52.347 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/qemu/objectstore 2024-03-12T17:20:52.347 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/qemu/fs 2024-03-12T17:20:52.347 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/qemu/workloads 2024-03-12T17:20:52.347 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/qemu/workloads/qemu_iozone.yaml.disabled 2024-03-12T17:20:52.347 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/qemu/workloads/#qemu_xfstests.yaml# 2024-03-12T17:20:52.347 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/qemu/workloads/qemu_xfstests.yaml 2024-03-12T17:20:52.347 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/qemu/workloads/qemu_fsstress.yaml 2024-03-12T17:20:52.347 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/qemu/workloads/qemu_bonnie.yaml 2024-03-12T17:20:52.347 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/qemu/cache 2024-03-12T17:20:52.347 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/qemu/cache/writeback.yaml 2024-03-12T17:20:52.347 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/qemu/cache/writethrough.yaml 2024-03-12T17:20:52.347 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/qemu/cache/none.yaml 2024-03-12T17:20:52.348 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rbd/qemu/% 2024-03-12T17:20:52.348 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rest 2024-03-12T17:20:52.348 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rest/basic 2024-03-12T17:20:52.348 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rest/basic/tasks 2024-03-12T17:20:52.348 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rest/basic/tasks/rest_test.yaml 2024-03-12T17:20:52.348 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw 2024-03-12T17:20:52.348 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/multifs 2024-03-12T17:20:52.348 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/multifs/clusters 2024-03-12T17:20:52.348 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/multifs/clusters/fixed-2.yaml 2024-03-12T17:20:52.348 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/multifs/objectstore 2024-03-12T17:20:52.348 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/multifs/fs 2024-03-12T17:20:52.348 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/multifs/fs/xfs.yaml 2024-03-12T17:20:52.348 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/multifs/rgw_pool_type 2024-03-12T17:20:52.349 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/multifs/frontend 2024-03-12T17:20:52.349 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/multifs/frontend/apache.yaml 2024-03-12T17:20:52.349 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/multifs/frontend/civetweb.yaml 2024-03-12T17:20:52.349 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/multifs/overrides.yaml 2024-03-12T17:20:52.349 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/multifs/% 2024-03-12T17:20:52.349 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/multifs/tasks 2024-03-12T17:20:52.349 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_roundtrip.yaml 2024-03-12T17:20:52.349 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_multipart_upload.yaml 2024-03-12T17:20:52.349 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_user_quota.yaml 2024-03-12T17:20:52.349 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_readwrite.yaml 2024-03-12T17:20:52.349 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_swift.yaml 2024-03-12T17:20:52.349 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_s3tests.yaml 2024-03-12T17:20:52.349 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_bucket_quota.yaml 2024-03-12T17:20:52.349 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/singleton 2024-03-12T17:20:52.349 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/singleton/objectstore 2024-03-12T17:20:52.350 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/singleton/fs 2024-03-12T17:20:52.350 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/singleton/fs/xfs.yaml 2024-03-12T17:20:52.350 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/singleton/rgw_pool_type 2024-03-12T17:20:52.350 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/singleton/frontend 2024-03-12T17:20:52.350 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/singleton/frontend/apache.yaml 2024-03-12T17:20:52.350 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/singleton/frontend/civetweb.yaml 2024-03-12T17:20:52.350 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/singleton/overrides.yaml 2024-03-12T17:20:52.350 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/singleton/% 2024-03-12T17:20:52.350 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/singleton/xfs.yaml 2024-03-12T17:20:52.350 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/singleton/all 2024-03-12T17:20:52.350 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/singleton/all/radosgw-admin-multi-region.yaml 2024-03-12T17:20:52.350 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/singleton/all/radosgw-admin.yaml 2024-03-12T17:20:52.350 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/singleton/all/radosgw-admin-data-sync.yaml 2024-03-12T17:20:52.351 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/singleton/all/radosgw-convert-to-region.yaml 2024-03-12T17:20:52.351 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/verify 2024-03-12T17:20:52.351 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/verify/validater 2024-03-12T17:20:52.351 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/verify/validater/valgrind.yaml 2024-03-12T17:20:52.351 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/verify/validater/lockdep.yaml 2024-03-12T17:20:52.351 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/verify/clusters 2024-03-12T17:20:52.351 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/verify/clusters/fixed-2.yaml 2024-03-12T17:20:52.351 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/verify/msgr-failures 2024-03-12T17:20:52.351 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/verify/msgr-failures/few.yaml 2024-03-12T17:20:52.351 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/verify/objectstore 2024-03-12T17:20:52.351 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/verify/fs 2024-03-12T17:20:52.351 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/verify/fs/xfs.yaml 2024-03-12T17:20:52.351 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/verify/rgw_pool_type 2024-03-12T17:20:52.351 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/verify/frontend 2024-03-12T17:20:52.351 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/verify/frontend/apache.yaml 2024-03-12T17:20:52.352 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/verify/frontend/civetweb.yaml 2024-03-12T17:20:52.352 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/verify/overrides.yaml 2024-03-12T17:20:52.352 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/verify/% 2024-03-12T17:20:52.406 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/verify/tasks 2024-03-12T17:20:52.406 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/verify/tasks/rgw_s3tests_multiregion.yaml 2024-03-12T17:20:52.406 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/verify/tasks/rgw_swift.yaml 2024-03-12T17:20:52.407 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rgw/verify/tasks/rgw_s3tests.yaml 2024-03-12T17:20:52.407 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-deploy 2024-03-12T17:20:52.407 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-deploy/basic 2024-03-12T17:20:52.407 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-deploy/basic/ceph-deploy-overrides 2024-03-12T17:20:52.407 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-deploy/basic/python_versions 2024-03-12T17:20:52.407 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-deploy/basic/python_versions/python_3.yaml 2024-03-12T17:20:52.407 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-deploy/basic/python_versions/python_2.yaml 2024-03-12T17:20:52.407 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-deploy/basic/config_options 2024-03-12T17:20:52.407 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-deploy/basic/distros 2024-03-12T17:20:52.407 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-deploy/basic/% 2024-03-12T17:20:52.407 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-deploy/basic/tasks 2024-03-12T17:20:52.407 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-deploy/basic/tasks/ceph-admin-commands.yaml 2024-03-12T17:20:52.407 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/tgt 2024-03-12T17:20:52.407 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/tgt/basic 2024-03-12T17:20:52.408 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/tgt/basic/clusters 2024-03-12T17:20:52.408 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/tgt/basic/clusters/fixed-3.yaml 2024-03-12T17:20:52.408 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/tgt/basic/msgr-failures 2024-03-12T17:20:52.408 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/tgt/basic/msgr-failures/many.yaml 2024-03-12T17:20:52.408 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/tgt/basic/msgr-failures/few.yaml 2024-03-12T17:20:52.408 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/tgt/basic/fs 2024-03-12T17:20:52.408 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/tgt/basic/fs/btrfs.yaml 2024-03-12T17:20:52.408 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/tgt/basic/% 2024-03-12T17:20:52.408 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/tgt/basic/tasks 2024-03-12T17:20:52.408 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/tgt/basic/tasks/iozone-sync.yaml 2024-03-12T17:20:52.408 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/tgt/basic/tasks/dbench-short.yaml 2024-03-12T17:20:52.408 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/tgt/basic/tasks/blogbench.yaml 2024-03-12T17:20:52.408 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/tgt/basic/tasks/ffsb.yaml 2024-03-12T17:20:52.408 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/tgt/basic/tasks/pjd.yaml 2024-03-12T17:20:52.408 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/tgt/basic/tasks/fsync-tester.yaml 2024-03-12T17:20:52.408 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/tgt/basic/tasks/iogen.yaml 2024-03-12T17:20:52.408 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/tgt/basic/tasks/fsx.yaml 2024-03-12T17:20:52.409 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/tgt/basic/tasks/bonnie.yaml 2024-03-12T17:20:52.409 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/tgt/basic/tasks/fio.yaml 2024-03-12T17:20:52.409 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/tgt/basic/tasks/iozone.yaml 2024-03-12T17:20:52.409 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/tgt/basic/tasks/dbench.yaml 2024-03-12T17:20:52.409 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/tgt/basic/tasks/fsstress.yaml 2024-03-12T17:20:52.409 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/samba 2024-03-12T17:20:52.409 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/samba/install 2024-03-12T17:20:52.409 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/samba/install/install.yaml 2024-03-12T17:20:52.409 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/samba/clusters 2024-03-12T17:20:52.409 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/samba/clusters/samba-basic.yaml 2024-03-12T17:20:52.409 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/samba/workload 2024-03-12T17:20:52.409 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/samba/workload/cifs-kernel-build.yaml.disabled 2024-03-12T17:20:52.409 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/samba/workload/cifs-fsstress.yaml 2024-03-12T17:20:52.409 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/samba/workload/smbtorture.yaml 2024-03-12T17:20:52.409 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/samba/workload/cifs-dbench.yaml 2024-03-12T17:20:52.410 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/samba/fs 2024-03-12T17:20:52.410 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/samba/fs/xfs.yaml 2024-03-12T17:20:52.410 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/samba/mount 2024-03-12T17:20:52.410 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/samba/mount/noceph.yaml 2024-03-12T17:20:52.410 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/samba/mount/kclient.yaml 2024-03-12T17:20:52.410 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/samba/mount/fuse.yaml 2024-03-12T17:20:52.410 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/samba/mount/native.yaml 2024-03-12T17:20:52.410 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/samba/% 2024-03-12T17:20:52.410 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-ansible 2024-03-12T17:20:52.410 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke 2024-03-12T17:20:52.410 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/5-tests 2024-03-12T17:20:52.410 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/5-tests/cls.yaml 2024-03-12T17:20:52.410 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/5-tests/rbd_cli_tests.yaml.disabled 2024-03-12T17:20:52.410 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/5-tests/rbd_import_export.yaml 2024-03-12T17:20:52.411 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/5-tests/ceph-admin-commands.yaml 2024-03-12T17:20:52.411 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/1-distros 2024-03-12T17:20:52.411 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/0-clusters 2024-03-12T17:20:52.411 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/0-clusters/single_mon_osd.yaml 2024-03-12T17:20:52.411 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/0-clusters/3-node.yaml 2024-03-12T17:20:52.411 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/3-common 2024-03-12T17:20:52.411 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/3-common/os_tuning 2024-03-12T17:20:52.411 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/3-common/os_tuning/vm_friendly.yaml 2024-03-12T17:20:52.411 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/3-common/source 2024-03-12T17:20:52.411 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/3-common/source/upstream_stable.yaml 2024-03-12T17:20:52.411 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/3-common/% 2024-03-12T17:20:52.411 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/% 2024-03-12T17:20:52.411 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd 2024-03-12T17:20:52.411 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd/journal 2024-03-12T17:20:52.411 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd/journal/collocated.yaml 2024-03-12T17:20:52.412 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd/% 2024-03-12T17:20:52.470 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd/devices 2024-03-12T17:20:52.470 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd/devices/osd_auto_discovery.yaml 2024-03-12T17:20:52.471 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd/devices/from_teuthology.yaml 2024-03-12T17:20:52.471 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/2-setup 2024-03-12T17:20:52.471 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-ansible/smoke/2-setup/ceph_ansible.yaml 2024-03-12T17:20:52.471 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/big 2024-03-12T17:20:52.471 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/big/rados-thrash 2024-03-12T17:20:52.471 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/big/rados-thrash/clusters 2024-03-12T17:20:52.471 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/big/rados-thrash/clusters/medium.yaml 2024-03-12T17:20:52.471 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/big/rados-thrash/clusters/big.yaml 2024-03-12T17:20:52.471 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/big/rados-thrash/clusters/small.yaml 2024-03-12T17:20:52.471 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/big/rados-thrash/fs 2024-03-12T17:20:52.471 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/big/rados-thrash/fs/btrfs.yaml 2024-03-12T17:20:52.471 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/big/rados-thrash/fs/xfs.yaml 2024-03-12T17:20:52.471 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/big/rados-thrash/workloads 2024-03-12T17:20:52.471 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/big/rados-thrash/workloads/snaps-few-objects.yaml 2024-03-12T17:20:52.472 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/big/rados-thrash/ceph 2024-03-12T17:20:52.472 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/big/rados-thrash/ceph/ceph.yaml 2024-03-12T17:20:52.472 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/big/rados-thrash/% 2024-03-12T17:20:52.472 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/big/rados-thrash/thrashers 2024-03-12T17:20:52.472 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/big/rados-thrash/thrashers/default.yaml 2024-03-12T17:20:52.472 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/mixed-clients 2024-03-12T17:20:52.472 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/mixed-clients/basic 2024-03-12T17:20:52.472 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/mixed-clients/basic/clusters 2024-03-12T17:20:52.472 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/mixed-clients/basic/clusters/fixed-3.yaml 2024-03-12T17:20:52.472 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/mixed-clients/basic/fs 2024-03-12T17:20:52.472 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/mixed-clients/basic/fs/btrfs.yaml 2024-03-12T17:20:52.472 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/mixed-clients/basic/tasks 2024-03-12T17:20:52.472 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/mixed-clients/basic/tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml 2024-03-12T17:20:52.472 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/mixed-clients/basic/tasks/kernel_cfuse_workunits_dbench_iozone.yaml 2024-03-12T17:20:52.473 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs 2024-03-12T17:20:52.473 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/traceless 2024-03-12T17:20:52.473 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/traceless/traceless 2024-03-12T17:20:52.473 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/traceless/traceless/50pc.yaml 2024-03-12T17:20:52.473 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/traceless/overrides 2024-03-12T17:20:52.473 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/traceless/overrides/whitelist_wrongly_marked_down.yaml 2024-03-12T17:20:52.473 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/traceless/overrides/debug.yaml 2024-03-12T17:20:52.473 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/traceless/overrides/+ 2024-03-12T17:20:52.473 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/traceless/overrides/frag_enable.yaml 2024-03-12T17:20:52.473 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/traceless/clusters 2024-03-12T17:20:52.473 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/traceless/clusters/fixed-2-ucephfs.yaml 2024-03-12T17:20:52.473 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/traceless/objectstore 2024-03-12T17:20:52.473 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/traceless/fs 2024-03-12T17:20:52.473 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/traceless/fs/xfs.yaml 2024-03-12T17:20:52.473 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/traceless/mount 2024-03-12T17:20:52.473 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/traceless/mount/fuse.yaml 2024-03-12T17:20:52.474 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/traceless/begin.yaml 2024-03-12T17:20:52.474 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/traceless/% 2024-03-12T17:20:52.474 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/traceless/tasks 2024-03-12T17:20:52.474 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/traceless/tasks/cfuse_workunit_suites_ffsb.yaml 2024-03-12T17:20:52.474 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/traceless/tasks/cfuse_workunit_suites_blogbench.yaml 2024-03-12T17:20:52.474 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/traceless/tasks/cfuse_workunit_suites_fsstress.yaml 2024-03-12T17:20:52.474 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/traceless/tasks/cfuse_workunit_suites_dbench.yaml 2024-03-12T17:20:52.474 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/multifs 2024-03-12T17:20:52.474 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/multifs/overrides 2024-03-12T17:20:52.474 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/multifs/overrides/whitelist_wrongly_marked_down.yaml 2024-03-12T17:20:52.474 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/multifs/overrides/mon-debug.yaml 2024-03-12T17:20:52.474 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/multifs/overrides/debug.yaml 2024-03-12T17:20:52.474 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/multifs/overrides/+ 2024-03-12T17:20:52.474 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/multifs/overrides/frag_enable.yaml 2024-03-12T17:20:52.475 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/multifs/clusters 2024-03-12T17:20:52.475 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/multifs/clusters/2-remote-clients.yaml 2024-03-12T17:20:52.475 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/multifs/objectstore 2024-03-12T17:20:52.475 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/multifs/fs 2024-03-12T17:20:52.475 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/multifs/fs/xfs.yaml 2024-03-12T17:20:52.475 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/multifs/mount 2024-03-12T17:20:52.475 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/multifs/mount/fuse.yaml 2024-03-12T17:20:52.475 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/multifs/begin.yaml 2024-03-12T17:20:52.475 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/multifs/% 2024-03-12T17:20:52.475 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/multifs/tasks 2024-03-12T17:20:52.475 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/multifs/tasks/failover.yaml 2024-03-12T17:20:52.475 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/snaps 2024-03-12T17:20:52.475 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/snaps/overrides 2024-03-12T17:20:52.475 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/snaps/overrides/whitelist_wrongly_marked_down.yaml 2024-03-12T17:20:52.475 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/snaps/overrides/debug.yaml 2024-03-12T17:20:52.476 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/snaps/overrides/+ 2024-03-12T17:20:52.476 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/snaps/overrides/frag_enable.yaml 2024-03-12T17:20:52.498 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/snaps/clusters 2024-03-12T17:20:52.498 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/snaps/clusters/fixed-2-ucephfs.yaml 2024-03-12T17:20:52.498 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/snaps/objectstore 2024-03-12T17:20:52.498 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/snaps/fs 2024-03-12T17:20:52.498 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/snaps/fs/xfs.yaml 2024-03-12T17:20:52.498 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/snaps/mount 2024-03-12T17:20:52.498 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/snaps/mount/fuse.yaml 2024-03-12T17:20:52.498 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/snaps/begin.yaml 2024-03-12T17:20:52.499 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/snaps/% 2024-03-12T17:20:52.499 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/snaps/tasks 2024-03-12T17:20:52.499 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/snaps/tasks/snaptests.yaml 2024-03-12T17:20:52.499 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic 2024-03-12T17:20:52.499 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic/overrides 2024-03-12T17:20:52.499 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic/overrides/whitelist_wrongly_marked_down.yaml 2024-03-12T17:20:52.499 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic/overrides/debug.yaml 2024-03-12T17:20:52.499 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic/overrides/+ 2024-03-12T17:20:52.499 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic/overrides/frag_enable.yaml 2024-03-12T17:20:52.499 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic/clusters 2024-03-12T17:20:52.499 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic/clusters/fixed-2-ucephfs.yaml 2024-03-12T17:20:52.499 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic/objectstore 2024-03-12T17:20:52.499 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic/fs 2024-03-12T17:20:52.499 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic/fs/xfs.yaml 2024-03-12T17:20:52.499 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic/mount 2024-03-12T17:20:52.500 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic/mount/fuse.yaml 2024-03-12T17:20:52.500 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic/inline 2024-03-12T17:20:52.500 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic/inline/yes.yaml 2024-03-12T17:20:52.500 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic/inline/no.yaml 2024-03-12T17:20:52.500 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic/begin.yaml 2024-03-12T17:20:52.500 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic/% 2024-03-12T17:20:52.500 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic/tasks 2024-03-12T17:20:52.500 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_fsync.yaml 2024-03-12T17:20:52.500 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic/tasks/libcephfs_interface_tests.yaml 2024-03-12T17:20:52.500 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_pjd.yaml 2024-03-12T17:20:52.500 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_norstats.yaml 2024-03-12T17:20:52.500 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_trivial_sync.yaml 2024-03-12T17:20:52.500 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_ffsb.yaml 2024-03-12T17:20:52.500 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_fsx.yaml 2024-03-12T17:20:52.500 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic/tasks/libcephfs_java.yaml 2024-03-12T17:20:52.500 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_misc.yaml 2024-03-12T17:20:52.500 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_misc_test_o_trunc.yaml 2024-03-12T17:20:52.501 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic/tasks/mds_creation_retry.yaml 2024-03-12T17:20:52.501 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic/tasks/asok_dump_tree.yaml 2024-03-12T17:20:52.501 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_quota.yaml 2024-03-12T17:20:52.501 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_truncate_delay.yaml 2024-03-12T17:20:52.501 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_kernel_untar_build.yaml 2024-03-12T17:20:52.501 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_blogbench.yaml 2024-03-12T17:20:52.501 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic/tasks/libcephfs_python.yaml 2024-03-12T17:20:52.501 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_fsstress.yaml 2024-03-12T17:20:52.501 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cephfs_scrub_tests.yaml 2024-03-12T17:20:52.501 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_iogen.yaml 2024-03-12T17:20:52.501 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_dbench.yaml 2024-03-12T17:20:52.501 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_iozone.yaml 2024-03-12T17:20:52.501 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/recovery 2024-03-12T17:20:52.501 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/recovery/overrides 2024-03-12T17:20:52.502 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/recovery/overrides/whitelist_wrongly_marked_down.yaml 2024-03-12T17:20:52.502 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/recovery/overrides/fuse-unmounted.yaml 2024-03-12T17:20:52.502 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/recovery/overrides/debug.yaml 2024-03-12T17:20:52.502 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/recovery/overrides/+ 2024-03-12T17:20:52.502 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/recovery/overrides/frag_enable.yaml 2024-03-12T17:20:52.502 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/recovery/clusters 2024-03-12T17:20:52.502 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/recovery/clusters/4-remote-clients.yaml 2024-03-12T17:20:52.502 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/recovery/objectstore 2024-03-12T17:20:52.502 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/recovery/fs 2024-03-12T17:20:52.502 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/recovery/fs/xfs.yaml 2024-03-12T17:20:52.502 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/recovery/mount 2024-03-12T17:20:52.502 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/recovery/mount/fuse.yaml 2024-03-12T17:20:52.502 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/recovery/begin.yaml 2024-03-12T17:20:52.502 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/recovery/% 2024-03-12T17:20:52.503 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/recovery/tasks 2024-03-12T17:20:52.503 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/backtrace.yaml 2024-03-12T17:20:52.503 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/forward-scrub.yaml 2024-03-12T17:20:52.503 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/client-readahad.yaml 2024-03-12T17:20:52.503 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/volume-client.yaml 2024-03-12T17:20:52.503 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/config-commands.yaml 2024-03-12T17:20:52.503 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/mds-full.yaml 2024-03-12T17:20:52.533 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/sessionmap.yaml 2024-03-12T17:20:52.533 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/data-scan.yaml 2024-03-12T17:20:52.533 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/cap-flush.yaml 2024-03-12T17:20:52.533 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/mds-flush.yaml 2024-03-12T17:20:52.533 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/auto-repair.yaml 2024-03-12T17:20:52.533 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/damage.yaml 2024-03-12T17:20:52.533 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/client-recovery.yaml 2024-03-12T17:20:52.533 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/journal-repair.yaml 2024-03-12T17:20:52.534 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/client-limits.yaml 2024-03-12T17:20:52.534 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/strays.yaml 2024-03-12T17:20:52.534 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/fragment.yaml 2024-03-12T17:20:52.534 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/recovery/tasks/pool-perm.yaml 2024-03-12T17:20:52.534 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/permission 2024-03-12T17:20:52.534 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/permission/overrides 2024-03-12T17:20:52.534 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/permission/overrides/whitelist_wrongly_marked_down.yaml 2024-03-12T17:20:52.534 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/permission/overrides/debug.yaml 2024-03-12T17:20:52.534 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/permission/overrides/+ 2024-03-12T17:20:52.534 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/permission/overrides/frag_enable.yaml 2024-03-12T17:20:52.534 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/permission/clusters 2024-03-12T17:20:52.534 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/permission/clusters/fixed-2-ucephfs.yaml 2024-03-12T17:20:52.534 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/permission/objectstore 2024-03-12T17:20:52.534 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/permission/fs 2024-03-12T17:20:52.535 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/permission/fs/xfs.yaml 2024-03-12T17:20:52.535 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/permission/mount 2024-03-12T17:20:52.535 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/permission/mount/fuse.yaml 2024-03-12T17:20:52.535 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/permission/begin.yaml 2024-03-12T17:20:52.535 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/permission/% 2024-03-12T17:20:52.535 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/permission/tasks 2024-03-12T17:20:52.535 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/permission/tasks/cfuse_workunit_suites_pjd.yaml 2024-03-12T17:20:52.535 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/permission/tasks/cfuse_workunit_misc.yaml 2024-03-12T17:20:52.535 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/standbyreplay 2024-03-12T17:20:52.535 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/standbyreplay/overrides 2024-03-12T17:20:52.535 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/standbyreplay/overrides/whitelist_wrongly_marked_down.yaml 2024-03-12T17:20:52.535 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/standbyreplay/overrides/debug.yaml 2024-03-12T17:20:52.535 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/standbyreplay/overrides/+ 2024-03-12T17:20:52.535 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/standbyreplay/overrides/frag_enable.yaml 2024-03-12T17:20:52.535 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/standbyreplay/clusters 2024-03-12T17:20:52.535 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/standbyreplay/clusters/standby-replay.yaml 2024-03-12T17:20:52.536 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/standbyreplay/objectstore 2024-03-12T17:20:52.536 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/standbyreplay/fs 2024-03-12T17:20:52.536 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/standbyreplay/fs/xfs.yaml 2024-03-12T17:20:52.536 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/standbyreplay/mount 2024-03-12T17:20:52.536 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/standbyreplay/mount/fuse.yaml 2024-03-12T17:20:52.536 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/standbyreplay/begin.yaml 2024-03-12T17:20:52.536 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/standbyreplay/% 2024-03-12T17:20:52.536 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/standbyreplay/tasks 2024-03-12T17:20:52.536 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/standbyreplay/tasks/migration.yaml 2024-03-12T17:20:52.536 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/32bits 2024-03-12T17:20:52.536 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/32bits/overrides 2024-03-12T17:20:52.536 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/32bits/overrides/whitelist_wrongly_marked_down.yaml 2024-03-12T17:20:52.536 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/32bits/overrides/debug.yaml 2024-03-12T17:20:52.536 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/32bits/overrides/+ 2024-03-12T17:20:52.536 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/32bits/overrides/faked-ino.yaml 2024-03-12T17:20:52.536 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/32bits/overrides/frag_enable.yaml 2024-03-12T17:20:52.537 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/32bits/clusters 2024-03-12T17:20:52.537 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/32bits/clusters/fixed-2-ucephfs.yaml 2024-03-12T17:20:52.537 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/32bits/objectstore 2024-03-12T17:20:52.537 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/32bits/fs 2024-03-12T17:20:52.537 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/32bits/fs/xfs.yaml 2024-03-12T17:20:52.537 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/32bits/mount 2024-03-12T17:20:52.537 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/32bits/mount/fuse.yaml 2024-03-12T17:20:52.537 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/32bits/begin.yaml 2024-03-12T17:20:52.537 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/32bits/% 2024-03-12T17:20:52.537 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/32bits/tasks 2024-03-12T17:20:52.537 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/32bits/tasks/cfuse_workunit_suites_pjd.yaml 2024-03-12T17:20:52.537 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/32bits/tasks/cfuse_workunit_suites_fsstress.yaml 2024-03-12T17:20:52.537 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/thrash 2024-03-12T17:20:52.537 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/thrash/ceph-thrash 2024-03-12T17:20:52.537 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/thrash/ceph-thrash/default.yaml 2024-03-12T17:20:52.538 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/thrash/overrides 2024-03-12T17:20:52.538 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/thrash/overrides/whitelist_wrongly_marked_down.yaml 2024-03-12T17:20:52.538 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/thrash/overrides/debug.yaml 2024-03-12T17:20:52.538 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/thrash/overrides/+ 2024-03-12T17:20:52.538 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/thrash/overrides/frag_enable.yaml 2024-03-12T17:20:52.538 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/thrash/clusters 2024-03-12T17:20:52.538 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/thrash/clusters/mds-1active-1standby.yaml 2024-03-12T17:20:52.538 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/thrash/msgr-failures 2024-03-12T17:20:52.575 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/thrash/msgr-failures/osd-mds-delay.yaml 2024-03-12T17:20:52.575 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/thrash/msgr-failures/none.yaml 2024-03-12T17:20:52.575 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/thrash/objectstore 2024-03-12T17:20:52.575 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/thrash/fs 2024-03-12T17:20:52.575 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/thrash/fs/xfs.yaml 2024-03-12T17:20:52.575 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/thrash/mount 2024-03-12T17:20:52.575 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/thrash/mount/fuse.yaml 2024-03-12T17:20:52.575 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/thrash/begin.yaml 2024-03-12T17:20:52.576 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/thrash/% 2024-03-12T17:20:52.576 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/thrash/tasks 2024-03-12T17:20:52.576 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/thrash/tasks/cfuse_workunit_suites_pjd.yaml 2024-03-12T17:20:52.576 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/thrash/tasks/cfuse_workunit_trivial_sync.yaml 2024-03-12T17:20:52.576 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/thrash/tasks/cfuse_workunit_snaptests.yaml 2024-03-12T17:20:52.576 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/thrash/tasks/cfuse_workunit_suites_fsstress.yaml 2024-03-12T17:20:52.576 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/verify 2024-03-12T17:20:52.576 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/verify/validater 2024-03-12T17:20:52.576 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml 2024-03-12T17:20:52.576 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/verify/validater/lockdep.yaml 2024-03-12T17:20:52.576 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/verify/overrides 2024-03-12T17:20:52.576 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/verify/overrides/whitelist_wrongly_marked_down.yaml 2024-03-12T17:20:52.576 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/verify/overrides/mon-debug.yaml 2024-03-12T17:20:52.576 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/verify/overrides/debug.yaml 2024-03-12T17:20:52.576 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/verify/overrides/+ 2024-03-12T17:20:52.577 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/verify/overrides/frag_enable.yaml 2024-03-12T17:20:52.577 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/verify/clusters 2024-03-12T17:20:52.577 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/verify/clusters/fixed-2-ucephfs.yaml 2024-03-12T17:20:52.577 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/verify/objectstore 2024-03-12T17:20:52.577 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/verify/fs 2024-03-12T17:20:52.577 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/verify/fs/xfs.yaml 2024-03-12T17:20:52.577 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/verify/mount 2024-03-12T17:20:52.577 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/verify/mount/fuse.yaml 2024-03-12T17:20:52.577 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/verify/begin.yaml 2024-03-12T17:20:52.577 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/verify/% 2024-03-12T17:20:52.577 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/verify/tasks 2024-03-12T17:20:52.577 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/verify/tasks/libcephfs_interface_tests.yaml 2024-03-12T17:20:52.577 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/verify/tasks/cfuse_workunit_suites_fsstress.yaml 2024-03-12T17:20:52.577 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/verify/tasks/cfuse_workunit_suites_dbench.yaml 2024-03-12T17:20:52.577 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/multiclient 2024-03-12T17:20:52.578 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/multiclient/overrides 2024-03-12T17:20:52.578 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/multiclient/overrides/whitelist_wrongly_marked_down.yaml 2024-03-12T17:20:52.578 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/multiclient/overrides/debug.yaml 2024-03-12T17:20:52.578 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/multiclient/overrides/+ 2024-03-12T17:20:52.578 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/multiclient/overrides/frag_enable.yaml 2024-03-12T17:20:52.578 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/multiclient/clusters 2024-03-12T17:20:52.578 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/multiclient/clusters/three_clients.yaml 2024-03-12T17:20:52.578 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/multiclient/clusters/two_clients.yaml 2024-03-12T17:20:52.578 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/multiclient/objectstore 2024-03-12T17:20:52.578 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/multiclient/fs 2024-03-12T17:20:52.579 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/multiclient/fs/xfs.yaml 2024-03-12T17:20:52.579 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/multiclient/mount 2024-03-12T17:20:52.579 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/multiclient/mount/fuse.yaml 2024-03-12T17:20:52.579 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/multiclient/mount/kclient.yaml.disabled 2024-03-12T17:20:52.579 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/multiclient/begin.yaml 2024-03-12T17:20:52.579 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/multiclient/% 2024-03-12T17:20:52.579 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/multiclient/tasks 2024-03-12T17:20:52.579 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/multiclient/tasks/fsx-mpi.yaml.disabled 2024-03-12T17:20:52.579 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/multiclient/tasks/ior-shared-file.yaml 2024-03-12T17:20:52.579 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/multiclient/tasks/cephfs_misc_tests.yaml 2024-03-12T17:20:52.579 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/fs/multiclient/tasks/mdtest.yaml 2024-03-12T17:20:52.579 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-disk 2024-03-12T17:20:52.579 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-disk/basic 2024-03-12T17:20:52.580 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-disk/basic/distros 2024-03-12T17:20:52.580 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-disk/basic/% 2024-03-12T17:20:52.580 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-disk/basic/tasks 2024-03-12T17:20:52.580 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/ceph-disk/basic/tasks/ceph-disk.yaml 2024-03-12T17:20:52.580 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd 2024-03-12T17:20:52.580 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/unmap 2024-03-12T17:20:52.580 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/unmap/clusters 2024-03-12T17:20:52.580 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/unmap/clusters/separate-client.yaml 2024-03-12T17:20:52.580 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/unmap/ceph 2024-03-12T17:20:52.580 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/unmap/ceph/ceph.yaml 2024-03-12T17:20:52.580 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/unmap/kernels 2024-03-12T17:20:52.580 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/unmap/kernels/pre-single-major.yaml 2024-03-12T17:20:52.580 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/unmap/kernels/single-major-on.yaml 2024-03-12T17:20:52.580 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/unmap/kernels/single-major-off.yaml 2024-03-12T17:20:52.580 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/unmap/conf.yaml 2024-03-12T17:20:52.581 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/unmap/% 2024-03-12T17:20:52.581 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/unmap/xfs.yaml 2024-03-12T17:20:52.581 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/unmap/tasks 2024-03-12T17:20:52.581 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/unmap/tasks/unmap.yaml 2024-03-12T17:20:52.581 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd 2024-03-12T17:20:52.609 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd/clusters 2024-03-12T17:20:52.609 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd/clusters/fixed-3.yaml 2024-03-12T17:20:52.609 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd/msgr-failures 2024-03-12T17:20:52.609 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd/msgr-failures/many.yaml 2024-03-12T17:20:52.609 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd/msgr-failures/few.yaml 2024-03-12T17:20:52.609 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd/fs 2024-03-12T17:20:52.610 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd/fs/btrfs.yaml 2024-03-12T17:20:52.610 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd/conf.yaml 2024-03-12T17:20:52.610 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd/% 2024-03-12T17:20:52.610 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd/tasks 2024-03-12T17:20:52.610 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_fsstress.yaml 2024-03-12T17:20:52.610 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_fio.yaml 2024-03-12T17:20:52.610 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_ffsb.yaml 2024-03-12T17:20:52.610 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_fsstress_ext4.yaml 2024-03-12T17:20:52.610 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_iozone.yaml 2024-03-12T17:20:52.610 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_dbench.yaml 2024-03-12T17:20:52.610 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_kernel_untar_build.yaml 2024-03-12T17:20:52.610 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_trivial_sync.yaml 2024-03-12T17:20:52.610 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_fsstress_btrfs.yaml 2024-03-12T17:20:52.610 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_fsx.yaml 2024-03-12T17:20:52.611 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/singleton 2024-03-12T17:20:52.611 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/singleton/msgr-failures 2024-03-12T17:20:52.611 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/singleton/msgr-failures/many.yaml 2024-03-12T17:20:52.611 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/singleton/msgr-failures/few.yaml 2024-03-12T17:20:52.611 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/singleton/fs 2024-03-12T17:20:52.611 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/singleton/fs/btrfs.yaml 2024-03-12T17:20:52.611 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/singleton/conf.yaml 2024-03-12T17:20:52.611 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/singleton/% 2024-03-12T17:20:52.611 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/singleton/tasks 2024-03-12T17:20:52.611 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/singleton/tasks/rbd_xfstests.yaml 2024-03-12T17:20:52.611 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount 2024-03-12T17:20:52.611 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/install 2024-03-12T17:20:52.611 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/install/ceph.yaml 2024-03-12T17:20:52.611 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/clusters 2024-03-12T17:20:52.612 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/clusters/fixed-3.yaml 2024-03-12T17:20:52.612 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/msgr-failures 2024-03-12T17:20:52.612 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/msgr-failures/many.yaml 2024-03-12T17:20:52.612 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/msgr-failures/few.yaml 2024-03-12T17:20:52.612 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/fs 2024-03-12T17:20:52.612 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/fs/btrfs.yaml 2024-03-12T17:20:52.612 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/conf.yaml 2024-03-12T17:20:52.612 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/% 2024-03-12T17:20:52.612 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/tasks 2024-03-12T17:20:52.612 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_map_unmap.yaml 2024-03-12T17:20:52.612 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_kfsx.yaml 2024-03-12T17:20:52.612 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_image_read.yaml 2024-03-12T17:20:52.612 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_simple_big.yaml 2024-03-12T17:20:52.613 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_concurrent.yaml 2024-03-12T17:20:52.613 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_map_snapshot_io.yaml 2024-03-12T17:20:52.613 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_huge_tickets.yaml 2024-03-12T17:20:52.613 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_kernel.yaml 2024-03-12T17:20:52.613 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/thrash 2024-03-12T17:20:52.613 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/thrash/clusters 2024-03-12T17:20:52.613 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/thrash/clusters/fixed-3.yaml 2024-03-12T17:20:52.613 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/thrash/fs 2024-03-12T17:20:52.613 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/thrash/fs/btrfs.yaml 2024-03-12T17:20:52.613 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/thrash/workloads 2024-03-12T17:20:52.613 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/thrash/workloads/rbd_fio.yaml 2024-03-12T17:20:52.613 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/thrash/workloads/rbd_workunit_suites_ffsb.yaml 2024-03-12T17:20:52.613 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/thrash/workloads/rbd_workunit_suites_iozone.yaml.disabled 2024-03-12T17:20:52.613 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/thrash/conf.yaml 2024-03-12T17:20:52.613 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/thrash/% 2024-03-12T17:20:52.613 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/thrash/thrashers 2024-03-12T17:20:52.614 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/thrash/thrashers/default.yaml 2024-03-12T17:20:52.614 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/krbd/thrash/thrashers/mon-thrasher.yaml 2024-03-12T17:20:52.614 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/buildpackages 2024-03-12T17:20:52.614 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/buildpackages/tests 2024-03-12T17:20:52.614 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/buildpackages/tests/distros 2024-03-12T17:20:52.614 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/buildpackages/tests/% 2024-03-12T17:20:52.614 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/buildpackages/tests/tasks 2024-03-12T17:20:52.614 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/buildpackages/tests/tasks/release.yaml 2024-03-12T17:20:52.614 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/buildpackages/any 2024-03-12T17:20:52.614 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/buildpackages/any/distros 2024-03-12T17:20:52.614 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/buildpackages/any/% 2024-03-12T17:20:52.614 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/buildpackages/any/tasks 2024-03-12T17:20:52.614 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/buildpackages/any/tasks/release.yaml 2024-03-12T17:20:52.629 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados 2024-03-12T17:20:52.629 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/objectstore 2024-03-12T17:20:52.630 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/objectstore/filestore-idempotent-aio-journal.yaml 2024-03-12T17:20:52.630 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/objectstore/ceph_objectstore_tool.yaml 2024-03-12T17:20:52.630 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/objectstore/fusestore.yaml 2024-03-12T17:20:52.630 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/objectstore/keyvaluedb.yaml 2024-03-12T17:20:52.630 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/objectstore/objectstore.yaml 2024-03-12T17:20:52.630 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/objectstore/alloc-hint.yaml 2024-03-12T17:20:52.630 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/objectstore/filejournal.yaml 2024-03-12T17:20:52.630 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/objectstore/objectcacher-stress.yaml 2024-03-12T17:20:52.630 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/objectstore/filestore-idempotent.yaml 2024-03-12T17:20:52.630 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton 2024-03-12T17:20:52.630 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton/msgr 2024-03-12T17:20:52.630 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton/msgr-failures 2024-03-12T17:20:52.630 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton/msgr-failures/many.yaml 2024-03-12T17:20:52.630 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton/msgr-failures/few.yaml 2024-03-12T17:20:52.631 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton/objectstore 2024-03-12T17:20:52.631 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton/fs 2024-03-12T17:20:52.631 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton/fs/xfs.yaml 2024-03-12T17:20:52.631 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton/% 2024-03-12T17:20:52.631 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton/all 2024-03-12T17:20:52.631 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton/all/divergent_priors.yaml 2024-03-12T17:20:52.631 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton/all/watch-notify-same-primary.yaml 2024-03-12T17:20:52.631 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton/all/ec-lost-unfound.yaml 2024-03-12T17:20:52.631 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton/all/rest-api.yaml 2024-03-12T17:20:52.631 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton/all/mon-config-keys.yaml 2024-03-12T17:20:52.631 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton/all/mon-thrasher.yaml 2024-03-12T17:20:52.631 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton/all/osd-recovery-incomplete.yaml 2024-03-12T17:20:52.631 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton/all/osd-recovery.yaml 2024-03-12T17:20:52.631 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton/all/admin-socket.yaml 2024-03-12T17:20:52.631 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton/all/reg11184.yaml 2024-03-12T17:20:52.632 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton/all/mon-seesaw.yaml 2024-03-12T17:20:52.632 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton/all/radostool.yaml 2024-03-12T17:20:52.632 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton/all/thrash_cache_writeback_proxy_none.yaml 2024-03-12T17:20:52.632 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton/all/dump-stuck.yaml 2024-03-12T17:20:52.632 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton/all/resolve_stuck_peering.yaml 2024-03-12T17:20:52.632 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton/all/osd-backfill.yaml 2024-03-12T17:20:52.632 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton/all/divergent_priors2.yaml 2024-03-12T17:20:52.632 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton/all/peer.yaml 2024-03-12T17:20:52.632 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton/all/test_envlibrados_for_rocksdb.yaml 2024-03-12T17:20:52.632 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton/all/thrash-rados.yaml 2024-03-12T17:20:52.632 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton/all/lost-unfound.yaml 2024-03-12T17:20:52.632 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton/all/cephtool.yaml 2024-03-12T17:20:52.632 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton/all/pg-removal-interruption.yaml 2024-03-12T17:20:52.632 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton/all/rebuild-mondb.yaml 2024-03-12T17:20:52.632 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton/all/lost-unfound-delete.yaml 2024-03-12T17:20:52.633 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton/rados.yaml 2024-03-12T17:20:52.633 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/basic 2024-03-12T17:20:52.633 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/basic/msgr 2024-03-12T17:20:52.633 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/basic/msgr/async.yaml 2024-03-12T17:20:52.633 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/basic/msgr/simple.yaml 2024-03-12T17:20:52.633 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/basic/msgr/random.yaml 2024-03-12T17:20:52.633 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/basic/clusters 2024-03-12T17:20:52.633 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/basic/clusters/openstack.yaml 2024-03-12T17:20:52.633 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/basic/clusters/fixed-2.yaml 2024-03-12T17:20:52.633 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/basic/clusters/+ 2024-03-12T17:20:52.633 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/basic/msgr-failures 2024-03-12T17:20:52.633 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/basic/msgr-failures/many.yaml 2024-03-12T17:20:52.633 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/basic/msgr-failures/few.yaml 2024-03-12T17:20:52.633 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/basic/objectstore 2024-03-12T17:20:52.634 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/basic/fs 2024-03-12T17:20:52.634 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/basic/fs/btrfs.yaml 2024-03-12T17:20:52.634 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/basic/fs/xfs.yaml 2024-03-12T17:20:52.634 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/basic/% 2024-03-12T17:20:52.634 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/basic/mon_kv_backend 2024-03-12T17:20:52.634 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/basic/tasks 2024-03-12T17:20:52.634 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/basic/tasks/readwrite.yaml 2024-03-12T17:20:52.634 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/basic/tasks/rados_cls_all.yaml 2024-03-12T17:20:52.634 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/basic/tasks/rados_workunit_loadgen_mostlyread.yaml 2024-03-12T17:20:52.634 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/basic/tasks/rados_stress_watch.yaml 2024-03-12T17:20:52.634 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/basic/tasks/rados_workunit_loadgen_big.yaml 2024-03-12T17:20:52.634 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/basic/tasks/scrub_test.yaml 2024-03-12T17:20:52.651 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/basic/tasks/rados_workunit_loadgen_mix.yaml 2024-03-12T17:20:52.651 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/basic/tasks/rados_python.yaml 2024-03-12T17:20:52.651 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/basic/tasks/repair_test.yaml 2024-03-12T17:20:52.652 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/basic/tasks/rados_api_tests.yaml 2024-03-12T17:20:52.652 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/basic/tasks/rgw_snaps.yaml 2024-03-12T17:20:52.652 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/basic/tasks/rados_striper.yaml 2024-03-12T17:20:52.652 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/basic/rados.yaml 2024-03-12T17:20:52.652 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec 2024-03-12T17:20:52.652 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/leveldb.yaml 2024-03-12T17:20:52.652 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/clusters 2024-03-12T17:20:52.652 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/clusters/openstack.yaml 2024-03-12T17:20:52.652 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/clusters/+ 2024-03-12T17:20:52.652 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/clusters/fixed-4.yaml 2024-03-12T17:20:52.652 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/msgr-failures 2024-03-12T17:20:52.652 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/objectstore 2024-03-12T17:20:52.653 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/fs 2024-03-12T17:20:52.653 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/fs/xfs.yaml 2024-03-12T17:20:52.653 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/workloads 2024-03-12T17:20:52.653 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml 2024-03-12T17:20:52.653 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/% 2024-03-12T17:20:52.653 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/thrashers 2024-03-12T17:20:52.653 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/thrashers/default.yaml 2024-03-12T17:20:52.653 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/rados.yaml 2024-03-12T17:20:52.653 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code 2024-03-12T17:20:52.653 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/fast 2024-03-12T17:20:52.653 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/fast/normal.yaml 2024-03-12T17:20:52.654 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/fast/fast.yaml 2024-03-12T17:20:52.654 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/leveldb.yaml 2024-03-12T17:20:52.654 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/clusters 2024-03-12T17:20:52.654 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/msgr-failures 2024-03-12T17:20:52.654 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/objectstore 2024-03-12T17:20:52.654 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/fs 2024-03-12T17:20:52.654 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads 2024-03-12T17:20:52.654 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-small-objects-fast-read-overwrites.yaml 2024-03-12T17:20:52.654 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-small-objects-overwrites.yaml 2024-03-12T17:20:52.654 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-rados-plugin=jerasure-k=3-m=1.yaml 2024-03-12T17:20:52.654 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-snaps-few-objects-overwrites.yaml 2024-03-12T17:20:52.654 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-radosbench.yaml 2024-03-12T17:20:52.655 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-rados-plugin=jerasure-k=2-m=1.yaml 2024-03-12T17:20:52.655 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-small-objects.yaml 2024-03-12T17:20:52.655 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-small-objects-fast-read.yaml 2024-03-12T17:20:52.655 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-pool-snaps-few-objects-overwrites.yaml 2024-03-12T17:20:52.655 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/% 2024-03-12T17:20:52.655 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/thrashers 2024-03-12T17:20:52.655 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/thrashers/default.yaml 2024-03-12T17:20:52.655 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/thrashers/fastread.yaml 2024-03-12T17:20:52.655 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/thrashers/morepggrow.yaml 2024-03-12T17:20:52.655 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/thrashers/pggrow.yaml 2024-03-12T17:20:52.655 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/thrashers/mapgap.yaml 2024-03-12T17:20:52.655 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code/rados.yaml 2024-03-12T17:20:52.655 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton-nomsgr 2024-03-12T17:20:52.656 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton-nomsgr/% 2024-03-12T17:20:52.656 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton-nomsgr/all 2024-03-12T17:20:52.656 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton-nomsgr/all/multi-backfill-reject.yaml 2024-03-12T17:20:52.656 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton-nomsgr/all/full-tiering.yaml 2024-03-12T17:20:52.656 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton-nomsgr/all/cache-fs-trunc.yaml 2024-03-12T17:20:52.656 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton-nomsgr/all/msgr.yaml 2024-03-12T17:20:52.656 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton-nomsgr/all/ceph-post-file.yaml 2024-03-12T17:20:52.656 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton-nomsgr/all/export-after-evict.yaml 2024-03-12T17:20:52.656 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton-nomsgr/all/valgrind-leaks.yaml 2024-03-12T17:20:52.693 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/singleton-nomsgr/rados.yaml 2024-03-12T17:20:52.693 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/upgrade 2024-03-12T17:20:52.693 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton 2024-03-12T17:20:52.693 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/6-next-mon 2024-03-12T17:20:52.693 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/6-next-mon/monb.yaml 2024-03-12T17:20:52.693 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/8-next-mon 2024-03-12T17:20:52.693 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/8-next-mon/monc.yaml 2024-03-12T17:20:52.694 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/1-jewel-install 2024-03-12T17:20:52.694 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/1-jewel-install/jewel.yaml 2024-03-12T17:20:52.694 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/5-workload 2024-03-12T17:20:52.694 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/5-workload/readwrite.yaml 2024-03-12T17:20:52.694 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/5-workload/snaps-few-objects.yaml 2024-03-12T17:20:52.694 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/5-workload/rbd-cls.yaml 2024-03-12T17:20:52.694 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/5-workload/rbd-import-export.yaml 2024-03-12T17:20:52.694 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/5-workload/+ 2024-03-12T17:20:52.694 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/4-mon 2024-03-12T17:20:52.694 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/4-mon/mona.yaml 2024-03-12T17:20:52.694 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/% 2024-03-12T17:20:52.695 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/9-workload 2024-03-12T17:20:52.695 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/9-workload/rbd-python.yaml 2024-03-12T17:20:52.695 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/9-workload/rgw-swift.yaml 2024-03-12T17:20:52.695 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/9-workload/snaps-many-objects.yaml 2024-03-12T17:20:52.695 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/9-workload/+ 2024-03-12T17:20:52.695 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/2-partial-upgrade 2024-03-12T17:20:52.695 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/2-partial-upgrade/firsthalf.yaml 2024-03-12T17:20:52.695 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/3-thrash 2024-03-12T17:20:52.695 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/3-thrash/default.yaml 2024-03-12T17:20:52.695 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/7-workload 2024-03-12T17:20:52.695 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/7-workload/radosbench.yaml 2024-03-12T17:20:52.696 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/7-workload/rbd_api.yaml 2024-03-12T17:20:52.696 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/7-workload/+ 2024-03-12T17:20:52.696 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/0-cluster 2024-03-12T17:20:52.696 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/0-cluster/openstack.yaml 2024-03-12T17:20:52.696 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/0-cluster/+ 2024-03-12T17:20:52.696 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/0-cluster/start.yaml 2024-03-12T17:20:52.696 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/monthrash 2024-03-12T17:20:52.696 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/monthrash/msgr 2024-03-12T17:20:52.696 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/monthrash/clusters 2024-03-12T17:20:52.696 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/monthrash/clusters/3-mons.yaml 2024-03-12T17:20:52.696 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/monthrash/clusters/9-mons.yaml 2024-03-12T17:20:52.696 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/monthrash/msgr-failures 2024-03-12T17:20:52.696 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/monthrash/msgr-failures/mon-delay.yaml 2024-03-12T17:20:52.697 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/monthrash/msgr-failures/few.yaml 2024-03-12T17:20:52.697 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/monthrash/objectstore 2024-03-12T17:20:52.697 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/monthrash/fs 2024-03-12T17:20:52.697 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/monthrash/fs/xfs.yaml 2024-03-12T17:20:52.697 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/monthrash/workloads 2024-03-12T17:20:52.697 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/monthrash/workloads/pool-create-delete.yaml 2024-03-12T17:20:52.697 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/monthrash/workloads/snaps-few-objects.yaml 2024-03-12T17:20:52.697 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/monthrash/workloads/rados_mon_workunits.yaml 2024-03-12T17:20:52.697 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/monthrash/workloads/rados_5925.yaml 2024-03-12T17:20:52.697 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/monthrash/workloads/rados_api_tests.yaml 2024-03-12T17:20:52.697 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/monthrash/ceph 2024-03-12T17:20:52.697 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/monthrash/ceph/ceph.yaml 2024-03-12T17:20:52.698 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/monthrash/% 2024-03-12T17:20:52.698 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/monthrash/mon_kv_backend 2024-03-12T17:20:52.698 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/monthrash/thrashers 2024-03-12T17:20:52.698 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/monthrash/thrashers/many.yaml 2024-03-12T17:20:52.698 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/monthrash/thrashers/one.yaml 2024-03-12T17:20:52.698 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/monthrash/thrashers/sync.yaml 2024-03-12T17:20:52.698 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/monthrash/thrashers/sync-many.yaml 2024-03-12T17:20:52.698 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/monthrash/thrashers/force-sync-many.yaml 2024-03-12T17:20:52.698 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/monthrash/rados.yaml 2024-03-12T17:20:52.731 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash 2024-03-12T17:20:52.731 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/msgr 2024-03-12T17:20:52.731 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/clusters 2024-03-12T17:20:52.731 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/clusters/openstack.yaml 2024-03-12T17:20:52.731 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/clusters/fixed-2.yaml 2024-03-12T17:20:52.732 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/clusters/+ 2024-03-12T17:20:52.732 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/1-pg-log-overrides 2024-03-12T17:20:52.732 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/1-pg-log-overrides/normal_pg_log.yaml 2024-03-12T17:20:52.732 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/1-pg-log-overrides/short_pg_log.yaml 2024-03-12T17:20:52.732 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/msgr-failures 2024-03-12T17:20:52.732 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/msgr-failures/few.yaml 2024-03-12T17:20:52.732 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/msgr-failures/fastclose.yaml 2024-03-12T17:20:52.732 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/msgr-failures/osd-delay.yaml 2024-03-12T17:20:52.732 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/0-size-min-size-overrides 2024-03-12T17:20:52.732 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/0-size-min-size-overrides/3-size-2-min-size.yaml 2024-03-12T17:20:52.732 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/0-size-min-size-overrides/2-size-2-min-size.yaml 2024-03-12T17:20:52.732 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/0-size-min-size-overrides/2-size-1-min-size.yaml 2024-03-12T17:20:52.733 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/objectstore 2024-03-12T17:20:52.733 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/fs 2024-03-12T17:20:52.733 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/fs/btrfs.yaml 2024-03-12T17:20:52.733 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/fs/xfs.yaml 2024-03-12T17:20:52.733 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/workloads 2024-03-12T17:20:52.733 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/workloads/radosbench.yaml 2024-03-12T17:20:52.733 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/workloads/cache-agent-big.yaml 2024-03-12T17:20:52.733 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/workloads/cache.yaml 2024-03-12T17:20:52.733 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/workloads/cache-agent-small.yaml 2024-03-12T17:20:52.733 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/workloads/snaps-few-objects.yaml 2024-03-12T17:20:52.733 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/workloads/write_fadvise_dontneed.yaml 2024-03-12T17:20:52.733 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/workloads/cache-pool-snaps.yaml 2024-03-12T17:20:52.734 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/workloads/admin_socket_objecter_requests.yaml 2024-03-12T17:20:52.734 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/workloads/cache-pool-snaps-readproxy.yaml 2024-03-12T17:20:52.734 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/workloads/cache-snaps.yaml 2024-03-12T17:20:52.734 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/workloads/pool-snaps-few-objects.yaml 2024-03-12T17:20:52.734 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/workloads/rados_api_tests.yaml 2024-03-12T17:20:52.734 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/workloads/small-objects.yaml 2024-03-12T17:20:52.734 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/hobj-sort.yaml 2024-03-12T17:20:52.734 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/% 2024-03-12T17:20:52.734 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/thrashers 2024-03-12T17:20:52.734 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/thrashers/default.yaml 2024-03-12T17:20:52.734 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/thrashers/morepggrow.yaml 2024-03-12T17:20:52.734 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/thrashers/pggrow.yaml 2024-03-12T17:20:52.735 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/thrashers/mapgap.yaml 2024-03-12T17:20:52.735 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/rocksdb.yaml 2024-03-12T17:20:52.735 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash/rados.yaml 2024-03-12T17:20:52.735 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/verify 2024-03-12T17:20:52.735 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/verify/msgr 2024-03-12T17:20:52.735 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/verify/validater 2024-03-12T17:20:52.735 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/verify/validater/valgrind.yaml 2024-03-12T17:20:52.735 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/verify/validater/lockdep.yaml 2024-03-12T17:20:52.735 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/verify/clusters 2024-03-12T17:20:52.735 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/verify/clusters/openstack.yaml 2024-03-12T17:20:52.735 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/verify/clusters/fixed-2.yaml 2024-03-12T17:20:52.735 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/verify/clusters/+ 2024-03-12T17:20:52.736 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/verify/msgr-failures 2024-03-12T17:20:52.736 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/verify/msgr-failures/few.yaml 2024-03-12T17:20:52.736 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/verify/objectstore 2024-03-12T17:20:52.736 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/verify/fs 2024-03-12T17:20:52.736 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/verify/fs/btrfs.yaml 2024-03-12T17:20:52.736 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/verify/1thrash 2024-03-12T17:20:52.736 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/verify/1thrash/default.yaml 2024-03-12T17:20:52.736 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/verify/1thrash/none.yaml 2024-03-12T17:20:52.736 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/verify/% 2024-03-12T17:20:52.736 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/verify/mon_kv_backend 2024-03-12T17:20:52.736 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/verify/tasks 2024-03-12T17:20:52.736 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/verify/tasks/rados_cls_all.yaml 2024-03-12T17:20:52.736 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/verify/tasks/mon_recovery.yaml 2024-03-12T17:20:52.736 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/verify/tasks/rados_api_tests.yaml 2024-03-12T17:20:52.737 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/verify/rados.yaml 2024-03-12T17:20:52.737 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/multimon 2024-03-12T17:20:52.737 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/multimon/msgr 2024-03-12T17:20:52.737 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/multimon/clusters 2024-03-12T17:20:52.737 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/multimon/clusters/21.yaml 2024-03-12T17:20:52.737 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/multimon/clusters/9.yaml 2024-03-12T17:20:52.763 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/multimon/clusters/3.yaml 2024-03-12T17:20:52.764 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/multimon/clusters/6.yaml 2024-03-12T17:20:52.764 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/multimon/msgr-failures 2024-03-12T17:20:52.764 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/multimon/msgr-failures/many.yaml 2024-03-12T17:20:52.764 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/multimon/msgr-failures/few.yaml 2024-03-12T17:20:52.764 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/multimon/objectstore 2024-03-12T17:20:52.764 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/multimon/fs 2024-03-12T17:20:52.764 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/multimon/fs/xfs.yaml 2024-03-12T17:20:52.764 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/multimon/% 2024-03-12T17:20:52.764 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/multimon/mon_kv_backend 2024-03-12T17:20:52.764 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/multimon/tasks 2024-03-12T17:20:52.764 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/multimon/tasks/mon_clock_with_skews.yaml 2024-03-12T17:20:52.764 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/multimon/tasks/mon_recovery.yaml 2024-03-12T17:20:52.765 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/multimon/tasks/mon_clock_no_skews.yaml 2024-03-12T17:20:52.765 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/multimon/rados.yaml 2024-03-12T17:20:52.765 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa 2024-03-12T17:20:52.765 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/leveldb.yaml 2024-03-12T17:20:52.765 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/clusters 2024-03-12T17:20:52.765 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/msgr-failures 2024-03-12T17:20:52.765 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/objectstore 2024-03-12T17:20:52.765 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/supported 2024-03-12T17:20:52.765 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/fs 2024-03-12T17:20:52.765 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/workloads 2024-03-12T17:20:52.765 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/workloads/ec-rados-plugin=isa-k=2-m=1.yaml 2024-03-12T17:20:52.765 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/arch 2024-03-12T17:20:52.765 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/arch/x86_64.yaml 2024-03-12T17:20:52.766 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/% 2024-03-12T17:20:52.766 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/thrashers 2024-03-12T17:20:52.766 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/rados.yaml 2024-03-12T17:20:52.766 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big 2024-03-12T17:20:52.766 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/cluster 2024-03-12T17:20:52.766 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/cluster/openstack.yaml 2024-03-12T17:20:52.766 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/cluster/12-osds.yaml 2024-03-12T17:20:52.766 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/cluster/+ 2024-03-12T17:20:52.766 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/leveldb.yaml 2024-03-12T17:20:52.766 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/msgr-failures 2024-03-12T17:20:52.766 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/objectstore 2024-03-12T17:20:52.766 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/fs 2024-03-12T17:20:52.766 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/workloads 2024-03-12T17:20:52.767 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml 2024-03-12T17:20:52.767 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/% 2024-03-12T17:20:52.767 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/thrashers 2024-03-12T17:20:52.767 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/thrashers/default.yaml 2024-03-12T17:20:52.767 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/thrashers/fastread.yaml 2024-03-12T17:20:52.767 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/thrashers/morepggrow.yaml 2024-03-12T17:20:52.767 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/thrashers/pggrow.yaml 2024-03-12T17:20:52.767 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/thrashers/mapgap.yaml 2024-03-12T17:20:52.767 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/rados/thrash-erasure-code-big/rados.yaml 2024-03-12T17:20:52.767 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/knfs 2024-03-12T17:20:52.767 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/knfs/basic 2024-03-12T17:20:52.767 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/knfs/basic/clusters 2024-03-12T17:20:52.767 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/knfs/basic/clusters/extra-client.yaml 2024-03-12T17:20:52.767 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/knfs/basic/fs 2024-03-12T17:20:52.768 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/knfs/basic/fs/xfs.yaml 2024-03-12T17:20:52.768 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/knfs/basic/mount 2024-03-12T17:20:52.768 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/knfs/basic/mount/v4.yaml 2024-03-12T17:20:52.768 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/knfs/basic/mount/v3.yaml 2024-03-12T17:20:52.768 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/knfs/basic/ceph 2024-03-12T17:20:52.768 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/knfs/basic/ceph/base.yaml 2024-03-12T17:20:52.768 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/knfs/basic/% 2024-03-12T17:20:52.768 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/knfs/basic/tasks 2024-03-12T17:20:52.768 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/knfs/basic/tasks/nfs_workunit_suites_dbench.yaml 2024-03-12T17:20:52.768 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/knfs/basic/tasks/nfs-workunit-kernel-untar-build.yaml 2024-03-12T17:20:52.768 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/knfs/basic/tasks/nfs_workunit_suites_ffsb.yaml 2024-03-12T17:20:52.768 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/knfs/basic/tasks/nfs_workunit_suites_blogbench.yaml 2024-03-12T17:20:52.768 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/knfs/basic/tasks/nfs_workunit_misc.yaml 2024-03-12T17:20:52.768 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/knfs/basic/tasks/nfs_workunit_suites_fsstress.yaml 2024-03-12T17:20:52.768 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/knfs/basic/tasks/nfs_workunit_suites_iozone.yaml 2024-03-12T17:20:52.768 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/experimental 2024-03-12T17:20:52.821 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/experimental/multimds 2024-03-12T17:20:52.822 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/experimental/multimds/clusters 2024-03-12T17:20:52.822 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/experimental/multimds/clusters/7-multimds.yaml 2024-03-12T17:20:52.822 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/experimental/multimds/% 2024-03-12T17:20:52.822 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/experimental/multimds/tasks 2024-03-12T17:20:52.822 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/experimental/multimds/tasks/fsstress_thrash_subtrees.yaml 2024-03-12T17:20:52.822 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal 2024-03-12T17:20:52.822 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/fs-misc 2024-03-12T17:20:52.822 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/fs-misc/clusters 2024-03-12T17:20:52.822 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/fs-misc/clusters/two_clients.yaml 2024-03-12T17:20:52.822 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/fs-misc/fs 2024-03-12T17:20:52.822 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/fs-misc/fs/btrfs.yaml 2024-03-12T17:20:52.822 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/fs-misc/% 2024-03-12T17:20:52.823 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/fs-misc/tasks 2024-03-12T17:20:52.823 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/fs-misc/tasks/locktest.yaml 2024-03-12T17:20:52.823 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/basic 2024-03-12T17:20:52.823 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/basic/clusters 2024-03-12T17:20:52.823 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/basic/clusters/fixed-3.yaml 2024-03-12T17:20:52.823 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/basic/fs 2024-03-12T17:20:52.823 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/basic/fs/btrfs.yaml 2024-03-12T17:20:52.823 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/basic/% 2024-03-12T17:20:52.823 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/basic/tasks 2024-03-12T17:20:52.823 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/basic/tasks/kclient_workunit_suites_blogbench.yaml 2024-03-12T17:20:52.823 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/basic/tasks/kclient_workunit_suites_fsx.yaml 2024-03-12T17:20:52.823 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/mds_restart 2024-03-12T17:20:52.824 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/mds_restart/clusters 2024-03-12T17:20:52.824 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/mds_restart/clusters/one_mds.yaml 2024-03-12T17:20:52.824 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/mds_restart/% 2024-03-12T17:20:52.824 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/mds_restart/tasks 2024-03-12T17:20:52.824 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/mds_restart/tasks/restart-workunit-backtraces.yaml 2024-03-12T17:20:52.824 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/multimds 2024-03-12T17:20:52.824 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/multimds/clusters 2024-03-12T17:20:52.824 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/multimds/clusters/3-node-3-mds.yaml 2024-03-12T17:20:52.824 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/multimds/clusters/3-node-9-mds.yaml 2024-03-12T17:20:52.824 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/multimds/fs 2024-03-12T17:20:52.824 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/multimds/fs/btrfs.yaml 2024-03-12T17:20:52.824 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/multimds/% 2024-03-12T17:20:52.824 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/multimds/mounts 2024-03-12T17:20:52.824 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/multimds/mounts/ceph-fuse.yaml 2024-03-12T17:20:52.824 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/multimds/mounts/kclient.yaml 2024-03-12T17:20:52.825 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/multimds/tasks 2024-03-12T17:20:52.825 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_suites_pjd.yaml 2024-03-12T17:20:52.825 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_suites_fsstress.yaml 2024-03-12T17:20:52.825 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_suites_truncate_delay.yaml 2024-03-12T17:20:52.825 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_misc.yaml 2024-03-12T17:20:52.825 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_suites_blogbench.yaml 2024-03-12T17:20:52.825 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_suites_fsync.yaml 2024-03-12T17:20:52.825 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_suites_dbench.yaml 2024-03-12T17:20:52.825 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/multimds/thrash 2024-03-12T17:20:52.825 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/multimds/thrash/normal.yaml 2024-03-12T17:20:52.825 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/marginal/multimds/thrash/exports.yaml 2024-03-12T17:20:52.825 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs 2024-03-12T17:20:52.826 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/cephfs 2024-03-12T17:20:52.826 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/clusters 2024-03-12T17:20:52.826 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/clusters/fixed-3-cephfs.yaml 2024-03-12T17:20:52.827 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/fs 2024-03-12T17:20:52.827 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/fs/xfs.yaml 2024-03-12T17:20:52.827 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/inline 2024-03-12T17:20:52.827 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/inline/yes.yaml 2024-03-12T17:20:52.827 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/inline/no.yaml 2024-03-12T17:20:52.827 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/conf.yaml 2024-03-12T17:20:52.827 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/% 2024-03-12T17:20:52.827 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks 2024-03-12T17:20:52.827 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_misc.yaml 2024-03-12T17:20:52.827 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_fsstress.yaml 2024-03-12T17:20:52.827 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_trivial_sync.yaml 2024-03-12T17:20:52.827 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_snaps.yaml 2024-03-12T17:20:52.827 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_direct_io.yaml 2024-03-12T17:20:52.828 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_fsx.yaml 2024-03-12T17:20:52.828 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_kernel_untar_build.yaml 2024-03-12T17:20:52.828 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_ffsb.yaml 2024-03-12T17:20:52.865 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_dbench.yaml 2024-03-12T17:20:52.865 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_fsync.yaml 2024-03-12T17:20:52.865 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_pjd.yaml 2024-03-12T17:20:52.865 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_iozone.yaml 2024-03-12T17:20:52.865 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_o_trunc.yaml 2024-03-12T17:20:52.865 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/mixed-clients 2024-03-12T17:20:52.865 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/mixed-clients/clusters 2024-03-12T17:20:52.865 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/mixed-clients/clusters/2-clients.yaml 2024-03-12T17:20:52.865 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/mixed-clients/fs 2024-03-12T17:20:52.865 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/mixed-clients/fs/xfs.yaml 2024-03-12T17:20:52.866 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/mixed-clients/conf.yaml 2024-03-12T17:20:52.866 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/mixed-clients/% 2024-03-12T17:20:52.866 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/mixed-clients/tasks 2024-03-12T17:20:52.866 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/mixed-clients/tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml 2024-03-12T17:20:52.866 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/mixed-clients/tasks/kernel_cfuse_workunits_dbench_iozone.yaml 2024-03-12T17:20:52.866 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/recovery 2024-03-12T17:20:52.866 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/recovery/dirfrag 2024-03-12T17:20:52.866 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/recovery/dirfrag/frag_enable.yaml 2024-03-12T17:20:52.866 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/recovery/clusters 2024-03-12T17:20:52.866 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/recovery/clusters/4-remote-clients.yaml 2024-03-12T17:20:52.866 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/recovery/% 2024-03-12T17:20:52.866 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/recovery/mounts 2024-03-12T17:20:52.866 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/recovery/mounts/kmounts.yaml 2024-03-12T17:20:52.866 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/recovery/xfs.yaml 2024-03-12T17:20:52.867 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks 2024-03-12T17:20:52.867 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/backtrace.yaml 2024-03-12T17:20:52.867 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/forward-scrub.yaml 2024-03-12T17:20:52.867 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/volume-client.yaml 2024-03-12T17:20:52.867 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/config-commands.yaml 2024-03-12T17:20:52.867 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/sessionmap.yaml 2024-03-12T17:20:52.867 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/failover.yaml.disabled 2024-03-12T17:20:52.867 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/data-scan.yaml 2024-03-12T17:20:52.867 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/mds-flush.yaml 2024-03-12T17:20:52.867 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/auto-repair.yaml 2024-03-12T17:20:52.867 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/damage.yaml 2024-03-12T17:20:52.867 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/client-recovery.yaml 2024-03-12T17:20:52.867 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/journal-repair.yaml 2024-03-12T17:20:52.867 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/client-limits.yaml 2024-03-12T17:20:52.867 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/strays.yaml.disabled 2024-03-12T17:20:52.868 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/recovery/tasks/pool-perm.yaml 2024-03-12T17:20:52.868 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/recovery/debug 2024-03-12T17:20:52.868 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/recovery/debug/mds_client.yaml 2024-03-12T17:20:52.868 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/thrash 2024-03-12T17:20:52.868 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/thrash/clusters 2024-03-12T17:20:52.868 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/thrash/clusters/fixed-3-cephfs.yaml 2024-03-12T17:20:52.868 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/thrash/fs 2024-03-12T17:20:52.868 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/thrash/fs/xfs.yaml 2024-03-12T17:20:52.868 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/thrash/workloads 2024-03-12T17:20:52.868 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/thrash/workloads/kclient_workunit_suites_ffsb.yaml 2024-03-12T17:20:52.868 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/thrash/workloads/kclient_workunit_suites_iozone.yaml 2024-03-12T17:20:52.868 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/thrash/conf.yaml 2024-03-12T17:20:52.868 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/thrash/% 2024-03-12T17:20:52.868 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/thrash/thrashers 2024-03-12T17:20:52.868 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/thrash/thrashers/default.yaml 2024-03-12T17:20:52.868 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/thrash/thrashers/mon.yaml 2024-03-12T17:20:52.869 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/kcephfs/thrash/thrashers/mds.yaml 2024-03-12T17:20:52.869 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade 2024-03-12T17:20:52.869 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x 2024-03-12T17:20:52.869 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/point-to-point-x 2024-03-12T17:20:52.869 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/point-to-point-x/point-to-point-upgrade.yaml 2024-03-12T17:20:52.869 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/point-to-point-x/distros 2024-03-12T17:20:52.869 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/point-to-point-x/distros/centos_7.2.yaml 2024-03-12T17:20:52.869 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/point-to-point-x/distros/ubuntu_14.04.yaml 2024-03-12T17:20:52.869 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/point-to-point-x/% 2024-03-12T17:20:52.869 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel 2024-03-12T17:20:52.869 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/kraken.yaml 2024-03-12T17:20:52.869 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/1-jewel-install 2024-03-12T17:20:52.869 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/1-jewel-install/jewel.yaml 2024-03-12T17:20:52.892 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/4-kraken.yaml 2024-03-12T17:20:52.892 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/3-upgrade-sequence 2024-03-12T17:20:52.892 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/3-upgrade-sequence/upgrade-all.yaml 2024-03-12T17:20:52.892 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/3-upgrade-sequence/upgrade-mon-osd-mds.yaml 2024-03-12T17:20:52.892 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/distros 2024-03-12T17:20:52.892 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/% 2024-03-12T17:20:52.892 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload 2024-03-12T17:20:52.892 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/test_rbd_python.yaml 2024-03-12T17:20:52.892 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/blogbench.yaml 2024-03-12T17:20:52.893 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/rados_api.yaml 2024-03-12T17:20:52.893 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/rados_loadgenbig.yaml 2024-03-12T17:20:52.893 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/ec-rados-default.yaml 2024-03-12T17:20:52.893 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/+ 2024-03-12T17:20:52.893 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/test_rbd_api.yaml 2024-03-12T17:20:52.893 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/0-cluster 2024-03-12T17:20:52.893 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/0-cluster/openstack.yaml 2024-03-12T17:20:52.893 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/0-cluster/+ 2024-03-12T17:20:52.893 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/0-cluster/start.yaml 2024-03-12T17:20:52.893 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload 2024-03-12T17:20:52.893 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/blogbench.yaml 2024-03-12T17:20:52.893 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/rados-snaps-few-objects.yaml 2024-03-12T17:20:52.893 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/+ 2024-03-12T17:20:52.893 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/rados_loadgenmix.yaml 2024-03-12T17:20:52.894 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/rbd_cls.yaml 2024-03-12T17:20:52.894 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/rados_mon_thrash.yaml 2024-03-12T17:20:52.894 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/rgw_swift.yaml 2024-03-12T17:20:52.894 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/rbd_import_export.yaml 2024-03-12T17:20:52.894 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split 2024-03-12T17:20:52.894 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/6-next-mon 2024-03-12T17:20:52.894 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/6-next-mon/monb.yaml 2024-03-12T17:20:52.894 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/8-next-mon 2024-03-12T17:20:52.894 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/8-next-mon/monc.yaml 2024-03-12T17:20:52.894 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/1-jewel-install 2024-03-12T17:20:52.894 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/1-jewel-install/jewel.yaml 2024-03-12T17:20:52.894 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/5-workload 2024-03-12T17:20:52.894 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/5-workload/readwrite.yaml 2024-03-12T17:20:52.894 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/5-workload/snaps-few-objects.yaml 2024-03-12T17:20:52.895 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/5-workload/rbd-cls.yaml 2024-03-12T17:20:52.895 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/5-workload/rbd-import-export.yaml 2024-03-12T17:20:52.895 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/5-workload/+ 2024-03-12T17:20:52.895 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/4-mon 2024-03-12T17:20:52.895 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/4-mon/mona.yaml 2024-03-12T17:20:52.895 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/distros 2024-03-12T17:20:52.895 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/% 2024-03-12T17:20:52.895 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/9-workload 2024-03-12T17:20:52.895 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/9-workload/rbd-python.yaml 2024-03-12T17:20:52.895 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/9-workload/rgw-swift.yaml 2024-03-12T17:20:52.895 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/9-workload/snaps-many-objects.yaml 2024-03-12T17:20:52.895 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/9-workload/+ 2024-03-12T17:20:52.895 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/2-partial-upgrade 2024-03-12T17:20:52.895 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/2-partial-upgrade/firsthalf.yaml 2024-03-12T17:20:52.896 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/3-thrash 2024-03-12T17:20:52.896 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/3-thrash/default.yaml 2024-03-12T17:20:52.896 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/7-workload 2024-03-12T17:20:52.896 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/7-workload/radosbench.yaml 2024-03-12T17:20:52.896 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/7-workload/rbd_api.yaml 2024-03-12T17:20:52.896 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/7-workload/+ 2024-03-12T17:20:52.924 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/0-cluster 2024-03-12T17:20:52.924 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/0-cluster/openstack.yaml 2024-03-12T17:20:52.924 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/0-cluster/+ 2024-03-12T17:20:52.924 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/0-cluster/start.yaml 2024-03-12T17:20:52.925 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64 2024-03-12T17:20:52.925 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/6-next-mon 2024-03-12T17:20:52.925 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/8-next-mon 2024-03-12T17:20:52.925 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/1-jewel-install 2024-03-12T17:20:52.925 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/5-workload 2024-03-12T17:20:52.925 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/5-workload/ec-rados-default.yaml 2024-03-12T17:20:52.925 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/4-mon 2024-03-12T17:20:52.925 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/% 2024-03-12T17:20:52.925 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/0-x86_64.yaml 2024-03-12T17:20:52.925 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/9-workload 2024-03-12T17:20:52.925 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/9-workload/ec-rados-plugin=jerasure-k=3-m=1.yaml 2024-03-12T17:20:52.925 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/2-partial-upgrade 2024-03-12T17:20:52.925 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/3-thrash 2024-03-12T17:20:52.925 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/3-thrash/default.yaml 2024-03-12T17:20:52.926 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/0-cluster 2024-03-12T17:20:52.926 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code 2024-03-12T17:20:52.926 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/6-next-mon 2024-03-12T17:20:52.926 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/8-next-mon 2024-03-12T17:20:52.926 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/1-jewel-install 2024-03-12T17:20:52.926 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/5-workload 2024-03-12T17:20:52.926 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/5-workload/ec-rados-default.yaml 2024-03-12T17:20:52.926 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/4-mon 2024-03-12T17:20:52.926 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/distros 2024-03-12T17:20:52.926 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/% 2024-03-12T17:20:52.926 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/9-workload 2024-03-12T17:20:52.926 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/9-workload/ec-rados-plugin=jerasure-k=3-m=1.yaml 2024-03-12T17:20:52.926 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/2-partial-upgrade 2024-03-12T17:20:52.926 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/3-thrash 2024-03-12T17:20:52.926 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/3-thrash/default.yaml 2024-03-12T17:20:52.927 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/0-cluster 2024-03-12T17:20:52.927 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x 2024-03-12T17:20:52.927 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel 2024-03-12T17:20:52.927 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/8-kraken.yaml 2024-03-12T17:20:52.927 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/1-hammer-jewel-install 2024-03-12T17:20:52.927 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/1-hammer-jewel-install/hammer-jewel.yaml 2024-03-12T17:20:52.927 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/4-jewel.yaml 2024-03-12T17:20:52.927 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/3.5-finish.yaml 2024-03-12T17:20:52.927 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/3-upgrade-sequence 2024-03-12T17:20:52.927 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/3-upgrade-sequence/upgrade-osd-mds-mon.yaml 2024-03-12T17:20:52.927 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/3-upgrade-sequence/upgrade-all.yaml 2024-03-12T17:20:52.927 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/7-upgrade-sequence 2024-03-12T17:20:52.927 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/7-upgrade-sequence/upgrade-by-daemon.yaml 2024-03-12T17:20:52.927 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/7-upgrade-sequence/upgrade-all.yaml 2024-03-12T17:20:52.927 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/distros 2024-03-12T17:20:52.928 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/distros/centos_7.2.yaml 2024-03-12T17:20:52.928 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/distros/ubuntu_14.04.yaml 2024-03-12T17:20:52.928 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/% 2024-03-12T17:20:52.928 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload 2024-03-12T17:20:52.961 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/rados-snaps-few-objects.yaml 2024-03-12T17:20:52.961 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/+ 2024-03-12T17:20:52.961 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/rados_loadgenmix.yaml 2024-03-12T17:20:52.962 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/rbd_cls.yaml 2024-03-12T17:20:52.962 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/rados_mon_thrash.yaml 2024-03-12T17:20:52.962 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/rbd_import_export.yaml 2024-03-12T17:20:52.962 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/rgw_s3tests.yaml 2024-03-12T17:20:52.962 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload 2024-03-12T17:20:52.962 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload/test_rbd_python.yaml 2024-03-12T17:20:52.962 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload/rados_api.yaml 2024-03-12T17:20:52.962 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload/rados_loadgenbig.yaml 2024-03-12T17:20:52.962 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload/ec-rados-default.yaml 2024-03-12T17:20:52.962 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload/+ 2024-03-12T17:20:52.962 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload/test_rbd_api.yaml 2024-03-12T17:20:52.962 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload 2024-03-12T17:20:52.962 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload/test_rbd_python.yaml 2024-03-12T17:20:52.962 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload/rados_api.yaml 2024-03-12T17:20:52.963 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload/rados_loadgenbig.yaml 2024-03-12T17:20:52.963 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload/ec-rados-default.yaml 2024-03-12T17:20:52.963 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload/+ 2024-03-12T17:20:52.963 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload/test_rbd_api.yaml 2024-03-12T17:20:52.963 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/5-hammer-jewel-x-upgrade 2024-03-12T17:20:52.963 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/5-hammer-jewel-x-upgrade/hammer-jewel-x.yaml 2024-03-12T17:20:52.963 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/0-cluster 2024-03-12T17:20:52.963 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/0-cluster/start.yaml 2024-03-12T17:20:52.963 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split 2024-03-12T17:20:52.963 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/6-next-mon 2024-03-12T17:20:52.963 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/8-next-mon 2024-03-12T17:20:52.963 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/5-workload 2024-03-12T17:20:52.963 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/4-mon 2024-03-12T17:20:52.963 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/distros 2024-03-12T17:20:52.963 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/distros/centos_7.2.yaml 2024-03-12T17:20:52.964 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/distros/ubuntu_14.04.yaml 2024-03-12T17:20:52.964 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/% 2024-03-12T17:20:52.964 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/9-workload 2024-03-12T17:20:52.964 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/1-hammer-install-and-upgrade-to-jewel 2024-03-12T17:20:52.964 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/1-hammer-install-and-upgrade-to-jewel/hammer-to-jewel.yaml 2024-03-12T17:20:52.964 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/2-partial-upgrade 2024-03-12T17:20:52.964 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/3-thrash 2024-03-12T17:20:52.964 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/7-workload 2024-03-12T17:20:52.964 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/0-cluster 2024-03-12T17:20:52.964 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade 2024-03-12T17:20:52.964 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x 2024-03-12T17:20:52.964 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd 2024-03-12T17:20:52.964 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/1-install 2024-03-12T17:20:52.964 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/1-install/hammer-client-x.yaml 2024-03-12T17:20:52.965 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/% 2024-03-12T17:20:52.965 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/2-workload 2024-03-12T17:20:52.965 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/2-workload/rbd_notification_tests.yaml 2024-03-12T17:20:52.965 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/0-cluster 2024-03-12T17:20:52.965 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/0-cluster/start.yaml 2024-03-12T17:20:52.965 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic 2024-03-12T17:20:53.032 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/1-install 2024-03-12T17:20:53.032 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/1-install/hammer-client-x.yaml 2024-03-12T17:20:53.032 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/% 2024-03-12T17:20:53.032 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/2-workload 2024-03-12T17:20:53.032 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/2-workload/rbd_cli_import_export.yaml 2024-03-12T17:20:53.033 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/2-workload/rbd_api_tests.yaml 2024-03-12T17:20:53.033 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/0-cluster 2024-03-12T17:20:53.033 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/0-cluster/start.yaml 2024-03-12T17:20:53.033 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x 2024-03-12T17:20:53.033 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd 2024-03-12T17:20:53.033 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/1-install 2024-03-12T17:20:53.033 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/1-install/jewel-client-x.yaml 2024-03-12T17:20:53.033 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/% 2024-03-12T17:20:53.033 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/2-workload 2024-03-12T17:20:53.033 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/2-workload/rbd_notification_tests.yaml 2024-03-12T17:20:53.033 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/0-cluster 2024-03-12T17:20:53.033 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/0-cluster/start.yaml 2024-03-12T17:20:53.033 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic 2024-03-12T17:20:53.033 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/1-install 2024-03-12T17:20:53.033 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/1-install/jewel-client-x.yaml 2024-03-12T17:20:53.033 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/% 2024-03-12T17:20:53.034 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/2-workload 2024-03-12T17:20:53.034 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/2-workload/rbd_cli_import_export.yaml 2024-03-12T17:20:53.034 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/2-workload/rbd_api_tests.yaml 2024-03-12T17:20:53.034 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/0-cluster 2024-03-12T17:20:53.034 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/0-cluster/start.yaml 2024-03-12T17:20:53.034 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/dummy 2024-03-12T17:20:53.034 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/dummy/% 2024-03-12T17:20:53.034 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/dummy/all 2024-03-12T17:20:53.034 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/dummy/all/nop.yaml 2024-03-12T17:20:53.034 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/hadoop 2024-03-12T17:20:53.034 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/hadoop/basic 2024-03-12T17:20:53.034 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/hadoop/basic/clusters 2024-03-12T17:20:53.034 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/hadoop/basic/clusters/fixed-3.yaml 2024-03-12T17:20:53.034 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/hadoop/basic/% 2024-03-12T17:20:53.035 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/hadoop/basic/xfs.yaml 2024-03-12T17:20:53.035 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/hadoop/basic/tasks 2024-03-12T17:20:53.035 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/hadoop/basic/tasks/wordcount.yaml 2024-03-12T17:20:53.035 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/hadoop/basic/tasks/repl.yaml 2024-03-12T17:20:53.035 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/hadoop/basic/tasks/terasort.yaml 2024-03-12T17:20:53.035 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology 2024-03-12T17:20:53.035 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/integration.yaml 2024-03-12T17:20:53.035 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/nop 2024-03-12T17:20:53.035 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/nop/% 2024-03-12T17:20:53.035 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/nop/all 2024-03-12T17:20:53.035 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/nop/all/nop.yaml 2024-03-12T17:20:53.035 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/rgw 2024-03-12T17:20:53.035 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/rgw/distros 2024-03-12T17:20:53.035 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/rgw/% 2024-03-12T17:20:53.035 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/rgw/tasks 2024-03-12T17:20:53.035 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/rgw/tasks/s3tests-fastcgi.yaml 2024-03-12T17:20:53.035 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/rgw/tasks/s3tests-fcgi.yaml 2024-03-12T17:20:53.036 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/rgw/tasks/s3tests-civetweb.yaml 2024-03-12T17:20:53.036 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/no-ceph 2024-03-12T17:20:53.036 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/no-ceph/clusters 2024-03-12T17:20:53.036 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/no-ceph/clusters/single.yaml 2024-03-12T17:20:53.036 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/no-ceph/% 2024-03-12T17:20:53.036 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/no-ceph/tasks 2024-03-12T17:20:53.036 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/no-ceph/tasks/teuthology.yaml 2024-03-12T17:20:53.036 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/ceph 2024-03-12T17:20:53.036 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/ceph/clusters 2024-03-12T17:20:53.036 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/ceph/clusters/single.yaml 2024-03-12T17:20:53.036 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/ceph/distros 2024-03-12T17:20:53.036 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/ceph/% 2024-03-12T17:20:53.036 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/ceph/tasks 2024-03-12T17:20:53.036 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/ceph/tasks/teuthology.yaml 2024-03-12T17:20:53.036 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/buildpackages 2024-03-12T17:20:53.082 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/buildpackages/distros 2024-03-12T17:20:53.082 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/buildpackages/% 2024-03-12T17:20:53.082 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/buildpackages/tasks 2024-03-12T17:20:53.082 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/buildpackages/tasks/default.yaml 2024-03-12T17:20:53.083 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/buildpackages/tasks/tag.yaml 2024-03-12T17:20:53.083 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/buildpackages/tasks/branch.yaml 2024-03-12T17:20:53.083 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/multi-cluster 2024-03-12T17:20:53.083 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/multi-cluster/fs 2024-03-12T17:20:53.083 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/multi-cluster/fs/xfs.yaml 2024-03-12T17:20:53.083 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/multi-cluster/% 2024-03-12T17:20:53.083 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/multi-cluster/all 2024-03-12T17:20:53.083 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/multi-cluster/all/thrashosds.yaml 2024-03-12T17:20:53.083 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/multi-cluster/all/ceph.yaml 2024-03-12T17:20:53.083 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/multi-cluster/all/upgrade.yaml 2024-03-12T17:20:53.083 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/multi-cluster/all/workunit.yaml 2024-03-12T17:20:53.083 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/workunits 2024-03-12T17:20:53.083 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/teuthology/workunits/yes.yaml 2024-03-12T17:20:53.083 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/multimds 2024-03-12T17:20:53.084 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/multimds/basic 2024-03-12T17:20:53.084 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/multimds/basic/overrides 2024-03-12T17:20:53.084 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/multimds/basic/overrides/fuse-default-perm-no.yaml 2024-03-12T17:20:53.084 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/multimds/basic/overrides/basic 2024-03-12T17:20:53.084 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/multimds/basic/overrides/% 2024-03-12T17:20:53.084 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/multimds/basic/clusters 2024-03-12T17:20:53.084 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/multimds/basic/clusters/9-mds.yaml 2024-03-12T17:20:53.084 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/multimds/basic/clusters/3-mds.yaml 2024-03-12T17:20:53.084 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/multimds/basic/fs 2024-03-12T17:20:53.084 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/multimds/basic/mount 2024-03-12T17:20:53.084 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/multimds/basic/mount/kclient.yaml 2024-03-12T17:20:53.084 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/multimds/basic/mount/fuse.yaml 2024-03-12T17:20:53.084 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/multimds/basic/inline 2024-03-12T17:20:53.084 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/multimds/basic/begin.yaml 2024-03-12T17:20:53.085 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/multimds/basic/% 2024-03-12T17:20:53.085 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/multimds/basic/tasks 2024-03-12T17:20:53.085 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/multimds/verify 2024-03-12T17:20:53.085 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/multimds/verify/validater 2024-03-12T17:20:53.085 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/multimds/verify/overrides 2024-03-12T17:20:53.085 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/multimds/verify/overrides/fuse-default-perm-no.yaml 2024-03-12T17:20:53.085 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/multimds/verify/overrides/% 2024-03-12T17:20:53.085 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/multimds/verify/overrides/verify 2024-03-12T17:20:53.085 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/multimds/verify/clusters 2024-03-12T17:20:53.085 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/multimds/verify/clusters/9-mds.yaml 2024-03-12T17:20:53.085 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/multimds/verify/clusters/3-mds.yaml 2024-03-12T17:20:53.085 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/multimds/verify/fs 2024-03-12T17:20:53.085 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/multimds/verify/mount 2024-03-12T17:20:53.085 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/multimds/verify/mount/kclient.yaml 2024-03-12T17:20:53.085 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/multimds/verify/mount/fuse.yaml 2024-03-12T17:20:53.086 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/multimds/verify/begin.yaml 2024-03-12T17:20:53.086 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/multimds/verify/% 2024-03-12T17:20:53.086 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/multimds/verify/tasks 2024-03-12T17:20:53.086 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke 2024-03-12T17:20:53.086 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/1node 2024-03-12T17:20:53.086 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/1node/clusters 2024-03-12T17:20:53.086 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/1node/clusters/openstack.yaml 2024-03-12T17:20:53.086 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/1node/clusters/+ 2024-03-12T17:20:53.086 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/1node/clusters/fixed-1.yaml 2024-03-12T17:20:53.086 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/1node/% 2024-03-12T17:20:53.086 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/1node/tasks 2024-03-12T17:20:53.086 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/1node/tasks/ceph-deploy.yaml 2024-03-12T17:20:53.086 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/systemd 2024-03-12T17:20:53.087 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/systemd/distro 2024-03-12T17:20:53.087 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/systemd/distro/ubuntu_16.04.yaml 2024-03-12T17:20:53.087 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/systemd/distro/centos_7.2.yaml 2024-03-12T17:20:53.087 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/systemd/% 2024-03-12T17:20:53.087 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/systemd/tasks 2024-03-12T17:20:53.087 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/systemd/tasks/systemd.yaml 2024-03-12T17:20:53.087 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/basic 2024-03-12T17:20:53.087 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/basic/clusters 2024-03-12T17:20:53.087 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/basic/clusters/fixed-3-cephfs.yaml 2024-03-12T17:20:53.087 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/basic/fs 2024-03-12T17:20:53.087 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/basic/fs/btrfs.yaml 2024-03-12T17:20:53.088 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/basic/% 2024-03-12T17:20:53.088 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/basic/tasks 2024-03-12T17:20:53.088 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/libcephfs_interface_tests.yaml 2024-03-12T17:20:53.088 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rados_cache_snaps.yaml 2024-03-12T17:20:53.088 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rados_cls_all.yaml 2024-03-12T17:20:53.088 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rbd_cli_import_export.yaml 2024-03-12T17:20:53.088 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/kclient_workunit_suites_fsstress.yaml 2024-03-12T17:20:53.088 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/cfuse_workunit_suites_pjd.yaml 2024-03-12T17:20:53.108 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/mon_thrash.yaml 2024-03-12T17:20:53.108 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/kclient_workunit_direct_io.yaml 2024-03-12T17:20:53.109 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rbd_fsx.yaml 2024-03-12T17:20:53.109 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rbd_python_api_tests.yaml 2024-03-12T17:20:53.109 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rbd_workunit_suites_iozone.yaml 2024-03-12T17:20:53.109 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/kclient_workunit_suites_dbench.yaml 2024-03-12T17:20:53.109 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rbd_api_tests.yaml 2024-03-12T17:20:53.109 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/cfuse_workunit_suites_blogbench.yaml 2024-03-12T17:20:53.109 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rados_ec_snaps.yaml 2024-03-12T17:20:53.109 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rgw_ec_s3tests.yaml 2024-03-12T17:20:53.109 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/kclient_workunit_suites_pjd.yaml 2024-03-12T17:20:53.109 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rados_workunit_loadgen_mix.yaml 2024-03-12T17:20:53.109 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rados_python.yaml 2024-03-12T17:20:53.109 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rgw_swift.yaml 2024-03-12T17:20:53.109 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rados_bench.yaml 2024-03-12T17:20:53.109 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rados_api_tests.yaml 2024-03-12T17:20:53.109 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/cfuse_workunit_suites_fsstress.yaml 2024-03-12T17:20:53.110 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/rgw_s3tests.yaml 2024-03-12T17:20:53.110 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/suites/smoke/basic/tasks/cfuse_workunit_suites_iozone.yaml 2024-03-12T17:20:53.110 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/machine_types 2024-03-12T17:20:53.110 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/machine_types/vps.yaml 2024-03-12T17:20:53.110 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/machine_types/schedule_rados_ovh.sh 2024-03-12T17:20:53.110 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/machine_types/schedule_rados.sh 2024-03-12T17:20:53.110 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/mon_kv_backend 2024-03-12T17:20:53.110 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/mon_kv_backend/leveldb.yaml 2024-03-12T17:20:53.110 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/mon_kv_backend/rocksdb.yaml 2024-03-12T17:20:53.110 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/README 2024-03-12T17:20:53.110 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks 2024-03-12T17:20:53.110 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/rebuild_mondb.py 2024-03-12T17:20:53.110 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/workunit.py 2024-03-12T17:20:53.110 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/osd_backfill.py 2024-03-12T17:20:53.111 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/calamari_setup.py 2024-03-12T17:20:53.111 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/object_source_down.py 2024-03-12T17:20:53.111 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/populate_rbd_pool.py 2024-03-12T17:20:53.111 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/util 2024-03-12T17:20:53.111 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/util/rgw.py 2024-03-12T17:20:53.111 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/util/__init__.py 2024-03-12T17:20:53.111 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/util/rados.py 2024-03-12T17:20:53.111 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/util/test 2024-03-12T17:20:53.111 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/util/test/__init__.py 2024-03-12T17:20:53.111 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/util/test/test_rados.py 2024-03-12T17:20:53.111 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/osd_failsafe_enospc.py 2024-03-12T17:20:53.111 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/osd_recovery.py 2024-03-12T17:20:53.111 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/die_on_err.py 2024-03-12T17:20:53.111 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/calamari_nosetests.py 2024-03-12T17:20:53.111 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/admin_socket.py 2024-03-12T17:20:53.111 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/mgr 2024-03-12T17:20:53.112 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/mgr/__init__.py 2024-03-12T17:20:53.112 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/mgr/test_failover.py 2024-03-12T17:20:53.112 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/mgr/mgr_test_case.py 2024-03-12T17:20:53.112 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/thrash_pool_snaps.py 2024-03-12T17:20:53.112 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/userdata_teardown.yaml 2024-03-12T17:20:53.112 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/radosbenchsweep.py 2024-03-12T17:20:53.112 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/mds_thrash.py 2024-03-12T17:20:53.112 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/rbd.py 2024-03-12T17:20:53.112 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/rgw.py 2024-03-12T17:20:53.112 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/teuthology_integration.py 2024-03-12T17:20:53.112 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/mon_seesaw.py 2024-03-12T17:20:53.112 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/repair_test.py 2024-03-12T17:20:53.112 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/watch_notify_same_primary.py 2024-03-12T17:20:53.112 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/peer.py 2024-03-12T17:20:53.113 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/restart.py 2024-03-12T17:20:53.113 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/ceph.py 2024-03-12T17:20:53.113 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/tests 2024-03-12T17:20:53.113 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/tests/test_buildpackages.py 2024-03-12T17:20:53.113 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/tests/test_radosgw_admin.py 2024-03-12T17:20:53.113 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/tests/test_devstack.py 2024-03-12T17:20:53.113 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/tests/__init__.py 2024-03-12T17:20:53.113 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/rgw_logsocket.py 2024-03-12T17:20:53.113 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/radosgw_admin.py 2024-03-12T17:20:53.113 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/ceph_client.py 2024-03-12T17:20:53.113 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/__init__.py 2024-03-12T17:20:53.113 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/aver.py 2024-03-12T17:20:53.113 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/cram.py 2024-03-12T17:20:53.113 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/cephfs 2024-03-12T17:20:53.113 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/cephfs/test_misc.py 2024-03-12T17:20:53.113 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/cephfs/test_client_limits.py 2024-03-12T17:20:53.114 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/cephfs/test_pool_perm.py 2024-03-12T17:20:53.114 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/cephfs/test_data_scan.py 2024-03-12T17:20:53.114 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/cephfs/test_client_recovery.py 2024-03-12T17:20:53.114 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/cephfs/test_journal_migration.py 2024-03-12T17:20:53.114 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/cephfs/test_dump_tree.py 2024-03-12T17:20:53.114 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/cephfs/test_mantle.py 2024-03-12T17:20:53.114 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/cephfs/test_sessionmap.py 2024-03-12T17:20:53.114 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/cephfs/__init__.py 2024-03-12T17:20:53.114 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/cephfs/test_journal_repair.py 2024-03-12T17:20:53.114 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/cephfs/kernel_mount.py 2024-03-12T17:20:53.114 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/cephfs/test_cap_flush.py 2024-03-12T17:20:53.114 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/cephfs/test_readahead.py 2024-03-12T17:20:53.114 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/cephfs/test_backtrace.py 2024-03-12T17:20:53.117 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/cephfs/test_auto_repair.py 2024-03-12T17:20:53.117 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/cephfs/test_strays.py 2024-03-12T17:20:53.117 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/cephfs/test_volume_client.py 2024-03-12T17:20:53.117 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/cephfs/cephfs_test_case.py 2024-03-12T17:20:53.117 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/cephfs/test_fragment.py 2024-03-12T17:20:53.117 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/cephfs/test_failover.py 2024-03-12T17:20:53.117 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/cephfs/test_full.py 2024-03-12T17:20:53.117 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/cephfs/filesystem.py 2024-03-12T17:20:53.117 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/cephfs/mount.py 2024-03-12T17:20:53.117 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/cephfs/test_damage.py 2024-03-12T17:20:53.117 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/cephfs/test_scrub_checks.py 2024-03-12T17:20:53.118 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/cephfs/test_config_commands.py 2024-03-12T17:20:53.118 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/cephfs/test_flush.py 2024-03-12T17:20:53.118 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/cephfs/fuse_mount.py 2024-03-12T17:20:53.118 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/cephfs/test_forward_scrub.py 2024-03-12T17:20:53.118 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/recovery_bench.py 2024-03-12T17:20:53.118 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/multibench.py 2024-03-12T17:20:53.118 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/devstack.py 2024-03-12T17:20:53.118 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/cephfs_test_runner.py 2024-03-12T17:20:53.118 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/filestore_idempotent.py 2024-03-12T17:20:53.118 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/mod_proxy_fcgi.tcp.conf.template 2024-03-12T17:20:53.118 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/scrub.py 2024-03-12T17:20:53.118 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/divergent_priors.py 2024-03-12T17:20:53.118 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/samba.py 2024-03-12T17:20:53.118 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/watch_notify_stress.py 2024-03-12T17:20:53.118 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/boto.cfg.template 2024-03-12T17:20:53.119 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/buildpackages.py 2024-03-12T17:20:53.119 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/ceph_test_case.py 2024-03-12T17:20:53.119 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/s3roundtrip.py 2024-03-12T17:20:53.119 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/qemu.py 2024-03-12T17:20:53.119 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/locktest.py 2024-03-12T17:20:53.119 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/manypools.py 2024-03-12T17:20:53.119 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/mds_creation_failure.py 2024-03-12T17:20:53.119 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/apache.conf.template 2024-03-12T17:20:53.119 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/ec_lost_unfound.py 2024-03-12T17:20:53.119 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/buildpackages 2024-03-12T17:20:53.119 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/buildpackages/ubuntu-16.04-user-data.txt 2024-03-12T17:20:53.119 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/buildpackages/ubuntu-14.04-user-data.txt 2024-03-12T17:20:53.119 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/buildpackages/centos-6.5-user-data.txt 2024-03-12T17:20:53.119 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/buildpackages/centos-7.1-user-data.txt 2024-03-12T17:20:53.120 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/buildpackages/make-deb.sh 2024-03-12T17:20:53.120 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/buildpackages/centos-7.0-user-data.txt 2024-03-12T17:20:53.120 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/buildpackages/make-rpm.sh 2024-03-12T17:20:53.120 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/buildpackages/opensuse-42.1-user-data.txt 2024-03-12T17:20:53.120 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/buildpackages/Makefile 2024-03-12T17:20:53.120 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/buildpackages/ubuntu-12.04-user-data.txt 2024-03-12T17:20:53.120 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/buildpackages/common.sh 2024-03-12T17:20:53.120 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/buildpackages/user-data.txt 2024-03-12T17:20:53.120 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/buildpackages/debian-8.0-user-data.txt 2024-03-12T17:20:53.120 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/buildpackages/centos-7.2-user-data.txt 2024-03-12T17:20:53.120 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/rbd_mirror.py 2024-03-12T17:20:53.120 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/dump_stuck.py 2024-03-12T17:20:53.120 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/ceph_objectstore_tool.py 2024-03-12T17:20:53.120 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/rbd_fsx.py 2024-03-12T17:20:53.120 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/radosgw_agent.py 2024-03-12T17:20:53.120 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/tgt.py 2024-03-12T17:20:53.120 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/vstart_runner.py 2024-03-12T17:20:53.121 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/resolve_stuck_peering.py 2024-03-12T17:20:53.121 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/rados.py 2024-03-12T17:20:53.121 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/s3tests.py 2024-03-12T17:20:53.121 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/userdata_setup.yaml 2024-03-12T17:20:53.121 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/lost_unfound.py 2024-03-12T17:20:53.121 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/s3readwrite.py 2024-03-12T17:20:53.121 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/ceph_fuse.py 2024-03-12T17:20:53.121 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/rest_api.py 2024-03-12T17:20:53.121 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/reg11184.py 2024-03-12T17:20:53.121 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/rep_lost_unfound_delete.py 2024-03-12T17:20:53.121 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/mod_proxy_fcgi.uds.conf.template 2024-03-12T17:20:53.121 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/ceph_deploy.py 2024-03-12T17:20:53.121 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/ceph_manager.py 2024-03-12T17:20:53.121 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/radosbench.py 2024-03-12T17:20:53.121 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/scrub_test.py 2024-03-12T17:20:53.121 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/mon_clock_skew_check.py 2024-03-12T17:20:53.122 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/kclient.py 2024-03-12T17:20:53.122 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/omapbench.py 2024-03-12T17:20:53.122 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/autotest.py 2024-03-12T17:20:53.122 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/mod_fastcgi.conf.template 2024-03-12T17:20:53.122 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/peering_speed_test.py 2024-03-12T17:20:53.122 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/mon_recovery.py 2024-03-12T17:20:53.122 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/cifs_mount.py 2024-03-12T17:20:53.122 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/rbd_fio.py 2024-03-12T17:20:53.122 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/logrotate.conf 2024-03-12T17:20:53.122 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/mon_thrash.py 2024-03-12T17:20:53.122 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/metadata.yaml 2024-03-12T17:20:53.122 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/divergent_priors2.py 2024-03-12T17:20:53.122 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/blktrace.py 2024-03-12T17:20:53.122 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/thrashosds.py 2024-03-12T17:20:53.123 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/systemd.py 2024-03-12T17:20:53.123 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/radosgw_admin_rest.py 2024-03-12T17:20:53.123 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/tasks/create_verify_lfn_objects.py 2024-03-12T17:20:53.123 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/timezone 2024-03-12T17:20:53.123 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/timezone/random.yaml 2024-03-12T17:20:53.123 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/timezone/eastern.yaml 2024-03-12T17:20:53.123 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/timezone/pacific.yaml 2024-03-12T17:20:53.123 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/.gitignore 2024-03-12T17:20:53.123 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/debug 2024-03-12T17:20:53.123 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/debug/openstack-30G.yaml 2024-03-12T17:20:53.123 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/debug/buildpackages.yaml 2024-03-12T17:20:53.123 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/debug/mds_client.yaml 2024-03-12T17:20:53.123 INFO:teuthology.orchestra.run.smithi017.stdout:./ceph-qa-suite/debug/openstack-15G.yaml 2024-03-12T17:20:53.125 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:20:53.125 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:20:53.125 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:20:53.125 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:20:53.125 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-03-12T17:20:53.125 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:20:53.276 INFO:teuthology.orchestra.run.smithi017.stdout:1 2024-03-12T17:20:53.459 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:20:53.459 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:20:53.459 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:20:53.459 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:20:53.459 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite").st_ino) 2024-03-12T17:20:53.459 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:20:53.633 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627776 2024-03-12T17:20:53.815 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:20:53.816 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:20:53.816 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:20:53.816 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:20:53.816 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/erasure-code").st_ino) 2024-03-12T17:20:53.816 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:20:54.009 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628339 2024-03-12T17:20:54.190 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:20:54.190 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:20:54.190 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:20:54.190 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:20:54.190 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/erasure-code/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml").st_ino) 2024-03-12T17:20:54.190 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:20:54.382 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627868 2024-03-12T17:20:54.564 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:20:54.564 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:20:54.564 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:20:54.564 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:20:54.564 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/erasure-code/ec-rados-plugin=jerasure-k=3-m=1.yaml").st_ino) 2024-03-12T17:20:54.564 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:20:54.756 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627867 2024-03-12T17:20:54.937 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:20:54.937 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:20:54.937 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:20:54.937 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:20:54.937 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/erasure-code/ec-rados-plugin=isa-k=2-m=1.yaml").st_ino) 2024-03-12T17:20:54.937 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:20:55.130 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627865 2024-03-12T17:20:55.311 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:20:55.311 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:20:55.311 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:20:55.311 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:20:55.311 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/erasure-code/ec-rados-plugin=jerasure-k=2-m=1.yaml").st_ino) 2024-03-12T17:20:55.312 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:20:55.503 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627866 2024-03-12T17:20:55.684 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:20:55.684 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:20:55.684 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:20:55.684 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:20:55.684 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/erasure-code/ec-rados-plugin=shec-k=4-m=3-c=2.yaml").st_ino) 2024-03-12T17:20:55.684 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:20:55.867 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627869 2024-03-12T17:20:56.048 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:20:56.048 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:20:56.048 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:20:56.048 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:20:56.048 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/erasure-code/ec-feature-plugins-v3.yaml").st_ino) 2024-03-12T17:20:56.048 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:20:56.236 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627862 2024-03-12T17:20:56.418 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:20:56.418 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:20:56.418 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:20:56.418 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:20:56.418 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/erasure-code/ec-rados-default.yaml").st_ino) 2024-03-12T17:20:56.418 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:20:56.611 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627863 2024-03-12T17:20:56.793 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:20:56.793 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:20:56.793 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:20:56.793 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:20:56.793 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/erasure-code/ec-rados-sequential.yaml").st_ino) 2024-03-12T17:20:56.793 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:20:56.988 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627870 2024-03-12T17:20:57.168 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:20:57.168 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:20:57.168 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:20:57.168 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:20:57.168 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/erasure-code/ec-rados-parallel.yaml").st_ino) 2024-03-12T17:20:57.168 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:20:57.363 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627864 2024-03-12T17:20:57.544 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:20:57.544 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:20:57.544 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:20:57.544 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:20:57.544 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/erasure-code/ec-feature-plugins-v2.yaml").st_ino) 2024-03-12T17:20:57.544 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:20:57.737 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628340 2024-03-12T17:20:57.918 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:20:57.919 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:20:57.919 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:20:57.919 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:20:57.919 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/releases").st_ino) 2024-03-12T17:20:57.919 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:20:58.111 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628355 2024-03-12T17:20:58.292 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:20:58.292 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:20:58.292 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:20:58.292 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:20:58.292 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/releases/jewel.yaml").st_ino) 2024-03-12T17:20:58.292 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:20:58.489 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627881 2024-03-12T17:20:58.673 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:20:58.673 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:20:58.673 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:20:58.673 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:20:58.673 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/releases/kraken.yaml").st_ino) 2024-03-12T17:20:58.673 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:20:58.867 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627882 2024-03-12T17:20:59.047 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:20:59.047 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:20:59.047 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:20:59.047 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:20:59.047 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/releases/infernalis.yaml").st_ino) 2024-03-12T17:20:59.047 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:20:59.241 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628356 2024-03-12T17:20:59.423 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:20:59.423 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:20:59.423 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:20:59.423 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:20:59.423 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tox.ini").st_ino) 2024-03-12T17:20:59.423 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:20:59.616 INFO:teuthology.orchestra.run.smithi017.stdout:1099511630008 2024-03-12T17:20:59.797 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:20:59.798 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:20:59.798 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:20:59.798 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:20:59.798 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/ceph-deploy-overrides").st_ino) 2024-03-12T17:20:59.798 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:20:59.980 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628308 2024-03-12T17:21:00.160 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:00.160 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:00.160 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:00.160 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:00.161 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/ceph-deploy-overrides/enable_dmcrypt_diff_journal_disk.yaml").st_ino) 2024-03-12T17:21:00.161 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:00.356 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627816 2024-03-12T17:21:00.540 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:00.540 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:00.540 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:00.540 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:00.540 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/ceph-deploy-overrides/ceph_deploy_dmcrypt.yaml").st_ino) 2024-03-12T17:21:00.540 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:00.721 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628309 2024-03-12T17:21:00.900 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:00.900 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:00.900 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:00.900 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:00.900 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/ceph-deploy-overrides/enable_diff_journal_disk.yaml").st_ino) 2024-03-12T17:21:00.900 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:01.092 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627815 2024-03-12T17:21:01.274 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:01.274 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:01.274 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:01.274 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:01.274 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/ceph-deploy-overrides/disable_diff_journal_disk.yaml").st_ino) 2024-03-12T17:21:01.274 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:01.473 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627814 2024-03-12T17:21:01.653 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:01.653 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:01.653 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:01.653 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:01.653 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/nightlies").st_ino) 2024-03-12T17:21:01.653 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:01.849 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628347 2024-03-12T17:21:02.030 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:02.030 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:02.030 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:02.030 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:02.030 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/nightlies/cron_wrapper").st_ino) 2024-03-12T17:21:02.030 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:02.224 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628348 2024-03-12T17:21:02.405 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:02.405 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:02.405 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:02.405 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:02.405 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/overrides").st_ino) 2024-03-12T17:21:02.405 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:02.599 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628351 2024-03-12T17:21:02.781 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:02.781 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:02.781 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:02.781 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:02.781 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/overrides/3-size-2-min-size.yaml").st_ino) 2024-03-12T17:21:02.781 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:02.976 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627878 2024-03-12T17:21:03.156 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:03.156 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:03.157 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:03.157 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:03.157 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/overrides/whitelist_wrongly_marked_down.yaml").st_ino) 2024-03-12T17:21:03.157 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:03.362 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627880 2024-03-12T17:21:03.541 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:03.541 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:03.541 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:03.541 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:03.541 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/overrides/2-size-2-min-size.yaml").st_ino) 2024-03-12T17:21:03.541 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:03.732 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627877 2024-03-12T17:21:03.914 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:03.914 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:03.914 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:03.914 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:03.914 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/overrides/2-size-1-min-size.yaml").st_ino) 2024-03-12T17:21:03.914 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:04.105 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628352 2024-03-12T17:21:04.286 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:04.286 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:04.286 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:04.286 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:04.286 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/overrides/short_pg_log.yaml").st_ino) 2024-03-12T17:21:04.286 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:04.482 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627879 2024-03-12T17:21:04.661 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:04.661 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:04.661 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:04.661 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:04.662 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/packages").st_ino) 2024-03-12T17:21:04.662 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:04.854 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628353 2024-03-12T17:21:05.034 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:05.034 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:05.034 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:05.034 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:05.035 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/packages/packages.yaml").st_ino) 2024-03-12T17:21:05.035 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:05.225 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628354 2024-03-12T17:21:05.407 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:05.407 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:05.407 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:05.407 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:05.407 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/clusters").st_ino) 2024-03-12T17:21:05.407 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:05.603 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628323 2024-03-12T17:21:05.784 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:05.784 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:05.784 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:05.784 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:05.784 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/clusters/extra-client.yaml").st_ino) 2024-03-12T17:21:05.784 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:05.975 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628324 2024-03-12T17:21:06.155 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:06.155 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:06.155 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:06.155 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:06.155 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/clusters/fixed-2.yaml").st_ino) 2024-03-12T17:21:06.155 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:06.354 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627830 2024-03-12T17:21:06.535 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:06.535 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:06.535 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:06.535 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:06.535 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/clusters/fixed-3.yaml").st_ino) 2024-03-12T17:21:06.535 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:06.728 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627832 2024-03-12T17:21:06.909 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:06.909 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:06.909 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:06.909 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:06.909 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/clusters/fixed-3-cephfs.yaml").st_ino) 2024-03-12T17:21:06.909 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:07.101 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627831 2024-03-12T17:21:07.283 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:07.283 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:07.283 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:07.283 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:07.283 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/clusters/fixed-4.yaml").st_ino) 2024-03-12T17:21:07.283 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:07.476 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627833 2024-03-12T17:21:07.658 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:07.658 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:07.658 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:07.658 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:07.658 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/clusters/fixed-1.yaml").st_ino) 2024-03-12T17:21:07.658 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:07.851 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627829 2024-03-12T17:21:08.032 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:08.032 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:08.032 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:08.032 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:08.032 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs").st_ino) 2024-03-12T17:21:08.032 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:08.222 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628310 2024-03-12T17:21:08.404 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:08.404 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:08.404 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:08.405 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:08.405 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/overrides").st_ino) 2024-03-12T17:21:08.405 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:08.593 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628316 2024-03-12T17:21:08.775 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:08.775 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:08.775 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:08.775 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:08.775 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/overrides/whitelist_wrongly_marked_down.yaml").st_ino) 2024-03-12T17:21:08.775 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:08.972 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627823 2024-03-12T17:21:09.152 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:09.152 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:09.152 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:09.152 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:09.152 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/overrides/debug.yaml").st_ino) 2024-03-12T17:21:09.152 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:09.345 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628317 2024-03-12T17:21:09.527 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:09.527 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:09.527 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:09.527 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:09.527 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/overrides/fuse").st_ino) 2024-03-12T17:21:09.527 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:09.720 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628318 2024-03-12T17:21:09.900 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:09.901 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:09.901 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:09.901 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:09.901 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/overrides/fuse/default-perm").st_ino) 2024-03-12T17:21:09.901 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:10.103 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628319 2024-03-12T17:21:10.283 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:10.283 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:10.283 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:10.284 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:10.284 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/overrides/fuse/default-perm/yes.yaml").st_ino) 2024-03-12T17:21:10.284 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:10.485 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627822 2024-03-12T17:21:10.666 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:10.666 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:10.666 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:10.666 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:10.666 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/overrides/fuse/default-perm/no.yaml").st_ino) 2024-03-12T17:21:10.666 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:10.859 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627821 2024-03-12T17:21:10.948 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:21:10.957 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:21:11.040 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:11.040 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:11.040 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:11.040 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:11.040 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/overrides/fuse/default-perm/%").st_ino) 2024-03-12T17:21:11.040 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:11.182 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628320 2024-03-12T17:21:11.360 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:11.360 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:11.360 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:11.360 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:11.360 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/overrides/frag_enable.yaml").st_ino) 2024-03-12T17:21:11.360 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:11.513 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627820 2024-03-12T17:21:11.694 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:11.694 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:11.694 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:11.694 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:11.694 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/clusters").st_ino) 2024-03-12T17:21:11.694 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:11.877 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628312 2024-03-12T17:21:12.058 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:12.058 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:12.058 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:12.058 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:12.058 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/clusters/9-mds.yaml").st_ino) 2024-03-12T17:21:12.058 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:12.250 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627817 2024-03-12T17:21:12.431 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:12.432 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:12.432 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:12.432 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:12.432 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/clusters/3-mds.yaml").st_ino) 2024-03-12T17:21:12.432 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:12.626 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628313 2024-03-12T17:21:12.805 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:12.805 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:12.805 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:12.805 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:12.805 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/clusters/fixed-2-ucephfs.yaml").st_ino) 2024-03-12T17:21:12.805 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:13.006 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627818 2024-03-12T17:21:13.188 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:13.188 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:13.188 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:13.188 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:13.188 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/mount").st_ino) 2024-03-12T17:21:13.188 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:13.382 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628314 2024-03-12T17:21:13.564 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:13.564 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:13.564 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:13.564 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:13.564 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/mount/kclient.yaml").st_ino) 2024-03-12T17:21:13.564 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:13.740 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627819 2024-03-12T17:21:13.922 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:13.922 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:13.923 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:13.923 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:13.923 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/mount/fuse.yaml").st_ino) 2024-03-12T17:21:13.923 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:14.117 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628315 2024-03-12T17:21:14.298 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:14.298 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:14.298 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:14.298 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:14.299 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/begin.yaml").st_ino) 2024-03-12T17:21:14.299 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:14.479 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628311 2024-03-12T17:21:14.662 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:14.662 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:14.662 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:14.663 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:14.663 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/tasks").st_ino) 2024-03-12T17:21:14.663 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:14.860 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628321 2024-03-12T17:21:15.041 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:15.041 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:15.041 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:15.042 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:15.042 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/tasks/libcephfs_interface_tests.yaml").st_ino) 2024-03-12T17:21:15.042 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:15.234 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627828 2024-03-12T17:21:15.415 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:15.415 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:15.415 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:15.415 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:15.415 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/tasks/cfuse_workunit_trivial_sync.yaml").st_ino) 2024-03-12T17:21:15.416 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:15.608 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627827 2024-03-12T17:21:15.790 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:15.790 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:15.790 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:15.790 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:15.790 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/tasks/cfuse_workunit_suites_ffsb.yaml").st_ino) 2024-03-12T17:21:15.790 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:15.983 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627825 2024-03-12T17:21:16.163 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:16.163 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:16.163 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:16.163 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:16.164 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/tasks/cfuse_workunit_suites_blogbench.yaml").st_ino) 2024-03-12T17:21:16.164 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:16.354 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628322 2024-03-12T17:21:16.535 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:16.535 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:16.536 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:16.536 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:16.536 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/tasks/cfuse_workunit_suites_fsstress.yaml").st_ino) 2024-03-12T17:21:16.536 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:16.732 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627826 2024-03-12T17:21:16.910 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:16.910 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:16.910 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:16.910 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:16.910 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/cephfs/tasks/cfuse_workunit_suites_dbench.yaml").st_ino) 2024-03-12T17:21:16.910 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:17.101 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627824 2024-03-12T17:21:17.283 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:17.283 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:17.283 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:17.283 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:17.283 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/objectstore").st_ino) 2024-03-12T17:21:17.284 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:17.479 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628349 2024-03-12T17:21:17.660 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:17.660 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:17.660 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:17.660 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:17.660 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/objectstore/bluestore.yaml").st_ino) 2024-03-12T17:21:17.661 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:17.851 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628350 2024-03-12T17:21:18.032 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:18.032 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:18.032 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:18.032 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:18.032 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/objectstore/filestore.yaml").st_ino) 2024-03-12T17:21:18.032 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:18.226 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627876 2024-03-12T17:21:18.408 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:18.408 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:18.408 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:18.408 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:18.408 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/config").st_ino) 2024-03-12T17:21:18.408 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:18.600 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628325 2024-03-12T17:21:18.793 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:18.794 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:18.794 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:18.794 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:18.794 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/config/rados.yaml").st_ino) 2024-03-12T17:21:18.794 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:18.958 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628326 2024-03-12T17:21:19.145 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:19.145 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:19.145 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:19.145 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:19.145 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/archs").st_ino) 2024-03-12T17:21:19.145 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:19.340 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628306 2024-03-12T17:21:19.521 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:19.521 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:19.522 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:19.522 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:19.522 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/archs/armv7.yaml").st_ino) 2024-03-12T17:21:19.522 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:19.717 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627811 2024-03-12T17:21:19.898 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:19.898 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:19.898 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:19.899 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:19.899 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/archs/i686.yaml").st_ino) 2024-03-12T17:21:19.899 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:20.092 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627812 2024-03-12T17:21:20.273 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:20.273 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:20.273 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:20.273 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:20.273 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/archs/aarch64.yaml").st_ino) 2024-03-12T17:21:20.273 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:20.465 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628307 2024-03-12T17:21:20.644 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:20.645 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:20.645 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:20.645 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:20.645 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/archs/x86_64.yaml").st_ino) 2024-03-12T17:21:20.645 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:20.835 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627813 2024-03-12T17:21:21.016 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:21.016 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:21.016 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:21.016 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:21.016 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/fs").st_ino) 2024-03-12T17:21:21.016 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:21.210 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628341 2024-03-12T17:21:21.391 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:21.391 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:21.391 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:21.391 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:21.391 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/fs/btrfs.yaml").st_ino) 2024-03-12T17:21:21.392 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:21.587 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628342 2024-03-12T17:21:21.768 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:21.768 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:21.768 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:21.768 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:21.768 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/fs/xfs.yaml").st_ino) 2024-03-12T17:21:21.768 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:21.962 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627872 2024-03-12T17:21:22.144 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:22.144 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:22.144 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:22.144 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:22.144 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/fs/ext4.yaml").st_ino) 2024-03-12T17:21:22.144 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:22.327 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627871 2024-03-12T17:21:22.507 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:22.507 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:22.507 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:22.507 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:22.507 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/rgw_pool_type").st_ino) 2024-03-12T17:21:22.507 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:22.700 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628357 2024-03-12T17:21:22.880 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:22.880 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:22.880 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:22.880 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:22.880 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/rgw_pool_type/ec-profile.yaml").st_ino) 2024-03-12T17:21:22.880 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:23.070 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627883 2024-03-12T17:21:23.251 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:23.251 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:23.251 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:23.251 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:23.251 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/rgw_pool_type/ec.yaml").st_ino) 2024-03-12T17:21:23.251 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:23.445 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627884 2024-03-12T17:21:23.631 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:23.631 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:23.631 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:23.631 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:23.631 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/rgw_pool_type/ec-cache.yaml").st_ino) 2024-03-12T17:21:23.631 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:23.825 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628358 2024-03-12T17:21:24.006 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:24.006 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:24.006 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:24.006 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:24.006 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/rgw_pool_type/replicated.yaml").st_ino) 2024-03-12T17:21:24.006 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:24.164 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627885 2024-03-12T17:21:24.342 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:24.342 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:24.342 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:24.342 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:24.343 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git").st_ino) 2024-03-12T17:21:24.343 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:24.533 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627777 2024-03-12T17:21:24.715 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:24.715 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:24.715 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:24.715 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:24.715 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/HEAD").st_ino) 2024-03-12T17:21:24.715 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:24.907 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627804 2024-03-12T17:21:25.089 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:25.089 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:25.089 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:25.089 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:25.089 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/description").st_ino) 2024-03-12T17:21:25.089 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:25.286 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627778 2024-03-12T17:21:25.468 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:25.468 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:25.468 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:25.468 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:25.468 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/index").st_ino) 2024-03-12T17:21:25.469 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:25.661 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627809 2024-03-12T17:21:25.842 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:25.843 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:25.843 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:25.843 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:25.843 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/objects").st_ino) 2024-03-12T17:21:25.843 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:26.035 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628288 2024-03-12T17:21:26.217 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:26.217 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:26.217 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:26.217 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:26.217 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/objects/info").st_ino) 2024-03-12T17:21:26.217 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:26.408 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628290 2024-03-12T17:21:26.589 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:26.590 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:26.591 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:26.591 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:26.591 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/objects/pack").st_ino) 2024-03-12T17:21:26.591 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:26.781 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628289 2024-03-12T17:21:26.963 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:26.963 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:26.963 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:26.963 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:26.963 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/objects/pack/pack-ac547ca4f300164f23b0bf1b8b1e66d5a7352309.idx").st_ino) 2024-03-12T17:21:26.963 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:27.157 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628292 2024-03-12T17:21:27.338 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:27.338 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:27.338 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:27.338 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:27.338 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/objects/pack/pack-ac547ca4f300164f23b0bf1b8b1e66d5a7352309.pack").st_ino) 2024-03-12T17:21:27.338 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:27.532 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628291 2024-03-12T17:21:27.713 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:27.713 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:27.713 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:27.713 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:27.713 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks").st_ino) 2024-03-12T17:21:27.713 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:27.907 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628281 2024-03-12T17:21:28.088 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:28.088 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:28.088 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:28.089 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:28.089 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks/pre-merge-commit.sample").st_ino) 2024-03-12T17:21:28.089 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:28.283 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627790 2024-03-12T17:21:28.464 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:28.465 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:28.465 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:28.465 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:28.465 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks/pre-commit.sample").st_ino) 2024-03-12T17:21:28.465 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:28.646 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628282 2024-03-12T17:21:28.828 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:28.828 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:28.828 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:28.828 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:28.828 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks/fsmonitor-watchman.sample").st_ino) 2024-03-12T17:21:28.828 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:29.025 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627781 2024-03-12T17:21:29.206 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:29.207 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:29.207 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:29.207 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:29.207 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks/commit-msg.sample").st_ino) 2024-03-12T17:21:29.207 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:29.402 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627788 2024-03-12T17:21:29.581 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:29.581 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:29.582 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:29.582 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:29.582 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks/pre-rebase.sample").st_ino) 2024-03-12T17:21:29.582 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:29.775 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627782 2024-03-12T17:21:29.957 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:29.957 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:29.957 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:29.957 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:29.957 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks/pre-receive.sample").st_ino) 2024-03-12T17:21:29.957 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:30.149 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627784 2024-03-12T17:21:30.330 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:30.331 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:30.331 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:30.331 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:30.331 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks/prepare-commit-msg.sample").st_ino) 2024-03-12T17:21:30.331 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:30.526 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627779 2024-03-12T17:21:30.707 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:30.707 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:30.708 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:30.708 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:30.708 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks/update.sample").st_ino) 2024-03-12T17:21:30.708 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:30.903 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627786 2024-03-12T17:21:31.083 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:31.083 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:31.083 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:31.083 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:31.083 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks/pre-push.sample").st_ino) 2024-03-12T17:21:31.084 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:31.281 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627787 2024-03-12T17:21:31.462 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:31.462 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:31.462 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:31.462 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:31.462 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks/pre-applypatch.sample").st_ino) 2024-03-12T17:21:31.462 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:31.657 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627789 2024-03-12T17:21:31.838 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:31.839 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:31.839 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:31.839 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:31.839 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks/push-to-checkout.sample").st_ino) 2024-03-12T17:21:31.839 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:32.031 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627780 2024-03-12T17:21:32.212 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:32.212 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:32.212 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:32.212 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:32.212 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks/post-update.sample").st_ino) 2024-03-12T17:21:32.212 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:32.406 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627785 2024-03-12T17:21:32.589 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:32.589 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:32.589 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:32.589 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:32.589 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/hooks/applypatch-msg.sample").st_ino) 2024-03-12T17:21:32.589 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:32.784 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627783 2024-03-12T17:21:32.966 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:32.966 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:32.966 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:32.966 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:32.966 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/logs").st_ino) 2024-03-12T17:21:32.966 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:33.157 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628296 2024-03-12T17:21:33.342 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:33.342 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:33.342 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:33.342 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:33.342 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/logs/HEAD").st_ino) 2024-03-12T17:21:33.342 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:33.516 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628302 2024-03-12T17:21:33.702 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:33.702 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:33.702 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:33.702 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:33.702 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/logs/refs").st_ino) 2024-03-12T17:21:33.702 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:33.897 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628297 2024-03-12T17:21:34.077 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:34.078 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:34.078 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:34.078 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:34.078 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/logs/refs/heads").st_ino) 2024-03-12T17:21:34.078 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:34.273 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628303 2024-03-12T17:21:34.454 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:34.454 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:34.454 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:34.454 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:34.454 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/logs/refs/heads/master").st_ino) 2024-03-12T17:21:34.454 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:34.647 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628304 2024-03-12T17:21:34.828 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:34.828 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:34.829 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:34.829 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:34.829 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/logs/refs/remotes").st_ino) 2024-03-12T17:21:34.829 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:35.021 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628298 2024-03-12T17:21:35.202 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:35.202 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:35.202 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:35.202 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:35.202 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/logs/refs/remotes/origin").st_ino) 2024-03-12T17:21:35.203 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:35.400 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628299 2024-03-12T17:21:35.580 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:35.581 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:35.581 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:35.581 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:35.581 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/logs/refs/remotes/origin/HEAD").st_ino) 2024-03-12T17:21:35.581 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:35.774 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628300 2024-03-12T17:21:35.956 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:35.956 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:35.956 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:35.956 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:35.956 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/packed-refs").st_ino) 2024-03-12T17:21:35.957 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:36.154 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627803 2024-03-12T17:21:36.334 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:36.335 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:36.335 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:36.335 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:36.335 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/config").st_ino) 2024-03-12T17:21:36.335 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:36.527 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627808 2024-03-12T17:21:36.709 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:36.709 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:36.709 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:36.709 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:36.709 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/info").st_ino) 2024-03-12T17:21:36.709 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:36.901 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628279 2024-03-12T17:21:37.082 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:37.082 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:37.082 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:37.082 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:37.082 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/info/exclude").st_ino) 2024-03-12T17:21:37.082 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:37.280 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628280 2024-03-12T17:21:37.461 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:37.461 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:37.461 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:37.461 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:37.461 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/refs").st_ino) 2024-03-12T17:21:37.461 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:37.647 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628284 2024-03-12T17:21:37.827 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:37.827 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:37.827 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:37.827 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:37.827 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/refs/tags").st_ino) 2024-03-12T17:21:37.827 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:38.019 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628286 2024-03-12T17:21:38.200 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:38.201 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:38.201 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:38.201 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:38.201 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/refs/heads").st_ino) 2024-03-12T17:21:38.201 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:38.394 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628285 2024-03-12T17:21:38.577 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:38.577 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:38.577 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:38.577 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:38.577 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/refs/heads/master").st_ino) 2024-03-12T17:21:38.577 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:38.769 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628301 2024-03-12T17:21:38.951 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:38.951 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:38.951 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:38.951 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:38.951 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/refs/remotes").st_ino) 2024-03-12T17:21:38.951 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:39.143 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628293 2024-03-12T17:21:39.325 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:39.325 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:39.325 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:39.325 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:39.325 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/refs/remotes/origin").st_ino) 2024-03-12T17:21:39.325 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:39.528 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628294 2024-03-12T17:21:39.710 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:39.711 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:39.711 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:39.711 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:39.711 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/refs/remotes/origin/HEAD").st_ino) 2024-03-12T17:21:39.711 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:39.907 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628295 2024-03-12T17:21:40.089 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:40.089 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:40.089 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:40.089 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:40.089 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.git/branches").st_ino) 2024-03-12T17:21:40.089 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:40.285 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628283 2024-03-12T17:21:40.466 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:40.467 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:40.467 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:40.467 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:40.467 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/config_options").st_ino) 2024-03-12T17:21:40.467 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:40.665 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628327 2024-03-12T17:21:40.846 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:40.846 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:40.847 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:40.847 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:40.847 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/config_options/cephdeploy_conf.yaml").st_ino) 2024-03-12T17:21:40.847 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:41.043 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628328 2024-03-12T17:21:41.107 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:21:41.115 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:21:41.224 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:41.225 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:41.225 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:41.225 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:41.225 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros").st_ino) 2024-03-12T17:21:41.225 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:41.363 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628331 2024-03-12T17:21:41.544 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:41.544 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:41.544 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:41.544 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:41.544 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/a-supported-distro.yaml").st_ino) 2024-03-12T17:21:41.544 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:41.701 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628332 2024-03-12T17:21:41.882 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:41.882 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:41.882 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:41.882 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:41.882 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/supported").st_ino) 2024-03-12T17:21:41.882 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:42.076 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628335 2024-03-12T17:21:42.256 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:42.256 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:42.256 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:42.256 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:42.256 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/supported/ubuntu_16.04.yaml").st_ino) 2024-03-12T17:21:42.257 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:42.453 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628338 2024-03-12T17:21:42.634 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:42.634 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:42.635 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:42.635 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:42.635 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/supported/centos_7.2.yaml").st_ino) 2024-03-12T17:21:42.635 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:42.828 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628336 2024-03-12T17:21:43.008 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:43.009 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:43.009 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:43.009 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:43.009 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/supported/ubuntu_14.04.yaml").st_ino) 2024-03-12T17:21:43.009 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:43.201 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628337 2024-03-12T17:21:43.382 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:43.383 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:43.383 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:43.383 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:43.383 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all").st_ino) 2024-03-12T17:21:43.383 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:43.565 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628333 2024-03-12T17:21:43.745 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:43.745 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:43.745 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:43.745 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:43.745 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/fedora_17.yaml").st_ino) 2024-03-12T17:21:43.746 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:43.937 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627845 2024-03-12T17:21:44.119 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:44.119 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:44.119 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:44.119 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:44.119 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/centos_6.4.yaml").st_ino) 2024-03-12T17:21:44.119 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:44.316 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627837 2024-03-12T17:21:44.496 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:44.496 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:44.496 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:44.497 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:44.497 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/debian_7.0.yaml").st_ino) 2024-03-12T17:21:44.497 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:44.691 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627843 2024-03-12T17:21:44.872 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:44.872 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:44.872 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:44.872 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:44.872 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/debian_6.0.yaml").st_ino) 2024-03-12T17:21:44.872 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:45.063 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627842 2024-03-12T17:21:45.245 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:45.245 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:45.245 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:45.245 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:45.245 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/fedora_19.yaml").st_ino) 2024-03-12T17:21:45.245 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:45.440 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627847 2024-03-12T17:21:45.620 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:45.620 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:45.620 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:45.621 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:45.621 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/ubuntu_16.04.yaml").st_ino) 2024-03-12T17:21:45.621 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:45.816 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627861 2024-03-12T17:21:45.997 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:45.997 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:45.997 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:45.997 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:45.997 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/opensuse_13.2.yaml").st_ino) 2024-03-12T17:21:45.997 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:46.187 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627849 2024-03-12T17:21:46.368 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:46.368 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:46.368 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:46.369 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:46.369 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/opensuse_12.2.yaml").st_ino) 2024-03-12T17:21:46.369 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:46.557 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627848 2024-03-12T17:21:46.738 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:46.738 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:46.738 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:46.738 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:46.738 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/rhel_6.3.yaml").st_ino) 2024-03-12T17:21:46.738 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:46.933 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627851 2024-03-12T17:21:47.115 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:47.115 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:47.115 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:47.115 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:47.115 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/sles_11-sp2.yaml").st_ino) 2024-03-12T17:21:47.115 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:47.312 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627855 2024-03-12T17:21:47.492 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:47.492 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:47.492 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:47.492 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:47.492 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/centos_7.2.yaml").st_ino) 2024-03-12T17:21:47.492 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:47.687 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627841 2024-03-12T17:21:47.868 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:47.868 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:47.868 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:47.868 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:47.868 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/rhel_6.4.yaml").st_ino) 2024-03-12T17:21:47.869 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:48.061 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627852 2024-03-12T17:21:48.243 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:48.243 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:48.243 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:48.243 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:48.243 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/centos_7.0.yaml").st_ino) 2024-03-12T17:21:48.243 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:48.435 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627839 2024-03-12T17:21:48.617 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:48.617 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:48.617 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:48.617 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:48.618 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/ubuntu_14.04_i686.yaml").st_ino) 2024-03-12T17:21:48.618 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:48.812 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627860 2024-03-12T17:21:48.994 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:48.994 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:48.994 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:48.994 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:48.994 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/opensuse_42.1.yaml").st_ino) 2024-03-12T17:21:48.994 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:49.186 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627850 2024-03-12T17:21:49.368 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:49.368 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:49.368 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:49.368 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:49.368 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/debian_8.0.yaml").st_ino) 2024-03-12T17:21:49.368 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:49.559 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627844 2024-03-12T17:21:49.739 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:49.740 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:49.740 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:49.740 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:49.740 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/fedora_18.yaml").st_ino) 2024-03-12T17:21:49.740 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:49.936 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627846 2024-03-12T17:21:50.116 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:50.116 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:50.116 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:50.116 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:50.116 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/rhel_7.0.yaml").st_ino) 2024-03-12T17:21:50.117 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:50.307 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627854 2024-03-12T17:21:50.489 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:50.490 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:50.490 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:50.490 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:50.490 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/ubuntu_14.04.yaml").st_ino) 2024-03-12T17:21:50.490 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:50.684 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627858 2024-03-12T17:21:50.865 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:50.865 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:50.865 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:50.865 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:50.865 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/centos_7.1.yaml").st_ino) 2024-03-12T17:21:50.865 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:51.058 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627840 2024-03-12T17:21:51.239 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:51.239 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:51.239 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:51.240 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:51.240 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/ubuntu_12.10.yaml").st_ino) 2024-03-12T17:21:51.240 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:51.424 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627857 2024-03-12T17:21:51.604 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:51.605 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:51.605 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:51.605 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:51.605 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/ubuntu_12.04.yaml").st_ino) 2024-03-12T17:21:51.605 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:51.790 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627856 2024-03-12T17:21:51.972 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:51.972 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:51.972 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:51.972 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:51.972 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/centos_6.3.yaml").st_ino) 2024-03-12T17:21:51.972 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:52.165 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628334 2024-03-12T17:21:52.347 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:52.347 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:52.347 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:52.347 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:52.347 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/rhel_6.5.yaml").st_ino) 2024-03-12T17:21:52.347 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:52.541 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627853 2024-03-12T17:21:52.722 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:52.722 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:52.722 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:52.723 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:52.723 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/ubuntu_14.04_aarch64.yaml").st_ino) 2024-03-12T17:21:52.723 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:52.918 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627859 2024-03-12T17:21:53.099 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:53.100 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:53.100 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:53.100 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:53.100 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/distros/all/centos_6.5.yaml").st_ino) 2024-03-12T17:21:53.100 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:53.291 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627838 2024-03-12T17:21:53.473 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:53.473 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:53.473 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:53.473 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:53.473 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites").st_ino) 2024-03-12T17:21:53.473 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:53.668 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628359 2024-03-12T17:21:53.850 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:53.850 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:53.850 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:53.850 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:53.850 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress").st_ino) 2024-03-12T17:21:53.850 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:54.048 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629771 2024-03-12T17:21:54.230 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:54.230 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:54.230 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:54.230 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:54.230 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/bench").st_ino) 2024-03-12T17:21:54.230 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:54.423 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629772 2024-03-12T17:21:54.604 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:54.604 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:54.604 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:54.604 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:54.605 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/bench/clusters").st_ino) 2024-03-12T17:21:54.605 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:54.799 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629774 2024-03-12T17:21:54.980 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:54.980 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:54.980 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:54.980 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:54.980 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/bench/clusters/fixed-3-cephfs.yaml").st_ino) 2024-03-12T17:21:54.980 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:55.172 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629775 2024-03-12T17:21:55.354 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:55.354 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:55.354 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:55.354 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:55.354 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/bench/%").st_ino) 2024-03-12T17:21:55.354 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:55.548 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629773 2024-03-12T17:21:55.728 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:55.728 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:55.728 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:55.728 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:55.728 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/bench/tasks").st_ino) 2024-03-12T17:21:55.728 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:55.922 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629776 2024-03-12T17:21:56.102 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:56.103 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:56.103 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:56.103 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:56.103 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/bench/tasks/kclient_workunit_suites_fsx.yaml").st_ino) 2024-03-12T17:21:56.103 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:56.279 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628870 2024-03-12T17:21:56.460 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:56.460 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:56.460 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:56.460 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:56.460 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/bench/tasks/cfuse_workunit_snaps.yaml").st_ino) 2024-03-12T17:21:56.461 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:56.655 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629777 2024-03-12T17:21:56.836 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:56.836 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:56.836 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:56.836 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:56.836 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash").st_ino) 2024-03-12T17:21:56.836 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:57.032 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629778 2024-03-12T17:21:57.215 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:57.215 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:57.215 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:57.215 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:57.215 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/clusters").st_ino) 2024-03-12T17:21:57.215 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:57.406 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629780 2024-03-12T17:21:57.587 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:57.587 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:57.587 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:57.587 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:57.587 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/clusters/16-osd.yaml").st_ino) 2024-03-12T17:21:57.587 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:57.779 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629782 2024-03-12T17:21:57.960 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:57.960 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:57.960 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:57.960 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:57.960 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/clusters/3-osd-1-machine.yaml").st_ino) 2024-03-12T17:21:57.960 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:58.154 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628871 2024-03-12T17:21:58.335 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:58.335 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:58.335 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:58.335 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:58.335 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/clusters/8-osd.yaml").st_ino) 2024-03-12T17:21:58.335 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:58.527 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628872 2024-03-12T17:21:58.707 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:58.707 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:58.707 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:58.707 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:58.707 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/fs").st_ino) 2024-03-12T17:21:58.708 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:58.890 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629783 2024-03-12T17:21:59.071 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:59.071 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:59.071 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:59.071 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:59.071 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/fs/none.yaml").st_ino) 2024-03-12T17:21:59.071 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:59.269 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629785 2024-03-12T17:21:59.449 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:59.449 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:59.449 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:59.449 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:59.449 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/fs/btrfs.yaml").st_ino) 2024-03-12T17:21:59.449 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:21:59.641 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629784 2024-03-12T17:21:59.822 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:21:59.822 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:21:59.822 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:21:59.822 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:21:59.822 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/fs/xfs.yaml").st_ino) 2024-03-12T17:21:59.822 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:00.013 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629786 2024-03-12T17:22:00.194 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:00.194 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:00.194 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:00.194 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:00.194 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/workloads").st_ino) 2024-03-12T17:22:00.194 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:00.388 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629789 2024-03-12T17:22:00.569 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:00.569 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:00.569 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:00.569 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:00.569 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/workloads/readwrite.yaml").st_ino) 2024-03-12T17:22:00.569 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:00.764 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628877 2024-03-12T17:22:00.945 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:00.945 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:00.946 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:00.946 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:00.946 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/workloads/radosbench.yaml").st_ino) 2024-03-12T17:22:00.946 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:01.141 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628876 2024-03-12T17:22:01.322 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:01.322 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:01.322 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:01.322 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:01.322 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/workloads/iozone_cfuse.yaml").st_ino) 2024-03-12T17:22:01.322 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:01.517 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628875 2024-03-12T17:22:01.697 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:01.697 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:01.698 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:01.698 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:01.698 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/workloads/bonnie_cfuse.yaml").st_ino) 2024-03-12T17:22:01.698 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:01.890 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629790 2024-03-12T17:22:02.072 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:02.072 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:02.072 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:02.072 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:02.072 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/%").st_ino) 2024-03-12T17:22:02.072 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:02.264 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629779 2024-03-12T17:22:02.446 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:02.446 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:02.446 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:02.446 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:02.446 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/thrashers").st_ino) 2024-03-12T17:22:02.447 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:02.637 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629787 2024-03-12T17:22:02.819 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:02.819 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:02.819 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:02.819 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:02.819 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/thrashers/default.yaml").st_ino) 2024-03-12T17:22:02.819 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:03.013 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629788 2024-03-12T17:22:03.194 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:03.194 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:03.194 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:03.194 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:03.194 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/thrashers/more-down.yaml").st_ino) 2024-03-12T17:22:03.194 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:03.435 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628874 2024-03-12T17:22:03.588 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:03.588 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:03.589 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:03.589 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:03.589 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/stress/thrash/thrashers/fast.yaml").st_ino) 2024-03-12T17:22:03.589 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:03.782 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628873 2024-03-12T17:22:03.962 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:03.962 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:03.962 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:03.962 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:03.962 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mgr").st_ino) 2024-03-12T17:22:03.963 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:04.158 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628796 2024-03-12T17:22:04.340 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:04.340 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:04.340 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:04.340 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:04.340 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mgr/basic").st_ino) 2024-03-12T17:22:04.340 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:04.534 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628797 2024-03-12T17:22:04.715 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:04.715 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:04.715 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:04.715 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:04.715 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mgr/basic/clusters").st_ino) 2024-03-12T17:22:04.715 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:04.907 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628799 2024-03-12T17:22:05.089 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:05.089 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:05.089 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:05.089 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:05.089 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mgr/basic/clusters/2-node-mgr.yaml").st_ino) 2024-03-12T17:22:05.089 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:05.285 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628800 2024-03-12T17:22:05.467 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:05.468 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:05.468 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:05.468 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:05.468 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mgr/basic/fs").st_ino) 2024-03-12T17:22:05.468 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:05.657 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628803 2024-03-12T17:22:05.839 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:05.839 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:05.839 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:05.839 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:05.839 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mgr/basic/fs/xfs.yaml").st_ino) 2024-03-12T17:22:05.839 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:06.032 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628804 2024-03-12T17:22:06.213 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:06.213 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:06.213 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:06.213 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:06.213 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mgr/basic/%").st_ino) 2024-03-12T17:22:06.213 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:06.405 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628798 2024-03-12T17:22:06.587 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:06.588 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:06.588 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:06.588 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:06.588 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mgr/basic/tasks").st_ino) 2024-03-12T17:22:06.588 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:06.781 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628805 2024-03-12T17:22:06.962 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:06.962 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:06.962 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:06.962 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:06.962 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mgr/basic/tasks/failover.yaml").st_ino) 2024-03-12T17:22:06.962 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:07.145 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628806 2024-03-12T17:22:07.326 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:07.327 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:07.327 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:07.327 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:07.327 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mgr/basic/debug").st_ino) 2024-03-12T17:22:07.327 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:07.519 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628801 2024-03-12T17:22:07.700 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:07.700 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:07.700 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:07.700 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:07.700 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mgr/basic/debug/mgr.yaml").st_ino) 2024-03-12T17:22:07.700 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:07.894 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628802 2024-03-12T17:22:08.075 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:08.075 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:08.075 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:08.075 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:08.075 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle").st_ino) 2024-03-12T17:22:08.075 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:08.269 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628848 2024-03-12T17:22:08.451 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:08.451 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:08.451 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:08.451 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:08.451 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd").st_ino) 2024-03-12T17:22:08.451 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:08.645 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628849 2024-03-12T17:22:08.827 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:08.827 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:08.827 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:08.827 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:08.827 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/powercycle").st_ino) 2024-03-12T17:22:08.827 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:09.017 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628857 2024-03-12T17:22:09.200 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:09.200 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:09.200 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:09.200 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:09.200 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/powercycle/default.yaml").st_ino) 2024-03-12T17:22:09.200 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:09.395 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628858 2024-03-12T17:22:09.575 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:09.575 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:09.575 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:09.575 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:09.575 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/clusters").st_ino) 2024-03-12T17:22:09.576 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:09.766 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628851 2024-03-12T17:22:09.947 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:09.948 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:09.948 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:09.948 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:09.948 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/clusters/3osd-1per-target.yaml").st_ino) 2024-03-12T17:22:09.948 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:10.139 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628852 2024-03-12T17:22:10.319 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:10.320 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:10.320 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:10.320 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:10.320 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/objectstore").st_ino) 2024-03-12T17:22:10.320 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:10.516 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628856 2024-03-12T17:22:10.696 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:10.697 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:10.697 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:10.697 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:10.697 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/fs").st_ino) 2024-03-12T17:22:10.697 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:10.890 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628853 2024-03-12T17:22:11.071 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:11.071 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:11.071 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:11.071 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:11.071 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/fs/btrfs.yaml").st_ino) 2024-03-12T17:22:11.072 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:11.252 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:22:11.260 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:22:11.264 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628854 2024-03-12T17:22:11.445 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:11.445 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:11.445 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:11.445 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:11.446 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/fs/xfs.yaml").st_ino) 2024-03-12T17:22:11.446 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:11.598 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628855 2024-03-12T17:22:11.779 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:11.779 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:11.779 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:11.779 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:11.779 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/%").st_ino) 2024-03-12T17:22:11.779 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:11.964 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628850 2024-03-12T17:22:12.145 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:12.145 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:12.145 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:12.145 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:12.145 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks").st_ino) 2024-03-12T17:22:12.145 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:12.336 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628859 2024-03-12T17:22:12.517 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:12.517 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:12.517 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:12.517 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:12.517 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/readwrite.yaml").st_ino) 2024-03-12T17:22:12.517 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:12.712 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628033 2024-03-12T17:22:12.894 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:12.894 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:12.894 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:12.894 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:12.894 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_suites_fsync.yaml").st_ino) 2024-03-12T17:22:12.894 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:13.085 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628028 2024-03-12T17:22:13.266 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:13.266 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:13.266 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:13.267 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:13.267 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/radosbench.yaml").st_ino) 2024-03-12T17:22:13.267 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:13.463 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628032 2024-03-12T17:22:13.647 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:13.647 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:13.647 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:13.647 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:13.647 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_suites_pjd.yaml").st_ino) 2024-03-12T17:22:13.647 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:13.841 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628029 2024-03-12T17:22:14.022 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:14.022 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:14.022 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:14.022 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:14.022 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_suites_ffsb.yaml").st_ino) 2024-03-12T17:22:14.022 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:14.200 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628025 2024-03-12T17:22:14.380 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:14.380 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:14.380 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:14.380 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:14.380 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_suites_fsx.yaml").st_ino) 2024-03-12T17:22:14.380 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:14.574 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628027 2024-03-12T17:22:14.755 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:14.755 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:14.755 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:14.755 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:14.755 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/snaps-few-objects.yaml").st_ino) 2024-03-12T17:22:14.755 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:14.949 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628034 2024-03-12T17:22:15.130 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:15.130 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:15.130 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:15.130 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:15.130 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_misc.yaml").st_ino) 2024-03-12T17:22:15.130 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:15.321 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628024 2024-03-12T17:22:15.503 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:15.503 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:15.503 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:15.503 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:15.503 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/admin_socket_objecter_requests.yaml").st_ino) 2024-03-12T17:22:15.503 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:15.685 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628860 2024-03-12T17:22:15.864 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:15.864 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:15.864 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:15.864 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:15.864 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_suites_truncate_delay.yaml").st_ino) 2024-03-12T17:22:15.864 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:16.056 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628030 2024-03-12T17:22:16.239 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:16.239 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:16.239 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:16.239 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:16.239 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/snaps-many-objects.yaml").st_ino) 2024-03-12T17:22:16.239 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:16.430 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628035 2024-03-12T17:22:16.610 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:16.610 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:16.610 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:16.610 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:16.610 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_kernel_untar_build.yaml").st_ino) 2024-03-12T17:22:16.611 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:16.806 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628023 2024-03-12T17:22:16.987 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:16.987 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:16.987 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:16.987 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:16.987 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/rados_api_tests.yaml").st_ino) 2024-03-12T17:22:16.987 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:17.179 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628031 2024-03-12T17:22:17.360 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:17.360 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:17.360 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:17.360 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:17.360 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/powercycle/osd/tasks/cfuse_workunit_suites_fsstress.yaml").st_ino) 2024-03-12T17:22:17.360 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:17.558 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628026 2024-03-12T17:22:17.741 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:17.741 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:17.742 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:17.742 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:17.742 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd").st_ino) 2024-03-12T17:22:17.742 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:17.932 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629304 2024-03-12T17:22:18.113 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:18.114 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:18.114 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:18.114 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:18.114 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli").st_ino) 2024-03-12T17:22:18.114 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:18.307 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629321 2024-03-12T17:22:18.487 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:18.487 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:18.488 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:18.488 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:18.488 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/features").st_ino) 2024-03-12T17:22:18.488 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:18.679 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629326 2024-03-12T17:22:18.861 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:18.861 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:18.861 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:18.861 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:18.861 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/features/defaults.yaml").st_ino) 2024-03-12T17:22:18.861 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:19.056 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629327 2024-03-12T17:22:19.238 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:19.238 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:19.238 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:19.239 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:19.239 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/features/journaling.yaml").st_ino) 2024-03-12T17:22:19.239 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:19.432 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628167 2024-03-12T17:22:19.614 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:19.614 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:19.614 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:19.614 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:19.614 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/features/layering.yaml").st_ino) 2024-03-12T17:22:19.614 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:19.809 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628168 2024-03-12T17:22:19.990 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:19.990 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:19.990 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:19.990 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:19.990 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/features/format-1.yaml").st_ino) 2024-03-12T17:22:19.991 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:20.184 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628166 2024-03-12T17:22:20.365 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:20.365 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:20.365 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:20.365 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:20.365 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/base").st_ino) 2024-03-12T17:22:20.365 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:20.561 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629323 2024-03-12T17:22:20.742 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:20.742 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:20.742 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:20.742 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:20.742 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/base/install.yaml").st_ino) 2024-03-12T17:22:20.742 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:20.936 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629324 2024-03-12T17:22:21.115 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:21.115 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:21.115 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:21.115 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:21.115 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/pool").st_ino) 2024-03-12T17:22:21.115 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:21.310 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629332 2024-03-12T17:22:21.491 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:21.492 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:21.492 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:21.492 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:21.492 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/pool/small-cache-pool.yaml").st_ino) 2024-03-12T17:22:21.492 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:21.686 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628172 2024-03-12T17:22:21.868 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:21.868 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:21.868 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:21.868 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:21.868 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/pool/replicated-data-pool.yaml").st_ino) 2024-03-12T17:22:21.868 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:22.068 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628171 2024-03-12T17:22:22.248 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:22.248 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:22.248 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:22.248 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:22.248 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/pool/ec-data-pool.yaml").st_ino) 2024-03-12T17:22:22.248 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:22.433 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629333 2024-03-12T17:22:22.613 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:22.614 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:22.614 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:22.614 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:22.614 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/pool/none.yaml").st_ino) 2024-03-12T17:22:22.614 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:22.809 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628170 2024-03-12T17:22:22.990 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:22.991 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:22.991 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:22.991 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:22.991 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/clusters").st_ino) 2024-03-12T17:22:22.991 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:23.187 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629325 2024-03-12T17:22:23.369 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:23.369 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:23.369 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:23.369 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:23.369 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/msgr-failures").st_ino) 2024-03-12T17:22:23.369 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:23.562 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629329 2024-03-12T17:22:23.743 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:23.743 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:23.743 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:23.743 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:23.743 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/msgr-failures/many.yaml").st_ino) 2024-03-12T17:22:23.743 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:23.937 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628169 2024-03-12T17:22:24.118 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:24.118 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:24.118 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:24.118 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:24.118 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/msgr-failures/few.yaml").st_ino) 2024-03-12T17:22:24.118 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:24.312 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629330 2024-03-12T17:22:24.492 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:24.492 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:24.492 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:24.492 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:24.492 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/objectstore").st_ino) 2024-03-12T17:22:24.493 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:24.683 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629331 2024-03-12T17:22:24.864 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:24.864 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:24.865 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:24.865 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:24.865 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/fs").st_ino) 2024-03-12T17:22:24.865 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:25.056 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629328 2024-03-12T17:22:25.237 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:25.237 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:25.237 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:25.237 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:25.237 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/workloads").st_ino) 2024-03-12T17:22:25.237 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:25.430 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629334 2024-03-12T17:22:25.612 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:25.612 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:25.612 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:25.612 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:25.612 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/workloads/rbd_cli_import_export.yaml").st_ino) 2024-03-12T17:22:25.612 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:25.806 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628173 2024-03-12T17:22:25.987 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:25.987 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:25.987 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:25.987 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:25.987 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/workloads/rbd_cli_copy.yaml").st_ino) 2024-03-12T17:22:25.987 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:26.182 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629335 2024-03-12T17:22:26.363 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:26.364 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:26.364 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:26.364 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:26.364 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/cli/%").st_ino) 2024-03-12T17:22:26.364 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:26.555 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629322 2024-03-12T17:22:26.735 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:26.735 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:26.736 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:26.736 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:26.736 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance").st_ino) 2024-03-12T17:22:26.736 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:26.919 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629353 2024-03-12T17:22:27.100 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:27.100 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:27.100 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:27.100 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:27.100 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/base").st_ino) 2024-03-12T17:22:27.100 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:27.294 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629355 2024-03-12T17:22:27.475 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:27.475 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:27.475 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:27.475 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:27.475 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/base/install.yaml").st_ino) 2024-03-12T17:22:27.476 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:27.674 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629356 2024-03-12T17:22:27.854 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:27.854 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:27.854 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:27.854 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:27.854 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/clusters").st_ino) 2024-03-12T17:22:27.855 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:28.047 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629357 2024-03-12T17:22:28.227 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:28.227 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:28.227 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:28.227 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:28.228 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/clusters/openstack.yaml").st_ino) 2024-03-12T17:22:28.228 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:28.419 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629360 2024-03-12T17:22:28.600 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:28.600 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:28.601 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:28.601 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:28.601 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/clusters/+").st_ino) 2024-03-12T17:22:28.601 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:28.793 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629358 2024-03-12T17:22:28.976 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:28.976 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:28.976 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:28.976 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:28.976 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/clusters/fixed-3.yaml").st_ino) 2024-03-12T17:22:28.976 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:29.169 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629359 2024-03-12T17:22:29.351 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:29.351 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:29.351 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:29.351 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:29.351 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/objectstore").st_ino) 2024-03-12T17:22:29.351 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:29.548 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629361 2024-03-12T17:22:29.729 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:29.729 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:29.729 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:29.729 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:29.729 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/workloads").st_ino) 2024-03-12T17:22:29.729 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:29.925 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629364 2024-03-12T17:22:30.106 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:30.106 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:30.106 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:30.106 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:30.106 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/workloads/dynamic_features.yaml").st_ino) 2024-03-12T17:22:30.106 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:30.298 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629365 2024-03-12T17:22:30.479 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:30.479 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:30.479 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:30.479 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:30.479 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/workloads/rebuild_object_map.yaml").st_ino) 2024-03-12T17:22:30.479 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:30.673 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628189 2024-03-12T17:22:30.854 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:30.854 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:30.858 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:30.858 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:30.858 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/%").st_ino) 2024-03-12T17:22:30.858 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:31.045 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629354 2024-03-12T17:22:31.226 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:31.226 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:31.226 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:31.226 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:31.226 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/xfs.yaml").st_ino) 2024-03-12T17:22:31.226 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:31.422 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629366 2024-03-12T17:22:31.603 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:31.603 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:31.603 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:31.603 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:31.603 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/qemu").st_ino) 2024-03-12T17:22:31.603 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:31.798 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629362 2024-03-12T17:22:31.980 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:31.980 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:31.980 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:31.980 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:31.980 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/maintenance/qemu/xfstests.yaml").st_ino) 2024-03-12T17:22:31.980 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:32.170 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629363 2024-03-12T17:22:32.351 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:32.351 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:32.351 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:32.351 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:32.351 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton").st_ino) 2024-03-12T17:22:32.351 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:32.548 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629409 2024-03-12T17:22:32.728 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:32.729 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:32.729 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:32.729 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:32.729 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/openstack.yaml").st_ino) 2024-03-12T17:22:32.729 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:32.921 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628220 2024-03-12T17:22:33.101 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:33.102 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:33.102 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:33.102 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:33.102 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/objectstore").st_ino) 2024-03-12T17:22:33.102 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:33.296 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629413 2024-03-12T17:22:33.476 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:33.476 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:33.476 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:33.476 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:33.476 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/%").st_ino) 2024-03-12T17:22:33.476 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:33.671 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629410 2024-03-12T17:22:33.853 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:33.853 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:33.854 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:33.854 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:33.854 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all").st_ino) 2024-03-12T17:22:33.854 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:34.044 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629411 2024-03-12T17:22:34.227 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:34.227 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:34.227 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:34.227 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:34.227 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/rbd-vs-unmanaged-snaps.yaml").st_ino) 2024-03-12T17:22:34.227 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:34.418 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628213 2024-03-12T17:22:34.599 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:34.599 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:34.599 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:34.599 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:34.599 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/rbd_mirror.yaml").st_ino) 2024-03-12T17:22:34.599 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:34.792 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628214 2024-03-12T17:22:34.973 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:34.973 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:34.973 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:34.973 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:34.973 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/verify_pool.yaml").st_ino) 2024-03-12T17:22:34.973 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:35.167 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628219 2024-03-12T17:22:35.348 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:35.348 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:35.348 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:35.348 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:35.348 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/formatted-output.yaml").st_ino) 2024-03-12T17:22:35.348 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:35.543 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628207 2024-03-12T17:22:35.724 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:35.724 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:35.724 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:35.724 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:35.724 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/rbdmap_RBDMAPFILE.yaml").st_ino) 2024-03-12T17:22:35.724 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:35.902 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628215 2024-03-12T17:22:36.082 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:36.082 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:36.083 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:36.083 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:36.083 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/qemu-iotests-writeback.yaml").st_ino) 2024-03-12T17:22:36.083 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:36.276 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628211 2024-03-12T17:22:36.457 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:36.457 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:36.457 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:36.457 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:36.457 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/read-flags-writeback.yaml").st_ino) 2024-03-12T17:22:36.457 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:36.653 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628217 2024-03-12T17:22:36.833 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:36.833 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:36.834 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:36.834 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:36.834 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/permissions.yaml").st_ino) 2024-03-12T17:22:36.834 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:37.026 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628209 2024-03-12T17:22:37.208 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:37.208 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:37.208 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:37.208 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:37.208 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/read-flags-no-cache.yaml").st_ino) 2024-03-12T17:22:37.208 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:37.402 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628216 2024-03-12T17:22:37.583 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:37.583 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:37.583 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:37.584 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:37.584 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/qemu-iotests-no-cache.yaml").st_ino) 2024-03-12T17:22:37.584 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:37.766 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628210 2024-03-12T17:22:37.946 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:37.947 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:37.947 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:37.947 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:37.947 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/qemu-iotests-writethrough.yaml").st_ino) 2024-03-12T17:22:37.947 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:38.138 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628212 2024-03-12T17:22:38.319 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:38.319 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:38.319 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:38.319 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:38.319 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/read-flags-writethrough.yaml").st_ino) 2024-03-12T17:22:38.319 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:38.511 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628218 2024-03-12T17:22:38.692 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:38.693 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:38.693 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:38.693 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:38.693 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/admin_socket.yaml").st_ino) 2024-03-12T17:22:38.693 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:38.885 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629412 2024-03-12T17:22:39.066 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:39.066 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:39.066 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:39.066 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:39.066 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/singleton/all/merge_diff.yaml").st_ino) 2024-03-12T17:22:39.066 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:39.248 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628208 2024-03-12T17:22:39.429 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:39.429 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:39.429 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:39.429 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:39.429 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic").st_ino) 2024-03-12T17:22:39.429 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:39.617 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629305 2024-03-12T17:22:39.802 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:39.802 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:39.802 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:39.803 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:39.803 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/base").st_ino) 2024-03-12T17:22:39.803 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:39.991 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629307 2024-03-12T17:22:40.174 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:40.174 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:40.174 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:40.174 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:40.174 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/base/install.yaml").st_ino) 2024-03-12T17:22:40.174 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:40.367 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629308 2024-03-12T17:22:40.547 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:40.547 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:40.547 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:40.548 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:40.548 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/cachepool").st_ino) 2024-03-12T17:22:40.548 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:40.742 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629309 2024-03-12T17:22:40.922 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:40.922 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:40.922 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:40.922 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:40.922 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/cachepool/none.yaml").st_ino) 2024-03-12T17:22:40.923 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:41.118 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629310 2024-03-12T17:22:41.298 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:41.298 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:41.299 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:41.299 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:41.299 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/cachepool/small.yaml").st_ino) 2024-03-12T17:22:41.299 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:41.400 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:22:41.407 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:22:41.492 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628159 2024-03-12T17:22:41.675 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:41.675 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:41.675 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:41.675 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:41.675 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/clusters").st_ino) 2024-03-12T17:22:41.675 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:41.826 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629311 2024-03-12T17:22:42.007 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:42.007 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:42.007 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:42.007 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:42.007 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/clusters/openstack.yaml").st_ino) 2024-03-12T17:22:42.007 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:42.201 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628160 2024-03-12T17:22:42.382 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:42.382 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:42.382 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:42.383 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:42.383 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/clusters/+").st_ino) 2024-03-12T17:22:42.383 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:42.563 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629312 2024-03-12T17:22:42.745 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:42.745 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:42.745 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:42.745 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:42.745 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/clusters/fixed-1.yaml").st_ino) 2024-03-12T17:22:42.745 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:42.942 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629313 2024-03-12T17:22:43.123 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:43.123 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:43.123 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:43.123 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:43.123 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/msgr-failures").st_ino) 2024-03-12T17:22:43.123 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:43.321 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629316 2024-03-12T17:22:43.503 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:43.503 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:43.503 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:43.503 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:43.503 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/msgr-failures/many.yaml").st_ino) 2024-03-12T17:22:43.503 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:43.684 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628161 2024-03-12T17:22:43.865 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:43.865 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:43.865 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:43.866 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:43.866 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/msgr-failures/few.yaml").st_ino) 2024-03-12T17:22:43.866 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:44.055 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629317 2024-03-12T17:22:44.237 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:44.237 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:44.237 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:44.237 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:44.237 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/objectstore").st_ino) 2024-03-12T17:22:44.237 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:44.429 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629318 2024-03-12T17:22:44.610 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:44.611 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:44.611 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:44.611 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:44.611 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/fs").st_ino) 2024-03-12T17:22:44.611 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:44.810 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629314 2024-03-12T17:22:44.994 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:44.994 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:44.994 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:44.994 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:44.994 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/fs/xfs.yaml").st_ino) 2024-03-12T17:22:44.994 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:45.181 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629315 2024-03-12T17:22:45.362 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:45.362 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:45.362 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:45.362 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:45.363 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/%").st_ino) 2024-03-12T17:22:45.363 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:45.557 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629306 2024-03-12T17:22:45.739 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:45.739 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:45.739 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:45.739 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:45.740 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/tasks").st_ino) 2024-03-12T17:22:45.740 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:45.930 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629319 2024-03-12T17:22:46.112 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:46.112 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:46.112 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:46.112 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:46.112 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/tasks/rbd_lock_and_fence.yaml").st_ino) 2024-03-12T17:22:46.113 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:46.309 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628164 2024-03-12T17:22:46.490 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:46.490 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:46.491 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:46.491 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:46.491 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/tasks/rbd_cli_tests.yaml").st_ino) 2024-03-12T17:22:46.491 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:46.682 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628162 2024-03-12T17:22:46.864 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:46.864 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:46.864 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:46.864 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:46.864 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/tasks/rbd_api_tests_old_format.yaml").st_ino) 2024-03-12T17:22:46.864 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:47.059 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629320 2024-03-12T17:22:47.243 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:47.243 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:47.243 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:47.243 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:47.243 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/tasks/rbd_cls_tests.yaml").st_ino) 2024-03-12T17:22:47.243 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:47.438 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628163 2024-03-12T17:22:47.619 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:47.619 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:47.619 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:47.619 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:47.620 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/basic/tasks/rbd_python_api_tests_old_format.yaml").st_ino) 2024-03-12T17:22:47.620 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:47.813 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628165 2024-03-12T17:22:47.994 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:47.994 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:47.994 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:47.994 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:47.994 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd").st_ino) 2024-03-12T17:22:47.994 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:48.191 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629336 2024-03-12T17:22:48.371 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:48.371 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:48.371 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:48.372 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:48.372 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/pool").st_ino) 2024-03-12T17:22:48.372 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:48.572 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629349 2024-03-12T17:22:48.753 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:48.753 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:48.753 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:48.753 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:48.753 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/pool/small-cache-pool.yaml").st_ino) 2024-03-12T17:22:48.753 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:48.946 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628181 2024-03-12T17:22:49.127 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:49.128 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:49.128 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:49.128 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:49.128 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/pool/replicated-data-pool.yaml").st_ino) 2024-03-12T17:22:49.128 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:49.321 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628180 2024-03-12T17:22:49.502 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:49.502 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:49.502 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:49.502 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:49.502 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/pool/ec-data-pool.yaml").st_ino) 2024-03-12T17:22:49.502 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:49.701 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629350 2024-03-12T17:22:49.882 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:49.882 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:49.882 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:49.882 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:49.882 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/pool/none.yaml").st_ino) 2024-03-12T17:22:49.882 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:50.075 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628179 2024-03-12T17:22:50.256 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:50.256 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:50.256 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:50.256 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:50.256 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/clusters").st_ino) 2024-03-12T17:22:50.256 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:50.449 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629340 2024-03-12T17:22:50.629 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:50.629 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:50.629 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:50.629 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:50.630 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/clusters/openstack.yaml").st_ino) 2024-03-12T17:22:50.630 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:50.822 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628176 2024-03-12T17:22:51.002 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:51.002 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:51.002 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:51.003 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:51.003 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/clusters/+").st_ino) 2024-03-12T17:22:51.003 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:51.195 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629341 2024-03-12T17:22:51.376 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:51.376 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:51.376 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:51.376 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:51.376 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/clusters/fixed-3.yaml").st_ino) 2024-03-12T17:22:51.376 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:51.575 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629342 2024-03-12T17:22:51.758 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:51.758 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:51.758 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:51.758 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:51.759 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/msgr-failures").st_ino) 2024-03-12T17:22:51.759 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:51.953 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629346 2024-03-12T17:22:52.133 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:52.134 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:52.134 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:52.134 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:52.134 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/msgr-failures/few.yaml").st_ino) 2024-03-12T17:22:52.134 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:52.319 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629347 2024-03-12T17:22:52.500 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:52.500 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:52.500 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:52.500 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:52.500 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/objectstore").st_ino) 2024-03-12T17:22:52.500 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:52.697 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629348 2024-03-12T17:22:52.877 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:52.877 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:52.877 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:52.877 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:52.877 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/config").st_ino) 2024-03-12T17:22:52.877 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:53.069 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629343 2024-03-12T17:22:53.250 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:53.250 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:53.250 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:53.250 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:53.250 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/config/skip-partial-discard.yaml").st_ino) 2024-03-12T17:22:53.250 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:53.441 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628178 2024-03-12T17:22:53.623 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:53.623 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:53.623 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:53.623 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:53.623 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/config/none.yaml").st_ino) 2024-03-12T17:22:53.624 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:53.820 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628177 2024-03-12T17:22:54.001 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:54.001 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:54.001 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:54.001 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:54.001 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/config/copy-on-read.yaml").st_ino) 2024-03-12T17:22:54.001 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:54.190 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629344 2024-03-12T17:22:54.371 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:54.371 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:54.371 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:54.371 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:54.371 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/fs").st_ino) 2024-03-12T17:22:54.371 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:54.570 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629345 2024-03-12T17:22:54.752 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:54.752 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:54.752 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:54.752 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:54.752 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/workloads").st_ino) 2024-03-12T17:22:54.752 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:54.947 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629351 2024-03-12T17:22:55.128 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:55.128 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:55.128 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:55.128 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:55.128 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/workloads/c_api_tests.yaml").st_ino) 2024-03-12T17:22:55.128 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:55.320 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629352 2024-03-12T17:22:55.500 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:55.500 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:55.500 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:55.500 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:55.500 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/workloads/rbd_fio.yaml").st_ino) 2024-03-12T17:22:55.500 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:55.689 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628188 2024-03-12T17:22:55.871 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:55.871 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:55.871 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:55.871 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:55.871 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/workloads/c_api_tests_with_defaults.yaml").st_ino) 2024-03-12T17:22:55.871 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:56.063 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628182 2024-03-12T17:22:56.244 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:56.244 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:56.244 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:56.244 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:56.244 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/workloads/python_api_tests.yaml").st_ino) 2024-03-12T17:22:56.245 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:56.437 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628185 2024-03-12T17:22:56.618 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:56.618 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:56.619 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:56.619 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:56.619 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/workloads/fsx.yaml").st_ino) 2024-03-12T17:22:56.619 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:56.813 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628184 2024-03-12T17:22:56.993 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:56.993 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:56.993 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:56.993 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:56.993 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/workloads/python_api_tests_with_journaling.yaml").st_ino) 2024-03-12T17:22:56.993 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:57.189 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628187 2024-03-12T17:22:57.371 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:57.371 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:57.371 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:57.371 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:57.371 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/workloads/c_api_tests_with_journaling.yaml").st_ino) 2024-03-12T17:22:57.371 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:57.566 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628183 2024-03-12T17:22:57.746 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:57.746 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:57.746 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:57.746 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:57.746 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/workloads/python_api_tests_with_defaults.yaml").st_ino) 2024-03-12T17:22:57.746 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:57.936 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628186 2024-03-12T17:22:58.117 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:58.117 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:58.117 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:58.117 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:58.117 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/cache").st_ino) 2024-03-12T17:22:58.117 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:58.311 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629338 2024-03-12T17:22:58.492 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:58.492 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:58.492 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:58.492 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:58.492 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/cache/writeback.yaml").st_ino) 2024-03-12T17:22:58.492 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:58.679 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628174 2024-03-12T17:22:58.863 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:58.863 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:58.863 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:58.863 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:58.863 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/cache/writethrough.yaml").st_ino) 2024-03-12T17:22:58.863 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:59.056 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628175 2024-03-12T17:22:59.237 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:59.237 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:59.237 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:59.237 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:59.237 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/cache/none.yaml").st_ino) 2024-03-12T17:22:59.237 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:59.417 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629339 2024-03-12T17:22:59.597 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:59.597 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:59.597 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:59.597 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:59.597 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/librbd/%").st_ino) 2024-03-12T17:22:59.597 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:22:59.792 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629337 2024-03-12T17:22:59.972 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:22:59.972 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:22:59.972 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:22:59.972 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:22:59.972 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind").st_ino) 2024-03-12T17:22:59.972 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:00.165 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629430 2024-03-12T17:23:00.347 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:00.347 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:00.347 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:00.347 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:00.347 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/base").st_ino) 2024-03-12T17:23:00.347 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:00.540 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629432 2024-03-12T17:23:00.722 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:00.722 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:00.722 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:00.722 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:00.722 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/base/install.yaml").st_ino) 2024-03-12T17:23:00.722 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:00.921 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629433 2024-03-12T17:23:01.101 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:01.101 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:01.101 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:01.101 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:01.101 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/clusters").st_ino) 2024-03-12T17:23:01.101 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:01.297 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629434 2024-03-12T17:23:01.478 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:01.478 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:01.478 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:01.478 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:01.478 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/objectstore").st_ino) 2024-03-12T17:23:01.479 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:01.681 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629436 2024-03-12T17:23:01.862 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:01.862 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:01.862 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:01.862 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:01.862 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/fs").st_ino) 2024-03-12T17:23:01.862 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:02.055 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629435 2024-03-12T17:23:02.238 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:02.238 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:02.238 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:02.238 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:02.238 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/workloads").st_ino) 2024-03-12T17:23:02.238 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:02.431 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629439 2024-03-12T17:23:02.614 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:02.614 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:02.614 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:02.614 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:02.615 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/workloads/rbd_mirror.yaml").st_ino) 2024-03-12T17:23:02.615 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:02.793 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628238 2024-03-12T17:23:02.974 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:02.974 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:02.975 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:02.975 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:02.975 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/workloads/c_api_tests.yaml").st_ino) 2024-03-12T17:23:02.975 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:03.157 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629440 2024-03-12T17:23:03.338 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:03.339 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:03.339 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:03.339 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:03.339 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/workloads/c_api_tests_with_defaults.yaml").st_ino) 2024-03-12T17:23:03.339 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:03.531 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628232 2024-03-12T17:23:03.712 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:03.713 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:03.713 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:03.713 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:03.713 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/workloads/python_api_tests.yaml").st_ino) 2024-03-12T17:23:03.713 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:03.902 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628235 2024-03-12T17:23:04.083 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:04.083 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:04.083 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:04.083 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:04.084 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/workloads/fsx.yaml").st_ino) 2024-03-12T17:23:04.084 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:04.277 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628234 2024-03-12T17:23:04.458 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:04.458 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:04.459 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:04.459 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:04.459 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/workloads/python_api_tests_with_journaling.yaml").st_ino) 2024-03-12T17:23:04.459 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:04.653 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628237 2024-03-12T17:23:04.833 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:04.833 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:04.833 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:04.833 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:04.833 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/workloads/c_api_tests_with_journaling.yaml").st_ino) 2024-03-12T17:23:04.833 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:05.024 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628233 2024-03-12T17:23:05.205 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:05.205 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:05.205 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:05.205 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:05.206 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/workloads/python_api_tests_with_defaults.yaml").st_ino) 2024-03-12T17:23:05.206 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:05.405 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628236 2024-03-12T17:23:05.585 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:05.586 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:05.586 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:05.586 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:05.586 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/validator").st_ino) 2024-03-12T17:23:05.586 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:05.777 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629437 2024-03-12T17:23:05.957 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:05.958 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:05.958 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:05.958 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:05.958 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/validator/memcheck.yaml").st_ino) 2024-03-12T17:23:05.958 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:06.152 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629438 2024-03-12T17:23:06.332 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:06.332 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:06.332 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:06.332 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:06.332 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/valgrind/%").st_ino) 2024-03-12T17:23:06.332 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:06.534 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629431 2024-03-12T17:23:06.715 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:06.715 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:06.715 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:06.715 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:06.715 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd").st_ino) 2024-03-12T17:23:06.715 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:06.907 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629380 2024-03-12T17:23:07.089 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:07.089 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:07.089 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:07.089 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:07.089 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd/base").st_ino) 2024-03-12T17:23:07.089 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:07.275 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629382 2024-03-12T17:23:07.456 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:07.456 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:07.456 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:07.456 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:07.456 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd/cluster").st_ino) 2024-03-12T17:23:07.456 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:07.650 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629383 2024-03-12T17:23:07.832 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:07.832 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:07.832 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:07.832 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:07.832 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd/cluster/openstack.yaml").st_ino) 2024-03-12T17:23:07.833 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:08.023 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629385 2024-03-12T17:23:08.205 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:08.205 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:08.205 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:08.205 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:08.205 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd/cluster/+").st_ino) 2024-03-12T17:23:08.205 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:08.399 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629384 2024-03-12T17:23:08.579 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:08.580 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:08.580 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:08.580 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:08.580 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd/cluster/fixed-3.yaml").st_ino) 2024-03-12T17:23:08.580 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:08.774 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628193 2024-03-12T17:23:08.956 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:08.956 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:08.956 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:08.956 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:08.956 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd/msgr-failures").st_ino) 2024-03-12T17:23:08.956 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:09.154 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629387 2024-03-12T17:23:09.336 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:09.336 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:09.336 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:09.336 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:09.336 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd/objectstore").st_ino) 2024-03-12T17:23:09.336 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:09.530 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629388 2024-03-12T17:23:09.711 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:09.712 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:09.712 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:09.712 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:09.712 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd/fs").st_ino) 2024-03-12T17:23:09.712 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:09.905 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629386 2024-03-12T17:23:10.085 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:10.086 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:10.086 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:10.086 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:10.086 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd/workloads").st_ino) 2024-03-12T17:23:10.086 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:10.280 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629390 2024-03-12T17:23:10.461 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:10.461 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:10.461 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:10.462 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:10.462 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd/workloads/rbd_nbd.yaml").st_ino) 2024-03-12T17:23:10.462 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:10.642 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628194 2024-03-12T17:23:10.826 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:10.826 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:10.826 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:10.826 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:10.826 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd/workloads/rbd_fsx_nbd.yaml").st_ino) 2024-03-12T17:23:10.826 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:11.019 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629391 2024-03-12T17:23:11.199 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:11.199 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:11.199 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:11.199 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:11.199 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd/%").st_ino) 2024-03-12T17:23:11.200 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:11.393 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629381 2024-03-12T17:23:11.544 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:23:11.552 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:23:11.575 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:11.575 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:11.575 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:11.575 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:11.575 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/nbd/thrashers").st_ino) 2024-03-12T17:23:11.575 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:11.757 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629389 2024-03-12T17:23:11.939 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:11.939 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:11.939 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:11.939 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:11.939 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash").st_ino) 2024-03-12T17:23:11.939 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:12.090 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629414 2024-03-12T17:23:12.271 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:12.271 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:12.271 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:12.271 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:12.271 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/base").st_ino) 2024-03-12T17:23:12.271 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:12.463 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629416 2024-03-12T17:23:12.643 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:12.643 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:12.643 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:12.643 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:12.643 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/base/install.yaml").st_ino) 2024-03-12T17:23:12.644 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:12.839 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629417 2024-03-12T17:23:13.020 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:13.021 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:13.021 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:13.021 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:13.021 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/clusters").st_ino) 2024-03-12T17:23:13.021 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:13.212 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629418 2024-03-12T17:23:13.394 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:13.394 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:13.394 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:13.394 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:13.394 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/clusters/openstack.yaml").st_ino) 2024-03-12T17:23:13.394 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:13.594 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628221 2024-03-12T17:23:13.775 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:13.775 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:13.775 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:13.776 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:13.776 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/clusters/fixed-2.yaml").st_ino) 2024-03-12T17:23:13.776 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:13.967 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629420 2024-03-12T17:23:14.148 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:14.148 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:14.148 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:14.148 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:14.148 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/clusters/+").st_ino) 2024-03-12T17:23:14.148 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:14.352 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629419 2024-03-12T17:23:14.533 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:14.533 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:14.533 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:14.533 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:14.533 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/msgr-failures").st_ino) 2024-03-12T17:23:14.533 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:14.732 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629423 2024-03-12T17:23:14.913 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:14.913 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:14.913 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:14.913 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:14.913 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/msgr-failures/few.yaml").st_ino) 2024-03-12T17:23:14.913 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:15.104 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629424 2024-03-12T17:23:15.286 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:15.286 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:15.286 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:15.286 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:15.286 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/objectstore").st_ino) 2024-03-12T17:23:15.286 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:15.480 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629425 2024-03-12T17:23:15.659 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:15.659 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:15.659 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:15.659 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:15.659 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/fs").st_ino) 2024-03-12T17:23:15.659 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:15.850 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629421 2024-03-12T17:23:16.031 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:16.031 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:16.031 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:16.031 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:16.031 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/fs/xfs.yaml").st_ino) 2024-03-12T17:23:16.031 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:16.227 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629422 2024-03-12T17:23:16.408 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:16.408 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:16.408 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:16.409 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:16.409 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/workloads").st_ino) 2024-03-12T17:23:16.409 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:16.601 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629428 2024-03-12T17:23:16.781 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:16.782 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:16.782 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:16.782 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:16.782 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_fsx_cache_writeback.yaml").st_ino) 2024-03-12T17:23:16.782 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:16.976 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628227 2024-03-12T17:23:17.156 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:17.157 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:17.157 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:17.157 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:17.157 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_fsx_copy_on_read.yaml").st_ino) 2024-03-12T17:23:17.157 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:17.337 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628229 2024-03-12T17:23:17.518 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:17.518 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:17.518 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:17.518 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:17.518 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_fsx_journal.yaml").st_ino) 2024-03-12T17:23:17.518 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:17.698 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628230 2024-03-12T17:23:17.878 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:17.878 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:17.878 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:17.878 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:17.878 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_api_tests_journaling.yaml").st_ino) 2024-03-12T17:23:17.878 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:18.074 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628225 2024-03-12T17:23:18.255 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:18.255 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:18.255 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:18.255 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:18.255 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_fsx_nocache.yaml").st_ino) 2024-03-12T17:23:18.255 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:18.448 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628231 2024-03-12T17:23:18.629 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:18.629 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:18.629 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:18.630 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:18.630 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_api_tests.yaml").st_ino) 2024-03-12T17:23:18.630 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:18.823 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628223 2024-03-12T17:23:19.004 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:19.004 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:19.004 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:19.004 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:19.004 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/workloads/journal.yaml").st_ino) 2024-03-12T17:23:19.004 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:19.197 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629429 2024-03-12T17:23:19.378 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:19.378 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:19.378 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:19.378 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:19.378 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_api_tests_copy_on_read.yaml").st_ino) 2024-03-12T17:23:19.378 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:19.577 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628224 2024-03-12T17:23:19.759 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:19.759 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:19.759 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:19.759 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:19.759 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_api_tests_no_locking.yaml").st_ino) 2024-03-12T17:23:19.759 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:19.952 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628226 2024-03-12T17:23:20.134 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:20.134 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:20.134 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:20.134 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:20.134 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/workloads/rbd_fsx_cache_writethrough.yaml").st_ino) 2024-03-12T17:23:20.134 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:20.325 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628228 2024-03-12T17:23:20.506 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:20.506 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:20.506 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:20.506 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:20.506 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/%").st_ino) 2024-03-12T17:23:20.506 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:20.700 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629415 2024-03-12T17:23:20.881 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:20.882 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:20.882 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:20.882 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:20.882 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/thrashers").st_ino) 2024-03-12T17:23:20.882 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:21.073 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629426 2024-03-12T17:23:21.254 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:21.254 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:21.254 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:21.254 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:21.254 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/thrashers/default.yaml").st_ino) 2024-03-12T17:23:21.254 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:21.446 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628222 2024-03-12T17:23:21.627 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:21.627 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:21.627 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:21.627 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:21.627 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/thrash/thrashers/cache.yaml").st_ino) 2024-03-12T17:23:21.628 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:21.820 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629427 2024-03-12T17:23:22.001 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:22.001 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:22.001 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:22.001 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:22.001 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror").st_ino) 2024-03-12T17:23:22.001 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:22.197 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629367 2024-03-12T17:23:22.378 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:22.378 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:22.378 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:22.378 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:22.378 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/base").st_ino) 2024-03-12T17:23:22.378 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:22.570 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629369 2024-03-12T17:23:22.752 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:22.752 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:22.752 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:22.752 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:22.752 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/base/install.yaml").st_ino) 2024-03-12T17:23:22.753 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:22.946 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629370 2024-03-12T17:23:23.127 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:23.127 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:23.127 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:23.127 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:23.127 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/cluster").st_ino) 2024-03-12T17:23:23.127 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:23.326 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629371 2024-03-12T17:23:23.510 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:23.510 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:23.511 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:23.511 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:23.511 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/cluster/openstack.yaml").st_ino) 2024-03-12T17:23:23.511 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:23.700 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628191 2024-03-12T17:23:23.881 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:23.881 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:23.881 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:23.881 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:23.882 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/cluster/2-node.yaml").st_ino) 2024-03-12T17:23:23.882 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:24.072 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628190 2024-03-12T17:23:24.254 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:24.255 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:24.255 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:24.255 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:24.255 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/cluster/+").st_ino) 2024-03-12T17:23:24.255 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:24.450 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629372 2024-03-12T17:23:24.631 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:24.631 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:24.631 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:24.631 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:24.631 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/msgr-failures").st_ino) 2024-03-12T17:23:24.631 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:24.815 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629374 2024-03-12T17:23:24.996 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:24.996 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:24.996 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:24.996 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:24.996 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/objectstore").st_ino) 2024-03-12T17:23:24.996 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:25.190 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629375 2024-03-12T17:23:25.372 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:25.372 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:25.372 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:25.372 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:25.372 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/fs").st_ino) 2024-03-12T17:23:25.372 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:25.568 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629373 2024-03-12T17:23:25.749 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:25.749 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:25.749 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:25.749 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:25.749 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/workloads").st_ino) 2024-03-12T17:23:25.749 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:25.947 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629378 2024-03-12T17:23:26.127 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:26.127 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:26.127 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:26.127 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:26.127 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/workloads/rbd-mirror-stress-workunit.yaml").st_ino) 2024-03-12T17:23:26.128 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:26.321 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629379 2024-03-12T17:23:26.502 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:26.503 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:26.503 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:26.503 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:26.503 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/workloads/rbd-mirror-workunit.yaml").st_ino) 2024-03-12T17:23:26.503 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:26.697 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628192 2024-03-12T17:23:26.877 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:26.877 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:26.877 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:26.878 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:26.878 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/%").st_ino) 2024-03-12T17:23:26.878 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:27.070 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629368 2024-03-12T17:23:27.252 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:27.252 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:27.252 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:27.252 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:27.252 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/rbd-mirror").st_ino) 2024-03-12T17:23:27.252 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:27.444 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629376 2024-03-12T17:23:27.625 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:27.625 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:27.625 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:27.625 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:27.625 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/mirror/rbd-mirror/one-per-cluster.yaml").st_ino) 2024-03-12T17:23:27.626 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:27.819 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629377 2024-03-12T17:23:28.000 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:28.000 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:28.000 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:28.000 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:28.000 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu").st_ino) 2024-03-12T17:23:28.000 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:28.190 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629392 2024-03-12T17:23:28.371 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:28.371 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:28.371 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:28.371 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:28.371 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/features").st_ino) 2024-03-12T17:23:28.371 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:28.555 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629399 2024-03-12T17:23:28.735 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:28.735 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:28.735 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:28.735 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:28.735 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/features/defaults.yaml").st_ino) 2024-03-12T17:23:28.735 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:28.926 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629400 2024-03-12T17:23:29.107 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:29.108 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:29.108 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:29.108 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:29.108 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/features/journaling.yaml").st_ino) 2024-03-12T17:23:29.108 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:29.301 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628198 2024-03-12T17:23:29.481 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:29.482 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:29.482 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:29.482 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:29.482 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/pool").st_ino) 2024-03-12T17:23:29.482 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:29.673 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629405 2024-03-12T17:23:29.854 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:29.854 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:29.854 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:29.854 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:29.854 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/pool/small-cache-pool.yaml").st_ino) 2024-03-12T17:23:29.854 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:30.050 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628202 2024-03-12T17:23:30.230 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:30.230 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:30.230 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:30.231 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:30.231 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/pool/replicated-data-pool.yaml").st_ino) 2024-03-12T17:23:30.231 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:30.425 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628201 2024-03-12T17:23:30.606 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:30.606 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:30.606 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:30.606 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:30.606 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/pool/ec-cache-pool.yaml").st_ino) 2024-03-12T17:23:30.606 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:30.798 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629406 2024-03-12T17:23:30.980 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:30.980 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:30.980 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:30.980 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:30.980 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/pool/ec-data-pool.yaml").st_ino) 2024-03-12T17:23:30.980 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:31.173 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628199 2024-03-12T17:23:31.354 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:31.355 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:31.355 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:31.355 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:31.355 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/pool/none.yaml").st_ino) 2024-03-12T17:23:31.355 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:31.548 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628200 2024-03-12T17:23:31.730 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:31.730 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:31.730 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:31.730 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:31.730 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/clusters").st_ino) 2024-03-12T17:23:31.730 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:31.925 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629396 2024-03-12T17:23:32.106 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:32.106 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:32.106 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:32.106 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:32.106 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/clusters/openstack.yaml").st_ino) 2024-03-12T17:23:32.106 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:32.306 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628197 2024-03-12T17:23:32.486 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:32.486 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:32.486 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:32.486 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:32.486 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/clusters/+").st_ino) 2024-03-12T17:23:32.486 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:32.682 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629397 2024-03-12T17:23:32.862 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:32.862 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:32.862 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:32.862 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:32.862 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/clusters/fixed-3.yaml").st_ino) 2024-03-12T17:23:32.863 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:33.056 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629398 2024-03-12T17:23:33.237 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:33.237 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:33.237 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:33.237 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:33.237 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/msgr-failures").st_ino) 2024-03-12T17:23:33.238 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:33.437 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629402 2024-03-12T17:23:33.618 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:33.618 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:33.618 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:33.618 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:33.618 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/msgr-failures/few.yaml").st_ino) 2024-03-12T17:23:33.618 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:33.813 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629403 2024-03-12T17:23:33.995 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:33.995 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:33.995 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:33.995 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:33.995 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/objectstore").st_ino) 2024-03-12T17:23:33.995 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:34.187 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629404 2024-03-12T17:23:34.368 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:34.368 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:34.368 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:34.368 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:34.369 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/fs").st_ino) 2024-03-12T17:23:34.369 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:34.562 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629401 2024-03-12T17:23:34.744 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:34.744 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:34.744 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:34.744 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:34.744 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/workloads").st_ino) 2024-03-12T17:23:34.744 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:34.936 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629407 2024-03-12T17:23:35.116 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:35.116 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:35.117 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:35.117 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:35.117 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/workloads/qemu_iozone.yaml.disabled").st_ino) 2024-03-12T17:23:35.117 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:35.309 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628205 2024-03-12T17:23:35.492 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:35.492 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:35.492 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:35.492 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:35.492 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/workloads/#qemu_xfstests.yaml#").st_ino) 2024-03-12T17:23:35.492 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:35.688 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629408 2024-03-12T17:23:35.868 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:35.868 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:35.869 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:35.869 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:35.869 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/workloads/qemu_xfstests.yaml").st_ino) 2024-03-12T17:23:35.869 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:36.064 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628206 2024-03-12T17:23:36.247 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:36.247 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:36.247 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:36.247 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:36.247 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/workloads/qemu_fsstress.yaml").st_ino) 2024-03-12T17:23:36.247 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:36.440 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628204 2024-03-12T17:23:36.621 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:36.621 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:36.621 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:36.621 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:36.621 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/workloads/qemu_bonnie.yaml").st_ino) 2024-03-12T17:23:36.621 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:36.815 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628203 2024-03-12T17:23:36.995 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:36.995 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:36.995 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:36.995 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:36.995 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/cache").st_ino) 2024-03-12T17:23:36.995 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:37.190 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629394 2024-03-12T17:23:37.371 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:37.371 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:37.371 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:37.371 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:37.372 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/cache/writeback.yaml").st_ino) 2024-03-12T17:23:37.372 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:37.567 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628195 2024-03-12T17:23:37.748 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:37.748 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:37.749 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:37.749 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:37.749 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/cache/writethrough.yaml").st_ino) 2024-03-12T17:23:37.749 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:37.940 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628196 2024-03-12T17:23:38.121 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:38.121 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:38.121 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:38.121 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:38.121 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/cache/none.yaml").st_ino) 2024-03-12T17:23:38.121 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:38.303 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629395 2024-03-12T17:23:38.482 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:38.483 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:38.483 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:38.483 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:38.483 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rbd/qemu/%").st_ino) 2024-03-12T17:23:38.483 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:38.675 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629393 2024-03-12T17:23:38.858 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:38.858 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:38.858 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:38.858 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:38.858 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rest").st_ino) 2024-03-12T17:23:38.858 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:39.062 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629441 2024-03-12T17:23:39.241 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:39.241 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:39.242 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:39.242 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:39.242 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rest/basic").st_ino) 2024-03-12T17:23:39.242 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:39.438 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629442 2024-03-12T17:23:39.619 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:39.619 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:39.619 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:39.619 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:39.619 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rest/basic/tasks").st_ino) 2024-03-12T17:23:39.619 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:39.812 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629443 2024-03-12T17:23:39.992 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:39.992 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:39.992 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:39.992 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:39.992 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rest/basic/tasks/rest_test.yaml").st_ino) 2024-03-12T17:23:39.992 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:40.174 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629444 2024-03-12T17:23:40.355 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:40.356 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:40.356 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:40.356 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:40.356 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw").st_ino) 2024-03-12T17:23:40.356 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:40.550 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629445 2024-03-12T17:23:40.732 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:40.732 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:40.732 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:40.732 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:40.732 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs").st_ino) 2024-03-12T17:23:40.732 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:40.929 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629446 2024-03-12T17:23:41.111 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:41.111 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:41.111 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:41.111 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:41.111 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/clusters").st_ino) 2024-03-12T17:23:41.111 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:41.318 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629448 2024-03-12T17:23:41.498 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:41.498 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:41.498 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:41.498 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:41.498 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/clusters/fixed-2.yaml").st_ino) 2024-03-12T17:23:41.498 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:41.676 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629449 2024-03-12T17:23:41.688 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:23:41.695 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:23:41.857 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:41.857 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:41.857 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:41.857 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:41.857 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/objectstore").st_ino) 2024-03-12T17:23:41.857 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:42.001 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629454 2024-03-12T17:23:42.182 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:42.182 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:42.182 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:42.182 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:42.182 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/fs").st_ino) 2024-03-12T17:23:42.182 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:42.375 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629452 2024-03-12T17:23:42.555 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:42.555 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:42.555 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:42.555 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:42.555 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/fs/xfs.yaml").st_ino) 2024-03-12T17:23:42.555 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:42.746 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629453 2024-03-12T17:23:42.928 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:42.928 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:42.928 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:42.928 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:42.928 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/rgw_pool_type").st_ino) 2024-03-12T17:23:42.928 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:43.121 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629455 2024-03-12T17:23:43.303 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:43.303 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:43.303 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:43.303 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:43.303 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/frontend").st_ino) 2024-03-12T17:23:43.303 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:43.498 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629450 2024-03-12T17:23:43.678 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:43.678 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:43.678 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:43.678 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:43.678 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/frontend/apache.yaml").st_ino) 2024-03-12T17:23:43.679 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:43.871 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629451 2024-03-12T17:23:44.052 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:44.052 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:44.052 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:44.052 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:44.052 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/frontend/civetweb.yaml").st_ino) 2024-03-12T17:23:44.052 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:44.245 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628239 2024-03-12T17:23:44.427 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:44.427 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:44.427 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:44.427 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:44.427 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/overrides.yaml").st_ino) 2024-03-12T17:23:44.427 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:44.610 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628240 2024-03-12T17:23:44.792 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:44.792 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:44.792 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:44.792 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:44.792 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/%").st_ino) 2024-03-12T17:23:44.792 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:44.972 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629447 2024-03-12T17:23:45.152 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:45.152 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:45.153 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:45.153 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:45.153 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/tasks").st_ino) 2024-03-12T17:23:45.153 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:45.338 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629456 2024-03-12T17:23:45.519 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:45.519 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:45.519 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:45.519 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:45.519 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_roundtrip.yaml").st_ino) 2024-03-12T17:23:45.519 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:45.712 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628243 2024-03-12T17:23:45.893 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:45.893 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:45.893 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:45.893 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:45.893 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_multipart_upload.yaml").st_ino) 2024-03-12T17:23:45.893 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:46.087 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628241 2024-03-12T17:23:46.269 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:46.269 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:46.269 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:46.269 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:46.269 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_user_quota.yaml").st_ino) 2024-03-12T17:23:46.269 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:46.450 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628246 2024-03-12T17:23:46.629 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:46.629 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:46.629 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:46.629 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:46.630 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_readwrite.yaml").st_ino) 2024-03-12T17:23:46.630 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:46.824 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628242 2024-03-12T17:23:47.004 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:47.004 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:47.004 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:47.005 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:47.005 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_swift.yaml").st_ino) 2024-03-12T17:23:47.005 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:47.198 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628245 2024-03-12T17:23:47.379 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:47.379 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:47.380 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:47.380 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:47.380 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_s3tests.yaml").st_ino) 2024-03-12T17:23:47.380 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:47.588 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628244 2024-03-12T17:23:47.768 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:47.768 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:47.769 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:47.769 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:47.769 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/multifs/tasks/rgw_bucket_quota.yaml").st_ino) 2024-03-12T17:23:47.769 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:47.962 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629457 2024-03-12T17:23:48.142 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:48.142 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:48.142 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:48.142 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:48.142 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton").st_ino) 2024-03-12T17:23:48.142 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:48.335 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629458 2024-03-12T17:23:48.516 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:48.516 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:48.516 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:48.516 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:48.516 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/objectstore").st_ino) 2024-03-12T17:23:48.516 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:48.709 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629466 2024-03-12T17:23:48.890 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:48.890 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:48.890 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:48.890 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:48.890 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/fs").st_ino) 2024-03-12T17:23:48.890 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:49.082 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629464 2024-03-12T17:23:49.263 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:49.263 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:49.263 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:49.263 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:49.263 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/fs/xfs.yaml").st_ino) 2024-03-12T17:23:49.263 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:49.460 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629465 2024-03-12T17:23:49.640 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:49.640 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:49.640 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:49.640 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:49.640 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/rgw_pool_type").st_ino) 2024-03-12T17:23:49.641 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:49.834 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629467 2024-03-12T17:23:50.015 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:50.015 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:50.015 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:50.015 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:50.015 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/frontend").st_ino) 2024-03-12T17:23:50.015 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:50.219 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629462 2024-03-12T17:23:50.400 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:50.400 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:50.400 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:50.400 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:50.400 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/frontend/apache.yaml").st_ino) 2024-03-12T17:23:50.400 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:50.611 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629463 2024-03-12T17:23:50.788 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:50.788 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:50.788 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:50.788 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:50.788 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/frontend/civetweb.yaml").st_ino) 2024-03-12T17:23:50.788 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:50.986 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628250 2024-03-12T17:23:51.168 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:51.168 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:51.168 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:51.168 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:51.168 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/overrides.yaml").st_ino) 2024-03-12T17:23:51.168 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:51.368 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628251 2024-03-12T17:23:51.549 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:51.549 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:51.549 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:51.549 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:51.549 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/%").st_ino) 2024-03-12T17:23:51.549 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:51.749 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629459 2024-03-12T17:23:51.929 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:51.929 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:51.929 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:51.929 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:51.929 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/xfs.yaml").st_ino) 2024-03-12T17:23:51.929 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:52.122 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629468 2024-03-12T17:23:52.303 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:52.303 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:52.303 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:52.303 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:52.303 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/all").st_ino) 2024-03-12T17:23:52.303 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:52.499 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629460 2024-03-12T17:23:52.680 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:52.680 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:52.680 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:52.680 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:52.680 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/all/radosgw-admin-multi-region.yaml").st_ino) 2024-03-12T17:23:52.680 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:52.875 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628247 2024-03-12T17:23:53.055 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:53.055 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:53.055 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:53.055 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:53.055 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/all/radosgw-admin.yaml").st_ino) 2024-03-12T17:23:53.055 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:53.249 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628248 2024-03-12T17:23:53.430 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:53.430 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:53.430 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:53.430 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:53.430 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/all/radosgw-admin-data-sync.yaml").st_ino) 2024-03-12T17:23:53.430 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:53.624 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629461 2024-03-12T17:23:53.805 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:53.805 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:53.805 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:53.806 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:53.806 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/singleton/all/radosgw-convert-to-region.yaml").st_ino) 2024-03-12T17:23:53.806 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:53.999 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628249 2024-03-12T17:23:54.180 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:54.180 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:54.180 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:54.180 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:54.180 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify").st_ino) 2024-03-12T17:23:54.180 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:54.373 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629469 2024-03-12T17:23:54.555 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:54.555 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:54.555 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:54.555 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:54.556 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/validater").st_ino) 2024-03-12T17:23:54.556 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:54.748 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629483 2024-03-12T17:23:54.928 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:54.928 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:54.928 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:54.928 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:54.929 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/validater/valgrind.yaml").st_ino) 2024-03-12T17:23:54.929 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:55.123 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628256 2024-03-12T17:23:55.304 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:55.304 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:55.304 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:55.304 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:55.305 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/validater/lockdep.yaml").st_ino) 2024-03-12T17:23:55.305 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:55.502 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629484 2024-03-12T17:23:55.683 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:55.683 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:55.683 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:55.683 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:55.683 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/clusters").st_ino) 2024-03-12T17:23:55.683 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:55.878 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629471 2024-03-12T17:23:56.060 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:56.060 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:56.060 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:56.060 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:56.060 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/clusters/fixed-2.yaml").st_ino) 2024-03-12T17:23:56.060 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:56.249 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629472 2024-03-12T17:23:56.430 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:56.430 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:56.430 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:56.430 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:56.430 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/msgr-failures").st_ino) 2024-03-12T17:23:56.430 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:56.623 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629477 2024-03-12T17:23:56.805 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:56.805 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:56.805 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:56.805 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:56.805 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/msgr-failures/few.yaml").st_ino) 2024-03-12T17:23:56.805 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:56.998 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629478 2024-03-12T17:23:57.179 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:57.179 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:57.179 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:57.179 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:57.179 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/objectstore").st_ino) 2024-03-12T17:23:57.179 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:57.371 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629479 2024-03-12T17:23:57.552 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:57.553 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:57.553 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:57.553 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:57.553 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/fs").st_ino) 2024-03-12T17:23:57.553 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:57.748 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629475 2024-03-12T17:23:57.929 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:57.929 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:57.929 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:57.929 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:57.929 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/fs/xfs.yaml").st_ino) 2024-03-12T17:23:57.929 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:58.124 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629476 2024-03-12T17:23:58.305 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:58.305 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:58.305 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:58.305 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:58.305 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/rgw_pool_type").st_ino) 2024-03-12T17:23:58.305 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:58.499 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629480 2024-03-12T17:23:58.678 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:58.678 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:58.678 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:58.678 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:58.678 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/frontend").st_ino) 2024-03-12T17:23:58.679 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:58.873 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629473 2024-03-12T17:23:59.053 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:59.053 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:59.053 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:59.053 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:59.053 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/frontend/apache.yaml").st_ino) 2024-03-12T17:23:59.053 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:59.244 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629474 2024-03-12T17:23:59.425 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:59.425 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:59.426 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:59.426 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:59.426 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/frontend/civetweb.yaml").st_ino) 2024-03-12T17:23:59.426 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:59.616 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628252 2024-03-12T17:23:59.797 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:23:59.797 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:23:59.797 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:23:59.797 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:23:59.797 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/overrides.yaml").st_ino) 2024-03-12T17:23:59.798 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:23:59.988 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628253 2024-03-12T17:24:00.170 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:00.170 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:00.170 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:00.171 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:00.171 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/%").st_ino) 2024-03-12T17:24:00.171 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:00.359 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629470 2024-03-12T17:24:00.540 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:00.541 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:00.541 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:00.541 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:00.541 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/tasks").st_ino) 2024-03-12T17:24:00.541 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:00.737 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629481 2024-03-12T17:24:00.917 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:00.917 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:00.917 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:00.917 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:00.917 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/tasks/rgw_s3tests_multiregion.yaml").st_ino) 2024-03-12T17:24:00.917 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:01.120 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628254 2024-03-12T17:24:01.301 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:01.301 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:01.301 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:01.301 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:01.301 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/tasks/rgw_swift.yaml").st_ino) 2024-03-12T17:24:01.301 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:01.503 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628255 2024-03-12T17:24:01.683 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:01.683 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:01.683 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:01.683 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:01.683 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rgw/verify/tasks/rgw_s3tests.yaml").st_ino) 2024-03-12T17:24:01.683 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:01.876 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629482 2024-03-12T17:24:02.056 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:02.056 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:02.057 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:02.057 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:02.057 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-deploy").st_ino) 2024-03-12T17:24:02.057 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:02.248 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628406 2024-03-12T17:24:02.430 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:02.430 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:02.430 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:02.430 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:02.430 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-deploy/basic").st_ino) 2024-03-12T17:24:02.430 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:02.624 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628407 2024-03-12T17:24:02.806 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:02.806 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:02.806 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:02.806 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:02.806 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-deploy/basic/ceph-deploy-overrides").st_ino) 2024-03-12T17:24:02.806 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:02.987 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628409 2024-03-12T17:24:03.168 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:03.168 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:03.168 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:03.168 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:03.168 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-deploy/basic/python_versions").st_ino) 2024-03-12T17:24:03.168 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:03.363 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628412 2024-03-12T17:24:03.543 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:03.543 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:03.543 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:03.544 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:03.544 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-deploy/basic/python_versions/python_3.yaml").st_ino) 2024-03-12T17:24:03.544 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:03.739 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627894 2024-03-12T17:24:03.919 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:03.919 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:03.919 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:03.919 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:03.919 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-deploy/basic/python_versions/python_2.yaml").st_ino) 2024-03-12T17:24:03.919 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:04.110 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628413 2024-03-12T17:24:04.292 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:04.292 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:04.292 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:04.293 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:04.293 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-deploy/basic/config_options").st_ino) 2024-03-12T17:24:04.293 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:04.484 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628410 2024-03-12T17:24:04.664 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:04.664 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:04.664 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:04.664 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:04.664 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-deploy/basic/distros").st_ino) 2024-03-12T17:24:04.664 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:04.854 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628411 2024-03-12T17:24:05.035 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:05.035 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:05.035 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:05.035 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:05.035 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-deploy/basic/%").st_ino) 2024-03-12T17:24:05.035 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:05.232 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628408 2024-03-12T17:24:05.409 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:05.409 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:05.410 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:05.410 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:05.410 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-deploy/basic/tasks").st_ino) 2024-03-12T17:24:05.410 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:05.613 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628414 2024-03-12T17:24:05.795 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:05.795 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:05.795 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:05.796 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:05.796 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-deploy/basic/tasks/ceph-admin-commands.yaml").st_ino) 2024-03-12T17:24:05.796 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:05.990 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628415 2024-03-12T17:24:06.171 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:06.172 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:06.172 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:06.172 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:06.172 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt").st_ino) 2024-03-12T17:24:06.172 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:06.353 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629828 2024-03-12T17:24:06.533 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:06.533 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:06.533 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:06.533 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:06.533 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic").st_ino) 2024-03-12T17:24:06.533 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:06.726 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629829 2024-03-12T17:24:06.906 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:06.907 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:06.907 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:06.907 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:06.907 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/clusters").st_ino) 2024-03-12T17:24:06.907 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:07.099 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629831 2024-03-12T17:24:07.280 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:07.281 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:07.281 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:07.281 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:07.281 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/clusters/fixed-3.yaml").st_ino) 2024-03-12T17:24:07.281 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:07.474 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629832 2024-03-12T17:24:07.655 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:07.655 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:07.656 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:07.656 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:07.656 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/msgr-failures").st_ino) 2024-03-12T17:24:07.656 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:07.846 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629835 2024-03-12T17:24:08.027 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:08.027 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:08.027 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:08.028 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:08.028 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/msgr-failures/many.yaml").st_ino) 2024-03-12T17:24:08.028 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:08.223 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628885 2024-03-12T17:24:08.404 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:08.404 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:08.404 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:08.404 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:08.404 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/msgr-failures/few.yaml").st_ino) 2024-03-12T17:24:08.404 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:08.597 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629836 2024-03-12T17:24:08.777 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:08.777 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:08.777 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:08.777 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:08.777 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/fs").st_ino) 2024-03-12T17:24:08.777 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:08.972 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629833 2024-03-12T17:24:09.154 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:09.154 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:09.154 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:09.154 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:09.155 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/fs/btrfs.yaml").st_ino) 2024-03-12T17:24:09.155 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:09.347 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629834 2024-03-12T17:24:09.528 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:09.528 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:09.528 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:09.528 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:09.528 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/%").st_ino) 2024-03-12T17:24:09.528 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:09.720 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629830 2024-03-12T17:24:09.901 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:09.901 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:09.901 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:09.901 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:09.901 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks").st_ino) 2024-03-12T17:24:09.901 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:10.095 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629837 2024-03-12T17:24:10.276 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:10.276 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:10.276 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:10.276 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:10.276 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks/iozone-sync.yaml").st_ino) 2024-03-12T17:24:10.276 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:10.459 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628895 2024-03-12T17:24:10.640 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:10.640 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:10.640 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:10.640 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:10.640 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks/dbench-short.yaml").st_ino) 2024-03-12T17:24:10.640 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:10.833 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628887 2024-03-12T17:24:11.013 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:11.013 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:11.014 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:11.014 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:11.014 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks/blogbench.yaml").st_ino) 2024-03-12T17:24:11.014 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:11.205 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629838 2024-03-12T17:24:11.386 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:11.386 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:11.386 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:11.386 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:11.386 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks/ffsb.yaml").st_ino) 2024-03-12T17:24:11.386 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:11.589 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628889 2024-03-12T17:24:11.771 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:11.771 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:11.771 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:11.771 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:11.771 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks/pjd.yaml").st_ino) 2024-03-12T17:24:11.771 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:11.827 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:24:11.833 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:24:11.940 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628897 2024-03-12T17:24:12.126 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:12.126 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:12.126 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:12.126 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:12.126 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks/fsync-tester.yaml").st_ino) 2024-03-12T17:24:12.127 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:12.282 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628893 2024-03-12T17:24:12.463 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:12.463 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:12.463 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:12.463 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:12.463 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks/iogen.yaml").st_ino) 2024-03-12T17:24:12.463 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:12.671 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628894 2024-03-12T17:24:12.851 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:12.852 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:12.852 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:12.852 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:12.852 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks/fsx.yaml").st_ino) 2024-03-12T17:24:12.852 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:13.042 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628892 2024-03-12T17:24:13.225 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:13.225 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:13.225 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:13.225 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:13.225 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks/bonnie.yaml").st_ino) 2024-03-12T17:24:13.225 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:13.415 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628886 2024-03-12T17:24:13.597 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:13.597 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:13.597 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:13.597 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:13.597 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks/fio.yaml").st_ino) 2024-03-12T17:24:13.597 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:13.789 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628890 2024-03-12T17:24:13.970 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:13.970 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:13.970 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:13.971 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:13.971 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks/iozone.yaml").st_ino) 2024-03-12T17:24:13.971 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:14.169 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628896 2024-03-12T17:24:14.350 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:14.350 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:14.350 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:14.350 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:14.350 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks/dbench.yaml").st_ino) 2024-03-12T17:24:14.350 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:14.540 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628888 2024-03-12T17:24:14.721 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:14.721 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:14.721 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:14.721 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:14.721 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/tgt/basic/tasks/fsstress.yaml").st_ino) 2024-03-12T17:24:14.721 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:14.919 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628891 2024-03-12T17:24:15.099 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:15.099 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:15.099 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:15.100 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:15.100 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba").st_ino) 2024-03-12T17:24:15.100 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:15.293 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629485 2024-03-12T17:24:15.475 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:15.475 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:15.475 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:15.475 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:15.475 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/install").st_ino) 2024-03-12T17:24:15.475 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:15.656 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629491 2024-03-12T17:24:15.836 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:15.836 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:15.836 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:15.836 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:15.836 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/install/install.yaml").st_ino) 2024-03-12T17:24:15.836 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:16.023 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629492 2024-03-12T17:24:16.203 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:16.203 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:16.203 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:16.203 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:16.203 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/clusters").st_ino) 2024-03-12T17:24:16.203 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:16.399 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629487 2024-03-12T17:24:16.583 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:16.583 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:16.583 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:16.583 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:16.583 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/clusters/samba-basic.yaml").st_ino) 2024-03-12T17:24:16.583 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:16.777 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629488 2024-03-12T17:24:16.957 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:16.957 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:16.957 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:16.957 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:16.958 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/workload").st_ino) 2024-03-12T17:24:16.958 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:17.148 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629495 2024-03-12T17:24:17.328 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:17.329 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:17.329 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:17.329 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:17.329 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/workload/cifs-kernel-build.yaml.disabled").st_ino) 2024-03-12T17:24:17.329 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:17.524 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628261 2024-03-12T17:24:17.704 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:17.704 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:17.704 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:17.705 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:17.705 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/workload/cifs-fsstress.yaml").st_ino) 2024-03-12T17:24:17.705 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:17.895 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628260 2024-03-12T17:24:18.077 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:18.077 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:18.077 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:18.077 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:18.077 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/workload/smbtorture.yaml").st_ino) 2024-03-12T17:24:18.077 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:18.269 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628262 2024-03-12T17:24:18.450 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:18.450 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:18.450 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:18.450 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:18.450 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/workload/cifs-dbench.yaml").st_ino) 2024-03-12T17:24:18.450 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:18.647 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629496 2024-03-12T17:24:18.827 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:18.827 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:18.827 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:18.827 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:18.827 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/fs").st_ino) 2024-03-12T17:24:18.828 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:19.019 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629489 2024-03-12T17:24:19.199 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:19.199 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:19.199 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:19.199 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:19.200 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/fs/xfs.yaml").st_ino) 2024-03-12T17:24:19.200 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:19.390 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629490 2024-03-12T17:24:19.572 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:19.572 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:19.572 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:19.572 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:19.572 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/mount").st_ino) 2024-03-12T17:24:19.572 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:19.763 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629493 2024-03-12T17:24:19.944 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:19.944 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:19.944 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:19.944 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:19.945 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/mount/noceph.yaml").st_ino) 2024-03-12T17:24:19.945 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:20.137 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628259 2024-03-12T17:24:20.319 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:20.319 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:20.319 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:20.319 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:20.319 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/mount/kclient.yaml").st_ino) 2024-03-12T17:24:20.319 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:20.514 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628257 2024-03-12T17:24:20.694 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:20.694 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:20.694 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:20.694 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:20.694 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/mount/fuse.yaml").st_ino) 2024-03-12T17:24:20.694 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:20.893 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629494 2024-03-12T17:24:21.073 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:21.074 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:21.074 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:21.074 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:21.074 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/mount/native.yaml").st_ino) 2024-03-12T17:24:21.074 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:21.268 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628258 2024-03-12T17:24:21.450 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:21.450 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:21.450 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:21.450 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:21.451 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/samba/%").st_ino) 2024-03-12T17:24:21.451 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:21.647 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629486 2024-03-12T17:24:21.827 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:21.828 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:21.828 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:21.828 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:21.828 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible").st_ino) 2024-03-12T17:24:21.828 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:22.022 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628384 2024-03-12T17:24:22.204 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:22.204 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:22.204 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:22.204 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:22.204 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke").st_ino) 2024-03-12T17:24:22.204 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:22.396 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628385 2024-03-12T17:24:22.578 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:22.578 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:22.578 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:22.578 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:22.578 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/5-tests").st_ino) 2024-03-12T17:24:22.578 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:22.773 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628404 2024-03-12T17:24:22.954 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:22.954 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:22.954 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:22.954 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:22.954 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/5-tests/cls.yaml").st_ino) 2024-03-12T17:24:22.954 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:23.150 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627891 2024-03-12T17:24:23.331 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:23.331 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:23.331 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:23.331 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:23.331 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/5-tests/rbd_cli_tests.yaml.disabled").st_ino) 2024-03-12T17:24:23.331 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:23.524 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627892 2024-03-12T17:24:23.703 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:23.704 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:23.704 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:23.704 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:23.704 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/5-tests/rbd_import_export.yaml").st_ino) 2024-03-12T17:24:23.704 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:23.899 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627893 2024-03-12T17:24:24.079 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:24.080 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:24.080 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:24.080 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:24.080 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/5-tests/ceph-admin-commands.yaml").st_ino) 2024-03-12T17:24:24.080 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:24.272 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628405 2024-03-12T17:24:24.452 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:24.452 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:24.453 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:24.453 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:24.453 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/1-distros").st_ino) 2024-03-12T17:24:24.453 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:24.647 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628389 2024-03-12T17:24:24.827 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:24.828 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:24.828 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:24.828 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:24.828 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/0-clusters").st_ino) 2024-03-12T17:24:24.828 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:25.018 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628387 2024-03-12T17:24:25.201 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:25.201 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:25.201 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:25.201 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:25.201 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/0-clusters/single_mon_osd.yaml").st_ino) 2024-03-12T17:24:25.201 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:25.395 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627889 2024-03-12T17:24:25.577 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:25.577 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:25.577 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:25.577 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:25.577 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/0-clusters/3-node.yaml").st_ino) 2024-03-12T17:24:25.577 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:25.771 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628388 2024-03-12T17:24:25.953 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:25.953 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:25.953 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:25.953 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:25.953 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/3-common").st_ino) 2024-03-12T17:24:25.953 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:26.154 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628392 2024-03-12T17:24:26.334 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:26.334 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:26.334 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:26.334 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:26.334 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/3-common/os_tuning").st_ino) 2024-03-12T17:24:26.334 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:26.539 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628394 2024-03-12T17:24:26.720 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:26.720 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:26.720 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:26.720 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:26.720 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/3-common/os_tuning/vm_friendly.yaml").st_ino) 2024-03-12T17:24:26.720 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:26.910 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628395 2024-03-12T17:24:27.091 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:27.091 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:27.091 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:27.091 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:27.091 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/3-common/source").st_ino) 2024-03-12T17:24:27.091 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:27.293 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628396 2024-03-12T17:24:27.473 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:27.473 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:27.473 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:27.473 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:27.473 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/3-common/source/upstream_stable.yaml").st_ino) 2024-03-12T17:24:27.473 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:27.669 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628397 2024-03-12T17:24:27.850 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:27.850 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:27.850 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:27.850 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:27.850 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/3-common/%").st_ino) 2024-03-12T17:24:27.850 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:28.043 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628393 2024-03-12T17:24:28.225 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:28.225 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:28.225 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:28.225 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:28.225 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/%").st_ino) 2024-03-12T17:24:28.225 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:28.425 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628386 2024-03-12T17:24:28.606 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:28.606 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:28.606 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:28.606 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:28.606 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd").st_ino) 2024-03-12T17:24:28.607 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:28.802 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628398 2024-03-12T17:24:28.984 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:28.984 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:28.984 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:28.984 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:28.984 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd/journal").st_ino) 2024-03-12T17:24:28.984 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:29.175 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628402 2024-03-12T17:24:29.357 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:29.357 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:29.357 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:29.357 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:29.357 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd/journal/collocated.yaml").st_ino) 2024-03-12T17:24:29.357 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:29.551 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628403 2024-03-12T17:24:29.733 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:29.733 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:29.733 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:29.733 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:29.733 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd/%").st_ino) 2024-03-12T17:24:29.733 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:29.926 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628399 2024-03-12T17:24:30.107 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:30.108 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:30.108 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:30.108 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:30.108 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd/devices").st_ino) 2024-03-12T17:24:30.108 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:30.301 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628400 2024-03-12T17:24:30.482 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:30.482 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:30.482 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:30.482 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:30.482 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd/devices/osd_auto_discovery.yaml").st_ino) 2024-03-12T17:24:30.482 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:30.675 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627890 2024-03-12T17:24:30.855 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:30.855 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:30.855 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:30.855 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:30.855 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/4-osd/devices/from_teuthology.yaml").st_ino) 2024-03-12T17:24:30.855 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:31.048 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628401 2024-03-12T17:24:31.228 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:31.228 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:31.228 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:31.228 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:31.228 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/2-setup").st_ino) 2024-03-12T17:24:31.228 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:31.420 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628390 2024-03-12T17:24:31.601 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:31.601 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:31.601 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:31.601 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:31.602 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-ansible/smoke/2-setup/ceph_ansible.yaml").st_ino) 2024-03-12T17:24:31.602 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:31.794 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628391 2024-03-12T17:24:31.974 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:31.974 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:31.975 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:31.975 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:31.975 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big").st_ino) 2024-03-12T17:24:31.975 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:32.168 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628360 2024-03-12T17:24:32.349 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:32.349 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:32.349 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:32.349 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:32.349 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash").st_ino) 2024-03-12T17:24:32.349 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:32.544 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628361 2024-03-12T17:24:32.726 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:32.726 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:32.726 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:32.726 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:32.726 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/clusters").st_ino) 2024-03-12T17:24:32.726 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:32.918 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628365 2024-03-12T17:24:33.099 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:33.099 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:33.099 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:33.099 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:33.099 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/clusters/medium.yaml").st_ino) 2024-03-12T17:24:33.099 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:33.292 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627886 2024-03-12T17:24:33.473 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:33.473 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:33.473 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:33.473 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:33.473 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/clusters/big.yaml").st_ino) 2024-03-12T17:24:33.473 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:33.668 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628366 2024-03-12T17:24:33.849 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:33.849 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:33.849 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:33.849 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:33.849 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/clusters/small.yaml").st_ino) 2024-03-12T17:24:33.849 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:34.043 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627887 2024-03-12T17:24:34.225 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:34.225 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:34.225 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:34.225 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:34.225 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/fs").st_ino) 2024-03-12T17:24:34.225 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:34.420 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628367 2024-03-12T17:24:34.602 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:34.602 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:34.602 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:34.602 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:34.602 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/fs/btrfs.yaml").st_ino) 2024-03-12T17:24:34.602 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:34.795 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628368 2024-03-12T17:24:34.977 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:34.977 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:34.977 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:34.977 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:34.977 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/fs/xfs.yaml").st_ino) 2024-03-12T17:24:34.977 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:35.171 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627888 2024-03-12T17:24:35.352 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:35.352 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:35.352 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:35.352 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:35.352 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/workloads").st_ino) 2024-03-12T17:24:35.353 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:35.537 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628371 2024-03-12T17:24:35.718 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:35.718 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:35.719 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:35.719 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:35.719 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/workloads/snaps-few-objects.yaml").st_ino) 2024-03-12T17:24:35.719 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:35.911 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628372 2024-03-12T17:24:36.092 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:36.092 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:36.092 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:36.092 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:36.092 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/ceph").st_ino) 2024-03-12T17:24:36.092 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:36.285 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628363 2024-03-12T17:24:36.466 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:36.466 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:36.466 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:36.466 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:36.466 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/ceph/ceph.yaml").st_ino) 2024-03-12T17:24:36.466 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:36.663 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628364 2024-03-12T17:24:36.844 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:36.844 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:36.844 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:36.844 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:36.844 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/%").st_ino) 2024-03-12T17:24:36.844 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:37.036 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628362 2024-03-12T17:24:37.219 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:37.219 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:37.219 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:37.219 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:37.219 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/thrashers").st_ino) 2024-03-12T17:24:37.219 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:37.411 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628369 2024-03-12T17:24:37.593 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:37.593 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:37.593 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:37.593 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:37.593 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/big/rados-thrash/thrashers/default.yaml").st_ino) 2024-03-12T17:24:37.593 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:37.777 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628370 2024-03-12T17:24:37.957 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:37.957 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:37.957 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:37.957 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:37.957 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mixed-clients").st_ino) 2024-03-12T17:24:37.957 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:38.150 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628807 2024-03-12T17:24:38.331 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:38.332 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:38.332 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:38.332 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:38.332 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mixed-clients/basic").st_ino) 2024-03-12T17:24:38.332 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:38.528 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628808 2024-03-12T17:24:38.710 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:38.710 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:38.710 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:38.710 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:38.710 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mixed-clients/basic/clusters").st_ino) 2024-03-12T17:24:38.710 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:38.905 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628809 2024-03-12T17:24:39.086 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:39.086 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:39.086 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:39.086 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:39.086 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mixed-clients/basic/clusters/fixed-3.yaml").st_ino) 2024-03-12T17:24:39.087 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:39.283 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628810 2024-03-12T17:24:39.464 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:39.464 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:39.464 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:39.465 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:39.465 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mixed-clients/basic/fs").st_ino) 2024-03-12T17:24:39.465 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:39.662 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628811 2024-03-12T17:24:39.843 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:39.843 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:39.843 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:39.843 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:39.843 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mixed-clients/basic/fs/btrfs.yaml").st_ino) 2024-03-12T17:24:39.844 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:40.034 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628812 2024-03-12T17:24:40.214 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:40.214 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:40.214 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:40.214 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:40.214 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mixed-clients/basic/tasks").st_ino) 2024-03-12T17:24:40.214 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:40.407 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628813 2024-03-12T17:24:40.589 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:40.589 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:40.589 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:40.590 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:40.590 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mixed-clients/basic/tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml").st_ino) 2024-03-12T17:24:40.590 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:40.782 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628022 2024-03-12T17:24:40.964 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:40.964 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:40.964 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:40.964 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:40.964 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/mixed-clients/basic/tasks/kernel_cfuse_workunits_dbench_iozone.yaml").st_ino) 2024-03-12T17:24:40.964 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:41.144 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628814 2024-03-12T17:24:41.324 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:41.324 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:41.324 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:41.324 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:41.324 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs").st_ino) 2024-03-12T17:24:41.324 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:41.519 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628433 2024-03-12T17:24:41.700 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:41.700 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:41.700 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:41.700 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:41.700 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless").st_ino) 2024-03-12T17:24:41.700 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:41.893 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628603 2024-03-12T17:24:41.967 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:24:41.975 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:24:42.073 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:42.073 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:42.073 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:42.073 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:42.073 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/traceless").st_ino) 2024-03-12T17:24:42.073 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:42.221 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628623 2024-03-12T17:24:42.401 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:42.401 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:42.401 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:42.401 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:42.402 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/traceless/50pc.yaml").st_ino) 2024-03-12T17:24:42.402 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:42.554 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628624 2024-03-12T17:24:42.736 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:42.736 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:42.736 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:42.736 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:42.736 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/overrides").st_ino) 2024-03-12T17:24:42.736 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:42.927 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628613 2024-03-12T17:24:43.110 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:43.111 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:43.111 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:43.111 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:43.111 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/overrides/whitelist_wrongly_marked_down.yaml").st_ino) 2024-03-12T17:24:43.111 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:43.302 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628617 2024-03-12T17:24:43.483 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:43.483 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:43.483 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:43.483 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:43.484 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/overrides/debug.yaml").st_ino) 2024-03-12T17:24:43.484 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:43.680 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628615 2024-03-12T17:24:43.862 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:43.862 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:43.862 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:43.862 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:43.862 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/overrides/+").st_ino) 2024-03-12T17:24:43.862 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:44.054 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628614 2024-03-12T17:24:44.235 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:44.235 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:44.235 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:44.235 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:44.235 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/overrides/frag_enable.yaml").st_ino) 2024-03-12T17:24:44.235 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:44.430 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628616 2024-03-12T17:24:44.611 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:44.611 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:44.611 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:44.611 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:44.611 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/clusters").st_ino) 2024-03-12T17:24:44.611 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:44.804 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628606 2024-03-12T17:24:44.984 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:44.984 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:44.984 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:44.984 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:44.984 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/clusters/fixed-2-ucephfs.yaml").st_ino) 2024-03-12T17:24:44.984 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:45.178 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628607 2024-03-12T17:24:45.360 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:45.360 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:45.360 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:45.360 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:45.360 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/objectstore").st_ino) 2024-03-12T17:24:45.360 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:45.553 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628612 2024-03-12T17:24:45.735 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:45.735 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:45.735 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:45.735 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:45.735 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/fs").st_ino) 2024-03-12T17:24:45.735 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:45.927 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628608 2024-03-12T17:24:46.109 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:46.109 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:46.109 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:46.109 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:46.109 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/fs/xfs.yaml").st_ino) 2024-03-12T17:24:46.109 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:46.304 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628609 2024-03-12T17:24:46.484 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:46.485 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:46.485 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:46.485 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:46.485 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/mount").st_ino) 2024-03-12T17:24:46.485 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:46.680 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628610 2024-03-12T17:24:46.863 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:46.863 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:46.863 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:46.864 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:46.864 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/mount/fuse.yaml").st_ino) 2024-03-12T17:24:46.864 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:47.060 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628611 2024-03-12T17:24:47.242 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:47.242 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:47.242 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:47.242 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:47.242 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/begin.yaml").st_ino) 2024-03-12T17:24:47.242 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:47.439 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628605 2024-03-12T17:24:47.621 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:47.621 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:47.621 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:47.621 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:47.621 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/%").st_ino) 2024-03-12T17:24:47.621 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:47.807 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628604 2024-03-12T17:24:47.988 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:47.988 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:47.988 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:47.988 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:47.988 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/tasks").st_ino) 2024-03-12T17:24:47.988 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:48.181 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628618 2024-03-12T17:24:48.362 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:48.362 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:48.362 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:48.362 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:48.362 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/tasks/cfuse_workunit_suites_ffsb.yaml").st_ino) 2024-03-12T17:24:48.362 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:48.554 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628621 2024-03-12T17:24:48.735 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:48.735 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:48.735 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:48.735 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:48.735 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/tasks/cfuse_workunit_suites_blogbench.yaml").st_ino) 2024-03-12T17:24:48.735 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:48.928 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628619 2024-03-12T17:24:49.108 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:49.109 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:49.109 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:49.109 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:49.109 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/tasks/cfuse_workunit_suites_fsstress.yaml").st_ino) 2024-03-12T17:24:49.109 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:49.303 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628622 2024-03-12T17:24:49.485 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:49.485 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:49.485 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:49.485 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:49.485 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/traceless/tasks/cfuse_workunit_suites_dbench.yaml").st_ino) 2024-03-12T17:24:49.485 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:49.679 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628620 2024-03-12T17:24:49.860 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:49.860 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:49.860 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:49.860 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:49.860 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs").st_ino) 2024-03-12T17:24:49.861 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:50.056 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628495 2024-03-12T17:24:50.237 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:50.237 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:50.237 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:50.237 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:50.237 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/overrides").st_ino) 2024-03-12T17:24:50.237 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:50.430 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628505 2024-03-12T17:24:50.611 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:50.611 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:50.611 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:50.611 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:50.611 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/overrides/whitelist_wrongly_marked_down.yaml").st_ino) 2024-03-12T17:24:50.611 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:50.805 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628509 2024-03-12T17:24:50.986 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:50.986 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:50.986 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:50.986 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:50.986 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/overrides/mon-debug.yaml").st_ino) 2024-03-12T17:24:50.986 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:51.180 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627916 2024-03-12T17:24:51.361 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:51.361 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:51.361 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:51.361 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:51.361 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/overrides/debug.yaml").st_ino) 2024-03-12T17:24:51.361 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:51.555 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628507 2024-03-12T17:24:51.736 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:51.736 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:51.737 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:51.737 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:51.737 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/overrides/+").st_ino) 2024-03-12T17:24:51.737 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:51.931 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628506 2024-03-12T17:24:52.111 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:52.111 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:52.111 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:52.111 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:52.112 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/overrides/frag_enable.yaml").st_ino) 2024-03-12T17:24:52.112 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:52.314 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628508 2024-03-12T17:24:52.495 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:52.495 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:52.495 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:52.496 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:52.496 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/clusters").st_ino) 2024-03-12T17:24:52.496 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:52.687 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628498 2024-03-12T17:24:52.868 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:52.868 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:52.868 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:52.868 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:52.868 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/clusters/2-remote-clients.yaml").st_ino) 2024-03-12T17:24:52.868 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:53.060 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628499 2024-03-12T17:24:53.240 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:53.240 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:53.240 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:53.240 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:53.240 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/objectstore").st_ino) 2024-03-12T17:24:53.241 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:53.433 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628504 2024-03-12T17:24:53.614 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:53.614 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:53.614 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:53.614 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:53.614 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/fs").st_ino) 2024-03-12T17:24:53.614 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:53.810 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628500 2024-03-12T17:24:53.992 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:53.992 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:53.992 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:53.992 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:53.992 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/fs/xfs.yaml").st_ino) 2024-03-12T17:24:53.992 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:54.183 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628501 2024-03-12T17:24:54.363 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:54.363 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:54.363 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:54.363 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:54.364 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/mount").st_ino) 2024-03-12T17:24:54.364 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:54.556 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628502 2024-03-12T17:24:54.738 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:54.738 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:54.738 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:54.738 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:54.738 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/mount/fuse.yaml").st_ino) 2024-03-12T17:24:54.738 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:54.934 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628503 2024-03-12T17:24:55.115 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:55.115 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:55.115 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:55.115 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:55.115 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/begin.yaml").st_ino) 2024-03-12T17:24:55.115 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:55.315 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628497 2024-03-12T17:24:55.495 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:55.495 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:55.495 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:55.495 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:55.495 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/%").st_ino) 2024-03-12T17:24:55.495 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:55.688 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628496 2024-03-12T17:24:55.868 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:55.868 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:55.868 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:55.868 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:55.868 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/tasks").st_ino) 2024-03-12T17:24:55.868 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:56.063 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628510 2024-03-12T17:24:56.244 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:56.244 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:56.244 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:56.244 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:56.244 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multifs/tasks/failover.yaml").st_ino) 2024-03-12T17:24:56.244 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:56.438 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628511 2024-03-12T17:24:56.620 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:56.620 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:56.620 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:56.620 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:56.620 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps").st_ino) 2024-03-12T17:24:56.620 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:56.815 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628546 2024-03-12T17:24:56.995 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:56.995 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:56.995 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:56.996 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:56.996 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/overrides").st_ino) 2024-03-12T17:24:56.996 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:57.185 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628556 2024-03-12T17:24:57.365 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:57.365 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:57.366 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:57.366 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:57.366 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/overrides/whitelist_wrongly_marked_down.yaml").st_ino) 2024-03-12T17:24:57.366 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:57.561 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628560 2024-03-12T17:24:57.742 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:57.743 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:57.743 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:57.743 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:57.743 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/overrides/debug.yaml").st_ino) 2024-03-12T17:24:57.743 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:57.935 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628558 2024-03-12T17:24:58.115 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:58.115 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:58.116 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:58.116 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:58.116 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/overrides/+").st_ino) 2024-03-12T17:24:58.116 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:58.308 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628557 2024-03-12T17:24:58.487 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:58.488 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:58.488 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:58.488 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:58.488 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/overrides/frag_enable.yaml").st_ino) 2024-03-12T17:24:58.488 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:58.681 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628559 2024-03-12T17:24:58.863 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:58.863 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:58.863 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:58.863 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:58.863 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/clusters").st_ino) 2024-03-12T17:24:58.863 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:59.054 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628549 2024-03-12T17:24:59.234 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:59.234 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:59.235 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:59.235 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:59.235 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/clusters/fixed-2-ucephfs.yaml").st_ino) 2024-03-12T17:24:59.235 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:59.426 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628550 2024-03-12T17:24:59.609 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:59.609 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:59.609 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:59.609 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:59.609 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/objectstore").st_ino) 2024-03-12T17:24:59.609 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:24:59.801 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628555 2024-03-12T17:24:59.982 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:24:59.982 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:24:59.982 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:24:59.982 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:24:59.982 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/fs").st_ino) 2024-03-12T17:24:59.983 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:00.179 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628551 2024-03-12T17:25:00.361 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:00.361 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:00.361 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:00.361 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:00.361 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/fs/xfs.yaml").st_ino) 2024-03-12T17:25:00.361 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:00.558 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628552 2024-03-12T17:25:00.740 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:00.740 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:00.740 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:00.740 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:00.740 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/mount").st_ino) 2024-03-12T17:25:00.740 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:00.933 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628553 2024-03-12T17:25:01.113 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:01.114 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:01.114 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:01.114 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:01.114 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/mount/fuse.yaml").st_ino) 2024-03-12T17:25:01.114 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:01.315 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628554 2024-03-12T17:25:01.496 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:01.496 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:01.496 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:01.496 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:01.497 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/begin.yaml").st_ino) 2024-03-12T17:25:01.497 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:01.691 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628548 2024-03-12T17:25:01.872 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:01.872 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:01.872 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:01.873 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:01.873 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/%").st_ino) 2024-03-12T17:25:01.873 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:02.068 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628547 2024-03-12T17:25:02.249 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:02.249 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:02.249 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:02.249 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:02.249 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/tasks").st_ino) 2024-03-12T17:25:02.249 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:02.443 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628561 2024-03-12T17:25:02.623 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:02.624 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:02.624 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:02.624 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:02.624 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/snaps/tasks/snaptests.yaml").st_ino) 2024-03-12T17:25:02.624 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:02.817 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628562 2024-03-12T17:25:02.998 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:02.998 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:02.998 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:02.998 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:02.998 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic").st_ino) 2024-03-12T17:25:02.998 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:03.192 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628452 2024-03-12T17:25:03.373 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:03.373 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:03.373 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:03.373 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:03.373 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/overrides").st_ino) 2024-03-12T17:25:03.373 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:03.568 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628464 2024-03-12T17:25:03.749 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:03.749 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:03.749 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:03.750 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:03.750 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/overrides/whitelist_wrongly_marked_down.yaml").st_ino) 2024-03-12T17:25:03.750 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:03.928 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628468 2024-03-12T17:25:04.110 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:04.110 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:04.110 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:04.111 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:04.111 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/overrides/debug.yaml").st_ino) 2024-03-12T17:25:04.111 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:04.306 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628466 2024-03-12T17:25:04.488 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:04.488 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:04.488 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:04.488 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:04.488 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/overrides/+").st_ino) 2024-03-12T17:25:04.488 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:04.685 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628465 2024-03-12T17:25:04.866 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:04.866 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:04.866 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:04.866 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:04.866 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/overrides/frag_enable.yaml").st_ino) 2024-03-12T17:25:04.866 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:05.060 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628467 2024-03-12T17:25:05.240 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:05.241 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:05.241 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:05.241 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:05.241 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/clusters").st_ino) 2024-03-12T17:25:05.241 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:05.434 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628455 2024-03-12T17:25:05.615 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:05.615 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:05.615 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:05.615 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:05.615 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/clusters/fixed-2-ucephfs.yaml").st_ino) 2024-03-12T17:25:05.615 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:05.812 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628456 2024-03-12T17:25:05.994 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:05.994 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:05.994 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:05.994 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:05.994 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/objectstore").st_ino) 2024-03-12T17:25:05.994 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:06.189 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628463 2024-03-12T17:25:06.369 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:06.370 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:06.370 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:06.370 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:06.370 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/fs").st_ino) 2024-03-12T17:25:06.370 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:06.564 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628457 2024-03-12T17:25:06.746 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:06.746 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:06.746 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:06.746 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:06.746 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/fs/xfs.yaml").st_ino) 2024-03-12T17:25:06.746 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:06.942 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628458 2024-03-12T17:25:07.123 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:07.124 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:07.124 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:07.124 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:07.124 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/mount").st_ino) 2024-03-12T17:25:07.124 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:07.318 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628461 2024-03-12T17:25:07.499 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:07.499 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:07.499 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:07.499 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:07.500 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/mount/fuse.yaml").st_ino) 2024-03-12T17:25:07.500 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:07.692 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628462 2024-03-12T17:25:07.874 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:07.874 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:07.875 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:07.875 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:07.875 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/inline").st_ino) 2024-03-12T17:25:07.875 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:08.074 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628459 2024-03-12T17:25:08.255 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:08.255 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:08.255 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:08.255 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:08.255 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/inline/yes.yaml").st_ino) 2024-03-12T17:25:08.255 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:08.452 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627896 2024-03-12T17:25:08.633 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:08.633 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:08.633 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:08.633 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:08.633 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/inline/no.yaml").st_ino) 2024-03-12T17:25:08.633 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:08.818 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628460 2024-03-12T17:25:08.999 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:08.999 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:08.999 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:08.999 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:08.999 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/begin.yaml").st_ino) 2024-03-12T17:25:08.999 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:09.189 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628454 2024-03-12T17:25:09.370 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:09.370 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:09.370 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:09.370 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:09.371 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/%").st_ino) 2024-03-12T17:25:09.371 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:09.567 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628453 2024-03-12T17:25:09.748 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:09.748 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:09.748 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:09.748 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:09.748 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks").st_ino) 2024-03-12T17:25:09.748 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:09.940 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628469 2024-03-12T17:25:10.121 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:10.121 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:10.121 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:10.121 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:10.122 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_fsync.yaml").st_ino) 2024-03-12T17:25:10.122 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:10.316 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627904 2024-03-12T17:25:10.497 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:10.497 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:10.498 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:10.498 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:10.498 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/libcephfs_interface_tests.yaml").st_ino) 2024-03-12T17:25:10.498 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:10.690 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628476 2024-03-12T17:25:10.871 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:10.871 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:10.871 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:10.871 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:10.871 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_pjd.yaml").st_ino) 2024-03-12T17:25:10.871 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:11.064 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627907 2024-03-12T17:25:11.244 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:11.244 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:11.244 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:11.244 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:11.244 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_norstats.yaml").st_ino) 2024-03-12T17:25:11.244 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:11.438 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627901 2024-03-12T17:25:11.618 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:11.618 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:11.619 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:11.619 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:11.619 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_trivial_sync.yaml").st_ino) 2024-03-12T17:25:11.619 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:11.813 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628475 2024-03-12T17:25:11.994 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:11.995 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:11.995 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:11.995 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:11.995 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_ffsb.yaml").st_ino) 2024-03-12T17:25:11.995 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:12.115 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:25:12.124 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:25:12.186 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628473 2024-03-12T17:25:12.368 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:12.368 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:12.368 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:12.368 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:12.368 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_fsx.yaml").st_ino) 2024-03-12T17:25:12.368 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:12.524 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627903 2024-03-12T17:25:12.704 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:12.704 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:12.704 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:12.704 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:12.704 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/libcephfs_java.yaml").st_ino) 2024-03-12T17:25:12.704 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:12.896 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627909 2024-03-12T17:25:13.077 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:13.077 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:13.077 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:13.077 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:13.077 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_misc.yaml").st_ino) 2024-03-12T17:25:13.077 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:13.274 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627899 2024-03-12T17:25:13.454 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:13.454 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:13.454 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:13.454 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:13.454 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_misc_test_o_trunc.yaml").st_ino) 2024-03-12T17:25:13.454 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:13.649 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627900 2024-03-12T17:25:13.830 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:13.830 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:13.830 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:13.830 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:13.830 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/mds_creation_retry.yaml").st_ino) 2024-03-12T17:25:13.830 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:14.025 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627911 2024-03-12T17:25:14.207 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:14.207 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:14.207 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:14.207 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:14.207 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/asok_dump_tree.yaml").st_ino) 2024-03-12T17:25:14.207 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:14.402 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628470 2024-03-12T17:25:14.583 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:14.583 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:14.583 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:14.583 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:14.583 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_quota.yaml").st_ino) 2024-03-12T17:25:14.583 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:14.780 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627902 2024-03-12T17:25:14.962 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:14.962 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:14.962 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:14.962 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:14.962 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_truncate_delay.yaml").st_ino) 2024-03-12T17:25:14.962 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:15.156 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627908 2024-03-12T17:25:15.337 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:15.337 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:15.337 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:15.337 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:15.338 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_kernel_untar_build.yaml").st_ino) 2024-03-12T17:25:15.338 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:15.523 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627898 2024-03-12T17:25:15.703 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:15.703 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:15.703 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:15.703 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:15.703 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_blogbench.yaml").st_ino) 2024-03-12T17:25:15.703 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:15.896 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628471 2024-03-12T17:25:16.077 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:16.077 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:16.077 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:16.077 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:16.077 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/libcephfs_python.yaml").st_ino) 2024-03-12T17:25:16.077 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:16.270 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627910 2024-03-12T17:25:16.451 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:16.451 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:16.451 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:16.452 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:16.452 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_fsstress.yaml").st_ino) 2024-03-12T17:25:16.452 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:16.646 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628474 2024-03-12T17:25:16.826 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:16.826 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:16.826 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:16.826 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:16.826 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cephfs_scrub_tests.yaml").st_ino) 2024-03-12T17:25:16.826 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:17.019 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627897 2024-03-12T17:25:17.200 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:17.200 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:17.200 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:17.200 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:17.200 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_iogen.yaml").st_ino) 2024-03-12T17:25:17.200 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:17.382 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627905 2024-03-12T17:25:17.563 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:17.563 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:17.563 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:17.563 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:17.563 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_dbench.yaml").st_ino) 2024-03-12T17:25:17.563 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:17.746 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628472 2024-03-12T17:25:17.927 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:17.927 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:17.927 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:17.927 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:17.927 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/basic/tasks/cfuse_workunit_suites_iozone.yaml").st_ino) 2024-03-12T17:25:17.927 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:18.120 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627906 2024-03-12T17:25:18.301 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:18.301 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:18.301 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:18.301 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:18.301 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery").st_ino) 2024-03-12T17:25:18.301 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:18.482 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628529 2024-03-12T17:25:18.664 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:18.664 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:18.664 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:18.664 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:18.664 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/overrides").st_ino) 2024-03-12T17:25:18.664 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:18.855 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628539 2024-03-12T17:25:19.037 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:19.037 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:19.037 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:19.037 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:19.037 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/overrides/whitelist_wrongly_marked_down.yaml").st_ino) 2024-03-12T17:25:19.038 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:19.228 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628543 2024-03-12T17:25:19.411 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:19.411 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:19.411 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:19.411 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:19.411 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/overrides/fuse-unmounted.yaml").st_ino) 2024-03-12T17:25:19.411 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:19.597 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627918 2024-03-12T17:25:19.778 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:19.779 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:19.779 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:19.779 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:19.779 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/overrides/debug.yaml").st_ino) 2024-03-12T17:25:19.779 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:19.962 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628541 2024-03-12T17:25:20.142 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:20.142 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:20.142 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:20.142 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:20.143 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/overrides/+").st_ino) 2024-03-12T17:25:20.143 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:20.333 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628540 2024-03-12T17:25:20.515 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:20.515 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:20.515 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:20.515 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:20.515 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/overrides/frag_enable.yaml").st_ino) 2024-03-12T17:25:20.515 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:20.711 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628542 2024-03-12T17:25:20.892 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:20.892 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:20.892 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:20.892 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:20.892 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/clusters").st_ino) 2024-03-12T17:25:20.892 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:21.088 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628532 2024-03-12T17:25:21.269 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:21.269 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:21.269 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:21.269 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:21.269 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/clusters/4-remote-clients.yaml").st_ino) 2024-03-12T17:25:21.269 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:21.465 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628533 2024-03-12T17:25:21.647 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:21.647 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:21.647 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:21.647 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:21.647 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/objectstore").st_ino) 2024-03-12T17:25:21.647 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:21.830 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628538 2024-03-12T17:25:22.011 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:22.011 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:22.011 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:22.011 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:22.011 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/fs").st_ino) 2024-03-12T17:25:22.011 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:22.205 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628534 2024-03-12T17:25:22.386 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:22.387 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:22.387 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:22.387 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:22.387 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/fs/xfs.yaml").st_ino) 2024-03-12T17:25:22.387 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:22.580 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628535 2024-03-12T17:25:22.761 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:22.761 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:22.761 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:22.761 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:22.761 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/mount").st_ino) 2024-03-12T17:25:22.761 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:22.953 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628536 2024-03-12T17:25:23.133 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:23.133 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:23.133 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:23.133 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:23.133 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/mount/fuse.yaml").st_ino) 2024-03-12T17:25:23.133 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:23.332 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628537 2024-03-12T17:25:23.512 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:23.512 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:23.512 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:23.513 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:23.513 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/begin.yaml").st_ino) 2024-03-12T17:25:23.513 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:23.694 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628531 2024-03-12T17:25:23.875 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:23.875 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:23.875 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:23.875 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:23.875 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/%").st_ino) 2024-03-12T17:25:23.875 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:24.065 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628530 2024-03-12T17:25:24.246 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:24.246 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:24.246 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:24.246 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:24.246 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks").st_ino) 2024-03-12T17:25:24.246 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:24.438 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628544 2024-03-12T17:25:24.618 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:24.618 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:24.618 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:24.618 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:24.619 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/backtrace.yaml").st_ino) 2024-03-12T17:25:24.619 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:24.812 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627919 2024-03-12T17:25:24.994 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:24.994 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:24.994 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:24.994 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:24.994 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/forward-scrub.yaml").st_ino) 2024-03-12T17:25:24.994 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:25.185 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627927 2024-03-12T17:25:25.367 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:25.367 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:25.367 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:25.367 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:25.367 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/client-readahad.yaml").st_ino) 2024-03-12T17:25:25.367 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:25.564 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627922 2024-03-12T17:25:25.745 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:25.745 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:25.745 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:25.745 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:25.745 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/volume-client.yaml").st_ino) 2024-03-12T17:25:25.746 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:25.939 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627935 2024-03-12T17:25:26.120 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:26.120 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:26.120 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:26.121 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:26.121 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/config-commands.yaml").st_ino) 2024-03-12T17:25:26.121 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:26.313 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627924 2024-03-12T17:25:26.494 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:26.494 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:26.494 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:26.494 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:26.494 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/mds-full.yaml").st_ino) 2024-03-12T17:25:26.494 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:26.687 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627931 2024-03-12T17:25:26.868 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:26.868 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:26.868 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:26.869 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:26.869 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/sessionmap.yaml").st_ino) 2024-03-12T17:25:26.869 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:27.063 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627933 2024-03-12T17:25:27.243 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:27.244 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:27.244 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:27.244 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:27.244 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/data-scan.yaml").st_ino) 2024-03-12T17:25:27.244 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:27.436 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627926 2024-03-12T17:25:27.617 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:27.617 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:27.617 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:27.617 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:27.618 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/cap-flush.yaml").st_ino) 2024-03-12T17:25:27.618 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:27.812 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627920 2024-03-12T17:25:27.992 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:27.993 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:27.993 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:27.993 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:27.993 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/mds-flush.yaml").st_ino) 2024-03-12T17:25:27.993 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:28.187 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627930 2024-03-12T17:25:28.368 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:28.368 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:28.368 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:28.368 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:28.369 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/auto-repair.yaml").st_ino) 2024-03-12T17:25:28.369 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:28.565 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628545 2024-03-12T17:25:28.746 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:28.746 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:28.746 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:28.746 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:28.746 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/damage.yaml").st_ino) 2024-03-12T17:25:28.746 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:28.952 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627925 2024-03-12T17:25:29.132 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:29.132 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:29.132 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:29.132 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:29.132 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/client-recovery.yaml").st_ino) 2024-03-12T17:25:29.132 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:29.313 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627923 2024-03-12T17:25:29.493 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:29.494 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:29.494 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:29.494 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:29.494 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/journal-repair.yaml").st_ino) 2024-03-12T17:25:29.494 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:29.688 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627929 2024-03-12T17:25:29.868 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:29.869 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:29.869 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:29.869 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:29.869 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/client-limits.yaml").st_ino) 2024-03-12T17:25:29.869 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:30.063 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627921 2024-03-12T17:25:30.245 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:30.245 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:30.245 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:30.245 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:30.245 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/strays.yaml").st_ino) 2024-03-12T17:25:30.245 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:30.438 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627934 2024-03-12T17:25:30.619 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:30.619 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:30.619 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:30.619 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:30.619 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/fragment.yaml").st_ino) 2024-03-12T17:25:30.620 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:30.813 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627928 2024-03-12T17:25:30.994 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:30.994 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:30.994 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:30.994 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:30.994 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/recovery/tasks/pool-perm.yaml").st_ino) 2024-03-12T17:25:30.994 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:31.184 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627932 2024-03-12T17:25:31.365 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:31.365 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:31.365 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:31.365 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:31.365 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission").st_ino) 2024-03-12T17:25:31.365 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:31.560 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628512 2024-03-12T17:25:31.742 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:31.742 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:31.742 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:31.743 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:31.743 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/overrides").st_ino) 2024-03-12T17:25:31.743 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:31.935 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628522 2024-03-12T17:25:32.117 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:32.117 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:32.117 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:32.117 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:32.117 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/overrides/whitelist_wrongly_marked_down.yaml").st_ino) 2024-03-12T17:25:32.117 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:32.309 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628526 2024-03-12T17:25:32.491 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:32.491 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:32.491 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:32.491 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:32.491 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/overrides/debug.yaml").st_ino) 2024-03-12T17:25:32.491 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:32.687 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628524 2024-03-12T17:25:32.868 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:32.868 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:32.868 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:32.868 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:32.868 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/overrides/+").st_ino) 2024-03-12T17:25:32.868 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:33.061 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628523 2024-03-12T17:25:33.242 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:33.242 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:33.242 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:33.242 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:33.242 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/overrides/frag_enable.yaml").st_ino) 2024-03-12T17:25:33.242 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:33.436 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628525 2024-03-12T17:25:33.618 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:33.618 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:33.618 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:33.618 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:33.618 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/clusters").st_ino) 2024-03-12T17:25:33.618 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:33.815 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628515 2024-03-12T17:25:33.996 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:33.996 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:33.996 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:33.996 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:33.996 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/clusters/fixed-2-ucephfs.yaml").st_ino) 2024-03-12T17:25:33.996 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:34.188 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628516 2024-03-12T17:25:34.369 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:34.369 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:34.369 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:34.369 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:34.369 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/objectstore").st_ino) 2024-03-12T17:25:34.370 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:34.562 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628521 2024-03-12T17:25:34.743 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:34.743 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:34.744 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:34.744 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:34.744 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/fs").st_ino) 2024-03-12T17:25:34.744 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:34.937 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628517 2024-03-12T17:25:35.117 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:35.117 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:35.117 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:35.117 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:35.117 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/fs/xfs.yaml").st_ino) 2024-03-12T17:25:35.117 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:35.309 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628518 2024-03-12T17:25:35.490 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:35.490 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:35.490 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:35.490 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:35.490 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/mount").st_ino) 2024-03-12T17:25:35.491 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:35.682 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628519 2024-03-12T17:25:35.863 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:35.863 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:35.863 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:35.863 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:35.864 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/mount/fuse.yaml").st_ino) 2024-03-12T17:25:35.864 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:36.056 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628520 2024-03-12T17:25:36.238 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:36.238 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:36.238 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:36.238 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:36.238 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/begin.yaml").st_ino) 2024-03-12T17:25:36.238 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:36.437 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628514 2024-03-12T17:25:36.617 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:36.617 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:36.618 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:36.618 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:36.618 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/%").st_ino) 2024-03-12T17:25:36.618 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:36.811 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628513 2024-03-12T17:25:36.992 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:36.992 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:36.992 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:36.992 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:36.992 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/tasks").st_ino) 2024-03-12T17:25:36.992 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:37.185 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628527 2024-03-12T17:25:37.367 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:37.367 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:37.367 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:37.367 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:37.367 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/tasks/cfuse_workunit_suites_pjd.yaml").st_ino) 2024-03-12T17:25:37.367 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:37.562 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627917 2024-03-12T17:25:37.744 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:37.744 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:37.744 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:37.744 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:37.744 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/permission/tasks/cfuse_workunit_misc.yaml").st_ino) 2024-03-12T17:25:37.744 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:37.936 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628528 2024-03-12T17:25:38.118 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:38.118 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:38.118 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:38.118 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:38.118 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay").st_ino) 2024-03-12T17:25:38.118 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:38.313 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628563 2024-03-12T17:25:38.499 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:38.499 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:38.499 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:38.499 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:38.499 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/overrides").st_ino) 2024-03-12T17:25:38.499 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:38.698 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628573 2024-03-12T17:25:38.879 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:38.879 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:38.879 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:38.879 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:38.879 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/overrides/whitelist_wrongly_marked_down.yaml").st_ino) 2024-03-12T17:25:38.879 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:39.075 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628577 2024-03-12T17:25:39.256 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:39.256 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:39.257 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:39.257 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:39.257 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/overrides/debug.yaml").st_ino) 2024-03-12T17:25:39.257 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:39.451 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628575 2024-03-12T17:25:39.632 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:39.632 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:39.632 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:39.632 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:39.632 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/overrides/+").st_ino) 2024-03-12T17:25:39.632 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:39.825 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628574 2024-03-12T17:25:40.005 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:40.005 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:40.006 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:40.006 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:40.006 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/overrides/frag_enable.yaml").st_ino) 2024-03-12T17:25:40.006 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:40.198 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628576 2024-03-12T17:25:40.380 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:40.380 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:40.380 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:40.380 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:40.380 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/clusters").st_ino) 2024-03-12T17:25:40.380 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:40.563 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628566 2024-03-12T17:25:40.744 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:40.744 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:40.744 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:40.744 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:40.744 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/clusters/standby-replay.yaml").st_ino) 2024-03-12T17:25:40.744 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:40.934 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628567 2024-03-12T17:25:41.116 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:41.116 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:41.116 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:41.116 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:41.116 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/objectstore").st_ino) 2024-03-12T17:25:41.116 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:41.312 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628572 2024-03-12T17:25:41.494 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:41.494 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:41.494 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:41.494 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:41.494 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/fs").st_ino) 2024-03-12T17:25:41.494 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:41.687 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628568 2024-03-12T17:25:41.868 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:41.868 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:41.868 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:41.868 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:41.868 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/fs/xfs.yaml").st_ino) 2024-03-12T17:25:41.868 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:42.058 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628569 2024-03-12T17:25:42.239 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:42.239 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:42.239 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:42.240 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:42.240 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/mount").st_ino) 2024-03-12T17:25:42.240 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:42.254 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:25:42.293 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:25:42.409 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628570 2024-03-12T17:25:42.590 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:42.590 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:42.590 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:42.590 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:42.590 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/mount/fuse.yaml").st_ino) 2024-03-12T17:25:42.590 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:42.744 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628571 2024-03-12T17:25:42.925 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:42.925 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:42.925 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:42.925 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:42.925 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/begin.yaml").st_ino) 2024-03-12T17:25:42.925 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:43.107 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628565 2024-03-12T17:25:43.287 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:43.288 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:43.288 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:43.288 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:43.288 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/%").st_ino) 2024-03-12T17:25:43.288 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:43.481 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628564 2024-03-12T17:25:43.662 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:43.662 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:43.662 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:43.662 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:43.662 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/tasks").st_ino) 2024-03-12T17:25:43.662 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:43.856 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628578 2024-03-12T17:25:44.036 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:44.036 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:44.036 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:44.036 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:44.037 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/standbyreplay/tasks/migration.yaml").st_ino) 2024-03-12T17:25:44.037 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:44.229 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628579 2024-03-12T17:25:44.411 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:44.411 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:44.411 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:44.411 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:44.411 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits").st_ino) 2024-03-12T17:25:44.411 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:44.605 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628434 2024-03-12T17:25:44.787 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:44.787 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:44.787 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:44.787 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:44.787 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/overrides").st_ino) 2024-03-12T17:25:44.787 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:44.980 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628444 2024-03-12T17:25:45.161 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:45.161 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:45.161 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:45.161 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:45.161 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/overrides/whitelist_wrongly_marked_down.yaml").st_ino) 2024-03-12T17:25:45.161 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:45.355 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628448 2024-03-12T17:25:45.537 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:45.537 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:45.537 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:45.537 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:45.537 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/overrides/debug.yaml").st_ino) 2024-03-12T17:25:45.538 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:45.731 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628446 2024-03-12T17:25:45.913 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:45.913 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:45.913 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:45.913 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:45.913 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/overrides/+").st_ino) 2024-03-12T17:25:45.913 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:46.110 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628445 2024-03-12T17:25:46.291 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:46.291 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:46.291 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:46.291 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:46.291 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/overrides/faked-ino.yaml").st_ino) 2024-03-12T17:25:46.291 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:46.486 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627895 2024-03-12T17:25:46.667 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:46.668 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:46.668 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:46.668 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:46.668 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/overrides/frag_enable.yaml").st_ino) 2024-03-12T17:25:46.668 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:46.860 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628447 2024-03-12T17:25:47.040 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:47.040 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:47.040 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:47.040 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:47.040 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/clusters").st_ino) 2024-03-12T17:25:47.040 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:47.237 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628437 2024-03-12T17:25:47.417 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:47.418 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:47.418 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:47.418 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:47.418 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/clusters/fixed-2-ucephfs.yaml").st_ino) 2024-03-12T17:25:47.418 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:47.618 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628438 2024-03-12T17:25:47.795 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:47.795 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:47.795 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:47.795 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:47.796 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/objectstore").st_ino) 2024-03-12T17:25:47.796 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:47.990 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628443 2024-03-12T17:25:48.171 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:48.171 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:48.171 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:48.172 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:48.172 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/fs").st_ino) 2024-03-12T17:25:48.172 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:48.366 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628439 2024-03-12T17:25:48.547 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:48.547 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:48.547 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:48.547 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:48.547 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/fs/xfs.yaml").st_ino) 2024-03-12T17:25:48.547 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:48.746 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628440 2024-03-12T17:25:48.924 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:48.924 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:48.924 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:48.924 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:48.925 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/mount").st_ino) 2024-03-12T17:25:48.925 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:49.123 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628441 2024-03-12T17:25:49.303 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:49.303 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:49.303 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:49.303 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:49.303 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/mount/fuse.yaml").st_ino) 2024-03-12T17:25:49.303 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:49.501 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628442 2024-03-12T17:25:49.681 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:49.681 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:49.681 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:49.681 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:49.681 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/begin.yaml").st_ino) 2024-03-12T17:25:49.681 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:49.875 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628436 2024-03-12T17:25:50.057 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:50.057 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:50.057 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:50.058 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:50.058 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/%").st_ino) 2024-03-12T17:25:50.058 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:50.252 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628435 2024-03-12T17:25:50.433 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:50.433 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:50.433 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:50.433 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:50.433 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/tasks").st_ino) 2024-03-12T17:25:50.433 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:50.631 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628449 2024-03-12T17:25:50.812 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:50.812 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:50.812 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:50.812 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:50.812 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/tasks/cfuse_workunit_suites_pjd.yaml").st_ino) 2024-03-12T17:25:50.813 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:51.007 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628451 2024-03-12T17:25:51.187 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:51.187 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:51.188 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:51.188 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:51.188 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/32bits/tasks/cfuse_workunit_suites_fsstress.yaml").st_ino) 2024-03-12T17:25:51.188 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:51.368 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628450 2024-03-12T17:25:51.548 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:51.549 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:51.549 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:51.549 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:51.549 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash").st_ino) 2024-03-12T17:25:51.549 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:51.741 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628580 2024-03-12T17:25:51.922 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:51.922 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:51.922 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:51.922 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:51.922 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/ceph-thrash").st_ino) 2024-03-12T17:25:51.922 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:52.115 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628583 2024-03-12T17:25:52.295 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:52.296 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:52.296 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:52.296 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:52.296 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/ceph-thrash/default.yaml").st_ino) 2024-03-12T17:25:52.296 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:52.491 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628584 2024-03-12T17:25:52.673 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:52.673 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:52.673 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:52.673 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:52.673 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/overrides").st_ino) 2024-03-12T17:25:52.673 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:52.877 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628594 2024-03-12T17:25:53.057 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:53.057 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:53.057 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:53.058 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:53.058 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/overrides/whitelist_wrongly_marked_down.yaml").st_ino) 2024-03-12T17:25:53.058 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:53.249 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628598 2024-03-12T17:25:53.429 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:53.429 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:53.429 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:53.429 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:53.429 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/overrides/debug.yaml").st_ino) 2024-03-12T17:25:53.430 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:53.621 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628596 2024-03-12T17:25:53.803 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:53.803 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:53.803 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:53.803 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:53.803 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/overrides/+").st_ino) 2024-03-12T17:25:53.803 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:54.004 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628595 2024-03-12T17:25:54.617 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:54.618 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:54.618 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:54.618 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:54.618 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/overrides/frag_enable.yaml").st_ino) 2024-03-12T17:25:54.618 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:54.815 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628597 2024-03-12T17:25:54.996 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:54.997 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:54.997 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:54.997 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:54.997 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/clusters").st_ino) 2024-03-12T17:25:54.997 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:55.192 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628585 2024-03-12T17:25:55.372 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:55.373 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:55.373 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:55.373 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:55.373 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/clusters/mds-1active-1standby.yaml").st_ino) 2024-03-12T17:25:55.373 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:55.564 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628586 2024-03-12T17:25:55.744 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:55.744 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:55.745 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:55.745 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:55.745 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/msgr-failures").st_ino) 2024-03-12T17:25:55.745 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:55.937 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628591 2024-03-12T17:25:56.118 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:56.118 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:56.118 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:56.118 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:56.118 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/msgr-failures/osd-mds-delay.yaml").st_ino) 2024-03-12T17:25:56.118 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:56.316 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627936 2024-03-12T17:25:56.497 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:56.497 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:56.497 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:56.497 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:56.497 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/msgr-failures/none.yaml").st_ino) 2024-03-12T17:25:56.497 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:56.691 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628592 2024-03-12T17:25:56.872 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:56.872 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:56.872 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:56.872 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:56.873 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/objectstore").st_ino) 2024-03-12T17:25:56.873 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:57.065 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628593 2024-03-12T17:25:57.248 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:57.248 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:57.248 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:57.248 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:57.248 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/fs").st_ino) 2024-03-12T17:25:57.248 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:57.440 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628587 2024-03-12T17:25:57.621 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:57.621 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:57.621 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:57.622 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:57.622 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/fs/xfs.yaml").st_ino) 2024-03-12T17:25:57.622 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:57.814 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628588 2024-03-12T17:25:57.995 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:57.995 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:57.995 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:57.995 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:57.995 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/mount").st_ino) 2024-03-12T17:25:57.996 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:58.187 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628589 2024-03-12T17:25:58.368 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:58.368 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:58.368 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:58.369 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:58.369 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/mount/fuse.yaml").st_ino) 2024-03-12T17:25:58.369 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:58.565 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628590 2024-03-12T17:25:58.746 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:58.746 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:58.746 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:58.746 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:58.746 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/begin.yaml").st_ino) 2024-03-12T17:25:58.746 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:58.937 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628582 2024-03-12T17:25:59.119 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:59.119 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:59.119 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:59.119 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:59.119 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/%").st_ino) 2024-03-12T17:25:59.119 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:59.312 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628581 2024-03-12T17:25:59.493 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:59.493 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:59.493 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:59.493 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:59.493 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/tasks").st_ino) 2024-03-12T17:25:59.493 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:25:59.685 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628599 2024-03-12T17:25:59.865 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:25:59.865 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:25:59.865 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:25:59.865 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:25:59.865 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/tasks/cfuse_workunit_suites_pjd.yaml").st_ino) 2024-03-12T17:25:59.865 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:00.047 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627937 2024-03-12T17:26:00.228 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:00.228 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:00.228 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:00.228 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:00.228 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/tasks/cfuse_workunit_trivial_sync.yaml").st_ino) 2024-03-12T17:26:00.228 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:00.423 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628602 2024-03-12T17:26:00.604 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:00.604 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:00.604 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:00.604 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:00.604 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/tasks/cfuse_workunit_snaptests.yaml").st_ino) 2024-03-12T17:26:00.604 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:00.797 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628600 2024-03-12T17:26:00.977 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:00.977 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:00.977 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:00.977 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:00.977 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/thrash/tasks/cfuse_workunit_suites_fsstress.yaml").st_ino) 2024-03-12T17:26:00.978 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:01.170 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628601 2024-03-12T17:26:01.350 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:01.350 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:01.350 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:01.350 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:01.351 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify").st_ino) 2024-03-12T17:26:01.351 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:01.545 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628625 2024-03-12T17:26:01.725 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:01.725 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:01.725 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:01.725 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:01.726 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/validater").st_ino) 2024-03-12T17:26:01.726 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:01.918 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628644 2024-03-12T17:26:02.099 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:02.099 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:02.099 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:02.100 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:02.100 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/validater/valgrind.yaml").st_ino) 2024-03-12T17:26:02.100 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:02.283 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627939 2024-03-12T17:26:02.464 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:02.464 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:02.464 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:02.464 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:02.464 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/validater/lockdep.yaml").st_ino) 2024-03-12T17:26:02.465 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:02.641 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628645 2024-03-12T17:26:02.821 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:02.822 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:02.822 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:02.822 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:02.822 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/overrides").st_ino) 2024-03-12T17:26:02.822 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:03.018 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628635 2024-03-12T17:26:03.198 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:03.198 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:03.199 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:03.199 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:03.199 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/overrides/whitelist_wrongly_marked_down.yaml").st_ino) 2024-03-12T17:26:03.199 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:03.397 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628639 2024-03-12T17:26:03.578 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:03.578 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:03.578 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:03.578 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:03.578 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/overrides/mon-debug.yaml").st_ino) 2024-03-12T17:26:03.578 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:03.783 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627938 2024-03-12T17:26:03.964 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:03.964 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:03.964 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:03.964 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:03.964 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/overrides/debug.yaml").st_ino) 2024-03-12T17:26:03.964 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:04.157 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628637 2024-03-12T17:26:04.338 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:04.338 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:04.338 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:04.338 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:04.338 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/overrides/+").st_ino) 2024-03-12T17:26:04.338 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:04.538 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628636 2024-03-12T17:26:04.719 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:04.720 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:04.720 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:04.720 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:04.720 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/overrides/frag_enable.yaml").st_ino) 2024-03-12T17:26:04.720 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:04.913 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628638 2024-03-12T17:26:05.095 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:05.095 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:05.095 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:05.095 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:05.095 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/clusters").st_ino) 2024-03-12T17:26:05.095 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:05.292 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628628 2024-03-12T17:26:05.473 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:05.473 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:05.473 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:05.474 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:05.474 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/clusters/fixed-2-ucephfs.yaml").st_ino) 2024-03-12T17:26:05.474 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:05.656 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628629 2024-03-12T17:26:05.837 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:05.838 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:05.838 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:05.838 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:05.838 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/objectstore").st_ino) 2024-03-12T17:26:05.838 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:06.037 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628634 2024-03-12T17:26:06.217 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:06.217 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:06.217 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:06.217 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:06.217 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/fs").st_ino) 2024-03-12T17:26:06.217 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:06.413 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628630 2024-03-12T17:26:06.594 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:06.594 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:06.594 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:06.594 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:06.594 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/fs/xfs.yaml").st_ino) 2024-03-12T17:26:06.594 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:06.790 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628631 2024-03-12T17:26:06.972 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:06.972 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:06.972 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:06.972 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:06.972 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/mount").st_ino) 2024-03-12T17:26:06.972 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:07.165 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628632 2024-03-12T17:26:07.346 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:07.347 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:07.347 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:07.347 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:07.347 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/mount/fuse.yaml").st_ino) 2024-03-12T17:26:07.347 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:07.544 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628633 2024-03-12T17:26:07.723 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:07.723 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:07.723 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:07.723 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:07.724 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/begin.yaml").st_ino) 2024-03-12T17:26:07.724 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:07.914 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628627 2024-03-12T17:26:08.096 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:08.096 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:08.096 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:08.096 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:08.096 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/%").st_ino) 2024-03-12T17:26:08.096 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:08.292 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628626 2024-03-12T17:26:08.472 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:08.473 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:08.473 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:08.473 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:08.473 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/tasks").st_ino) 2024-03-12T17:26:08.473 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:08.673 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628640 2024-03-12T17:26:08.854 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:08.854 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:08.854 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:08.854 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:08.854 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/tasks/libcephfs_interface_tests.yaml").st_ino) 2024-03-12T17:26:08.854 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:09.047 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628643 2024-03-12T17:26:09.229 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:09.229 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:09.229 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:09.229 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:09.229 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/tasks/cfuse_workunit_suites_fsstress.yaml").st_ino) 2024-03-12T17:26:09.229 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:09.423 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628642 2024-03-12T17:26:09.604 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:09.604 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:09.605 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:09.605 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:09.605 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/verify/tasks/cfuse_workunit_suites_dbench.yaml").st_ino) 2024-03-12T17:26:09.605 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:09.788 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628641 2024-03-12T17:26:09.968 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:09.968 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:09.968 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:09.968 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:09.969 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient").st_ino) 2024-03-12T17:26:09.969 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:10.165 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628477 2024-03-12T17:26:10.345 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:10.346 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:10.346 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:10.346 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:10.346 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/overrides").st_ino) 2024-03-12T17:26:10.346 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:10.539 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628488 2024-03-12T17:26:10.720 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:10.720 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:10.720 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:10.720 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:10.720 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/overrides/whitelist_wrongly_marked_down.yaml").st_ino) 2024-03-12T17:26:10.720 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:10.912 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628492 2024-03-12T17:26:11.093 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:11.093 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:11.093 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:11.093 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:11.093 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/overrides/debug.yaml").st_ino) 2024-03-12T17:26:11.093 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:11.286 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628490 2024-03-12T17:26:11.468 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:11.468 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:11.468 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:11.468 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:11.468 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/overrides/+").st_ino) 2024-03-12T17:26:11.468 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:11.663 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628489 2024-03-12T17:26:11.845 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:11.845 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:11.845 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:11.845 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:11.845 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/overrides/frag_enable.yaml").st_ino) 2024-03-12T17:26:11.845 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:12.038 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628491 2024-03-12T17:26:12.219 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:12.219 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:12.219 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:12.219 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:12.219 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/clusters").st_ino) 2024-03-12T17:26:12.220 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:12.410 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628480 2024-03-12T17:26:12.430 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:26:12.437 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:26:12.591 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:12.591 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:12.591 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:12.591 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:12.592 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/clusters/three_clients.yaml").st_ino) 2024-03-12T17:26:12.592 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:12.784 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628481 2024-03-12T17:26:12.965 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:12.965 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:12.965 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:12.965 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:12.965 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/clusters/two_clients.yaml").st_ino) 2024-03-12T17:26:12.965 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:13.156 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627912 2024-03-12T17:26:13.338 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:13.338 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:13.338 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:13.338 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:13.338 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/objectstore").st_ino) 2024-03-12T17:26:13.338 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:13.532 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628487 2024-03-12T17:26:13.712 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:13.712 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:13.712 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:13.712 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:13.712 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/fs").st_ino) 2024-03-12T17:26:13.712 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:13.905 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628482 2024-03-12T17:26:14.086 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:14.086 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:14.086 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:14.086 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:14.086 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/fs/xfs.yaml").st_ino) 2024-03-12T17:26:14.086 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:14.278 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628483 2024-03-12T17:26:14.459 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:14.459 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:14.459 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:14.459 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:14.459 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/mount").st_ino) 2024-03-12T17:26:14.459 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:14.651 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628484 2024-03-12T17:26:14.832 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:14.832 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:14.832 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:14.832 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:14.832 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/mount/fuse.yaml").st_ino) 2024-03-12T17:26:14.832 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:15.024 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628485 2024-03-12T17:26:15.206 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:15.206 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:15.206 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:15.206 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:15.206 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/mount/kclient.yaml.disabled").st_ino) 2024-03-12T17:26:15.207 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:15.399 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628486 2024-03-12T17:26:15.580 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:15.581 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:15.581 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:15.581 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:15.581 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/begin.yaml").st_ino) 2024-03-12T17:26:15.581 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:15.774 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628479 2024-03-12T17:26:15.954 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:15.954 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:15.954 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:15.954 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:15.954 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/%").st_ino) 2024-03-12T17:26:15.954 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:16.149 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628478 2024-03-12T17:26:16.330 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:16.330 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:16.330 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:16.330 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:16.330 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/tasks").st_ino) 2024-03-12T17:26:16.330 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:16.527 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628493 2024-03-12T17:26:16.707 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:16.707 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:16.707 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:16.707 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:16.707 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/tasks/fsx-mpi.yaml.disabled").st_ino) 2024-03-12T17:26:16.707 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:16.903 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627913 2024-03-12T17:26:17.083 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:17.083 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:17.083 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:17.084 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:17.084 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/tasks/ior-shared-file.yaml").st_ino) 2024-03-12T17:26:17.084 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:17.274 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627914 2024-03-12T17:26:17.455 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:17.455 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:17.455 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:17.455 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:17.455 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/tasks/cephfs_misc_tests.yaml").st_ino) 2024-03-12T17:26:17.455 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:17.649 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628494 2024-03-12T17:26:17.830 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:17.830 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:17.830 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:17.830 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:17.830 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/fs/multiclient/tasks/mdtest.yaml").st_ino) 2024-03-12T17:26:17.830 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:18.023 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627915 2024-03-12T17:26:18.204 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:18.204 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:18.204 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:18.204 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:18.204 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-disk").st_ino) 2024-03-12T17:26:18.204 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:18.395 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628416 2024-03-12T17:26:18.577 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:18.577 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:18.577 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:18.577 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:18.577 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-disk/basic").st_ino) 2024-03-12T17:26:18.577 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:18.770 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628417 2024-03-12T17:26:18.951 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:18.951 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:18.951 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:18.951 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:18.951 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-disk/basic/distros").st_ino) 2024-03-12T17:26:18.951 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:19.151 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628419 2024-03-12T17:26:19.333 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:19.333 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:19.333 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:19.333 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:19.333 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-disk/basic/%").st_ino) 2024-03-12T17:26:19.333 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:19.527 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628418 2024-03-12T17:26:19.706 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:19.706 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:19.706 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:19.706 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:19.706 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-disk/basic/tasks").st_ino) 2024-03-12T17:26:19.707 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:19.907 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628420 2024-03-12T17:26:20.088 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:20.089 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:20.089 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:20.089 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:20.089 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/ceph-disk/basic/tasks/ceph-disk.yaml").st_ino) 2024-03-12T17:26:20.089 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:20.286 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628421 2024-03-12T17:26:20.467 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:20.467 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:20.467 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:20.467 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:20.467 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd").st_ino) 2024-03-12T17:26:20.467 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:20.656 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628709 2024-03-12T17:26:20.837 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:20.837 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:20.837 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:20.837 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:20.837 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap").st_ino) 2024-03-12T17:26:20.838 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:21.031 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628750 2024-03-12T17:26:21.214 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:21.214 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:21.214 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:21.214 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:21.214 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap/clusters").st_ino) 2024-03-12T17:26:21.214 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:21.408 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628754 2024-03-12T17:26:21.589 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:21.589 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:21.589 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:21.589 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:21.589 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap/clusters/separate-client.yaml").st_ino) 2024-03-12T17:26:21.589 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:21.783 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628755 2024-03-12T17:26:21.962 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:21.962 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:21.962 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:21.963 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:21.963 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap/ceph").st_ino) 2024-03-12T17:26:21.963 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:22.156 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628752 2024-03-12T17:26:22.337 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:22.337 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:22.337 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:22.337 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:22.337 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap/ceph/ceph.yaml").st_ino) 2024-03-12T17:26:22.337 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:22.532 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628753 2024-03-12T17:26:22.711 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:22.711 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:22.711 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:22.711 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:22.711 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap/kernels").st_ino) 2024-03-12T17:26:22.711 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:22.905 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628756 2024-03-12T17:26:23.086 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:23.086 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:23.086 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:23.086 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:23.086 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap/kernels/pre-single-major.yaml").st_ino) 2024-03-12T17:26:23.086 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:23.288 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628757 2024-03-12T17:26:23.468 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:23.468 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:23.468 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:23.468 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:23.468 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap/kernels/single-major-on.yaml").st_ino) 2024-03-12T17:26:23.468 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:23.662 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628011 2024-03-12T17:26:23.843 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:23.843 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:23.843 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:23.843 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:23.843 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap/kernels/single-major-off.yaml").st_ino) 2024-03-12T17:26:23.843 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:24.035 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628010 2024-03-12T17:26:24.215 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:24.215 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:24.215 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:24.216 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:24.216 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap/conf.yaml").st_ino) 2024-03-12T17:26:24.216 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:24.407 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628009 2024-03-12T17:26:24.588 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:24.588 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:24.588 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:24.588 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:24.588 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap/%").st_ino) 2024-03-12T17:26:24.588 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:24.782 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628751 2024-03-12T17:26:24.963 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:24.963 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:24.963 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:24.963 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:24.963 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap/xfs.yaml").st_ino) 2024-03-12T17:26:24.963 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:25.156 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628760 2024-03-12T17:26:25.338 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:25.338 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:25.338 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:25.338 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:25.338 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap/tasks").st_ino) 2024-03-12T17:26:25.338 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:25.531 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628758 2024-03-12T17:26:25.711 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:25.711 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:25.711 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:25.711 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:25.711 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/unmap/tasks/unmap.yaml").st_ino) 2024-03-12T17:26:25.712 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:25.904 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628759 2024-03-12T17:26:26.085 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:26.085 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:26.085 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:26.085 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:26.085 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd").st_ino) 2024-03-12T17:26:26.085 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:26.278 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628722 2024-03-12T17:26:26.459 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:26.459 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:26.459 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:26.459 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:26.460 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/clusters").st_ino) 2024-03-12T17:26:26.460 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:26.652 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628724 2024-03-12T17:26:26.834 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:26.834 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:26.834 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:26.834 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:26.834 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/clusters/fixed-3.yaml").st_ino) 2024-03-12T17:26:26.834 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:27.024 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628725 2024-03-12T17:26:27.205 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:27.205 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:27.205 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:27.205 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:27.205 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/msgr-failures").st_ino) 2024-03-12T17:26:27.205 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:27.398 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628728 2024-03-12T17:26:27.579 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:27.579 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:27.579 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:27.579 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:27.579 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/msgr-failures/many.yaml").st_ino) 2024-03-12T17:26:27.579 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:27.775 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627993 2024-03-12T17:26:27.955 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:27.955 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:27.955 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:27.955 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:27.955 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/msgr-failures/few.yaml").st_ino) 2024-03-12T17:26:27.955 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:28.149 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628729 2024-03-12T17:26:28.330 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:28.330 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:28.331 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:28.331 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:28.331 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/fs").st_ino) 2024-03-12T17:26:28.331 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:28.531 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628726 2024-03-12T17:26:28.711 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:28.711 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:28.711 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:28.711 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:28.711 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/fs/btrfs.yaml").st_ino) 2024-03-12T17:26:28.711 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:28.902 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628727 2024-03-12T17:26:29.083 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:29.083 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:29.083 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:29.084 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:29.084 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/conf.yaml").st_ino) 2024-03-12T17:26:29.084 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:29.279 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627992 2024-03-12T17:26:29.461 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:29.461 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:29.461 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:29.461 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:29.461 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/%").st_ino) 2024-03-12T17:26:29.461 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:29.656 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628723 2024-03-12T17:26:29.837 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:29.837 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:29.837 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:29.837 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:29.838 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/tasks").st_ino) 2024-03-12T17:26:29.838 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:30.028 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628730 2024-03-12T17:26:30.210 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:30.210 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:30.210 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:30.210 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:30.210 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_fsstress.yaml").st_ino) 2024-03-12T17:26:30.210 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:30.405 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627997 2024-03-12T17:26:30.586 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:30.587 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:30.587 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:30.587 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:30.587 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_fio.yaml").st_ino) 2024-03-12T17:26:30.587 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:30.774 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628731 2024-03-12T17:26:30.955 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:30.955 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:30.956 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:30.956 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:30.956 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_ffsb.yaml").st_ino) 2024-03-12T17:26:30.956 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:31.147 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627996 2024-03-12T17:26:31.328 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:31.329 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:31.329 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:31.329 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:31.329 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_fsstress_ext4.yaml").st_ino) 2024-03-12T17:26:31.329 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:31.520 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627999 2024-03-12T17:26:31.700 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:31.700 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:31.700 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:31.700 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:31.701 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_iozone.yaml").st_ino) 2024-03-12T17:26:31.701 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:31.893 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628001 2024-03-12T17:26:32.073 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:32.074 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:32.074 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:32.074 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:32.074 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_dbench.yaml").st_ino) 2024-03-12T17:26:32.074 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:32.268 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627995 2024-03-12T17:26:32.449 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:32.449 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:32.450 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:32.450 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:32.450 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_kernel_untar_build.yaml").st_ino) 2024-03-12T17:26:32.450 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:32.630 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627994 2024-03-12T17:26:32.811 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:32.812 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:32.812 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:32.812 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:32.812 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_trivial_sync.yaml").st_ino) 2024-03-12T17:26:32.812 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:33.007 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628002 2024-03-12T17:26:33.188 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:33.188 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:33.188 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:33.188 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:33.189 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_fsstress_btrfs.yaml").st_ino) 2024-03-12T17:26:33.189 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:33.384 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627998 2024-03-12T17:26:33.564 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:33.564 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:33.565 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:33.565 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:33.565 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd/tasks/rbd_workunit_suites_fsx.yaml").st_ino) 2024-03-12T17:26:33.565 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:33.757 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628000 2024-03-12T17:26:33.939 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:33.939 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:33.939 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:33.939 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:33.939 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/singleton").st_ino) 2024-03-12T17:26:33.939 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:34.135 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628732 2024-03-12T17:26:34.315 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:34.315 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:34.315 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:34.316 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:34.316 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/singleton/msgr-failures").st_ino) 2024-03-12T17:26:34.316 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:34.508 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628736 2024-03-12T17:26:34.689 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:34.689 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:34.689 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:34.689 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:34.689 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/singleton/msgr-failures/many.yaml").st_ino) 2024-03-12T17:26:34.689 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:34.880 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628004 2024-03-12T17:26:35.061 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:35.061 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:35.061 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:35.061 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:35.061 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/singleton/msgr-failures/few.yaml").st_ino) 2024-03-12T17:26:35.061 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:35.255 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628737 2024-03-12T17:26:35.436 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:35.437 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:35.437 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:35.437 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:35.437 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/singleton/fs").st_ino) 2024-03-12T17:26:35.437 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:35.642 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628734 2024-03-12T17:26:35.822 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:35.822 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:35.822 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:35.822 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:35.822 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/singleton/fs/btrfs.yaml").st_ino) 2024-03-12T17:26:35.822 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:36.020 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628735 2024-03-12T17:26:36.201 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:36.201 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:36.202 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:36.202 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:36.202 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/singleton/conf.yaml").st_ino) 2024-03-12T17:26:36.202 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:36.395 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628003 2024-03-12T17:26:36.576 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:36.576 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:36.576 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:36.576 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:36.576 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/singleton/%").st_ino) 2024-03-12T17:26:36.576 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:36.772 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628733 2024-03-12T17:26:36.954 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:36.954 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:36.954 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:36.954 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:36.954 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/singleton/tasks").st_ino) 2024-03-12T17:26:36.955 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:37.147 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628738 2024-03-12T17:26:37.329 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:37.329 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:37.329 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:37.329 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:37.329 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/singleton/tasks/rbd_xfstests.yaml").st_ino) 2024-03-12T17:26:37.330 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:37.522 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628739 2024-03-12T17:26:37.703 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:37.703 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:37.703 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:37.703 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:37.703 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount").st_ino) 2024-03-12T17:26:37.703 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:37.897 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628710 2024-03-12T17:26:38.078 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:38.078 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:38.079 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:38.079 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:38.079 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/install").st_ino) 2024-03-12T17:26:38.079 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:38.273 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628716 2024-03-12T17:26:38.453 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:38.454 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:38.454 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:38.454 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:38.454 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/install/ceph.yaml").st_ino) 2024-03-12T17:26:38.454 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:38.648 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628717 2024-03-12T17:26:38.829 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:38.829 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:38.829 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:38.829 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:38.829 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/clusters").st_ino) 2024-03-12T17:26:38.829 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:39.021 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628712 2024-03-12T17:26:39.204 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:39.204 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:39.204 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:39.204 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:39.204 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/clusters/fixed-3.yaml").st_ino) 2024-03-12T17:26:39.204 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:39.397 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628713 2024-03-12T17:26:39.578 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:39.578 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:39.578 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:39.578 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:39.578 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/msgr-failures").st_ino) 2024-03-12T17:26:39.578 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:39.772 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628718 2024-03-12T17:26:39.954 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:39.954 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:39.954 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:39.954 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:39.954 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/msgr-failures/many.yaml").st_ino) 2024-03-12T17:26:39.955 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:40.149 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627984 2024-03-12T17:26:40.331 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:40.331 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:40.331 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:40.331 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:40.331 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/msgr-failures/few.yaml").st_ino) 2024-03-12T17:26:40.331 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:40.525 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628719 2024-03-12T17:26:40.706 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:40.706 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:40.706 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:40.706 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:40.706 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/fs").st_ino) 2024-03-12T17:26:40.706 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:40.899 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628714 2024-03-12T17:26:41.081 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:41.081 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:41.081 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:41.081 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:41.081 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/fs/btrfs.yaml").st_ino) 2024-03-12T17:26:41.081 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:41.275 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628715 2024-03-12T17:26:41.455 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:41.455 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:41.455 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:41.455 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:41.455 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/conf.yaml").st_ino) 2024-03-12T17:26:41.455 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:41.637 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627983 2024-03-12T17:26:41.818 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:41.818 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:41.818 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:41.818 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:41.818 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/%").st_ino) 2024-03-12T17:26:41.819 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:42.014 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628711 2024-03-12T17:26:42.195 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:42.196 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:42.196 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:42.196 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:42.196 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/tasks").st_ino) 2024-03-12T17:26:42.196 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:42.397 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628720 2024-03-12T17:26:42.578 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:42.578 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:42.578 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:42.578 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:42.578 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_map_unmap.yaml").st_ino) 2024-03-12T17:26:42.578 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:42.772 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627990 2024-03-12T17:26:42.786 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:26:42.795 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:26:42.952 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:42.952 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:42.952 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:42.952 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:42.952 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_kfsx.yaml").st_ino) 2024-03-12T17:26:42.953 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:43.144 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627988 2024-03-12T17:26:43.325 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:43.325 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:43.325 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:43.326 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:43.326 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_image_read.yaml").st_ino) 2024-03-12T17:26:43.326 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:43.518 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627986 2024-03-12T17:26:43.700 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:43.700 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:43.700 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:43.700 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:43.701 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_simple_big.yaml").st_ino) 2024-03-12T17:26:43.701 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:43.895 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627991 2024-03-12T17:26:44.076 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:44.076 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:44.076 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:44.076 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:44.076 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_concurrent.yaml").st_ino) 2024-03-12T17:26:44.076 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:44.269 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628721 2024-03-12T17:26:44.450 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:44.450 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:44.451 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:44.451 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:44.451 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_map_snapshot_io.yaml").st_ino) 2024-03-12T17:26:44.451 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:44.630 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627989 2024-03-12T17:26:44.810 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:44.811 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:44.811 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:44.811 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:44.811 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_huge_tickets.yaml").st_ino) 2024-03-12T17:26:44.811 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:45.006 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627985 2024-03-12T17:26:45.187 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:45.187 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:45.187 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:45.187 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:45.187 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/rbd-nomount/tasks/rbd_kernel.yaml").st_ino) 2024-03-12T17:26:45.187 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:45.382 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627987 2024-03-12T17:26:45.564 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:45.564 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:45.564 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:45.564 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:45.564 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash").st_ino) 2024-03-12T17:26:45.564 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:45.757 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628740 2024-03-12T17:26:45.941 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:45.941 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:45.941 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:45.941 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:45.942 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash/clusters").st_ino) 2024-03-12T17:26:45.942 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:46.146 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628742 2024-03-12T17:26:46.327 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:46.327 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:46.327 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:46.327 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:46.327 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash/clusters/fixed-3.yaml").st_ino) 2024-03-12T17:26:46.328 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:46.528 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628743 2024-03-12T17:26:46.709 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:46.709 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:46.709 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:46.709 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:46.709 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash/fs").st_ino) 2024-03-12T17:26:46.709 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:46.906 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628744 2024-03-12T17:26:47.088 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:47.088 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:47.088 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:47.088 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:47.088 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash/fs/btrfs.yaml").st_ino) 2024-03-12T17:26:47.088 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:47.287 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628745 2024-03-12T17:26:47.470 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:47.470 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:47.471 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:47.471 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:47.471 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash/workloads").st_ino) 2024-03-12T17:26:47.471 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:47.648 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628748 2024-03-12T17:26:47.829 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:47.829 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:47.829 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:47.829 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:47.829 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash/workloads/rbd_fio.yaml").st_ino) 2024-03-12T17:26:47.829 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:48.024 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628749 2024-03-12T17:26:48.206 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:48.206 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:48.206 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:48.206 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:48.206 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash/workloads/rbd_workunit_suites_ffsb.yaml").st_ino) 2024-03-12T17:26:48.206 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:48.389 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628007 2024-03-12T17:26:48.570 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:48.570 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:48.570 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:48.570 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:48.570 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash/workloads/rbd_workunit_suites_iozone.yaml.disabled").st_ino) 2024-03-12T17:26:48.570 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:48.762 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628008 2024-03-12T17:26:48.943 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:48.943 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:48.943 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:48.943 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:48.943 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash/conf.yaml").st_ino) 2024-03-12T17:26:48.943 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:49.136 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628005 2024-03-12T17:26:49.318 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:49.318 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:49.318 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:49.318 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:49.318 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash/%").st_ino) 2024-03-12T17:26:49.318 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:49.511 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628741 2024-03-12T17:26:49.693 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:49.693 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:49.693 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:49.693 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:49.694 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash/thrashers").st_ino) 2024-03-12T17:26:49.694 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:49.886 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628746 2024-03-12T17:26:50.067 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:50.067 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:50.067 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:50.067 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:50.067 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash/thrashers/default.yaml").st_ino) 2024-03-12T17:26:50.067 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:50.260 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628747 2024-03-12T17:26:50.441 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:50.442 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:50.442 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:50.442 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:50.442 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/krbd/thrash/thrashers/mon-thrasher.yaml").st_ino) 2024-03-12T17:26:50.442 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:50.644 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628006 2024-03-12T17:26:50.826 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:50.826 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:50.826 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:50.826 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:50.826 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/buildpackages").st_ino) 2024-03-12T17:26:50.826 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:51.021 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628373 2024-03-12T17:26:51.201 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:51.201 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:51.201 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:51.201 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:51.202 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/buildpackages/tests").st_ino) 2024-03-12T17:26:51.202 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:51.396 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628379 2024-03-12T17:26:51.576 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:51.576 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:51.576 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:51.577 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:51.577 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/buildpackages/tests/distros").st_ino) 2024-03-12T17:26:51.577 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:51.769 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628381 2024-03-12T17:26:51.951 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:51.951 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:51.951 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:51.951 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:51.951 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/buildpackages/tests/%").st_ino) 2024-03-12T17:26:51.951 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:52.146 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628380 2024-03-12T17:26:52.327 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:52.327 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:52.327 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:52.327 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:52.327 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/buildpackages/tests/tasks").st_ino) 2024-03-12T17:26:52.327 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:52.518 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628382 2024-03-12T17:26:52.699 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:52.699 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:52.699 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:52.699 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:52.699 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/buildpackages/tests/tasks/release.yaml").st_ino) 2024-03-12T17:26:52.700 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:52.889 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628383 2024-03-12T17:26:53.070 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:53.070 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:53.070 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:53.070 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:53.070 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/buildpackages/any").st_ino) 2024-03-12T17:26:53.070 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:53.270 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628374 2024-03-12T17:26:53.452 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:53.452 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:53.452 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:53.452 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:53.452 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/buildpackages/any/distros").st_ino) 2024-03-12T17:26:53.452 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:53.647 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628376 2024-03-12T17:26:53.828 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:53.828 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:53.829 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:53.829 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:53.829 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/buildpackages/any/%").st_ino) 2024-03-12T17:26:53.829 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:54.021 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628375 2024-03-12T17:26:54.201 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:54.201 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:54.201 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:54.201 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:54.201 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/buildpackages/any/tasks").st_ino) 2024-03-12T17:26:54.201 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:54.393 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628377 2024-03-12T17:26:54.574 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:54.574 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:54.575 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:54.575 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:54.575 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/buildpackages/any/tasks/release.yaml").st_ino) 2024-03-12T17:26:54.575 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:54.768 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628378 2024-03-12T17:26:54.949 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:54.949 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:54.949 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:54.949 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:54.949 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados").st_ino) 2024-03-12T17:26:54.949 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:55.132 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629112 2024-03-12T17:26:55.313 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:55.313 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:55.313 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:55.313 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:55.313 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/objectstore").st_ino) 2024-03-12T17:26:55.313 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:55.507 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629162 2024-03-12T17:26:55.687 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:55.687 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:55.687 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:55.687 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:55.687 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/objectstore/filestore-idempotent-aio-journal.yaml").st_ino) 2024-03-12T17:26:55.687 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:55.879 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628069 2024-03-12T17:26:56.060 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:56.061 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:56.061 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:56.061 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:56.061 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/objectstore/ceph_objectstore_tool.yaml").st_ino) 2024-03-12T17:26:56.061 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:56.253 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628067 2024-03-12T17:26:56.434 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:56.434 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:56.434 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:56.434 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:56.434 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/objectstore/fusestore.yaml").st_ino) 2024-03-12T17:26:56.434 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:56.633 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628071 2024-03-12T17:26:56.814 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:56.814 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:56.814 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:56.814 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:56.814 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/objectstore/keyvaluedb.yaml").st_ino) 2024-03-12T17:26:56.814 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:57.006 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628072 2024-03-12T17:26:57.187 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:57.188 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:57.188 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:57.188 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:57.188 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/objectstore/objectstore.yaml").st_ino) 2024-03-12T17:26:57.188 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:57.379 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628074 2024-03-12T17:26:57.560 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:57.561 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:57.561 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:57.561 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:57.561 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/objectstore/alloc-hint.yaml").st_ino) 2024-03-12T17:26:57.561 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:57.755 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629163 2024-03-12T17:26:57.937 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:57.937 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:57.937 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:57.937 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:57.937 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/objectstore/filejournal.yaml").st_ino) 2024-03-12T17:26:57.937 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:58.130 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628068 2024-03-12T17:26:58.311 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:58.312 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:58.312 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:58.312 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:58.312 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/objectstore/objectcacher-stress.yaml").st_ino) 2024-03-12T17:26:58.312 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:58.505 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628073 2024-03-12T17:26:58.686 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:58.686 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:58.686 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:58.686 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:58.686 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/objectstore/filestore-idempotent.yaml").st_ino) 2024-03-12T17:26:58.686 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:58.877 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628070 2024-03-12T17:26:59.059 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:59.059 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:59.059 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:59.059 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:59.059 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton").st_ino) 2024-03-12T17:26:59.059 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:59.252 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629169 2024-03-12T17:26:59.434 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:59.434 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:59.434 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:59.434 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:59.434 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/msgr").st_ino) 2024-03-12T17:26:59.434 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:59.626 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629175 2024-03-12T17:26:59.808 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:26:59.809 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:26:59.809 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:26:59.809 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:26:59.809 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/msgr-failures").st_ino) 2024-03-12T17:26:59.809 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:26:59.998 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629176 2024-03-12T17:27:00.179 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:00.180 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:00.180 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:00.180 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:00.180 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/msgr-failures/many.yaml").st_ino) 2024-03-12T17:27:00.180 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:00.373 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628105 2024-03-12T17:27:00.554 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:00.554 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:00.554 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:00.554 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:00.554 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/msgr-failures/few.yaml").st_ino) 2024-03-12T17:27:00.554 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:00.749 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629177 2024-03-12T17:27:00.927 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:00.927 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:00.927 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:00.927 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:00.928 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/objectstore").st_ino) 2024-03-12T17:27:00.928 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:01.123 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629178 2024-03-12T17:27:01.304 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:01.304 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:01.304 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:01.304 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:01.304 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/fs").st_ino) 2024-03-12T17:27:01.304 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:01.498 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629173 2024-03-12T17:27:01.679 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:01.679 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:01.680 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:01.680 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:01.680 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/fs/xfs.yaml").st_ino) 2024-03-12T17:27:01.680 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:01.871 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629174 2024-03-12T17:27:02.053 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:02.053 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:02.053 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:02.053 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:02.053 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/%").st_ino) 2024-03-12T17:27:02.053 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:02.243 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629170 2024-03-12T17:27:02.424 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:02.424 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:02.424 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:02.424 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:02.424 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all").st_ino) 2024-03-12T17:27:02.424 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:02.619 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629171 2024-03-12T17:27:02.800 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:02.801 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:02.801 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:02.801 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:02.801 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/divergent_priors.yaml").st_ino) 2024-03-12T17:27:02.801 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:02.993 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628082 2024-03-12T17:27:03.174 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:03.174 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:03.174 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:03.174 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:03.174 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/watch-notify-same-primary.yaml").st_ino) 2024-03-12T17:27:03.174 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:03.370 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628104 2024-03-12T17:27:03.552 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:03.552 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:03.552 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:03.552 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:03.552 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/ec-lost-unfound.yaml").st_ino) 2024-03-12T17:27:03.552 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:03.754 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628085 2024-03-12T17:27:03.935 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:03.936 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:03.936 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:03.936 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:03.936 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/rest-api.yaml").st_ino) 2024-03-12T17:27:03.936 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:04.130 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628100 2024-03-12T17:27:04.311 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:04.311 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:04.311 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:04.311 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:04.311 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/mon-config-keys.yaml").st_ino) 2024-03-12T17:27:04.311 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:04.506 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628088 2024-03-12T17:27:04.686 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:04.687 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:04.687 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:04.687 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:04.687 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/mon-thrasher.yaml").st_ino) 2024-03-12T17:27:04.687 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:04.885 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628090 2024-03-12T17:27:05.066 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:05.066 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:05.066 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:05.066 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:05.066 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/osd-recovery-incomplete.yaml").st_ino) 2024-03-12T17:27:05.066 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:05.261 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628092 2024-03-12T17:27:05.442 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:05.442 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:05.442 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:05.442 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:05.442 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/osd-recovery.yaml").st_ino) 2024-03-12T17:27:05.442 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:05.639 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628093 2024-03-12T17:27:05.821 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:05.821 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:05.821 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:05.821 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:05.821 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/admin-socket.yaml").st_ino) 2024-03-12T17:27:05.821 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:06.017 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629172 2024-03-12T17:27:06.198 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:06.198 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:06.198 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:06.198 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:06.198 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/reg11184.yaml").st_ino) 2024-03-12T17:27:06.198 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:06.395 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628098 2024-03-12T17:27:06.576 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:06.577 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:06.577 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:06.577 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:06.577 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/mon-seesaw.yaml").st_ino) 2024-03-12T17:27:06.577 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:06.770 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628089 2024-03-12T17:27:06.951 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:06.951 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:06.951 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:06.951 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:06.951 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/radostool.yaml").st_ino) 2024-03-12T17:27:06.951 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:07.144 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628096 2024-03-12T17:27:07.326 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:07.326 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:07.326 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:07.326 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:07.326 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/thrash_cache_writeback_proxy_none.yaml").st_ino) 2024-03-12T17:27:07.326 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:07.524 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628103 2024-03-12T17:27:07.705 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:07.705 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:07.705 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:07.705 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:07.705 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/dump-stuck.yaml").st_ino) 2024-03-12T17:27:07.705 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:07.895 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628084 2024-03-12T17:27:08.076 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:08.077 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:08.077 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:08.077 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:08.077 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/resolve_stuck_peering.yaml").st_ino) 2024-03-12T17:27:08.077 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:08.269 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628099 2024-03-12T17:27:08.450 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:08.450 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:08.450 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:08.450 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:08.450 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/osd-backfill.yaml").st_ino) 2024-03-12T17:27:08.450 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:08.644 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628091 2024-03-12T17:27:08.825 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:08.826 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:08.826 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:08.826 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:08.826 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/divergent_priors2.yaml").st_ino) 2024-03-12T17:27:08.826 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:09.019 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628083 2024-03-12T17:27:09.201 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:09.201 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:09.201 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:09.201 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:09.201 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/peer.yaml").st_ino) 2024-03-12T17:27:09.201 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:09.390 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628094 2024-03-12T17:27:09.571 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:09.571 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:09.571 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:09.571 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:09.571 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/test_envlibrados_for_rocksdb.yaml").st_ino) 2024-03-12T17:27:09.571 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:09.764 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628101 2024-03-12T17:27:09.945 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:09.945 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:09.945 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:09.945 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:09.945 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/thrash-rados.yaml").st_ino) 2024-03-12T17:27:09.945 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:10.134 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628102 2024-03-12T17:27:10.314 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:10.314 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:10.314 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:10.314 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:10.314 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/lost-unfound.yaml").st_ino) 2024-03-12T17:27:10.314 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:10.506 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628087 2024-03-12T17:27:10.686 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:10.686 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:10.686 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:10.687 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:10.687 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/cephtool.yaml").st_ino) 2024-03-12T17:27:10.687 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:10.880 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628081 2024-03-12T17:27:11.061 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:11.061 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:11.061 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:11.062 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:11.062 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/pg-removal-interruption.yaml").st_ino) 2024-03-12T17:27:11.062 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:11.255 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628095 2024-03-12T17:27:11.436 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:11.436 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:11.436 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:11.436 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:11.436 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/rebuild-mondb.yaml").st_ino) 2024-03-12T17:27:11.436 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:11.632 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628097 2024-03-12T17:27:11.814 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:11.814 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:11.814 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:11.815 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:11.815 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/all/lost-unfound-delete.yaml").st_ino) 2024-03-12T17:27:11.815 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:12.006 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628086 2024-03-12T17:27:12.187 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:12.187 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:12.187 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:12.187 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:12.187 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton/rados.yaml").st_ino) 2024-03-12T17:27:12.187 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:12.382 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629179 2024-03-12T17:27:12.562 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:12.562 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:12.562 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:12.562 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:12.562 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic").st_ino) 2024-03-12T17:27:12.563 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:12.756 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629113 2024-03-12T17:27:12.924 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:27:12.932 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:27:12.938 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:12.938 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:12.938 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:12.938 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:12.938 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/msgr").st_ino) 2024-03-12T17:27:12.938 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:13.103 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629124 2024-03-12T17:27:13.285 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:13.285 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:13.285 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:13.285 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:13.285 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/msgr/async.yaml").st_ino) 2024-03-12T17:27:13.285 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:13.437 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629125 2024-03-12T17:27:13.618 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:13.618 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:13.618 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:13.618 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:13.618 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/msgr/simple.yaml").st_ino) 2024-03-12T17:27:13.618 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:13.813 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628039 2024-03-12T17:27:13.993 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:13.994 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:13.994 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:13.994 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:13.994 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/msgr/random.yaml").st_ino) 2024-03-12T17:27:13.994 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:14.191 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628038 2024-03-12T17:27:14.371 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:14.371 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:14.371 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:14.371 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:14.371 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/clusters").st_ino) 2024-03-12T17:27:14.371 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:14.571 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629115 2024-03-12T17:27:14.751 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:14.751 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:14.752 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:14.752 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:14.752 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/clusters/openstack.yaml").st_ino) 2024-03-12T17:27:14.752 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:14.945 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628036 2024-03-12T17:27:15.126 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:15.126 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:15.126 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:15.126 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:15.126 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/clusters/fixed-2.yaml").st_ino) 2024-03-12T17:27:15.126 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:15.322 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629117 2024-03-12T17:27:15.504 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:15.504 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:15.504 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:15.504 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:15.504 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/clusters/+").st_ino) 2024-03-12T17:27:15.504 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:15.697 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629116 2024-03-12T17:27:15.878 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:15.878 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:15.878 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:15.878 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:15.878 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/msgr-failures").st_ino) 2024-03-12T17:27:15.878 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:16.077 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629122 2024-03-12T17:27:16.258 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:16.258 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:16.258 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:16.258 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:16.258 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/msgr-failures/many.yaml").st_ino) 2024-03-12T17:27:16.258 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:16.454 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628037 2024-03-12T17:27:16.635 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:16.635 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:16.635 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:16.635 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:16.635 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/msgr-failures/few.yaml").st_ino) 2024-03-12T17:27:16.635 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:16.832 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629123 2024-03-12T17:27:17.012 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:17.012 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:17.012 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:17.012 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:17.012 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/objectstore").st_ino) 2024-03-12T17:27:17.012 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:17.209 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629126 2024-03-12T17:27:17.389 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:17.389 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:17.390 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:17.390 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:17.390 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/fs").st_ino) 2024-03-12T17:27:17.390 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:17.585 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629118 2024-03-12T17:27:17.767 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:17.767 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:17.767 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:17.767 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:17.767 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/fs/btrfs.yaml").st_ino) 2024-03-12T17:27:17.767 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:17.962 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629119 2024-03-12T17:27:18.144 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:18.144 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:18.144 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:18.144 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:18.144 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/fs/xfs.yaml").st_ino) 2024-03-12T17:27:18.144 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:18.340 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629120 2024-03-12T17:27:18.521 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:18.521 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:18.521 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:18.521 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:18.521 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/%").st_ino) 2024-03-12T17:27:18.521 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:18.721 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629114 2024-03-12T17:27:18.901 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:18.902 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:18.902 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:18.902 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:18.902 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/mon_kv_backend").st_ino) 2024-03-12T17:27:18.902 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:19.097 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629121 2024-03-12T17:27:19.278 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:19.278 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:19.278 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:19.278 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:19.278 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/tasks").st_ino) 2024-03-12T17:27:19.278 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:19.476 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629128 2024-03-12T17:27:19.657 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:19.657 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:19.657 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:19.657 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:19.657 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/tasks/readwrite.yaml").st_ino) 2024-03-12T17:27:19.658 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:19.848 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628047 2024-03-12T17:27:20.031 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:20.031 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:20.031 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:20.031 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:20.031 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/tasks/rados_cls_all.yaml").st_ino) 2024-03-12T17:27:20.031 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:20.223 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628040 2024-03-12T17:27:20.405 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:20.405 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:20.405 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:20.405 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:20.405 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/tasks/rados_workunit_loadgen_mostlyread.yaml").st_ino) 2024-03-12T17:27:20.405 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:20.597 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628046 2024-03-12T17:27:20.779 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:20.779 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:20.779 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:20.779 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:20.779 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/tasks/rados_stress_watch.yaml").st_ino) 2024-03-12T17:27:20.779 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:20.974 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628042 2024-03-12T17:27:21.156 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:21.156 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:21.156 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:21.156 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:21.156 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/tasks/rados_workunit_loadgen_big.yaml").st_ino) 2024-03-12T17:27:21.156 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:21.348 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628044 2024-03-12T17:27:21.530 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:21.530 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:21.530 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:21.531 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:21.531 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/tasks/scrub_test.yaml").st_ino) 2024-03-12T17:27:21.531 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:21.725 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628050 2024-03-12T17:27:21.905 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:21.905 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:21.905 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:21.906 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:21.906 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/tasks/rados_workunit_loadgen_mix.yaml").st_ino) 2024-03-12T17:27:21.906 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:22.097 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628045 2024-03-12T17:27:22.278 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:22.278 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:22.278 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:22.278 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:22.278 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/tasks/rados_python.yaml").st_ino) 2024-03-12T17:27:22.278 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:22.474 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628041 2024-03-12T17:27:22.655 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:22.656 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:22.656 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:22.656 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:22.656 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/tasks/repair_test.yaml").st_ino) 2024-03-12T17:27:22.656 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:22.847 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628048 2024-03-12T17:27:23.028 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:23.028 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:23.028 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:23.028 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:23.028 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/tasks/rados_api_tests.yaml").st_ino) 2024-03-12T17:27:23.028 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:23.222 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629129 2024-03-12T17:27:23.404 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:23.404 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:23.404 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:23.404 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:23.404 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/tasks/rgw_snaps.yaml").st_ino) 2024-03-12T17:27:23.404 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:23.597 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628049 2024-03-12T17:27:23.778 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:23.778 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:23.778 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:23.779 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:23.779 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/tasks/rados_striper.yaml").st_ino) 2024-03-12T17:27:23.779 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:23.972 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628043 2024-03-12T17:27:24.154 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:24.154 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:24.154 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:24.154 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:24.154 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/basic/rados.yaml").st_ino) 2024-03-12T17:27:24.154 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:24.346 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629127 2024-03-12T17:27:24.528 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:24.528 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:24.528 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:24.528 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:24.528 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec").st_ino) 2024-03-12T17:27:24.528 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:24.723 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629207 2024-03-12T17:27:24.904 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:24.904 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:24.904 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:24.904 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:24.904 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/leveldb.yaml").st_ino) 2024-03-12T17:27:24.905 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:25.095 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629214 2024-03-12T17:27:25.276 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:25.277 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:25.277 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:25.277 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:25.277 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/clusters").st_ino) 2024-03-12T17:27:25.277 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:25.468 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629209 2024-03-12T17:27:25.649 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:25.649 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:25.649 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:25.649 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:25.649 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/clusters/openstack.yaml").st_ino) 2024-03-12T17:27:25.650 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:25.828 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628112 2024-03-12T17:27:26.008 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:26.009 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:26.009 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:26.009 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:26.009 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/clusters/+").st_ino) 2024-03-12T17:27:26.009 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:26.202 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629210 2024-03-12T17:27:26.382 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:26.382 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:26.382 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:26.382 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:26.383 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/clusters/fixed-4.yaml").st_ino) 2024-03-12T17:27:26.383 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:26.567 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629211 2024-03-12T17:27:26.747 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:26.747 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:26.747 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:26.747 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:26.747 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/msgr-failures").st_ino) 2024-03-12T17:27:26.747 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:26.941 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629215 2024-03-12T17:27:27.122 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:27.122 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:27.122 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:27.122 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:27.122 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/objectstore").st_ino) 2024-03-12T17:27:27.123 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:27.318 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629216 2024-03-12T17:27:27.499 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:27.499 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:27.499 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:27.499 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:27.499 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/fs").st_ino) 2024-03-12T17:27:27.499 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:27.691 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629212 2024-03-12T17:27:27.873 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:27.873 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:27.873 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:27.873 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:27.873 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/fs/xfs.yaml").st_ino) 2024-03-12T17:27:27.873 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:28.066 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629213 2024-03-12T17:27:28.248 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:28.248 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:28.248 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:28.248 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:28.248 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/workloads").st_ino) 2024-03-12T17:27:28.248 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:28.440 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629220 2024-03-12T17:27:28.620 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:28.620 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:28.620 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:28.620 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:28.620 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/workloads/ec-rados-plugin=shec-k=4-m=3-c=2.yaml").st_ino) 2024-03-12T17:27:28.620 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:28.821 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629221 2024-03-12T17:27:29.001 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:29.001 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:29.001 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:29.001 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:29.001 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/%").st_ino) 2024-03-12T17:27:29.001 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:29.194 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629208 2024-03-12T17:27:29.375 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:29.375 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:29.375 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:29.375 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:29.376 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/thrashers").st_ino) 2024-03-12T17:27:29.376 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:29.568 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629218 2024-03-12T17:27:29.749 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:29.749 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:29.749 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:29.749 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:29.749 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/thrashers/default.yaml").st_ino) 2024-03-12T17:27:29.749 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:29.941 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629219 2024-03-12T17:27:30.122 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:30.122 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:30.122 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:30.122 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:30.122 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-shec/rados.yaml").st_ino) 2024-03-12T17:27:30.122 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:30.315 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629217 2024-03-12T17:27:30.496 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:30.496 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:30.497 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:30.497 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:30.497 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code").st_ino) 2024-03-12T17:27:30.497 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:30.689 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629222 2024-03-12T17:27:30.871 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:30.871 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:30.871 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:30.871 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:30.871 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/fast").st_ino) 2024-03-12T17:27:30.871 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:31.064 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629225 2024-03-12T17:27:31.246 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:31.246 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:31.246 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:31.246 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:31.246 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/fast/normal.yaml").st_ino) 2024-03-12T17:27:31.246 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:31.441 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628113 2024-03-12T17:27:31.622 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:31.622 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:31.622 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:31.622 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:31.622 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/fast/fast.yaml").st_ino) 2024-03-12T17:27:31.622 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:31.815 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629226 2024-03-12T17:27:31.996 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:31.996 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:31.996 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:31.997 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:31.997 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/leveldb.yaml").st_ino) 2024-03-12T17:27:31.997 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:32.190 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629228 2024-03-12T17:27:32.370 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:32.370 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:32.370 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:32.370 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:32.370 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/clusters").st_ino) 2024-03-12T17:27:32.370 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:32.567 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629224 2024-03-12T17:27:32.747 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:32.747 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:32.748 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:32.748 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:32.748 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/msgr-failures").st_ino) 2024-03-12T17:27:32.748 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:32.943 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629229 2024-03-12T17:27:33.126 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:33.127 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:33.127 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:33.127 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:33.127 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/objectstore").st_ino) 2024-03-12T17:27:33.127 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:33.327 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629230 2024-03-12T17:27:33.508 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:33.508 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:33.508 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:33.508 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:33.509 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/fs").st_ino) 2024-03-12T17:27:33.509 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:33.717 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629227 2024-03-12T17:27:33.897 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:33.897 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:33.898 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:33.898 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:33.898 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads").st_ino) 2024-03-12T17:27:33.898 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:34.092 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629234 2024-03-12T17:27:34.272 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:34.272 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:34.272 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:34.273 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:34.273 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-small-objects-fast-read-overwrites.yaml").st_ino) 2024-03-12T17:27:34.273 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:34.466 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628119 2024-03-12T17:27:34.647 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:34.647 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:34.647 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:34.648 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:34.648 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-small-objects-overwrites.yaml").st_ino) 2024-03-12T17:27:34.648 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:34.843 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628121 2024-03-12T17:27:35.024 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:35.024 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:35.024 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:35.024 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:35.025 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-rados-plugin=jerasure-k=3-m=1.yaml").st_ino) 2024-03-12T17:27:35.025 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:35.218 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629237 2024-03-12T17:27:35.399 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:35.399 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:35.399 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:35.399 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:35.399 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-snaps-few-objects-overwrites.yaml").st_ino) 2024-03-12T17:27:35.399 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:35.593 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628123 2024-03-12T17:27:35.774 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:35.774 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:35.774 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:35.774 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:35.774 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-radosbench.yaml").st_ino) 2024-03-12T17:27:35.774 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:35.968 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628118 2024-03-12T17:27:36.149 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:36.149 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:36.149 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:36.149 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:36.149 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-rados-plugin=jerasure-k=2-m=1.yaml").st_ino) 2024-03-12T17:27:36.150 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:36.343 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629236 2024-03-12T17:27:36.524 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:36.524 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:36.524 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:36.524 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:36.524 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-small-objects.yaml").st_ino) 2024-03-12T17:27:36.524 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:36.709 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628122 2024-03-12T17:27:36.890 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:36.891 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:36.891 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:36.891 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:36.891 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-small-objects-fast-read.yaml").st_ino) 2024-03-12T17:27:36.891 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:37.085 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628120 2024-03-12T17:27:37.267 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:37.267 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:37.267 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:37.267 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:37.267 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/workloads/ec-pool-snaps-few-objects-overwrites.yaml").st_ino) 2024-03-12T17:27:37.267 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:37.460 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629235 2024-03-12T17:27:37.640 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:37.640 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:37.640 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:37.641 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:37.641 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/%").st_ino) 2024-03-12T17:27:37.641 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:37.828 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629223 2024-03-12T17:27:38.009 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:38.009 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:38.009 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:38.009 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:38.009 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/thrashers").st_ino) 2024-03-12T17:27:38.009 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:38.202 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629232 2024-03-12T17:27:38.384 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:38.384 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:38.384 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:38.384 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:38.384 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/thrashers/default.yaml").st_ino) 2024-03-12T17:27:38.384 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:38.577 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629233 2024-03-12T17:27:38.759 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:38.759 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:38.759 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:38.759 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:38.760 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/thrashers/fastread.yaml").st_ino) 2024-03-12T17:27:38.760 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:38.958 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628114 2024-03-12T17:27:39.138 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:39.138 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:39.138 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:39.138 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:39.138 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/thrashers/morepggrow.yaml").st_ino) 2024-03-12T17:27:39.138 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:39.330 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628116 2024-03-12T17:27:39.511 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:39.512 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:39.512 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:39.512 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:39.512 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/thrashers/pggrow.yaml").st_ino) 2024-03-12T17:27:39.512 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:39.708 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628117 2024-03-12T17:27:39.890 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:39.890 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:39.890 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:39.890 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:39.890 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/thrashers/mapgap.yaml").st_ino) 2024-03-12T17:27:39.890 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:40.083 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628115 2024-03-12T17:27:40.263 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:40.264 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:40.264 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:40.264 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:40.264 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code/rados.yaml").st_ino) 2024-03-12T17:27:40.264 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:40.458 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629231 2024-03-12T17:27:40.639 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:40.640 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:40.640 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:40.640 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:40.640 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton-nomsgr").st_ino) 2024-03-12T17:27:40.640 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:40.829 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629164 2024-03-12T17:27:41.010 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:41.010 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:41.010 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:41.010 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:41.010 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton-nomsgr/%").st_ino) 2024-03-12T17:27:41.010 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:41.190 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629165 2024-03-12T17:27:41.370 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:41.370 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:41.370 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:41.371 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:41.371 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton-nomsgr/all").st_ino) 2024-03-12T17:27:41.371 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:41.551 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629166 2024-03-12T17:27:41.732 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:41.732 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:41.732 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:41.732 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:41.733 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton-nomsgr/all/multi-backfill-reject.yaml").st_ino) 2024-03-12T17:27:41.733 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:41.925 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628079 2024-03-12T17:27:42.106 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:42.106 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:42.107 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:42.107 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:42.107 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton-nomsgr/all/full-tiering.yaml").st_ino) 2024-03-12T17:27:42.107 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:42.303 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628077 2024-03-12T17:27:42.484 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:42.484 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:42.484 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:42.484 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:42.484 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton-nomsgr/all/cache-fs-trunc.yaml").st_ino) 2024-03-12T17:27:42.484 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:42.676 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629167 2024-03-12T17:27:42.857 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:42.857 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:42.857 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:42.857 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:42.857 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton-nomsgr/all/msgr.yaml").st_ino) 2024-03-12T17:27:42.858 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:43.057 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628078 2024-03-12T17:27:43.097 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:27:43.106 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:27:43.236 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:43.237 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:43.237 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:43.237 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:43.237 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton-nomsgr/all/ceph-post-file.yaml").st_ino) 2024-03-12T17:27:43.237 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:43.385 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628075 2024-03-12T17:27:43.565 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:43.565 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:43.565 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:43.566 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:43.566 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton-nomsgr/all/export-after-evict.yaml").st_ino) 2024-03-12T17:27:43.566 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:43.718 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628076 2024-03-12T17:27:43.899 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:43.899 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:43.899 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:43.899 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:43.899 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton-nomsgr/all/valgrind-leaks.yaml").st_ino) 2024-03-12T17:27:43.899 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:44.093 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628080 2024-03-12T17:27:44.274 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:44.274 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:44.274 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:44.274 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:44.274 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/singleton-nomsgr/rados.yaml").st_ino) 2024-03-12T17:27:44.274 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:44.467 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629168 2024-03-12T17:27:44.648 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:44.648 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:44.648 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:44.648 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:44.648 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade").st_ino) 2024-03-12T17:27:44.648 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:44.843 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629263 2024-03-12T17:27:45.023 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:45.023 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:45.023 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:45.023 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:45.023 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton").st_ino) 2024-03-12T17:27:45.023 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:45.216 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629264 2024-03-12T17:27:45.397 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:45.397 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:45.397 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:45.397 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:45.397 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/6-next-mon").st_ino) 2024-03-12T17:27:45.397 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:45.591 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629278 2024-03-12T17:27:45.772 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:45.772 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:45.772 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:45.772 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:45.773 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/6-next-mon/monb.yaml").st_ino) 2024-03-12T17:27:45.773 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:45.966 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629279 2024-03-12T17:27:46.147 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:46.147 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:46.147 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:46.147 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:46.147 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/8-next-mon").st_ino) 2024-03-12T17:27:46.147 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:46.341 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629281 2024-03-12T17:27:46.522 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:46.522 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:46.522 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:46.522 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:46.522 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/8-next-mon/monc.yaml").st_ino) 2024-03-12T17:27:46.523 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:46.719 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629282 2024-03-12T17:27:46.899 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:46.899 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:46.900 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:46.900 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:46.900 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/1-jewel-install").st_ino) 2024-03-12T17:27:46.900 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:47.091 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629268 2024-03-12T17:27:47.272 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:47.273 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:47.273 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:47.273 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:47.273 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/1-jewel-install/jewel.yaml").st_ino) 2024-03-12T17:27:47.273 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:47.466 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629269 2024-03-12T17:27:47.648 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:47.648 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:47.648 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:47.648 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:47.648 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/5-workload").st_ino) 2024-03-12T17:27:47.648 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:47.852 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629276 2024-03-12T17:27:48.032 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:48.032 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:48.032 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:48.032 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:48.032 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/5-workload/readwrite.yaml").st_ino) 2024-03-12T17:27:48.032 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:48.224 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628147 2024-03-12T17:27:48.404 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:48.405 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:48.405 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:48.405 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:48.405 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/5-workload/snaps-few-objects.yaml").st_ino) 2024-03-12T17:27:48.405 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:48.596 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628148 2024-03-12T17:27:48.777 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:48.777 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:48.777 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:48.777 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:48.777 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/5-workload/rbd-cls.yaml").st_ino) 2024-03-12T17:27:48.777 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:48.971 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628145 2024-03-12T17:27:49.151 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:49.152 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:49.152 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:49.152 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:49.152 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/5-workload/rbd-import-export.yaml").st_ino) 2024-03-12T17:27:49.152 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:49.331 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628146 2024-03-12T17:27:49.512 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:49.512 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:49.512 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:49.512 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:49.512 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/5-workload/+").st_ino) 2024-03-12T17:27:49.512 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:49.704 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629277 2024-03-12T17:27:49.885 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:49.885 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:49.885 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:49.885 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:49.885 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/4-mon").st_ino) 2024-03-12T17:27:49.885 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:50.077 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629274 2024-03-12T17:27:50.257 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:50.257 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:50.258 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:50.258 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:50.258 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/4-mon/mona.yaml").st_ino) 2024-03-12T17:27:50.258 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:50.449 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629275 2024-03-12T17:27:50.631 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:50.631 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:50.631 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:50.631 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:50.631 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/%").st_ino) 2024-03-12T17:27:50.631 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:50.831 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629265 2024-03-12T17:27:51.012 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:51.012 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:51.012 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:51.012 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:51.012 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/9-workload").st_ino) 2024-03-12T17:27:51.012 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:51.206 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629283 2024-03-12T17:27:51.387 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:51.387 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:51.387 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:51.387 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:51.387 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/9-workload/rbd-python.yaml").st_ino) 2024-03-12T17:27:51.387 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:51.581 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628151 2024-03-12T17:27:51.761 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:51.762 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:51.762 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:51.762 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:51.762 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/9-workload/rgw-swift.yaml").st_ino) 2024-03-12T17:27:51.762 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:51.954 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628152 2024-03-12T17:27:52.136 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:52.136 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:52.137 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:52.137 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:52.137 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/9-workload/snaps-many-objects.yaml").st_ino) 2024-03-12T17:27:52.137 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:52.329 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628153 2024-03-12T17:27:52.510 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:52.510 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:52.510 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:52.510 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:52.510 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/9-workload/+").st_ino) 2024-03-12T17:27:52.510 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:52.704 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629284 2024-03-12T17:27:52.885 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:52.885 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:52.885 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:52.886 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:52.886 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/2-partial-upgrade").st_ino) 2024-03-12T17:27:52.886 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:53.078 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629270 2024-03-12T17:27:53.259 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:53.259 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:53.259 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:53.259 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:53.259 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/2-partial-upgrade/firsthalf.yaml").st_ino) 2024-03-12T17:27:53.259 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:53.451 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629271 2024-03-12T17:27:53.633 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:53.633 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:53.633 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:53.633 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:53.633 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/3-thrash").st_ino) 2024-03-12T17:27:53.633 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:53.827 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629272 2024-03-12T17:27:54.010 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:54.010 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:54.010 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:54.010 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:54.010 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/3-thrash/default.yaml").st_ino) 2024-03-12T17:27:54.010 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:54.203 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629273 2024-03-12T17:27:54.384 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:54.385 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:54.385 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:54.385 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:54.385 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/7-workload").st_ino) 2024-03-12T17:27:54.385 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:54.573 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629781 2024-03-12T17:27:54.754 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:54.754 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:54.754 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:54.754 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:54.754 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/7-workload/radosbench.yaml").st_ino) 2024-03-12T17:27:54.754 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:54.949 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628149 2024-03-12T17:27:55.130 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:55.130 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:55.130 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:55.130 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:55.130 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/7-workload/rbd_api.yaml").st_ino) 2024-03-12T17:27:55.130 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:55.308 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628150 2024-03-12T17:27:55.489 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:55.489 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:55.489 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:55.489 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:55.489 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/7-workload/+").st_ino) 2024-03-12T17:27:55.490 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:55.684 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629280 2024-03-12T17:27:55.865 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:55.865 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:55.865 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:55.865 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:55.865 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/0-cluster").st_ino) 2024-03-12T17:27:55.865 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:56.060 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629266 2024-03-12T17:27:56.240 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:56.240 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:56.241 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:56.241 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:56.241 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/0-cluster/openstack.yaml").st_ino) 2024-03-12T17:27:56.241 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:56.435 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628143 2024-03-12T17:27:56.617 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:56.617 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:56.617 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:56.617 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:56.617 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/0-cluster/+").st_ino) 2024-03-12T17:27:56.617 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:56.812 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629267 2024-03-12T17:27:56.993 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:56.993 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:56.993 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:56.993 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:56.993 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/upgrade/jewel-x-singleton/0-cluster/start.yaml").st_ino) 2024-03-12T17:27:56.993 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:57.184 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628144 2024-03-12T17:27:57.366 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:57.366 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:57.366 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:57.366 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:57.366 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash").st_ino) 2024-03-12T17:27:57.366 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:57.552 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629130 2024-03-12T17:27:57.733 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:57.733 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:57.733 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:57.733 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:57.733 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/msgr").st_ino) 2024-03-12T17:27:57.734 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:57.931 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629139 2024-03-12T17:27:58.112 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:58.112 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:58.112 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:58.112 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:58.112 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/clusters").st_ino) 2024-03-12T17:27:58.113 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:58.310 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629134 2024-03-12T17:27:58.488 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:58.488 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:58.488 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:58.488 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:58.488 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/clusters/3-mons.yaml").st_ino) 2024-03-12T17:27:58.488 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:58.684 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629135 2024-03-12T17:27:58.865 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:58.866 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:58.866 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:58.866 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:58.866 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/clusters/9-mons.yaml").st_ino) 2024-03-12T17:27:58.866 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:59.059 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628051 2024-03-12T17:27:59.240 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:59.240 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:59.240 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:59.240 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:59.240 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/msgr-failures").st_ino) 2024-03-12T17:27:59.240 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:59.430 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629140 2024-03-12T17:27:59.613 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:59.613 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:59.613 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:59.613 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:59.613 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/msgr-failures/mon-delay.yaml").st_ino) 2024-03-12T17:27:59.613 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:27:59.809 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628052 2024-03-12T17:27:59.990 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:27:59.990 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:27:59.990 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:27:59.990 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:27:59.990 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/msgr-failures/few.yaml").st_ino) 2024-03-12T17:27:59.990 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:00.184 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629141 2024-03-12T17:28:00.364 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:00.365 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:00.365 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:00.365 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:00.365 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/objectstore").st_ino) 2024-03-12T17:28:00.365 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:00.558 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629142 2024-03-12T17:28:00.739 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:00.739 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:00.739 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:00.739 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:00.739 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/fs").st_ino) 2024-03-12T17:28:00.739 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:00.935 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629136 2024-03-12T17:28:01.115 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:01.115 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:01.116 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:01.116 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:01.116 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/fs/xfs.yaml").st_ino) 2024-03-12T17:28:01.116 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:01.314 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629137 2024-03-12T17:28:01.495 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:01.495 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:01.495 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:01.495 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:01.495 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/workloads").st_ino) 2024-03-12T17:28:01.495 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:01.687 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629146 2024-03-12T17:28:01.868 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:01.868 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:01.868 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:01.868 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:01.869 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/workloads/pool-create-delete.yaml").st_ino) 2024-03-12T17:28:01.869 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:02.063 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629147 2024-03-12T17:28:02.243 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:02.244 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:02.244 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:02.244 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:02.244 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/workloads/snaps-few-objects.yaml").st_ino) 2024-03-12T17:28:02.244 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:02.443 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628060 2024-03-12T17:28:02.624 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:02.624 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:02.624 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:02.624 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:02.624 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/workloads/rados_mon_workunits.yaml").st_ino) 2024-03-12T17:28:02.624 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:02.821 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628059 2024-03-12T17:28:03.002 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:03.002 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:03.002 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:03.002 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:03.002 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/workloads/rados_5925.yaml").st_ino) 2024-03-12T17:28:03.002 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:03.194 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628057 2024-03-12T17:28:03.373 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:03.374 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:03.374 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:03.374 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:03.374 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/workloads/rados_api_tests.yaml").st_ino) 2024-03-12T17:28:03.374 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:03.566 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628058 2024-03-12T17:28:03.747 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:03.747 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:03.747 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:03.747 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:03.747 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/ceph").st_ino) 2024-03-12T17:28:03.747 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:03.937 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629132 2024-03-12T17:28:04.119 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:04.119 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:04.119 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:04.119 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:04.119 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/ceph/ceph.yaml").st_ino) 2024-03-12T17:28:04.119 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:04.311 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629133 2024-03-12T17:28:04.493 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:04.493 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:04.493 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:04.493 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:04.493 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/%").st_ino) 2024-03-12T17:28:04.493 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:04.687 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629131 2024-03-12T17:28:04.868 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:04.868 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:04.868 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:04.868 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:04.868 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/mon_kv_backend").st_ino) 2024-03-12T17:28:04.868 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:05.052 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629138 2024-03-12T17:28:05.236 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:05.236 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:05.236 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:05.236 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:05.236 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/thrashers").st_ino) 2024-03-12T17:28:05.236 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:05.431 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629144 2024-03-12T17:28:05.612 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:05.612 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:05.612 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:05.612 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:05.612 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/thrashers/many.yaml").st_ino) 2024-03-12T17:28:05.612 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:05.807 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628053 2024-03-12T17:28:05.989 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:05.989 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:05.989 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:05.989 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:05.989 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/thrashers/one.yaml").st_ino) 2024-03-12T17:28:05.989 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:06.181 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628054 2024-03-12T17:28:06.363 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:06.363 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:06.363 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:06.363 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:06.364 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/thrashers/sync.yaml").st_ino) 2024-03-12T17:28:06.364 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:06.555 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628056 2024-03-12T17:28:06.736 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:06.737 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:06.737 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:06.737 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:06.737 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/thrashers/sync-many.yaml").st_ino) 2024-03-12T17:28:06.737 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:06.927 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628055 2024-03-12T17:28:07.109 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:07.109 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:07.109 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:07.109 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:07.109 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/thrashers/force-sync-many.yaml").st_ino) 2024-03-12T17:28:07.109 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:07.301 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629145 2024-03-12T17:28:07.481 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:07.481 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:07.481 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:07.481 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:07.481 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/monthrash/rados.yaml").st_ino) 2024-03-12T17:28:07.481 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:07.673 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629143 2024-03-12T17:28:07.854 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:07.854 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:07.855 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:07.855 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:07.855 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash").st_ino) 2024-03-12T17:28:07.855 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:08.046 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629238 2024-03-12T17:28:08.227 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:08.227 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:08.227 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:08.227 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:08.227 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/msgr").st_ino) 2024-03-12T17:28:08.227 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:08.421 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629253 2024-03-12T17:28:08.603 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:08.603 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:08.603 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:08.603 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:08.603 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/clusters").st_ino) 2024-03-12T17:28:08.603 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:08.795 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629247 2024-03-12T17:28:08.975 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:08.975 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:08.975 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:08.976 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:08.976 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/clusters/openstack.yaml").st_ino) 2024-03-12T17:28:08.976 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:09.168 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628124 2024-03-12T17:28:09.350 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:09.350 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:09.350 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:09.350 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:09.350 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/clusters/fixed-2.yaml").st_ino) 2024-03-12T17:28:09.350 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:09.544 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629249 2024-03-12T17:28:09.725 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:09.725 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:09.725 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:09.725 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:09.725 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/clusters/+").st_ino) 2024-03-12T17:28:09.725 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:09.918 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629248 2024-03-12T17:28:10.099 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:10.099 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:10.100 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:10.100 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:10.100 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/1-pg-log-overrides").st_ino) 2024-03-12T17:28:10.100 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:10.294 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629244 2024-03-12T17:28:10.475 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:10.475 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:10.475 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:10.475 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:10.475 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/1-pg-log-overrides/normal_pg_log.yaml").st_ino) 2024-03-12T17:28:10.475 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:10.670 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629245 2024-03-12T17:28:10.851 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:10.851 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:10.851 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:10.851 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:10.851 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/1-pg-log-overrides/short_pg_log.yaml").st_ino) 2024-03-12T17:28:10.851 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:11.044 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629246 2024-03-12T17:28:11.225 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:11.225 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:11.225 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:11.225 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:11.225 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/msgr-failures").st_ino) 2024-03-12T17:28:11.225 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:11.420 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629254 2024-03-12T17:28:11.601 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:11.601 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:11.601 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:11.601 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:11.602 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/msgr-failures/few.yaml").st_ino) 2024-03-12T17:28:11.602 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:11.796 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628126 2024-03-12T17:28:11.976 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:11.976 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:11.976 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:11.976 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:11.976 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/msgr-failures/fastclose.yaml").st_ino) 2024-03-12T17:28:11.977 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:12.172 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629255 2024-03-12T17:28:12.353 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:12.353 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:12.353 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:12.353 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:12.354 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/msgr-failures/osd-delay.yaml").st_ino) 2024-03-12T17:28:12.354 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:12.545 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628127 2024-03-12T17:28:12.726 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:12.726 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:12.726 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:12.726 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:12.726 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/0-size-min-size-overrides").st_ino) 2024-03-12T17:28:12.727 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:12.930 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629240 2024-03-12T17:28:13.111 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:13.111 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:13.111 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:13.111 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:13.111 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/0-size-min-size-overrides/3-size-2-min-size.yaml").st_ino) 2024-03-12T17:28:13.111 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:13.246 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:28:13.255 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:28:13.302 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629243 2024-03-12T17:28:13.488 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:13.489 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:13.489 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:13.489 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:13.489 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/0-size-min-size-overrides/2-size-2-min-size.yaml").st_ino) 2024-03-12T17:28:13.489 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:13.640 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629242 2024-03-12T17:28:13.822 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:13.822 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:13.822 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:13.822 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:13.822 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/0-size-min-size-overrides/2-size-1-min-size.yaml").st_ino) 2024-03-12T17:28:13.822 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:14.018 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629241 2024-03-12T17:28:14.198 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:14.198 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:14.199 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:14.199 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:14.199 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/objectstore").st_ino) 2024-03-12T17:28:14.199 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:14.393 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629256 2024-03-12T17:28:14.575 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:14.575 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:14.575 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:14.575 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:14.575 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/fs").st_ino) 2024-03-12T17:28:14.575 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:14.767 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629250 2024-03-12T17:28:14.948 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:14.948 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:14.948 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:14.948 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:14.948 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/fs/btrfs.yaml").st_ino) 2024-03-12T17:28:14.948 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:15.136 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629251 2024-03-12T17:28:15.317 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:15.317 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:15.317 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:15.317 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:15.317 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/fs/xfs.yaml").st_ino) 2024-03-12T17:28:15.318 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:15.508 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629252 2024-03-12T17:28:15.689 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:15.689 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:15.689 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:15.690 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:15.690 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads").st_ino) 2024-03-12T17:28:15.690 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:15.885 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629261 2024-03-12T17:28:16.066 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:16.066 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:16.066 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:16.066 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:16.066 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads/radosbench.yaml").st_ino) 2024-03-12T17:28:16.066 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:16.259 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628139 2024-03-12T17:28:16.441 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:16.441 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:16.441 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:16.441 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:16.441 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads/cache-agent-big.yaml").st_ino) 2024-03-12T17:28:16.441 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:16.638 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628131 2024-03-12T17:28:16.820 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:16.820 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:16.820 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:16.820 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:16.820 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads/cache.yaml").st_ino) 2024-03-12T17:28:16.820 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:17.025 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628136 2024-03-12T17:28:17.205 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:17.205 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:17.205 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:17.205 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:17.205 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads/cache-agent-small.yaml").st_ino) 2024-03-12T17:28:17.205 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:17.396 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628132 2024-03-12T17:28:17.576 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:17.577 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:17.577 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:17.577 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:17.577 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads/snaps-few-objects.yaml").st_ino) 2024-03-12T17:28:17.577 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:17.771 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628141 2024-03-12T17:28:17.950 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:17.950 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:17.950 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:17.950 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:17.950 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads/write_fadvise_dontneed.yaml").st_ino) 2024-03-12T17:28:17.950 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:18.146 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628142 2024-03-12T17:28:18.327 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:18.327 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:18.327 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:18.327 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:18.327 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads/cache-pool-snaps.yaml").st_ino) 2024-03-12T17:28:18.327 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:18.521 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628134 2024-03-12T17:28:18.701 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:18.702 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:18.702 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:18.702 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:18.702 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads/admin_socket_objecter_requests.yaml").st_ino) 2024-03-12T17:28:18.702 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:18.896 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629262 2024-03-12T17:28:19.077 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:19.077 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:19.078 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:19.078 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:19.078 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads/cache-pool-snaps-readproxy.yaml").st_ino) 2024-03-12T17:28:19.078 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:19.269 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628133 2024-03-12T17:28:19.451 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:19.451 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:19.451 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:19.451 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:19.451 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads/cache-snaps.yaml").st_ino) 2024-03-12T17:28:19.451 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:19.646 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628135 2024-03-12T17:28:19.827 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:19.827 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:19.827 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:19.827 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:19.827 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads/pool-snaps-few-objects.yaml").st_ino) 2024-03-12T17:28:19.827 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:20.021 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628137 2024-03-12T17:28:20.206 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:20.206 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:20.206 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:20.206 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:20.206 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads/rados_api_tests.yaml").st_ino) 2024-03-12T17:28:20.206 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:20.398 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628138 2024-03-12T17:28:20.580 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:20.580 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:20.580 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:20.580 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:20.580 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/workloads/small-objects.yaml").st_ino) 2024-03-12T17:28:20.580 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:20.776 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628140 2024-03-12T17:28:20.957 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:20.957 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:20.957 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:20.957 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:20.957 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/hobj-sort.yaml").st_ino) 2024-03-12T17:28:20.957 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:21.151 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628125 2024-03-12T17:28:21.334 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:21.334 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:21.334 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:21.334 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:21.334 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/%").st_ino) 2024-03-12T17:28:21.334 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:21.528 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629239 2024-03-12T17:28:21.708 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:21.708 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:21.708 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:21.708 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:21.709 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/thrashers").st_ino) 2024-03-12T17:28:21.709 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:21.900 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629259 2024-03-12T17:28:22.082 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:22.082 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:22.082 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:22.082 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:22.082 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/thrashers/default.yaml").st_ino) 2024-03-12T17:28:22.082 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:22.274 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629260 2024-03-12T17:28:22.454 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:22.454 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:22.454 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:22.454 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:22.454 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/thrashers/morepggrow.yaml").st_ino) 2024-03-12T17:28:22.455 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:22.649 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628129 2024-03-12T17:28:22.828 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:22.828 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:22.828 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:22.828 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:22.828 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/thrashers/pggrow.yaml").st_ino) 2024-03-12T17:28:22.828 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:23.021 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628130 2024-03-12T17:28:23.203 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:23.203 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:23.203 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:23.203 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:23.203 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/thrashers/mapgap.yaml").st_ino) 2024-03-12T17:28:23.203 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:23.392 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628128 2024-03-12T17:28:23.573 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:23.573 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:23.573 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:23.573 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:23.573 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/rocksdb.yaml").st_ino) 2024-03-12T17:28:23.573 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:23.767 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629258 2024-03-12T17:28:23.948 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:23.948 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:23.948 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:23.948 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:23.948 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash/rados.yaml").st_ino) 2024-03-12T17:28:23.948 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:24.142 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629257 2024-03-12T17:28:24.323 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:24.323 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:24.323 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:24.323 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:24.323 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify").st_ino) 2024-03-12T17:28:24.323 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:24.520 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629285 2024-03-12T17:28:24.700 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:24.701 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:24.701 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:24.701 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:24.701 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/msgr").st_ino) 2024-03-12T17:28:24.701 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:24.896 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629295 2024-03-12T17:28:25.077 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:25.077 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:25.077 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:25.077 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:25.077 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/validater").st_ino) 2024-03-12T17:28:25.077 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:25.270 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629302 2024-03-12T17:28:25.451 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:25.451 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:25.451 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:25.451 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:25.452 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/validater/valgrind.yaml").st_ino) 2024-03-12T17:28:25.452 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:25.647 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628158 2024-03-12T17:28:25.829 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:25.829 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:25.829 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:25.829 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:25.829 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/validater/lockdep.yaml").st_ino) 2024-03-12T17:28:25.829 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:26.024 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629303 2024-03-12T17:28:26.205 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:26.205 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:26.205 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:26.205 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:26.205 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/clusters").st_ino) 2024-03-12T17:28:26.205 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:26.389 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629289 2024-03-12T17:28:26.570 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:26.571 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:26.571 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:26.571 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:26.571 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/clusters/openstack.yaml").st_ino) 2024-03-12T17:28:26.571 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:26.763 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628155 2024-03-12T17:28:26.946 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:26.946 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:26.946 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:26.946 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:26.946 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/clusters/fixed-2.yaml").st_ino) 2024-03-12T17:28:26.946 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:27.140 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629291 2024-03-12T17:28:27.322 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:27.322 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:27.322 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:27.322 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:27.323 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/clusters/+").st_ino) 2024-03-12T17:28:27.323 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:27.515 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629290 2024-03-12T17:28:27.695 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:27.695 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:27.696 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:27.696 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:27.696 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/msgr-failures").st_ino) 2024-03-12T17:28:27.696 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:27.891 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629296 2024-03-12T17:28:28.072 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:28.072 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:28.073 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:28.073 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:28.073 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/msgr-failures/few.yaml").st_ino) 2024-03-12T17:28:28.073 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:28.265 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629297 2024-03-12T17:28:28.447 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:28.447 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:28.447 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:28.466 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:28.466 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/objectstore").st_ino) 2024-03-12T17:28:28.466 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:28.633 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629298 2024-03-12T17:28:28.813 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:28.813 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:28.813 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:28.813 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:28.813 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/fs").st_ino) 2024-03-12T17:28:28.813 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:29.007 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629292 2024-03-12T17:28:29.189 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:29.189 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:29.189 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:29.189 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:29.189 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/fs/btrfs.yaml").st_ino) 2024-03-12T17:28:29.189 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:29.385 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629293 2024-03-12T17:28:29.566 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:29.566 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:29.567 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:29.567 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:29.567 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/1thrash").st_ino) 2024-03-12T17:28:29.567 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:29.764 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629287 2024-03-12T17:28:29.945 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:29.945 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:29.945 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:29.945 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:29.945 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/1thrash/default.yaml").st_ino) 2024-03-12T17:28:29.945 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:30.140 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629288 2024-03-12T17:28:30.321 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:30.321 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:30.322 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:30.322 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:30.322 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/1thrash/none.yaml").st_ino) 2024-03-12T17:28:30.322 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:30.517 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628154 2024-03-12T17:28:30.698 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:30.699 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:30.699 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:30.699 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:30.699 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/%").st_ino) 2024-03-12T17:28:30.699 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:30.889 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629286 2024-03-12T17:28:31.071 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:31.072 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:31.072 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:31.072 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:31.072 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/mon_kv_backend").st_ino) 2024-03-12T17:28:31.072 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:31.267 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629294 2024-03-12T17:28:31.448 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:31.448 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:31.448 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:31.448 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:31.448 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/tasks").st_ino) 2024-03-12T17:28:31.448 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:31.644 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629300 2024-03-12T17:28:31.825 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:31.825 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:31.825 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:31.825 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:31.825 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/tasks/rados_cls_all.yaml").st_ino) 2024-03-12T17:28:31.825 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:32.023 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628157 2024-03-12T17:28:32.203 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:32.203 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:32.203 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:32.203 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:32.203 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/tasks/mon_recovery.yaml").st_ino) 2024-03-12T17:28:32.203 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:32.397 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629301 2024-03-12T17:28:32.577 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:32.577 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:32.577 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:32.577 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:32.577 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/tasks/rados_api_tests.yaml").st_ino) 2024-03-12T17:28:32.578 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:32.771 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628156 2024-03-12T17:28:32.952 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:32.952 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:32.952 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:32.953 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:32.953 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/verify/rados.yaml").st_ino) 2024-03-12T17:28:32.953 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:33.142 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629299 2024-03-12T17:28:33.323 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:33.324 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:33.324 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:33.324 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:33.324 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon").st_ino) 2024-03-12T17:28:33.324 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:33.516 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629148 2024-03-12T17:28:33.696 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:33.696 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:33.696 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:33.696 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:33.696 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/msgr").st_ino) 2024-03-12T17:28:33.696 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:33.890 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629155 2024-03-12T17:28:34.071 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:34.071 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:34.071 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:34.071 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:34.071 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/clusters").st_ino) 2024-03-12T17:28:34.071 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:34.267 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629150 2024-03-12T17:28:34.448 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:34.448 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:34.448 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:34.448 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:34.448 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/clusters/21.yaml").st_ino) 2024-03-12T17:28:34.448 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:34.643 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629151 2024-03-12T17:28:34.824 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:34.825 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:34.825 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:34.825 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:34.825 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/clusters/9.yaml").st_ino) 2024-03-12T17:28:34.825 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:35.016 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628063 2024-03-12T17:28:35.198 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:35.198 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:35.198 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:35.198 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:35.198 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/clusters/3.yaml").st_ino) 2024-03-12T17:28:35.198 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:35.391 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628061 2024-03-12T17:28:35.572 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:35.572 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:35.572 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:35.572 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:35.572 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/clusters/6.yaml").st_ino) 2024-03-12T17:28:35.572 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:35.770 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628062 2024-03-12T17:28:35.950 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:35.950 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:35.950 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:35.950 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:35.950 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/msgr-failures").st_ino) 2024-03-12T17:28:35.950 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:36.143 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629156 2024-03-12T17:28:36.324 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:36.324 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:36.324 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:36.324 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:36.324 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/msgr-failures/many.yaml").st_ino) 2024-03-12T17:28:36.324 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:36.515 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628064 2024-03-12T17:28:36.697 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:36.697 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:36.697 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:36.698 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:36.698 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/msgr-failures/few.yaml").st_ino) 2024-03-12T17:28:36.698 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:36.890 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629157 2024-03-12T17:28:37.071 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:37.071 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:37.071 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:37.071 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:37.072 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/objectstore").st_ino) 2024-03-12T17:28:37.072 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:37.262 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629158 2024-03-12T17:28:37.448 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:37.448 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:37.448 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:37.448 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:37.448 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/fs").st_ino) 2024-03-12T17:28:37.448 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:37.642 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629152 2024-03-12T17:28:37.822 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:37.822 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:37.822 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:37.822 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:37.822 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/fs/xfs.yaml").st_ino) 2024-03-12T17:28:37.823 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:38.016 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629153 2024-03-12T17:28:38.197 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:38.197 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:38.197 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:38.198 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:38.198 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/%").st_ino) 2024-03-12T17:28:38.198 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:38.388 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629149 2024-03-12T17:28:38.569 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:38.569 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:38.569 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:38.569 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:38.569 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/mon_kv_backend").st_ino) 2024-03-12T17:28:38.569 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:38.766 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629154 2024-03-12T17:28:38.946 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:38.946 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:38.947 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:38.947 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:38.947 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/tasks").st_ino) 2024-03-12T17:28:38.947 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:39.139 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629160 2024-03-12T17:28:39.321 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:39.321 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:39.321 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:39.321 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:39.321 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/tasks/mon_clock_with_skews.yaml").st_ino) 2024-03-12T17:28:39.321 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:39.503 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628065 2024-03-12T17:28:39.684 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:39.684 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:39.684 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:39.684 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:39.684 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/tasks/mon_recovery.yaml").st_ino) 2024-03-12T17:28:39.684 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:39.879 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628066 2024-03-12T17:28:40.060 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:40.060 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:40.060 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:40.060 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:40.060 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/tasks/mon_clock_no_skews.yaml").st_ino) 2024-03-12T17:28:40.060 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:40.264 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629161 2024-03-12T17:28:40.446 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:40.446 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:40.446 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:40.446 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:40.446 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/multimon/rados.yaml").st_ino) 2024-03-12T17:28:40.446 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:40.639 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629159 2024-03-12T17:28:40.820 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:40.821 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:40.821 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:40.821 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:40.821 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa").st_ino) 2024-03-12T17:28:40.821 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:41.024 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629193 2024-03-12T17:28:41.207 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:41.207 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:41.207 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:41.207 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:41.207 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/leveldb.yaml").st_ino) 2024-03-12T17:28:41.207 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:41.400 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629199 2024-03-12T17:28:41.581 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:41.581 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:41.581 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:41.581 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:41.582 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/clusters").st_ino) 2024-03-12T17:28:41.582 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:41.774 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629197 2024-03-12T17:28:41.955 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:41.955 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:41.955 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:41.955 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:41.956 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/msgr-failures").st_ino) 2024-03-12T17:28:41.956 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:42.149 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629200 2024-03-12T17:28:42.331 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:42.331 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:42.331 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:42.331 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:42.331 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/objectstore").st_ino) 2024-03-12T17:28:42.331 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:42.524 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629201 2024-03-12T17:28:42.706 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:42.706 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:42.706 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:42.706 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:42.706 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/supported").st_ino) 2024-03-12T17:28:42.706 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:42.902 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629203 2024-03-12T17:28:43.083 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:43.083 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:43.083 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:43.084 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:43.084 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/fs").st_ino) 2024-03-12T17:28:43.084 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:43.279 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629198 2024-03-12T17:28:43.401 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:28:43.410 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:28:43.460 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:43.460 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:43.461 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:43.461 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:43.461 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/workloads").st_ino) 2024-03-12T17:28:43.461 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:43.597 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629205 2024-03-12T17:28:43.777 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:43.778 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:43.778 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:43.778 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:43.778 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/workloads/ec-rados-plugin=isa-k=2-m=1.yaml").st_ino) 2024-03-12T17:28:43.778 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:43.928 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629206 2024-03-12T17:28:44.110 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:44.110 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:44.110 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:44.110 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:44.110 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/arch").st_ino) 2024-03-12T17:28:44.110 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:44.304 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629195 2024-03-12T17:28:44.486 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:44.486 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:44.486 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:44.486 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:44.486 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/arch/x86_64.yaml").st_ino) 2024-03-12T17:28:44.486 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:44.680 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629196 2024-03-12T17:28:44.861 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:44.861 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:44.861 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:44.861 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:44.861 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/%").st_ino) 2024-03-12T17:28:44.861 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:45.054 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629194 2024-03-12T17:28:45.238 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:45.238 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:45.239 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:45.239 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:45.239 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/thrashers").st_ino) 2024-03-12T17:28:45.239 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:45.414 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629204 2024-03-12T17:28:45.595 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:45.595 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:45.595 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:45.595 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:45.595 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-isa/rados.yaml").st_ino) 2024-03-12T17:28:45.595 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:45.790 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629202 2024-03-12T17:28:45.969 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:45.969 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:45.970 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:45.970 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:45.970 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big").st_ino) 2024-03-12T17:28:45.970 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:46.165 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629180 2024-03-12T17:28:46.346 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:46.347 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:46.347 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:46.347 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:46.347 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/cluster").st_ino) 2024-03-12T17:28:46.347 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:46.538 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629182 2024-03-12T17:28:46.720 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:46.720 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:46.720 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:46.720 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:46.720 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/cluster/openstack.yaml").st_ino) 2024-03-12T17:28:46.721 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:46.915 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628107 2024-03-12T17:28:47.096 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:47.097 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:47.097 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:47.097 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:47.097 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/cluster/12-osds.yaml").st_ino) 2024-03-12T17:28:47.097 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:47.289 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628106 2024-03-12T17:28:47.469 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:47.469 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:47.469 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:47.469 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:47.469 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/cluster/+").st_ino) 2024-03-12T17:28:47.469 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:47.661 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629183 2024-03-12T17:28:47.842 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:47.843 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:47.843 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:47.843 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:47.843 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/leveldb.yaml").st_ino) 2024-03-12T17:28:47.843 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:48.034 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629185 2024-03-12T17:28:48.215 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:48.215 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:48.215 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:48.215 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:48.215 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/msgr-failures").st_ino) 2024-03-12T17:28:48.215 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:48.407 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629186 2024-03-12T17:28:48.589 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:48.589 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:48.589 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:48.589 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:48.589 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/objectstore").st_ino) 2024-03-12T17:28:48.589 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:48.784 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629187 2024-03-12T17:28:48.964 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:48.964 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:48.964 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:48.964 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:48.964 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/fs").st_ino) 2024-03-12T17:28:48.964 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:49.157 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629184 2024-03-12T17:28:49.338 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:49.338 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:49.339 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:49.339 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:49.339 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/workloads").st_ino) 2024-03-12T17:28:49.339 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:49.533 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629191 2024-03-12T17:28:49.714 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:49.714 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:49.714 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:49.715 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:49.715 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/workloads/ec-rados-plugin=lrc-k=4-m=2-l=3.yaml").st_ino) 2024-03-12T17:28:49.715 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:49.906 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629192 2024-03-12T17:28:50.088 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:50.088 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:50.088 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:50.088 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:50.088 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/%").st_ino) 2024-03-12T17:28:50.088 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:50.281 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629181 2024-03-12T17:28:50.462 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:50.463 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:50.463 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:50.463 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:50.463 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/thrashers").st_ino) 2024-03-12T17:28:50.463 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:50.660 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629189 2024-03-12T17:28:50.842 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:50.842 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:50.842 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:50.842 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:50.842 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/thrashers/default.yaml").st_ino) 2024-03-12T17:28:50.842 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:51.036 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629190 2024-03-12T17:28:51.218 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:51.218 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:51.219 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:51.219 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:51.219 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/thrashers/fastread.yaml").st_ino) 2024-03-12T17:28:51.219 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:51.411 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628108 2024-03-12T17:28:51.594 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:51.594 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:51.594 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:51.594 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:51.595 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/thrashers/morepggrow.yaml").st_ino) 2024-03-12T17:28:51.595 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:51.789 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628110 2024-03-12T17:28:51.970 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:51.970 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:51.970 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:51.970 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:51.970 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/thrashers/pggrow.yaml").st_ino) 2024-03-12T17:28:51.970 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:52.162 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628111 2024-03-12T17:28:52.342 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:52.342 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:52.342 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:52.342 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:52.342 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/thrashers/mapgap.yaml").st_ino) 2024-03-12T17:28:52.342 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:52.524 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628109 2024-03-12T17:28:52.704 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:52.704 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:52.704 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:52.705 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:52.705 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/rados/thrash-erasure-code-big/rados.yaml").st_ino) 2024-03-12T17:28:52.705 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:52.889 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629188 2024-03-12T17:28:53.070 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:53.070 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:53.070 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:53.070 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:53.070 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs").st_ino) 2024-03-12T17:28:53.070 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:53.266 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628696 2024-03-12T17:28:53.448 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:53.448 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:53.448 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:53.448 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:53.448 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic").st_ino) 2024-03-12T17:28:53.448 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:53.645 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628697 2024-03-12T17:28:53.827 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:53.827 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:53.827 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:53.827 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:53.827 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/clusters").st_ino) 2024-03-12T17:28:53.827 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:54.019 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628701 2024-03-12T17:28:54.201 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:54.201 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:54.201 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:54.201 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:54.202 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/clusters/extra-client.yaml").st_ino) 2024-03-12T17:28:54.202 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:54.395 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628702 2024-03-12T17:28:54.576 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:54.576 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:54.576 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:54.576 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:54.577 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/fs").st_ino) 2024-03-12T17:28:54.577 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:54.771 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628703 2024-03-12T17:28:54.951 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:54.951 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:54.951 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:54.951 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:54.951 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/fs/xfs.yaml").st_ino) 2024-03-12T17:28:54.951 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:55.146 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628704 2024-03-12T17:28:55.326 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:55.326 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:55.326 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:55.326 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:55.326 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/mount").st_ino) 2024-03-12T17:28:55.326 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:55.519 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628705 2024-03-12T17:28:55.700 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:55.700 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:55.700 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:55.700 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:55.700 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/mount/v4.yaml").st_ino) 2024-03-12T17:28:55.700 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:55.893 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627976 2024-03-12T17:28:56.073 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:56.073 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:56.073 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:56.073 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:56.073 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/mount/v3.yaml").st_ino) 2024-03-12T17:28:56.073 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:56.268 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628706 2024-03-12T17:28:56.449 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:56.450 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:56.450 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:56.450 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:56.450 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/ceph").st_ino) 2024-03-12T17:28:56.450 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:56.646 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628699 2024-03-12T17:28:56.828 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:56.828 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:56.828 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:56.828 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:56.828 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/ceph/base.yaml").st_ino) 2024-03-12T17:28:56.828 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:57.021 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628700 2024-03-12T17:28:57.202 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:57.202 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:57.202 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:57.202 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:57.203 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/%").st_ino) 2024-03-12T17:28:57.203 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:57.396 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628698 2024-03-12T17:28:57.577 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:57.577 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:57.577 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:57.577 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:57.578 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/tasks").st_ino) 2024-03-12T17:28:57.578 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:57.770 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628707 2024-03-12T17:28:57.951 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:57.951 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:57.951 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:57.951 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:57.951 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/tasks/nfs_workunit_suites_dbench.yaml").st_ino) 2024-03-12T17:28:57.951 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:58.149 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627979 2024-03-12T17:28:58.330 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:58.330 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:58.330 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:58.330 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:58.330 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/tasks/nfs-workunit-kernel-untar-build.yaml").st_ino) 2024-03-12T17:28:58.330 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:58.525 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628708 2024-03-12T17:28:58.706 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:58.706 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:58.706 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:58.706 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:58.706 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/tasks/nfs_workunit_suites_ffsb.yaml").st_ino) 2024-03-12T17:28:58.706 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:58.901 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627980 2024-03-12T17:28:59.079 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:59.080 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:59.080 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:59.080 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:59.080 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/tasks/nfs_workunit_suites_blogbench.yaml").st_ino) 2024-03-12T17:28:59.080 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:59.271 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627978 2024-03-12T17:28:59.453 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:59.453 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:59.453 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:59.453 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:59.453 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/tasks/nfs_workunit_misc.yaml").st_ino) 2024-03-12T17:28:59.453 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:28:59.647 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627977 2024-03-12T17:28:59.828 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:28:59.828 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:28:59.828 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:28:59.828 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:28:59.828 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/tasks/nfs_workunit_suites_fsstress.yaml").st_ino) 2024-03-12T17:28:59.828 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:00.021 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627981 2024-03-12T17:29:00.204 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:00.204 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:00.204 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:00.204 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:00.204 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/knfs/basic/tasks/nfs_workunit_suites_iozone.yaml").st_ino) 2024-03-12T17:29:00.204 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:00.397 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627982 2024-03-12T17:29:00.578 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:00.578 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:00.578 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:00.578 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:00.578 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/experimental").st_ino) 2024-03-12T17:29:00.578 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:00.795 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628426 2024-03-12T17:29:00.954 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:00.954 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:00.955 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:00.955 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:00.955 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/experimental/multimds").st_ino) 2024-03-12T17:29:00.955 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:01.146 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628427 2024-03-12T17:29:01.328 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:01.328 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:01.328 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:01.328 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:01.328 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/experimental/multimds/clusters").st_ino) 2024-03-12T17:29:01.328 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:01.522 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628429 2024-03-12T17:29:01.702 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:01.702 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:01.702 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:01.702 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:01.702 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/experimental/multimds/clusters/7-multimds.yaml").st_ino) 2024-03-12T17:29:01.702 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:01.900 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628430 2024-03-12T17:29:02.079 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:02.080 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:02.080 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:02.080 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:02.080 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/experimental/multimds/%").st_ino) 2024-03-12T17:29:02.080 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:02.276 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628428 2024-03-12T17:29:02.457 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:02.457 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:02.457 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:02.458 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:02.458 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/experimental/multimds/tasks").st_ino) 2024-03-12T17:29:02.458 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:02.666 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628431 2024-03-12T17:29:02.847 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:02.847 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:02.847 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:02.847 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:02.847 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/experimental/multimds/tasks/fsstress_thrash_subtrees.yaml").st_ino) 2024-03-12T17:29:02.847 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:03.041 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628432 2024-03-12T17:29:03.222 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:03.222 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:03.222 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:03.222 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:03.222 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal").st_ino) 2024-03-12T17:29:03.223 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:03.416 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628761 2024-03-12T17:29:03.596 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:03.596 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:03.596 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:03.596 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:03.596 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/fs-misc").st_ino) 2024-03-12T17:29:03.596 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:03.791 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628770 2024-03-12T17:29:03.970 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:03.971 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:03.971 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:03.971 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:03.971 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/fs-misc/clusters").st_ino) 2024-03-12T17:29:03.971 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:04.165 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628772 2024-03-12T17:29:04.345 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:04.345 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:04.346 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:04.346 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:04.346 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/fs-misc/clusters/two_clients.yaml").st_ino) 2024-03-12T17:29:04.346 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:04.538 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628773 2024-03-12T17:29:04.720 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:04.720 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:04.720 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:04.720 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:04.720 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/fs-misc/fs").st_ino) 2024-03-12T17:29:04.720 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:04.916 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628774 2024-03-12T17:29:05.096 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:05.096 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:05.096 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:05.096 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:05.096 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/fs-misc/fs/btrfs.yaml").st_ino) 2024-03-12T17:29:05.096 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:05.289 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628775 2024-03-12T17:29:05.470 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:05.471 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:05.471 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:05.471 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:05.471 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/fs-misc/%").st_ino) 2024-03-12T17:29:05.471 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:05.665 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628771 2024-03-12T17:29:05.846 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:05.846 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:05.846 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:05.846 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:05.846 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/fs-misc/tasks").st_ino) 2024-03-12T17:29:05.846 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:06.039 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628776 2024-03-12T17:29:06.221 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:06.221 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:06.221 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:06.221 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:06.221 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/fs-misc/tasks/locktest.yaml").st_ino) 2024-03-12T17:29:06.221 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:06.419 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628777 2024-03-12T17:29:06.600 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:06.600 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:06.600 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:06.600 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:06.600 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/basic").st_ino) 2024-03-12T17:29:06.600 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:06.794 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628762 2024-03-12T17:29:06.976 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:06.976 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:06.976 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:06.976 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:06.976 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/basic/clusters").st_ino) 2024-03-12T17:29:06.976 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:07.169 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628764 2024-03-12T17:29:07.349 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:07.349 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:07.350 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:07.350 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:07.350 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/basic/clusters/fixed-3.yaml").st_ino) 2024-03-12T17:29:07.350 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:07.545 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628765 2024-03-12T17:29:07.726 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:07.726 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:07.726 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:07.726 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:07.726 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/basic/fs").st_ino) 2024-03-12T17:29:07.726 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:07.919 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628766 2024-03-12T17:29:08.100 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:08.100 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:08.100 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:08.100 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:08.100 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/basic/fs/btrfs.yaml").st_ino) 2024-03-12T17:29:08.100 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:08.291 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628767 2024-03-12T17:29:08.472 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:08.472 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:08.472 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:08.472 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:08.473 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/basic/%").st_ino) 2024-03-12T17:29:08.473 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:08.664 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628763 2024-03-12T17:29:08.844 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:08.844 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:08.844 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:08.844 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:08.845 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/basic/tasks").st_ino) 2024-03-12T17:29:08.845 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:09.041 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628768 2024-03-12T17:29:09.222 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:09.223 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:09.223 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:09.223 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:09.223 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/basic/tasks/kclient_workunit_suites_blogbench.yaml").st_ino) 2024-03-12T17:29:09.223 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:09.414 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628769 2024-03-12T17:29:09.595 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:09.595 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:09.595 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:09.595 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:09.595 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/basic/tasks/kclient_workunit_suites_fsx.yaml").st_ino) 2024-03-12T17:29:09.595 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:09.786 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628012 2024-03-12T17:29:09.967 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:09.967 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:09.967 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:09.968 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:09.968 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/mds_restart").st_ino) 2024-03-12T17:29:09.968 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:10.160 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628778 2024-03-12T17:29:10.342 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:10.342 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:10.342 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:10.342 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:10.342 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/mds_restart/clusters").st_ino) 2024-03-12T17:29:10.342 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:10.533 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628780 2024-03-12T17:29:10.715 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:10.715 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:10.715 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:10.715 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:10.715 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/mds_restart/clusters/one_mds.yaml").st_ino) 2024-03-12T17:29:10.715 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:10.906 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628781 2024-03-12T17:29:11.087 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:11.087 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:11.087 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:11.087 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:11.087 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/mds_restart/%").st_ino) 2024-03-12T17:29:11.087 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:11.281 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628779 2024-03-12T17:29:11.462 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:11.462 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:11.462 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:11.462 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:11.462 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/mds_restart/tasks").st_ino) 2024-03-12T17:29:11.462 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:11.657 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628782 2024-03-12T17:29:11.838 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:11.838 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:11.838 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:11.838 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:11.838 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/mds_restart/tasks/restart-workunit-backtraces.yaml").st_ino) 2024-03-12T17:29:11.839 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:12.033 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628783 2024-03-12T17:29:12.214 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:12.214 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:12.215 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:12.215 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:12.215 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds").st_ino) 2024-03-12T17:29:12.215 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:12.406 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628784 2024-03-12T17:29:12.588 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:12.588 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:12.588 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:12.588 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:12.588 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/clusters").st_ino) 2024-03-12T17:29:12.589 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:12.782 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628786 2024-03-12T17:29:12.963 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:12.963 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:12.963 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:12.963 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:12.963 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/clusters/3-node-3-mds.yaml").st_ino) 2024-03-12T17:29:12.963 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:13.150 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628787 2024-03-12T17:29:13.332 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:13.332 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:13.332 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:13.332 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:13.332 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/clusters/3-node-9-mds.yaml").st_ino) 2024-03-12T17:29:13.332 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:13.527 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628013 2024-03-12T17:29:13.545 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:29:13.553 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:29:13.707 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:13.707 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:13.707 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:13.707 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:13.708 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/fs").st_ino) 2024-03-12T17:29:13.708 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:13.902 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628788 2024-03-12T17:29:14.082 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:14.082 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:14.082 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:14.082 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:14.082 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/fs/btrfs.yaml").st_ino) 2024-03-12T17:29:14.083 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:14.277 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628789 2024-03-12T17:29:14.457 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:14.457 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:14.457 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:14.457 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:14.457 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/%").st_ino) 2024-03-12T17:29:14.457 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:14.652 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628785 2024-03-12T17:29:14.832 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:14.833 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:14.833 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:14.833 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:14.833 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/mounts").st_ino) 2024-03-12T17:29:14.833 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:15.028 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628790 2024-03-12T17:29:15.209 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:15.209 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:15.209 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:15.209 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:15.210 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/mounts/ceph-fuse.yaml").st_ino) 2024-03-12T17:29:15.210 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:15.402 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628791 2024-03-12T17:29:15.583 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:15.583 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:15.583 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:15.584 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:15.584 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/mounts/kclient.yaml").st_ino) 2024-03-12T17:29:15.584 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:15.779 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628014 2024-03-12T17:29:15.959 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:15.959 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:15.959 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:15.960 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:15.960 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/tasks").st_ino) 2024-03-12T17:29:15.960 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:16.154 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628792 2024-03-12T17:29:16.335 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:16.335 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:16.335 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:16.335 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:16.335 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_suites_pjd.yaml").st_ino) 2024-03-12T17:29:16.335 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:16.528 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628019 2024-03-12T17:29:16.710 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:16.710 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:16.710 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:16.710 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:16.710 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_suites_fsstress.yaml").st_ino) 2024-03-12T17:29:16.710 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:16.902 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628017 2024-03-12T17:29:17.083 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:17.083 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:17.083 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:17.083 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:17.083 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_suites_truncate_delay.yaml").st_ino) 2024-03-12T17:29:17.083 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:17.281 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628020 2024-03-12T17:29:17.463 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:17.463 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:17.464 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:17.464 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:17.464 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_misc.yaml").st_ino) 2024-03-12T17:29:17.464 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:17.658 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628793 2024-03-12T17:29:17.840 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:17.840 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:17.840 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:17.840 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:17.840 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_suites_blogbench.yaml").st_ino) 2024-03-12T17:29:17.840 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:18.029 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628015 2024-03-12T17:29:18.211 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:18.211 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:18.211 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:18.212 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:18.212 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_suites_fsync.yaml").st_ino) 2024-03-12T17:29:18.212 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:18.404 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628018 2024-03-12T17:29:18.586 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:18.586 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:18.586 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:18.586 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:18.586 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/tasks/workunit_suites_dbench.yaml").st_ino) 2024-03-12T17:29:18.586 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:18.771 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628016 2024-03-12T17:29:18.949 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:18.949 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:18.950 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:18.950 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:18.950 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/thrash").st_ino) 2024-03-12T17:29:18.950 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:19.143 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628794 2024-03-12T17:29:19.325 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:19.325 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:19.325 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:19.326 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:19.326 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/thrash/normal.yaml").st_ino) 2024-03-12T17:29:19.326 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:19.519 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628021 2024-03-12T17:29:19.700 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:19.700 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:19.700 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:19.700 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:19.700 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/marginal/multimds/thrash/exports.yaml").st_ino) 2024-03-12T17:29:19.700 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:19.892 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628795 2024-03-12T17:29:20.074 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:20.074 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:20.074 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:20.074 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:20.074 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs").st_ino) 2024-03-12T17:29:20.074 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:20.269 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628654 2024-03-12T17:29:20.449 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:20.449 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:20.449 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:20.449 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:20.449 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs").st_ino) 2024-03-12T17:29:20.450 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:20.641 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628655 2024-03-12T17:29:20.823 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:20.823 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:20.823 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:20.823 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:20.823 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/clusters").st_ino) 2024-03-12T17:29:20.823 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:21.016 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628657 2024-03-12T17:29:21.196 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:21.196 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:21.196 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:21.197 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:21.197 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/clusters/fixed-3-cephfs.yaml").st_ino) 2024-03-12T17:29:21.197 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:21.391 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628658 2024-03-12T17:29:21.572 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:21.572 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:21.573 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:21.573 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:21.573 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/fs").st_ino) 2024-03-12T17:29:21.573 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:21.762 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628659 2024-03-12T17:29:21.943 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:21.943 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:21.943 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:21.943 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:21.943 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/fs/xfs.yaml").st_ino) 2024-03-12T17:29:21.943 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:22.124 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628660 2024-03-12T17:29:22.304 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:22.305 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:22.305 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:22.305 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:22.305 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/inline").st_ino) 2024-03-12T17:29:22.305 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:22.500 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628661 2024-03-12T17:29:22.681 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:22.681 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:22.681 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:22.682 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:22.682 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/inline/yes.yaml").st_ino) 2024-03-12T17:29:22.682 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:22.874 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627943 2024-03-12T17:29:23.055 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:23.055 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:23.055 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:23.055 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:23.055 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/inline/no.yaml").st_ino) 2024-03-12T17:29:23.056 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:23.254 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628662 2024-03-12T17:29:23.433 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:23.433 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:23.433 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:23.433 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:23.433 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/conf.yaml").st_ino) 2024-03-12T17:29:23.433 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:23.627 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627942 2024-03-12T17:29:23.808 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:23.808 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:23.808 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:23.808 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:23.808 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/%").st_ino) 2024-03-12T17:29:23.808 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:24.001 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628656 2024-03-12T17:29:24.186 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:24.186 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:24.186 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:24.187 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:24.187 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks").st_ino) 2024-03-12T17:29:24.187 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:24.378 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628663 2024-03-12T17:29:24.559 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:24.559 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:24.559 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:24.559 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:24.559 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_misc.yaml").st_ino) 2024-03-12T17:29:24.559 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:24.754 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627945 2024-03-12T17:29:24.933 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:24.933 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:24.933 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:24.933 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:24.933 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_fsstress.yaml").st_ino) 2024-03-12T17:29:24.933 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:25.130 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627950 2024-03-12T17:29:25.310 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:25.310 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:25.310 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:25.310 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:25.310 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_trivial_sync.yaml").st_ino) 2024-03-12T17:29:25.310 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:25.504 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627955 2024-03-12T17:29:25.684 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:25.684 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:25.684 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:25.684 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:25.684 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_snaps.yaml").st_ino) 2024-03-12T17:29:25.685 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:25.870 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627947 2024-03-12T17:29:26.050 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:26.050 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:26.051 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:26.051 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:26.051 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_direct_io.yaml").st_ino) 2024-03-12T17:29:26.051 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:26.248 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628664 2024-03-12T17:29:26.429 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:26.429 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:26.429 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:26.429 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:26.429 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_fsx.yaml").st_ino) 2024-03-12T17:29:26.429 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:26.624 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627951 2024-03-12T17:29:26.804 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:26.804 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:26.804 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:26.804 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:26.804 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_kernel_untar_build.yaml").st_ino) 2024-03-12T17:29:26.804 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:26.999 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627944 2024-03-12T17:29:27.179 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:27.179 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:27.179 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:27.180 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:27.180 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_ffsb.yaml").st_ino) 2024-03-12T17:29:27.180 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:27.373 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627949 2024-03-12T17:29:27.554 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:27.554 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:27.554 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:27.555 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:27.555 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_dbench.yaml").st_ino) 2024-03-12T17:29:27.555 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:27.749 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627948 2024-03-12T17:29:27.930 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:27.931 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:27.931 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:27.931 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:27.931 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_fsync.yaml").st_ino) 2024-03-12T17:29:27.931 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:28.122 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627952 2024-03-12T17:29:28.304 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:28.304 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:28.304 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:28.304 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:28.304 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_pjd.yaml").st_ino) 2024-03-12T17:29:28.304 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:28.496 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627954 2024-03-12T17:29:28.677 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:28.677 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:28.677 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:28.677 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:28.678 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_suites_iozone.yaml").st_ino) 2024-03-12T17:29:28.678 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:28.874 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627953 2024-03-12T17:29:29.055 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:29.055 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:29.055 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:29.055 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:29.055 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/cephfs/tasks/kclient_workunit_o_trunc.yaml").st_ino) 2024-03-12T17:29:29.055 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:29.251 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627946 2024-03-12T17:29:29.432 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:29.432 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:29.432 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:29.432 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:29.432 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/mixed-clients").st_ino) 2024-03-12T17:29:29.432 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:29.626 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628665 2024-03-12T17:29:29.806 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:29.806 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:29.806 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:29.806 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:29.806 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/mixed-clients/clusters").st_ino) 2024-03-12T17:29:29.806 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:30.000 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628667 2024-03-12T17:29:30.182 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:30.182 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:30.182 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:30.182 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:30.183 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/mixed-clients/clusters/2-clients.yaml").st_ino) 2024-03-12T17:29:30.183 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:30.378 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628668 2024-03-12T17:29:30.560 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:30.560 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:30.560 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:30.561 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:30.561 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/mixed-clients/fs").st_ino) 2024-03-12T17:29:30.561 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:30.755 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628669 2024-03-12T17:29:30.936 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:30.936 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:30.936 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:30.936 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:30.936 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/mixed-clients/fs/xfs.yaml").st_ino) 2024-03-12T17:29:30.936 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:31.130 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628670 2024-03-12T17:29:31.310 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:31.311 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:31.311 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:31.311 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:31.311 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/mixed-clients/conf.yaml").st_ino) 2024-03-12T17:29:31.311 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:31.505 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627956 2024-03-12T17:29:31.687 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:31.687 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:31.687 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:31.687 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:31.687 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/mixed-clients/%").st_ino) 2024-03-12T17:29:31.687 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:31.883 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628666 2024-03-12T17:29:32.063 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:32.063 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:32.063 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:32.063 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:32.063 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/mixed-clients/tasks").st_ino) 2024-03-12T17:29:32.064 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:32.257 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628671 2024-03-12T17:29:32.439 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:32.439 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:32.439 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:32.440 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:32.440 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/mixed-clients/tasks/kernel_cfuse_workunits_untarbuild_blogbench.yaml").st_ino) 2024-03-12T17:29:32.440 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:32.634 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627957 2024-03-12T17:29:32.814 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:32.814 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:32.815 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:32.815 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:32.815 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/mixed-clients/tasks/kernel_cfuse_workunits_dbench_iozone.yaml").st_ino) 2024-03-12T17:29:32.815 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:33.007 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628672 2024-03-12T17:29:33.187 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:33.187 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:33.187 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:33.188 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:33.188 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery").st_ino) 2024-03-12T17:29:33.188 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:33.382 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628673 2024-03-12T17:29:33.563 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:33.564 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:33.564 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:33.564 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:33.564 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/dirfrag").st_ino) 2024-03-12T17:29:33.564 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:33.757 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628679 2024-03-12T17:29:33.938 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:33.938 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:33.938 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:33.938 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:33.939 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/dirfrag/frag_enable.yaml").st_ino) 2024-03-12T17:29:33.939 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:34.130 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628680 2024-03-12T17:29:34.311 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:34.312 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:34.312 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:34.312 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:34.312 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/clusters").st_ino) 2024-03-12T17:29:34.312 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:34.511 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628675 2024-03-12T17:29:34.692 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:34.692 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:34.692 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:34.692 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:34.692 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/clusters/4-remote-clients.yaml").st_ino) 2024-03-12T17:29:34.693 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:34.890 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628676 2024-03-12T17:29:35.071 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:35.072 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:35.072 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:35.072 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:35.072 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/%").st_ino) 2024-03-12T17:29:35.072 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:35.261 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628674 2024-03-12T17:29:35.442 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:35.442 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:35.442 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:35.442 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:35.442 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/mounts").st_ino) 2024-03-12T17:29:35.442 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:35.636 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628681 2024-03-12T17:29:35.816 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:35.817 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:35.817 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:35.817 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:35.817 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/mounts/kmounts.yaml").st_ino) 2024-03-12T17:29:35.817 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:36.007 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628682 2024-03-12T17:29:36.189 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:36.189 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:36.189 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:36.189 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:36.189 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/xfs.yaml").st_ino) 2024-03-12T17:29:36.189 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:36.382 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628685 2024-03-12T17:29:36.563 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:36.563 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:36.563 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:36.563 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:36.564 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks").st_ino) 2024-03-12T17:29:36.564 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:36.758 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628683 2024-03-12T17:29:36.940 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:36.940 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:36.940 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:36.940 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:36.940 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/backtrace.yaml").st_ino) 2024-03-12T17:29:36.940 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:37.120 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627958 2024-03-12T17:29:37.302 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:37.302 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:37.302 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:37.303 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:37.303 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/forward-scrub.yaml").st_ino) 2024-03-12T17:29:37.303 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:37.493 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627965 2024-03-12T17:29:37.674 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:37.674 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:37.674 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:37.674 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:37.674 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/volume-client.yaml").st_ino) 2024-03-12T17:29:37.674 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:37.874 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627971 2024-03-12T17:29:38.055 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:38.056 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:38.056 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:38.056 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:38.056 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/config-commands.yaml").st_ino) 2024-03-12T17:29:38.056 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:38.247 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627961 2024-03-12T17:29:38.428 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:38.428 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:38.428 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:38.428 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:38.428 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/sessionmap.yaml").st_ino) 2024-03-12T17:29:38.429 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:38.609 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627969 2024-03-12T17:29:38.790 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:38.790 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:38.790 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:38.790 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:38.790 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/failover.yaml.disabled").st_ino) 2024-03-12T17:29:38.790 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:38.975 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627964 2024-03-12T17:29:39.156 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:39.156 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:39.156 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:39.156 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:39.156 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/data-scan.yaml").st_ino) 2024-03-12T17:29:39.156 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:39.350 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627963 2024-03-12T17:29:39.532 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:39.532 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:39.533 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:39.533 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:39.533 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/mds-flush.yaml").st_ino) 2024-03-12T17:29:39.533 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:39.714 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627967 2024-03-12T17:29:39.895 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:39.895 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:39.895 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:39.895 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:39.895 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/auto-repair.yaml").st_ino) 2024-03-12T17:29:39.895 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:40.087 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628684 2024-03-12T17:29:40.269 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:40.269 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:40.269 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:40.269 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:40.269 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/damage.yaml").st_ino) 2024-03-12T17:29:40.269 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:40.465 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627962 2024-03-12T17:29:40.645 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:40.646 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:40.646 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:40.646 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:40.646 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/client-recovery.yaml").st_ino) 2024-03-12T17:29:40.646 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:40.848 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627960 2024-03-12T17:29:41.029 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:41.029 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:41.029 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:41.029 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:41.029 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/journal-repair.yaml").st_ino) 2024-03-12T17:29:41.030 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:41.223 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627966 2024-03-12T17:29:41.403 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:41.403 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:41.403 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:41.403 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:41.403 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/client-limits.yaml").st_ino) 2024-03-12T17:29:41.403 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:41.597 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627959 2024-03-12T17:29:41.778 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:41.778 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:41.778 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:41.778 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:41.778 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/strays.yaml.disabled").st_ino) 2024-03-12T17:29:41.778 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:41.970 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627970 2024-03-12T17:29:42.152 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:42.152 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:42.152 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:42.152 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:42.152 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/tasks/pool-perm.yaml").st_ino) 2024-03-12T17:29:42.152 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:42.347 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627968 2024-03-12T17:29:42.530 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:42.531 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:42.531 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:42.531 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:42.531 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/debug").st_ino) 2024-03-12T17:29:42.531 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:42.725 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628677 2024-03-12T17:29:42.907 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:42.907 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:42.907 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:42.907 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:42.907 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/recovery/debug/mds_client.yaml").st_ino) 2024-03-12T17:29:42.907 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:43.100 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628678 2024-03-12T17:29:43.281 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:43.282 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:43.282 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:43.282 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:43.282 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash").st_ino) 2024-03-12T17:29:43.282 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:43.483 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628686 2024-03-12T17:29:43.665 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:43.666 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:43.666 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:43.666 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:43.666 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash/clusters").st_ino) 2024-03-12T17:29:43.666 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:43.723 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:29:43.730 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:29:43.840 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628688 2024-03-12T17:29:44.022 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:44.022 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:44.022 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:44.022 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:44.022 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash/clusters/fixed-3-cephfs.yaml").st_ino) 2024-03-12T17:29:44.022 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:44.163 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628689 2024-03-12T17:29:44.343 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:44.343 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:44.343 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:44.344 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:44.344 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash/fs").st_ino) 2024-03-12T17:29:44.344 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:44.538 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628690 2024-03-12T17:29:44.720 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:44.720 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:44.720 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:44.720 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:44.720 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash/fs/xfs.yaml").st_ino) 2024-03-12T17:29:44.720 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:44.913 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628691 2024-03-12T17:29:45.094 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:45.094 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:45.094 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:45.094 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:45.094 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash/workloads").st_ino) 2024-03-12T17:29:45.094 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:45.286 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628694 2024-03-12T17:29:45.467 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:45.467 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:45.467 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:45.467 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:45.467 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash/workloads/kclient_workunit_suites_ffsb.yaml").st_ino) 2024-03-12T17:29:45.467 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:45.666 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628695 2024-03-12T17:29:45.847 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:45.847 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:45.847 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:45.847 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:45.847 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash/workloads/kclient_workunit_suites_iozone.yaml").st_ino) 2024-03-12T17:29:45.847 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:46.041 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627975 2024-03-12T17:29:46.223 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:46.223 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:46.223 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:46.223 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:46.223 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash/conf.yaml").st_ino) 2024-03-12T17:29:46.223 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:46.406 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627972 2024-03-12T17:29:46.587 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:46.587 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:46.587 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:46.587 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:46.587 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash/%").st_ino) 2024-03-12T17:29:46.587 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:46.781 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628687 2024-03-12T17:29:46.960 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:46.960 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:46.960 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:46.960 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:46.960 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash/thrashers").st_ino) 2024-03-12T17:29:46.960 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:47.158 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628692 2024-03-12T17:29:47.338 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:47.339 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:47.339 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:47.339 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:47.339 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash/thrashers/default.yaml").st_ino) 2024-03-12T17:29:47.339 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:47.530 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628693 2024-03-12T17:29:47.712 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:47.712 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:47.712 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:47.712 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:47.712 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash/thrashers/mon.yaml").st_ino) 2024-03-12T17:29:47.712 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:47.908 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627974 2024-03-12T17:29:48.090 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:48.090 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:48.090 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:48.090 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:48.091 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/kcephfs/thrash/thrashers/mds.yaml").st_ino) 2024-03-12T17:29:48.091 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:48.284 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627973 2024-03-12T17:29:48.465 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:48.465 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:48.465 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:48.465 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:48.465 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade").st_ino) 2024-03-12T17:29:48.466 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:48.660 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629839 2024-03-12T17:29:48.842 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:48.843 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:48.843 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:48.843 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:48.843 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x").st_ino) 2024-03-12T17:29:48.843 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:49.034 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629913 2024-03-12T17:29:49.216 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:49.216 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:49.216 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:49.216 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:49.216 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/point-to-point-x").st_ino) 2024-03-12T17:29:49.216 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:49.406 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629929 2024-03-12T17:29:49.588 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:49.588 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:49.588 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:49.588 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:49.588 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/point-to-point-x/point-to-point-upgrade.yaml").st_ino) 2024-03-12T17:29:49.588 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:49.779 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628937 2024-03-12T17:29:49.959 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:49.959 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:49.959 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:49.960 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:49.960 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/point-to-point-x/distros").st_ino) 2024-03-12T17:29:49.960 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:50.156 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629931 2024-03-12T17:29:50.338 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:50.338 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:50.338 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:50.338 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:50.338 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/point-to-point-x/distros/centos_7.2.yaml").st_ino) 2024-03-12T17:29:50.338 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:50.533 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629932 2024-03-12T17:29:50.714 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:50.714 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:50.714 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:50.714 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:50.714 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/point-to-point-x/distros/ubuntu_14.04.yaml").st_ino) 2024-03-12T17:29:50.714 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:50.907 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629933 2024-03-12T17:29:51.088 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:51.089 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:51.089 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:51.089 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:51.089 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/point-to-point-x/%").st_ino) 2024-03-12T17:29:51.089 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:51.281 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629930 2024-03-12T17:29:51.461 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:51.461 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:51.461 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:51.461 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:51.461 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel").st_ino) 2024-03-12T17:29:51.461 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:51.656 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629914 2024-03-12T17:29:51.837 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:51.837 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:51.837 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:51.837 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:51.837 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/kraken.yaml").st_ino) 2024-03-12T17:29:51.838 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:52.029 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629928 2024-03-12T17:29:52.211 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:52.211 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:52.211 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:52.211 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:52.211 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/1-jewel-install").st_ino) 2024-03-12T17:29:52.211 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:52.406 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629918 2024-03-12T17:29:52.588 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:52.588 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:52.588 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:52.588 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:52.588 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/1-jewel-install/jewel.yaml").st_ino) 2024-03-12T17:29:52.588 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:52.779 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629919 2024-03-12T17:29:52.960 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:52.960 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:52.960 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:52.960 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:52.960 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/4-kraken.yaml").st_ino) 2024-03-12T17:29:52.960 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:53.155 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629924 2024-03-12T17:29:53.336 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:53.336 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:53.336 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:53.336 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:53.336 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/3-upgrade-sequence").st_ino) 2024-03-12T17:29:53.336 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:53.526 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629922 2024-03-12T17:29:53.708 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:53.708 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:53.708 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:53.708 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:53.708 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/3-upgrade-sequence/upgrade-all.yaml").st_ino) 2024-03-12T17:29:53.708 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:53.901 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629923 2024-03-12T17:29:54.082 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:54.082 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:54.083 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:54.083 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:54.083 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/3-upgrade-sequence/upgrade-mon-osd-mds.yaml").st_ino) 2024-03-12T17:29:54.083 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:54.278 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628929 2024-03-12T17:29:54.459 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:54.459 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:54.459 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:54.459 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:54.460 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/distros").st_ino) 2024-03-12T17:29:54.460 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:54.643 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629927 2024-03-12T17:29:54.823 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:54.823 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:54.824 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:54.824 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:54.824 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/%").st_ino) 2024-03-12T17:29:54.824 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:55.006 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629915 2024-03-12T17:29:55.186 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:55.186 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:55.187 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:55.187 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:55.187 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload").st_ino) 2024-03-12T17:29:55.187 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:55.379 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629920 2024-03-12T17:29:55.559 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:55.560 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:55.560 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:55.560 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:55.560 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/test_rbd_python.yaml").st_ino) 2024-03-12T17:29:55.560 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:55.754 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628928 2024-03-12T17:29:55.936 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:55.936 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:55.936 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:55.936 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:55.936 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/blogbench.yaml").st_ino) 2024-03-12T17:29:55.936 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:56.131 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628923 2024-03-12T17:29:56.313 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:56.313 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:56.313 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:56.313 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:56.313 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/rados_api.yaml").st_ino) 2024-03-12T17:29:56.313 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:56.492 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628925 2024-03-12T17:29:56.672 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:56.672 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:56.672 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:56.672 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:56.672 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/rados_loadgenbig.yaml").st_ino) 2024-03-12T17:29:56.673 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:56.868 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628926 2024-03-12T17:29:57.048 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:57.049 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:57.049 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:57.049 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:57.049 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/ec-rados-default.yaml").st_ino) 2024-03-12T17:29:57.049 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:57.247 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628924 2024-03-12T17:29:57.424 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:57.424 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:57.424 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:57.424 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:57.424 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/+").st_ino) 2024-03-12T17:29:57.424 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:57.618 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629921 2024-03-12T17:29:57.799 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:57.799 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:57.799 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:57.799 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:57.799 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/2-workload/test_rbd_api.yaml").st_ino) 2024-03-12T17:29:57.799 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:57.989 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628927 2024-03-12T17:29:58.169 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:58.170 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:58.170 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:58.170 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:58.170 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/0-cluster").st_ino) 2024-03-12T17:29:58.170 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:58.363 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629916 2024-03-12T17:29:58.544 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:58.544 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:58.544 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:58.544 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:58.544 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/0-cluster/openstack.yaml").st_ino) 2024-03-12T17:29:58.544 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:58.737 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628921 2024-03-12T17:29:58.918 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:58.918 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:58.918 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:58.918 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:58.918 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/0-cluster/+").st_ino) 2024-03-12T17:29:58.918 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:59.096 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629917 2024-03-12T17:29:59.276 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:59.276 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:59.277 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:59.277 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:59.277 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/0-cluster/start.yaml").st_ino) 2024-03-12T17:29:59.277 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:59.470 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628922 2024-03-12T17:29:59.651 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:29:59.652 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:29:59.652 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:29:59.652 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:29:59.652 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload").st_ino) 2024-03-12T17:29:59.652 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:29:59.851 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629925 2024-03-12T17:30:00.032 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:00.032 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:00.032 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:00.032 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:00.032 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/blogbench.yaml").st_ino) 2024-03-12T17:30:00.032 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:00.214 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628930 2024-03-12T17:30:00.394 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:00.395 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:00.395 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:00.395 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:00.395 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/rados-snaps-few-objects.yaml").st_ino) 2024-03-12T17:30:00.395 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:00.590 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628931 2024-03-12T17:30:00.771 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:00.771 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:00.771 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:00.771 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:00.771 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/+").st_ino) 2024-03-12T17:30:00.771 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:00.964 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629926 2024-03-12T17:30:01.144 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:01.144 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:01.144 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:01.144 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:01.144 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/rados_loadgenmix.yaml").st_ino) 2024-03-12T17:30:01.144 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:01.338 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628932 2024-03-12T17:30:01.520 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:01.520 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:01.520 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:01.520 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:01.520 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/rbd_cls.yaml").st_ino) 2024-03-12T17:30:01.520 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:01.715 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628934 2024-03-12T17:30:01.897 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:01.897 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:01.897 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:01.897 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:01.897 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/rados_mon_thrash.yaml").st_ino) 2024-03-12T17:30:01.897 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:02.088 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628933 2024-03-12T17:30:02.269 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:02.270 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:02.270 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:02.270 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:02.270 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/rgw_swift.yaml").st_ino) 2024-03-12T17:30:02.270 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:02.463 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628936 2024-03-12T17:30:02.644 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:02.644 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:02.644 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:02.644 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:02.644 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/parallel/5-final-workload/rbd_import_export.yaml").st_ino) 2024-03-12T17:30:02.644 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:02.839 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628935 2024-03-12T17:30:03.020 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:03.020 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:03.020 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:03.020 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:03.020 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split").st_ino) 2024-03-12T17:30:03.020 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:03.215 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629963 2024-03-12T17:30:03.394 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:03.395 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:03.395 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:03.395 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:03.395 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/6-next-mon").st_ino) 2024-03-12T17:30:03.395 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:03.598 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629977 2024-03-12T17:30:03.779 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:03.779 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:03.779 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:03.779 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:03.780 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/6-next-mon/monb.yaml").st_ino) 2024-03-12T17:30:03.780 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:03.973 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629978 2024-03-12T17:30:04.155 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:04.155 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:04.155 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:04.155 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:04.155 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/8-next-mon").st_ino) 2024-03-12T17:30:04.155 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:04.348 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629981 2024-03-12T17:30:04.528 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:04.528 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:04.528 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:04.528 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:04.528 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/8-next-mon/monc.yaml").st_ino) 2024-03-12T17:30:04.528 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:04.723 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629982 2024-03-12T17:30:04.905 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:04.905 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:04.905 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:04.905 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:04.905 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/1-jewel-install").st_ino) 2024-03-12T17:30:04.905 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:05.098 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629967 2024-03-12T17:30:05.279 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:05.279 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:05.279 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:05.279 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:05.279 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/1-jewel-install/jewel.yaml").st_ino) 2024-03-12T17:30:05.280 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:05.468 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629968 2024-03-12T17:30:05.650 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:05.650 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:05.650 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:05.650 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:05.650 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/5-workload").st_ino) 2024-03-12T17:30:05.650 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:05.846 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629975 2024-03-12T17:30:06.028 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:06.028 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:06.028 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:06.028 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:06.028 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/5-workload/readwrite.yaml").st_ino) 2024-03-12T17:30:06.028 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:06.225 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628943 2024-03-12T17:30:06.405 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:06.405 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:06.405 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:06.405 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:06.405 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/5-workload/snaps-few-objects.yaml").st_ino) 2024-03-12T17:30:06.405 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:06.598 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628944 2024-03-12T17:30:06.779 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:06.779 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:06.779 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:06.779 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:06.779 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/5-workload/rbd-cls.yaml").st_ino) 2024-03-12T17:30:06.779 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:06.971 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628941 2024-03-12T17:30:07.153 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:07.153 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:07.153 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:07.153 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:07.153 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/5-workload/rbd-import-export.yaml").st_ino) 2024-03-12T17:30:07.153 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:07.344 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628942 2024-03-12T17:30:07.526 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:07.526 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:07.526 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:07.526 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:07.526 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/5-workload/+").st_ino) 2024-03-12T17:30:07.526 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:07.718 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629976 2024-03-12T17:30:07.899 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:07.900 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:07.900 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:07.900 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:07.900 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/4-mon").st_ino) 2024-03-12T17:30:07.900 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:08.092 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629973 2024-03-12T17:30:08.274 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:08.275 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:08.275 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:08.275 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:08.275 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/4-mon/mona.yaml").st_ino) 2024-03-12T17:30:08.275 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:08.470 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629974 2024-03-12T17:30:08.652 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:08.652 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:08.652 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:08.652 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:08.652 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/distros").st_ino) 2024-03-12T17:30:08.652 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:08.848 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629985 2024-03-12T17:30:09.029 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:09.029 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:09.029 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:09.029 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:09.030 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/%").st_ino) 2024-03-12T17:30:09.030 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:09.222 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629964 2024-03-12T17:30:09.403 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:09.403 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:09.403 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:09.403 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:09.403 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/9-workload").st_ino) 2024-03-12T17:30:09.403 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:09.598 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629983 2024-03-12T17:30:09.779 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:09.779 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:09.779 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:09.779 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:09.779 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/9-workload/rbd-python.yaml").st_ino) 2024-03-12T17:30:09.779 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:09.972 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628947 2024-03-12T17:30:10.154 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:10.154 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:10.154 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:10.154 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:10.154 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/9-workload/rgw-swift.yaml").st_ino) 2024-03-12T17:30:10.154 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:10.348 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628948 2024-03-12T17:30:10.530 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:10.530 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:10.530 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:10.530 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:10.530 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/9-workload/snaps-many-objects.yaml").st_ino) 2024-03-12T17:30:10.530 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:10.720 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628949 2024-03-12T17:30:10.901 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:10.901 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:10.901 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:10.901 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:10.901 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/9-workload/+").st_ino) 2024-03-12T17:30:10.901 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:11.093 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629984 2024-03-12T17:30:11.274 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:11.274 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:11.274 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:11.274 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:11.274 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/2-partial-upgrade").st_ino) 2024-03-12T17:30:11.274 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:11.455 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629969 2024-03-12T17:30:11.635 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:11.635 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:11.635 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:11.635 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:11.636 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/2-partial-upgrade/firsthalf.yaml").st_ino) 2024-03-12T17:30:11.636 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:11.833 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629970 2024-03-12T17:30:12.013 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:12.014 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:12.014 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:12.014 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:12.014 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/3-thrash").st_ino) 2024-03-12T17:30:12.014 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:12.209 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629971 2024-03-12T17:30:12.388 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:12.388 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:12.388 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:12.388 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:12.388 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/3-thrash/default.yaml").st_ino) 2024-03-12T17:30:12.388 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:12.586 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629972 2024-03-12T17:30:12.768 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:12.769 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:12.769 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:12.769 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:12.769 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/7-workload").st_ino) 2024-03-12T17:30:12.769 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:12.961 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629979 2024-03-12T17:30:13.143 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:13.143 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:13.143 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:13.143 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:13.143 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/7-workload/radosbench.yaml").st_ino) 2024-03-12T17:30:13.143 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:13.328 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628945 2024-03-12T17:30:13.509 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:13.509 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:13.509 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:13.509 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:13.510 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/7-workload/rbd_api.yaml").st_ino) 2024-03-12T17:30:13.510 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:13.708 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628946 2024-03-12T17:30:13.888 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:13.889 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:13.889 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:13.889 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:13.889 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/7-workload/+").st_ino) 2024-03-12T17:30:13.889 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:14.038 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:30:14.046 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:30:14.080 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629980 2024-03-12T17:30:14.260 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:14.260 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:14.260 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:14.261 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:14.261 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/0-cluster").st_ino) 2024-03-12T17:30:14.261 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:14.413 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629965 2024-03-12T17:30:14.593 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:14.594 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:14.594 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:14.594 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:14.594 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/0-cluster/openstack.yaml").st_ino) 2024-03-12T17:30:14.594 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:14.789 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628939 2024-03-12T17:30:14.969 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:14.969 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:14.969 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:14.969 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:14.969 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/0-cluster/+").st_ino) 2024-03-12T17:30:14.969 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:15.167 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629966 2024-03-12T17:30:15.348 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:15.348 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:15.348 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:15.348 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:15.348 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split/0-cluster/start.yaml").st_ino) 2024-03-12T17:30:15.349 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:15.543 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628940 2024-03-12T17:30:15.723 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:15.724 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:15.724 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:15.724 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:15.724 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64").st_ino) 2024-03-12T17:30:15.724 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:15.920 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629934 2024-03-12T17:30:16.101 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:16.101 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:16.101 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:16.102 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:16.102 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/6-next-mon").st_ino) 2024-03-12T17:30:16.102 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:16.295 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629944 2024-03-12T17:30:16.475 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:16.475 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:16.475 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:16.475 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:16.476 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/8-next-mon").st_ino) 2024-03-12T17:30:16.476 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:16.666 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629945 2024-03-12T17:30:16.847 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:16.847 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:16.847 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:16.847 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:16.847 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/1-jewel-install").st_ino) 2024-03-12T17:30:16.848 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:17.037 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629937 2024-03-12T17:30:17.218 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:17.218 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:17.218 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:17.218 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:17.218 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/5-workload").st_ino) 2024-03-12T17:30:17.218 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:17.410 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629942 2024-03-12T17:30:17.592 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:17.592 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:17.592 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:17.592 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:17.592 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/5-workload/ec-rados-default.yaml").st_ino) 2024-03-12T17:30:17.592 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:17.770 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629943 2024-03-12T17:30:17.950 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:17.950 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:17.950 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:17.950 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:17.950 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/4-mon").st_ino) 2024-03-12T17:30:17.951 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:18.147 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629941 2024-03-12T17:30:18.328 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:18.328 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:18.328 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:18.328 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:18.328 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/%").st_ino) 2024-03-12T17:30:18.329 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:18.528 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629935 2024-03-12T17:30:18.708 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:18.708 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:18.708 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:18.708 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:18.708 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/0-x86_64.yaml").st_ino) 2024-03-12T17:30:18.709 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:18.909 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628938 2024-03-12T17:30:19.088 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:19.089 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:19.089 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:19.089 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:19.089 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/9-workload").st_ino) 2024-03-12T17:30:19.089 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:19.289 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629946 2024-03-12T17:30:19.470 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:19.470 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:19.470 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:19.470 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:19.470 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/9-workload/ec-rados-plugin=jerasure-k=3-m=1.yaml").st_ino) 2024-03-12T17:30:19.471 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:19.663 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629947 2024-03-12T17:30:19.845 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:19.845 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:19.845 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:19.845 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:19.845 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/2-partial-upgrade").st_ino) 2024-03-12T17:30:19.845 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:20.039 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629938 2024-03-12T17:30:20.221 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:20.221 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:20.221 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:20.221 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:20.221 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/3-thrash").st_ino) 2024-03-12T17:30:20.221 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:20.416 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629939 2024-03-12T17:30:20.596 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:20.596 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:20.596 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:20.597 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:20.597 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/3-thrash/default.yaml").st_ino) 2024-03-12T17:30:20.597 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:20.793 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629940 2024-03-12T17:30:20.975 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:20.975 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:20.975 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:20.975 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:20.976 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code-x86_64/0-cluster").st_ino) 2024-03-12T17:30:20.976 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:21.166 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629936 2024-03-12T17:30:21.347 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:21.347 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:21.347 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:21.347 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:21.348 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code").st_ino) 2024-03-12T17:30:21.348 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:21.540 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629948 2024-03-12T17:30:21.721 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:21.721 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:21.721 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:21.721 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:21.721 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/6-next-mon").st_ino) 2024-03-12T17:30:21.721 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:21.916 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629958 2024-03-12T17:30:22.098 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:22.098 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:22.098 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:22.098 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:22.098 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/8-next-mon").st_ino) 2024-03-12T17:30:22.098 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:22.290 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629959 2024-03-12T17:30:22.471 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:22.471 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:22.471 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:22.471 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:22.471 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/1-jewel-install").st_ino) 2024-03-12T17:30:22.471 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:22.666 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629951 2024-03-12T17:30:22.848 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:22.848 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:22.848 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:22.848 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:22.848 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/5-workload").st_ino) 2024-03-12T17:30:22.848 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:23.044 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629956 2024-03-12T17:30:23.224 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:23.225 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:23.225 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:23.225 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:23.225 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/5-workload/ec-rados-default.yaml").st_ino) 2024-03-12T17:30:23.225 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:23.420 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629957 2024-03-12T17:30:23.601 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:23.601 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:23.601 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:23.601 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:23.602 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/4-mon").st_ino) 2024-03-12T17:30:23.602 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:23.797 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629955 2024-03-12T17:30:23.979 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:23.979 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:23.979 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:23.979 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:23.979 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/distros").st_ino) 2024-03-12T17:30:23.979 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:24.170 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629962 2024-03-12T17:30:24.351 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:24.351 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:24.351 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:24.351 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:24.351 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/%").st_ino) 2024-03-12T17:30:24.351 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:24.535 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629949 2024-03-12T17:30:24.716 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:24.716 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:24.716 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:24.716 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:24.716 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/9-workload").st_ino) 2024-03-12T17:30:24.716 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:24.921 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629960 2024-03-12T17:30:25.102 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:25.102 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:25.102 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:25.102 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:25.102 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/9-workload/ec-rados-plugin=jerasure-k=3-m=1.yaml").st_ino) 2024-03-12T17:30:25.102 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:25.298 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629961 2024-03-12T17:30:25.478 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:25.478 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:25.478 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:25.478 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:25.478 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/2-partial-upgrade").st_ino) 2024-03-12T17:30:25.479 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:25.673 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629952 2024-03-12T17:30:25.854 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:25.854 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:25.854 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:25.854 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:25.854 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/3-thrash").st_ino) 2024-03-12T17:30:25.855 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:26.050 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629953 2024-03-12T17:30:26.231 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:26.231 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:26.231 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:26.231 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:26.231 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/3-thrash/default.yaml").st_ino) 2024-03-12T17:30:26.231 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:26.425 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629954 2024-03-12T17:30:26.606 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:26.606 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:26.606 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:26.606 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:26.606 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/jewel-x/stress-split-erasure-code/0-cluster").st_ino) 2024-03-12T17:30:26.606 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:26.797 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629950 2024-03-12T17:30:26.980 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:26.980 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:26.980 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:26.980 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:26.980 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x").st_ino) 2024-03-12T17:30:26.980 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:27.172 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629875 2024-03-12T17:30:27.354 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:27.354 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:27.354 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:27.354 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:27.354 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel").st_ino) 2024-03-12T17:30:27.354 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:27.533 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629876 2024-03-12T17:30:27.714 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:27.715 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:27.715 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:27.715 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:27.715 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/8-kraken.yaml").st_ino) 2024-03-12T17:30:27.715 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:27.910 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629893 2024-03-12T17:30:28.091 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:28.091 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:28.091 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:28.091 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:28.091 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/1-hammer-jewel-install").st_ino) 2024-03-12T17:30:28.091 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:28.286 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629880 2024-03-12T17:30:28.466 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:28.466 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:28.466 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:28.466 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:28.466 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/1-hammer-jewel-install/hammer-jewel.yaml").st_ino) 2024-03-12T17:30:28.466 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:28.662 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629881 2024-03-12T17:30:28.842 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:28.842 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:28.842 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:28.843 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:28.843 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/4-jewel.yaml").st_ino) 2024-03-12T17:30:28.843 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:29.035 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629886 2024-03-12T17:30:29.215 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:29.215 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:29.216 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:29.216 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:29.216 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/3.5-finish.yaml").st_ino) 2024-03-12T17:30:29.216 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:29.389 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628906 2024-03-12T17:30:29.570 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:29.570 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:29.570 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:29.571 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:29.571 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/3-upgrade-sequence").st_ino) 2024-03-12T17:30:29.571 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:29.763 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629884 2024-03-12T17:30:29.944 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:29.944 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:29.944 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:29.944 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:29.944 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/3-upgrade-sequence/upgrade-osd-mds-mon.yaml").st_ino) 2024-03-12T17:30:29.945 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:30.141 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628905 2024-03-12T17:30:30.321 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:30.322 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:30.322 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:30.322 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:30.322 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/3-upgrade-sequence/upgrade-all.yaml").st_ino) 2024-03-12T17:30:30.322 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:30.521 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629885 2024-03-12T17:30:30.703 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:30.703 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:30.703 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:30.703 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:30.703 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/7-upgrade-sequence").st_ino) 2024-03-12T17:30:30.703 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:30.898 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629891 2024-03-12T17:30:31.079 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:31.080 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:31.080 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:31.080 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:31.080 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/7-upgrade-sequence/upgrade-by-daemon.yaml").st_ino) 2024-03-12T17:30:31.080 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:31.273 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628912 2024-03-12T17:30:31.455 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:31.457 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:31.458 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:31.458 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:31.458 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/7-upgrade-sequence/upgrade-all.yaml").st_ino) 2024-03-12T17:30:31.458 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:31.656 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629892 2024-03-12T17:30:31.837 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:31.837 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:31.837 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:31.837 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:31.837 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/distros").st_ino) 2024-03-12T17:30:31.837 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:32.032 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629896 2024-03-12T17:30:32.213 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:32.213 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:32.213 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:32.214 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:32.214 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/distros/centos_7.2.yaml").st_ino) 2024-03-12T17:30:32.214 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:32.408 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629897 2024-03-12T17:30:32.589 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:32.589 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:32.589 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:32.589 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:32.589 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/distros/ubuntu_14.04.yaml").st_ino) 2024-03-12T17:30:32.589 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:32.782 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628919 2024-03-12T17:30:32.963 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:32.963 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:32.963 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:32.963 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:32.963 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/%").st_ino) 2024-03-12T17:30:32.963 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:33.155 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629877 2024-03-12T17:30:33.336 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:33.336 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:33.336 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:33.336 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:33.336 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload").st_ino) 2024-03-12T17:30:33.336 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:33.522 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629894 2024-03-12T17:30:33.704 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:33.704 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:33.704 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:33.704 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:33.704 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/rados-snaps-few-objects.yaml").st_ino) 2024-03-12T17:30:33.704 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:33.891 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628913 2024-03-12T17:30:34.072 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:34.072 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:34.072 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:34.072 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:34.072 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/+").st_ino) 2024-03-12T17:30:34.072 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:34.267 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629895 2024-03-12T17:30:34.448 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:34.448 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:34.448 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:34.448 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:34.449 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/rados_loadgenmix.yaml").st_ino) 2024-03-12T17:30:34.449 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:34.648 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628914 2024-03-12T17:30:34.829 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:34.829 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:34.829 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:34.829 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:34.829 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/rbd_cls.yaml").st_ino) 2024-03-12T17:30:34.829 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:35.022 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628916 2024-03-12T17:30:35.203 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:35.203 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:35.203 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:35.204 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:35.204 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/rados_mon_thrash.yaml").st_ino) 2024-03-12T17:30:35.204 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:35.397 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628915 2024-03-12T17:30:35.578 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:35.578 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:35.578 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:35.578 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:35.578 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/rbd_import_export.yaml").st_ino) 2024-03-12T17:30:35.578 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:35.775 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628917 2024-03-12T17:30:35.956 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:35.956 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:35.956 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:35.956 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:35.956 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/9-final-workload/rgw_s3tests.yaml").st_ino) 2024-03-12T17:30:35.956 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:36.145 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628918 2024-03-12T17:30:36.326 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:36.326 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:36.326 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:36.326 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:36.326 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload").st_ino) 2024-03-12T17:30:36.327 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:36.502 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629882 2024-03-12T17:30:36.684 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:36.684 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:36.684 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:36.685 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:36.685 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload/test_rbd_python.yaml").st_ino) 2024-03-12T17:30:36.685 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:36.875 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628904 2024-03-12T17:30:37.057 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:37.057 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:37.057 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:37.057 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:37.057 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload/rados_api.yaml").st_ino) 2024-03-12T17:30:37.057 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:37.252 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628901 2024-03-12T17:30:37.431 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:37.431 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:37.431 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:37.432 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:37.432 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload/rados_loadgenbig.yaml").st_ino) 2024-03-12T17:30:37.432 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:37.627 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628902 2024-03-12T17:30:37.807 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:37.808 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:37.808 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:37.808 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:37.808 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload/ec-rados-default.yaml").st_ino) 2024-03-12T17:30:37.808 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:37.999 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628900 2024-03-12T17:30:38.180 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:38.180 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:38.180 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:38.180 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:38.180 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload/+").st_ino) 2024-03-12T17:30:38.180 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:38.374 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629883 2024-03-12T17:30:38.556 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:38.556 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:38.556 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:38.556 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:38.556 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/2-workload/test_rbd_api.yaml").st_ino) 2024-03-12T17:30:38.556 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:38.749 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628903 2024-03-12T17:30:38.929 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:38.930 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:38.930 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:38.930 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:38.930 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload").st_ino) 2024-03-12T17:30:38.930 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:39.118 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629889 2024-03-12T17:30:39.299 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:39.299 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:39.299 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:39.299 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:39.299 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload/test_rbd_python.yaml").st_ino) 2024-03-12T17:30:39.299 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:39.494 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628911 2024-03-12T17:30:39.675 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:39.675 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:39.675 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:39.675 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:39.675 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload/rados_api.yaml").st_ino) 2024-03-12T17:30:39.675 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:39.868 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628908 2024-03-12T17:30:40.049 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:40.049 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:40.049 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:40.050 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:40.050 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload/rados_loadgenbig.yaml").st_ino) 2024-03-12T17:30:40.050 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:40.244 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628909 2024-03-12T17:30:40.425 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:40.425 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:40.425 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:40.425 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:40.425 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload/ec-rados-default.yaml").st_ino) 2024-03-12T17:30:40.425 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:40.618 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628907 2024-03-12T17:30:40.799 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:40.799 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:40.799 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:40.800 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:40.800 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload/+").st_ino) 2024-03-12T17:30:40.800 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:40.983 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629890 2024-03-12T17:30:41.163 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:41.163 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:41.163 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:41.163 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:41.163 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/6-workload/test_rbd_api.yaml").st_ino) 2024-03-12T17:30:41.163 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:41.363 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628910 2024-03-12T17:30:41.545 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:41.545 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:41.545 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:41.545 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:41.545 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/5-hammer-jewel-x-upgrade").st_ino) 2024-03-12T17:30:41.545 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:41.739 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629887 2024-03-12T17:30:41.920 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:41.920 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:41.920 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:41.920 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:41.920 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/5-hammer-jewel-x-upgrade/hammer-jewel-x.yaml").st_ino) 2024-03-12T17:30:41.920 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:42.113 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629888 2024-03-12T17:30:42.294 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:42.294 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:42.294 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:42.294 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:42.294 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/0-cluster").st_ino) 2024-03-12T17:30:42.294 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:42.484 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629878 2024-03-12T17:30:42.666 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:42.666 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:42.666 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:42.666 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:42.666 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/parallel/0-cluster/start.yaml").st_ino) 2024-03-12T17:30:42.666 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:42.860 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629879 2024-03-12T17:30:43.041 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:43.041 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:43.041 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:43.041 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:43.041 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split").st_ino) 2024-03-12T17:30:43.041 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:43.234 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629898 2024-03-12T17:30:43.414 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:43.415 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:43.415 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:43.415 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:43.415 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/6-next-mon").st_ino) 2024-03-12T17:30:43.415 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:43.610 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629907 2024-03-12T17:30:43.790 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:43.790 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:43.791 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:43.791 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:43.791 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/8-next-mon").st_ino) 2024-03-12T17:30:43.791 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:43.985 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629909 2024-03-12T17:30:44.166 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:44.166 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:44.166 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:44.166 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:44.166 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/5-workload").st_ino) 2024-03-12T17:30:44.166 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:44.194 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:30:44.220 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:30:44.336 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629906 2024-03-12T17:30:44.518 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:44.518 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:44.518 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:44.518 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:44.519 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/4-mon").st_ino) 2024-03-12T17:30:44.519 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:44.710 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629905 2024-03-12T17:30:44.890 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:44.890 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:44.890 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:44.890 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:44.890 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/distros").st_ino) 2024-03-12T17:30:44.890 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:45.083 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629911 2024-03-12T17:30:45.263 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:45.263 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:45.263 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:45.263 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:45.263 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/distros/centos_7.2.yaml").st_ino) 2024-03-12T17:30:45.263 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:45.457 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629912 2024-03-12T17:30:45.638 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:45.638 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:45.638 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:45.638 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:45.638 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/distros/ubuntu_14.04.yaml").st_ino) 2024-03-12T17:30:45.638 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:45.830 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628920 2024-03-12T17:30:46.011 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:46.011 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:46.012 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:46.012 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:46.012 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/%").st_ino) 2024-03-12T17:30:46.012 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:46.205 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629899 2024-03-12T17:30:46.387 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:46.387 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:46.387 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:46.387 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:46.387 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/9-workload").st_ino) 2024-03-12T17:30:46.387 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:46.569 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629910 2024-03-12T17:30:46.749 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:46.750 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:46.750 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:46.750 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:46.750 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/1-hammer-install-and-upgrade-to-jewel").st_ino) 2024-03-12T17:30:46.750 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:46.945 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629901 2024-03-12T17:30:47.126 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:47.126 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:47.126 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:47.126 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:47.126 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/1-hammer-install-and-upgrade-to-jewel/hammer-to-jewel.yaml").st_ino) 2024-03-12T17:30:47.126 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:47.319 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629902 2024-03-12T17:30:47.499 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:47.499 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:47.500 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:47.500 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:47.500 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/2-partial-upgrade").st_ino) 2024-03-12T17:30:47.500 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:47.694 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629903 2024-03-12T17:30:47.876 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:47.876 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:47.876 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:47.876 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:47.876 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/3-thrash").st_ino) 2024-03-12T17:30:47.876 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:48.067 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629904 2024-03-12T17:30:48.248 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:48.249 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:48.249 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:48.249 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:48.249 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/7-workload").st_ino) 2024-03-12T17:30:48.249 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:48.442 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629908 2024-03-12T17:30:48.624 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:48.624 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:48.624 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:48.624 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:48.624 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/hammer-jewel-x/stress-split/0-cluster").st_ino) 2024-03-12T17:30:48.624 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:48.809 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629900 2024-03-12T17:30:48.988 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:48.989 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:48.989 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:48.989 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:48.989 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade").st_ino) 2024-03-12T17:30:48.989 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:49.176 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629840 2024-03-12T17:30:49.358 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:49.358 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:49.358 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:49.358 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:49.358 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x").st_ino) 2024-03-12T17:30:49.358 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:49.549 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629841 2024-03-12T17:30:49.731 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:49.731 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:49.731 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:49.731 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:49.731 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd").st_ino) 2024-03-12T17:30:49.731 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:49.927 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629850 2024-03-12T17:30:50.108 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:50.108 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:50.108 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:50.108 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:50.108 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/1-install").st_ino) 2024-03-12T17:30:50.108 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:50.300 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629854 2024-03-12T17:30:50.481 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:50.481 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:50.481 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:50.481 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:50.481 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/1-install/hammer-client-x.yaml").st_ino) 2024-03-12T17:30:50.481 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:50.675 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629855 2024-03-12T17:30:50.856 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:50.856 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:50.856 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:50.856 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:50.856 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/%").st_ino) 2024-03-12T17:30:50.856 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:51.049 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629851 2024-03-12T17:30:51.231 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:51.231 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:51.231 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:51.231 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:51.231 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/2-workload").st_ino) 2024-03-12T17:30:51.231 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:51.425 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629856 2024-03-12T17:30:51.607 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:51.607 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:51.607 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:51.608 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:51.608 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/2-workload/rbd_notification_tests.yaml").st_ino) 2024-03-12T17:30:51.608 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:51.800 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629857 2024-03-12T17:30:51.981 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:51.981 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:51.981 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:51.982 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:51.982 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/0-cluster").st_ino) 2024-03-12T17:30:51.982 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:52.174 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629852 2024-03-12T17:30:52.355 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:52.355 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:52.355 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:52.355 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:52.355 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/rbd/0-cluster/start.yaml").st_ino) 2024-03-12T17:30:52.355 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:52.549 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629853 2024-03-12T17:30:52.729 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:52.729 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:52.730 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:52.730 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:52.730 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic").st_ino) 2024-03-12T17:30:52.730 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:52.919 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629842 2024-03-12T17:30:53.100 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:53.100 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:53.100 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:53.100 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:53.101 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/1-install").st_ino) 2024-03-12T17:30:53.101 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:53.297 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629846 2024-03-12T17:30:53.478 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:53.478 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:53.478 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:53.478 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:53.479 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/1-install/hammer-client-x.yaml").st_ino) 2024-03-12T17:30:53.479 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:53.675 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629847 2024-03-12T17:30:53.856 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:53.856 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:53.856 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:53.856 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:53.856 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/%").st_ino) 2024-03-12T17:30:53.856 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:54.041 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629843 2024-03-12T17:30:54.222 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:54.222 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:54.222 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:54.222 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:54.223 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/2-workload").st_ino) 2024-03-12T17:30:54.223 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:54.420 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629848 2024-03-12T17:30:54.600 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:54.601 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:54.601 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:54.601 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:54.601 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/2-workload/rbd_cli_import_export.yaml").st_ino) 2024-03-12T17:30:54.601 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:54.794 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628898 2024-03-12T17:30:54.974 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:54.974 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:54.974 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:54.974 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:54.974 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/2-workload/rbd_api_tests.yaml").st_ino) 2024-03-12T17:30:54.974 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:55.168 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629849 2024-03-12T17:30:55.349 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:55.350 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:55.350 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:55.350 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:55.350 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/0-cluster").st_ino) 2024-03-12T17:30:55.350 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:55.542 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629844 2024-03-12T17:30:55.722 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:55.722 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:55.722 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:55.722 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:55.723 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/hammer-client-x/basic/0-cluster/start.yaml").st_ino) 2024-03-12T17:30:55.723 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:55.917 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629845 2024-03-12T17:30:56.097 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:56.097 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:56.098 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:56.098 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:56.098 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x").st_ino) 2024-03-12T17:30:56.098 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:56.291 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629858 2024-03-12T17:30:56.472 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:56.472 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:56.472 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:56.472 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:56.472 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd").st_ino) 2024-03-12T17:30:56.473 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:56.666 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629867 2024-03-12T17:30:56.848 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:56.848 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:56.848 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:56.848 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:56.848 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/1-install").st_ino) 2024-03-12T17:30:56.848 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:57.044 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629871 2024-03-12T17:30:57.225 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:57.225 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:57.225 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:57.225 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:57.225 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/1-install/jewel-client-x.yaml").st_ino) 2024-03-12T17:30:57.225 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:57.419 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629872 2024-03-12T17:30:57.600 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:57.600 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:57.600 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:57.600 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:57.600 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/%").st_ino) 2024-03-12T17:30:57.600 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:57.797 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629868 2024-03-12T17:30:57.977 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:57.977 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:57.977 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:57.977 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:57.977 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/2-workload").st_ino) 2024-03-12T17:30:57.977 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:58.170 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629873 2024-03-12T17:30:58.350 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:58.350 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:58.350 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:58.350 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:58.350 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/2-workload/rbd_notification_tests.yaml").st_ino) 2024-03-12T17:30:58.351 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:58.543 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629874 2024-03-12T17:30:58.724 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:58.724 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:58.724 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:58.725 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:58.725 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/0-cluster").st_ino) 2024-03-12T17:30:58.725 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:58.926 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629869 2024-03-12T17:30:59.106 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:59.106 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:59.106 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:59.106 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:59.107 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/rbd/0-cluster/start.yaml").st_ino) 2024-03-12T17:30:59.107 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:59.303 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629870 2024-03-12T17:30:59.484 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:59.484 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:59.484 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:59.485 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:59.485 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic").st_ino) 2024-03-12T17:30:59.485 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:30:59.679 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629859 2024-03-12T17:30:59.860 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:30:59.860 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:30:59.860 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:30:59.861 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:30:59.861 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/1-install").st_ino) 2024-03-12T17:30:59.861 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:00.051 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629863 2024-03-12T17:31:00.232 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:00.232 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:00.232 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:00.232 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:00.232 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/1-install/jewel-client-x.yaml").st_ino) 2024-03-12T17:31:00.232 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:00.423 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629864 2024-03-12T17:31:00.604 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:00.604 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:00.604 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:00.604 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:00.604 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/%").st_ino) 2024-03-12T17:31:00.605 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:00.792 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629860 2024-03-12T17:31:00.973 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:00.973 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:00.973 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:00.973 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:00.973 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/2-workload").st_ino) 2024-03-12T17:31:00.973 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:01.167 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629865 2024-03-12T17:31:01.348 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:01.349 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:01.349 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:01.349 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:01.349 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/2-workload/rbd_cli_import_export.yaml").st_ino) 2024-03-12T17:31:01.349 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:01.541 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628899 2024-03-12T17:31:01.721 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:01.722 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:01.722 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:01.722 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:01.722 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/2-workload/rbd_api_tests.yaml").st_ino) 2024-03-12T17:31:01.722 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:01.915 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629866 2024-03-12T17:31:02.096 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:02.096 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:02.096 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:02.096 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:02.096 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/0-cluster").st_ino) 2024-03-12T17:31:02.096 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:02.290 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629861 2024-03-12T17:31:02.472 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:02.472 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:02.472 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:02.472 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:02.472 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/upgrade/client-upgrade/jewel-client-x/basic/0-cluster/start.yaml").st_ino) 2024-03-12T17:31:02.472 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:02.671 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629862 2024-03-12T17:31:02.852 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:02.852 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:02.852 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:02.852 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:02.852 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/dummy").st_ino) 2024-03-12T17:31:02.852 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:03.046 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628422 2024-03-12T17:31:03.226 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:03.226 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:03.226 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:03.226 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:03.226 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/dummy/%").st_ino) 2024-03-12T17:31:03.227 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:03.420 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628423 2024-03-12T17:31:03.600 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:03.600 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:03.600 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:03.600 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:03.600 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/dummy/all").st_ino) 2024-03-12T17:31:03.600 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:03.792 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628424 2024-03-12T17:31:03.973 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:03.973 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:03.973 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:03.973 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:03.973 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/dummy/all/nop.yaml").st_ino) 2024-03-12T17:31:03.973 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:04.169 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628425 2024-03-12T17:31:04.351 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:04.351 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:04.351 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:04.351 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:04.352 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/hadoop").st_ino) 2024-03-12T17:31:04.352 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:04.546 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628646 2024-03-12T17:31:04.727 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:04.727 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:04.727 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:04.727 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:04.727 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/hadoop/basic").st_ino) 2024-03-12T17:31:04.727 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:04.921 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628647 2024-03-12T17:31:05.101 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:05.102 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:05.102 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:05.102 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:05.102 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/hadoop/basic/clusters").st_ino) 2024-03-12T17:31:05.102 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:05.306 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628649 2024-03-12T17:31:05.487 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:05.487 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:05.487 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:05.487 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:05.487 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/hadoop/basic/clusters/fixed-3.yaml").st_ino) 2024-03-12T17:31:05.487 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:05.687 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628650 2024-03-12T17:31:05.869 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:05.869 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:05.869 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:05.869 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:05.869 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/hadoop/basic/%").st_ino) 2024-03-12T17:31:05.869 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:06.061 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628648 2024-03-12T17:31:06.242 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:06.242 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:06.242 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:06.242 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:06.242 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/hadoop/basic/xfs.yaml").st_ino) 2024-03-12T17:31:06.242 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:06.435 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628653 2024-03-12T17:31:06.616 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:06.616 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:06.616 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:06.616 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:06.617 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/hadoop/basic/tasks").st_ino) 2024-03-12T17:31:06.617 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:06.810 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628651 2024-03-12T17:31:06.990 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:06.990 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:06.991 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:06.991 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:06.991 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/hadoop/basic/tasks/wordcount.yaml").st_ino) 2024-03-12T17:31:06.991 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:07.182 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627941 2024-03-12T17:31:07.363 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:07.363 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:07.363 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:07.363 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:07.363 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/hadoop/basic/tasks/repl.yaml").st_ino) 2024-03-12T17:31:07.363 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:07.559 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628652 2024-03-12T17:31:07.740 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:07.740 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:07.740 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:07.740 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:07.740 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/hadoop/basic/tasks/terasort.yaml").st_ino) 2024-03-12T17:31:07.740 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:07.931 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627940 2024-03-12T17:31:08.112 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:08.112 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:08.112 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:08.112 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:08.112 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology").st_ino) 2024-03-12T17:31:08.112 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:08.308 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629791 2024-03-12T17:31:08.489 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:08.489 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:08.490 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:08.490 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:08.490 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/integration.yaml").st_ino) 2024-03-12T17:31:08.490 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:08.683 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629804 2024-03-12T17:31:08.863 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:08.863 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:08.863 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:08.864 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:08.864 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/nop").st_ino) 2024-03-12T17:31:08.864 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:09.058 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629817 2024-03-12T17:31:09.240 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:09.241 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:09.241 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:09.241 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:09.241 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/nop/%").st_ino) 2024-03-12T17:31:09.241 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:09.433 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629818 2024-03-12T17:31:09.613 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:09.613 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:09.613 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:09.613 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:09.613 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/nop/all").st_ino) 2024-03-12T17:31:09.614 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:09.806 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629819 2024-03-12T17:31:09.987 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:09.987 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:09.987 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:09.988 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:09.988 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/nop/all/nop.yaml").st_ino) 2024-03-12T17:31:09.988 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:10.178 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629820 2024-03-12T17:31:10.360 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:10.360 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:10.360 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:10.360 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:10.360 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/rgw").st_ino) 2024-03-12T17:31:10.360 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:10.554 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629821 2024-03-12T17:31:10.734 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:10.734 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:10.735 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:10.735 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:10.735 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/rgw/distros").st_ino) 2024-03-12T17:31:10.735 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:10.934 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629823 2024-03-12T17:31:11.115 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:11.115 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:11.115 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:11.115 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:11.115 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/rgw/%").st_ino) 2024-03-12T17:31:11.115 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:11.307 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629822 2024-03-12T17:31:11.489 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:11.489 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:11.489 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:11.489 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:11.489 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/rgw/tasks").st_ino) 2024-03-12T17:31:11.489 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:11.681 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629824 2024-03-12T17:31:11.863 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:11.863 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:11.863 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:11.863 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:11.863 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/rgw/tasks/s3tests-fastcgi.yaml").st_ino) 2024-03-12T17:31:11.863 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:12.043 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628883 2024-03-12T17:31:12.224 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:12.224 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:12.224 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:12.224 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:12.224 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/rgw/tasks/s3tests-fcgi.yaml").st_ino) 2024-03-12T17:31:12.224 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:12.411 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628884 2024-03-12T17:31:12.593 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:12.593 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:12.593 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:12.593 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:12.593 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/rgw/tasks/s3tests-civetweb.yaml").st_ino) 2024-03-12T17:31:12.593 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:12.786 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629825 2024-03-12T17:31:12.967 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:12.967 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:12.967 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:12.968 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:12.968 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/no-ceph").st_ino) 2024-03-12T17:31:12.968 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:13.157 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629811 2024-03-12T17:31:13.338 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:13.338 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:13.338 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:13.338 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:13.338 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/no-ceph/clusters").st_ino) 2024-03-12T17:31:13.338 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:13.534 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629813 2024-03-12T17:31:13.716 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:13.716 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:13.716 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:13.716 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:13.716 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/no-ceph/clusters/single.yaml").st_ino) 2024-03-12T17:31:13.717 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:13.896 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629814 2024-03-12T17:31:14.077 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:14.078 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:14.078 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:14.078 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:14.078 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/no-ceph/%").st_ino) 2024-03-12T17:31:14.078 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:14.270 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629812 2024-03-12T17:31:14.350 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:31:14.359 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:31:14.450 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:14.450 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:14.450 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:14.450 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:14.451 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/no-ceph/tasks").st_ino) 2024-03-12T17:31:14.451 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:14.580 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629815 2024-03-12T17:31:14.761 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:14.761 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:14.761 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:14.761 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:14.761 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/no-ceph/tasks/teuthology.yaml").st_ino) 2024-03-12T17:31:14.761 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:14.897 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629816 2024-03-12T17:31:15.077 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:15.077 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:15.077 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:15.077 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:15.077 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/ceph").st_ino) 2024-03-12T17:31:15.078 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:15.274 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629797 2024-03-12T17:31:15.455 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:15.455 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:15.455 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:15.455 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:15.455 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/ceph/clusters").st_ino) 2024-03-12T17:31:15.455 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:15.644 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629799 2024-03-12T17:31:15.825 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:15.826 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:15.826 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:15.826 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:15.826 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/ceph/clusters/single.yaml").st_ino) 2024-03-12T17:31:15.826 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:16.019 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629800 2024-03-12T17:31:16.201 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:16.201 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:16.201 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:16.201 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:16.201 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/ceph/distros").st_ino) 2024-03-12T17:31:16.201 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:16.395 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629801 2024-03-12T17:31:16.576 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:16.576 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:16.576 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:16.576 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:16.577 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/ceph/%").st_ino) 2024-03-12T17:31:16.577 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:16.772 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629798 2024-03-12T17:31:16.952 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:16.952 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:16.952 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:16.952 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:16.952 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/ceph/tasks").st_ino) 2024-03-12T17:31:16.952 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:17.146 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629802 2024-03-12T17:31:17.327 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:17.327 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:17.327 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:17.327 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:17.327 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/ceph/tasks/teuthology.yaml").st_ino) 2024-03-12T17:31:17.327 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:17.522 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629803 2024-03-12T17:31:17.703 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:17.703 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:17.703 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:17.703 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:17.703 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/buildpackages").st_ino) 2024-03-12T17:31:17.703 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:17.899 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629792 2024-03-12T17:31:18.079 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:18.079 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:18.079 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:18.080 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:18.080 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/buildpackages/distros").st_ino) 2024-03-12T17:31:18.080 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:18.273 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629794 2024-03-12T17:31:18.454 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:18.455 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:18.455 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:18.455 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:18.455 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/buildpackages/%").st_ino) 2024-03-12T17:31:18.455 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:18.648 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629793 2024-03-12T17:31:18.828 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:18.828 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:18.828 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:18.828 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:18.828 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/buildpackages/tasks").st_ino) 2024-03-12T17:31:18.828 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:19.009 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629795 2024-03-12T17:31:19.190 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:19.190 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:19.190 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:19.190 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:19.190 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/buildpackages/tasks/default.yaml").st_ino) 2024-03-12T17:31:19.190 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:19.382 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628878 2024-03-12T17:31:19.563 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:19.564 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:19.564 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:19.564 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:19.564 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/buildpackages/tasks/tag.yaml").st_ino) 2024-03-12T17:31:19.564 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:19.757 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628879 2024-03-12T17:31:19.939 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:19.939 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:19.939 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:19.939 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:19.939 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/buildpackages/tasks/branch.yaml").st_ino) 2024-03-12T17:31:19.939 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:20.137 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629796 2024-03-12T17:31:20.318 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:20.318 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:20.318 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:20.318 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:20.318 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/multi-cluster").st_ino) 2024-03-12T17:31:20.318 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:20.512 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629805 2024-03-12T17:31:20.693 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:20.693 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:20.693 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:20.693 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:20.693 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/multi-cluster/fs").st_ino) 2024-03-12T17:31:20.693 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:20.886 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629809 2024-03-12T17:31:21.068 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:21.068 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:21.068 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:21.068 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:21.068 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/multi-cluster/fs/xfs.yaml").st_ino) 2024-03-12T17:31:21.068 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:21.259 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629810 2024-03-12T17:31:21.440 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:21.440 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:21.440 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:21.440 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:21.440 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/multi-cluster/%").st_ino) 2024-03-12T17:31:21.440 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:21.644 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629806 2024-03-12T17:31:21.825 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:21.825 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:21.825 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:21.825 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:21.825 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/multi-cluster/all").st_ino) 2024-03-12T17:31:21.826 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:22.017 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629807 2024-03-12T17:31:22.199 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:22.199 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:22.199 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:22.199 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:22.200 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/multi-cluster/all/thrashosds.yaml").st_ino) 2024-03-12T17:31:22.200 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:22.392 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628880 2024-03-12T17:31:22.572 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:22.572 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:22.572 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:22.573 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:22.573 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/multi-cluster/all/ceph.yaml").st_ino) 2024-03-12T17:31:22.573 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:22.755 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629808 2024-03-12T17:31:22.936 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:22.936 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:22.937 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:22.937 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:22.937 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/multi-cluster/all/upgrade.yaml").st_ino) 2024-03-12T17:31:22.937 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:23.132 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628881 2024-03-12T17:31:23.314 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:23.314 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:23.314 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:23.314 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:23.314 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/multi-cluster/all/workunit.yaml").st_ino) 2024-03-12T17:31:23.314 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:23.507 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628882 2024-03-12T17:31:23.688 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:23.688 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:23.688 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:23.688 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:23.688 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/workunits").st_ino) 2024-03-12T17:31:23.689 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:23.883 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629826 2024-03-12T17:31:24.063 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:24.063 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:24.063 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:24.064 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:24.064 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/teuthology/workunits/yes.yaml").st_ino) 2024-03-12T17:31:24.064 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:24.257 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629827 2024-03-12T17:31:24.438 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:24.438 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:24.438 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:24.438 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:24.438 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds").st_ino) 2024-03-12T17:31:24.438 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:24.630 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628815 2024-03-12T17:31:24.811 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:24.811 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:24.811 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:24.811 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:24.811 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic").st_ino) 2024-03-12T17:31:24.811 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:25.004 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628816 2024-03-12T17:31:25.185 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:25.185 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:25.185 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:25.185 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:25.185 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/overrides").st_ino) 2024-03-12T17:31:25.185 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:25.367 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628827 2024-03-12T17:31:25.548 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:25.549 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:25.549 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:25.549 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:25.549 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/overrides/fuse-default-perm-no.yaml").st_ino) 2024-03-12T17:31:25.549 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:25.742 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628830 2024-03-12T17:31:25.922 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:25.923 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:25.923 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:25.923 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:25.923 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/overrides/basic").st_ino) 2024-03-12T17:31:25.923 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:26.118 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628829 2024-03-12T17:31:26.299 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:26.299 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:26.299 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:26.299 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:26.299 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/overrides/%").st_ino) 2024-03-12T17:31:26.299 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:26.493 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628828 2024-03-12T17:31:26.674 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:26.674 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:26.674 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:26.674 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:26.674 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/clusters").st_ino) 2024-03-12T17:31:26.674 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:26.867 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628819 2024-03-12T17:31:27.049 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:27.049 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:27.049 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:27.049 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:27.049 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/clusters/9-mds.yaml").st_ino) 2024-03-12T17:31:27.049 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:27.240 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628821 2024-03-12T17:31:27.421 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:27.421 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:27.421 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:27.421 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:27.421 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/clusters/3-mds.yaml").st_ino) 2024-03-12T17:31:27.421 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:27.617 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628820 2024-03-12T17:31:27.797 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:27.797 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:27.797 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:27.797 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:27.797 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/fs").st_ino) 2024-03-12T17:31:27.797 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:27.991 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628822 2024-03-12T17:31:28.173 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:28.173 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:28.173 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:28.173 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:28.173 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/mount").st_ino) 2024-03-12T17:31:28.173 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:28.370 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628824 2024-03-12T17:31:28.552 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:28.552 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:28.552 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:28.552 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:28.552 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/mount/kclient.yaml").st_ino) 2024-03-12T17:31:28.552 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:28.749 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628826 2024-03-12T17:31:28.931 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:28.931 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:28.931 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:28.931 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:28.931 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/mount/fuse.yaml").st_ino) 2024-03-12T17:31:28.931 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:29.124 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628825 2024-03-12T17:31:29.304 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:29.304 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:29.304 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:29.304 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:29.304 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/inline").st_ino) 2024-03-12T17:31:29.304 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:29.498 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628823 2024-03-12T17:31:29.680 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:29.680 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:29.680 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:29.680 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:29.680 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/begin.yaml").st_ino) 2024-03-12T17:31:29.680 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:29.875 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628818 2024-03-12T17:31:30.056 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:30.056 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:30.056 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:30.057 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:30.057 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/%").st_ino) 2024-03-12T17:31:30.057 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:30.250 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628817 2024-03-12T17:31:30.431 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:30.431 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:30.431 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:30.431 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:30.431 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/basic/tasks").st_ino) 2024-03-12T17:31:30.432 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:30.626 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628831 2024-03-12T17:31:30.805 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:30.805 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:30.805 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:30.805 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:30.806 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify").st_ino) 2024-03-12T17:31:30.806 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:30.998 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628832 2024-03-12T17:31:31.181 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:31.181 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:31.181 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:31.181 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:31.181 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/validater").st_ino) 2024-03-12T17:31:31.181 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:31.373 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628847 2024-03-12T17:31:31.554 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:31.554 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:31.554 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:31.554 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:31.555 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/overrides").st_ino) 2024-03-12T17:31:31.555 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:31.746 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628842 2024-03-12T17:31:31.927 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:31.928 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:31.928 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:31.928 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:31.928 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/overrides/fuse-default-perm-no.yaml").st_ino) 2024-03-12T17:31:31.928 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:32.105 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628844 2024-03-12T17:31:32.285 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:32.285 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:32.285 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:32.285 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:32.285 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/overrides/%").st_ino) 2024-03-12T17:31:32.286 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:32.480 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628843 2024-03-12T17:31:32.661 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:32.661 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:32.661 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:32.661 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:32.661 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/overrides/verify").st_ino) 2024-03-12T17:31:32.661 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:32.858 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628845 2024-03-12T17:31:33.039 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:33.039 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:33.039 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:33.039 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:33.039 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/clusters").st_ino) 2024-03-12T17:31:33.039 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:33.232 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628835 2024-03-12T17:31:33.411 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:33.411 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:33.411 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:33.411 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:33.412 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/clusters/9-mds.yaml").st_ino) 2024-03-12T17:31:33.412 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:33.607 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628837 2024-03-12T17:31:33.788 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:33.788 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:33.788 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:33.788 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:33.788 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/clusters/3-mds.yaml").st_ino) 2024-03-12T17:31:33.788 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:33.982 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628836 2024-03-12T17:31:34.163 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:34.163 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:34.163 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:34.164 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:34.164 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/fs").st_ino) 2024-03-12T17:31:34.164 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:34.357 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628838 2024-03-12T17:31:34.539 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:34.539 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:34.539 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:34.539 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:34.539 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/mount").st_ino) 2024-03-12T17:31:34.539 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:34.733 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628839 2024-03-12T17:31:34.915 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:34.915 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:34.915 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:34.915 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:34.915 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/mount/kclient.yaml").st_ino) 2024-03-12T17:31:34.915 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:35.109 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628841 2024-03-12T17:31:35.290 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:35.290 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:35.291 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:35.291 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:35.291 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/mount/fuse.yaml").st_ino) 2024-03-12T17:31:35.291 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:35.488 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628840 2024-03-12T17:31:35.670 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:35.670 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:35.670 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:35.670 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:35.670 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/begin.yaml").st_ino) 2024-03-12T17:31:35.670 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:35.865 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628834 2024-03-12T17:31:36.045 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:36.045 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:36.045 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:36.045 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:36.045 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/%").st_ino) 2024-03-12T17:31:36.045 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:36.240 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628833 2024-03-12T17:31:36.422 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:36.422 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:36.422 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:36.422 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:36.422 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/multimds/verify/tasks").st_ino) 2024-03-12T17:31:36.422 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:36.615 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628846 2024-03-12T17:31:36.797 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:36.797 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:36.797 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:36.797 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:36.797 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke").st_ino) 2024-03-12T17:31:36.797 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:36.984 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629497 2024-03-12T17:31:37.164 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:37.164 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:37.164 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:37.164 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:37.164 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/1node").st_ino) 2024-03-12T17:31:37.165 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:37.357 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629498 2024-03-12T17:31:37.539 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:37.539 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:37.539 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:37.539 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:37.539 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/1node/clusters").st_ino) 2024-03-12T17:31:37.539 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:37.737 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629500 2024-03-12T17:31:37.918 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:37.918 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:37.919 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:37.919 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:37.919 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/1node/clusters/openstack.yaml").st_ino) 2024-03-12T17:31:37.919 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:38.113 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628263 2024-03-12T17:31:38.293 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:38.293 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:38.293 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:38.294 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:38.294 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/1node/clusters/+").st_ino) 2024-03-12T17:31:38.294 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:38.485 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629501 2024-03-12T17:31:38.666 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:38.666 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:38.666 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:38.667 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:38.667 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/1node/clusters/fixed-1.yaml").st_ino) 2024-03-12T17:31:38.667 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:38.861 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629502 2024-03-12T17:31:39.043 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:39.043 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:39.043 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:39.043 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:39.043 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/1node/%").st_ino) 2024-03-12T17:31:39.043 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:39.238 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629499 2024-03-12T17:31:39.418 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:39.418 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:39.418 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:39.419 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:39.419 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/1node/tasks").st_ino) 2024-03-12T17:31:39.419 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:39.614 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629503 2024-03-12T17:31:39.795 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:39.795 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:39.795 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:39.795 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:39.795 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/1node/tasks/ceph-deploy.yaml").st_ino) 2024-03-12T17:31:39.795 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:39.987 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629504 2024-03-12T17:31:40.168 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:40.168 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:40.168 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:40.168 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:40.168 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/systemd").st_ino) 2024-03-12T17:31:40.168 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:40.361 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629764 2024-03-12T17:31:40.543 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:40.543 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:40.543 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:40.543 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:40.543 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/systemd/distro").st_ino) 2024-03-12T17:31:40.543 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:40.725 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629766 2024-03-12T17:31:40.905 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:40.905 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:40.906 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:40.906 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:40.906 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/systemd/distro/ubuntu_16.04.yaml").st_ino) 2024-03-12T17:31:40.906 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:41.099 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629768 2024-03-12T17:31:41.279 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:41.279 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:41.279 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:41.280 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:41.280 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/systemd/distro/centos_7.2.yaml").st_ino) 2024-03-12T17:31:41.280 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:41.474 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629767 2024-03-12T17:31:41.655 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:41.655 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:41.655 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:41.655 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:41.655 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/systemd/%").st_ino) 2024-03-12T17:31:41.655 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:41.848 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629765 2024-03-12T17:31:42.029 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:42.029 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:42.029 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:42.029 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:42.029 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/systemd/tasks").st_ino) 2024-03-12T17:31:42.029 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:42.220 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629769 2024-03-12T17:31:42.401 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:42.401 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:42.401 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:42.401 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:42.401 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/systemd/tasks/systemd.yaml").st_ino) 2024-03-12T17:31:42.401 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:42.595 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629770 2024-03-12T17:31:42.777 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:42.777 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:42.777 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:42.777 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:42.777 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic").st_ino) 2024-03-12T17:31:42.777 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:42.970 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629505 2024-03-12T17:31:43.151 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:43.151 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:43.151 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:43.151 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:43.152 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/clusters").st_ino) 2024-03-12T17:31:43.152 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:43.344 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629507 2024-03-12T17:31:43.526 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:43.526 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:43.526 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:43.526 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:43.526 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/clusters/fixed-3-cephfs.yaml").st_ino) 2024-03-12T17:31:43.526 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:43.727 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629508 2024-03-12T17:31:43.907 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:43.907 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:43.907 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:43.907 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:43.907 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/fs").st_ino) 2024-03-12T17:31:43.907 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:44.098 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629509 2024-03-12T17:31:44.279 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:44.279 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:44.279 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:44.279 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:44.279 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/fs/btrfs.yaml").st_ino) 2024-03-12T17:31:44.280 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:44.475 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629510 2024-03-12T17:31:44.490 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:31:44.499 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:31:44.656 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:44.656 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:44.656 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:44.656 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:44.656 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/%").st_ino) 2024-03-12T17:31:44.656 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:44.851 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629506 2024-03-12T17:31:45.032 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:45.032 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:45.032 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:45.032 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:45.032 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks").st_ino) 2024-03-12T17:31:45.032 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:45.234 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629511 2024-03-12T17:31:45.415 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:45.415 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:45.415 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:45.415 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:45.415 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/libcephfs_interface_tests.yaml").st_ino) 2024-03-12T17:31:45.415 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:45.609 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628271 2024-03-12T17:31:45.789 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:45.790 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:45.790 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:45.790 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:45.790 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rados_cache_snaps.yaml").st_ino) 2024-03-12T17:31:45.790 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:45.969 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628275 2024-03-12T17:31:46.151 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:46.151 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:46.151 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:46.151 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:46.151 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rados_cls_all.yaml").st_ino) 2024-03-12T17:31:46.151 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:46.344 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628276 2024-03-12T17:31:46.525 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:46.525 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:46.525 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:46.525 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:46.525 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rbd_cli_import_export.yaml").st_ino) 2024-03-12T17:31:46.526 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:46.722 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628863 2024-03-12T17:31:46.903 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:46.903 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:46.903 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:46.903 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:46.903 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/kclient_workunit_suites_fsstress.yaml").st_ino) 2024-03-12T17:31:46.904 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:47.097 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628269 2024-03-12T17:31:47.278 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:47.278 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:47.278 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:47.278 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:47.278 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/cfuse_workunit_suites_pjd.yaml").st_ino) 2024-03-12T17:31:47.278 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:47.458 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628266 2024-03-12T17:31:47.638 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:47.639 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:47.639 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:47.639 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:47.639 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/mon_thrash.yaml").st_ino) 2024-03-12T17:31:47.639 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:47.834 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628272 2024-03-12T17:31:48.014 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:48.015 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:48.015 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:48.015 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:48.015 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/kclient_workunit_direct_io.yaml").st_ino) 2024-03-12T17:31:48.015 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:48.211 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628267 2024-03-12T17:31:48.392 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:48.393 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:48.393 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:48.393 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:48.393 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rbd_fsx.yaml").st_ino) 2024-03-12T17:31:48.393 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:48.586 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628864 2024-03-12T17:31:48.767 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:48.767 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:48.767 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:48.767 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:48.767 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rbd_python_api_tests.yaml").st_ino) 2024-03-12T17:31:48.767 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:48.960 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628865 2024-03-12T17:31:49.142 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:49.142 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:49.142 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:49.142 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:49.142 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rbd_workunit_suites_iozone.yaml").st_ino) 2024-03-12T17:31:49.142 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:49.336 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628866 2024-03-12T17:31:49.518 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:49.518 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:49.518 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:49.518 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:49.518 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/kclient_workunit_suites_dbench.yaml").st_ino) 2024-03-12T17:31:49.518 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:49.710 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628268 2024-03-12T17:31:49.892 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:49.892 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:49.892 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:49.892 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:49.892 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rbd_api_tests.yaml").st_ino) 2024-03-12T17:31:49.892 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:50.086 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628862 2024-03-12T17:31:50.266 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:50.266 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:50.266 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:50.266 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:50.266 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/cfuse_workunit_suites_blogbench.yaml").st_ino) 2024-03-12T17:31:50.266 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:50.459 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629512 2024-03-12T17:31:50.640 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:50.640 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:50.640 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:50.640 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:50.640 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rados_ec_snaps.yaml").st_ino) 2024-03-12T17:31:50.641 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:50.833 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628277 2024-03-12T17:31:51.012 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:51.013 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:51.013 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:51.013 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:51.013 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rgw_ec_s3tests.yaml").st_ino) 2024-03-12T17:31:51.013 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:51.206 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628867 2024-03-12T17:31:51.387 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:51.387 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:51.387 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:51.387 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:51.387 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/kclient_workunit_suites_pjd.yaml").st_ino) 2024-03-12T17:31:51.387 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:51.579 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628270 2024-03-12T17:31:51.761 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:51.761 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:51.761 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:51.761 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:51.761 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rados_workunit_loadgen_mix.yaml").st_ino) 2024-03-12T17:31:51.761 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:51.947 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628861 2024-03-12T17:31:52.128 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:52.128 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:52.128 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:52.128 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:52.128 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rados_python.yaml").st_ino) 2024-03-12T17:31:52.128 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:52.319 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628278 2024-03-12T17:31:52.499 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:52.500 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:52.500 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:52.500 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:52.500 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rgw_swift.yaml").st_ino) 2024-03-12T17:31:52.500 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:52.685 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628869 2024-03-12T17:31:52.866 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:52.867 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:52.867 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:52.867 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:52.867 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rados_bench.yaml").st_ino) 2024-03-12T17:31:52.867 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:53.058 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628274 2024-03-12T17:31:53.240 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:53.240 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:53.240 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:53.240 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:53.240 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rados_api_tests.yaml").st_ino) 2024-03-12T17:31:53.240 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:53.437 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628273 2024-03-12T17:31:53.617 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:53.617 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:53.617 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:53.617 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:53.617 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/cfuse_workunit_suites_fsstress.yaml").st_ino) 2024-03-12T17:31:53.618 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:53.811 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628264 2024-03-12T17:31:53.993 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:53.994 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:53.994 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:53.994 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:53.994 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/rgw_s3tests.yaml").st_ino) 2024-03-12T17:31:53.994 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:54.177 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628868 2024-03-12T17:31:54.357 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:54.357 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:54.358 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:54.358 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:54.358 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/suites/smoke/basic/tasks/cfuse_workunit_suites_iozone.yaml").st_ino) 2024-03-12T17:31:54.358 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:54.552 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628265 2024-03-12T17:31:54.732 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:54.733 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:54.733 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:54.733 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:54.733 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/machine_types").st_ino) 2024-03-12T17:31:54.733 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:54.931 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628343 2024-03-12T17:31:55.111 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:55.111 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:55.112 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:55.112 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:55.112 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/machine_types/vps.yaml").st_ino) 2024-03-12T17:31:55.112 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:55.305 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627874 2024-03-12T17:31:55.485 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:55.485 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:55.485 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:55.485 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:55.485 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/machine_types/schedule_rados_ovh.sh").st_ino) 2024-03-12T17:31:55.485 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:55.687 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627873 2024-03-12T17:31:55.868 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:55.868 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:55.868 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:55.868 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:55.868 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/machine_types/schedule_rados.sh").st_ino) 2024-03-12T17:31:55.868 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:56.060 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628344 2024-03-12T17:31:56.241 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:56.241 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:56.241 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:56.241 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:56.241 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/mon_kv_backend").st_ino) 2024-03-12T17:31:56.241 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:56.434 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628345 2024-03-12T17:31:56.616 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:56.616 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:56.616 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:56.616 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:56.616 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/mon_kv_backend/leveldb.yaml").st_ino) 2024-03-12T17:31:56.616 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:56.811 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628346 2024-03-12T17:31:56.992 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:56.992 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:56.992 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:56.992 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:56.992 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/mon_kv_backend/rocksdb.yaml").st_ino) 2024-03-12T17:31:56.992 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:57.183 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627875 2024-03-12T17:31:57.363 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:57.364 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:57.364 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:57.364 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:57.364 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/README").st_ino) 2024-03-12T17:31:57.364 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:57.556 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627810 2024-03-12T17:31:57.737 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:57.737 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:57.738 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:57.738 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:57.738 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks").st_ino) 2024-03-12T17:31:57.738 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:57.933 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629986 2024-03-12T17:31:58.113 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:58.113 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:58.113 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:58.113 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:58.113 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/rebuild_mondb.py").st_ino) 2024-03-12T17:31:58.113 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:58.314 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629050 2024-03-12T17:31:58.494 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:58.494 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:58.494 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:58.494 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:58.494 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/workunit.py").st_ino) 2024-03-12T17:31:58.494 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:58.696 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629082 2024-03-12T17:31:58.877 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:58.877 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:58.877 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:58.877 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:58.877 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/osd_backfill.py").st_ino) 2024-03-12T17:31:58.877 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:59.067 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629033 2024-03-12T17:31:59.248 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:59.248 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:59.248 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:59.248 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:59.248 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/calamari_setup.py").st_ino) 2024-03-12T17:31:59.248 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:59.440 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628965 2024-03-12T17:31:59.622 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:59.622 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:59.622 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:59.622 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:59.622 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/object_source_down.py").st_ino) 2024-03-12T17:31:59.622 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:31:59.818 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629031 2024-03-12T17:31:59.999 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:31:59.999 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:31:59.999 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:31:59.999 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:31:59.999 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/populate_rbd_pool.py").st_ino) 2024-03-12T17:31:59.999 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:00.191 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629038 2024-03-12T17:32:00.372 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:00.372 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:00.372 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:00.372 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:00.372 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/util").st_ino) 2024-03-12T17:32:00.372 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:00.565 INFO:teuthology.orchestra.run.smithi017.stdout:1099511630002 2024-03-12T17:32:00.746 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:00.746 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:00.746 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:00.747 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:00.747 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/util/rgw.py").st_ino) 2024-03-12T17:32:00.747 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:00.941 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629077 2024-03-12T17:32:01.121 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:01.122 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:01.122 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:01.122 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:01.122 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/util/__init__.py").st_ino) 2024-03-12T17:32:01.122 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:01.314 INFO:teuthology.orchestra.run.smithi017.stdout:1099511630003 2024-03-12T17:32:01.495 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:01.495 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:01.495 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:01.495 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:01.495 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/util/rados.py").st_ino) 2024-03-12T17:32:01.495 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:01.688 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629076 2024-03-12T17:32:01.869 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:01.869 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:01.869 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:01.869 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:01.869 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/util/test").st_ino) 2024-03-12T17:32:01.870 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:02.056 INFO:teuthology.orchestra.run.smithi017.stdout:1099511630004 2024-03-12T17:32:02.236 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:02.236 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:02.236 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:02.236 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:02.236 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/util/test/__init__.py").st_ino) 2024-03-12T17:32:02.237 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:02.429 INFO:teuthology.orchestra.run.smithi017.stdout:1099511630005 2024-03-12T17:32:02.610 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:02.610 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:02.610 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:02.610 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:02.610 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/util/test/test_rados.py").st_ino) 2024-03-12T17:32:02.611 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:02.802 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629078 2024-03-12T17:32:02.983 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:02.983 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:02.983 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:02.983 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:02.983 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/osd_failsafe_enospc.py").st_ino) 2024-03-12T17:32:02.983 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:03.177 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629034 2024-03-12T17:32:03.358 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:03.358 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:03.358 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:03.358 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:03.358 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/osd_recovery.py").st_ino) 2024-03-12T17:32:03.358 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:03.538 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629035 2024-03-12T17:32:03.718 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:03.719 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:03.719 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:03.719 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:03.719 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/die_on_err.py").st_ino) 2024-03-12T17:32:03.719 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:03.917 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629007 2024-03-12T17:32:04.097 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:04.097 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:04.097 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:04.097 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:04.097 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/calamari_nosetests.py").st_ino) 2024-03-12T17:32:04.097 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:04.289 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628964 2024-03-12T17:32:04.471 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:04.471 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:04.471 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:04.471 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:04.471 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/admin_socket.py").st_ino) 2024-03-12T17:32:04.471 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:04.663 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628950 2024-03-12T17:32:04.843 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:04.843 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:04.843 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:04.843 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:04.843 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/mgr").st_ino) 2024-03-12T17:32:04.844 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:05.035 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629998 2024-03-12T17:32:05.216 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:05.216 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:05.216 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:05.216 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:05.216 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/mgr/__init__.py").st_ino) 2024-03-12T17:32:05.216 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:05.401 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629999 2024-03-12T17:32:05.582 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:05.582 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:05.582 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:05.582 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:05.582 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/mgr/test_failover.py").st_ino) 2024-03-12T17:32:05.583 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:05.776 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629022 2024-03-12T17:32:05.958 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:05.958 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:05.958 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:05.958 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:05.958 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/mgr/mgr_test_case.py").st_ino) 2024-03-12T17:32:05.958 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:06.151 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629021 2024-03-12T17:32:06.332 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:06.332 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:06.332 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:06.332 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:06.332 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/thrash_pool_snaps.py").st_ino) 2024-03-12T17:32:06.332 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:06.537 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629072 2024-03-12T17:32:06.717 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:06.717 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:06.717 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:06.717 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:06.717 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/userdata_teardown.yaml").st_ino) 2024-03-12T17:32:06.717 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:06.912 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629075 2024-03-12T17:32:07.092 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:07.092 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:07.092 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:07.092 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:07.093 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/radosbenchsweep.py").st_ino) 2024-03-12T17:32:07.093 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:07.285 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629042 2024-03-12T17:32:07.466 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:07.466 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:07.466 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:07.466 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:07.467 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/mds_thrash.py").st_ino) 2024-03-12T17:32:07.467 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:07.661 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629019 2024-03-12T17:32:07.843 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:07.843 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:07.843 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:07.843 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:07.843 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/rbd.py").st_ino) 2024-03-12T17:32:07.843 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:08.039 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629046 2024-03-12T17:32:08.220 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:08.220 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:08.220 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:08.220 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:08.220 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/rgw.py").st_ino) 2024-03-12T17:32:08.220 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:08.413 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629058 2024-03-12T17:32:08.594 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:08.594 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:08.594 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:08.594 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:08.594 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/teuthology_integration.py").st_ino) 2024-03-12T17:32:08.594 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:08.788 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629070 2024-03-12T17:32:08.969 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:08.969 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:08.969 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:08.969 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:08.969 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/mon_seesaw.py").st_ino) 2024-03-12T17:32:08.969 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:09.160 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629028 2024-03-12T17:32:09.341 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:09.341 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:09.342 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:09.342 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:09.342 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/repair_test.py").st_ino) 2024-03-12T17:32:09.342 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:09.537 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629054 2024-03-12T17:32:09.718 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:09.718 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:09.718 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:09.718 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:09.718 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/watch_notify_same_primary.py").st_ino) 2024-03-12T17:32:09.718 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:09.908 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629080 2024-03-12T17:32:10.089 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:10.090 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:10.090 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:10.090 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:10.090 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/peer.py").st_ino) 2024-03-12T17:32:10.090 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:10.281 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629036 2024-03-12T17:32:10.462 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:10.462 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:10.462 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:10.462 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:10.463 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/restart.py").st_ino) 2024-03-12T17:32:10.463 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:10.657 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629057 2024-03-12T17:32:10.839 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:10.839 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:10.839 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:10.839 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:10.839 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/ceph.py").st_ino) 2024-03-12T17:32:10.839 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:11.032 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628966 2024-03-12T17:32:11.213 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:11.214 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:11.214 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:11.214 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:11.214 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/tests").st_ino) 2024-03-12T17:32:11.214 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:11.415 INFO:teuthology.orchestra.run.smithi017.stdout:1099511630000 2024-03-12T17:32:11.596 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:11.596 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:11.596 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:11.596 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:11.596 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/tests/test_buildpackages.py").st_ino) 2024-03-12T17:32:11.596 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:11.797 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629067 2024-03-12T17:32:11.977 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:11.977 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:11.977 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:11.978 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:11.978 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/tests/test_radosgw_admin.py").st_ino) 2024-03-12T17:32:11.978 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:12.171 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629069 2024-03-12T17:32:12.351 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:12.351 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:12.351 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:12.351 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:12.351 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/tests/test_devstack.py").st_ino) 2024-03-12T17:32:12.351 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:12.545 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629068 2024-03-12T17:32:12.726 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:12.726 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:12.726 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:12.726 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:12.726 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/tests/__init__.py").st_ino) 2024-03-12T17:32:12.726 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:12.915 INFO:teuthology.orchestra.run.smithi017.stdout:1099511630001 2024-03-12T17:32:13.096 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:13.096 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:13.096 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:13.096 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:13.096 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/rgw_logsocket.py").st_ino) 2024-03-12T17:32:13.096 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:13.292 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629059 2024-03-12T17:32:13.474 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:13.474 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:13.475 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:13.475 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:13.475 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/radosgw_admin.py").st_ino) 2024-03-12T17:32:13.475 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:13.671 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629043 2024-03-12T17:32:13.852 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:13.852 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:13.852 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:13.852 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:13.852 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/ceph_client.py").st_ino) 2024-03-12T17:32:13.852 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:14.037 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628967 2024-03-12T17:32:14.218 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:14.218 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:14.219 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:14.219 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:14.219 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/__init__.py").st_ino) 2024-03-12T17:32:14.219 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:14.418 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629987 2024-03-12T17:32:14.598 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:14.599 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:14.599 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:14.599 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:14.599 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/aver.py").st_ino) 2024-03-12T17:32:14.599 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:14.630 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:32:14.654 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:32:14.771 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628953 2024-03-12T17:32:14.953 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:14.953 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:14.953 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:14.953 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:14.953 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cram.py").st_ino) 2024-03-12T17:32:14.953 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:15.154 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629004 2024-03-12T17:32:15.334 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:15.334 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:15.334 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:15.334 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:15.334 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs").st_ino) 2024-03-12T17:32:15.334 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:15.528 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629996 2024-03-12T17:32:15.709 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:15.709 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:15.709 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:15.709 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:15.709 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_misc.py").st_ino) 2024-03-12T17:32:15.709 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:15.900 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628995 2024-03-12T17:32:16.081 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:16.081 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:16.081 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:16.081 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:16.082 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_client_limits.py").st_ino) 2024-03-12T17:32:16.082 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:16.276 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628981 2024-03-12T17:32:16.457 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:16.457 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:16.457 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:16.457 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:16.457 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_pool_perm.py").st_ino) 2024-03-12T17:32:16.457 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:16.654 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628996 2024-03-12T17:32:16.836 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:16.836 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:16.836 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:16.836 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:16.836 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_data_scan.py").st_ino) 2024-03-12T17:32:16.837 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:17.023 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628985 2024-03-12T17:32:17.204 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:17.204 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:17.204 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:17.204 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:17.204 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_client_recovery.py").st_ino) 2024-03-12T17:32:17.204 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:17.397 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628982 2024-03-12T17:32:17.578 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:17.578 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:17.578 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:17.578 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:17.578 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_journal_migration.py").st_ino) 2024-03-12T17:32:17.578 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:17.772 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628992 2024-03-12T17:32:17.952 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:17.952 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:17.952 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:17.952 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:17.952 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_dump_tree.py").st_ino) 2024-03-12T17:32:17.953 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:18.139 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628986 2024-03-12T17:32:18.320 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:18.320 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:18.320 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:18.320 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:18.320 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_mantle.py").st_ino) 2024-03-12T17:32:18.320 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:18.514 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628994 2024-03-12T17:32:18.695 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:18.695 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:18.695 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:18.695 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:18.695 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_sessionmap.py").st_ino) 2024-03-12T17:32:18.695 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:18.890 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628999 2024-03-12T17:32:19.072 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:19.072 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:19.072 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:19.072 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:19.072 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/__init__.py").st_ino) 2024-03-12T17:32:19.072 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:19.265 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629997 2024-03-12T17:32:19.447 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:19.447 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:19.447 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:19.447 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:19.447 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_journal_repair.py").st_ino) 2024-03-12T17:32:19.448 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:19.642 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628993 2024-03-12T17:32:19.824 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:19.824 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:19.824 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:19.824 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:19.824 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/kernel_mount.py").st_ino) 2024-03-12T17:32:19.824 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:20.015 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628976 2024-03-12T17:32:20.197 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:20.197 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:20.197 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:20.197 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:20.197 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_cap_flush.py").st_ino) 2024-03-12T17:32:20.197 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:20.390 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628980 2024-03-12T17:32:20.571 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:20.571 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:20.571 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:20.572 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:20.572 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_readahead.py").st_ino) 2024-03-12T17:32:20.572 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:20.766 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628997 2024-03-12T17:32:20.946 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:20.946 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:20.946 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:20.946 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:20.946 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_backtrace.py").st_ino) 2024-03-12T17:32:20.946 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:21.144 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628979 2024-03-12T17:32:21.324 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:21.324 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:21.324 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:21.325 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:21.325 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_auto_repair.py").st_ino) 2024-03-12T17:32:21.325 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:21.518 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628978 2024-03-12T17:32:21.698 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:21.699 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:21.699 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:21.699 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:21.699 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_strays.py").st_ino) 2024-03-12T17:32:21.699 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:21.894 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629000 2024-03-12T17:32:22.075 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:22.075 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:22.075 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:22.075 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:22.075 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_volume_client.py").st_ino) 2024-03-12T17:32:22.076 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:22.270 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629001 2024-03-12T17:32:22.451 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:22.452 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:22.452 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:22.452 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:22.452 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/cephfs_test_case.py").st_ino) 2024-03-12T17:32:22.452 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:22.644 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628973 2024-03-12T17:32:22.825 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:22.825 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:22.826 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:22.826 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:22.826 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_fragment.py").st_ino) 2024-03-12T17:32:22.826 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:23.019 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628990 2024-03-12T17:32:23.201 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:23.201 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:23.201 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:23.201 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:23.201 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_failover.py").st_ino) 2024-03-12T17:32:23.201 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:23.395 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628987 2024-03-12T17:32:23.575 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:23.575 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:23.575 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:23.575 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:23.576 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_full.py").st_ino) 2024-03-12T17:32:23.576 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:23.772 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628991 2024-03-12T17:32:23.953 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:23.953 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:23.953 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:23.953 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:23.953 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/filesystem.py").st_ino) 2024-03-12T17:32:23.953 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:24.146 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628974 2024-03-12T17:32:24.327 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:24.327 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:24.327 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:24.327 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:24.327 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/mount.py").st_ino) 2024-03-12T17:32:24.327 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:24.522 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628977 2024-03-12T17:32:24.702 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:24.703 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:24.703 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:24.703 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:24.703 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_damage.py").st_ino) 2024-03-12T17:32:24.703 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:24.887 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628984 2024-03-12T17:32:25.068 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:25.068 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:25.068 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:25.068 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:25.069 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_scrub_checks.py").st_ino) 2024-03-12T17:32:25.069 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:25.265 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628998 2024-03-12T17:32:25.445 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:25.445 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:25.445 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:25.445 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:25.445 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_config_commands.py").st_ino) 2024-03-12T17:32:25.445 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:25.640 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628983 2024-03-12T17:32:25.822 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:25.822 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:25.822 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:25.822 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:25.822 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_flush.py").st_ino) 2024-03-12T17:32:25.822 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:26.019 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628988 2024-03-12T17:32:26.200 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:26.200 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:26.200 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:26.200 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:26.200 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/fuse_mount.py").st_ino) 2024-03-12T17:32:26.200 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:26.390 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628975 2024-03-12T17:32:26.572 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:26.572 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:26.572 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:26.572 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:26.572 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs/test_forward_scrub.py").st_ino) 2024-03-12T17:32:26.572 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:26.766 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628989 2024-03-12T17:32:26.947 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:26.947 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:26.948 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:26.948 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:26.948 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/recovery_bench.py").st_ino) 2024-03-12T17:32:26.948 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:27.142 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629051 2024-03-12T17:32:27.322 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:27.322 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:27.322 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:27.322 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:27.322 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/multibench.py").st_ino) 2024-03-12T17:32:27.322 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:27.515 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629030 2024-03-12T17:32:27.695 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:27.695 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:27.695 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:27.696 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:27.696 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/devstack.py").st_ino) 2024-03-12T17:32:27.696 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:27.890 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629006 2024-03-12T17:32:28.070 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:28.070 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:28.070 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:28.071 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:28.071 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cephfs_test_runner.py").st_ino) 2024-03-12T17:32:28.071 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:28.263 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629002 2024-03-12T17:32:28.444 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:28.444 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:28.444 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:28.444 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:28.444 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/filestore_idempotent.py").st_ino) 2024-03-12T17:32:28.444 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:28.620 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629012 2024-03-12T17:32:28.801 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:28.801 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:28.801 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:28.801 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:28.801 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/mod_proxy_fcgi.tcp.conf.template").st_ino) 2024-03-12T17:32:28.801 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:28.993 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629024 2024-03-12T17:32:29.175 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:29.176 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:29.176 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:29.176 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:29.176 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/scrub.py").st_ino) 2024-03-12T17:32:29.176 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:29.370 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629064 2024-03-12T17:32:29.550 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:29.550 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:29.550 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:29.550 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:29.550 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/divergent_priors.py").st_ino) 2024-03-12T17:32:29.550 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:29.743 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629008 2024-03-12T17:32:29.924 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:29.924 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:29.924 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:29.924 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:29.924 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/samba.py").st_ino) 2024-03-12T17:32:29.924 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:30.115 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629063 2024-03-12T17:32:30.297 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:30.297 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:30.297 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:30.298 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:30.298 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/watch_notify_stress.py").st_ino) 2024-03-12T17:32:30.298 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:30.496 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629081 2024-03-12T17:32:30.678 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:30.678 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:30.678 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:30.678 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:30.679 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/boto.cfg.template").st_ino) 2024-03-12T17:32:30.679 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:30.872 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628955 2024-03-12T17:32:31.053 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:31.053 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:31.053 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:31.053 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:31.053 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages.py").st_ino) 2024-03-12T17:32:31.053 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:31.245 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628956 2024-03-12T17:32:31.427 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:31.427 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:31.427 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:31.427 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:31.427 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/ceph_test_case.py").st_ino) 2024-03-12T17:32:31.427 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:31.621 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628972 2024-03-12T17:32:31.803 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:31.803 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:31.803 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:31.803 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:31.803 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/s3roundtrip.py").st_ino) 2024-03-12T17:32:31.803 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:31.999 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629061 2024-03-12T17:32:32.180 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:32.181 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:32.181 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:32.181 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:32.181 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/qemu.py").st_ino) 2024-03-12T17:32:32.181 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:32.374 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629039 2024-03-12T17:32:32.555 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:32.555 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:32.555 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:32.555 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:32.555 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/locktest.py").st_ino) 2024-03-12T17:32:32.555 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:32.751 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629014 2024-03-12T17:32:32.932 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:32.932 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:32.932 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:32.932 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:32.932 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/manypools.py").st_ino) 2024-03-12T17:32:32.932 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:33.122 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629017 2024-03-12T17:32:33.303 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:33.303 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:33.303 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:33.303 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:33.303 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/mds_creation_failure.py").st_ino) 2024-03-12T17:32:33.303 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:33.499 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629018 2024-03-12T17:32:33.678 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:33.678 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:33.678 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:33.678 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:33.679 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/apache.conf.template").st_ino) 2024-03-12T17:32:33.679 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:33.870 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628951 2024-03-12T17:32:34.052 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:34.052 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:34.052 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:34.052 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:34.052 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/ec_lost_unfound.py").st_ino) 2024-03-12T17:32:34.052 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:34.244 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629011 2024-03-12T17:32:34.426 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:34.426 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:34.426 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:34.426 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:34.426 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages").st_ino) 2024-03-12T17:32:34.426 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:34.617 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629988 2024-03-12T17:32:34.797 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:34.797 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:34.797 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:34.797 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:34.797 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/ubuntu-16.04-user-data.txt").st_ino) 2024-03-12T17:32:34.797 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:34.992 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629995 2024-03-12T17:32:35.173 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:35.173 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:35.173 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:35.173 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:35.173 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/ubuntu-14.04-user-data.txt").st_ino) 2024-03-12T17:32:35.173 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:35.367 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629994 2024-03-12T17:32:35.549 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:35.549 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:35.549 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:35.549 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:35.549 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/centos-6.5-user-data.txt").st_ino) 2024-03-12T17:32:35.549 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:35.734 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628957 2024-03-12T17:32:35.915 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:35.915 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:35.915 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:35.915 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:35.916 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/centos-7.1-user-data.txt").st_ino) 2024-03-12T17:32:35.916 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:36.107 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629991 2024-03-12T17:32:36.288 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:36.288 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:36.288 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:36.288 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:36.288 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/make-deb.sh").st_ino) 2024-03-12T17:32:36.288 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:36.482 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628960 2024-03-12T17:32:36.663 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:36.663 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:36.664 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:36.664 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:36.664 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/centos-7.0-user-data.txt").st_ino) 2024-03-12T17:32:36.664 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:36.865 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629990 2024-03-12T17:32:37.045 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:37.046 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:37.046 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:37.046 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:37.046 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/make-rpm.sh").st_ino) 2024-03-12T17:32:37.046 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:37.249 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628961 2024-03-12T17:32:37.426 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:37.426 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:37.426 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:37.427 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:37.427 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/opensuse-42.1-user-data.txt").st_ino) 2024-03-12T17:32:37.427 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:37.618 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628962 2024-03-12T17:32:37.799 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:37.799 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:37.799 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:37.799 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:37.799 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/Makefile").st_ino) 2024-03-12T17:32:37.799 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:37.993 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629989 2024-03-12T17:32:38.175 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:38.175 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:38.175 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:38.175 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:38.175 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/ubuntu-12.04-user-data.txt").st_ino) 2024-03-12T17:32:38.175 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:38.370 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629993 2024-03-12T17:32:38.551 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:38.552 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:38.552 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:38.552 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:38.552 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/common.sh").st_ino) 2024-03-12T17:32:38.552 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:38.750 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628958 2024-03-12T17:32:38.931 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:38.931 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:38.931 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:38.931 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:38.931 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/user-data.txt").st_ino) 2024-03-12T17:32:38.931 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:39.125 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628963 2024-03-12T17:32:39.307 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:39.307 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:39.307 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:39.307 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:39.307 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/debian-8.0-user-data.txt").st_ino) 2024-03-12T17:32:39.307 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:39.502 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628959 2024-03-12T17:32:39.682 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:39.682 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:39.682 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:39.683 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:39.683 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/buildpackages/centos-7.2-user-data.txt").st_ino) 2024-03-12T17:32:39.683 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:39.880 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629992 2024-03-12T17:32:40.061 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:40.061 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:40.061 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:40.061 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:40.061 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/rbd_mirror.py").st_ino) 2024-03-12T17:32:40.061 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:40.261 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629049 2024-03-12T17:32:40.441 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:40.441 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:40.441 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:40.441 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:40.441 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/dump_stuck.py").st_ino) 2024-03-12T17:32:40.441 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:40.634 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629010 2024-03-12T17:32:40.814 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:40.814 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:40.814 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:40.814 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:40.814 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/ceph_objectstore_tool.py").st_ino) 2024-03-12T17:32:40.814 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:41.006 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628971 2024-03-12T17:32:41.187 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:41.187 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:41.187 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:41.187 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:41.187 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/rbd_fsx.py").st_ino) 2024-03-12T17:32:41.187 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:41.388 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629048 2024-03-12T17:32:41.569 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:41.569 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:41.569 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:41.569 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:41.569 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/radosgw_agent.py").st_ino) 2024-03-12T17:32:41.569 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:41.765 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629045 2024-03-12T17:32:41.947 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:41.947 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:41.947 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:41.947 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:41.947 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/tgt.py").st_ino) 2024-03-12T17:32:41.947 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:42.141 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629071 2024-03-12T17:32:42.322 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:42.322 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:42.322 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:42.322 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:42.322 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/vstart_runner.py").st_ino) 2024-03-12T17:32:42.322 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:42.515 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629079 2024-03-12T17:32:42.696 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:42.696 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:42.696 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:42.696 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:42.696 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/resolve_stuck_peering.py").st_ino) 2024-03-12T17:32:42.696 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:42.879 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629055 2024-03-12T17:32:43.059 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:43.059 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:43.060 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:43.060 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:43.060 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/rados.py").st_ino) 2024-03-12T17:32:43.060 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:43.256 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629040 2024-03-12T17:32:43.436 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:43.437 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:43.437 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:43.437 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:43.437 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/s3tests.py").st_ino) 2024-03-12T17:32:43.437 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:43.635 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629062 2024-03-12T17:32:43.815 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:43.815 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:43.815 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:43.815 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:43.815 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/userdata_setup.yaml").st_ino) 2024-03-12T17:32:43.815 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:44.012 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629074 2024-03-12T17:32:44.194 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:44.194 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:44.194 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:44.194 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:44.194 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/lost_unfound.py").st_ino) 2024-03-12T17:32:44.194 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:44.392 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629016 2024-03-12T17:32:44.572 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:44.572 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:44.572 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:44.572 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:44.572 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/s3readwrite.py").st_ino) 2024-03-12T17:32:44.572 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:44.766 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629060 2024-03-12T17:32:44.894 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:32:44.902 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:32:44.945 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:44.945 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:44.945 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:44.945 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:44.945 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/ceph_fuse.py").st_ino) 2024-03-12T17:32:44.945 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:45.069 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628969 2024-03-12T17:32:45.254 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:45.254 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:45.254 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:45.254 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:45.254 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/rest_api.py").st_ino) 2024-03-12T17:32:45.254 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:45.394 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629056 2024-03-12T17:32:45.578 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:45.578 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:45.578 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:45.579 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:45.579 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/reg11184.py").st_ino) 2024-03-12T17:32:45.579 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:45.774 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629052 2024-03-12T17:32:45.955 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:45.955 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:45.955 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:45.955 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:45.955 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/rep_lost_unfound_delete.py").st_ino) 2024-03-12T17:32:45.955 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:46.136 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629053 2024-03-12T17:32:46.316 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:46.316 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:46.316 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:46.316 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:46.317 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/mod_proxy_fcgi.uds.conf.template").st_ino) 2024-03-12T17:32:46.317 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:46.510 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629025 2024-03-12T17:32:46.691 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:46.691 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:46.691 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:46.691 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:46.691 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/ceph_deploy.py").st_ino) 2024-03-12T17:32:46.691 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:46.884 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628968 2024-03-12T17:32:47.065 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:47.065 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:47.065 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:47.065 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:47.065 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/ceph_manager.py").st_ino) 2024-03-12T17:32:47.065 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:47.260 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628970 2024-03-12T17:32:47.440 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:47.441 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:47.441 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:47.441 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:47.441 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/radosbench.py").st_ino) 2024-03-12T17:32:47.441 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:47.635 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629041 2024-03-12T17:32:47.816 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:47.816 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:47.816 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:47.816 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:47.817 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/scrub_test.py").st_ino) 2024-03-12T17:32:47.817 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:48.009 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629065 2024-03-12T17:32:48.190 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:48.190 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:48.190 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:48.190 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:48.190 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/mon_clock_skew_check.py").st_ino) 2024-03-12T17:32:48.190 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:48.387 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629026 2024-03-12T17:32:48.568 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:48.568 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:48.568 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:48.568 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:48.568 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/kclient.py").st_ino) 2024-03-12T17:32:48.568 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:48.762 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629013 2024-03-12T17:32:48.944 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:48.944 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:48.944 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:48.944 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:48.944 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/omapbench.py").st_ino) 2024-03-12T17:32:48.944 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:49.139 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629032 2024-03-12T17:32:49.319 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:49.319 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:49.319 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:49.319 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:49.319 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/autotest.py").st_ino) 2024-03-12T17:32:49.319 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:49.512 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628952 2024-03-12T17:32:49.693 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:49.693 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:49.693 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:49.693 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:49.693 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/mod_fastcgi.conf.template").st_ino) 2024-03-12T17:32:49.693 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:49.893 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629023 2024-03-12T17:32:50.074 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:50.074 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:50.074 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:50.074 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:50.074 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/peering_speed_test.py").st_ino) 2024-03-12T17:32:50.075 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:50.267 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629037 2024-03-12T17:32:50.448 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:50.448 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:50.448 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:50.448 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:50.448 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/mon_recovery.py").st_ino) 2024-03-12T17:32:50.448 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:50.641 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629027 2024-03-12T17:32:50.823 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:50.823 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:50.823 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:50.823 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:50.823 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/cifs_mount.py").st_ino) 2024-03-12T17:32:50.823 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:51.017 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629003 2024-03-12T17:32:51.198 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:51.199 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:51.199 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:51.199 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:51.199 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/rbd_fio.py").st_ino) 2024-03-12T17:32:51.199 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:51.392 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629047 2024-03-12T17:32:51.573 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:51.573 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:51.573 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:51.573 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:51.573 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/logrotate.conf").st_ino) 2024-03-12T17:32:51.573 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:51.771 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629015 2024-03-12T17:32:51.952 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:51.952 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:51.953 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:51.953 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:51.953 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/mon_thrash.py").st_ino) 2024-03-12T17:32:51.953 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:52.147 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629029 2024-03-12T17:32:52.326 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:52.326 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:52.326 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:52.326 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:52.326 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/metadata.yaml").st_ino) 2024-03-12T17:32:52.326 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:52.519 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629020 2024-03-12T17:32:52.701 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:52.701 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:52.701 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:52.701 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:52.701 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/divergent_priors2.py").st_ino) 2024-03-12T17:32:52.702 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:52.892 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629009 2024-03-12T17:32:53.073 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:53.074 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:53.074 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:53.074 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:53.074 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/blktrace.py").st_ino) 2024-03-12T17:32:53.074 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:53.270 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628954 2024-03-12T17:32:53.449 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:53.449 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:53.449 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:53.449 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:53.449 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/thrashosds.py").st_ino) 2024-03-12T17:32:53.449 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:53.642 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629073 2024-03-12T17:32:53.824 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:53.824 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:53.824 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:53.824 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:53.824 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/systemd.py").st_ino) 2024-03-12T17:32:53.824 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:54.019 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629066 2024-03-12T17:32:54.200 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:54.200 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:54.200 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:54.200 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:54.200 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/radosgw_admin_rest.py").st_ino) 2024-03-12T17:32:54.200 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:54.394 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629044 2024-03-12T17:32:54.575 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:54.575 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:54.575 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:54.575 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:54.575 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/tasks/create_verify_lfn_objects.py").st_ino) 2024-03-12T17:32:54.575 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:54.760 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629005 2024-03-12T17:32:54.941 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:54.941 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:54.941 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:54.941 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:54.941 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/timezone").st_ino) 2024-03-12T17:32:54.941 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:55.136 INFO:teuthology.orchestra.run.smithi017.stdout:1099511630006 2024-03-12T17:32:55.317 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:55.317 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:55.317 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:55.317 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:55.317 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/timezone/random.yaml").st_ino) 2024-03-12T17:32:55.317 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:55.512 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629084 2024-03-12T17:32:55.692 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:55.692 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:55.693 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:55.693 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:55.693 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/timezone/eastern.yaml").st_ino) 2024-03-12T17:32:55.693 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:55.887 INFO:teuthology.orchestra.run.smithi017.stdout:1099511630007 2024-03-12T17:32:56.068 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:56.068 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:56.068 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:56.069 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:56.069 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/timezone/pacific.yaml").st_ino) 2024-03-12T17:32:56.069 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:56.259 INFO:teuthology.orchestra.run.smithi017.stdout:1099511629083 2024-03-12T17:32:56.441 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:56.441 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:56.441 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:56.441 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:56.441 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/.gitignore").st_ino) 2024-03-12T17:32:56.441 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:56.635 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628305 2024-03-12T17:32:56.816 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:56.816 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:56.816 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:56.816 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:56.816 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/debug").st_ino) 2024-03-12T17:32:56.817 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:57.012 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628329 2024-03-12T17:32:57.193 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:57.194 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:57.194 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:57.194 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:57.194 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/debug/openstack-30G.yaml").st_ino) 2024-03-12T17:32:57.194 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:57.386 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627836 2024-03-12T17:32:57.567 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:57.567 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:57.567 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:57.567 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:57.567 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/debug/buildpackages.yaml").st_ino) 2024-03-12T17:32:57.567 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:57.759 INFO:teuthology.orchestra.run.smithi017.stdout:1099511628330 2024-03-12T17:32:57.939 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:57.939 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:57.939 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:57.939 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:57.940 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/debug/mds_client.yaml").st_ino) 2024-03-12T17:32:57.940 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:58.133 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627834 2024-03-12T17:32:58.313 DEBUG:teuthology.orchestra.run.smithi017:> adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T17:32:58.314 DEBUG:teuthology.orchestra.run.smithi017:> import os 2024-03-12T17:32:58.314 DEBUG:teuthology.orchestra.run.smithi017:> import stat 2024-03-12T17:32:58.314 DEBUG:teuthology.orchestra.run.smithi017:> 2024-03-12T17:32:58.314 DEBUG:teuthology.orchestra.run.smithi017:> print(os.lstat("/home/ubuntu/cephtest/mnt.0/./ceph-qa-suite/debug/openstack-15G.yaml").st_ino) 2024-03-12T17:32:58.314 DEBUG:teuthology.orchestra.run.smithi017:> ' 2024-03-12T17:32:58.508 INFO:teuthology.orchestra.run.smithi017.stdout:1099511627835 2024-03-12T17:32:58.689 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-12T17:32:58.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.959+0000 7f78b4e00640 1 Processor -- start 2024-03-12T17:32:58.955 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.959+0000 7f78b4e00640 1 -- start start 2024-03-12T17:32:58.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.961+0000 7f78b4e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f78b0160c40 0x7f78b0165340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:32:58.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.961+0000 7f78b4e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f78b0070240 0x7f78b00706b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:32:58.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.961+0000 7f78b4e00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78b00cc760 con 0x7f78b00cab30 2024-03-12T17:32:58.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.961+0000 7f78b4e00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78b0070bf0 con 0x7f78b0070240 2024-03-12T17:32:58.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.961+0000 7f78b4e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b0165880 con 0x7f78b0160c40 2024-03-12T17:32:58.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.961+0000 7f78afe00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f78b0070240 0x7f78b00706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:32:58.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.961+0000 7f78afe00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f78b0070240 0x7f78b00706b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41980/0 (socket says 172.21.15.17:41980) 2024-03-12T17:32:58.957 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.961+0000 7f78afe00640 1 -- 172.21.15.17:0/4014485429 learned_addr learned my addr 172.21.15.17:0/4014485429 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:32:58.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.962+0000 7f78af400640 1 --2- 172.21.15.17:0/4014485429 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f78b0160c40 0x7f78b0165340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:32:58.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.962+0000 7f78afe00640 1 -- 172.21.15.17:0/4014485429 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f78b0160c40 msgr2=0x7f78b0165340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:32:58.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.962+0000 7f78afe00640 1 --2- 172.21.15.17:0/4014485429 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f78b0160c40 0x7f78b0165340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:32:58.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.962+0000 7f78afe00640 1 -- 172.21.15.17:0/4014485429 >> v1:172.21.15.94:6789/0 conn(0x7f78b00cab30 legacy=0x7f78b00b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:32:58.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.962+0000 7f78afe00640 1 -- 172.21.15.17:0/4014485429 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b00cc9e0 con 0x7f78b0070240 2024-03-12T17:32:58.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.962+0000 7f78af400640 1 --2- 172.21.15.17:0/4014485429 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f78b0160c40 0x7f78b0165340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:32:58.958 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.963+0000 7f78afe00640 1 --2- 172.21.15.17:0/4014485429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78b0070240 0x7f78b00706b0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f78a8009870 tx=0x7f78a802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d88a3fe15a2fad server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:32:58.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.963+0000 7f78ae000640 1 -- 172.21.15.17:0/4014485429 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a8031640 con 0x7f78b0070240 2024-03-12T17:32:58.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.963+0000 7f78ae000640 1 -- 172.21.15.17:0/4014485429 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a80317a0 con 0x7f78b0070240 2024-03-12T17:32:58.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.963+0000 7f78ae000640 1 -- 172.21.15.17:0/4014485429 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a8031b30 con 0x7f78b0070240 2024-03-12T17:32:58.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.964+0000 7f78b4e00640 1 -- 172.21.15.17:0/4014485429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78b0070240 msgr2=0x7f78b00706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:32:58.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.964+0000 7f78b4e00640 1 --2- 172.21.15.17:0/4014485429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78b0070240 0x7f78b00706b0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f78a8009870 tx=0x7f78a802b8f0 comp rx=0 tx=0).stop 2024-03-12T17:32:58.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.964+0000 7f78b4e00640 1 -- 172.21.15.17:0/4014485429 shutdown_connections 2024-03-12T17:32:58.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.964+0000 7f78b4e00640 1 --2- 172.21.15.17:0/4014485429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78b0070240 0x7f78b00706b0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:32:58.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.964+0000 7f78b4e00640 1 --2- 172.21.15.17:0/4014485429 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f78b0160c40 0x7f78b0165340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:32:58.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.964+0000 7f78b4e00640 1 -- 172.21.15.17:0/4014485429 >> 172.21.15.17:0/4014485429 conn(0x7f78b0069ce0 msgr2=0x7f78b006a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:32:58.960 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.964+0000 7f78b4e00640 1 -- 172.21.15.17:0/4014485429 shutdown_connections 2024-03-12T17:32:58.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.964+0000 7f78b4e00640 1 -- 172.21.15.17:0/4014485429 wait complete. 2024-03-12T17:32:58.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.966+0000 7f78b4e00640 1 Processor -- start 2024-03-12T17:32:58.962 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.967+0000 7f78b4e00640 1 -- start start 2024-03-12T17:32:58.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.968+0000 7f78b4e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78b0070240 0x7f78b00b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:32:58.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.968+0000 7f78b4e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f78b00cab30 0x7f78b0148b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:32:58.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.968+0000 7f78b4e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78b0160c40 0x7f78b00b41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:32:58.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.968+0000 7f78b4e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b00b4710 con 0x7f78b0160c40 2024-03-12T17:32:58.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.968+0000 7f78b4e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b00b2a20 con 0x7f78b0070240 2024-03-12T17:32:58.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.968+0000 7f78b4e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b00b2d00 con 0x7f78b00cab30 2024-03-12T17:32:58.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.968+0000 7f78afe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78b0160c40 0x7f78b00b41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:32:58.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.968+0000 7f78afe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78b0160c40 0x7f78b00b41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:41988/0 (socket says 172.21.15.17:41988) 2024-03-12T17:32:58.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.968+0000 7f78afe00640 1 -- 172.21.15.17:0/3683262263 learned_addr learned my addr 172.21.15.17:0/3683262263 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:32:58.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.969+0000 7f78af400640 1 --2- 172.21.15.17:0/3683262263 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78b0070240 0x7f78b00b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:32:58.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.969+0000 7f78aea00640 1 --2- 172.21.15.17:0/3683262263 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f78b00cab30 0x7f78b0148b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:32:58.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.969+0000 7f78afe00640 1 -- 172.21.15.17:0/3683262263 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f78b00cab30 msgr2=0x7f78b0148b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:32:58.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.969+0000 7f78afe00640 1 --2- 172.21.15.17:0/3683262263 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f78b00cab30 0x7f78b0148b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:32:58.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.969+0000 7f78afe00640 1 -- 172.21.15.17:0/3683262263 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78b0070240 msgr2=0x7f78b00b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:32:58.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.969+0000 7f78afe00640 1 --2- 172.21.15.17:0/3683262263 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78b0070240 0x7f78b00b23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:32:58.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.969+0000 7f78afe00640 1 -- 172.21.15.17:0/3683262263 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a80094d0 con 0x7f78b0160c40 2024-03-12T17:32:58.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.969+0000 7f78afe00640 1 --2- 172.21.15.17:0/3683262263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78b0160c40 0x7f78b00b41d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f78a802b930 tx=0x7f78a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:32:58.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.969+0000 7f78a7400640 1 -- 172.21.15.17:0/3683262263 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a803ac60 con 0x7f78b0160c40 2024-03-12T17:32:58.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.970+0000 7f78a7400640 1 -- 172.21.15.17:0/3683262263 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a803ade0 con 0x7f78b0160c40 2024-03-12T17:32:58.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.970+0000 7f78a7400640 1 -- 172.21.15.17:0/3683262263 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a8044630 con 0x7f78b0160c40 2024-03-12T17:32:58.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.970+0000 7f78b4e00640 1 -- 172.21.15.17:0/3683262263 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b00b2fe0 con 0x7f78b0160c40 2024-03-12T17:32:58.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.970+0000 7f78b4e00640 1 -- 172.21.15.17:0/3683262263 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b0162ae0 con 0x7f78b0160c40 2024-03-12T17:32:58.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.971+0000 7f78b4e00640 1 -- 172.21.15.17:0/3683262263 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78b004e030 con 0x7f78b0160c40 2024-03-12T17:32:58.967 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.972+0000 7f78a7400640 1 -- 172.21.15.17:0/3683262263 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f78a802f050 con 0x7f78b0160c40 2024-03-12T17:32:58.968 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.973+0000 7f78a7400640 1 --2- 172.21.15.17:0/3683262263 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f789006ac30 0x7f789006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:32:58.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.973+0000 7f78a7400640 1 -- 172.21.15.17:0/3683262263 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f78a80ab4c0 con 0x7f78b0160c40 2024-03-12T17:32:58.969 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.974+0000 7f78af400640 1 --2- 172.21.15.17:0/3683262263 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f789006ac30 0x7f789006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:32:58.970 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.975+0000 7f78af400640 1 --2- 172.21.15.17:0/3683262263 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f789006ac30 0x7f789006d0f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f78a0007510 tx=0x7f78a00074a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:32:58.974 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:58.979+0000 7f78a7400640 1 -- 172.21.15.17:0/3683262263 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f78a8076650 con 0x7f78b0160c40 2024-03-12T17:32:59.212 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.216+0000 7f78b4e00640 1 -- 172.21.15.17:0/3683262263 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f78b015ef20 con 0x7f78b0160c40 2024-03-12T17:32:59.213 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.218+0000 7f78a7400640 1 -- 172.21.15.17:0/3683262263 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4731 (secure 0 0 0) 0x7f78a8032040 con 0x7f78b0160c40 2024-03-12T17:32:59.213 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:32:59.214 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4808,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6834/3175855266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3175855266},{"type":"v1","addr":"172.21.15.94:6834","nonce":3175855266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":4927,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/1725537585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1725537585},{"type":"v1","addr":"172.21.15.17:6835","nonce":1725537585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":4939,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/630541950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6833","nonce":630541950},{"type":"v1","addr":"172.21.15.94:6835","nonce":630541950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T17:20:29.180386+0000","modified":"2024-03-12T17:20:32.399146+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5433":{"gid":5433,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6837/2711965846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":2711965846},{"type":"v1","addr":"172.21.15.17:6837","nonce":2711965846}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-03-12T17:32:59.214 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 22 2024-03-12T17:32:59.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.221+0000 7f78b4e00640 1 -- 172.21.15.17:0/3683262263 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f789006ac30 msgr2=0x7f789006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:32:59.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.221+0000 7f78b4e00640 1 --2- 172.21.15.17:0/3683262263 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f789006ac30 0x7f789006d0f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f78a0007510 tx=0x7f78a00074a0 comp rx=0 tx=0).stop 2024-03-12T17:32:59.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.222+0000 7f78b4e00640 1 -- 172.21.15.17:0/3683262263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78b0160c40 msgr2=0x7f78b00b41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:32:59.217 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.222+0000 7f78b4e00640 1 --2- 172.21.15.17:0/3683262263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78b0160c40 0x7f78b00b41d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f78a802b930 tx=0x7f78a80046c0 comp rx=0 tx=0).stop 2024-03-12T17:32:59.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.222+0000 7f78b4e00640 1 -- 172.21.15.17:0/3683262263 shutdown_connections 2024-03-12T17:32:59.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.222+0000 7f78b4e00640 1 --2- 172.21.15.17:0/3683262263 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f789006ac30 0x7f789006d0f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:32:59.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.222+0000 7f78b4e00640 1 --2- 172.21.15.17:0/3683262263 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f78b0160c40 0x7f78b00b41d0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:32:59.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.222+0000 7f78b4e00640 1 --2- 172.21.15.17:0/3683262263 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f78b00cab30 0x7f78b0148b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:32:59.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.222+0000 7f78b4e00640 1 --2- 172.21.15.17:0/3683262263 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f78b0070240 0x7f78b00b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:32:59.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.222+0000 7f78b4e00640 1 -- 172.21.15.17:0/3683262263 >> 172.21.15.17:0/3683262263 conn(0x7f78b0069ce0 msgr2=0x7f78b015e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:32:59.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.222+0000 7f78b4e00640 1 -- 172.21.15.17:0/3683262263 shutdown_connections 2024-03-12T17:32:59.218 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.222+0000 7f78b4e00640 1 -- 172.21.15.17:0/3683262263 wait complete. 2024-03-12T17:32:59.238 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump tree /ceph-qa-suite/suites/smoke/1node/tasks 2024-03-12T17:32:59.476 INFO:teuthology.orchestra.run.smithi017.stdout:[{"ino":1099511629504,"rdev":0,"ctime":"2024-03-12T17:20:50.489713+0000","btime":"2024-03-12T17:20:50.486713+0000","mode":33188,"uid":1000,"gid":1301,"nlink":1,"dir_layout":{"dir_hash":0,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":4194304,"stripe_count":1,"object_size":4194304,"pool_id":7,"pool_ns":""},"old_pools":[],"size":216,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-03-12T17:20:50.489713+0000","atime":"2024-03-12T17:20:50.486713+0000","time_warp_seq":0,"change_attr":1,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":216,"rfiles":1,"rsubdirs":0,"rsnaps":0,"rctime":"2024-03-12T17:20:50.489713+0000"},"accounted_rstat":{"version":0,"rbytes":216,"rfiles":1,"rsubdirs":0,"rsnaps":0,"rctime":"2024-03-12T17:20:50.489713+0000"},"version":4,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"lock":0,"caps":1,"dirtyparent":1,"dirty":1,"authpin":0},"nref":3,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":5601,"pending":"pAsLsXsFsc","issued":"pAsLsXsFsc","wanted":"-","last_sent":3}],"loner":5601,"want_loner":-1,"mds_caps_wanted":[],"dirfrags":[]},{"ino":1099511629503,"rdev":0,"ctime":"2024-03-12T17:20:50.486713+0000","btime":"2024-03-12T17:20:50.479713+0000","mode":16877,"uid":1000,"gid":1301,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-03-12T17:20:50.486713+0000","atime":"2024-03-12T17:20:50.479713+0000","time_warp_seq":0,"change_attr":1,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-03-12T17:20:50.486713+0000","num_files":1,"num_subdirs":0,"change_attr":1},"rstat":{"version":0,"rbytes":216,"rfiles":1,"rsubdirs":1,"rsnaps":0,"rctime":"2024-03-12T17:20:50.489713+0000"},"accounted_rstat":{"version":0,"rbytes":216,"rfiles":1,"rsubdirs":1,"rsnaps":0,"rctime":"2024-03-12T17:20:50.489713+0000"},"version":21,"file_data_version":0,"xattr_version":1,"backtrace_version":12,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1,"waiter":0,"authpin":0},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","type":"ifile","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":5601,"pending":"pAsLsXsFsx","issued":"pAsLsXsFsx","wanted":"pAsLsXsFsxcral","last_sent":7}],"loner":5601,"want_loner":5601,"mds_caps_wanted":[],"dirfrags":[{"path":"/ceph-qa-suite/suites/smoke/1node/tasks","dirfrag":"0x100000006bf","snapid_first":2,"projected_version":"5","version":"5","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"dirty":1,"authpin":0},"nref":2,"dentries":[{"path":"ceph-qa-suite/suites/smoke/1node/tasks/ceph-deploy.yaml","path_ino":1,"snap_first":2,"snap_last":18446744073709551614,"is_primary":true,"is_remote":false,"is_null":false,"is_new":false,"inode":1099511629504,"remote_type":"","version":4,"projected_version":4,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"inodepin":1,"dirty":1,"authpin":0},"nref":2,"lock":{},"versionlock":{"gather_set":[],"state":"lock","type":"dversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]}]}]}] 2024-03-12T17:32:59.477 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "accounted_rstat": { "rbytes": 216, "rctime": "2024-03-12T17:20:50.489713+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 0, "version": 0 }, "atime": "2024-03-12T17:20:50.486713+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-03-12T17:20:50.486713+0000", "change_attr": 1, "client_caps": [ { "client_id": 5601, "issued": "pAsLsXsFsc", "last_sent": 3, "pending": "pAsLsXsFsc", "wanted": "-" } ], "client_ranges": [], "ctime": "2024-03-12T17:20:50.489713+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 0, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfrags": [], "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1301, "ino": 1099511629504, "is_auth": true, "is_freezing": false, "is_frozen": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 4194304, "pool_id": 7, "pool_ns": "", "stripe_count": 1, "stripe_unit": 4194304 }, "linklock": {}, "loner": 5601, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 33188, "mtime": "2024-03-12T17:20:50.489713+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 3, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "pins": { "authpin": 0, "caps": 1, "dirty": 1, "dirtyparent": 1, "lock": 0, "ptrwaiter": 0, "request": 0 }, "policylock": {}, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 216, "rctime": "2024-03-12T17:20:50.489713+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 0, "version": 0 }, "size": 216, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 4, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] }, { "accounted_rstat": { "rbytes": 216, "rctime": "2024-03-12T17:20:50.489713+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-03-12T17:20:50.479713+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 12, "btime": "2024-03-12T17:20:50.479713+0000", "change_attr": 1, "client_caps": [ { "client_id": 5601, "issued": "pAsLsXsFsx", "last_sent": 7, "pending": "pAsLsXsFsx", "wanted": "pAsLsXsFsxcral" } ], "client_ranges": [], "ctime": "2024-03-12T17:20:50.486713+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfrags": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dentries": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 1099511629504, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": false, "is_primary": true, "is_remote": false, "lock": {}, "nref": 2, "path": "ceph-qa-suite/suites/smoke/1node/tasks/ceph-deploy.yaml", "path_ino": 1, "pins": { "authpin": 0, "dirty": 1, "inodepin": 1, "lock": 0, "request": 0 }, "projected_version": 4, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 2, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 4, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "dversion", "xlock_by": {} } } ], "dir_auth": "", "dirfrag": "0x100000006bf", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/ceph-qa-suite/suites/smoke/1node/tasks", "pins": { "authpin": 0, "child": 1, "dirty": 1 }, "projected_version": "5", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" } ], "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 1, "mtime": "2024-03-12T17:20:50.486713+0000", "num_files": 1, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ifile", "xlock_by": {} }, "flocklock": {}, "gid": 1301, "ino": 1099511629503, "is_auth": true, "is_freezing": false, "is_frozen": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 5601, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-03-12T17:20:50.486713+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "pins": { "authpin": 0, "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "lock": 0, "request": 0, "waiter": 0 }, "policylock": {}, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 216, "rctime": "2024-03-12T17:20:50.489713+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 21, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": 5601, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } ] 2024-03-12T17:32:59.478 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-12T17:32:59.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.710+0000 7f098b200640 1 Processor -- start 2024-03-12T17:32:59.705 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.710+0000 7f098b200640 1 -- start start 2024-03-12T17:32:59.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.711+0000 7f098b200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f098c15ce80 0x7f098c0cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:32:59.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.711+0000 7f098b200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f098c0b85f0 0x7f098c0cf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:32:59.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.711+0000 7f098b200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f098c161650 con 0x7f098c15caa0 2024-03-12T17:32:59.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.711+0000 7f098b200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f098c160ea0 con 0x7f098c0b85f0 2024-03-12T17:32:59.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.711+0000 7f098b200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098c161090 con 0x7f098c15ce80 2024-03-12T17:32:59.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.712+0000 7f098a800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f098c0b85f0 0x7f098c0cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:32:59.707 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.712+0000 7f098a800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f098c0b85f0 0x7f098c0cf870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42002/0 (socket says 172.21.15.17:42002) 2024-03-12T17:32:59.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.712+0000 7f098a800640 1 -- 172.21.15.17:0/964329513 learned_addr learned my addr 172.21.15.17:0/964329513 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:32:59.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.712+0000 7f0989e00640 1 --1- 172.21.15.17:0/964329513 >> v1:172.21.15.17:6789/0 conn(0x7f098c15caa0 0x7f098c160790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:44624/0 (socket says 172.21.15.17:44624) 2024-03-12T17:32:59.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.712+0000 7f0989400640 1 --2- 172.21.15.17:0/964329513 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f098c15ce80 0x7f098c0cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:32:59.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.712+0000 7f098a800640 1 -- 172.21.15.17:0/964329513 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f098c15ce80 msgr2=0x7f098c0cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:32:59.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.712+0000 7f098a800640 1 --2- 172.21.15.17:0/964329513 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f098c15ce80 0x7f098c0cf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:32:59.708 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.712+0000 7f098a800640 1 -- 172.21.15.17:0/964329513 >> v1:172.21.15.17:6789/0 conn(0x7f098c15caa0 legacy=0x7f098c160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:32:59.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.712+0000 7f0988a00640 1 -- 172.21.15.17:0/964329513 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3128519169 0 0) 0x7f098c161650 con 0x7f098c15caa0 2024-03-12T17:32:59.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.712+0000 7f098a800640 1 -- 172.21.15.17:0/964329513 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098c161370 con 0x7f098c0b85f0 2024-03-12T17:32:59.709 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.712+0000 7f0989400640 1 --2- 172.21.15.17:0/964329513 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f098c15ce80 0x7f098c0cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:32:59.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.713+0000 7f098a800640 1 --2- 172.21.15.17:0/964329513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f098c0b85f0 0x7f098c0cf870 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0984009e50 tx=0x7f098402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd01c9ff8ce639a9 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:32:59.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.714+0000 7f0988a00640 1 -- 172.21.15.17:0/964329513 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098402cb00 con 0x7f098c0b85f0 2024-03-12T17:32:59.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.714+0000 7f0988a00640 1 -- 172.21.15.17:0/964329513 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098402cc60 con 0x7f098c0b85f0 2024-03-12T17:32:59.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.714+0000 7f0988a00640 1 -- 172.21.15.17:0/964329513 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09840343f0 con 0x7f098c0b85f0 2024-03-12T17:32:59.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.714+0000 7f098b200640 1 -- 172.21.15.17:0/964329513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f098c0b85f0 msgr2=0x7f098c0cf870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:32:59.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.714+0000 7f098b200640 1 --2- 172.21.15.17:0/964329513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f098c0b85f0 0x7f098c0cf870 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f0984009e50 tx=0x7f098402bf60 comp rx=0 tx=0).stop 2024-03-12T17:32:59.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.715+0000 7f098b200640 1 -- 172.21.15.17:0/964329513 shutdown_connections 2024-03-12T17:32:59.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.715+0000 7f098b200640 1 --2- 172.21.15.17:0/964329513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f098c0b85f0 0x7f098c0cf870 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:32:59.710 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.715+0000 7f098b200640 1 --2- 172.21.15.17:0/964329513 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f098c15ce80 0x7f098c0cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:32:59.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.715+0000 7f098b200640 1 -- 172.21.15.17:0/964329513 >> 172.21.15.17:0/964329513 conn(0x7f098c06b160 msgr2=0x7f098c06b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:32:59.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.715+0000 7f098b200640 1 -- 172.21.15.17:0/964329513 shutdown_connections 2024-03-12T17:32:59.711 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.715+0000 7f098b200640 1 -- 172.21.15.17:0/964329513 wait complete. 2024-03-12T17:32:59.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.716+0000 7f098b200640 1 Processor -- start 2024-03-12T17:32:59.712 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.717+0000 7f098b200640 1 -- start start 2024-03-12T17:32:59.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.717+0000 7f098b200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f098c0b85f0 0x7f098c159240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:32:59.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.718+0000 7f098b200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f098c15caa0 0x7f098c0d2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:32:59.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.718+0000 7f098b200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f098c15ce80 0x7f098c0d2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:32:59.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.718+0000 7f098b200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098c159780 con 0x7f098c15caa0 2024-03-12T17:32:59.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.718+0000 7f098b200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098c0b2d00 con 0x7f098c15ce80 2024-03-12T17:32:59.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.718+0000 7f098b200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098c0cbd40 con 0x7f098c0b85f0 2024-03-12T17:32:59.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.718+0000 7f0989400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f098c15caa0 0x7f098c0d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:32:59.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.718+0000 7f0989400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f098c15caa0 0x7f098c0d2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42014/0 (socket says 172.21.15.17:42014) 2024-03-12T17:32:59.714 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.718+0000 7f0989400640 1 -- 172.21.15.17:0/135861183 learned_addr learned my addr 172.21.15.17:0/135861183 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:32:59.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.718+0000 7f0989400640 1 -- 172.21.15.17:0/135861183 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f098c0b85f0 msgr2=0x7f098c159240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:32:59.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.718+0000 7f0989400640 1 --2- 172.21.15.17:0/135861183 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f098c0b85f0 0x7f098c159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:32:59.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.718+0000 7f0989400640 1 -- 172.21.15.17:0/135861183 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f098c15ce80 msgr2=0x7f098c0d2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:32:59.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.718+0000 7f0989400640 1 --2- 172.21.15.17:0/135861183 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f098c15ce80 0x7f098c0d2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:32:59.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.718+0000 7f0989400640 1 -- 172.21.15.17:0/135861183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0984009b30 con 0x7f098c15caa0 2024-03-12T17:32:59.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.719+0000 7f0989400640 1 --2- 172.21.15.17:0/135861183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f098c15caa0 0x7f098c0d2710 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f097800c7c0 tx=0x7f097800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:32:59.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.719+0000 7f0982000640 1 -- 172.21.15.17:0/135861183 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0978007820 con 0x7f098c15caa0 2024-03-12T17:32:59.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.719+0000 7f0982000640 1 -- 172.21.15.17:0/135861183 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0978007980 con 0x7f098c15caa0 2024-03-12T17:32:59.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.719+0000 7f098b200640 1 -- 172.21.15.17:0/135861183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f098c0cc020 con 0x7f098c15caa0 2024-03-12T17:32:59.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.719+0000 7f0982000640 1 -- 172.21.15.17:0/135861183 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0978007d10 con 0x7f098c15caa0 2024-03-12T17:32:59.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.719+0000 7f098b200640 1 -- 172.21.15.17:0/135861183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f098c0cc5e0 con 0x7f098c15caa0 2024-03-12T17:32:59.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.720+0000 7f098b200640 1 -- 172.21.15.17:0/135861183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f098c072360 con 0x7f098c15caa0 2024-03-12T17:32:59.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.721+0000 7f0982000640 1 -- 172.21.15.17:0/135861183 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f09780113f0 con 0x7f098c15caa0 2024-03-12T17:32:59.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.722+0000 7f0982000640 1 --2- 172.21.15.17:0/135861183 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f096c06ac30 0x7f096c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:32:59.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.722+0000 7f0982000640 1 -- 172.21.15.17:0/135861183 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f0978089540 con 0x7f098c15caa0 2024-03-12T17:32:59.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.723+0000 7f0989e00640 1 --2- 172.21.15.17:0/135861183 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f096c06ac30 0x7f096c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:32:59.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.724+0000 7f0989e00640 1 --2- 172.21.15.17:0/135861183 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f096c06ac30 0x7f096c06d0f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f097c007fd0 tx=0x7f097c007920 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:32:59.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.727+0000 7f0982000640 1 -- 172.21.15.17:0/135861183 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f0978054640 con 0x7f098c15caa0 2024-03-12T17:32:59.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.965+0000 7f098b200640 1 -- 172.21.15.17:0/135861183 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f098c0b2e40 con 0x7f098c15caa0 2024-03-12T17:32:59.961 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.966+0000 7f0982000640 1 -- 172.21.15.17:0/135861183 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4731 (secure 0 0 0) 0x7f0978057c60 con 0x7f098c15caa0 2024-03-12T17:32:59.962 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:32:59.962 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4808,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6834/3175855266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3175855266},{"type":"v1","addr":"172.21.15.94:6834","nonce":3175855266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":4927,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/1725537585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1725537585},{"type":"v1","addr":"172.21.15.17:6835","nonce":1725537585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":4939,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/630541950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6833","nonce":630541950},{"type":"v1","addr":"172.21.15.94:6835","nonce":630541950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T17:20:29.180386+0000","modified":"2024-03-12T17:20:32.399146+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5433":{"gid":5433,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6837/2711965846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":2711965846},{"type":"v1","addr":"172.21.15.17:6837","nonce":2711965846}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-03-12T17:32:59.962 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 22 2024-03-12T17:32:59.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.969+0000 7f098b200640 1 -- 172.21.15.17:0/135861183 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f096c06ac30 msgr2=0x7f096c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:32:59.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.969+0000 7f098b200640 1 --2- 172.21.15.17:0/135861183 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f096c06ac30 0x7f096c06d0f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f097c007fd0 tx=0x7f097c007920 comp rx=0 tx=0).stop 2024-03-12T17:32:59.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.969+0000 7f098b200640 1 -- 172.21.15.17:0/135861183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f098c15caa0 msgr2=0x7f098c0d2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:32:59.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.969+0000 7f098b200640 1 --2- 172.21.15.17:0/135861183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f098c15caa0 0x7f098c0d2710 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f097800c7c0 tx=0x7f097800cc80 comp rx=0 tx=0).stop 2024-03-12T17:32:59.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.970+0000 7f098b200640 1 -- 172.21.15.17:0/135861183 shutdown_connections 2024-03-12T17:32:59.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.970+0000 7f098b200640 1 --2- 172.21.15.17:0/135861183 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f096c06ac30 0x7f096c06d0f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:32:59.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.970+0000 7f098b200640 1 --2- 172.21.15.17:0/135861183 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f098c15ce80 0x7f098c0d2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:32:59.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.970+0000 7f098b200640 1 --2- 172.21.15.17:0/135861183 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f098c15caa0 0x7f098c0d2710 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:32:59.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.970+0000 7f098b200640 1 --2- 172.21.15.17:0/135861183 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f098c0b85f0 0x7f098c159240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:32:59.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.970+0000 7f098b200640 1 -- 172.21.15.17:0/135861183 >> 172.21.15.17:0/135861183 conn(0x7f098c06b160 msgr2=0x7f098c06b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:32:59.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.970+0000 7f098b200640 1 -- 172.21.15.17:0/135861183 shutdown_connections 2024-03-12T17:32:59.966 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:32:59.970+0000 7f098b200640 1 -- 172.21.15.17:0/135861183 wait complete. 2024-03-12T17:32:59.984 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dump tree /ceph-qa-suite/suites/smoke/1node/tasks 1 2024-03-12T17:33:00.205 INFO:teuthology.orchestra.run.smithi017.stdout:[{"ino":1099511629504,"rdev":0,"ctime":"2024-03-12T17:20:50.489713+0000","btime":"2024-03-12T17:20:50.486713+0000","mode":33188,"uid":1000,"gid":1301,"nlink":1,"dir_layout":{"dir_hash":0,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":4194304,"stripe_count":1,"object_size":4194304,"pool_id":7,"pool_ns":""},"old_pools":[],"size":216,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-03-12T17:20:50.489713+0000","atime":"2024-03-12T17:20:50.486713+0000","time_warp_seq":0,"change_attr":1,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"0.000000","num_files":0,"num_subdirs":0,"change_attr":0},"rstat":{"version":0,"rbytes":216,"rfiles":1,"rsubdirs":0,"rsnaps":0,"rctime":"2024-03-12T17:20:50.489713+0000"},"accounted_rstat":{"version":0,"rbytes":216,"rfiles":1,"rsubdirs":0,"rsnaps":0,"rctime":"2024-03-12T17:20:50.489713+0000"},"version":4,"file_data_version":0,"xattr_version":1,"backtrace_version":2,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"ptrwaiter":0,"request":0,"lock":0,"caps":1,"dirtyparent":1,"dirty":1,"authpin":0},"nref":3,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":5601,"pending":"pAsLsXsFsc","issued":"pAsLsXsFsc","wanted":"-","last_sent":3}],"loner":5601,"want_loner":-1,"mds_caps_wanted":[],"dirfrags":[]},{"ino":1099511629503,"rdev":0,"ctime":"2024-03-12T17:20:50.486713+0000","btime":"2024-03-12T17:20:50.479713+0000","mode":16877,"uid":1000,"gid":1301,"nlink":1,"dir_layout":{"dir_hash":2,"unused1":0,"unused2":0,"unused3":0},"layout":{"stripe_unit":0,"stripe_count":0,"object_size":0,"pool_id":-1,"pool_ns":""},"old_pools":[],"size":0,"truncate_seq":1,"truncate_size":18446744073709551615,"truncate_from":0,"truncate_pending":0,"mtime":"2024-03-12T17:20:50.486713+0000","atime":"2024-03-12T17:20:50.479713+0000","time_warp_seq":0,"change_attr":1,"export_pin":-1,"export_ephemeral_random_pin":0,"export_ephemeral_distributed_pin":false,"client_ranges":[],"dirstat":{"version":0,"mtime":"2024-03-12T17:20:50.486713+0000","num_files":1,"num_subdirs":0,"change_attr":1},"rstat":{"version":0,"rbytes":216,"rfiles":1,"rsubdirs":1,"rsnaps":0,"rctime":"2024-03-12T17:20:50.489713+0000"},"accounted_rstat":{"version":0,"rbytes":216,"rfiles":1,"rsubdirs":1,"rsnaps":0,"rctime":"2024-03-12T17:20:50.489713+0000"},"version":21,"file_data_version":0,"xattr_version":1,"backtrace_version":12,"stray_prior_path":"","max_size_ever":0,"quota":{"max_bytes":0,"max_files":0},"last_scrub_stamp":"0.000000","last_scrub_version":0,"symlink":"","xattrs":[{"key":"security.selinux","val":"unconfined_u:object_r:unlabeled_t:s0\u0000"}],"dirfragtree":{"splits":[]},"old_inodes":[],"oldest_snap":18446744073709551614,"damage_flags":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"dirfrag":1,"caps":1,"dirtyparent":1,"dirty":1,"waiter":0,"authpin":0},"nref":4,"versionlock":{"gather_set":[],"state":"lock","type":"iversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"authlock":{},"linklock":{},"dirfragtreelock":{},"filelock":{"gather_set":[],"state":"excl","type":"ifile","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"xattrlock":{},"snaplock":{},"nestlock":{"gather_set":[],"state":"lock","type":"inest","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"flocklock":{},"policylock":{},"states":["auth","dirty","dirtyparent","dirtypool"],"client_caps":[{"client_id":5601,"pending":"pAsLsXsFsx","issued":"pAsLsXsFsx","wanted":"pAsLsXsFsxcral","last_sent":7}],"loner":5601,"want_loner":5601,"mds_caps_wanted":[],"dirfrags":[{"path":"/ceph-qa-suite/suites/smoke/1node/tasks","dirfrag":"0x100000006bf","snapid_first":2,"projected_version":"5","version":"5","committing_version":"0","committed_version":"0","is_rep":false,"dir_auth":"","states":["auth","dirty","complete"],"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"child":1,"dirty":1,"authpin":0},"nref":2,"dentries":[{"path":"ceph-qa-suite/suites/smoke/1node/tasks/ceph-deploy.yaml","path_ino":1,"snap_first":2,"snap_last":18446744073709551614,"is_primary":true,"is_remote":false,"is_null":false,"is_new":false,"inode":1099511629504,"remote_type":"","version":4,"projected_version":4,"auth_pins":0,"is_auth":true,"auth_state":{"replicas":{}},"replica_state":{"authority":[0,-2],"replica_nonce":0},"auth_pins":0,"is_frozen":false,"is_freezing":false,"pins":{"request":0,"lock":0,"inodepin":1,"dirty":1,"authpin":0},"nref":2,"lock":{},"versionlock":{"gather_set":[],"state":"lock","type":"dversion","is_leased":false,"num_rdlocks":0,"num_wrlocks":0,"num_xlocks":0,"xlock_by":{}},"states":["auth","dirty"]}]}]}] 2024-03-12T17:33:00.206 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "accounted_rstat": { "rbytes": 216, "rctime": "2024-03-12T17:20:50.489713+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 0, "version": 0 }, "atime": "2024-03-12T17:20:50.486713+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 2, "btime": "2024-03-12T17:20:50.486713+0000", "change_attr": 1, "client_caps": [ { "client_id": 5601, "issued": "pAsLsXsFsc", "last_sent": 3, "pending": "pAsLsXsFsc", "wanted": "-" } ], "client_ranges": [], "ctime": "2024-03-12T17:20:50.489713+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 0, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfrags": [], "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 0, "mtime": "0.000000", "num_files": 0, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": {}, "flocklock": {}, "gid": 1301, "ino": 1099511629504, "is_auth": true, "is_freezing": false, "is_frozen": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 4194304, "pool_id": 7, "pool_ns": "", "stripe_count": 1, "stripe_unit": 4194304 }, "linklock": {}, "loner": 5601, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 33188, "mtime": "2024-03-12T17:20:50.489713+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 3, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "pins": { "authpin": 0, "caps": 1, "dirty": 1, "dirtyparent": 1, "lock": 0, "ptrwaiter": 0, "request": 0 }, "policylock": {}, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 216, "rctime": "2024-03-12T17:20:50.489713+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 0, "version": 0 }, "size": 216, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 4, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": -1, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] }, { "accounted_rstat": { "rbytes": 216, "rctime": "2024-03-12T17:20:50.489713+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "atime": "2024-03-12T17:20:50.479713+0000", "auth_pins": 0, "auth_state": { "replicas": {} }, "authlock": {}, "backtrace_version": 12, "btime": "2024-03-12T17:20:50.479713+0000", "change_attr": 1, "client_caps": [ { "client_id": 5601, "issued": "pAsLsXsFsx", "last_sent": 7, "pending": "pAsLsXsFsx", "wanted": "pAsLsXsFsxcral" } ], "client_ranges": [], "ctime": "2024-03-12T17:20:50.486713+0000", "damage_flags": 0, "dir_layout": { "dir_hash": 2, "unused1": 0, "unused2": 0, "unused3": 0 }, "dirfrags": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "committed_version": "0", "committing_version": "0", "dentries": [ { "auth_pins": 0, "auth_state": { "replicas": {} }, "inode": 1099511629504, "is_auth": true, "is_freezing": false, "is_frozen": false, "is_new": false, "is_null": false, "is_primary": true, "is_remote": false, "lock": {}, "nref": 2, "path": "ceph-qa-suite/suites/smoke/1node/tasks/ceph-deploy.yaml", "path_ino": 1, "pins": { "authpin": 0, "dirty": 1, "inodepin": 1, "lock": 0, "request": 0 }, "projected_version": 4, "remote_type": "", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snap_first": 2, "snap_last": 18446744073709551614, "states": [ "auth", "dirty" ], "version": 4, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "dversion", "xlock_by": {} } } ], "dir_auth": "", "dirfrag": "0x100000006bf", "is_auth": true, "is_freezing": false, "is_frozen": false, "is_rep": false, "nref": 2, "path": "/ceph-qa-suite/suites/smoke/1node/tasks", "pins": { "authpin": 0, "child": 1, "dirty": 1 }, "projected_version": "5", "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "snapid_first": 2, "states": [ "auth", "dirty", "complete" ], "version": "5" } ], "dirfragtree": { "splits": [] }, "dirfragtreelock": {}, "dirstat": { "change_attr": 1, "mtime": "2024-03-12T17:20:50.486713+0000", "num_files": 1, "num_subdirs": 0, "version": 0 }, "export_ephemeral_distributed_pin": false, "export_ephemeral_random_pin": 0, "export_pin": -1, "file_data_version": 0, "filelock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "excl", "type": "ifile", "xlock_by": {} }, "flocklock": {}, "gid": 1301, "ino": 1099511629503, "is_auth": true, "is_freezing": false, "is_frozen": false, "last_scrub_stamp": "0.000000", "last_scrub_version": 0, "layout": { "object_size": 0, "pool_id": -1, "pool_ns": "", "stripe_count": 0, "stripe_unit": 0 }, "linklock": {}, "loner": 5601, "max_size_ever": 0, "mds_caps_wanted": [], "mode": 16877, "mtime": "2024-03-12T17:20:50.486713+0000", "nestlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "inest", "xlock_by": {} }, "nlink": 1, "nref": 4, "old_inodes": [], "old_pools": [], "oldest_snap": 18446744073709551614, "pins": { "authpin": 0, "caps": 1, "dirfrag": 1, "dirty": 1, "dirtyparent": 1, "lock": 0, "request": 0, "waiter": 0 }, "policylock": {}, "quota": { "max_bytes": 0, "max_files": 0 }, "rdev": 0, "replica_state": { "authority": [ 0, -2 ], "replica_nonce": 0 }, "rstat": { "rbytes": 216, "rctime": "2024-03-12T17:20:50.489713+0000", "rfiles": 1, "rsnaps": 0, "rsubdirs": 1, "version": 0 }, "size": 0, "snaplock": {}, "states": [ "auth", "dirty", "dirtyparent", "dirtypool" ], "stray_prior_path": "", "symlink": "", "time_warp_seq": 0, "truncate_from": 0, "truncate_pending": 0, "truncate_seq": 1, "truncate_size": 18446744073709551615, "uid": 1000, "version": 21, "versionlock": { "gather_set": [], "is_leased": false, "num_rdlocks": 0, "num_wrlocks": 0, "num_xlocks": 0, "state": "lock", "type": "iversion", "xlock_by": {} }, "want_loner": 5601, "xattr_version": 1, "xattrlock": {}, "xattrs": [ { "key": "security.selinux", "val": "unconfined_u:object_r:unlabeled_t:s0\u0000" } ] } ] 2024-03-12T17:33:00.206 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-12T17:33:00.207 DEBUG:teuthology.orchestra.run.smithi017:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-12T17:33:00.331 DEBUG:teuthology.orchestra.run.smithi094:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-12T17:33:00.460 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-12T17:33:00.460 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:33:00.460 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-12T17:33:00.520 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:33:00.521 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-12T17:33:00.576 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T17:33:00.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.802+0000 7f8845c00640 1 Processor -- start 2024-03-12T17:33:00.798 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.802+0000 7f8845c00640 1 -- start start 2024-03-12T17:33:00.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.804+0000 7f8845c00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f88400cb930 0x7f88400b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:00.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.804+0000 7f8845c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88400cd850 0x7f88400b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:00.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.804+0000 7f8845c00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88400ce1a0 con 0x7f88400b23e0 2024-03-12T17:33:00.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.804+0000 7f8845c00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88400b1900 con 0x7f88400cb930 2024-03-12T17:33:00.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.804+0000 7f8845c00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88400b1be0 con 0x7f88400cd850 2024-03-12T17:33:00.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.804+0000 7f8837e00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f88400b23e0 0x7f88400cbd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:44634/0 (socket says 172.21.15.17:44634) 2024-03-12T17:33:00.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.804+0000 7f8837e00640 1 -- 172.21.15.17:0/3697770513 learned_addr learned my addr 172.21.15.17:0/3697770513 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:33:00.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.805+0000 7f883fe00640 1 --2- 172.21.15.17:0/3697770513 >> v2:172.21.15.94:3300/0 conn(0x7f88400cb930 0x7f88400b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:00.800 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.805+0000 7f8845200640 1 --2- 172.21.15.17:0/3697770513 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88400cd850 0x7f88400b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:00.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.805+0000 7f883f400640 1 -- 172.21.15.17:0/3697770513 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1783507902 0 0) 0x7f88400ce1a0 con 0x7f88400b23e0 2024-03-12T17:33:00.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.805+0000 7f883f400640 1 -- 172.21.15.17:0/3697770513 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8824003520 con 0x7f88400b23e0 2024-03-12T17:33:00.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.805+0000 7f883f400640 1 -- 172.21.15.17:0/3697770513 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1796963373 0 0) 0x7f8824003520 con 0x7f88400b23e0 2024-03-12T17:33:00.802 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.805+0000 7f883f400640 1 -- 172.21.15.17:0/3697770513 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88400cd850 msgr2=0x7f88400b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:00.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.805+0000 7f883f400640 1 --2- 172.21.15.17:0/3697770513 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88400cd850 0x7f88400b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:00.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.805+0000 7f883f400640 1 -- 172.21.15.17:0/3697770513 >> v2:172.21.15.94:3300/0 conn(0x7f88400cb930 msgr2=0x7f88400b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:00.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.805+0000 7f883f400640 1 --2- 172.21.15.17:0/3697770513 >> v2:172.21.15.94:3300/0 conn(0x7f88400cb930 0x7f88400b45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:00.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.805+0000 7f883f400640 1 -- 172.21.15.17:0/3697770513 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88400b1ec0 con 0x7f88400b23e0 2024-03-12T17:33:00.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.805+0000 7f883f400640 1 -- 172.21.15.17:0/3697770513 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7f8828001670 con 0x7f88400b23e0 2024-03-12T17:33:00.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.805+0000 7f883f400640 1 -- 172.21.15.17:0/3697770513 >> v1:172.21.15.17:6789/0 conn(0x7f88400b23e0 legacy=0x7f88400cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:00.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.805+0000 7f883f400640 1 --2- 172.21.15.17:0/3697770513 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8824003970 0x7f8824003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:00.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.805+0000 7f883f400640 1 --2- 172.21.15.17:0/3697770513 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88400cd850 0x7f88240047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:00.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.806+0000 7f883f400640 1 --2- 172.21.15.17:0/3697770513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8824004d00 0x7f8824005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:00.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.806+0000 7f883f400640 1 -- 172.21.15.17:0/3697770513 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88400b1900 con 0x7f8824004d00 2024-03-12T17:33:00.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.806+0000 7f883f400640 1 -- 172.21.15.17:0/3697770513 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88400b1be0 con 0x7f8824003970 2024-03-12T17:33:00.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.806+0000 7f883f400640 1 -- 172.21.15.17:0/3697770513 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f882400db90 con 0x7f88400cd850 2024-03-12T17:33:00.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.806+0000 7f8845200640 1 --2- 172.21.15.17:0/3697770513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8824004d00 0x7f8824005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:00.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.806+0000 7f883fe00640 1 --2- 172.21.15.17:0/3697770513 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8824003970 0x7f8824003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:00.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.806+0000 7f8837e00640 1 --2- 172.21.15.17:0/3697770513 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88400cd850 0x7f88240047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:00.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.806+0000 7f8845200640 1 -- 172.21.15.17:0/3697770513 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88400cd850 msgr2=0x7f88240047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:00.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.806+0000 7f8845200640 1 --2- 172.21.15.17:0/3697770513 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88400cd850 0x7f88240047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:00.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.806+0000 7f8845200640 1 -- 172.21.15.17:0/3697770513 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8824003970 msgr2=0x7f8824003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:00.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.806+0000 7f8845200640 1 --2- 172.21.15.17:0/3697770513 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8824003970 0x7f8824003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:00.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.806+0000 7f8845200640 1 -- 172.21.15.17:0/3697770513 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8824003520 con 0x7f8824004d00 2024-03-12T17:33:00.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.807+0000 7f8845200640 1 --2- 172.21.15.17:0/3697770513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8824004d00 0x7f8824005180 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f883800e170 tx=0x7f88240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de06efb93ab0ac5b server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:00.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.808+0000 7f883f400640 1 -- 172.21.15.17:0/3697770513 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883802cbf0 con 0x7f8824004d00 2024-03-12T17:33:00.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.808+0000 7f883f400640 1 -- 172.21.15.17:0/3697770513 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883800f040 con 0x7f8824004d00 2024-03-12T17:33:00.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.808+0000 7f883f400640 1 -- 172.21.15.17:0/3697770513 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8838034440 con 0x7f8824004d00 2024-03-12T17:33:00.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.808+0000 7f8845c00640 1 -- 172.21.15.17:0/3697770513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8824004d00 msgr2=0x7f8824005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:00.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.808+0000 7f8845c00640 1 --2- 172.21.15.17:0/3697770513 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8824004d00 0x7f8824005180 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f883800e170 tx=0x7f88240057f0 comp rx=0 tx=0).stop 2024-03-12T17:33:00.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.808+0000 7f8845200640 1 -- 172.21.15.17:0/3697770513 reap_dead start 2024-03-12T17:33:00.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.808+0000 7f8845c00640 1 -- 172.21.15.17:0/3697770513 shutdown_connections 2024-03-12T17:33:00.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.808+0000 7f8845c00640 1 -- 172.21.15.17:0/3697770513 >> 172.21.15.17:0/3697770513 conn(0x7f8840069ce0 msgr2=0x7f884006a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:00.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.809+0000 7f8845c00640 1 -- 172.21.15.17:0/3697770513 shutdown_connections 2024-03-12T17:33:00.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.809+0000 7f8845c00640 1 -- 172.21.15.17:0/3697770513 wait complete. 2024-03-12T17:33:00.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.810+0000 7f8845c00640 1 Processor -- start 2024-03-12T17:33:00.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.810+0000 7f8845c00640 1 -- start start 2024-03-12T17:33:00.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.811+0000 7f8845c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8824004d00 0x7f8840141c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:00.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.811+0000 7f8845c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8840152260 0x7f8840150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:00.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.811+0000 7f8845c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f88401526e0 0x7f88401511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:00.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.811+0000 7f8845c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88401517d0 con 0x7f8824004d00 2024-03-12T17:33:00.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.811+0000 7f8845c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8840151ab0 con 0x7f88401526e0 2024-03-12T17:33:00.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.811+0000 7f8845c00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88401541e0 con 0x7f8840152260 2024-03-12T17:33:00.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.812+0000 7f883fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8824004d00 0x7f8840141c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:00.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.812+0000 7f883fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8824004d00 0x7f8840141c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42042/0 (socket says 172.21.15.17:42042) 2024-03-12T17:33:00.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.812+0000 7f883fe00640 1 -- 172.21.15.17:0/2840272797 learned_addr learned my addr 172.21.15.17:0/2840272797 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:00.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.812+0000 7f883fe00640 1 -- 172.21.15.17:0/2840272797 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8840152260 msgr2=0x7f8840150c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:00.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.812+0000 7f883fe00640 1 --2- 172.21.15.17:0/2840272797 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8840152260 0x7f8840150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:00.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.812+0000 7f883fe00640 1 -- 172.21.15.17:0/2840272797 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f88401526e0 msgr2=0x7f88401511a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:00.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.812+0000 7f883fe00640 1 --2- 172.21.15.17:0/2840272797 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f88401526e0 0x7f88401511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:00.808 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.812+0000 7f883fe00640 1 -- 172.21.15.17:0/2840272797 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88400ce600 con 0x7f8824004d00 2024-03-12T17:33:00.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.812+0000 7f883fe00640 1 --2- 172.21.15.17:0/2840272797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8824004d00 0x7f8840141c80 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f8830011600 tx=0x7f8830011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:00.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.813+0000 7f883cc00640 1 -- 172.21.15.17:0/2840272797 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8830015870 con 0x7f8824004d00 2024-03-12T17:33:00.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.813+0000 7f883cc00640 1 -- 172.21.15.17:0/2840272797 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88300159d0 con 0x7f8824004d00 2024-03-12T17:33:00.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.813+0000 7f883cc00640 1 -- 172.21.15.17:0/2840272797 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8830015d40 con 0x7f8824004d00 2024-03-12T17:33:00.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.813+0000 7f8845c00640 1 -- 172.21.15.17:0/2840272797 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88401544c0 con 0x7f8824004d00 2024-03-12T17:33:00.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.813+0000 7f8845c00640 1 -- 172.21.15.17:0/2840272797 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88400cae00 con 0x7f8824004d00 2024-03-12T17:33:00.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.814+0000 7f8845c00640 1 -- 172.21.15.17:0/2840272797 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f884004e030 con 0x7f8824004d00 2024-03-12T17:33:00.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.815+0000 7f883cc00640 1 -- 172.21.15.17:0/2840272797 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f883000f490 con 0x7f8824004d00 2024-03-12T17:33:00.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.816+0000 7f883cc00640 1 --2- 172.21.15.17:0/2840272797 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f881c06ac30 0x7f881c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:00.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.816+0000 7f883cc00640 1 -- 172.21.15.17:0/2840272797 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8830089c20 con 0x7f8824004d00 2024-03-12T17:33:00.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.816+0000 7f8837e00640 1 --2- 172.21.15.17:0/2840272797 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f881c06ac30 0x7f881c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:00.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.817+0000 7f8837e00640 1 --2- 172.21.15.17:0/2840272797 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f881c06ac30 0x7f881c06d0f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8828001cf0 tx=0x7f8828001c80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:00.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:00.821+0000 7f883cc00640 1 -- 172.21.15.17:0/2840272797 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f8830054d20 con 0x7f8824004d00 2024-03-12T17:33:01.018 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.022+0000 7f8845c00640 1 -- 172.21.15.17:0/2840272797 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88400b03a0 con 0x7f8824004d00 2024-03-12T17:33:01.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.024+0000 7f883cc00640 1 -- 172.21.15.17:0/2840272797 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16149 (secure 0 0 0) 0x7f8830022090 con 0x7f8824004d00 2024-03-12T17:33:01.020 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:33:01.020 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":49,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:21:33.443906+0000","last_up_change":"2024-03-12T17:18:38.144756+0000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-12T17:18:39.552910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-03-12T17:20:26.824841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-03-12T17:20:28.205468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":37305},{"type":"v1","addr":"172.21.15.17:6801","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":37305},{"type":"v1","addr":"172.21.15.17:6803","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":37305},{"type":"v1","addr":"172.21.15.17:6807","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":37305},{"type":"v1","addr":"172.21.15.17:6805","nonce":37305}]},"public_addr":"172.21.15.17:6801/37305","cluster_addr":"172.21.15.17:6803/37305","heartbeat_back_addr":"172.21.15.17:6807/37305","heartbeat_front_addr":"172.21.15.17:6805/37305","state":["exists","up"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":37307},{"type":"v1","addr":"172.21.15.17:6814","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":37307},{"type":"v1","addr":"172.21.15.17:6818","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":37307},{"type":"v1","addr":"172.21.15.17:6827","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":37307},{"type":"v1","addr":"172.21.15.17:6823","nonce":37307}]},"public_addr":"172.21.15.17:6814/37307","cluster_addr":"172.21.15.17:6818/37307","heartbeat_back_addr":"172.21.15.17:6827/37307","heartbeat_front_addr":"172.21.15.17:6823/37307","state":["exists","up"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":37303},{"type":"v1","addr":"172.21.15.17:6809","nonce":37303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":37303},{"type":"v1","addr":"172.21.15.17:6811","nonce":37303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":37303},{"type":"v1","addr":"172.21.15.17:6819","nonce":37303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":37303},{"type":"v1","addr":"172.21.15.17:6815","nonce":37303}]},"public_addr":"172.21.15.17:6809/37303","cluster_addr":"172.21.15.17:6811/37303","heartbeat_back_addr":"172.21.15.17:6819/37303","heartbeat_front_addr":"172.21.15.17:6815/37303","state":["exists","up"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":37308},{"type":"v1","addr":"172.21.15.17:6822","nonce":37308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":37308},{"type":"v1","addr":"172.21.15.17:6826","nonce":37308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":37308},{"type":"v1","addr":"172.21.15.17:6831","nonce":37308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":37308},{"type":"v1","addr":"172.21.15.17:6829","nonce":37308}]},"public_addr":"172.21.15.17:6822/37308","cluster_addr":"172.21.15.17:6826/37308","heartbeat_back_addr":"172.21.15.17:6831/37308","heartbeat_front_addr":"172.21.15.17:6829/37308","state":["exists","up"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":37465},{"type":"v1","addr":"172.21.15.94:6809","nonce":37465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6811","nonce":37465},{"type":"v1","addr":"172.21.15.94:6813","nonce":37465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6819","nonce":37465},{"type":"v1","addr":"172.21.15.94:6822","nonce":37465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6815","nonce":37465},{"type":"v1","addr":"172.21.15.94:6817","nonce":37465}]},"public_addr":"172.21.15.94:6809/37465","cluster_addr":"172.21.15.94:6813/37465","heartbeat_back_addr":"172.21.15.94:6822/37465","heartbeat_front_addr":"172.21.15.94:6817/37465","state":["exists","up"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":37464},{"type":"v1","addr":"172.21.15.94:6812","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":37464},{"type":"v1","addr":"172.21.15.94:6816","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":37464},{"type":"v1","addr":"172.21.15.94:6823","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":37464},{"type":"v1","addr":"172.21.15.94:6820","nonce":37464}]},"public_addr":"172.21.15.94:6812/37464","cluster_addr":"172.21.15.94:6816/37464","heartbeat_back_addr":"172.21.15.94:6823/37464","heartbeat_front_addr":"172.21.15.94:6820/37464","state":["exists","up"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":37467},{"type":"v1","addr":"172.21.15.94:6825","nonce":37467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":37467},{"type":"v1","addr":"172.21.15.94:6827","nonce":37467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":37467},{"type":"v1","addr":"172.21.15.94:6831","nonce":37467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":37467},{"type":"v1","addr":"172.21.15.94:6829","nonce":37467}]},"public_addr":"172.21.15.94:6825/37467","cluster_addr":"172.21.15.94:6827/37467","heartbeat_back_addr":"172.21.15.94:6831/37467","heartbeat_front_addr":"172.21.15.94:6829/37467","state":["exists","up"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":37466},{"type":"v1","addr":"172.21.15.94:6801","nonce":37466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":37466},{"type":"v1","addr":"172.21.15.94:6803","nonce":37466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":37466},{"type":"v1","addr":"172.21.15.94:6807","nonce":37466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":37466},{"type":"v1","addr":"172.21.15.94:6805","nonce":37466}]},"public_addr":"172.21.15.94:6801/37466","cluster_addr":"172.21.15.94:6803/37466","heartbeat_back_addr":"172.21.15.94:6807/37466","heartbeat_front_addr":"172.21.15.94:6805/37466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.327217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.186966+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.419986+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.150585+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.120621+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.121576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.181257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.293188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.36","mappings":[{"from":0,"to":5}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:33:01.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.027+0000 7f8845c00640 1 -- 172.21.15.17:0/2840272797 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f881c06ac30 msgr2=0x7f881c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:01.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.027+0000 7f8845c00640 1 --2- 172.21.15.17:0/2840272797 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f881c06ac30 0x7f881c06d0f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8828001cf0 tx=0x7f8828001c80 comp rx=0 tx=0).stop 2024-03-12T17:33:01.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.027+0000 7f8845c00640 1 -- 172.21.15.17:0/2840272797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8824004d00 msgr2=0x7f8840141c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:01.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.027+0000 7f8845c00640 1 --2- 172.21.15.17:0/2840272797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8824004d00 0x7f8840141c80 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f8830011600 tx=0x7f8830011ac0 comp rx=0 tx=0).stop 2024-03-12T17:33:01.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.027+0000 7f8845c00640 1 -- 172.21.15.17:0/2840272797 shutdown_connections 2024-03-12T17:33:01.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.027+0000 7f8845c00640 1 --2- 172.21.15.17:0/2840272797 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f881c06ac30 0x7f881c06d0f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:01.023 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.027+0000 7f8845c00640 1 --2- 172.21.15.17:0/2840272797 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f88401526e0 0x7f88401511a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:01.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.027+0000 7f8845c00640 1 --2- 172.21.15.17:0/2840272797 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8840152260 0x7f8840150c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:01.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.027+0000 7f8845c00640 1 --2- 172.21.15.17:0/2840272797 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8824004d00 0x7f8840141c80 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:01.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.028+0000 7f8845c00640 1 -- 172.21.15.17:0/2840272797 >> 172.21.15.17:0/2840272797 conn(0x7f8840069ce0 msgr2=0x7f88400b0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:01.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.028+0000 7f8845c00640 1 -- 172.21.15.17:0/2840272797 shutdown_connections 2024-03-12T17:33:01.024 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.028+0000 7f8845c00640 1 -- 172.21.15.17:0/2840272797 wait complete. 2024-03-12T17:33:01.043 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-12T17:18:39.552910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-12T17:20:26.824841+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-03-12T17:20:28.205468+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-12T17:33:01.043 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-12T17:33:01.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.256+0000 7f8929c00640 1 Processor -- start 2024-03-12T17:33:01.252 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.257+0000 7f8929c00640 1 -- start start 2024-03-12T17:33:01.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.258+0000 7f8929c00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f89240adcb0 0x7f89240b5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:01.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.258+0000 7f8929c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f89240af230 0x7f89240af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:01.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.258+0000 7f8929c00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89240ae190 con 0x7f89240cf540 2024-03-12T17:33:01.253 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.258+0000 7f8929c00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89240ae470 con 0x7f89240adcb0 2024-03-12T17:33:01.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.258+0000 7f8929c00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89240ae750 con 0x7f89240af230 2024-03-12T17:33:01.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.259+0000 7f8929200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f89240af230 0x7f89240af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:01.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.259+0000 7f8923400640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f89240adcb0 0x7f89240b5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:01.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.259+0000 7f8929200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f89240af230 0x7f89240af6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.17:55382/0 (socket says 172.21.15.17:55382) 2024-03-12T17:33:01.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.259+0000 7f8929200640 1 -- 172.21.15.17:0/3972197314 learned_addr learned my addr 172.21.15.17:0/3972197314 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:01.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.259+0000 7f8929200640 1 -- 172.21.15.17:0/3972197314 >> v2:172.21.15.94:3300/0 conn(0x7f89240adcb0 msgr2=0x7f89240b5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:01.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.259+0000 7f8929200640 1 --2- 172.21.15.17:0/3972197314 >> v2:172.21.15.94:3300/0 conn(0x7f89240adcb0 0x7f89240b5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:01.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.259+0000 7f8929200640 1 -- 172.21.15.17:0/3972197314 >> v1:172.21.15.94:6789/0 conn(0x7f89240cf540 legacy=0x7f89240cf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:01.255 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.259+0000 7f8929200640 1 -- 172.21.15.17:0/3972197314 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89240aea30 con 0x7f89240af230 2024-03-12T17:33:01.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.261+0000 7f8929200640 1 --2- 172.21.15.17:0/3972197314 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f89240af230 0x7f89240af6e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f891c009e50 tx=0x7f891c02bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85476e899438a480 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:01.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.261+0000 7f8922a00640 1 -- 172.21.15.17:0/3972197314 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c02ca80 con 0x7f89240af230 2024-03-12T17:33:01.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.261+0000 7f8922a00640 1 -- 172.21.15.17:0/3972197314 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891c02cbe0 con 0x7f89240af230 2024-03-12T17:33:01.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.261+0000 7f8922a00640 1 -- 172.21.15.17:0/3972197314 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c0343f0 con 0x7f89240af230 2024-03-12T17:33:01.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.262+0000 7f8929c00640 1 -- 172.21.15.17:0/3972197314 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f89240af230 msgr2=0x7f89240af6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:01.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.262+0000 7f8929c00640 1 --2- 172.21.15.17:0/3972197314 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f89240af230 0x7f89240af6e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f891c009e50 tx=0x7f891c02bee0 comp rx=0 tx=0).stop 2024-03-12T17:33:01.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.262+0000 7f8929c00640 1 -- 172.21.15.17:0/3972197314 shutdown_connections 2024-03-12T17:33:01.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.262+0000 7f8929c00640 1 --2- 172.21.15.17:0/3972197314 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f89240af230 0x7f89240af6e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:01.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.262+0000 7f8929c00640 1 --2- 172.21.15.17:0/3972197314 >> v2:172.21.15.94:3300/0 conn(0x7f89240adcb0 0x7f89240b5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:01.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.262+0000 7f8929c00640 1 -- 172.21.15.17:0/3972197314 >> 172.21.15.17:0/3972197314 conn(0x7f8924098a60 msgr2=0x7f89240b4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:01.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.262+0000 7f8929c00640 1 -- 172.21.15.17:0/3972197314 shutdown_connections 2024-03-12T17:33:01.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.262+0000 7f8929c00640 1 -- 172.21.15.17:0/3972197314 wait complete. 2024-03-12T17:33:01.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.264+0000 7f8929c00640 1 Processor -- start 2024-03-12T17:33:01.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.264+0000 7f8929c00640 1 -- start start 2024-03-12T17:33:01.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.265+0000 7f8929c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f89240adcb0 0x7f89241ef990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:01.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.266+0000 7f8929c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f89240af230 0x7f892415bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:01.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.266+0000 7f8929c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89240cf540 0x7f89241400a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:01.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.266+0000 7f8929c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f892415cb60 con 0x7f89240cf540 2024-03-12T17:33:01.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.266+0000 7f8929c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f892415c5a0 con 0x7f89240adcb0 2024-03-12T17:33:01.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.266+0000 7f8929c00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f892415c880 con 0x7f89240af230 2024-03-12T17:33:01.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.266+0000 7f8929200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89240cf540 0x7f89241400a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:01.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.266+0000 7f8929200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89240cf540 0x7f89241400a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42056/0 (socket says 172.21.15.17:42056) 2024-03-12T17:33:01.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.266+0000 7f8929200640 1 -- 172.21.15.17:0/4199526736 learned_addr learned my addr 172.21.15.17:0/4199526736 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:01.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.266+0000 7f8923400640 1 --2- 172.21.15.17:0/4199526736 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f89240af230 0x7f892415bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:01.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.266+0000 7f8923e00640 1 --2- 172.21.15.17:0/4199526736 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f89240adcb0 0x7f89241ef990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:01.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.266+0000 7f8929200640 1 -- 172.21.15.17:0/4199526736 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f89240af230 msgr2=0x7f892415bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:01.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.266+0000 7f8929200640 1 --2- 172.21.15.17:0/4199526736 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f89240af230 0x7f892415bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:01.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.267+0000 7f8929200640 1 -- 172.21.15.17:0/4199526736 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f89240adcb0 msgr2=0x7f89241ef990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:01.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.267+0000 7f8929200640 1 --2- 172.21.15.17:0/4199526736 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f89240adcb0 0x7f89241ef990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:01.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.267+0000 7f8929200640 1 -- 172.21.15.17:0/4199526736 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f891c009b30 con 0x7f89240cf540 2024-03-12T17:33:01.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.267+0000 7f8923e00640 1 --2- 172.21.15.17:0/4199526736 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f89240adcb0 0x7f89241ef990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:33:01.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.267+0000 7f8929200640 1 --2- 172.21.15.17:0/4199526736 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89240cf540 0x7f89241400a0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f891c036040 tx=0x7f891c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:01.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.267+0000 7f891be00640 1 -- 172.21.15.17:0/4199526736 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c009510 con 0x7f89240cf540 2024-03-12T17:33:01.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.267+0000 7f891be00640 1 -- 172.21.15.17:0/4199526736 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891c03e450 con 0x7f89240cf540 2024-03-12T17:33:01.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.267+0000 7f8929c00640 1 -- 172.21.15.17:0/4199526736 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8924144520 con 0x7f89240cf540 2024-03-12T17:33:01.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.267+0000 7f891be00640 1 -- 172.21.15.17:0/4199526736 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c03e820 con 0x7f89240cf540 2024-03-12T17:33:01.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.267+0000 7f8929c00640 1 -- 172.21.15.17:0/4199526736 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89240cbf50 con 0x7f89240cf540 2024-03-12T17:33:01.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.269+0000 7f8929c00640 1 -- 172.21.15.17:0/4199526736 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89240ad0a0 con 0x7f89240cf540 2024-03-12T17:33:01.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.269+0000 7f891be00640 1 -- 172.21.15.17:0/4199526736 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f891c02cd50 con 0x7f89240cf540 2024-03-12T17:33:01.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.270+0000 7f891be00640 1 --2- 172.21.15.17:0/4199526736 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f890406ac00 0x7f890406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:01.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.270+0000 7f891be00640 1 -- 172.21.15.17:0/4199526736 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f891c0abe70 con 0x7f89240cf540 2024-03-12T17:33:01.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.271+0000 7f8923e00640 1 --2- 172.21.15.17:0/4199526736 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f890406ac00 0x7f890406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:01.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.271+0000 7f8923e00640 1 --2- 172.21.15.17:0/4199526736 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f890406ac00 0x7f890406d0c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8914001680 tx=0x7f8914009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:01.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.275+0000 7f891be00640 1 -- 172.21.15.17:0/4199526736 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f891c076f70 con 0x7f89240cf540 2024-03-12T17:33:01.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.471+0000 7f8929c00640 1 -- 172.21.15.17:0/4199526736 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f89240cc140 con 0x7f89240cf540 2024-03-12T17:33:01.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.472+0000 7f891be00640 1 -- 172.21.15.17:0/4199526736 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7f891c0430a0 con 0x7f89240cf540 2024-03-12T17:33:01.468 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-03-12T17:33:01.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.475+0000 7f8929c00640 1 -- 172.21.15.17:0/4199526736 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f890406ac00 msgr2=0x7f890406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:01.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.475+0000 7f8929c00640 1 --2- 172.21.15.17:0/4199526736 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f890406ac00 0x7f890406d0c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8914001680 tx=0x7f8914009040 comp rx=0 tx=0).stop 2024-03-12T17:33:01.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.475+0000 7f8929c00640 1 -- 172.21.15.17:0/4199526736 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89240cf540 msgr2=0x7f89241400a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:01.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.475+0000 7f8929c00640 1 --2- 172.21.15.17:0/4199526736 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89240cf540 0x7f89241400a0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f891c036040 tx=0x7f891c004a40 comp rx=0 tx=0).stop 2024-03-12T17:33:01.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.475+0000 7f8929c00640 1 -- 172.21.15.17:0/4199526736 shutdown_connections 2024-03-12T17:33:01.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.475+0000 7f8929c00640 1 --2- 172.21.15.17:0/4199526736 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f890406ac00 0x7f890406d0c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:01.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.475+0000 7f8929c00640 1 --2- 172.21.15.17:0/4199526736 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f89240cf540 0x7f89241400a0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:01.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.475+0000 7f8929c00640 1 --2- 172.21.15.17:0/4199526736 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f89240af230 0x7f892415bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:01.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.475+0000 7f8929c00640 1 --2- 172.21.15.17:0/4199526736 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f89240adcb0 0x7f89241ef990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:01.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.475+0000 7f8929c00640 1 -- 172.21.15.17:0/4199526736 >> 172.21.15.17:0/4199526736 conn(0x7f8924098a60 msgr2=0x7f892406e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:01.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.475+0000 7f8929c00640 1 -- 172.21.15.17:0/4199526736 shutdown_connections 2024-03-12T17:33:01.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.475+0000 7f8929c00640 1 -- 172.21.15.17:0/4199526736 wait complete. 2024-03-12T17:33:01.489 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-12T17:33:01.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.718+0000 7ffb86a00640 1 Processor -- start 2024-03-12T17:33:01.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.718+0000 7ffb86a00640 1 -- start start 2024-03-12T17:33:01.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.719+0000 7ffb86a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffb800b2070 0x7ffb800b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:01.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.720+0000 7ffb86a00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb800ce320 con 0x7ffb80144240 2024-03-12T17:33:01.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.720+0000 7ffb86a00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb80144620 con 0x7ffb800cb970 2024-03-12T17:33:01.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.720+0000 7ffb86a00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8015f3d0 con 0x7ffb800b2070 2024-03-12T17:33:01.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.720+0000 7ffb7fe00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7ffb80144240 0x7ffb800ce7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:44642/0 (socket says 172.21.15.17:44642) 2024-03-12T17:33:01.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.720+0000 7ffb7fe00640 1 -- 172.21.15.17:0/991177061 learned_addr learned my addr 172.21.15.17:0/991177061 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:33:01.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.720+0000 7ffb7f400640 1 --2- 172.21.15.17:0/991177061 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffb800b2070 0x7ffb800b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:01.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.720+0000 7ffb7ea00640 1 -- 172.21.15.17:0/991177061 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1015080449 0 0) 0x7ffb800ce320 con 0x7ffb80144240 2024-03-12T17:33:01.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.721+0000 7ffb7ea00640 1 -- 172.21.15.17:0/991177061 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb64003520 con 0x7ffb80144240 2024-03-12T17:33:01.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.721+0000 7ffb7ea00640 1 -- 172.21.15.17:0/991177061 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2397216498 0 0) 0x7ffb64003520 con 0x7ffb80144240 2024-03-12T17:33:01.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.721+0000 7ffb7ea00640 1 -- 172.21.15.17:0/991177061 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffb800b2070 msgr2=0x7ffb800b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:01.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.721+0000 7ffb7ea00640 1 --2- 172.21.15.17:0/991177061 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffb800b2070 0x7ffb800b24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:01.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.721+0000 7ffb7ea00640 1 -- 172.21.15.17:0/991177061 >> v1:172.21.15.94:6789/0 conn(0x7ffb800cb970 legacy=0x7ffb8015e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:01.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.721+0000 7ffb7ea00640 1 -- 172.21.15.17:0/991177061 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb800cd9f0 con 0x7ffb80144240 2024-03-12T17:33:01.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.721+0000 7ffb7ea00640 1 -- 172.21.15.17:0/991177061 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7ffb70001670 con 0x7ffb80144240 2024-03-12T17:33:01.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.721+0000 7ffb7ea00640 1 -- 172.21.15.17:0/991177061 >> v1:172.21.15.17:6789/0 conn(0x7ffb80144240 legacy=0x7ffb800ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:01.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.721+0000 7ffb7ea00640 1 --2- 172.21.15.17:0/991177061 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffb800b2070 0x7ffb640039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:01.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.721+0000 7ffb7ea00640 1 --2- 172.21.15.17:0/991177061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb64003ee0 0x7ffb640047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:01.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.721+0000 7ffb7ea00640 1 --2- 172.21.15.17:0/991177061 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb64004d00 0x7ffb64005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:01.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.721+0000 7ffb7ea00640 1 -- 172.21.15.17:0/991177061 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8015f3d0 con 0x7ffb64003ee0 2024-03-12T17:33:01.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.721+0000 7ffb7ea00640 1 -- 172.21.15.17:0/991177061 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6400b9e0 con 0x7ffb64004d00 2024-03-12T17:33:01.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.721+0000 7ffb7ea00640 1 -- 172.21.15.17:0/991177061 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6400bba0 con 0x7ffb800b2070 2024-03-12T17:33:01.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.721+0000 7ffb7f400640 1 --2- 172.21.15.17:0/991177061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb64003ee0 0x7ffb640047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:01.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.722+0000 7ffb7fe00640 1 --2- 172.21.15.17:0/991177061 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffb800b2070 0x7ffb640039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:01.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.722+0000 7ffb84a00640 1 --2- 172.21.15.17:0/991177061 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb64004d00 0x7ffb64005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:01.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.722+0000 7ffb7f400640 1 -- 172.21.15.17:0/991177061 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffb800b2070 msgr2=0x7ffb640039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:01.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.722+0000 7ffb7f400640 1 --2- 172.21.15.17:0/991177061 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffb800b2070 0x7ffb640039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:01.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.722+0000 7ffb7f400640 1 -- 172.21.15.17:0/991177061 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb64004d00 msgr2=0x7ffb64005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:01.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.722+0000 7ffb7f400640 1 --2- 172.21.15.17:0/991177061 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb64004d00 0x7ffb64005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:01.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.722+0000 7ffb7f400640 1 -- 172.21.15.17:0/991177061 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb64003520 con 0x7ffb64003ee0 2024-03-12T17:33:01.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.722+0000 7ffb84a00640 1 --2- 172.21.15.17:0/991177061 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb64004d00 0x7ffb64005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:33:01.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.723+0000 7ffb7f400640 1 --2- 172.21.15.17:0/991177061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb64003ee0 0x7ffb640047c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ffb68009fc0 tx=0x7ffb640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c65201254a611cf server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:01.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.723+0000 7ffb7ea00640 1 -- 172.21.15.17:0/991177061 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6802cb40 con 0x7ffb64003ee0 2024-03-12T17:33:01.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.723+0000 7ffb7ea00640 1 -- 172.21.15.17:0/991177061 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6800f040 con 0x7ffb64003ee0 2024-03-12T17:33:01.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.723+0000 7ffb7ea00640 1 -- 172.21.15.17:0/991177061 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb68034440 con 0x7ffb64003ee0 2024-03-12T17:33:01.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.724+0000 7ffb86a00640 1 -- 172.21.15.17:0/991177061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb64003ee0 msgr2=0x7ffb640047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:01.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.724+0000 7ffb86a00640 1 --2- 172.21.15.17:0/991177061 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb64003ee0 0x7ffb640047c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ffb68009fc0 tx=0x7ffb640057f0 comp rx=0 tx=0).stop 2024-03-12T17:33:01.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.724+0000 7ffb84a00640 1 -- 172.21.15.17:0/991177061 reap_dead start 2024-03-12T17:33:01.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.724+0000 7ffb86a00640 1 -- 172.21.15.17:0/991177061 shutdown_connections 2024-03-12T17:33:01.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.724+0000 7ffb86a00640 1 -- 172.21.15.17:0/991177061 >> 172.21.15.17:0/991177061 conn(0x7ffb80069ce0 msgr2=0x7ffb8006a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:01.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.724+0000 7ffb86a00640 1 -- 172.21.15.17:0/991177061 shutdown_connections 2024-03-12T17:33:01.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.724+0000 7ffb86a00640 1 -- 172.21.15.17:0/991177061 wait complete. 2024-03-12T17:33:01.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.726+0000 7ffb86a00640 1 Processor -- start 2024-03-12T17:33:01.722 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.726+0000 7ffb86a00640 1 -- start start 2024-03-12T17:33:01.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.727+0000 7ffb86a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb801f2c60 0x7ffb801f3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:01.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.727+0000 7ffb86a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb801f3040 0x7ffb8013d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:01.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.727+0000 7ffb86a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffb8013daf0 0x7ffb800b3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:01.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.727+0000 7ffb86a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8013df70 con 0x7ffb801f3040 2024-03-12T17:33:01.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.727+0000 7ffb86a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8013f9c0 con 0x7ffb801f2c60 2024-03-12T17:33:01.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.727+0000 7ffb86a00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8013fca0 con 0x7ffb8013daf0 2024-03-12T17:33:01.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.728+0000 7ffb7f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb801f3040 0x7ffb8013d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:01.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.728+0000 7ffb7f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb801f3040 0x7ffb8013d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:42080/0 (socket says 172.21.15.17:42080) 2024-03-12T17:33:01.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.728+0000 7ffb7f400640 1 -- 172.21.15.17:0/2186182298 learned_addr learned my addr 172.21.15.17:0/2186182298 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:01.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.728+0000 7ffb84a00640 1 --2- 172.21.15.17:0/2186182298 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffb8013daf0 0x7ffb800b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:01.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.728+0000 7ffb7f400640 1 -- 172.21.15.17:0/2186182298 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffb8013daf0 msgr2=0x7ffb800b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:01.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.728+0000 7ffb7fe00640 1 --2- 172.21.15.17:0/2186182298 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb801f2c60 0x7ffb801f3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:01.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.728+0000 7ffb7f400640 1 --2- 172.21.15.17:0/2186182298 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffb8013daf0 0x7ffb800b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:01.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.728+0000 7ffb7f400640 1 -- 172.21.15.17:0/2186182298 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb801f2c60 msgr2=0x7ffb801f3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:01.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.728+0000 7ffb7f400640 1 --2- 172.21.15.17:0/2186182298 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb801f2c60 0x7ffb801f3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:01.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.728+0000 7ffb7f400640 1 -- 172.21.15.17:0/2186182298 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8013ff80 con 0x7ffb801f3040 2024-03-12T17:33:01.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.728+0000 7ffb84a00640 1 --2- 172.21.15.17:0/2186182298 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffb8013daf0 0x7ffb800b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:33:01.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.728+0000 7ffb7fe00640 1 --2- 172.21.15.17:0/2186182298 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb801f2c60 0x7ffb801f3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:33:01.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.729+0000 7ffb7f400640 1 --2- 172.21.15.17:0/2186182298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb801f3040 0x7ffb8013d5b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ffb6800e170 tx=0x7ffb68009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:01.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.729+0000 7ffb77e00640 1 -- 172.21.15.17:0/2186182298 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb68034a40 con 0x7ffb801f3040 2024-03-12T17:33:01.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.729+0000 7ffb77e00640 1 -- 172.21.15.17:0/2186182298 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb68034ba0 con 0x7ffb801f3040 2024-03-12T17:33:01.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.729+0000 7ffb77e00640 1 -- 172.21.15.17:0/2186182298 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb68003990 con 0x7ffb801f3040 2024-03-12T17:33:01.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.729+0000 7ffb86a00640 1 -- 172.21.15.17:0/2186182298 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb801f3dc0 con 0x7ffb801f3040 2024-03-12T17:33:01.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.729+0000 7ffb86a00640 1 -- 172.21.15.17:0/2186182298 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb801f34a0 con 0x7ffb801f3040 2024-03-12T17:33:01.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.731+0000 7ffb86a00640 1 -- 172.21.15.17:0/2186182298 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb80140110 con 0x7ffb801f3040 2024-03-12T17:33:01.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.731+0000 7ffb77e00640 1 -- 172.21.15.17:0/2186182298 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7ffb68040450 con 0x7ffb801f3040 2024-03-12T17:33:01.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.732+0000 7ffb77e00640 1 --2- 172.21.15.17:0/2186182298 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ffb5c06ac30 0x7ffb5c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:01.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.732+0000 7ffb77e00640 1 -- 172.21.15.17:0/2186182298 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ffb680abc20 con 0x7ffb801f3040 2024-03-12T17:33:01.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.733+0000 7ffb7fe00640 1 --2- 172.21.15.17:0/2186182298 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ffb5c06ac30 0x7ffb5c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:01.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.733+0000 7ffb7fe00640 1 --2- 172.21.15.17:0/2186182298 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ffb5c06ac30 0x7ffb5c06d0f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ffb70001eb0 tx=0x7ffb70001d80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:01.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.737+0000 7ffb77e00640 1 -- 172.21.15.17:0/2186182298 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7ffb68076e40 con 0x7ffb801f3040 2024-03-12T17:33:01.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.938+0000 7ffb86a00640 1 -- 172.21.15.17:0/2186182298 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffb800736c0 con 0x7ffb801f3040 2024-03-12T17:33:01.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.939+0000 7ffb77e00640 1 -- 172.21.15.17:0/2186182298 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v49) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffb6807a460 con 0x7ffb801f3040 2024-03-12T17:33:01.934 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-03-12T17:33:01.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.941+0000 7ffb86a00640 1 -- 172.21.15.17:0/2186182298 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ffb5c06ac30 msgr2=0x7ffb5c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:01.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.941+0000 7ffb86a00640 1 --2- 172.21.15.17:0/2186182298 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ffb5c06ac30 0x7ffb5c06d0f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ffb70001eb0 tx=0x7ffb70001d80 comp rx=0 tx=0).stop 2024-03-12T17:33:01.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.941+0000 7ffb86a00640 1 -- 172.21.15.17:0/2186182298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb801f3040 msgr2=0x7ffb8013d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:01.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.941+0000 7ffb86a00640 1 --2- 172.21.15.17:0/2186182298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb801f3040 0x7ffb8013d5b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ffb6800e170 tx=0x7ffb68009750 comp rx=0 tx=0).stop 2024-03-12T17:33:01.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.942+0000 7ffb86a00640 1 -- 172.21.15.17:0/2186182298 shutdown_connections 2024-03-12T17:33:01.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.942+0000 7ffb86a00640 1 --2- 172.21.15.17:0/2186182298 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ffb5c06ac30 0x7ffb5c06d0f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:01.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.942+0000 7ffb86a00640 1 --2- 172.21.15.17:0/2186182298 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffb8013daf0 0x7ffb800b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:01.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.942+0000 7ffb86a00640 1 --2- 172.21.15.17:0/2186182298 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffb801f3040 0x7ffb8013d5b0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:01.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.942+0000 7ffb86a00640 1 --2- 172.21.15.17:0/2186182298 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffb801f2c60 0x7ffb801f3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:01.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.942+0000 7ffb86a00640 1 -- 172.21.15.17:0/2186182298 >> 172.21.15.17:0/2186182298 conn(0x7ffb80069ce0 msgr2=0x7ffb80142090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:01.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.942+0000 7ffb86a00640 1 -- 172.21.15.17:0/2186182298 shutdown_connections 2024-03-12T17:33:01.938 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:01.942+0000 7ffb86a00640 1 -- 172.21.15.17:0/2186182298 wait complete. 2024-03-12T17:33:01.956 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-12T17:33:02.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.184+0000 7f8d5b000640 1 Processor -- start 2024-03-12T17:33:02.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.184+0000 7f8d5b000640 1 -- start start 2024-03-12T17:33:02.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.186+0000 7f8d5b000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8d540d2fa0 0x7f8d540d3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:02.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.186+0000 7f8d5b000640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f8d540b5b50 0x7f8d540b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:02.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.186+0000 7f8d5b000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8d540cd840 0x7f8d540cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:02.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.186+0000 7f8d5b000640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d540b59e0 con 0x7f8d540cd840 2024-03-12T17:33:02.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.186+0000 7f8d5b000640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d540d14e0 con 0x7f8d540b5b50 2024-03-12T17:33:02.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.186+0000 7f8d5b000640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d540d38c0 con 0x7f8d540d2fa0 2024-03-12T17:33:02.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.186+0000 7f8d59000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8d540cd840 0x7f8d540cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:02.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.186+0000 7f8d59000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f8d540cd840 0x7f8d540cdcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48912/0 (socket says 172.21.15.17:48912) 2024-03-12T17:33:02.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.186+0000 7f8d59000640 1 -- 172.21.15.17:0/137189365 learned_addr learned my addr 172.21.15.17:0/137189365 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:02.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.187+0000 7f8d53e00640 1 --2- 172.21.15.17:0/137189365 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8d540d2fa0 0x7f8d540d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:02.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.187+0000 7f8d53400640 1 --2- 172.21.15.17:0/137189365 >> v2:172.21.15.94:3300/0 conn(0x7f8d540b5b50 0x7f8d540b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:02.183 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.187+0000 7f8d59000640 1 -- 172.21.15.17:0/137189365 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8d540d2fa0 msgr2=0x7f8d540d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:02.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.187+0000 7f8d59000640 1 --2- 172.21.15.17:0/137189365 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8d540d2fa0 0x7f8d540d3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:02.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.187+0000 7f8d59000640 1 -- 172.21.15.17:0/137189365 >> v2:172.21.15.94:3300/0 conn(0x7f8d540b5b50 msgr2=0x7f8d540b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:02.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.187+0000 7f8d59000640 1 --2- 172.21.15.17:0/137189365 >> v2:172.21.15.94:3300/0 conn(0x7f8d540b5b50 0x7f8d540b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:02.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.187+0000 7f8d59000640 1 -- 172.21.15.17:0/137189365 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d540b85b0 con 0x7f8d540cd840 2024-03-12T17:33:02.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.187+0000 7f8d53400640 1 --2- 172.21.15.17:0/137189365 >> v2:172.21.15.94:3300/0 conn(0x7f8d540b5b50 0x7f8d540b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:33:02.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.187+0000 7f8d53e00640 1 --2- 172.21.15.17:0/137189365 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8d540d2fa0 0x7f8d540d3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:33:02.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.188+0000 7f8d59000640 1 --2- 172.21.15.17:0/137189365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d540cd840 0x7f8d540cdcd0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8d54067530 tx=0x7f8d4c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6df2b5a47b1d6813 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:02.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.188+0000 7f8d52a00640 1 -- 172.21.15.17:0/137189365 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c02ca80 con 0x7f8d540cd840 2024-03-12T17:33:02.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.188+0000 7f8d52a00640 1 -- 172.21.15.17:0/137189365 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4c02cbe0 con 0x7f8d540cd840 2024-03-12T17:33:02.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.188+0000 7f8d52a00640 1 -- 172.21.15.17:0/137189365 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c0343f0 con 0x7f8d540cd840 2024-03-12T17:33:02.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.189+0000 7f8d5b000640 1 -- 172.21.15.17:0/137189365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d540cd840 msgr2=0x7f8d540cdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:02.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.189+0000 7f8d5b000640 1 --2- 172.21.15.17:0/137189365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d540cd840 0x7f8d540cdcd0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f8d54067530 tx=0x7f8d4c02bee0 comp rx=0 tx=0).stop 2024-03-12T17:33:02.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.189+0000 7f8d5b000640 1 -- 172.21.15.17:0/137189365 shutdown_connections 2024-03-12T17:33:02.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.189+0000 7f8d5b000640 1 --2- 172.21.15.17:0/137189365 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d540cd840 0x7f8d540cdcd0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:02.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.189+0000 7f8d5b000640 1 --2- 172.21.15.17:0/137189365 >> v2:172.21.15.94:3300/0 conn(0x7f8d540b5b50 0x7f8d540b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:02.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.189+0000 7f8d5b000640 1 --2- 172.21.15.17:0/137189365 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8d540d2fa0 0x7f8d540d3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:02.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.189+0000 7f8d5b000640 1 -- 172.21.15.17:0/137189365 >> 172.21.15.17:0/137189365 conn(0x7f8d54065df0 msgr2=0x7f8d54066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:02.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.189+0000 7f8d5b000640 1 -- 172.21.15.17:0/137189365 shutdown_connections 2024-03-12T17:33:02.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.189+0000 7f8d5b000640 1 -- 172.21.15.17:0/137189365 wait complete. 2024-03-12T17:33:02.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.191+0000 7f8d5b000640 1 Processor -- start 2024-03-12T17:33:02.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.191+0000 7f8d5b000640 1 -- start start 2024-03-12T17:33:02.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.192+0000 7f8d5b000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d540b5b50 0x7f8d540c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:02.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.192+0000 7f8d5b000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8d540cd840 0x7f8d540c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:02.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.192+0000 7f8d5b000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d540d2fa0 0x7f8d540cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:02.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.192+0000 7f8d5b000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d540ca8e0 con 0x7f8d540b5b50 2024-03-12T17:33:02.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.192+0000 7f8d5b000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d540c6530 con 0x7f8d540d2fa0 2024-03-12T17:33:02.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.192+0000 7f8d5b000640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d540c6af0 con 0x7f8d540cd840 2024-03-12T17:33:02.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.192+0000 7f8d53e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d540b5b50 0x7f8d540c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:02.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.193+0000 7f8d53e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d540b5b50 0x7f8d540c9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48914/0 (socket says 172.21.15.17:48914) 2024-03-12T17:33:02.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.193+0000 7f8d53e00640 1 -- 172.21.15.17:0/1640854693 learned_addr learned my addr 172.21.15.17:0/1640854693 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:02.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.193+0000 7f8d53400640 1 --2- 172.21.15.17:0/1640854693 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8d540cd840 0x7f8d540c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:02.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.193+0000 7f8d59000640 1 --2- 172.21.15.17:0/1640854693 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d540d2fa0 0x7f8d540cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:02.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.193+0000 7f8d53e00640 1 -- 172.21.15.17:0/1640854693 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8d540cd840 msgr2=0x7f8d540c6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:02.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.193+0000 7f8d53e00640 1 --2- 172.21.15.17:0/1640854693 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8d540cd840 0x7f8d540c6f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:02.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.193+0000 7f8d53e00640 1 -- 172.21.15.17:0/1640854693 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d540d2fa0 msgr2=0x7f8d540cbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:02.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.193+0000 7f8d53e00640 1 --2- 172.21.15.17:0/1640854693 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d540d2fa0 0x7f8d540cbcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:02.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.193+0000 7f8d53e00640 1 -- 172.21.15.17:0/1640854693 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d4c009b30 con 0x7f8d540b5b50 2024-03-12T17:33:02.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.193+0000 7f8d53e00640 1 --2- 172.21.15.17:0/1640854693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d540b5b50 0x7f8d540c9ad0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8d4400c820 tx=0x7f8d4400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:02.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.193+0000 7f8d4be00640 1 -- 172.21.15.17:0/1640854693 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d440079d0 con 0x7f8d540b5b50 2024-03-12T17:33:02.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.194+0000 7f8d4be00640 1 -- 172.21.15.17:0/1640854693 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d44007b30 con 0x7f8d540b5b50 2024-03-12T17:33:02.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.194+0000 7f8d4be00640 1 -- 172.21.15.17:0/1640854693 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4400ce70 con 0x7f8d540b5b50 2024-03-12T17:33:02.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.194+0000 7f8d5b000640 1 -- 172.21.15.17:0/1640854693 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d540ca320 con 0x7f8d540b5b50 2024-03-12T17:33:02.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.194+0000 7f8d5b000640 1 -- 172.21.15.17:0/1640854693 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d540c6780 con 0x7f8d540b5b50 2024-03-12T17:33:02.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.195+0000 7f8d5b000640 1 -- 172.21.15.17:0/1640854693 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d540736c0 con 0x7f8d540b5b50 2024-03-12T17:33:02.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.196+0000 7f8d4be00640 1 -- 172.21.15.17:0/1640854693 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f8d440113f0 con 0x7f8d540b5b50 2024-03-12T17:33:02.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.197+0000 7f8d4be00640 1 --2- 172.21.15.17:0/1640854693 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f8d3006ac30 0x7f8d3006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:02.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.197+0000 7f8d4be00640 1 -- 172.21.15.17:0/1640854693 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8d44089470 con 0x7f8d540b5b50 2024-03-12T17:33:02.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.197+0000 7f8d53400640 1 --2- 172.21.15.17:0/1640854693 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f8d3006ac30 0x7f8d3006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:02.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.198+0000 7f8d53400640 1 --2- 172.21.15.17:0/1640854693 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f8d3006ac30 0x7f8d3006d0f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8d540b1950 tx=0x7f8d3c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:02.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.201+0000 7f8d4be00640 1 -- 172.21.15.17:0/1640854693 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f8d44054610 con 0x7f8d540b5b50 2024-03-12T17:33:02.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.397+0000 7f8d5b000640 1 -- 172.21.15.17:0/1640854693 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8d540c62b0 con 0x7f8d540b5b50 2024-03-12T17:33:02.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.398+0000 7f8d4be00640 1 -- 172.21.15.17:0/1640854693 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v49) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8d4401f020 con 0x7f8d540b5b50 2024-03-12T17:33:02.394 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-03-12T17:33:02.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.401+0000 7f8d5b000640 1 -- 172.21.15.17:0/1640854693 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f8d3006ac30 msgr2=0x7f8d3006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:02.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.401+0000 7f8d5b000640 1 --2- 172.21.15.17:0/1640854693 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f8d3006ac30 0x7f8d3006d0f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8d540b1950 tx=0x7f8d3c008040 comp rx=0 tx=0).stop 2024-03-12T17:33:02.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.401+0000 7f8d5b000640 1 -- 172.21.15.17:0/1640854693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d540b5b50 msgr2=0x7f8d540c9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:02.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.401+0000 7f8d5b000640 1 --2- 172.21.15.17:0/1640854693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d540b5b50 0x7f8d540c9ad0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f8d4400c820 tx=0x7f8d4400cc20 comp rx=0 tx=0).stop 2024-03-12T17:33:02.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.401+0000 7f8d5b000640 1 -- 172.21.15.17:0/1640854693 shutdown_connections 2024-03-12T17:33:02.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.401+0000 7f8d5b000640 1 --2- 172.21.15.17:0/1640854693 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f8d3006ac30 0x7f8d3006d0f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:02.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.401+0000 7f8d5b000640 1 --2- 172.21.15.17:0/1640854693 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8d540d2fa0 0x7f8d540cbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:02.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.401+0000 7f8d5b000640 1 --2- 172.21.15.17:0/1640854693 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8d540cd840 0x7f8d540c6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:02.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.401+0000 7f8d5b000640 1 --2- 172.21.15.17:0/1640854693 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8d540b5b50 0x7f8d540c9ad0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:02.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.401+0000 7f8d5b000640 1 -- 172.21.15.17:0/1640854693 >> 172.21.15.17:0/1640854693 conn(0x7f8d54065df0 msgr2=0x7f8d5415c220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:02.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.401+0000 7f8d5b000640 1 -- 172.21.15.17:0/1640854693 shutdown_connections 2024-03-12T17:33:02.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.401+0000 7f8d5b000640 1 -- 172.21.15.17:0/1640854693 wait complete. 2024-03-12T17:33:02.415 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-12T17:33:02.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.641+0000 7f9576400640 1 Processor -- start 2024-03-12T17:33:02.637 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.642+0000 7f9576400640 1 -- start start 2024-03-12T17:33:02.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.643+0000 7f9576400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f95700b4b20 0x7f9570167800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:02.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.643+0000 7f9576400640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9570160470 con 0x7f95700b86c0 2024-03-12T17:33:02.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.643+0000 7f9576400640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f957006b840 con 0x7f9570160090 2024-03-12T17:33:02.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.643+0000 7f9576400640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95700d0e40 con 0x7f95700b4b20 2024-03-12T17:33:02.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.644+0000 7f956fe00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f95700b86c0 0x7f95700b4410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:50924/0 (socket says 172.21.15.17:50924) 2024-03-12T17:33:02.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.644+0000 7f956fe00640 1 -- 172.21.15.17:0/2902136021 learned_addr learned my addr 172.21.15.17:0/2902136021 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:33:02.639 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.644+0000 7f9575a00640 1 --2- 172.21.15.17:0/2902136021 >> v2:172.21.15.17:3300/0 conn(0x7f95700b4b20 0x7f9570167800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:02.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.644+0000 7f956f400640 1 -- 172.21.15.17:0/2902136021 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2018531730 0 0) 0x7f9570160470 con 0x7f95700b86c0 2024-03-12T17:33:02.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.644+0000 7f956f400640 1 -- 172.21.15.17:0/2902136021 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9550003520 con 0x7f95700b86c0 2024-03-12T17:33:02.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.644+0000 7f9575a00640 1 -- 172.21.15.17:0/2902136021 >> v1:172.21.15.94:6789/0 conn(0x7f9570160090 legacy=0x7f957006b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:02.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.644+0000 7f9575a00640 1 -- 172.21.15.17:0/2902136021 >> v1:172.21.15.17:6789/0 conn(0x7f95700b86c0 legacy=0x7f95700b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:02.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.644+0000 7f9575a00640 1 -- 172.21.15.17:0/2902136021 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95700d0a80 con 0x7f95700b4b20 2024-03-12T17:33:02.640 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.645+0000 7f9575a00640 1 --2- 172.21.15.17:0/2902136021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95700b4b20 0x7f9570167800 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f95680097a0 tx=0x7f956802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a6c0e96eeea789 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:02.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.646+0000 7f956f400640 1 -- 172.21.15.17:0/2902136021 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9568031830 con 0x7f95700b4b20 2024-03-12T17:33:02.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.646+0000 7f956f400640 1 -- 172.21.15.17:0/2902136021 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9568031990 con 0x7f95700b4b20 2024-03-12T17:33:02.641 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.646+0000 7f956f400640 1 -- 172.21.15.17:0/2902136021 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9568031d20 con 0x7f95700b4b20 2024-03-12T17:33:02.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.646+0000 7f9576400640 1 -- 172.21.15.17:0/2902136021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95700b4b20 msgr2=0x7f9570167800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:02.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.646+0000 7f9576400640 1 --2- 172.21.15.17:0/2902136021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95700b4b20 0x7f9570167800 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f95680097a0 tx=0x7f956802b8d0 comp rx=0 tx=0).stop 2024-03-12T17:33:02.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.647+0000 7f9576400640 1 -- 172.21.15.17:0/2902136021 shutdown_connections 2024-03-12T17:33:02.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.647+0000 7f9576400640 1 --2- 172.21.15.17:0/2902136021 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95700b4b20 0x7f9570167800 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:02.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.647+0000 7f9576400640 1 -- 172.21.15.17:0/2902136021 >> 172.21.15.17:0/2902136021 conn(0x7f95700cf5f0 msgr2=0x7f95700cfa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:02.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.647+0000 7f9576400640 1 -- 172.21.15.17:0/2902136021 shutdown_connections 2024-03-12T17:33:02.642 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.647+0000 7f9576400640 1 -- 172.21.15.17:0/2902136021 wait complete. 2024-03-12T17:33:02.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.648+0000 7f9576400640 1 Processor -- start 2024-03-12T17:33:02.644 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.649+0000 7f9576400640 1 -- start start 2024-03-12T17:33:02.645 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.650+0000 7f9576400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f95700b4b20 0x7f9570159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:02.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.650+0000 7f9576400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95700b86c0 0x7f95701f2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:02.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.650+0000 7f9576400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9570160090 0x7f9570157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:02.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.650+0000 7f9576400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95701f3270 con 0x7f95700b86c0 2024-03-12T17:33:02.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.650+0000 7f9576400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9570159f10 con 0x7f9570160090 2024-03-12T17:33:02.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.650+0000 7f9576400640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95700c9be0 con 0x7f95700b4b20 2024-03-12T17:33:02.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.650+0000 7f956fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95700b86c0 0x7f95701f2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:02.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.650+0000 7f956fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95700b86c0 0x7f95701f2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48944/0 (socket says 172.21.15.17:48944) 2024-03-12T17:33:02.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.650+0000 7f956fe00640 1 -- 172.21.15.17:0/3581755299 learned_addr learned my addr 172.21.15.17:0/3581755299 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:02.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.650+0000 7f9575000640 1 --2- 172.21.15.17:0/3581755299 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f95700b4b20 0x7f9570159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:02.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.650+0000 7f9575a00640 1 --2- 172.21.15.17:0/3581755299 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9570160090 0x7f9570157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:02.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.650+0000 7f956fe00640 1 -- 172.21.15.17:0/3581755299 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f95700b4b20 msgr2=0x7f9570159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:02.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.650+0000 7f956fe00640 1 --2- 172.21.15.17:0/3581755299 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f95700b4b20 0x7f9570159930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:02.646 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.650+0000 7f956fe00640 1 -- 172.21.15.17:0/3581755299 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9570160090 msgr2=0x7f9570157ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:02.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.650+0000 7f956fe00640 1 --2- 172.21.15.17:0/3581755299 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9570160090 0x7f9570157ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:02.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.650+0000 7f956fe00640 1 -- 172.21.15.17:0/3581755299 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9568009400 con 0x7f95700b86c0 2024-03-12T17:33:02.647 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.651+0000 7f956fe00640 1 --2- 172.21.15.17:0/3581755299 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95700b86c0 0x7f95701f2d30 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f955800cbc0 tx=0x7f955800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:02.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.651+0000 7f956cc00640 1 -- 172.21.15.17:0/3581755299 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955800ad40 con 0x7f95700b86c0 2024-03-12T17:33:02.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.651+0000 7f956cc00640 1 -- 172.21.15.17:0/3581755299 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9558012400 con 0x7f95700b86c0 2024-03-12T17:33:02.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.651+0000 7f956cc00640 1 -- 172.21.15.17:0/3581755299 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955800aea0 con 0x7f95700b86c0 2024-03-12T17:33:02.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.651+0000 7f9576400640 1 -- 172.21.15.17:0/3581755299 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95700c9ec0 con 0x7f95700b86c0 2024-03-12T17:33:02.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.651+0000 7f9576400640 1 -- 172.21.15.17:0/3581755299 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9570158000 con 0x7f95700b86c0 2024-03-12T17:33:02.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.652+0000 7f9576400640 1 -- 172.21.15.17:0/3581755299 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9570067120 con 0x7f95700b86c0 2024-03-12T17:33:02.648 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.653+0000 7f956cc00640 1 -- 172.21.15.17:0/3581755299 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f9558007070 con 0x7f95700b86c0 2024-03-12T17:33:02.649 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.654+0000 7f956cc00640 1 --2- 172.21.15.17:0/3581755299 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f954c06ac00 0x7f954c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:02.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.654+0000 7f956cc00640 1 -- 172.21.15.17:0/3581755299 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f9558089350 con 0x7f95700b86c0 2024-03-12T17:33:02.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.654+0000 7f9575000640 1 --2- 172.21.15.17:0/3581755299 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f954c06ac00 0x7f954c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:02.650 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.655+0000 7f9575000640 1 --2- 172.21.15.17:0/3581755299 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f954c06ac00 0x7f954c06d0c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9560000f60 tx=0x7f9560009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:02.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.659+0000 7f956cc00640 1 -- 172.21.15.17:0/3581755299 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f9558058030 con 0x7f95700b86c0 2024-03-12T17:33:02.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.869+0000 7f9576400640 1 -- 172.21.15.17:0/3581755299 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9570072360 con 0x7f95700b86c0 2024-03-12T17:33:02.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.870+0000 7f956cc00640 1 -- 172.21.15.17:0/3581755299 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v49) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9558057bc0 con 0x7f95700b86c0 2024-03-12T17:33:02.865 INFO:teuthology.orchestra.run.smithi017.stderr:listed 0 entries 2024-03-12T17:33:02.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.873+0000 7f9576400640 1 -- 172.21.15.17:0/3581755299 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f954c06ac00 msgr2=0x7f954c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:02.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.873+0000 7f9576400640 1 --2- 172.21.15.17:0/3581755299 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f954c06ac00 0x7f954c06d0c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9560000f60 tx=0x7f9560009040 comp rx=0 tx=0).stop 2024-03-12T17:33:02.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.873+0000 7f9576400640 1 -- 172.21.15.17:0/3581755299 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95700b86c0 msgr2=0x7f95701f2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:02.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.873+0000 7f9576400640 1 --2- 172.21.15.17:0/3581755299 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95700b86c0 0x7f95701f2d30 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f955800cbc0 tx=0x7f955800a430 comp rx=0 tx=0).stop 2024-03-12T17:33:02.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.873+0000 7f9576400640 1 -- 172.21.15.17:0/3581755299 shutdown_connections 2024-03-12T17:33:02.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.873+0000 7f9576400640 1 --2- 172.21.15.17:0/3581755299 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f954c06ac00 0x7f954c06d0c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:02.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.873+0000 7f9576400640 1 --2- 172.21.15.17:0/3581755299 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9570160090 0x7f9570157ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:02.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.873+0000 7f9576400640 1 --2- 172.21.15.17:0/3581755299 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f95700b86c0 0x7f95701f2d30 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:02.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.873+0000 7f9576400640 1 --2- 172.21.15.17:0/3581755299 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f95700b4b20 0x7f9570159930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:02.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.873+0000 7f9576400640 1 -- 172.21.15.17:0/3581755299 >> 172.21.15.17:0/3581755299 conn(0x7f95700cf5f0 msgr2=0x7f957006b130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:02.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.873+0000 7f9576400640 1 -- 172.21.15.17:0/3581755299 shutdown_connections 2024-03-12T17:33:02.869 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:02.873+0000 7f9576400640 1 -- 172.21.15.17:0/3581755299 wait complete. 2024-03-12T17:33:02.889 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-12T17:33:02.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:33:02.890 DEBUG:teuthology.orchestra.run.smithi017:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-03-12T17:33:03.082 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi017.front.sepia.ceph.com 2024-03-12T17:33:03.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:33:03.082 DEBUG:teuthology.orchestra.run.smithi017:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-12T17:33:03.121 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-12T17:33:03.121 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-12T17:33:03.168 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053417,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498348k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249172k,nr_inodes=812293,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498348k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-12T17:33:03.168 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:33:03.168 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-12T17:33:03.218 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054202,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249800k,nr_inodes=812450,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-12T17:33:03.218 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-12T17:33:03.219 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-12T17:33:03.273 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053417,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498348k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249172k,nr_inodes=812293,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498348k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-12T17:33:03.273 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-12T17:33:03.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.504+0000 7f4994c00640 1 Processor -- start 2024-03-12T17:33:03.500 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.504+0000 7f4994c00640 1 -- start start 2024-03-12T17:33:03.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.506+0000 7f4994c00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f499015caa0 0x7f4990160790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:03.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.506+0000 7f4994c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f499015ce80 0x7f49900cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:03.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.506+0000 7f4994c00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4990161650 con 0x7f49900b85f0 2024-03-12T17:33:03.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.506+0000 7f4994c00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4990161090 con 0x7f499015caa0 2024-03-12T17:33:03.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.506+0000 7f4994c00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4990161370 con 0x7f499015ce80 2024-03-12T17:33:03.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.506+0000 7f498fe00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f49900b85f0 0x7f49900b43a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:50926/0 (socket says 172.21.15.17:50926) 2024-03-12T17:33:03.502 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.506+0000 7f498fe00640 1 -- 172.21.15.17:0/1577941529 learned_addr learned my addr 172.21.15.17:0/1577941529 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:33:03.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.507+0000 7f498f400640 1 --2- 172.21.15.17:0/1577941529 >> v2:172.21.15.94:3300/0 conn(0x7f499015caa0 0x7f4990160790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:03.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.507+0000 7f4987e00640 1 --2- 172.21.15.17:0/1577941529 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f499015ce80 0x7f49900cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:03.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.507+0000 7f498ea00640 1 -- 172.21.15.17:0/1577941529 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3041875730 0 0) 0x7f4990161650 con 0x7f49900b85f0 2024-03-12T17:33:03.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.507+0000 7f498ea00640 1 -- 172.21.15.17:0/1577941529 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4974003520 con 0x7f49900b85f0 2024-03-12T17:33:03.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.507+0000 7f498ea00640 1 -- 172.21.15.17:0/1577941529 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3770018949 0 0) 0x7f4974003520 con 0x7f49900b85f0 2024-03-12T17:33:03.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.507+0000 7f498ea00640 1 -- 172.21.15.17:0/1577941529 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f499015ce80 msgr2=0x7f49900cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:03.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.507+0000 7f498ea00640 1 --2- 172.21.15.17:0/1577941529 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f499015ce80 0x7f49900cf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:03.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.507+0000 7f498ea00640 1 -- 172.21.15.17:0/1577941529 >> v2:172.21.15.94:3300/0 conn(0x7f499015caa0 msgr2=0x7f4990160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:03.505 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.507+0000 7f498ea00640 1 --2- 172.21.15.17:0/1577941529 >> v2:172.21.15.94:3300/0 conn(0x7f499015caa0 0x7f4990160790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:03.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.507+0000 7f498ea00640 1 -- 172.21.15.17:0/1577941529 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49900d0ad0 con 0x7f49900b85f0 2024-03-12T17:33:03.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.507+0000 7f498ea00640 1 -- 172.21.15.17:0/1577941529 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7f49880019f0 con 0x7f49900b85f0 2024-03-12T17:33:03.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.507+0000 7f498ea00640 1 -- 172.21.15.17:0/1577941529 >> v1:172.21.15.17:6789/0 conn(0x7f49900b85f0 legacy=0x7f49900b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:03.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.507+0000 7f498ea00640 1 --2- 172.21.15.17:0/1577941529 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f499015ce80 0x7f4974003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:03.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.508+0000 7f498ea00640 1 --2- 172.21.15.17:0/1577941529 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4974003f40 0x7f49740047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:03.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.508+0000 7f498ea00640 1 --2- 172.21.15.17:0/1577941529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4974004d00 0x7f4974005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:03.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.508+0000 7f498ea00640 1 -- 172.21.15.17:0/1577941529 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4990161090 con 0x7f4974004d00 2024-03-12T17:33:03.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.508+0000 7f498ea00640 1 -- 172.21.15.17:0/1577941529 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4990161370 con 0x7f4974003f40 2024-03-12T17:33:03.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.508+0000 7f498ea00640 1 -- 172.21.15.17:0/1577941529 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f497400b980 con 0x7f499015ce80 2024-03-12T17:33:03.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.508+0000 7f498fe00640 1 --2- 172.21.15.17:0/1577941529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4974004d00 0x7f4974005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:03.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.508+0000 7f498f400640 1 --2- 172.21.15.17:0/1577941529 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f499015ce80 0x7f4974003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:03.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.508+0000 7f4987e00640 1 --2- 172.21.15.17:0/1577941529 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4974003f40 0x7f49740047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:03.506 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.508+0000 7f498fe00640 1 -- 172.21.15.17:0/1577941529 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f499015ce80 msgr2=0x7f4974003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:03.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.508+0000 7f498fe00640 1 --2- 172.21.15.17:0/1577941529 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f499015ce80 0x7f4974003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:03.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.508+0000 7f498fe00640 1 -- 172.21.15.17:0/1577941529 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4974003f40 msgr2=0x7f49740047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:03.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.508+0000 7f498fe00640 1 --2- 172.21.15.17:0/1577941529 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4974003f40 0x7f49740047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:03.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.508+0000 7f498fe00640 1 -- 172.21.15.17:0/1577941529 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4974003520 con 0x7f4974004d00 2024-03-12T17:33:03.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.508+0000 7f498f400640 1 --2- 172.21.15.17:0/1577941529 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f499015ce80 0x7f4974003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:33:03.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.508+0000 7f4987e00640 1 --2- 172.21.15.17:0/1577941529 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4974003f40 0x7f49740047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:33:03.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.509+0000 7f498fe00640 1 --2- 172.21.15.17:0/1577941529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4974004d00 0x7f4974005180 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f498800a7b0 tx=0x7f49740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24d06117c5ebc05a server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:03.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.510+0000 7f498ea00640 1 -- 172.21.15.17:0/1577941529 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4988034630 con 0x7f4974004d00 2024-03-12T17:33:03.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.510+0000 7f498ea00640 1 -- 172.21.15.17:0/1577941529 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498802f070 con 0x7f4974004d00 2024-03-12T17:33:03.507 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.510+0000 7f498ea00640 1 -- 172.21.15.17:0/1577941529 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4988034a10 con 0x7f4974004d00 2024-03-12T17:33:03.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.510+0000 7f4994c00640 1 -- 172.21.15.17:0/1577941529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4974004d00 msgr2=0x7f4974005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:03.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.510+0000 7f4994c00640 1 --2- 172.21.15.17:0/1577941529 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4974004d00 0x7f4974005180 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f498800a7b0 tx=0x7f49740057f0 comp rx=0 tx=0).stop 2024-03-12T17:33:03.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.510+0000 7f498fe00640 1 -- 172.21.15.17:0/1577941529 reap_dead start 2024-03-12T17:33:03.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.510+0000 7f4994c00640 1 -- 172.21.15.17:0/1577941529 shutdown_connections 2024-03-12T17:33:03.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.510+0000 7f4994c00640 1 -- 172.21.15.17:0/1577941529 >> 172.21.15.17:0/1577941529 conn(0x7f499006b160 msgr2=0x7f499006b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:03.508 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.510+0000 7f4994c00640 1 -- 172.21.15.17:0/1577941529 shutdown_connections 2024-03-12T17:33:03.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.510+0000 7f4994c00640 1 -- 172.21.15.17:0/1577941529 wait complete. 2024-03-12T17:33:03.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.512+0000 7f4994c00640 1 Processor -- start 2024-03-12T17:33:03.509 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.512+0000 7f4994c00640 1 -- start start 2024-03-12T17:33:03.510 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.513+0000 7f4994c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49900cd6a0 0x7f4990159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:03.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.513+0000 7f4994c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f49900b1c80 0x7f4990159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:03.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.513+0000 7f4994c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f49900cda80 0x7f49901f5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:03.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.513+0000 7f4994c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49900b52a0 con 0x7f49900cd6a0 2024-03-12T17:33:03.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.513+0000 7f4994c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49900b2720 con 0x7f49900cda80 2024-03-12T17:33:03.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.513+0000 7f4994c00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49900b2a00 con 0x7f49900b1c80 2024-03-12T17:33:03.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.513+0000 7f498f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49900cd6a0 0x7f4990159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:03.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.514+0000 7f498f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49900cd6a0 0x7f4990159a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48968/0 (socket says 172.21.15.17:48968) 2024-03-12T17:33:03.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.514+0000 7f498f400640 1 -- 172.21.15.17:0/4013464722 learned_addr learned my addr 172.21.15.17:0/4013464722 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:03.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.514+0000 7f498f400640 1 -- 172.21.15.17:0/4013464722 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f49900b1c80 msgr2=0x7f4990159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:03.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.514+0000 7f4987e00640 1 --2- 172.21.15.17:0/4013464722 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f49900b1c80 0x7f4990159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:03.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.514+0000 7f498fe00640 1 --2- 172.21.15.17:0/4013464722 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f49900cda80 0x7f49901f5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:03.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.514+0000 7f498f400640 1 --2- 172.21.15.17:0/4013464722 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f49900b1c80 0x7f4990159fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:03.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.514+0000 7f498f400640 1 -- 172.21.15.17:0/4013464722 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f49900cda80 msgr2=0x7f49901f5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:03.511 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.514+0000 7f498f400640 1 --2- 172.21.15.17:0/4013464722 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f49900cda80 0x7f49901f5910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:03.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.514+0000 7f498f400640 1 -- 172.21.15.17:0/4013464722 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49900c9b00 con 0x7f49900cd6a0 2024-03-12T17:33:03.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.514+0000 7f498f400640 1 --2- 172.21.15.17:0/4013464722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49900cd6a0 0x7f4990159a90 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f49800109d0 tx=0x7f4980010e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:03.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.515+0000 7f4987400640 1 -- 172.21.15.17:0/4013464722 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498000ec20 con 0x7f49900cd6a0 2024-03-12T17:33:03.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.515+0000 7f4987400640 1 -- 172.21.15.17:0/4013464722 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f498000ed80 con 0x7f49900cd6a0 2024-03-12T17:33:03.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.515+0000 7f4987400640 1 -- 172.21.15.17:0/4013464722 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498001c620 con 0x7f49900cd6a0 2024-03-12T17:33:03.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.515+0000 7f4994c00640 1 -- 172.21.15.17:0/4013464722 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49900b2ce0 con 0x7f49900cd6a0 2024-03-12T17:33:03.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.515+0000 7f4994c00640 1 -- 172.21.15.17:0/4013464722 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49900b4ce0 con 0x7f49900cd6a0 2024-03-12T17:33:03.512 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.516+0000 7f4994c00640 1 -- 172.21.15.17:0/4013464722 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4990072360 con 0x7f49900cd6a0 2024-03-12T17:33:03.513 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.517+0000 7f4987400640 1 -- 172.21.15.17:0/4013464722 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f498001c780 con 0x7f49900cd6a0 2024-03-12T17:33:03.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.519+0000 7f4987400640 1 --2- 172.21.15.17:0/4013464722 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f496c06ac30 0x7f496c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:03.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.519+0000 7f4987400640 1 -- 172.21.15.17:0/4013464722 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f4980089a20 con 0x7f49900cd6a0 2024-03-12T17:33:03.514 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.519+0000 7f4987e00640 1 --2- 172.21.15.17:0/4013464722 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f496c06ac30 0x7f496c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:03.515 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.520+0000 7f4987e00640 1 --2- 172.21.15.17:0/4013464722 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f496c06ac30 0x7f496c06d0f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f49900b6520 tx=0x7f4978008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:03.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.523+0000 7f4987400640 1 -- 172.21.15.17:0/4013464722 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f4980054c60 con 0x7f49900cd6a0 2024-03-12T17:33:03.759 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.763+0000 7f4994c00640 1 -- 172.21.15.17:0/4013464722 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f49900c9c90 con 0x7f49900cd6a0 2024-03-12T17:33:03.760 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.765+0000 7f4987400640 1 -- 172.21.15.17:0/4013464722 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4731 (secure 0 0 0) 0x7f4980058280 con 0x7f49900cd6a0 2024-03-12T17:33:03.760 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:33:03.760 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4808,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6834/3175855266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3175855266},{"type":"v1","addr":"172.21.15.94:6834","nonce":3175855266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":4927,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/1725537585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1725537585},{"type":"v1","addr":"172.21.15.17:6835","nonce":1725537585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":4939,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/630541950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6833","nonce":630541950},{"type":"v1","addr":"172.21.15.94:6835","nonce":630541950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T17:20:29.180386+0000","modified":"2024-03-12T17:20:32.399146+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5433":{"gid":5433,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6837/2711965846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":2711965846},{"type":"v1","addr":"172.21.15.17:6837","nonce":2711965846}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-03-12T17:33:03.761 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 22 2024-03-12T17:33:03.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.767+0000 7f4994c00640 1 -- 172.21.15.17:0/4013464722 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f496c06ac30 msgr2=0x7f496c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:03.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.767+0000 7f4994c00640 1 --2- 172.21.15.17:0/4013464722 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f496c06ac30 0x7f496c06d0f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f49900b6520 tx=0x7f4978008040 comp rx=0 tx=0).stop 2024-03-12T17:33:03.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.767+0000 7f4994c00640 1 -- 172.21.15.17:0/4013464722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49900cd6a0 msgr2=0x7f4990159a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:03.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.767+0000 7f4994c00640 1 --2- 172.21.15.17:0/4013464722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49900cd6a0 0x7f4990159a90 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f49800109d0 tx=0x7f4980010e90 comp rx=0 tx=0).stop 2024-03-12T17:33:03.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.767+0000 7f4994c00640 1 -- 172.21.15.17:0/4013464722 shutdown_connections 2024-03-12T17:33:03.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.767+0000 7f4994c00640 1 --2- 172.21.15.17:0/4013464722 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f496c06ac30 0x7f496c06d0f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:03.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.767+0000 7f4994c00640 1 --2- 172.21.15.17:0/4013464722 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f49900cda80 0x7f49901f5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:03.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.767+0000 7f4994c00640 1 --2- 172.21.15.17:0/4013464722 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f49900b1c80 0x7f4990159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:03.763 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.767+0000 7f4994c00640 1 --2- 172.21.15.17:0/4013464722 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f49900cd6a0 0x7f4990159a90 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:03.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.767+0000 7f4994c00640 1 -- 172.21.15.17:0/4013464722 >> 172.21.15.17:0/4013464722 conn(0x7f499006b160 msgr2=0x7f499015bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:03.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.767+0000 7f4994c00640 1 -- 172.21.15.17:0/4013464722 shutdown_connections 2024-03-12T17:33:03.764 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:03.768+0000 7f4994c00640 1 -- 172.21.15.17:0/4013464722 wait complete. 2024-03-12T17:33:03.783 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T17:33:03.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.002+0000 7fafaaa00640 1 Processor -- start 2024-03-12T17:33:03.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.002+0000 7fafaaa00640 1 -- start start 2024-03-12T17:33:04.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.004+0000 7fafaaa00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fafa40b2070 0x7fafa40b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:04.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.004+0000 7fafaaa00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fafa40cb970 0x7fafa40cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:04.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.004+0000 7fafaaa00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa40ce320 con 0x7fafa4144240 2024-03-12T17:33:04.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.004+0000 7fafaaa00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafa40cc320 con 0x7fafa40cb970 2024-03-12T17:33:04.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.004+0000 7fafaaa00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafa4144620 con 0x7fafa40b2070 2024-03-12T17:33:04.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.004+0000 7fafa8a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fafa40cb970 0x7fafa40cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:04.000 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.004+0000 7fafa8a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fafa40cb970 0x7fafa40cbde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48974/0 (socket says 172.21.15.17:48974) 2024-03-12T17:33:04.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.004+0000 7fafa8a00640 1 -- 172.21.15.17:0/3521498078 learned_addr learned my addr 172.21.15.17:0/3521498078 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:04.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.004+0000 7fafa3400640 1 --2- 172.21.15.17:0/3521498078 >> v2:172.21.15.94:3300/0 conn(0x7fafa40b2070 0x7fafa40b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:04.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.005+0000 7fafa8a00640 1 -- 172.21.15.17:0/3521498078 >> v2:172.21.15.94:3300/0 conn(0x7fafa40b2070 msgr2=0x7fafa40b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:04.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.005+0000 7fafa8a00640 1 --2- 172.21.15.17:0/3521498078 >> v2:172.21.15.94:3300/0 conn(0x7fafa40b2070 0x7fafa40b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:04.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.005+0000 7fafa8a00640 1 -- 172.21.15.17:0/3521498078 >> v1:172.21.15.94:6789/0 conn(0x7fafa4144240 legacy=0x7fafa40ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:04.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.005+0000 7fafa8a00640 1 -- 172.21.15.17:0/3521498078 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa415f3d0 con 0x7fafa40cb970 2024-03-12T17:33:04.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.006+0000 7fafa8a00640 1 --2- 172.21.15.17:0/3521498078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafa40cb970 0x7fafa40cbde0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fafa415bfe0 tx=0x7faf9c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc387adccf356924 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:04.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.006+0000 7fafa2a00640 1 -- 172.21.15.17:0/3521498078 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c02ca80 con 0x7fafa40cb970 2024-03-12T17:33:04.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.006+0000 7fafa2a00640 1 -- 172.21.15.17:0/3521498078 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9c02cbe0 con 0x7fafa40cb970 2024-03-12T17:33:04.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.006+0000 7fafa2a00640 1 -- 172.21.15.17:0/3521498078 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c0343f0 con 0x7fafa40cb970 2024-03-12T17:33:04.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.007+0000 7fafaaa00640 1 -- 172.21.15.17:0/3521498078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafa40cb970 msgr2=0x7fafa40cbde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:04.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.007+0000 7fafaaa00640 1 --2- 172.21.15.17:0/3521498078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafa40cb970 0x7fafa40cbde0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fafa415bfe0 tx=0x7faf9c02bee0 comp rx=0 tx=0).stop 2024-03-12T17:33:04.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.007+0000 7fafaaa00640 1 -- 172.21.15.17:0/3521498078 shutdown_connections 2024-03-12T17:33:04.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.007+0000 7fafaaa00640 1 --2- 172.21.15.17:0/3521498078 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafa40cb970 0x7fafa40cbde0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:04.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.007+0000 7fafaaa00640 1 --2- 172.21.15.17:0/3521498078 >> v2:172.21.15.94:3300/0 conn(0x7fafa40b2070 0x7fafa40b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:04.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.007+0000 7fafaaa00640 1 -- 172.21.15.17:0/3521498078 >> 172.21.15.17:0/3521498078 conn(0x7fafa4069ce0 msgr2=0x7fafa406a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:04.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.007+0000 7fafaaa00640 1 -- 172.21.15.17:0/3521498078 shutdown_connections 2024-03-12T17:33:04.003 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.007+0000 7fafaaa00640 1 -- 172.21.15.17:0/3521498078 wait complete. 2024-03-12T17:33:04.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.009+0000 7fafaaa00640 1 Processor -- start 2024-03-12T17:33:04.004 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.009+0000 7fafaaa00640 1 -- start start 2024-03-12T17:33:04.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.010+0000 7fafaaa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafa40b2070 0x7fafa40c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:04.005 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.010+0000 7fafaaa00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fafa40cb970 0x7fafa41f5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:04.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.010+0000 7fafaaa00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafa4144240 0x7fafa40c3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:04.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.010+0000 7fafaaa00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa4141200 con 0x7fafa40b2070 2024-03-12T17:33:04.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.010+0000 7fafaaa00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa40c63e0 con 0x7fafa4144240 2024-03-12T17:33:04.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.010+0000 7fafaaa00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa41f6610 con 0x7fafa40cb970 2024-03-12T17:33:04.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.010+0000 7fafa3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafa40b2070 0x7fafa40c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:04.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.010+0000 7fafa3e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafa40b2070 0x7fafa40c5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48976/0 (socket says 172.21.15.17:48976) 2024-03-12T17:33:04.006 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.010+0000 7fafa3e00640 1 -- 172.21.15.17:0/516794595 learned_addr learned my addr 172.21.15.17:0/516794595 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:04.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.011+0000 7fafa3400640 1 --2- 172.21.15.17:0/516794595 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fafa40cb970 0x7fafa41f5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:04.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.011+0000 7fafa3e00640 1 -- 172.21.15.17:0/516794595 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fafa40cb970 msgr2=0x7fafa41f5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:04.009 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.011+0000 7fafa8a00640 1 --2- 172.21.15.17:0/516794595 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafa4144240 0x7fafa40c3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:04.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.011+0000 7fafa3e00640 1 --2- 172.21.15.17:0/516794595 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fafa40cb970 0x7fafa41f5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:04.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.011+0000 7fafa3e00640 1 -- 172.21.15.17:0/516794595 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafa4144240 msgr2=0x7fafa40c3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:04.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.011+0000 7fafa3e00640 1 --2- 172.21.15.17:0/516794595 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafa4144240 0x7fafa40c3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:04.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.011+0000 7fafa3e00640 1 -- 172.21.15.17:0/516794595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf9c009b30 con 0x7fafa40b2070 2024-03-12T17:33:04.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.011+0000 7fafa3e00640 1 --2- 172.21.15.17:0/516794595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafa40b2070 0x7fafa40c5ea0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7faf9400b3f0 tx=0x7faf9400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:04.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.011+0000 7faf9be00640 1 -- 172.21.15.17:0/516794595 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf94011830 con 0x7fafa40b2070 2024-03-12T17:33:04.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.011+0000 7faf9be00640 1 -- 172.21.15.17:0/516794595 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf94011990 con 0x7fafa40b2070 2024-03-12T17:33:04.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.011+0000 7faf9be00640 1 -- 172.21.15.17:0/516794595 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf94011d40 con 0x7fafa40b2070 2024-03-12T17:33:04.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.011+0000 7fafaaa00640 1 -- 172.21.15.17:0/516794595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa41f68f0 con 0x7fafa40b2070 2024-03-12T17:33:04.010 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.012+0000 7fafaaa00640 1 -- 172.21.15.17:0/516794595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa4141730 con 0x7fafa40b2070 2024-03-12T17:33:04.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.013+0000 7fafaaa00640 1 -- 172.21.15.17:0/516794595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafa41f6b10 con 0x7fafa40b2070 2024-03-12T17:33:04.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.014+0000 7faf9be00640 1 -- 172.21.15.17:0/516794595 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7faf9401a400 con 0x7fafa40b2070 2024-03-12T17:33:04.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.015+0000 7faf9be00640 1 --2- 172.21.15.17:0/516794595 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faf8406ac00 0x7faf8406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:04.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.015+0000 7faf9be00640 1 -- 172.21.15.17:0/516794595 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7faf940892d0 con 0x7fafa40b2070 2024-03-12T17:33:04.011 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.016+0000 7fafa3400640 1 --2- 172.21.15.17:0/516794595 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faf8406ac00 0x7faf8406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:04.012 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.016+0000 7fafa3400640 1 --2- 172.21.15.17:0/516794595 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faf8406ac00 0x7faf8406d0c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fafa415e100 tx=0x7faf90008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:04.015 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.020+0000 7faf9be00640 1 -- 172.21.15.17:0/516794595 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7faf940543d0 con 0x7fafa40b2070 2024-03-12T17:33:04.216 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.221+0000 7fafaaa00640 1 -- 172.21.15.17:0/516794595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fafa40736c0 con 0x7fafa40b2070 2024-03-12T17:33:04.219 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.224+0000 7faf9be00640 1 -- 172.21.15.17:0/516794595 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16149 (secure 0 0 0) 0x7faf940579f0 con 0x7fafa40b2070 2024-03-12T17:33:04.220 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:33:04.220 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":49,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:21:33.443906+0000","last_up_change":"2024-03-12T17:18:38.144756+0000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-12T17:18:39.552910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-03-12T17:20:26.824841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-03-12T17:20:28.205468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":37305},{"type":"v1","addr":"172.21.15.17:6801","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":37305},{"type":"v1","addr":"172.21.15.17:6803","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":37305},{"type":"v1","addr":"172.21.15.17:6807","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":37305},{"type":"v1","addr":"172.21.15.17:6805","nonce":37305}]},"public_addr":"172.21.15.17:6801/37305","cluster_addr":"172.21.15.17:6803/37305","heartbeat_back_addr":"172.21.15.17:6807/37305","heartbeat_front_addr":"172.21.15.17:6805/37305","state":["exists","up"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":37307},{"type":"v1","addr":"172.21.15.17:6814","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":37307},{"type":"v1","addr":"172.21.15.17:6818","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":37307},{"type":"v1","addr":"172.21.15.17:6827","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":37307},{"type":"v1","addr":"172.21.15.17:6823","nonce":37307}]},"public_addr":"172.21.15.17:6814/37307","cluster_addr":"172.21.15.17:6818/37307","heartbeat_back_addr":"172.21.15.17:6827/37307","heartbeat_front_addr":"172.21.15.17:6823/37307","state":["exists","up"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":37303},{"type":"v1","addr":"172.21.15.17:6809","nonce":37303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":37303},{"type":"v1","addr":"172.21.15.17:6811","nonce":37303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":37303},{"type":"v1","addr":"172.21.15.17:6819","nonce":37303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":37303},{"type":"v1","addr":"172.21.15.17:6815","nonce":37303}]},"public_addr":"172.21.15.17:6809/37303","cluster_addr":"172.21.15.17:6811/37303","heartbeat_back_addr":"172.21.15.17:6819/37303","heartbeat_front_addr":"172.21.15.17:6815/37303","state":["exists","up"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":37308},{"type":"v1","addr":"172.21.15.17:6822","nonce":37308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":37308},{"type":"v1","addr":"172.21.15.17:6826","nonce":37308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":37308},{"type":"v1","addr":"172.21.15.17:6831","nonce":37308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":37308},{"type":"v1","addr":"172.21.15.17:6829","nonce":37308}]},"public_addr":"172.21.15.17:6822/37308","cluster_addr":"172.21.15.17:6826/37308","heartbeat_back_addr":"172.21.15.17:6831/37308","heartbeat_front_addr":"172.21.15.17:6829/37308","state":["exists","up"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":37465},{"type":"v1","addr":"172.21.15.94:6809","nonce":37465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6811","nonce":37465},{"type":"v1","addr":"172.21.15.94:6813","nonce":37465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6819","nonce":37465},{"type":"v1","addr":"172.21.15.94:6822","nonce":37465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6815","nonce":37465},{"type":"v1","addr":"172.21.15.94:6817","nonce":37465}]},"public_addr":"172.21.15.94:6809/37465","cluster_addr":"172.21.15.94:6813/37465","heartbeat_back_addr":"172.21.15.94:6822/37465","heartbeat_front_addr":"172.21.15.94:6817/37465","state":["exists","up"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":37464},{"type":"v1","addr":"172.21.15.94:6812","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":37464},{"type":"v1","addr":"172.21.15.94:6816","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":37464},{"type":"v1","addr":"172.21.15.94:6823","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":37464},{"type":"v1","addr":"172.21.15.94:6820","nonce":37464}]},"public_addr":"172.21.15.94:6812/37464","cluster_addr":"172.21.15.94:6816/37464","heartbeat_back_addr":"172.21.15.94:6823/37464","heartbeat_front_addr":"172.21.15.94:6820/37464","state":["exists","up"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":37467},{"type":"v1","addr":"172.21.15.94:6825","nonce":37467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":37467},{"type":"v1","addr":"172.21.15.94:6827","nonce":37467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":37467},{"type":"v1","addr":"172.21.15.94:6831","nonce":37467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":37467},{"type":"v1","addr":"172.21.15.94:6829","nonce":37467}]},"public_addr":"172.21.15.94:6825/37467","cluster_addr":"172.21.15.94:6827/37467","heartbeat_back_addr":"172.21.15.94:6831/37467","heartbeat_front_addr":"172.21.15.94:6829/37467","state":["exists","up"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":37466},{"type":"v1","addr":"172.21.15.94:6801","nonce":37466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":37466},{"type":"v1","addr":"172.21.15.94:6803","nonce":37466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":37466},{"type":"v1","addr":"172.21.15.94:6807","nonce":37466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":37466},{"type":"v1","addr":"172.21.15.94:6805","nonce":37466}]},"public_addr":"172.21.15.94:6801/37466","cluster_addr":"172.21.15.94:6803/37466","heartbeat_back_addr":"172.21.15.94:6807/37466","heartbeat_front_addr":"172.21.15.94:6805/37466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.327217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.186966+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.419986+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.150585+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.120621+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.121576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.181257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.293188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.36","mappings":[{"from":0,"to":5}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:33:04.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.226+0000 7fafaaa00640 1 -- 172.21.15.17:0/516794595 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faf8406ac00 msgr2=0x7faf8406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:04.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.227+0000 7fafaaa00640 1 --2- 172.21.15.17:0/516794595 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faf8406ac00 0x7faf8406d0c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fafa415e100 tx=0x7faf90008040 comp rx=0 tx=0).stop 2024-03-12T17:33:04.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.227+0000 7fafaaa00640 1 -- 172.21.15.17:0/516794595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafa40b2070 msgr2=0x7fafa40c5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:04.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.227+0000 7fafaaa00640 1 --2- 172.21.15.17:0/516794595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafa40b2070 0x7fafa40c5ea0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7faf9400b3f0 tx=0x7faf9400b8b0 comp rx=0 tx=0).stop 2024-03-12T17:33:04.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.227+0000 7fafaaa00640 1 -- 172.21.15.17:0/516794595 shutdown_connections 2024-03-12T17:33:04.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.227+0000 7fafaaa00640 1 --2- 172.21.15.17:0/516794595 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7faf8406ac00 0x7faf8406d0c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:04.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.227+0000 7fafaaa00640 1 --2- 172.21.15.17:0/516794595 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fafa4144240 0x7fafa40c3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:04.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.227+0000 7fafaaa00640 1 --2- 172.21.15.17:0/516794595 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fafa40cb970 0x7fafa41f5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:04.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.227+0000 7fafaaa00640 1 --2- 172.21.15.17:0/516794595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fafa40b2070 0x7fafa40c5ea0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:04.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.227+0000 7fafaaa00640 1 -- 172.21.15.17:0/516794595 >> 172.21.15.17:0/516794595 conn(0x7fafa4069ce0 msgr2=0x7fafa406d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:04.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.227+0000 7fafaaa00640 1 -- 172.21.15.17:0/516794595 shutdown_connections 2024-03-12T17:33:04.223 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.227+0000 7fafaaa00640 1 -- 172.21.15.17:0/516794595 wait complete. 2024-03-12T17:33:04.241 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-12T17:18:39.552910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-12T17:20:26.824841+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-03-12T17:20:28.205468+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-12T17:33:04.241 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-12T17:33:04.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.465+0000 7f8607a00640 1 Processor -- start 2024-03-12T17:33:04.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.466+0000 7f8607a00640 1 -- start start 2024-03-12T17:33:04.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.467+0000 7f8607a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f86000b5b50 0x7f86000b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:04.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.467+0000 7f8607a00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86000d14e0 con 0x7f86000cd840 2024-03-12T17:33:04.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.467+0000 7f8607a00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86000b85b0 con 0x7f86000d2fa0 2024-03-12T17:33:04.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.467+0000 7f8607a00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86000b59e0 con 0x7f86000b5b50 2024-03-12T17:33:04.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.468+0000 7f8605a00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f86000cd840 0x7f86000d1f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:50936/0 (socket says 172.21.15.17:50936) 2024-03-12T17:33:04.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.468+0000 7f8605a00640 1 -- 172.21.15.17:0/4139973856 learned_addr learned my addr 172.21.15.17:0/4139973856 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:33:04.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.468+0000 7f85ffe00640 1 --2- 172.21.15.17:0/4139973856 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f86000b5b50 0x7f86000b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:04.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.468+0000 7f85ff400640 1 -- 172.21.15.17:0/4139973856 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 723740952 0 0) 0x7f86000d14e0 con 0x7f86000cd840 2024-03-12T17:33:04.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.468+0000 7f85ff400640 1 -- 172.21.15.17:0/4139973856 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85e4003520 con 0x7f86000cd840 2024-03-12T17:33:04.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.469+0000 7f85ff400640 1 -- 172.21.15.17:0/4139973856 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 547733048 0 0) 0x7f85e4003520 con 0x7f86000cd840 2024-03-12T17:33:04.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.469+0000 7f85ff400640 1 -- 172.21.15.17:0/4139973856 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f86000b5b50 msgr2=0x7f86000b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:04.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.469+0000 7f85ff400640 1 --2- 172.21.15.17:0/4139973856 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f86000b5b50 0x7f86000b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:04.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.469+0000 7f85ff400640 1 -- 172.21.15.17:0/4139973856 >> v1:172.21.15.94:6789/0 conn(0x7f86000d2fa0 legacy=0x7f86000d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:04.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.469+0000 7f85ff400640 1 -- 172.21.15.17:0/4139973856 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86000b8890 con 0x7f86000cd840 2024-03-12T17:33:04.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.469+0000 7f85ff400640 1 -- 172.21.15.17:0/4139973856 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7f85f8001670 con 0x7f86000cd840 2024-03-12T17:33:04.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.469+0000 7f85ff400640 1 -- 172.21.15.17:0/4139973856 >> v1:172.21.15.17:6789/0 conn(0x7f86000cd840 legacy=0x7f86000d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:04.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.469+0000 7f85ff400640 1 --2- 172.21.15.17:0/4139973856 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f86000b5b50 0x7f85e40039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:04.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.469+0000 7f85ff400640 1 --2- 172.21.15.17:0/4139973856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85e4003f70 0x7f85e40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:04.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.469+0000 7f85ff400640 1 --2- 172.21.15.17:0/4139973856 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f85e4004d00 0x7f85e4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:04.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.469+0000 7f85ff400640 1 -- 172.21.15.17:0/4139973856 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e400ba90 con 0x7f85e4003f70 2024-03-12T17:33:04.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.469+0000 7f85ff400640 1 -- 172.21.15.17:0/4139973856 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e400bc00 con 0x7f85e4004d00 2024-03-12T17:33:04.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.469+0000 7f85ff400640 1 -- 172.21.15.17:0/4139973856 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e400bdc0 con 0x7f86000b5b50 2024-03-12T17:33:04.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.469+0000 7f85ffe00640 1 --2- 172.21.15.17:0/4139973856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85e4003f70 0x7f85e40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:04.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.469+0000 7f8605000640 1 --2- 172.21.15.17:0/4139973856 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f86000b5b50 0x7f85e40039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:04.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.470+0000 7f85ffe00640 1 -- 172.21.15.17:0/4139973856 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f86000b5b50 msgr2=0x7f85e40039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:04.466 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.470+0000 7f85ffe00640 1 --2- 172.21.15.17:0/4139973856 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f86000b5b50 0x7f85e40039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:04.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.470+0000 7f85ffe00640 1 -- 172.21.15.17:0/4139973856 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f85e4004d00 msgr2=0x7f85e4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:04.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.470+0000 7f85ffe00640 1 --2- 172.21.15.17:0/4139973856 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f85e4004d00 0x7f85e4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:04.467 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.470+0000 7f85ffe00640 1 -- 172.21.15.17:0/4139973856 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e4003520 con 0x7f85e4003f70 2024-03-12T17:33:04.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.471+0000 7f85ffe00640 1 --2- 172.21.15.17:0/4139973856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85e4003f70 0x7f85e40047c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f85e8009ac0 tx=0x7f85e40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1e8ad0fbdd49e6e server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:04.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.471+0000 7f85ff400640 1 -- 172.21.15.17:0/4139973856 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e802c600 con 0x7f85e4003f70 2024-03-12T17:33:04.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.471+0000 7f85ff400640 1 -- 172.21.15.17:0/4139973856 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e802c760 con 0x7f85e4003f70 2024-03-12T17:33:04.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.471+0000 7f85ff400640 1 -- 172.21.15.17:0/4139973856 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e802caf0 con 0x7f85e4003f70 2024-03-12T17:33:04.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.471+0000 7f8607a00640 1 -- 172.21.15.17:0/4139973856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85e4003f70 msgr2=0x7f85e40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:04.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.471+0000 7f8607a00640 1 --2- 172.21.15.17:0/4139973856 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f85e4003f70 0x7f85e40047c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f85e8009ac0 tx=0x7f85e40057f0 comp rx=0 tx=0).stop 2024-03-12T17:33:04.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.471+0000 7f8605a00640 1 -- 172.21.15.17:0/4139973856 reap_dead start 2024-03-12T17:33:04.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.472+0000 7f8607a00640 1 -- 172.21.15.17:0/4139973856 shutdown_connections 2024-03-12T17:33:04.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.472+0000 7f8607a00640 1 -- 172.21.15.17:0/4139973856 >> 172.21.15.17:0/4139973856 conn(0x7f8600065df0 msgr2=0x7f8600066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:04.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.472+0000 7f8607a00640 1 -- 172.21.15.17:0/4139973856 shutdown_connections 2024-03-12T17:33:04.468 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.472+0000 7f8607a00640 1 -- 172.21.15.17:0/4139973856 wait complete. 2024-03-12T17:33:04.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.473+0000 7f8607a00640 1 Processor -- start 2024-03-12T17:33:04.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.474+0000 7f8607a00640 1 -- start start 2024-03-12T17:33:04.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.475+0000 7f8607a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f85e4003f70 0x7f86000b6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:04.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.475+0000 7f8607a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f860015f0d0 0x7f86000cc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:04.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.475+0000 7f8607a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86000cc690 0x7f860015d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:04.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.475+0000 7f8607a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86001f29c0 con 0x7f86000cc690 2024-03-12T17:33:04.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.475+0000 7f8607a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860015f590 con 0x7f85e4003f70 2024-03-12T17:33:04.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.475+0000 7f8607a00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860015f870 con 0x7f860015f0d0 2024-03-12T17:33:04.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.475+0000 7f8605a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86000cc690 0x7f860015d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:04.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.475+0000 7f8605a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86000cc690 0x7f860015d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:48992/0 (socket says 172.21.15.17:48992) 2024-03-12T17:33:04.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.475+0000 7f8605a00640 1 -- 172.21.15.17:0/2212413998 learned_addr learned my addr 172.21.15.17:0/2212413998 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:04.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.475+0000 7f85ffe00640 1 --2- 172.21.15.17:0/2212413998 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f860015f0d0 0x7f86000cc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:04.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.475+0000 7f8605a00640 1 -- 172.21.15.17:0/2212413998 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f860015f0d0 msgr2=0x7f86000cc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:04.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.475+0000 7f8605a00640 1 --2- 172.21.15.17:0/2212413998 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f860015f0d0 0x7f86000cc150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:04.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.475+0000 7f8605000640 1 --2- 172.21.15.17:0/2212413998 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f85e4003f70 0x7f86000b6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:04.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.475+0000 7f8605a00640 1 -- 172.21.15.17:0/2212413998 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f85e4003f70 msgr2=0x7f86000b6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:04.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.475+0000 7f8605a00640 1 --2- 172.21.15.17:0/2212413998 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f85e4003f70 0x7f86000b6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:04.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.475+0000 7f8605a00640 1 -- 172.21.15.17:0/2212413998 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860015fb50 con 0x7f86000cc690 2024-03-12T17:33:04.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.476+0000 7f8605a00640 1 --2- 172.21.15.17:0/2212413998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86000cc690 0x7f860015d2d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f8600067530 tx=0x7f85f800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:04.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.476+0000 7f85fcc00640 1 -- 172.21.15.17:0/2212413998 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f8007230 con 0x7f86000cc690 2024-03-12T17:33:04.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.476+0000 7f85fcc00640 1 -- 172.21.15.17:0/2212413998 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f800ced0 con 0x7f86000cc690 2024-03-12T17:33:04.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.476+0000 7f85fcc00640 1 -- 172.21.15.17:0/2212413998 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f80075d0 con 0x7f86000cc690 2024-03-12T17:33:04.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.476+0000 7f8607a00640 1 -- 172.21.15.17:0/2212413998 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f860015fe30 con 0x7f86000cc690 2024-03-12T17:33:04.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.476+0000 7f8607a00640 1 -- 172.21.15.17:0/2212413998 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86000b7170 con 0x7f86000cc690 2024-03-12T17:33:04.473 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.477+0000 7f8607a00640 1 -- 172.21.15.17:0/2212413998 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86000b8220 con 0x7f86000cc690 2024-03-12T17:33:04.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.478+0000 7f85fcc00640 1 -- 172.21.15.17:0/2212413998 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f85f80047e0 con 0x7f86000cc690 2024-03-12T17:33:04.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.479+0000 7f85fcc00640 1 --2- 172.21.15.17:0/2212413998 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f85dc06ac00 0x7f85dc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:04.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.479+0000 7f85fcc00640 1 -- 172.21.15.17:0/2212413998 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f85f8088900 con 0x7f86000cc690 2024-03-12T17:33:04.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.479+0000 7f8605000640 1 --2- 172.21.15.17:0/2212413998 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f85dc06ac00 0x7f85dc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:04.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.480+0000 7f8605000640 1 --2- 172.21.15.17:0/2212413998 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f85dc06ac00 0x7f85dc06d0c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f85f0007fd0 tx=0x7f85f0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:04.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.484+0000 7f85fcc00640 1 -- 172.21.15.17:0/2212413998 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f86000b8220 con 0x7f86000cc690 2024-03-12T17:33:04.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.690+0000 7f8607a00640 1 -- 172.21.15.17:0/2212413998 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f86000b8220 con 0x7f86000cc690 2024-03-12T17:33:04.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.691+0000 7f85fcc00640 1 -- 172.21.15.17:0/2212413998 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v49) v1 ==== 93+0+10 (secure 0 0 0) 0x7f86000b8220 con 0x7f86000cc690 2024-03-12T17:33:04.686 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 1 2024-03-12T17:33:04.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.694+0000 7f8607a00640 1 -- 172.21.15.17:0/2212413998 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f85dc06ac00 msgr2=0x7f85dc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:04.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.694+0000 7f8607a00640 1 --2- 172.21.15.17:0/2212413998 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f85dc06ac00 0x7f85dc06d0c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f85f0007fd0 tx=0x7f85f0009040 comp rx=0 tx=0).stop 2024-03-12T17:33:04.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.694+0000 7f8607a00640 1 -- 172.21.15.17:0/2212413998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86000cc690 msgr2=0x7f860015d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:04.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.694+0000 7f8607a00640 1 --2- 172.21.15.17:0/2212413998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86000cc690 0x7f860015d2d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f8600067530 tx=0x7f85f800cb90 comp rx=0 tx=0).stop 2024-03-12T17:33:04.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.694+0000 7f8607a00640 1 -- 172.21.15.17:0/2212413998 shutdown_connections 2024-03-12T17:33:04.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.694+0000 7f8607a00640 1 --2- 172.21.15.17:0/2212413998 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f85dc06ac00 0x7f85dc06d0c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:04.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.694+0000 7f8607a00640 1 --2- 172.21.15.17:0/2212413998 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f86000cc690 0x7f860015d2d0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:04.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.694+0000 7f8607a00640 1 --2- 172.21.15.17:0/2212413998 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f860015f0d0 0x7f86000cc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:04.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.694+0000 7f8607a00640 1 --2- 172.21.15.17:0/2212413998 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f85e4003f70 0x7f86000b6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:04.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.694+0000 7f8607a00640 1 -- 172.21.15.17:0/2212413998 >> 172.21.15.17:0/2212413998 conn(0x7f8600065df0 msgr2=0x7f86000d3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:04.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.694+0000 7f8607a00640 1 -- 172.21.15.17:0/2212413998 shutdown_connections 2024-03-12T17:33:04.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.694+0000 7f8607a00640 1 -- 172.21.15.17:0/2212413998 wait complete. 2024-03-12T17:33:04.708 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-12T17:33:04.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.940+0000 7fb45e600640 1 Processor -- start 2024-03-12T17:33:04.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.940+0000 7fb45e600640 1 -- start start 2024-03-12T17:33:04.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.942+0000 7fb45e600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb4580d2fa0 0x7fb4580d3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:04.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.942+0000 7fb45e600640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb4580b5b50 0x7fb4580b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:04.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.942+0000 7fb45e600640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4580d14e0 con 0x7fb4580cd840 2024-03-12T17:33:04.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.942+0000 7fb45e600640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4580b59e0 con 0x7fb4580b5b50 2024-03-12T17:33:04.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.942+0000 7fb45e600640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4580d38c0 con 0x7fb4580d2fa0 2024-03-12T17:33:04.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.942+0000 7fb44fe00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb4580b5b50 0x7fb4580b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:04.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.943+0000 7fb44fe00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb4580b5b50 0x7fb4580b5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49008/0 (socket says 172.21.15.17:49008) 2024-03-12T17:33:04.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.943+0000 7fb44fe00640 1 -- 172.21.15.17:0/2684580434 learned_addr learned my addr 172.21.15.17:0/2684580434 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:04.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.943+0000 7fb457400640 1 --2- 172.21.15.17:0/2684580434 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb4580d2fa0 0x7fb4580d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:04.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.943+0000 7fb44fe00640 1 -- 172.21.15.17:0/2684580434 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb4580d2fa0 msgr2=0x7fb4580d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:04.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.943+0000 7fb44fe00640 1 --2- 172.21.15.17:0/2684580434 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb4580d2fa0 0x7fb4580d3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:04.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.943+0000 7fb44fe00640 1 -- 172.21.15.17:0/2684580434 >> v1:172.21.15.17:6789/0 conn(0x7fb4580cd840 legacy=0x7fb4580d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:04.941 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.943+0000 7fb44fe00640 1 -- 172.21.15.17:0/2684580434 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4580b85b0 con 0x7fb4580b5b50 2024-03-12T17:33:04.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.944+0000 7fb44fe00640 1 --2- 172.21.15.17:0/2684580434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4580b5b50 0x7fb4580b5f70 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fb440009870 tx=0x7fb44002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1451b786308936e0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:04.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.945+0000 7fb456a00640 1 -- 172.21.15.17:0/2684580434 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb440030840 con 0x7fb4580b5b50 2024-03-12T17:33:04.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.945+0000 7fb456a00640 1 -- 172.21.15.17:0/2684580434 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4400309a0 con 0x7fb4580b5b50 2024-03-12T17:33:04.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.945+0000 7fb456a00640 1 -- 172.21.15.17:0/2684580434 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb440030d30 con 0x7fb4580b5b50 2024-03-12T17:33:04.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.945+0000 7fb45e600640 1 -- 172.21.15.17:0/2684580434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4580b5b50 msgr2=0x7fb4580b5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:04.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.945+0000 7fb45e600640 1 --2- 172.21.15.17:0/2684580434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4580b5b50 0x7fb4580b5f70 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fb440009870 tx=0x7fb44002b980 comp rx=0 tx=0).stop 2024-03-12T17:33:04.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.945+0000 7fb45e600640 1 -- 172.21.15.17:0/2684580434 shutdown_connections 2024-03-12T17:33:04.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.945+0000 7fb45e600640 1 --2- 172.21.15.17:0/2684580434 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4580b5b50 0x7fb4580b5f70 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:04.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.945+0000 7fb45e600640 1 --2- 172.21.15.17:0/2684580434 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb4580d2fa0 0x7fb4580d3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:04.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.945+0000 7fb45e600640 1 -- 172.21.15.17:0/2684580434 >> 172.21.15.17:0/2684580434 conn(0x7fb458065df0 msgr2=0x7fb458066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:04.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.946+0000 7fb45e600640 1 -- 172.21.15.17:0/2684580434 shutdown_connections 2024-03-12T17:33:04.944 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.946+0000 7fb45e600640 1 -- 172.21.15.17:0/2684580434 wait complete. 2024-03-12T17:33:04.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.947+0000 7fb45e600640 1 Processor -- start 2024-03-12T17:33:04.945 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.947+0000 7fb45e600640 1 -- start start 2024-03-12T17:33:04.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.948+0000 7fb45e600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4580b5b50 0x7fb4580cb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:04.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.948+0000 7fb45e600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4580cd840 0x7fb45815e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:04.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.948+0000 7fb45e600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb4580d2fa0 0x7fb45815edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:04.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.948+0000 7fb45e600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4580cc200 con 0x7fb4580b5b50 2024-03-12T17:33:04.949 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.948+0000 7fb45e600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4581f6740 con 0x7fb4580cd840 2024-03-12T17:33:04.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.948+0000 7fb45e600640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4581f6460 con 0x7fb4580d2fa0 2024-03-12T17:33:04.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.949+0000 7fb457400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4580b5b50 0x7fb4580cb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:04.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.949+0000 7fb457400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4580b5b50 0x7fb4580cb140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49024/0 (socket says 172.21.15.17:49024) 2024-03-12T17:33:04.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.949+0000 7fb457400640 1 -- 172.21.15.17:0/2748438671 learned_addr learned my addr 172.21.15.17:0/2748438671 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:04.950 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.949+0000 7fb457400640 1 -- 172.21.15.17:0/2748438671 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb4580d2fa0 msgr2=0x7fb45815edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:04.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.949+0000 7fb457400640 1 --2- 172.21.15.17:0/2748438671 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb4580d2fa0 0x7fb45815edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:04.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.949+0000 7fb457400640 1 -- 172.21.15.17:0/2748438671 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4580cd840 msgr2=0x7fb45815e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:04.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.949+0000 7fb457400640 1 --2- 172.21.15.17:0/2748438671 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4580cd840 0x7fb45815e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:04.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.949+0000 7fb457400640 1 -- 172.21.15.17:0/2748438671 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4400094d0 con 0x7fb4580b5b50 2024-03-12T17:33:04.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.949+0000 7fb457400640 1 --2- 172.21.15.17:0/2748438671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4580b5b50 0x7fb4580cb140 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb44800d5f0 tx=0x7fb44800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:04.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.950+0000 7fb44f400640 1 -- 172.21.15.17:0/2748438671 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4480125f0 con 0x7fb4580b5b50 2024-03-12T17:33:04.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.950+0000 7fb44f400640 1 -- 172.21.15.17:0/2748438671 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb448012750 con 0x7fb4580b5b50 2024-03-12T17:33:04.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.950+0000 7fb44f400640 1 -- 172.21.15.17:0/2748438671 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb448012b00 con 0x7fb4580b5b50 2024-03-12T17:33:04.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.950+0000 7fb45e600640 1 -- 172.21.15.17:0/2748438671 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4581f2400 con 0x7fb4580b5b50 2024-03-12T17:33:04.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.950+0000 7fb45e600640 1 -- 172.21.15.17:0/2748438671 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4581f29c0 con 0x7fb4580b5b50 2024-03-12T17:33:04.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.951+0000 7fb45e600640 1 -- 172.21.15.17:0/2748438671 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4581f2b80 con 0x7fb4580b5b50 2024-03-12T17:33:04.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.952+0000 7fb44f400640 1 -- 172.21.15.17:0/2748438671 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fb448012c60 con 0x7fb4580b5b50 2024-03-12T17:33:04.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.953+0000 7fb44f400640 1 --2- 172.21.15.17:0/2748438671 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb43406ac30 0x7fb43406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:04.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.953+0000 7fb44f400640 1 -- 172.21.15.17:0/2748438671 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb4480897f0 con 0x7fb4580b5b50 2024-03-12T17:33:04.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.953+0000 7fb44fe00640 1 --2- 172.21.15.17:0/2748438671 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb43406ac30 0x7fb43406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:04.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.954+0000 7fb44fe00640 1 --2- 172.21.15.17:0/2748438671 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb43406ac30 0x7fb43406d0f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb440036000 tx=0x7fb44003b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:04.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:04.957+0000 7fb44f400640 1 -- 172.21.15.17:0/2748438671 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fb448054980 con 0x7fb4580b5b50 2024-03-12T17:33:05.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.155+0000 7fb45e600640 1 -- 172.21.15.17:0/2748438671 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb4581f2260 con 0x7fb4580b5b50 2024-03-12T17:33:05.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.156+0000 7fb44f400640 1 -- 172.21.15.17:0/2748438671 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v49) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb4581f2260 con 0x7fb4580b5b50 2024-03-12T17:33:05.152 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 32 2024-03-12T17:33:05.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.158+0000 7fb45e600640 1 -- 172.21.15.17:0/2748438671 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb43406ac30 msgr2=0x7fb43406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:05.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.158+0000 7fb45e600640 1 --2- 172.21.15.17:0/2748438671 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb43406ac30 0x7fb43406d0f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fb440036000 tx=0x7fb44003b040 comp rx=0 tx=0).stop 2024-03-12T17:33:05.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.159+0000 7fb45e600640 1 -- 172.21.15.17:0/2748438671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4580b5b50 msgr2=0x7fb4580cb140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:05.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.159+0000 7fb45e600640 1 --2- 172.21.15.17:0/2748438671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4580b5b50 0x7fb4580cb140 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb44800d5f0 tx=0x7fb44800dab0 comp rx=0 tx=0).stop 2024-03-12T17:33:05.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.159+0000 7fb45e600640 1 -- 172.21.15.17:0/2748438671 shutdown_connections 2024-03-12T17:33:05.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.159+0000 7fb45e600640 1 --2- 172.21.15.17:0/2748438671 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb43406ac30 0x7fb43406d0f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:05.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.159+0000 7fb45e600640 1 --2- 172.21.15.17:0/2748438671 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb4580d2fa0 0x7fb45815edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:05.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.159+0000 7fb45e600640 1 --2- 172.21.15.17:0/2748438671 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb4580cd840 0x7fb45815e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:05.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.159+0000 7fb45e600640 1 --2- 172.21.15.17:0/2748438671 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb4580b5b50 0x7fb4580cb140 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:05.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.159+0000 7fb45e600640 1 -- 172.21.15.17:0/2748438671 >> 172.21.15.17:0/2748438671 conn(0x7fb458065df0 msgr2=0x7fb4580c8540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:05.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.159+0000 7fb45e600640 1 -- 172.21.15.17:0/2748438671 shutdown_connections 2024-03-12T17:33:05.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.159+0000 7fb45e600640 1 -- 172.21.15.17:0/2748438671 wait complete. 2024-03-12T17:33:05.172 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-12T17:33:05.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.386+0000 7fa3c5800640 1 Processor -- start 2024-03-12T17:33:05.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.387+0000 7fa3c5800640 1 -- start start 2024-03-12T17:33:05.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.388+0000 7fa3c5800640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa3c00cfcb0 0x7fa3c00d0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:05.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.388+0000 7fa3c5800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa3c015d010 0x7fa3c015d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:05.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.388+0000 7fa3c5800640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3c015e070 con 0x7fa3c00ae4b0 2024-03-12T17:33:05.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.388+0000 7fa3c5800640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3c015dab0 con 0x7fa3c015d010 2024-03-12T17:33:05.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.388+0000 7fa3c5800640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c015dd90 con 0x7fa3c00cfcb0 2024-03-12T17:33:05.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.389+0000 7fa3c4e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa3c015d010 0x7fa3c015d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:05.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.389+0000 7fa3c4e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fa3c015d010 0x7fa3c015d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49026/0 (socket says 172.21.15.17:49026) 2024-03-12T17:33:05.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.389+0000 7fa3c4e00640 1 -- 172.21.15.17:0/1554995961 learned_addr learned my addr 172.21.15.17:0/1554995961 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:05.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.389+0000 7fa3b7e00640 1 --2- 172.21.15.17:0/1554995961 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa3c00cfcb0 0x7fa3c00d0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:05.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.390+0000 7fa3c4e00640 1 -- 172.21.15.17:0/1554995961 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa3c00cfcb0 msgr2=0x7fa3c00d0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:05.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.390+0000 7fa3c4e00640 1 --2- 172.21.15.17:0/1554995961 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa3c00cfcb0 0x7fa3c00d0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:05.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.390+0000 7fa3c4e00640 1 -- 172.21.15.17:0/1554995961 >> v1:172.21.15.17:6789/0 conn(0x7fa3c00ae4b0 legacy=0x7fa3c00ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:05.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.390+0000 7fa3c4e00640 1 -- 172.21.15.17:0/1554995961 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c00cf4b0 con 0x7fa3c015d010 2024-03-12T17:33:05.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.391+0000 7fa3c4e00640 1 --2- 172.21.15.17:0/1554995961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3c015d010 0x7fa3c015d4a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8009e50 tx=0x7fa3b802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95d6c2dab5ccc98c server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:05.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.391+0000 7fa3bf400640 1 -- 172.21.15.17:0/1554995961 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b802cb00 con 0x7fa3c015d010 2024-03-12T17:33:05.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.391+0000 7fa3bf400640 1 -- 172.21.15.17:0/1554995961 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b802cc60 con 0x7fa3c015d010 2024-03-12T17:33:05.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.391+0000 7fa3bf400640 1 -- 172.21.15.17:0/1554995961 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b80343f0 con 0x7fa3c015d010 2024-03-12T17:33:05.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.392+0000 7fa3c5800640 1 -- 172.21.15.17:0/1554995961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3c015d010 msgr2=0x7fa3c015d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:05.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.392+0000 7fa3c5800640 1 --2- 172.21.15.17:0/1554995961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3c015d010 0x7fa3c015d4a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8009e50 tx=0x7fa3b802bf60 comp rx=0 tx=0).stop 2024-03-12T17:33:05.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.392+0000 7fa3c5800640 1 -- 172.21.15.17:0/1554995961 shutdown_connections 2024-03-12T17:33:05.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.392+0000 7fa3c5800640 1 --2- 172.21.15.17:0/1554995961 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3c015d010 0x7fa3c015d4a0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:05.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.392+0000 7fa3c5800640 1 --2- 172.21.15.17:0/1554995961 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa3c00cfcb0 0x7fa3c00d0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:05.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.392+0000 7fa3c5800640 1 -- 172.21.15.17:0/1554995961 >> 172.21.15.17:0/1554995961 conn(0x7fa3c00b4ca0 msgr2=0x7fa3c0098a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:05.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.392+0000 7fa3c5800640 1 -- 172.21.15.17:0/1554995961 shutdown_connections 2024-03-12T17:33:05.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.392+0000 7fa3c5800640 1 -- 172.21.15.17:0/1554995961 wait complete. 2024-03-12T17:33:05.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.394+0000 7fa3c5800640 1 Processor -- start 2024-03-12T17:33:05.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.394+0000 7fa3c5800640 1 -- start start 2024-03-12T17:33:05.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.395+0000 7fa3c5800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3c00ae4b0 0x7fa3c009b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:05.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.395+0000 7fa3c5800640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa3c00cfcb0 0x7fa3c015b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:05.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.395+0000 7fa3c5800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3c015d010 0x7fa3c015bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:05.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.395+0000 7fa3c5800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c0099650 con 0x7fa3c015d010 2024-03-12T17:33:05.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.395+0000 7fa3c5800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c0147de0 con 0x7fa3c00ae4b0 2024-03-12T17:33:05.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.395+0000 7fa3c5800640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c015c210 con 0x7fa3c00cfcb0 2024-03-12T17:33:05.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.395+0000 7fa3c4e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3c015d010 0x7fa3c015bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:05.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.395+0000 7fa3c4e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3c015d010 0x7fa3c015bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49042/0 (socket says 172.21.15.17:49042) 2024-03-12T17:33:05.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.395+0000 7fa3c4e00640 1 -- 172.21.15.17:0/1170176335 learned_addr learned my addr 172.21.15.17:0/1170176335 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:05.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.395+0000 7fa3c4e00640 1 -- 172.21.15.17:0/1170176335 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa3c00cfcb0 msgr2=0x7fa3c015b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:05.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.395+0000 7fa3c4e00640 1 --2- 172.21.15.17:0/1170176335 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa3c00cfcb0 0x7fa3c015b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:05.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.395+0000 7fa3c4e00640 1 -- 172.21.15.17:0/1170176335 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3c00ae4b0 msgr2=0x7fa3c009b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:05.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.395+0000 7fa3c4e00640 1 --2- 172.21.15.17:0/1170176335 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3c00ae4b0 0x7fa3c009b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:05.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.395+0000 7fa3c4e00640 1 -- 172.21.15.17:0/1170176335 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b8009b30 con 0x7fa3c015d010 2024-03-12T17:33:05.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.396+0000 7fa3c4e00640 1 --2- 172.21.15.17:0/1170176335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3c015d010 0x7fa3c015bcd0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8036040 tx=0x7fa3b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:05.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.396+0000 7fa3bcc00640 1 -- 172.21.15.17:0/1170176335 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b8040670 con 0x7fa3c015d010 2024-03-12T17:33:05.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.396+0000 7fa3bcc00640 1 -- 172.21.15.17:0/1170176335 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b8040810 con 0x7fa3c015d010 2024-03-12T17:33:05.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.396+0000 7fa3bcc00640 1 -- 172.21.15.17:0/1170176335 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b8040bc0 con 0x7fa3c015d010 2024-03-12T17:33:05.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.396+0000 7fa3c5800640 1 -- 172.21.15.17:0/1170176335 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3c015c4c0 con 0x7fa3c015d010 2024-03-12T17:33:05.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.396+0000 7fa3c5800640 1 -- 172.21.15.17:0/1170176335 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3c0099b40 con 0x7fa3c015d010 2024-03-12T17:33:05.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.397+0000 7fa3c5800640 1 -- 172.21.15.17:0/1170176335 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3c004e030 con 0x7fa3c015d010 2024-03-12T17:33:05.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.398+0000 7fa3bcc00640 1 -- 172.21.15.17:0/1170176335 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fa3b8040d20 con 0x7fa3c015d010 2024-03-12T17:33:05.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.399+0000 7fa3bcc00640 1 --2- 172.21.15.17:0/1170176335 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fa39c06ac00 0x7fa39c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:05.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.399+0000 7fa3bcc00640 1 -- 172.21.15.17:0/1170176335 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fa3b80ac450 con 0x7fa3c015d010 2024-03-12T17:33:05.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.399+0000 7fa3bfe00640 1 --2- 172.21.15.17:0/1170176335 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fa39c06ac00 0x7fa39c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:05.395 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.400+0000 7fa3bfe00640 1 --2- 172.21.15.17:0/1170176335 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fa39c06ac00 0x7fa39c06d0c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0000f60 tx=0x7fa3b00079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:05.398 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.403+0000 7fa3bcc00640 1 -- 172.21.15.17:0/1170176335 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fa3b8077710 con 0x7fa3c015d010 2024-03-12T17:33:05.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.602+0000 7fa3c5800640 1 -- 172.21.15.17:0/1170176335 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa3c0159800 con 0x7fa3c015d010 2024-03-12T17:33:05.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.603+0000 7fa3bcc00640 1 -- 172.21.15.17:0/1170176335 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v49) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa3b8009510 con 0x7fa3c015d010 2024-03-12T17:33:05.599 INFO:teuthology.orchestra.run.smithi017.stdout:pg_num: 64 2024-03-12T17:33:05.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.606+0000 7fa3c5800640 1 -- 172.21.15.17:0/1170176335 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fa39c06ac00 msgr2=0x7fa39c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:05.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.606+0000 7fa3c5800640 1 --2- 172.21.15.17:0/1170176335 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fa39c06ac00 0x7fa39c06d0c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa3b0000f60 tx=0x7fa3b00079b0 comp rx=0 tx=0).stop 2024-03-12T17:33:05.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.606+0000 7fa3c5800640 1 -- 172.21.15.17:0/1170176335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3c015d010 msgr2=0x7fa3c015bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:05.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.606+0000 7fa3c5800640 1 --2- 172.21.15.17:0/1170176335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3c015d010 0x7fa3c015bcd0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8036040 tx=0x7fa3b8004a40 comp rx=0 tx=0).stop 2024-03-12T17:33:05.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.606+0000 7fa3c5800640 1 -- 172.21.15.17:0/1170176335 shutdown_connections 2024-03-12T17:33:05.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.606+0000 7fa3c5800640 1 --2- 172.21.15.17:0/1170176335 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fa39c06ac00 0x7fa39c06d0c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:05.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.606+0000 7fa3c5800640 1 --2- 172.21.15.17:0/1170176335 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fa3c015d010 0x7fa3c015bcd0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:05.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.606+0000 7fa3c5800640 1 --2- 172.21.15.17:0/1170176335 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fa3c00cfcb0 0x7fa3c015b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:05.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.606+0000 7fa3c5800640 1 --2- 172.21.15.17:0/1170176335 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fa3c00ae4b0 0x7fa3c009b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:05.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.606+0000 7fa3c5800640 1 -- 172.21.15.17:0/1170176335 >> 172.21.15.17:0/1170176335 conn(0x7fa3c00b4ca0 msgr2=0x7fa3c00b1260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:05.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.607+0000 7fa3c5800640 1 -- 172.21.15.17:0/1170176335 shutdown_connections 2024-03-12T17:33:05.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.607+0000 7fa3c5800640 1 -- 172.21.15.17:0/1170176335 wait complete. 2024-03-12T17:33:05.620 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-12T17:33:05.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.840+0000 7ffacfc00640 1 Processor -- start 2024-03-12T17:33:05.836 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.840+0000 7ffacfc00640 1 -- start start 2024-03-12T17:33:05.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.841+0000 7ffacfc00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ffac8144240 0x7ffac80ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:05.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.841+0000 7ffacfc00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffac80cb970 0x7ffac80cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:05.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.841+0000 7ffacfc00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffac80ce320 con 0x7ffac80cecf0 2024-03-12T17:33:05.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.842+0000 7ffacfc00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffac80cc340 con 0x7ffac8144240 2024-03-12T17:33:05.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.842+0000 7ffacfc00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac8144620 con 0x7ffac80cb970 2024-03-12T17:33:05.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.842+0000 7ffacd200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ffac8144240 0x7ffac80ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:05.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.842+0000 7ffacd200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ffac8144240 0x7ffac80ce7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49054/0 (socket says 172.21.15.17:49054) 2024-03-12T17:33:05.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.842+0000 7ffacd200640 1 -- 172.21.15.17:0/1425007226 learned_addr learned my addr 172.21.15.17:0/1425007226 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:05.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.842+0000 7ffacdc00640 1 --2- 172.21.15.17:0/1425007226 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffac80cb970 0x7ffac80cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:05.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.842+0000 7ffacd200640 1 -- 172.21.15.17:0/1425007226 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffac80cb970 msgr2=0x7ffac80cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:05.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.842+0000 7ffacd200640 1 --2- 172.21.15.17:0/1425007226 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffac80cb970 0x7ffac80cbe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:05.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.842+0000 7ffacd200640 1 -- 172.21.15.17:0/1425007226 >> v1:172.21.15.17:6789/0 conn(0x7ffac80cecf0 legacy=0x7ffac80b2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:05.839 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.842+0000 7ffacd200640 1 -- 172.21.15.17:0/1425007226 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac815f3d0 con 0x7ffac8144240 2024-03-12T17:33:05.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.843+0000 7ffacd200640 1 --2- 172.21.15.17:0/1425007226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffac8144240 0x7ffac80ce7b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7ffabc009870 tx=0x7ffabc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef76c2b87dfc7a99 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:05.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.844+0000 7ffac7400640 1 -- 172.21.15.17:0/1425007226 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc030840 con 0x7ffac8144240 2024-03-12T17:33:05.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.844+0000 7ffac7400640 1 -- 172.21.15.17:0/1425007226 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffabc0309a0 con 0x7ffac8144240 2024-03-12T17:33:05.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.844+0000 7ffac7400640 1 -- 172.21.15.17:0/1425007226 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc030d30 con 0x7ffac8144240 2024-03-12T17:33:05.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.844+0000 7ffacfc00640 1 -- 172.21.15.17:0/1425007226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffac8144240 msgr2=0x7ffac80ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:05.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.844+0000 7ffacfc00640 1 --2- 172.21.15.17:0/1425007226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffac8144240 0x7ffac80ce7b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7ffabc009870 tx=0x7ffabc02b980 comp rx=0 tx=0).stop 2024-03-12T17:33:05.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.844+0000 7ffacfc00640 1 -- 172.21.15.17:0/1425007226 shutdown_connections 2024-03-12T17:33:05.840 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.844+0000 7ffacfc00640 1 --2- 172.21.15.17:0/1425007226 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffac80cb970 0x7ffac80cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:05.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.844+0000 7ffacfc00640 1 --2- 172.21.15.17:0/1425007226 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffac8144240 0x7ffac80ce7b0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:05.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.844+0000 7ffacfc00640 1 -- 172.21.15.17:0/1425007226 >> 172.21.15.17:0/1425007226 conn(0x7ffac8069ce0 msgr2=0x7ffac806a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:05.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.844+0000 7ffacfc00640 1 -- 172.21.15.17:0/1425007226 shutdown_connections 2024-03-12T17:33:05.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.845+0000 7ffacfc00640 1 -- 172.21.15.17:0/1425007226 wait complete. 2024-03-12T17:33:05.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.846+0000 7ffacfc00640 1 Processor -- start 2024-03-12T17:33:05.841 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.846+0000 7ffacfc00640 1 -- start start 2024-03-12T17:33:05.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.847+0000 7ffacfc00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffac80cb970 0x7ffac8158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:05.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.847+0000 7ffacfc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffac80cecf0 0x7ffac8158f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:05.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.847+0000 7ffacfc00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffac8144240 0x7ffac815c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:05.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.847+0000 7ffacfc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac815a4c0 con 0x7ffac80cecf0 2024-03-12T17:33:05.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.847+0000 7ffacfc00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac8158d60 con 0x7ffac8144240 2024-03-12T17:33:05.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.847+0000 7ffacfc00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac8159840 con 0x7ffac80cb970 2024-03-12T17:33:05.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.847+0000 7ffac7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffac80cecf0 0x7ffac8158f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:05.844 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.848+0000 7ffac7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffac80cecf0 0x7ffac8158f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49068/0 (socket says 172.21.15.17:49068) 2024-03-12T17:33:05.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.848+0000 7ffac7e00640 1 -- 172.21.15.17:0/1633647311 learned_addr learned my addr 172.21.15.17:0/1633647311 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:05.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.848+0000 7ffacd200640 1 --2- 172.21.15.17:0/1633647311 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffac80cb970 0x7ffac8158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:05.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.848+0000 7ffac7e00640 1 -- 172.21.15.17:0/1633647311 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffac80cb970 msgr2=0x7ffac8158820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:05.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.848+0000 7ffac7e00640 1 --2- 172.21.15.17:0/1633647311 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffac80cb970 0x7ffac8158820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:05.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.848+0000 7ffac7e00640 1 -- 172.21.15.17:0/1633647311 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffac8144240 msgr2=0x7ffac815c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:05.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.848+0000 7ffacdc00640 1 --2- 172.21.15.17:0/1633647311 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffac8144240 0x7ffac815c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:05.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.848+0000 7ffac7e00640 1 --2- 172.21.15.17:0/1633647311 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffac8144240 0x7ffac815c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:05.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.848+0000 7ffac7e00640 1 -- 172.21.15.17:0/1633647311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffabc0094d0 con 0x7ffac80cecf0 2024-03-12T17:33:05.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.848+0000 7ffac7e00640 1 --2- 172.21.15.17:0/1633647311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffac80cecf0 0x7ffac8158f40 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7ffab400c450 tx=0x7ffab400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:05.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.849+0000 7ffac4c00640 1 -- 172.21.15.17:0/1633647311 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab40052d0 con 0x7ffac80cecf0 2024-03-12T17:33:05.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.849+0000 7ffac4c00640 1 -- 172.21.15.17:0/1633647311 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab4005430 con 0x7ffac80cecf0 2024-03-12T17:33:05.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.849+0000 7ffac4c00640 1 -- 172.21.15.17:0/1633647311 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab4012870 con 0x7ffac80cecf0 2024-03-12T17:33:05.845 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.849+0000 7ffacfc00640 1 -- 172.21.15.17:0/1633647311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffac8159b20 con 0x7ffac80cecf0 2024-03-12T17:33:05.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.849+0000 7ffacfc00640 1 -- 172.21.15.17:0/1633647311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffac815a0e0 con 0x7ffac80cecf0 2024-03-12T17:33:05.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.850+0000 7ffacfc00640 1 -- 172.21.15.17:0/1633647311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffac80736c0 con 0x7ffac80cecf0 2024-03-12T17:33:05.846 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.851+0000 7ffac4c00640 1 -- 172.21.15.17:0/1633647311 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7ffab40129d0 con 0x7ffac80cecf0 2024-03-12T17:33:05.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.852+0000 7ffac4c00640 1 --2- 172.21.15.17:0/1633647311 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ffaa806ac00 0x7ffaa806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:05.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.852+0000 7ffac4c00640 1 -- 172.21.15.17:0/1633647311 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ffab4088f10 con 0x7ffac80cecf0 2024-03-12T17:33:05.847 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.852+0000 7ffacd200640 1 --2- 172.21.15.17:0/1633647311 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ffaa806ac00 0x7ffaa806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:05.848 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.853+0000 7ffacd200640 1 --2- 172.21.15.17:0/1633647311 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ffaa806ac00 0x7ffaa806d0c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ffabc036000 tx=0x7ffabc03b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:05.852 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:05.856+0000 7ffac4c00640 1 -- 172.21.15.17:0/1633647311 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7ffab40540a0 con 0x7ffac80cecf0 2024-03-12T17:33:06.093 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.097+0000 7ffacfc00640 1 -- 172.21.15.17:0/1633647311 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffac80b2750 con 0x7ffac80cecf0 2024-03-12T17:33:06.094 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.099+0000 7ffac4c00640 1 -- 172.21.15.17:0/1633647311 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4731 (secure 0 0 0) 0x7ffab40576c0 con 0x7ffac80cecf0 2024-03-12T17:33:06.094 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:33:06.095 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4808,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6834/3175855266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3175855266},{"type":"v1","addr":"172.21.15.94:6834","nonce":3175855266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":4927,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/1725537585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1725537585},{"type":"v1","addr":"172.21.15.17:6835","nonce":1725537585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":4939,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/630541950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6833","nonce":630541950},{"type":"v1","addr":"172.21.15.94:6835","nonce":630541950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T17:20:29.180386+0000","modified":"2024-03-12T17:20:32.399146+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5433":{"gid":5433,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6837/2711965846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":2711965846},{"type":"v1","addr":"172.21.15.17:6837","nonce":2711965846}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-03-12T17:33:06.095 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 22 2024-03-12T17:33:06.097 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.101+0000 7ffacfc00640 1 -- 172.21.15.17:0/1633647311 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ffaa806ac00 msgr2=0x7ffaa806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:06.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.101+0000 7ffacfc00640 1 --2- 172.21.15.17:0/1633647311 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ffaa806ac00 0x7ffaa806d0c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ffabc036000 tx=0x7ffabc03b040 comp rx=0 tx=0).stop 2024-03-12T17:33:06.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.101+0000 7ffacfc00640 1 -- 172.21.15.17:0/1633647311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffac80cecf0 msgr2=0x7ffac8158f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:06.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.101+0000 7ffacfc00640 1 --2- 172.21.15.17:0/1633647311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffac80cecf0 0x7ffac8158f40 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7ffab400c450 tx=0x7ffab400c910 comp rx=0 tx=0).stop 2024-03-12T17:33:06.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.102+0000 7ffacfc00640 1 -- 172.21.15.17:0/1633647311 shutdown_connections 2024-03-12T17:33:06.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.102+0000 7ffacfc00640 1 --2- 172.21.15.17:0/1633647311 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ffaa806ac00 0x7ffaa806d0c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:06.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.102+0000 7ffacfc00640 1 --2- 172.21.15.17:0/1633647311 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffac8144240 0x7ffac815c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:06.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.102+0000 7ffacfc00640 1 --2- 172.21.15.17:0/1633647311 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffac80cecf0 0x7ffac8158f40 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:06.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.102+0000 7ffacfc00640 1 --2- 172.21.15.17:0/1633647311 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffac80cb970 0x7ffac8158820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:06.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.102+0000 7ffacfc00640 1 -- 172.21.15.17:0/1633647311 >> 172.21.15.17:0/1633647311 conn(0x7ffac8069ce0 msgr2=0x7ffac80b2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:06.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.102+0000 7ffacfc00640 1 -- 172.21.15.17:0/1633647311 shutdown_connections 2024-03-12T17:33:06.098 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.102+0000 7ffacfc00640 1 -- 172.21.15.17:0/1633647311 wait complete. 2024-03-12T17:33:06.119 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T17:33:06.343 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.348+0000 7f5fb1200640 1 Processor -- start 2024-03-12T17:33:06.344 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.348+0000 7f5fb1200640 1 -- start start 2024-03-12T17:33:06.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.350+0000 7f5fb1200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5fac1441f0 0x7f5fac070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:06.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.350+0000 7f5fb1200640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f5fac15ae20 0x7f5fac06d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:06.345 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.350+0000 7f5fb1200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fac0a7660 con 0x7f5fac0b3b70 2024-03-12T17:33:06.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.350+0000 7f5fb1200640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fac15e460 con 0x7f5fac15ae20 2024-03-12T17:33:06.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.350+0000 7f5fb1200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fac1445d0 con 0x7f5fac1441f0 2024-03-12T17:33:06.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.350+0000 7f5fabe00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f5fac0b3b70 0x7f5fac15e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:50984/0 (socket says 172.21.15.17:50984) 2024-03-12T17:33:06.346 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.350+0000 7f5fabe00640 1 -- 172.21.15.17:0/4180628764 learned_addr learned my addr 172.21.15.17:0/4180628764 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:33:06.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.350+0000 7f5fab400640 1 --2- 172.21.15.17:0/4180628764 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5fac1441f0 0x7f5fac070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:06.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.350+0000 7f5faaa00640 1 --2- 172.21.15.17:0/4180628764 >> v2:172.21.15.94:3300/0 conn(0x7f5fac15ae20 0x7f5fac06d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:06.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.351+0000 7f5faa000640 1 -- 172.21.15.17:0/4180628764 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1388028327 0 0) 0x7f5fac0a7660 con 0x7f5fac0b3b70 2024-03-12T17:33:06.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.351+0000 7f5faa000640 1 -- 172.21.15.17:0/4180628764 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f90003520 con 0x7f5fac0b3b70 2024-03-12T17:33:06.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.351+0000 7f5faa000640 1 -- 172.21.15.17:0/4180628764 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4208483560 0 0) 0x7f5f90003520 con 0x7f5fac0b3b70 2024-03-12T17:33:06.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.351+0000 7f5fab400640 1 -- 172.21.15.17:0/4180628764 >> v2:172.21.15.94:3300/0 conn(0x7f5fac15ae20 msgr2=0x7f5fac06d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:06.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.351+0000 7f5fab400640 1 --2- 172.21.15.17:0/4180628764 >> v2:172.21.15.94:3300/0 conn(0x7f5fac15ae20 0x7f5fac06d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:06.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.351+0000 7f5fab400640 1 -- 172.21.15.17:0/4180628764 >> v1:172.21.15.17:6789/0 conn(0x7f5fac0b3b70 legacy=0x7f5fac15e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:06.347 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.351+0000 7f5fab400640 1 -- 172.21.15.17:0/4180628764 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fac15b3e0 con 0x7f5fac1441f0 2024-03-12T17:33:06.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.353+0000 7f5fab400640 1 --2- 172.21.15.17:0/4180628764 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5fac1441f0 0x7f5fac070240 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c0097a0 tx=0x7f5f9c02b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ea0201beab955d0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:06.348 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.353+0000 7f5faa000640 1 -- 172.21.15.17:0/4180628764 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c02f050 con 0x7f5fac1441f0 2024-03-12T17:33:06.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.353+0000 7f5faa000640 1 -- 172.21.15.17:0/4180628764 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f9c031500 con 0x7f5fac1441f0 2024-03-12T17:33:06.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.353+0000 7f5faa000640 1 -- 172.21.15.17:0/4180628764 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa40019f0 con 0x7f5fac1441f0 2024-03-12T17:33:06.349 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.354+0000 7f5fb1200640 1 -- 172.21.15.17:0/4180628764 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5fac1441f0 msgr2=0x7f5fac070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:06.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.354+0000 7f5fb1200640 1 --2- 172.21.15.17:0/4180628764 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5fac1441f0 0x7f5fac070240 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c0097a0 tx=0x7f5f9c02b820 comp rx=0 tx=0).stop 2024-03-12T17:33:06.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.354+0000 7f5fb1200640 1 -- 172.21.15.17:0/4180628764 shutdown_connections 2024-03-12T17:33:06.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.354+0000 7f5fb1200640 1 --2- 172.21.15.17:0/4180628764 >> v2:172.21.15.94:3300/0 conn(0x7f5fac15ae20 0x7f5fac06d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:06.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.354+0000 7f5fb1200640 1 --2- 172.21.15.17:0/4180628764 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5fac1441f0 0x7f5fac070240 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:06.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.354+0000 7f5fb1200640 1 -- 172.21.15.17:0/4180628764 >> 172.21.15.17:0/4180628764 conn(0x7f5fac069ce0 msgr2=0x7f5fac06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:06.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.354+0000 7f5fb1200640 1 -- 172.21.15.17:0/4180628764 shutdown_connections 2024-03-12T17:33:06.350 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.354+0000 7f5fb1200640 1 -- 172.21.15.17:0/4180628764 wait complete. 2024-03-12T17:33:06.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.356+0000 7f5fb1200640 1 Processor -- start 2024-03-12T17:33:06.351 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.356+0000 7f5fb1200640 1 -- start start 2024-03-12T17:33:06.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.357+0000 7f5fb1200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5fac0b3b70 0x7f5fac15a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:06.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.357+0000 7f5fb1200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5fac1441f0 0x7f5fac0b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:06.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.357+0000 7f5fb1200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fac15ae20 0x7f5fac1f2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:06.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.357+0000 7f5fb1200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fac0b1d40 con 0x7f5fac15ae20 2024-03-12T17:33:06.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.357+0000 7f5fb1200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fac1e5a70 con 0x7f5fac1441f0 2024-03-12T17:33:06.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.357+0000 7f5fb1200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fac0b1780 con 0x7f5fac0b3b70 2024-03-12T17:33:06.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.357+0000 7f5fabe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fac15ae20 0x7f5fac1f2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:06.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.357+0000 7f5fabe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fac15ae20 0x7f5fac1f2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49070/0 (socket says 172.21.15.17:49070) 2024-03-12T17:33:06.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.357+0000 7f5fabe00640 1 -- 172.21.15.17:0/2528924502 learned_addr learned my addr 172.21.15.17:0/2528924502 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:06.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.357+0000 7f5fab400640 1 --2- 172.21.15.17:0/2528924502 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5fac0b3b70 0x7f5fac15a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:06.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.357+0000 7f5fabe00640 1 -- 172.21.15.17:0/2528924502 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5fac0b3b70 msgr2=0x7f5fac15a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:06.353 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.357+0000 7f5faaa00640 1 --2- 172.21.15.17:0/2528924502 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5fac1441f0 0x7f5fac0b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:06.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.357+0000 7f5fabe00640 1 --2- 172.21.15.17:0/2528924502 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5fac0b3b70 0x7f5fac15a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:06.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.357+0000 7f5fabe00640 1 -- 172.21.15.17:0/2528924502 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5fac1441f0 msgr2=0x7f5fac0b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:06.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.357+0000 7f5fabe00640 1 --2- 172.21.15.17:0/2528924502 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5fac1441f0 0x7f5fac0b0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:06.354 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.357+0000 7f5fabe00640 1 -- 172.21.15.17:0/2528924502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f9c009400 con 0x7f5fac15ae20 2024-03-12T17:33:06.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.358+0000 7f5fabe00640 1 --2- 172.21.15.17:0/2528924502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fac15ae20 0x7f5fac1f2580 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4001830 tx=0x7f5fa400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:06.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.358+0000 7f5fa3400640 1 -- 172.21.15.17:0/2528924502 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa4012400 con 0x7f5fac15ae20 2024-03-12T17:33:06.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.358+0000 7f5fa3400640 1 -- 172.21.15.17:0/2528924502 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa4012560 con 0x7f5fac15ae20 2024-03-12T17:33:06.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.358+0000 7f5fa3400640 1 -- 172.21.15.17:0/2528924502 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa4012910 con 0x7f5fac15ae20 2024-03-12T17:33:06.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.358+0000 7f5fb1200640 1 -- 172.21.15.17:0/2528924502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fac0b1a60 con 0x7f5fac15ae20 2024-03-12T17:33:06.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.358+0000 7f5fb1200640 1 -- 172.21.15.17:0/2528924502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fac143630 con 0x7f5fac15ae20 2024-03-12T17:33:06.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.359+0000 7f5fb1200640 1 -- 172.21.15.17:0/2528924502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fac1e58d0 con 0x7f5fac15ae20 2024-03-12T17:33:06.355 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.360+0000 7f5fa3400640 1 -- 172.21.15.17:0/2528924502 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f5fa4012a70 con 0x7f5fac15ae20 2024-03-12T17:33:06.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.361+0000 7f5fa3400640 1 --2- 172.21.15.17:0/2528924502 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f5f8c06ac00 0x7f5f8c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:06.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.361+0000 7f5fa3400640 1 -- 172.21.15.17:0/2528924502 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f5fa4089be0 con 0x7f5fac15ae20 2024-03-12T17:33:06.357 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.362+0000 7f5fab400640 1 --2- 172.21.15.17:0/2528924502 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f5f8c06ac00 0x7f5f8c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:06.358 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.363+0000 7f5fab400640 1 --2- 172.21.15.17:0/2528924502 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f5f8c06ac00 0x7f5f8c06d0c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c035000 tx=0x7f5f9c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:06.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.366+0000 7f5fa3400640 1 -- 172.21.15.17:0/2528924502 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f5fac1e58d0 con 0x7f5fac15ae20 2024-03-12T17:33:06.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.564+0000 7f5fb1200640 1 -- 172.21.15.17:0/2528924502 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5fac1e5f50 con 0x7f5fac15ae20 2024-03-12T17:33:06.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.567+0000 7f5fa3400640 1 -- 172.21.15.17:0/2528924502 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16149 (secure 0 0 0) 0x7f5fac1e5f50 con 0x7f5fac15ae20 2024-03-12T17:33:06.563 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:33:06.564 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":49,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:21:33.443906+0000","last_up_change":"2024-03-12T17:18:38.144756+0000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-12T17:18:39.552910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-03-12T17:20:26.824841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-03-12T17:20:28.205468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":37305},{"type":"v1","addr":"172.21.15.17:6801","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":37305},{"type":"v1","addr":"172.21.15.17:6803","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":37305},{"type":"v1","addr":"172.21.15.17:6807","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":37305},{"type":"v1","addr":"172.21.15.17:6805","nonce":37305}]},"public_addr":"172.21.15.17:6801/37305","cluster_addr":"172.21.15.17:6803/37305","heartbeat_back_addr":"172.21.15.17:6807/37305","heartbeat_front_addr":"172.21.15.17:6805/37305","state":["exists","up"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":37307},{"type":"v1","addr":"172.21.15.17:6814","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":37307},{"type":"v1","addr":"172.21.15.17:6818","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":37307},{"type":"v1","addr":"172.21.15.17:6827","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":37307},{"type":"v1","addr":"172.21.15.17:6823","nonce":37307}]},"public_addr":"172.21.15.17:6814/37307","cluster_addr":"172.21.15.17:6818/37307","heartbeat_back_addr":"172.21.15.17:6827/37307","heartbeat_front_addr":"172.21.15.17:6823/37307","state":["exists","up"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":37303},{"type":"v1","addr":"172.21.15.17:6809","nonce":37303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":37303},{"type":"v1","addr":"172.21.15.17:6811","nonce":37303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":37303},{"type":"v1","addr":"172.21.15.17:6819","nonce":37303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":37303},{"type":"v1","addr":"172.21.15.17:6815","nonce":37303}]},"public_addr":"172.21.15.17:6809/37303","cluster_addr":"172.21.15.17:6811/37303","heartbeat_back_addr":"172.21.15.17:6819/37303","heartbeat_front_addr":"172.21.15.17:6815/37303","state":["exists","up"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":37308},{"type":"v1","addr":"172.21.15.17:6822","nonce":37308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":37308},{"type":"v1","addr":"172.21.15.17:6826","nonce":37308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":37308},{"type":"v1","addr":"172.21.15.17:6831","nonce":37308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":37308},{"type":"v1","addr":"172.21.15.17:6829","nonce":37308}]},"public_addr":"172.21.15.17:6822/37308","cluster_addr":"172.21.15.17:6826/37308","heartbeat_back_addr":"172.21.15.17:6831/37308","heartbeat_front_addr":"172.21.15.17:6829/37308","state":["exists","up"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":37465},{"type":"v1","addr":"172.21.15.94:6809","nonce":37465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6811","nonce":37465},{"type":"v1","addr":"172.21.15.94:6813","nonce":37465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6819","nonce":37465},{"type":"v1","addr":"172.21.15.94:6822","nonce":37465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6815","nonce":37465},{"type":"v1","addr":"172.21.15.94:6817","nonce":37465}]},"public_addr":"172.21.15.94:6809/37465","cluster_addr":"172.21.15.94:6813/37465","heartbeat_back_addr":"172.21.15.94:6822/37465","heartbeat_front_addr":"172.21.15.94:6817/37465","state":["exists","up"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":37464},{"type":"v1","addr":"172.21.15.94:6812","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":37464},{"type":"v1","addr":"172.21.15.94:6816","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":37464},{"type":"v1","addr":"172.21.15.94:6823","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":37464},{"type":"v1","addr":"172.21.15.94:6820","nonce":37464}]},"public_addr":"172.21.15.94:6812/37464","cluster_addr":"172.21.15.94:6816/37464","heartbeat_back_addr":"172.21.15.94:6823/37464","heartbeat_front_addr":"172.21.15.94:6820/37464","state":["exists","up"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":37467},{"type":"v1","addr":"172.21.15.94:6825","nonce":37467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":37467},{"type":"v1","addr":"172.21.15.94:6827","nonce":37467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":37467},{"type":"v1","addr":"172.21.15.94:6831","nonce":37467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":37467},{"type":"v1","addr":"172.21.15.94:6829","nonce":37467}]},"public_addr":"172.21.15.94:6825/37467","cluster_addr":"172.21.15.94:6827/37467","heartbeat_back_addr":"172.21.15.94:6831/37467","heartbeat_front_addr":"172.21.15.94:6829/37467","state":["exists","up"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":37466},{"type":"v1","addr":"172.21.15.94:6801","nonce":37466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":37466},{"type":"v1","addr":"172.21.15.94:6803","nonce":37466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":37466},{"type":"v1","addr":"172.21.15.94:6807","nonce":37466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":37466},{"type":"v1","addr":"172.21.15.94:6805","nonce":37466}]},"public_addr":"172.21.15.94:6801/37466","cluster_addr":"172.21.15.94:6803/37466","heartbeat_back_addr":"172.21.15.94:6807/37466","heartbeat_front_addr":"172.21.15.94:6805/37466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.327217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.186966+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.419986+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.150585+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.120621+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.121576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.181257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.293188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.36","mappings":[{"from":0,"to":5}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:33:06.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.570+0000 7f5fb1200640 1 -- 172.21.15.17:0/2528924502 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f5f8c06ac00 msgr2=0x7f5f8c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:06.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.570+0000 7f5fb1200640 1 --2- 172.21.15.17:0/2528924502 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f5f8c06ac00 0x7f5f8c06d0c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c035000 tx=0x7f5f9c008030 comp rx=0 tx=0).stop 2024-03-12T17:33:06.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.570+0000 7f5fb1200640 1 -- 172.21.15.17:0/2528924502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fac15ae20 msgr2=0x7f5fac1f2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:06.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.570+0000 7f5fb1200640 1 --2- 172.21.15.17:0/2528924502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fac15ae20 0x7f5fac1f2580 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4001830 tx=0x7f5fa400a430 comp rx=0 tx=0).stop 2024-03-12T17:33:06.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.570+0000 7f5fb1200640 1 -- 172.21.15.17:0/2528924502 shutdown_connections 2024-03-12T17:33:06.566 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.570+0000 7f5fb1200640 1 --2- 172.21.15.17:0/2528924502 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f5f8c06ac00 0x7f5f8c06d0c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:06.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.570+0000 7f5fb1200640 1 --2- 172.21.15.17:0/2528924502 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5fac15ae20 0x7f5fac1f2580 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:06.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.570+0000 7f5fb1200640 1 --2- 172.21.15.17:0/2528924502 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f5fac1441f0 0x7f5fac0b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:06.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.570+0000 7f5fb1200640 1 --2- 172.21.15.17:0/2528924502 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5fac0b3b70 0x7f5fac15a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:06.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.570+0000 7f5fb1200640 1 -- 172.21.15.17:0/2528924502 >> 172.21.15.17:0/2528924502 conn(0x7f5fac069ce0 msgr2=0x7f5fac15bff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:06.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.570+0000 7f5fb1200640 1 -- 172.21.15.17:0/2528924502 shutdown_connections 2024-03-12T17:33:06.567 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.571+0000 7f5fb1200640 1 -- 172.21.15.17:0/2528924502 wait complete. 2024-03-12T17:33:06.586 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-12T17:33:06.587 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-12T17:33:06.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.805+0000 7ffaa4c00640 1 Processor -- start 2024-03-12T17:33:06.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.805+0000 7ffaa4c00640 1 -- start start 2024-03-12T17:33:06.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.807+0000 7ffaa4c00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ffaa00ced90 0x7ffaa00b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:06.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.807+0000 7ffaa4c00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ffaa00b3950 0x7ffaa00ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:06.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.807+0000 7ffaa4c00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa00cb340 con 0x7ffaa006c3f0 2024-03-12T17:33:06.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.807+0000 7ffaa4c00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa0159d50 con 0x7ffaa00ced90 2024-03-12T17:33:06.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.807+0000 7ffaa4c00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa00b1c50 con 0x7ffaa00b3950 2024-03-12T17:33:06.803 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.807+0000 7ffa9de00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ffaa00ced90 0x7ffaa00b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:06.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.807+0000 7ffa9de00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ffaa00ced90 0x7ffaa00b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49076/0 (socket says 172.21.15.17:49076) 2024-03-12T17:33:06.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.807+0000 7ffa9de00640 1 -- 172.21.15.17:0/3043955379 learned_addr learned my addr 172.21.15.17:0/3043955379 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:06.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.808+0000 7ffa9e800640 1 --2- 172.21.15.17:0/3043955379 >> v2:172.21.15.94:3300/0 conn(0x7ffaa00b3950 0x7ffaa00ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:06.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.808+0000 7ffa9de00640 1 -- 172.21.15.17:0/3043955379 >> v2:172.21.15.94:3300/0 conn(0x7ffaa00b3950 msgr2=0x7ffaa00ccd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:06.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.808+0000 7ffa9de00640 1 --2- 172.21.15.17:0/3043955379 >> v2:172.21.15.94:3300/0 conn(0x7ffaa00b3950 0x7ffaa00ccd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:06.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.808+0000 7ffa9de00640 1 -- 172.21.15.17:0/3043955379 >> v1:172.21.15.17:6789/0 conn(0x7ffaa006c3f0 legacy=0x7ffaa00b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:06.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.808+0000 7ffa9de00640 1 -- 172.21.15.17:0/3043955379 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa00b1ef0 con 0x7ffaa00ced90 2024-03-12T17:33:06.804 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.808+0000 7ffa9e800640 1 --2- 172.21.15.17:0/3043955379 >> v2:172.21.15.94:3300/0 conn(0x7ffaa00b3950 0x7ffaa00ccd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:33:06.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.809+0000 7ffa9de00640 1 --2- 172.21.15.17:0/3043955379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffaa00ced90 0x7ffaa00b1710 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ffaa015e4e0 tx=0x7ffa9002e170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80342595be50acc3 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:06.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.809+0000 7ffa9ca00640 1 -- 172.21.15.17:0/3043955379 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa90036440 con 0x7ffaa00ced90 2024-03-12T17:33:06.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.809+0000 7ffa9ca00640 1 -- 172.21.15.17:0/3043955379 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa900365a0 con 0x7ffaa00ced90 2024-03-12T17:33:06.805 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.809+0000 7ffa9ca00640 1 -- 172.21.15.17:0/3043955379 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa90036930 con 0x7ffaa00ced90 2024-03-12T17:33:06.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.810+0000 7ffaa4c00640 1 -- 172.21.15.17:0/3043955379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffaa00ced90 msgr2=0x7ffaa00b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:06.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.810+0000 7ffaa4c00640 1 --2- 172.21.15.17:0/3043955379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffaa00ced90 0x7ffaa00b1710 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ffaa015e4e0 tx=0x7ffa9002e170 comp rx=0 tx=0).stop 2024-03-12T17:33:06.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.810+0000 7ffaa4c00640 1 -- 172.21.15.17:0/3043955379 shutdown_connections 2024-03-12T17:33:06.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.810+0000 7ffaa4c00640 1 --2- 172.21.15.17:0/3043955379 >> v2:172.21.15.94:3300/0 conn(0x7ffaa00b3950 0x7ffaa00ccd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:06.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.810+0000 7ffaa4c00640 1 --2- 172.21.15.17:0/3043955379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffaa00ced90 0x7ffaa00b1710 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:06.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.810+0000 7ffaa4c00640 1 -- 172.21.15.17:0/3043955379 >> 172.21.15.17:0/3043955379 conn(0x7ffaa0069ce0 msgr2=0x7ffaa006a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:06.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.810+0000 7ffaa4c00640 1 -- 172.21.15.17:0/3043955379 shutdown_connections 2024-03-12T17:33:06.806 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.810+0000 7ffaa4c00640 1 -- 172.21.15.17:0/3043955379 wait complete. 2024-03-12T17:33:06.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.812+0000 7ffaa4c00640 1 Processor -- start 2024-03-12T17:33:06.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.812+0000 7ffaa4c00640 1 -- start start 2024-03-12T17:33:06.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.813+0000 7ffaa4c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffaa006c3f0 0x7ffaa00af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:06.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.813+0000 7ffaa4c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffaa00b3950 0x7ffaa0152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:06.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.813+0000 7ffaa4c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffaa00ced90 0x7ffaa00afc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:06.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.813+0000 7ffaa4c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa0152ad0 con 0x7ffaa00b3950 2024-03-12T17:33:06.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.813+0000 7ffaa4c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa00b07c0 con 0x7ffaa006c3f0 2024-03-12T17:33:06.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.813+0000 7ffaa4c00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa00b04e0 con 0x7ffaa00ced90 2024-03-12T17:33:06.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.813+0000 7ffa9d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffaa00b3950 0x7ffaa0152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:06.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.814+0000 7ffa9d400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffaa00b3950 0x7ffaa0152590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49082/0 (socket says 172.21.15.17:49082) 2024-03-12T17:33:06.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.814+0000 7ffa9d400640 1 -- 172.21.15.17:0/2784873901 learned_addr learned my addr 172.21.15.17:0/2784873901 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:06.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.814+0000 7ffa9de00640 1 --2- 172.21.15.17:0/2784873901 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffaa006c3f0 0x7ffaa00af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:06.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.814+0000 7ffa9e800640 1 --2- 172.21.15.17:0/2784873901 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffaa00ced90 0x7ffaa00afc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:06.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.814+0000 7ffa9d400640 1 -- 172.21.15.17:0/2784873901 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffaa00ced90 msgr2=0x7ffaa00afc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:06.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.814+0000 7ffa9d400640 1 --2- 172.21.15.17:0/2784873901 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffaa00ced90 0x7ffaa00afc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:06.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.814+0000 7ffa9d400640 1 -- 172.21.15.17:0/2784873901 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffaa006c3f0 msgr2=0x7ffaa00af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:06.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.814+0000 7ffa9d400640 1 --2- 172.21.15.17:0/2784873901 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffaa006c3f0 0x7ffaa00af4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:06.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.814+0000 7ffa9d400640 1 -- 172.21.15.17:0/2784873901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa9000b770 con 0x7ffaa00b3950 2024-03-12T17:33:06.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.814+0000 7ffa9d400640 1 --2- 172.21.15.17:0/2784873901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffaa00b3950 0x7ffaa0152590 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c00c400 tx=0x7ffa8c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:06.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.815+0000 7ffa96000640 1 -- 172.21.15.17:0/2784873901 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c0052d0 con 0x7ffaa00b3950 2024-03-12T17:33:06.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.815+0000 7ffa96000640 1 -- 172.21.15.17:0/2784873901 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa8c005430 con 0x7ffaa00b3950 2024-03-12T17:33:06.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.815+0000 7ffa96000640 1 -- 172.21.15.17:0/2784873901 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa8c003830 con 0x7ffaa00b3950 2024-03-12T17:33:06.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.815+0000 7ffaa4c00640 1 -- 172.21.15.17:0/2784873901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaa00ae9e0 con 0x7ffaa00b3950 2024-03-12T17:33:06.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.815+0000 7ffaa4c00640 1 -- 172.21.15.17:0/2784873901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa00aefa0 con 0x7ffaa00b3950 2024-03-12T17:33:06.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.816+0000 7ffaa4c00640 1 -- 172.21.15.17:0/2784873901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaa0067120 con 0x7ffaa00b3950 2024-03-12T17:33:06.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.817+0000 7ffa96000640 1 -- 172.21.15.17:0/2784873901 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7ffa8c003990 con 0x7ffaa00b3950 2024-03-12T17:33:06.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.818+0000 7ffa96000640 1 --2- 172.21.15.17:0/2784873901 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ffa8006ac00 0x7ffa8006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:06.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.818+0000 7ffa96000640 1 -- 172.21.15.17:0/2784873901 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ffa8c088920 con 0x7ffaa00b3950 2024-03-12T17:33:06.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.818+0000 7ffa9de00640 1 --2- 172.21.15.17:0/2784873901 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ffa8006ac00 0x7ffa8006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:06.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.819+0000 7ffa9de00640 1 --2- 172.21.15.17:0/2784873901 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ffa8006ac00 0x7ffa8006d0c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ffa90038000 tx=0x7ffa90032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:06.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:06.823+0000 7ffa96000640 1 -- 172.21.15.17:0/2784873901 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7ffa8c053ab0 con 0x7ffaa00b3950 2024-03-12T17:33:07.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.065+0000 7ffaa4c00640 1 -- 172.21.15.17:0/2784873901 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffaa00ae840 con 0x7ffaa00b3950 2024-03-12T17:33:07.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.066+0000 7ffa96000640 1 -- 172.21.15.17:0/2784873901 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4731 (secure 0 0 0) 0x7ffaa00ae840 con 0x7ffaa00b3950 2024-03-12T17:33:07.062 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:33:07.062 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4808,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6834/3175855266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3175855266},{"type":"v1","addr":"172.21.15.94:6834","nonce":3175855266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":4927,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/1725537585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1725537585},{"type":"v1","addr":"172.21.15.17:6835","nonce":1725537585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":4939,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/630541950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6833","nonce":630541950},{"type":"v1","addr":"172.21.15.94:6835","nonce":630541950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T17:20:29.180386+0000","modified":"2024-03-12T17:20:32.399146+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5433":{"gid":5433,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6837/2711965846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":2711965846},{"type":"v1","addr":"172.21.15.17:6837","nonce":2711965846}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-03-12T17:33:07.062 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 22 2024-03-12T17:33:07.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.069+0000 7ffaa4c00640 1 -- 172.21.15.17:0/2784873901 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ffa8006ac00 msgr2=0x7ffa8006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:07.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.069+0000 7ffaa4c00640 1 --2- 172.21.15.17:0/2784873901 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ffa8006ac00 0x7ffa8006d0c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ffa90038000 tx=0x7ffa90032000 comp rx=0 tx=0).stop 2024-03-12T17:33:07.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.069+0000 7ffaa4c00640 1 -- 172.21.15.17:0/2784873901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffaa00b3950 msgr2=0x7ffaa0152590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:07.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.069+0000 7ffaa4c00640 1 --2- 172.21.15.17:0/2784873901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffaa00b3950 0x7ffaa0152590 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c00c400 tx=0x7ffa8c00c8c0 comp rx=0 tx=0).stop 2024-03-12T17:33:07.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.069+0000 7ffaa4c00640 1 -- 172.21.15.17:0/2784873901 shutdown_connections 2024-03-12T17:33:07.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.069+0000 7ffaa4c00640 1 --2- 172.21.15.17:0/2784873901 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ffa8006ac00 0x7ffa8006d0c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:07.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.069+0000 7ffaa4c00640 1 --2- 172.21.15.17:0/2784873901 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ffaa00ced90 0x7ffaa00afc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:07.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.069+0000 7ffaa4c00640 1 --2- 172.21.15.17:0/2784873901 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ffaa00b3950 0x7ffaa0152590 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:07.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.069+0000 7ffaa4c00640 1 --2- 172.21.15.17:0/2784873901 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ffaa006c3f0 0x7ffaa00af4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:07.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.069+0000 7ffaa4c00640 1 -- 172.21.15.17:0/2784873901 >> 172.21.15.17:0/2784873901 conn(0x7ffaa0069ce0 msgr2=0x7ffaa006c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:07.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.069+0000 7ffaa4c00640 1 -- 172.21.15.17:0/2784873901 shutdown_connections 2024-03-12T17:33:07.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.069+0000 7ffaa4c00640 1 -- 172.21.15.17:0/2784873901 wait complete. 2024-03-12T17:33:07.086 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-12T17:33:07.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.315+0000 7fccca000640 1 Processor -- start 2024-03-12T17:33:07.311 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.315+0000 7fccca000640 1 -- start start 2024-03-12T17:33:07.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.316+0000 7fccca000640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fccc40d2fa0 0x7fccc40d3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:07.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.316+0000 7fccca000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fccc40b5f70 0x7fccc40d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:07.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.316+0000 7fccca000640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccc40d14e0 con 0x7fccc40b5b50 2024-03-12T17:33:07.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.316+0000 7fccca000640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccc40b59e0 con 0x7fccc40b5f70 2024-03-12T17:33:07.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.316+0000 7fccca000640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccc40d38c0 con 0x7fccc40d2fa0 2024-03-12T17:33:07.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.317+0000 7fccc3e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fccc40b5f70 0x7fccc40d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:07.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.317+0000 7fccc3e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fccc40b5f70 0x7fccc40d1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49084/0 (socket says 172.21.15.17:49084) 2024-03-12T17:33:07.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.317+0000 7fccc3e00640 1 -- 172.21.15.17:0/3151207120 learned_addr learned my addr 172.21.15.17:0/3151207120 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:07.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.317+0000 7fccc3400640 1 --2- 172.21.15.17:0/3151207120 >> v2:172.21.15.94:3300/0 conn(0x7fccc40d2fa0 0x7fccc40d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:07.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.317+0000 7fccc3e00640 1 -- 172.21.15.17:0/3151207120 >> v2:172.21.15.94:3300/0 conn(0x7fccc40d2fa0 msgr2=0x7fccc40d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:07.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.317+0000 7fccc3e00640 1 --2- 172.21.15.17:0/3151207120 >> v2:172.21.15.94:3300/0 conn(0x7fccc40d2fa0 0x7fccc40d3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:07.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.317+0000 7fccc3e00640 1 -- 172.21.15.17:0/3151207120 >> v1:172.21.15.94:6789/0 conn(0x7fccc40b5b50 legacy=0x7fccc40cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:07.314 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.318+0000 7fccc3e00640 1 -- 172.21.15.17:0/3151207120 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc40b85b0 con 0x7fccc40b5f70 2024-03-12T17:33:07.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.319+0000 7fccc3e00640 1 --2- 172.21.15.17:0/3151207120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccc40b5f70 0x7fccc40d1f30 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fccc40b4dc0 tx=0x7fccbc02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=986f7e751df2d4b9 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:07.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.319+0000 7fccc2000640 1 -- 172.21.15.17:0/3151207120 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccbc02ca80 con 0x7fccc40b5f70 2024-03-12T17:33:07.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.319+0000 7fccc2000640 1 -- 172.21.15.17:0/3151207120 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccbc02cbe0 con 0x7fccc40b5f70 2024-03-12T17:33:07.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.319+0000 7fccc2000640 1 -- 172.21.15.17:0/3151207120 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccbc0343f0 con 0x7fccc40b5f70 2024-03-12T17:33:07.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.320+0000 7fccca000640 1 -- 172.21.15.17:0/3151207120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccc40b5f70 msgr2=0x7fccc40d1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:07.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.320+0000 7fccca000640 1 --2- 172.21.15.17:0/3151207120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccc40b5f70 0x7fccc40d1f30 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fccc40b4dc0 tx=0x7fccbc02bee0 comp rx=0 tx=0).stop 2024-03-12T17:33:07.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.320+0000 7fccca000640 1 -- 172.21.15.17:0/3151207120 shutdown_connections 2024-03-12T17:33:07.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.320+0000 7fccca000640 1 --2- 172.21.15.17:0/3151207120 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccc40b5f70 0x7fccc40d1f30 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:07.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.320+0000 7fccca000640 1 --2- 172.21.15.17:0/3151207120 >> v2:172.21.15.94:3300/0 conn(0x7fccc40d2fa0 0x7fccc40d3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:07.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.320+0000 7fccca000640 1 -- 172.21.15.17:0/3151207120 >> 172.21.15.17:0/3151207120 conn(0x7fccc4065df0 msgr2=0x7fccc4066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:07.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.320+0000 7fccca000640 1 -- 172.21.15.17:0/3151207120 shutdown_connections 2024-03-12T17:33:07.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.320+0000 7fccca000640 1 -- 172.21.15.17:0/3151207120 wait complete. 2024-03-12T17:33:07.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.322+0000 7fccca000640 1 Processor -- start 2024-03-12T17:33:07.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.322+0000 7fccca000640 1 -- start start 2024-03-12T17:33:07.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.323+0000 7fccca000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fccc40b5b50 0x7fccc41f1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:07.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.323+0000 7fccca000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccc40b5f70 0x7fccc40b68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:07.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.323+0000 7fccca000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fccc40d2fa0 0x7fccc40b6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:07.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.323+0000 7fccca000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc40cbee0 con 0x7fccc40b5f70 2024-03-12T17:33:07.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.323+0000 7fccca000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccc415f170 con 0x7fccc40b5b50 2024-03-12T17:33:07.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.323+0000 7fccca000640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccc415e560 con 0x7fccc40d2fa0 2024-03-12T17:33:07.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.323+0000 7fccc2a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccc40b5f70 0x7fccc40b68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:07.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.323+0000 7fccc2a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccc40b5f70 0x7fccc40b68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49100/0 (socket says 172.21.15.17:49100) 2024-03-12T17:33:07.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.323+0000 7fccc2a00640 1 -- 172.21.15.17:0/4174851595 learned_addr learned my addr 172.21.15.17:0/4174851595 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:07.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.324+0000 7fccc3e00640 1 --2- 172.21.15.17:0/4174851595 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fccc40d2fa0 0x7fccc40b6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:07.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.324+0000 7fccc3400640 1 --2- 172.21.15.17:0/4174851595 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fccc40b5b50 0x7fccc41f1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:07.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.324+0000 7fccc2a00640 1 -- 172.21.15.17:0/4174851595 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fccc40d2fa0 msgr2=0x7fccc40b6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:07.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.324+0000 7fccc2a00640 1 --2- 172.21.15.17:0/4174851595 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fccc40d2fa0 0x7fccc40b6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:07.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.324+0000 7fccc2a00640 1 -- 172.21.15.17:0/4174851595 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fccc40b5b50 msgr2=0x7fccc41f1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:07.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.324+0000 7fccc2a00640 1 --2- 172.21.15.17:0/4174851595 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fccc40b5b50 0x7fccc41f1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:07.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.324+0000 7fccc2a00640 1 -- 172.21.15.17:0/4174851595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccbc009b30 con 0x7fccc40b5f70 2024-03-12T17:33:07.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.324+0000 7fccc2a00640 1 --2- 172.21.15.17:0/4174851595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccc40b5f70 0x7fccc40b68f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fccb000b3f0 tx=0x7fccb000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:07.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.324+0000 7fccbb400640 1 -- 172.21.15.17:0/4174851595 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb0011830 con 0x7fccc40b5f70 2024-03-12T17:33:07.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.324+0000 7fccbb400640 1 -- 172.21.15.17:0/4174851595 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb0011990 con 0x7fccc40b5f70 2024-03-12T17:33:07.321 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.324+0000 7fccbb400640 1 -- 172.21.15.17:0/4174851595 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb0011d40 con 0x7fccc40b5f70 2024-03-12T17:33:07.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.324+0000 7fccca000640 1 -- 172.21.15.17:0/4174851595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccc415e840 con 0x7fccc40b5f70 2024-03-12T17:33:07.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.325+0000 7fccca000640 1 -- 172.21.15.17:0/4174851595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccc415ee00 con 0x7fccc40b5f70 2024-03-12T17:33:07.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.326+0000 7fccca000640 1 -- 172.21.15.17:0/4174851595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccc40736c0 con 0x7fccc40b5f70 2024-03-12T17:33:07.322 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.327+0000 7fccbb400640 1 -- 172.21.15.17:0/4174851595 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fccb001a400 con 0x7fccc40b5f70 2024-03-12T17:33:07.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.328+0000 7fccbb400640 1 --2- 172.21.15.17:0/4174851595 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fcca406ac00 0x7fcca406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:07.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.328+0000 7fccbb400640 1 -- 172.21.15.17:0/4174851595 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fccb0089240 con 0x7fccc40b5f70 2024-03-12T17:33:07.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.329+0000 7fccc3400640 1 --2- 172.21.15.17:0/4174851595 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fcca406ac00 0x7fcca406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:07.324 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.329+0000 7fccc3400640 1 --2- 172.21.15.17:0/4174851595 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fcca406ac00 0x7fcca406d0c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fccb4006fd0 tx=0x7fccb4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:07.328 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.333+0000 7fccbb400640 1 -- 172.21.15.17:0/4174851595 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fccb00543d0 con 0x7fccc40b5f70 2024-03-12T17:33:07.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.572+0000 7fccca000640 1 -- 172.21.15.17:0/4174851595 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fccc415f2b0 con 0x7fccc40b5f70 2024-03-12T17:33:07.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.573+0000 7fccbb400640 1 -- 172.21.15.17:0/4174851595 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4731 (secure 0 0 0) 0x7fccc415f2b0 con 0x7fccc40b5f70 2024-03-12T17:33:07.568 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:33:07.569 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":22,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4808,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6834/3175855266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3175855266},{"type":"v1","addr":"172.21.15.94:6834","nonce":3175855266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":4927,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/1725537585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1725537585},{"type":"v1","addr":"172.21.15.17:6835","nonce":1725537585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":4939,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/630541950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6833","nonce":630541950},{"type":"v1","addr":"172.21.15.94:6835","nonce":630541950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T17:20:29.180386+0000","modified":"2024-03-12T17:20:32.399146+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5433":{"gid":5433,"name":"c","rank":0,"incarnation":18,"state":"up:active","state_seq":3,"addr":"172.21.15.17:6837/2711965846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":2711965846},{"type":"v1","addr":"172.21.15.17:6837","nonce":2711965846}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-03-12T17:33:07.569 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 22 2024-03-12T17:33:07.570 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.575+0000 7fccca000640 1 -- 172.21.15.17:0/4174851595 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fcca406ac00 msgr2=0x7fcca406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:07.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.575+0000 7fccca000640 1 --2- 172.21.15.17:0/4174851595 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fcca406ac00 0x7fcca406d0c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fccb4006fd0 tx=0x7fccb4008040 comp rx=0 tx=0).stop 2024-03-12T17:33:07.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.575+0000 7fccca000640 1 -- 172.21.15.17:0/4174851595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccc40b5f70 msgr2=0x7fccc40b68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:07.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.575+0000 7fccca000640 1 --2- 172.21.15.17:0/4174851595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccc40b5f70 0x7fccc40b68f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fccb000b3f0 tx=0x7fccb000b8b0 comp rx=0 tx=0).stop 2024-03-12T17:33:07.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.575+0000 7fccca000640 1 -- 172.21.15.17:0/4174851595 shutdown_connections 2024-03-12T17:33:07.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.575+0000 7fccca000640 1 --2- 172.21.15.17:0/4174851595 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fcca406ac00 0x7fcca406d0c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:07.571 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.575+0000 7fccca000640 1 --2- 172.21.15.17:0/4174851595 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fccc40d2fa0 0x7fccc40b6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:07.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.575+0000 7fccca000640 1 --2- 172.21.15.17:0/4174851595 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fccc40b5f70 0x7fccc40b68f0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:07.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.575+0000 7fccca000640 1 --2- 172.21.15.17:0/4174851595 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fccc40b5b50 0x7fccc41f1c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:07.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.575+0000 7fccca000640 1 -- 172.21.15.17:0/4174851595 >> 172.21.15.17:0/4174851595 conn(0x7fccc4065df0 msgr2=0x7fccc40b7690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:07.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.576+0000 7fccca000640 1 -- 172.21.15.17:0/4174851595 shutdown_connections 2024-03-12T17:33:07.572 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.576+0000 7fccca000640 1 -- 172.21.15.17:0/4174851595 wait complete. 2024-03-12T17:33:07.591 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T17:33:07.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.819+0000 7f3efbe00640 1 Processor -- start 2024-03-12T17:33:07.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.819+0000 7f3efbe00640 1 -- start start 2024-03-12T17:33:07.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.820+0000 7f3efbe00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3efc1441f0 0x7f3efc070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:07.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.820+0000 7f3efbe00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3efc15ae20 0x7f3efc06d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:07.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.820+0000 7f3efbe00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3efc0a7660 con 0x7f3efc0b3b70 2024-03-12T17:33:07.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.820+0000 7f3efbe00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3efc15e460 con 0x7f3efc1441f0 2024-03-12T17:33:07.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.820+0000 7f3efbe00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc1445d0 con 0x7f3efc15ae20 2024-03-12T17:33:07.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.821+0000 7f3efaa00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3efc1441f0 0x7f3efc070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:07.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.821+0000 7f3efaa00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f3efc1441f0 0x7f3efc070240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49104/0 (socket says 172.21.15.17:49104) 2024-03-12T17:33:07.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.821+0000 7f3efaa00640 1 -- 172.21.15.17:0/261657491 learned_addr learned my addr 172.21.15.17:0/261657491 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:07.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.821+0000 7f3efa000640 1 --2- 172.21.15.17:0/261657491 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3efc15ae20 0x7f3efc06d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:07.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.821+0000 7f3efaa00640 1 -- 172.21.15.17:0/261657491 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3efc15ae20 msgr2=0x7f3efc06d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:07.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.821+0000 7f3efaa00640 1 --2- 172.21.15.17:0/261657491 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3efc15ae20 0x7f3efc06d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:07.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.821+0000 7f3efaa00640 1 -- 172.21.15.17:0/261657491 >> v1:172.21.15.94:6789/0 conn(0x7f3efc0b3b70 legacy=0x7f3efc15e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:07.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.821+0000 7f3efaa00640 1 -- 172.21.15.17:0/261657491 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3efc15b3e0 con 0x7f3efc1441f0 2024-03-12T17:33:07.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.822+0000 7f3efaa00640 1 --2- 172.21.15.17:0/261657491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3efc1441f0 0x7f3efc070240 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f3eec009870 tx=0x7f3eec02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98d9944d85caef3b server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:07.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.823+0000 7f3ef9600640 1 -- 172.21.15.17:0/261657491 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec030840 con 0x7f3efc1441f0 2024-03-12T17:33:07.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.823+0000 7f3ef9600640 1 -- 172.21.15.17:0/261657491 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eec0309a0 con 0x7f3efc1441f0 2024-03-12T17:33:07.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.823+0000 7f3ef9600640 1 -- 172.21.15.17:0/261657491 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec030d30 con 0x7f3efc1441f0 2024-03-12T17:33:07.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.823+0000 7f3efbe00640 1 -- 172.21.15.17:0/261657491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3efc1441f0 msgr2=0x7f3efc070240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:07.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.823+0000 7f3efbe00640 1 --2- 172.21.15.17:0/261657491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3efc1441f0 0x7f3efc070240 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f3eec009870 tx=0x7f3eec02b980 comp rx=0 tx=0).stop 2024-03-12T17:33:07.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.823+0000 7f3efbe00640 1 -- 172.21.15.17:0/261657491 shutdown_connections 2024-03-12T17:33:07.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.823+0000 7f3efbe00640 1 --2- 172.21.15.17:0/261657491 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3efc15ae20 0x7f3efc06d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:07.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.823+0000 7f3efbe00640 1 --2- 172.21.15.17:0/261657491 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3efc1441f0 0x7f3efc070240 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:07.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.823+0000 7f3efbe00640 1 -- 172.21.15.17:0/261657491 >> 172.21.15.17:0/261657491 conn(0x7f3efc069ce0 msgr2=0x7f3efc06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:07.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.824+0000 7f3efbe00640 1 -- 172.21.15.17:0/261657491 shutdown_connections 2024-03-12T17:33:07.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.824+0000 7f3efbe00640 1 -- 172.21.15.17:0/261657491 wait complete. 2024-03-12T17:33:07.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.825+0000 7f3efbe00640 1 Processor -- start 2024-03-12T17:33:07.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.826+0000 7f3efbe00640 1 -- start start 2024-03-12T17:33:07.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.826+0000 7f3efbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3efc0b3b70 0x7f3efc13f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:07.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.827+0000 7f3efbe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3efc1441f0 0x7f3efc0af590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:07.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.827+0000 7f3efbe00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3efc15ae20 0x7f3efc0c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:07.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.827+0000 7f3efbe00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc0afec0 con 0x7f3efc0b3b70 2024-03-12T17:33:07.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.827+0000 7f3efbe00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc1f39b0 con 0x7f3efc1441f0 2024-03-12T17:33:07.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.827+0000 7f3efbe00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc1f3c90 con 0x7f3efc15ae20 2024-03-12T17:33:07.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.827+0000 7f3efaa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3efc0b3b70 0x7f3efc13f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:07.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.827+0000 7f3efaa00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3efc0b3b70 0x7f3efc13f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49110/0 (socket says 172.21.15.17:49110) 2024-03-12T17:33:07.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.827+0000 7f3efaa00640 1 -- 172.21.15.17:0/2128910306 learned_addr learned my addr 172.21.15.17:0/2128910306 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:07.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.827+0000 7f3efa000640 1 --2- 172.21.15.17:0/2128910306 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3efc1441f0 0x7f3efc0af590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:07.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.827+0000 7f3efb400640 1 --2- 172.21.15.17:0/2128910306 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3efc15ae20 0x7f3efc0c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:07.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.827+0000 7f3efaa00640 1 -- 172.21.15.17:0/2128910306 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3efc15ae20 msgr2=0x7f3efc0c43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:07.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.827+0000 7f3efaa00640 1 --2- 172.21.15.17:0/2128910306 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3efc15ae20 0x7f3efc0c43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:07.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.827+0000 7f3efaa00640 1 -- 172.21.15.17:0/2128910306 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3efc1441f0 msgr2=0x7f3efc0af590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:07.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.827+0000 7f3efaa00640 1 --2- 172.21.15.17:0/2128910306 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3efc1441f0 0x7f3efc0af590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:07.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.827+0000 7f3efaa00640 1 -- 172.21.15.17:0/2128910306 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eec0094d0 con 0x7f3efc0b3b70 2024-03-12T17:33:07.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.827+0000 7f3efa000640 1 --2- 172.21.15.17:0/2128910306 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3efc1441f0 0x7f3efc0af590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:33:07.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.828+0000 7f3efaa00640 1 --2- 172.21.15.17:0/2128910306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3efc0b3b70 0x7f3efc13f2c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f3eec000c00 tx=0x7f3eec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:07.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.828+0000 7f3ef2a00640 1 -- 172.21.15.17:0/2128910306 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec030810 con 0x7f3efc0b3b70 2024-03-12T17:33:07.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.828+0000 7f3ef2a00640 1 -- 172.21.15.17:0/2128910306 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eec043400 con 0x7f3efc0b3b70 2024-03-12T17:33:07.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.828+0000 7f3efbe00640 1 -- 172.21.15.17:0/2128910306 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3efc1f3f70 con 0x7f3efc0b3b70 2024-03-12T17:33:07.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.828+0000 7f3ef2a00640 1 -- 172.21.15.17:0/2128910306 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eec0437d0 con 0x7f3efc0b3b70 2024-03-12T17:33:07.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.828+0000 7f3efbe00640 1 -- 172.21.15.17:0/2128910306 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3efc0ca400 con 0x7f3efc0b3b70 2024-03-12T17:33:07.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.829+0000 7f3efbe00640 1 -- 172.21.15.17:0/2128910306 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3efc0ca6b0 con 0x7f3efc0b3b70 2024-03-12T17:33:07.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.830+0000 7f3ef2a00640 1 -- 172.21.15.17:0/2128910306 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f3eec043930 con 0x7f3efc0b3b70 2024-03-12T17:33:07.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.831+0000 7f3ef2a00640 1 --2- 172.21.15.17:0/2128910306 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f3edc06ac30 0x7f3edc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:07.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.832+0000 7f3ef2a00640 1 -- 172.21.15.17:0/2128910306 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3eec03e070 con 0x7f3efc0b3b70 2024-03-12T17:33:07.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.832+0000 7f3efa000640 1 --2- 172.21.15.17:0/2128910306 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f3edc06ac30 0x7f3edc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:07.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.833+0000 7f3efa000640 1 --2- 172.21.15.17:0/2128910306 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f3edc06ac30 0x7f3edc06d0f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3efc0b2ba0 tx=0x7f3ee8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:07.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:07.836+0000 7f3ef2a00640 1 -- 172.21.15.17:0/2128910306 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f3eec077770 con 0x7f3efc0b3b70 2024-03-12T17:33:08.034 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.038+0000 7f3efbe00640 1 -- 172.21.15.17:0/2128910306 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3efc1f3810 con 0x7f3efc0b3b70 2024-03-12T17:33:08.037 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.042+0000 7f3ef2a00640 1 -- 172.21.15.17:0/2128910306 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16149 (secure 0 0 0) 0x7f3efc1f3810 con 0x7f3efc0b3b70 2024-03-12T17:33:08.038 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:33:08.038 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":49,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:21:33.443906+0000","last_up_change":"2024-03-12T17:18:38.144756+0000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-12T17:18:39.552910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-03-12T17:20:26.824841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-03-12T17:20:28.205468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":37305},{"type":"v1","addr":"172.21.15.17:6801","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":37305},{"type":"v1","addr":"172.21.15.17:6803","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":37305},{"type":"v1","addr":"172.21.15.17:6807","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":37305},{"type":"v1","addr":"172.21.15.17:6805","nonce":37305}]},"public_addr":"172.21.15.17:6801/37305","cluster_addr":"172.21.15.17:6803/37305","heartbeat_back_addr":"172.21.15.17:6807/37305","heartbeat_front_addr":"172.21.15.17:6805/37305","state":["exists","up"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":37307},{"type":"v1","addr":"172.21.15.17:6814","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":37307},{"type":"v1","addr":"172.21.15.17:6818","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":37307},{"type":"v1","addr":"172.21.15.17:6827","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":37307},{"type":"v1","addr":"172.21.15.17:6823","nonce":37307}]},"public_addr":"172.21.15.17:6814/37307","cluster_addr":"172.21.15.17:6818/37307","heartbeat_back_addr":"172.21.15.17:6827/37307","heartbeat_front_addr":"172.21.15.17:6823/37307","state":["exists","up"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":37303},{"type":"v1","addr":"172.21.15.17:6809","nonce":37303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":37303},{"type":"v1","addr":"172.21.15.17:6811","nonce":37303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":37303},{"type":"v1","addr":"172.21.15.17:6819","nonce":37303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":37303},{"type":"v1","addr":"172.21.15.17:6815","nonce":37303}]},"public_addr":"172.21.15.17:6809/37303","cluster_addr":"172.21.15.17:6811/37303","heartbeat_back_addr":"172.21.15.17:6819/37303","heartbeat_front_addr":"172.21.15.17:6815/37303","state":["exists","up"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":37308},{"type":"v1","addr":"172.21.15.17:6822","nonce":37308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":37308},{"type":"v1","addr":"172.21.15.17:6826","nonce":37308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":37308},{"type":"v1","addr":"172.21.15.17:6831","nonce":37308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":37308},{"type":"v1","addr":"172.21.15.17:6829","nonce":37308}]},"public_addr":"172.21.15.17:6822/37308","cluster_addr":"172.21.15.17:6826/37308","heartbeat_back_addr":"172.21.15.17:6831/37308","heartbeat_front_addr":"172.21.15.17:6829/37308","state":["exists","up"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":37465},{"type":"v1","addr":"172.21.15.94:6809","nonce":37465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6811","nonce":37465},{"type":"v1","addr":"172.21.15.94:6813","nonce":37465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6819","nonce":37465},{"type":"v1","addr":"172.21.15.94:6822","nonce":37465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6815","nonce":37465},{"type":"v1","addr":"172.21.15.94:6817","nonce":37465}]},"public_addr":"172.21.15.94:6809/37465","cluster_addr":"172.21.15.94:6813/37465","heartbeat_back_addr":"172.21.15.94:6822/37465","heartbeat_front_addr":"172.21.15.94:6817/37465","state":["exists","up"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":37464},{"type":"v1","addr":"172.21.15.94:6812","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":37464},{"type":"v1","addr":"172.21.15.94:6816","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":37464},{"type":"v1","addr":"172.21.15.94:6823","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":37464},{"type":"v1","addr":"172.21.15.94:6820","nonce":37464}]},"public_addr":"172.21.15.94:6812/37464","cluster_addr":"172.21.15.94:6816/37464","heartbeat_back_addr":"172.21.15.94:6823/37464","heartbeat_front_addr":"172.21.15.94:6820/37464","state":["exists","up"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":37467},{"type":"v1","addr":"172.21.15.94:6825","nonce":37467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":37467},{"type":"v1","addr":"172.21.15.94:6827","nonce":37467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":37467},{"type":"v1","addr":"172.21.15.94:6831","nonce":37467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":37467},{"type":"v1","addr":"172.21.15.94:6829","nonce":37467}]},"public_addr":"172.21.15.94:6825/37467","cluster_addr":"172.21.15.94:6827/37467","heartbeat_back_addr":"172.21.15.94:6831/37467","heartbeat_front_addr":"172.21.15.94:6829/37467","state":["exists","up"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":37466},{"type":"v1","addr":"172.21.15.94:6801","nonce":37466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":37466},{"type":"v1","addr":"172.21.15.94:6803","nonce":37466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":37466},{"type":"v1","addr":"172.21.15.94:6807","nonce":37466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":37466},{"type":"v1","addr":"172.21.15.94:6805","nonce":37466}]},"public_addr":"172.21.15.94:6801/37466","cluster_addr":"172.21.15.94:6803/37466","heartbeat_back_addr":"172.21.15.94:6807/37466","heartbeat_front_addr":"172.21.15.94:6805/37466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.327217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.186966+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.419986+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.150585+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.120621+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.121576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.181257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.293188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.36","mappings":[{"from":0,"to":5}]},{"pgid":"7.3e","mappings":[{"from":0,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:33:08.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.045+0000 7f3efbe00640 1 -- 172.21.15.17:0/2128910306 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f3edc06ac30 msgr2=0x7f3edc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:08.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.045+0000 7f3efbe00640 1 --2- 172.21.15.17:0/2128910306 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f3edc06ac30 0x7f3edc06d0f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3efc0b2ba0 tx=0x7f3ee8008040 comp rx=0 tx=0).stop 2024-03-12T17:33:08.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.045+0000 7f3efbe00640 1 -- 172.21.15.17:0/2128910306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3efc0b3b70 msgr2=0x7f3efc13f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:08.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.045+0000 7f3efbe00640 1 --2- 172.21.15.17:0/2128910306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3efc0b3b70 0x7f3efc13f2c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f3eec000c00 tx=0x7f3eec004730 comp rx=0 tx=0).stop 2024-03-12T17:33:08.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.045+0000 7f3efbe00640 1 -- 172.21.15.17:0/2128910306 shutdown_connections 2024-03-12T17:33:08.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.045+0000 7f3efbe00640 1 --2- 172.21.15.17:0/2128910306 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f3edc06ac30 0x7f3edc06d0f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:08.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.045+0000 7f3efbe00640 1 --2- 172.21.15.17:0/2128910306 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f3efc15ae20 0x7f3efc0c43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:08.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.045+0000 7f3efbe00640 1 --2- 172.21.15.17:0/2128910306 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3efc1441f0 0x7f3efc0af590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:08.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.045+0000 7f3efbe00640 1 --2- 172.21.15.17:0/2128910306 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3efc0b3b70 0x7f3efc13f2c0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:08.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.045+0000 7f3efbe00640 1 -- 172.21.15.17:0/2128910306 >> 172.21.15.17:0/2128910306 conn(0x7f3efc069ce0 msgr2=0x7f3efc06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:08.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.045+0000 7f3efbe00640 1 -- 172.21.15.17:0/2128910306 shutdown_connections 2024-03-12T17:33:08.042 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.045+0000 7f3efbe00640 1 -- 172.21.15.17:0/2128910306 wait complete. 2024-03-12T17:33:08.062 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-12T17:33:08.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.291+0000 7feb63200640 1 Processor -- start 2024-03-12T17:33:08.287 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.291+0000 7feb63200640 1 -- start start 2024-03-12T17:33:08.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.293+0000 7feb63200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feb640b86c0 0x7feb640b4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:08.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.293+0000 7feb63200640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7feb640b4950 0x7feb640d1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:08.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.293+0000 7feb63200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb640b4da0 con 0x7feb64160090 2024-03-12T17:33:08.288 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.293+0000 7feb63200640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb640d0e40 con 0x7feb640b4950 2024-03-12T17:33:08.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.293+0000 7feb63200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb64160470 con 0x7feb640b86c0 2024-03-12T17:33:08.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.293+0000 7feb61e00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7feb64160090 0x7feb6406b130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:50998/0 (socket says 172.21.15.17:50998) 2024-03-12T17:33:08.289 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.293+0000 7feb61e00640 1 -- 172.21.15.17:0/2821061503 learned_addr learned my addr 172.21.15.17:0/2821061503 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:33:08.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.293+0000 7feb61400640 1 --2- 172.21.15.17:0/2821061503 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feb640b86c0 0x7feb640b4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:08.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.293+0000 7feb62800640 1 --2- 172.21.15.17:0/2821061503 >> v2:172.21.15.94:3300/0 conn(0x7feb640b4950 0x7feb640d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:08.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.294+0000 7feb60a00640 1 -- 172.21.15.17:0/2821061503 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2106220365 0 0) 0x7feb54001110 con 0x7feb64160090 2024-03-12T17:33:08.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.294+0000 7feb60a00640 1 -- 172.21.15.17:0/2821061503 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb48003520 con 0x7feb64160090 2024-03-12T17:33:08.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.294+0000 7feb60a00640 1 -- 172.21.15.17:0/2821061503 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1529130932 0 0) 0x7feb48003520 con 0x7feb64160090 2024-03-12T17:33:08.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.294+0000 7feb60a00640 1 -- 172.21.15.17:0/2821061503 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feb640b86c0 msgr2=0x7feb640b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:08.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.294+0000 7feb60a00640 1 --2- 172.21.15.17:0/2821061503 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feb640b86c0 0x7feb640b4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:08.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.294+0000 7feb60a00640 1 -- 172.21.15.17:0/2821061503 >> v2:172.21.15.94:3300/0 conn(0x7feb640b4950 msgr2=0x7feb640d1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:08.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.294+0000 7feb60a00640 1 --2- 172.21.15.17:0/2821061503 >> v2:172.21.15.94:3300/0 conn(0x7feb640b4950 0x7feb640d1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:08.291 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.294+0000 7feb60a00640 1 -- 172.21.15.17:0/2821061503 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb6406b840 con 0x7feb64160090 2024-03-12T17:33:08.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.294+0000 7feb60a00640 1 -- 172.21.15.17:0/2821061503 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7feb54001800 con 0x7feb64160090 2024-03-12T17:33:08.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.294+0000 7feb60a00640 1 -- 172.21.15.17:0/2821061503 >> v1:172.21.15.17:6789/0 conn(0x7feb64160090 legacy=0x7feb6406b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:08.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.294+0000 7feb60a00640 1 --2- 172.21.15.17:0/2821061503 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feb640b86c0 0x7feb48003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:08.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.294+0000 7feb60a00640 1 --2- 172.21.15.17:0/2821061503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb48003ef0 0x7feb480047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:08.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.294+0000 7feb60a00640 1 --2- 172.21.15.17:0/2821061503 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb48004d00 0x7feb48005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:08.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.294+0000 7feb60a00640 1 -- 172.21.15.17:0/2821061503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb640d0e40 con 0x7feb48003ef0 2024-03-12T17:33:08.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.294+0000 7feb60a00640 1 -- 172.21.15.17:0/2821061503 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb64160470 con 0x7feb48004d00 2024-03-12T17:33:08.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.294+0000 7feb60a00640 1 -- 172.21.15.17:0/2821061503 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb4800b9d0 con 0x7feb640b86c0 2024-03-12T17:33:08.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.294+0000 7feb61400640 1 --2- 172.21.15.17:0/2821061503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb48003ef0 0x7feb480047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:08.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.295+0000 7feb61e00640 1 --2- 172.21.15.17:0/2821061503 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feb640b86c0 0x7feb48003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:08.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.295+0000 7feb62800640 1 --2- 172.21.15.17:0/2821061503 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb48004d00 0x7feb48005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:08.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.295+0000 7feb61400640 1 -- 172.21.15.17:0/2821061503 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feb640b86c0 msgr2=0x7feb48003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:08.292 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.295+0000 7feb61400640 1 --2- 172.21.15.17:0/2821061503 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feb640b86c0 0x7feb48003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:08.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.295+0000 7feb61400640 1 -- 172.21.15.17:0/2821061503 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb48004d00 msgr2=0x7feb48005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:08.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.295+0000 7feb61400640 1 --2- 172.21.15.17:0/2821061503 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb48004d00 0x7feb48005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:08.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.295+0000 7feb61400640 1 -- 172.21.15.17:0/2821061503 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb48003520 con 0x7feb48003ef0 2024-03-12T17:33:08.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.297+0000 7feb61400640 1 --2- 172.21.15.17:0/2821061503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb48003ef0 0x7feb480047c0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7feb50009af0 tx=0x7feb480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaa833d067266e9b server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:08.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.297+0000 7feb60a00640 1 -- 172.21.15.17:0/2821061503 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5002c6b0 con 0x7feb48003ef0 2024-03-12T17:33:08.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.297+0000 7feb60a00640 1 -- 172.21.15.17:0/2821061503 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb5002c810 con 0x7feb48003ef0 2024-03-12T17:33:08.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.297+0000 7feb60a00640 1 -- 172.21.15.17:0/2821061503 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5002cba0 con 0x7feb48003ef0 2024-03-12T17:33:08.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.297+0000 7feb63200640 1 -- 172.21.15.17:0/2821061503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb48003ef0 msgr2=0x7feb480047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:08.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.297+0000 7feb63200640 1 --2- 172.21.15.17:0/2821061503 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb48003ef0 0x7feb480047c0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7feb50009af0 tx=0x7feb480057f0 comp rx=0 tx=0).stop 2024-03-12T17:33:08.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.298+0000 7feb62800640 1 -- 172.21.15.17:0/2821061503 reap_dead start 2024-03-12T17:33:08.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.298+0000 7feb63200640 1 -- 172.21.15.17:0/2821061503 shutdown_connections 2024-03-12T17:33:08.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.298+0000 7feb63200640 1 -- 172.21.15.17:0/2821061503 >> 172.21.15.17:0/2821061503 conn(0x7feb640cf5f0 msgr2=0x7feb640cfa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:08.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.298+0000 7feb63200640 1 -- 172.21.15.17:0/2821061503 shutdown_connections 2024-03-12T17:33:08.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.298+0000 7feb63200640 1 -- 172.21.15.17:0/2821061503 wait complete. 2024-03-12T17:33:08.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.300+0000 7feb63200640 1 Processor -- start 2024-03-12T17:33:08.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.300+0000 7feb63200640 1 -- start start 2024-03-12T17:33:08.297 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.301+0000 7feb63200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb48003ef0 0x7feb641581a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:08.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.301+0000 7feb63200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feb64159b10 0x7feb640c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:08.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.301+0000 7feb63200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb641f2030 0x7feb641f24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:08.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.301+0000 7feb63200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb641586e0 con 0x7feb48003ef0 2024-03-12T17:33:08.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.301+0000 7feb63200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb640ca3d0 con 0x7feb641f2030 2024-03-12T17:33:08.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.301+0000 7feb63200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb640ca6b0 con 0x7feb64159b10 2024-03-12T17:33:08.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.301+0000 7feb61e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb48003ef0 0x7feb641581a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:08.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.301+0000 7feb61e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb48003ef0 0x7feb641581a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49122/0 (socket says 172.21.15.17:49122) 2024-03-12T17:33:08.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.301+0000 7feb61e00640 1 -- 172.21.15.17:0/800340879 learned_addr learned my addr 172.21.15.17:0/800340879 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:08.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.301+0000 7feb61400640 1 --2- 172.21.15.17:0/800340879 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feb64159b10 0x7feb640c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:08.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.301+0000 7feb62800640 1 --2- 172.21.15.17:0/800340879 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb641f2030 0x7feb641f24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:08.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.301+0000 7feb61e00640 1 -- 172.21.15.17:0/800340879 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feb64159b10 msgr2=0x7feb640c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:08.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.302+0000 7feb61e00640 1 --2- 172.21.15.17:0/800340879 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feb64159b10 0x7feb640c9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:08.298 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.302+0000 7feb61e00640 1 -- 172.21.15.17:0/800340879 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb641f2030 msgr2=0x7feb641f24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:08.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.302+0000 7feb61e00640 1 --2- 172.21.15.17:0/800340879 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb641f2030 0x7feb641f24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:08.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.302+0000 7feb61e00640 1 -- 172.21.15.17:0/800340879 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb640ca990 con 0x7feb48003ef0 2024-03-12T17:33:08.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.302+0000 7feb61e00640 1 --2- 172.21.15.17:0/800340879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb48003ef0 0x7feb641581a0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7feb54001eb0 tx=0x7feb54007790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:08.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.302+0000 7feb5a000640 1 -- 172.21.15.17:0/800340879 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb54001830 con 0x7feb48003ef0 2024-03-12T17:33:08.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.302+0000 7feb5a000640 1 -- 172.21.15.17:0/800340879 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb5400e920 con 0x7feb48003ef0 2024-03-12T17:33:08.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.302+0000 7feb63200640 1 -- 172.21.15.17:0/800340879 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb640cac70 con 0x7feb48003ef0 2024-03-12T17:33:08.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.302+0000 7feb5a000640 1 -- 172.21.15.17:0/800340879 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5400ecd0 con 0x7feb48003ef0 2024-03-12T17:33:08.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.302+0000 7feb63200640 1 -- 172.21.15.17:0/800340879 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb640c9fa0 con 0x7feb48003ef0 2024-03-12T17:33:08.299 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.304+0000 7feb63200640 1 -- 172.21.15.17:0/800340879 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb64067120 con 0x7feb48003ef0 2024-03-12T17:33:08.300 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.305+0000 7feb5a000640 1 -- 172.21.15.17:0/800340879 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7feb54013420 con 0x7feb48003ef0 2024-03-12T17:33:08.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.306+0000 7feb5a000640 1 --2- 172.21.15.17:0/800340879 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7feb4406ac30 0x7feb4406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:08.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.306+0000 7feb5a000640 1 -- 172.21.15.17:0/800340879 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7feb54088fc0 con 0x7feb48003ef0 2024-03-12T17:33:08.301 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.306+0000 7feb61400640 1 --2- 172.21.15.17:0/800340879 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7feb4406ac30 0x7feb4406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:08.302 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.307+0000 7feb61400640 1 --2- 172.21.15.17:0/800340879 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7feb4406ac30 0x7feb4406d0f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7feb50036000 tx=0x7feb50030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:08.306 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.310+0000 7feb5a000640 1 -- 172.21.15.17:0/800340879 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7feb54054030 con 0x7feb48003ef0 2024-03-12T17:33:08.541 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.545+0000 7feb63200640 1 -- 172.21.15.17:0/800340879 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7feb64072360 con 0x7feb48003ef0 2024-03-12T17:33:08.542 INFO:tasks.ceph.mon.a.smithi017.stderr:2024-03-12T17:33:08.547+0000 7f30e5800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-12T17:33:08.558 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.562+0000 7feb5a000640 1 -- 172.21.15.17:0/800340879 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) v1 ==== 161+0+0 (secure 0 0 0) 0x7feb54057650 con 0x7feb48003ef0 2024-03-12T17:33:08.558 INFO:teuthology.orchestra.run.smithi017.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-12T17:33:08.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.565+0000 7feb63200640 1 -- 172.21.15.17:0/800340879 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7feb4406ac30 msgr2=0x7feb4406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:08.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.565+0000 7feb63200640 1 --2- 172.21.15.17:0/800340879 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7feb4406ac30 0x7feb4406d0f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7feb50036000 tx=0x7feb50030000 comp rx=0 tx=0).stop 2024-03-12T17:33:08.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.565+0000 7feb63200640 1 -- 172.21.15.17:0/800340879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb48003ef0 msgr2=0x7feb641581a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:08.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.565+0000 7feb63200640 1 --2- 172.21.15.17:0/800340879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb48003ef0 0x7feb641581a0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7feb54001eb0 tx=0x7feb54007790 comp rx=0 tx=0).stop 2024-03-12T17:33:08.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.566+0000 7feb63200640 1 -- 172.21.15.17:0/800340879 shutdown_connections 2024-03-12T17:33:08.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.566+0000 7feb63200640 1 --2- 172.21.15.17:0/800340879 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7feb4406ac30 0x7feb4406d0f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:08.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.566+0000 7feb63200640 1 --2- 172.21.15.17:0/800340879 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7feb641f2030 0x7feb641f24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:08.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.566+0000 7feb63200640 1 --2- 172.21.15.17:0/800340879 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7feb64159b10 0x7feb640c9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:08.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.566+0000 7feb63200640 1 --2- 172.21.15.17:0/800340879 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7feb48003ef0 0x7feb641581a0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:08.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.566+0000 7feb63200640 1 -- 172.21.15.17:0/800340879 >> 172.21.15.17:0/800340879 conn(0x7feb640cf5f0 msgr2=0x7feb640d30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:08.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.566+0000 7feb63200640 1 -- 172.21.15.17:0/800340879 shutdown_connections 2024-03-12T17:33:08.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.566+0000 7feb63200640 1 -- 172.21.15.17:0/800340879 wait complete. 2024-03-12T17:33:08.583 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-12T17:33:08.661 INFO:tasks.ceph.mds.c.smithi017.stdout:starting mds.c at 2024-03-12T17:33:08.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.788+0000 7f46b0a00640 1 Processor -- start 2024-03-12T17:33:08.783 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.788+0000 7f46b0a00640 1 -- start start 2024-03-12T17:33:08.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.789+0000 7f46b0a00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f46ac06c3f0 0x7f46ac0b3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:08.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.789+0000 7f46b0a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f46ac0b3780 0x7f46ac0ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:08.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.789+0000 7f46b0a00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46ac0cb340 con 0x7f46ac0ced90 2024-03-12T17:33:08.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.789+0000 7f46b0a00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46ac0b3bf0 con 0x7f46ac0b3780 2024-03-12T17:33:08.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.789+0000 7f46b0a00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46ac159d50 con 0x7f46ac06c3f0 2024-03-12T17:33:08.785 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.790+0000 7f46a9e00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f46ac0ced90 0x7f46ac0b1710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:51000/0 (socket says 172.21.15.17:51000) 2024-03-12T17:33:08.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.790+0000 7f46a9e00640 1 -- 172.21.15.17:0/894200781 learned_addr learned my addr 172.21.15.17:0/894200781 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:33:08.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.790+0000 7f46aa800640 1 --2- 172.21.15.17:0/894200781 >> v2:172.21.15.17:3300/0 conn(0x7f46ac0b3780 0x7f46ac0ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:08.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.790+0000 7f46a9400640 1 --2- 172.21.15.17:0/894200781 >> v2:172.21.15.94:3300/0 conn(0x7f46ac06c3f0 0x7f46ac0b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:08.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.790+0000 7f46a8a00640 1 -- 172.21.15.17:0/894200781 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1132956126 0 0) 0x7f46ac0cb340 con 0x7f46ac0ced90 2024-03-12T17:33:08.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.790+0000 7f46a8a00640 1 -- 172.21.15.17:0/894200781 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4690003520 con 0x7f46ac0ced90 2024-03-12T17:33:08.786 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.790+0000 7f46aa800640 1 -- 172.21.15.17:0/894200781 >> v2:172.21.15.94:3300/0 conn(0x7f46ac06c3f0 msgr2=0x7f46ac0b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:08.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.790+0000 7f46aa800640 1 --2- 172.21.15.17:0/894200781 >> v2:172.21.15.94:3300/0 conn(0x7f46ac06c3f0 0x7f46ac0b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:08.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.790+0000 7f46aa800640 1 -- 172.21.15.17:0/894200781 >> v1:172.21.15.17:6789/0 conn(0x7f46ac0ced90 legacy=0x7f46ac0b1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:08.787 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.790+0000 7f46aa800640 1 -- 172.21.15.17:0/894200781 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ac0b1ef0 con 0x7f46ac0b3780 2024-03-12T17:33:08.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.792+0000 7f46aa800640 1 --2- 172.21.15.17:0/894200781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46ac0b3780 0x7f46ac0ccd40 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f46ac0cc240 tx=0x7f46a402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6f6226f76f22c0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:08.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.792+0000 7f46a8a00640 1 -- 172.21.15.17:0/894200781 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a402cc80 con 0x7f46ac0b3780 2024-03-12T17:33:08.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.792+0000 7f46a8a00640 1 -- 172.21.15.17:0/894200781 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a402cde0 con 0x7f46ac0b3780 2024-03-12T17:33:08.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.792+0000 7f46a8a00640 1 -- 172.21.15.17:0/894200781 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a4034660 con 0x7f46ac0b3780 2024-03-12T17:33:08.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.792+0000 7f46b0a00640 1 -- 172.21.15.17:0/894200781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46ac0b3780 msgr2=0x7f46ac0ccd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:08.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.792+0000 7f46b0a00640 1 --2- 172.21.15.17:0/894200781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46ac0b3780 0x7f46ac0ccd40 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f46ac0cc240 tx=0x7f46a402bed0 comp rx=0 tx=0).stop 2024-03-12T17:33:08.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.793+0000 7f46b0a00640 1 -- 172.21.15.17:0/894200781 shutdown_connections 2024-03-12T17:33:08.788 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.793+0000 7f46b0a00640 1 --2- 172.21.15.17:0/894200781 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46ac0b3780 0x7f46ac0ccd40 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:08.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.793+0000 7f46b0a00640 1 --2- 172.21.15.17:0/894200781 >> v2:172.21.15.94:3300/0 conn(0x7f46ac06c3f0 0x7f46ac0b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:08.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.793+0000 7f46b0a00640 1 -- 172.21.15.17:0/894200781 >> 172.21.15.17:0/894200781 conn(0x7f46ac069ce0 msgr2=0x7f46ac06a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:08.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.793+0000 7f46b0a00640 1 -- 172.21.15.17:0/894200781 shutdown_connections 2024-03-12T17:33:08.789 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.793+0000 7f46b0a00640 1 -- 172.21.15.17:0/894200781 wait complete. 2024-03-12T17:33:08.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.795+0000 7f46b0a00640 1 Processor -- start 2024-03-12T17:33:08.790 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.795+0000 7f46b0a00640 1 -- start start 2024-03-12T17:33:08.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.796+0000 7f46b0a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f46ac06c3f0 0x7f46ac1f2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:08.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.796+0000 7f46b0a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46ac0b3780 0x7f46ac1efa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:08.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.796+0000 7f46b0a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46ac0ced90 0x7f46ac15b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:08.792 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.796+0000 7f46b0a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac156560 con 0x7f46ac0ced90 2024-03-12T17:33:08.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.796+0000 7f46b0a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac0abe90 con 0x7f46ac0b3780 2024-03-12T17:33:08.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.796+0000 7f46b0a00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac0ac170 con 0x7f46ac06c3f0 2024-03-12T17:33:08.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.797+0000 7f46aa800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46ac0ced90 0x7f46ac15b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:08.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.797+0000 7f46aa800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46ac0ced90 0x7f46ac15b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49166/0 (socket says 172.21.15.17:49166) 2024-03-12T17:33:08.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.797+0000 7f46aa800640 1 -- 172.21.15.17:0/3127871648 learned_addr learned my addr 172.21.15.17:0/3127871648 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:08.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.797+0000 7f46a9400640 1 --2- 172.21.15.17:0/3127871648 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46ac0b3780 0x7f46ac1efa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:08.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.797+0000 7f46a9e00640 1 --2- 172.21.15.17:0/3127871648 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f46ac06c3f0 0x7f46ac1f2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:08.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.797+0000 7f46aa800640 1 -- 172.21.15.17:0/3127871648 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f46ac06c3f0 msgr2=0x7f46ac1f2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:08.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.797+0000 7f46aa800640 1 --2- 172.21.15.17:0/3127871648 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f46ac06c3f0 0x7f46ac1f2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:08.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.797+0000 7f46aa800640 1 -- 172.21.15.17:0/3127871648 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46ac0b3780 msgr2=0x7f46ac1efa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:08.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.797+0000 7f46aa800640 1 --2- 172.21.15.17:0/3127871648 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46ac0b3780 0x7f46ac1efa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:08.793 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.797+0000 7f46aa800640 1 -- 172.21.15.17:0/3127871648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a4009a70 con 0x7f46ac0ced90 2024-03-12T17:33:08.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.797+0000 7f46aa800640 1 --2- 172.21.15.17:0/3127871648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46ac0ced90 0x7f46ac15b680 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f46a4009e80 tx=0x7f46a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:08.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.798+0000 7f46a2000640 1 -- 172.21.15.17:0/3127871648 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a4040650 con 0x7f46ac0ced90 2024-03-12T17:33:08.794 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.798+0000 7f46a2000640 1 -- 172.21.15.17:0/3127871648 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46a40407b0 con 0x7f46ac0ced90 2024-03-12T17:33:08.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.798+0000 7f46a2000640 1 -- 172.21.15.17:0/3127871648 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46a4040b60 con 0x7f46ac0ced90 2024-03-12T17:33:08.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.798+0000 7f46b0a00640 1 -- 172.21.15.17:0/3127871648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46ac0ac450 con 0x7f46ac0ced90 2024-03-12T17:33:08.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.798+0000 7f46b0a00640 1 -- 172.21.15.17:0/3127871648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46ac14d6c0 con 0x7f46ac0ced90 2024-03-12T17:33:08.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.799+0000 7f46b0a00640 1 -- 172.21.15.17:0/3127871648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46ac156710 con 0x7f46ac0ced90 2024-03-12T17:33:08.795 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.800+0000 7f46a2000640 1 -- 172.21.15.17:0/3127871648 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f46a4040cc0 con 0x7f46ac0ced90 2024-03-12T17:33:08.796 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.801+0000 7f46a2000640 1 --2- 172.21.15.17:0/3127871648 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f468806ac00 0x7f468806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:08.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.801+0000 7f46a2000640 1 -- 172.21.15.17:0/3127871648 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f46a40ac100 con 0x7f46ac0ced90 2024-03-12T17:33:08.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.801+0000 7f46a9e00640 1 --2- 172.21.15.17:0/3127871648 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f468806ac00 0x7f468806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:08.797 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.802+0000 7f46a9e00640 1 --2- 172.21.15.17:0/3127871648 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f468806ac00 0x7f468806d0c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f469c0011e0 tx=0x7f469c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:08.801 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:08.806+0000 7f46a2000640 1 -- 172.21.15.17:0/3127871648 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f46ac156710 con 0x7f46ac0ced90 2024-03-12T17:33:09.041 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.045+0000 7f46b0a00640 1 -- 172.21.15.17:0/3127871648 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f46ac0ad750 con 0x7f46ac0ced90 2024-03-12T17:33:09.564 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.569+0000 7f46a2000640 1 -- 172.21.15.17:0/3127871648 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) v1 ==== 104+0+0 (secure 0 0 0) 0x7f46a4077360 con 0x7f46ac0ced90 2024-03-12T17:33:09.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.573+0000 7f46b0a00640 1 -- 172.21.15.17:0/3127871648 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f468806ac00 msgr2=0x7f468806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:09.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.573+0000 7f46b0a00640 1 --2- 172.21.15.17:0/3127871648 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f468806ac00 0x7f468806d0c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f469c0011e0 tx=0x7f469c009040 comp rx=0 tx=0).stop 2024-03-12T17:33:09.568 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.573+0000 7f46b0a00640 1 -- 172.21.15.17:0/3127871648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46ac0ced90 msgr2=0x7f46ac15b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:09.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.573+0000 7f46b0a00640 1 --2- 172.21.15.17:0/3127871648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46ac0ced90 0x7f46ac15b680 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f46a4009e80 tx=0x7f46a4004a40 comp rx=0 tx=0).stop 2024-03-12T17:33:09.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.573+0000 7f46b0a00640 1 -- 172.21.15.17:0/3127871648 shutdown_connections 2024-03-12T17:33:09.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.573+0000 7f46b0a00640 1 --2- 172.21.15.17:0/3127871648 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f468806ac00 0x7f468806d0c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:09.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.573+0000 7f46b0a00640 1 --2- 172.21.15.17:0/3127871648 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f46ac0ced90 0x7f46ac15b680 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:09.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.573+0000 7f46b0a00640 1 --2- 172.21.15.17:0/3127871648 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f46ac0b3780 0x7f46ac1efa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:09.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.573+0000 7f46b0a00640 1 --2- 172.21.15.17:0/3127871648 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f46ac06c3f0 0x7f46ac1f2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:09.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.573+0000 7f46b0a00640 1 -- 172.21.15.17:0/3127871648 >> 172.21.15.17:0/3127871648 conn(0x7f46ac069ce0 msgr2=0x7f46ac0b14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:09.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.573+0000 7f46b0a00640 1 -- 172.21.15.17:0/3127871648 shutdown_connections 2024-03-12T17:33:09.569 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.573+0000 7f46b0a00640 1 -- 172.21.15.17:0/3127871648 wait complete. 2024-03-12T17:33:09.589 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-12T17:33:09.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.815+0000 7f1a79c00640 1 Processor -- start 2024-03-12T17:33:09.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.815+0000 7f1a79c00640 1 -- start start 2024-03-12T17:33:09.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.816+0000 7f1a79c00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1a7415c9b0 0x7f1a740cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:09.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.816+0000 7f1a79c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a7415cd90 0x7f1a740cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:09.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.816+0000 7f1a79c00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a740b8520 con 0x7f1a74160730 2024-03-12T17:33:09.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.816+0000 7f1a79c00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a741615f0 con 0x7f1a7415c9b0 2024-03-12T17:33:09.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.816+0000 7f1a79c00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a74161310 con 0x7f1a7415cd90 2024-03-12T17:33:09.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.817+0000 7f1a73e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f1a7415c9b0 0x7f1a740cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:09.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.817+0000 7f1a73400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a7415cd90 0x7f1a740cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:09.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.817+0000 7f1a73400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a7415cd90 0x7f1a740cf810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.17:60686/0 (socket says 172.21.15.17:60686) 2024-03-12T17:33:09.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.817+0000 7f1a73400640 1 -- 172.21.15.17:0/192161530 learned_addr learned my addr 172.21.15.17:0/192161530 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:09.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.818+0000 7f1a73e00640 1 -- 172.21.15.17:0/192161530 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a7415cd90 msgr2=0x7f1a740cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:09.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.818+0000 7f1a73e00640 1 --2- 172.21.15.17:0/192161530 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a7415cd90 0x7f1a740cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:09.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.818+0000 7f1a73e00640 1 -- 172.21.15.17:0/192161530 >> v1:172.21.15.94:6789/0 conn(0x7f1a74160730 legacy=0x7f1a740b4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:09.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.818+0000 7f1a73e00640 1 -- 172.21.15.17:0/192161530 --> v2:172.21.15.94:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a740d0a70 con 0x7f1a7415c9b0 2024-03-12T17:33:09.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.818+0000 7f1a73400640 1 --2- 172.21.15.17:0/192161530 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a7415cd90 0x7f1a740cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-12T17:33:09.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.819+0000 7f1a73e00640 1 --2- 172.21.15.17:0/192161530 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a7415c9b0 0x7f1a740cf2d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1a640097a0 tx=0x7f1a6402b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80e5277c05742d9a server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:09.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.820+0000 7f1a72a00640 1 -- 172.21.15.17:0/192161530 <== mon.1 v2:172.21.15.94:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a64031780 con 0x7f1a7415c9b0 2024-03-12T17:33:09.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.820+0000 7f1a72a00640 1 -- 172.21.15.17:0/192161530 <== mon.1 v2:172.21.15.94:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a640318e0 con 0x7f1a7415c9b0 2024-03-12T17:33:09.816 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.820+0000 7f1a72a00640 1 -- 172.21.15.17:0/192161530 <== mon.1 v2:172.21.15.94:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a64031c70 con 0x7f1a7415c9b0 2024-03-12T17:33:09.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.821+0000 7f1a79c00640 1 -- 172.21.15.17:0/192161530 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a7415c9b0 msgr2=0x7f1a740cf2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:09.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.821+0000 7f1a79c00640 1 --2- 172.21.15.17:0/192161530 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a7415c9b0 0x7f1a740cf2d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1a640097a0 tx=0x7f1a6402b820 comp rx=0 tx=0).stop 2024-03-12T17:33:09.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.821+0000 7f1a79c00640 1 -- 172.21.15.17:0/192161530 shutdown_connections 2024-03-12T17:33:09.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.821+0000 7f1a79c00640 1 --2- 172.21.15.17:0/192161530 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a7415cd90 0x7f1a740cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:09.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.821+0000 7f1a79c00640 1 --2- 172.21.15.17:0/192161530 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a7415c9b0 0x7f1a740cf2d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:09.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.821+0000 7f1a79c00640 1 -- 172.21.15.17:0/192161530 >> 172.21.15.17:0/192161530 conn(0x7f1a7406b160 msgr2=0x7f1a7406b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:09.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.821+0000 7f1a79c00640 1 -- 172.21.15.17:0/192161530 shutdown_connections 2024-03-12T17:33:09.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.821+0000 7f1a79c00640 1 -- 172.21.15.17:0/192161530 wait complete. 2024-03-12T17:33:09.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.823+0000 7f1a79c00640 1 Processor -- start 2024-03-12T17:33:09.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.823+0000 7f1a79c00640 1 -- start start 2024-03-12T17:33:09.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.824+0000 7f1a79c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a7415c9b0 0x7f1a74157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:09.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.824+0000 7f1a79c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a7415cd90 0x7f1a740b4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:09.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.824+0000 7f1a79c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a74160730 0x7f1a740b7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:09.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.824+0000 7f1a79c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a740b3270 con 0x7f1a7415c9b0 2024-03-12T17:33:09.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.824+0000 7f1a79c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7415db60 con 0x7f1a7415cd90 2024-03-12T17:33:09.821 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.824+0000 7f1a79c00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a740b4850 con 0x7f1a74160730 2024-03-12T17:33:09.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.824+0000 7f1a73e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a7415c9b0 0x7f1a74157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:09.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.824+0000 7f1a73e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a7415c9b0 0x7f1a74157eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49174/0 (socket says 172.21.15.17:49174) 2024-03-12T17:33:09.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.824+0000 7f1a73e00640 1 -- 172.21.15.17:0/2696184224 learned_addr learned my addr 172.21.15.17:0/2696184224 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:09.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.825+0000 7f1a79200640 1 --2- 172.21.15.17:0/2696184224 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a74160730 0x7f1a740b7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:09.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.825+0000 7f1a73400640 1 --2- 172.21.15.17:0/2696184224 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a7415cd90 0x7f1a740b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:09.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.825+0000 7f1a73e00640 1 -- 172.21.15.17:0/2696184224 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a74160730 msgr2=0x7f1a740b7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:09.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.825+0000 7f1a73e00640 1 --2- 172.21.15.17:0/2696184224 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a74160730 0x7f1a740b7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:09.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.825+0000 7f1a73e00640 1 -- 172.21.15.17:0/2696184224 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a7415cd90 msgr2=0x7f1a740b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:09.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.825+0000 7f1a73e00640 1 --2- 172.21.15.17:0/2696184224 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a7415cd90 0x7f1a740b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:09.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.825+0000 7f1a73e00640 1 -- 172.21.15.17:0/2696184224 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5c0094d0 con 0x7f1a7415c9b0 2024-03-12T17:33:09.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.825+0000 7f1a73400640 1 --2- 172.21.15.17:0/2696184224 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a7415cd90 0x7f1a740b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:33:09.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.825+0000 7f1a73e00640 1 --2- 172.21.15.17:0/2696184224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a7415c9b0 0x7f1a74157eb0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f1a640098c0 tx=0x7f1a640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:09.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.825+0000 7f1a6be00640 1 -- 172.21.15.17:0/2696184224 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a64032820 con 0x7f1a7415c9b0 2024-03-12T17:33:09.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.826+0000 7f1a6be00640 1 -- 172.21.15.17:0/2696184224 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a64032980 con 0x7f1a7415c9b0 2024-03-12T17:33:09.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.826+0000 7f1a6be00640 1 -- 172.21.15.17:0/2696184224 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a64032d30 con 0x7f1a7415c9b0 2024-03-12T17:33:09.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.826+0000 7f1a79c00640 1 -- 172.21.15.17:0/2696184224 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a64009400 con 0x7f1a7415c9b0 2024-03-12T17:33:09.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.826+0000 7f1a79c00640 1 -- 172.21.15.17:0/2696184224 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a740b2940 con 0x7f1a7415c9b0 2024-03-12T17:33:09.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.827+0000 7f1a79c00640 1 -- 172.21.15.17:0/2696184224 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a74072360 con 0x7f1a7415c9b0 2024-03-12T17:33:09.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.828+0000 7f1a6be00640 1 -- 172.21.15.17:0/2696184224 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f1a6404e440 con 0x7f1a7415c9b0 2024-03-12T17:33:09.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.828+0000 7f1a6be00640 1 --2- 172.21.15.17:0/2696184224 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f1a5006ac00 0x7f1a5006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:09.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.829+0000 7f1a6be00640 1 -- 172.21.15.17:0/2696184224 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f1a640ab4b0 con 0x7f1a7415c9b0 2024-03-12T17:33:09.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.829+0000 7f1a73400640 1 --2- 172.21.15.17:0/2696184224 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f1a5006ac00 0x7f1a5006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:09.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.830+0000 7f1a73400640 1 --2- 172.21.15.17:0/2696184224 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f1a5006ac00 0x7f1a5006d0c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1a7415d350 tx=0x7f1a5c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:09.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:09.834+0000 7f1a6be00640 1 -- 172.21.15.17:0/2696184224 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f1a64076710 con 0x7f1a7415c9b0 2024-03-12T17:33:10.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:10.033+0000 7f1a79c00640 1 -- 172.21.15.17:0/2696184224 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1a7404e030 con 0x7f1a7415c9b0 2024-03-12T17:33:10.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:10.927+0000 7f1a6be00640 1 -- 172.21.15.17:0/2696184224 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v51) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1a64079d30 con 0x7f1a7415c9b0 2024-03-12T17:33:10.923 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_metadata' removed 2024-03-12T17:33:10.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:10.931+0000 7f1a79c00640 1 -- 172.21.15.17:0/2696184224 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f1a5006ac00 msgr2=0x7f1a5006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:10.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:10.931+0000 7f1a79c00640 1 --2- 172.21.15.17:0/2696184224 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f1a5006ac00 0x7f1a5006d0c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1a7415d350 tx=0x7f1a5c008040 comp rx=0 tx=0).stop 2024-03-12T17:33:10.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:10.931+0000 7f1a79c00640 1 -- 172.21.15.17:0/2696184224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a7415c9b0 msgr2=0x7f1a74157eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:10.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:10.931+0000 7f1a79c00640 1 --2- 172.21.15.17:0/2696184224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a7415c9b0 0x7f1a74157eb0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f1a640098c0 tx=0x7f1a640046c0 comp rx=0 tx=0).stop 2024-03-12T17:33:10.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:10.932+0000 7f1a79c00640 1 -- 172.21.15.17:0/2696184224 shutdown_connections 2024-03-12T17:33:10.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:10.932+0000 7f1a79c00640 1 --2- 172.21.15.17:0/2696184224 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f1a5006ac00 0x7f1a5006d0c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:10.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:10.932+0000 7f1a79c00640 1 --2- 172.21.15.17:0/2696184224 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f1a74160730 0x7f1a740b7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:10.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:10.932+0000 7f1a79c00640 1 --2- 172.21.15.17:0/2696184224 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f1a7415cd90 0x7f1a740b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:10.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:10.932+0000 7f1a79c00640 1 --2- 172.21.15.17:0/2696184224 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f1a7415c9b0 0x7f1a74157eb0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:10.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:10.932+0000 7f1a79c00640 1 -- 172.21.15.17:0/2696184224 >> 172.21.15.17:0/2696184224 conn(0x7f1a7406b160 msgr2=0x7f1a740c6690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:10.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:10.932+0000 7f1a79c00640 1 -- 172.21.15.17:0/2696184224 shutdown_connections 2024-03-12T17:33:10.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:10.932+0000 7f1a79c00640 1 -- 172.21.15.17:0/2696184224 wait complete. 2024-03-12T17:33:10.950 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-12T17:33:11.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.178+0000 7ff667600640 1 Processor -- start 2024-03-12T17:33:11.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.178+0000 7ff667600640 1 -- start start 2024-03-12T17:33:11.175 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.180+0000 7ff667600640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7ff6600cb720 0x7ff66006d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:11.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.180+0000 7ff667600640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff66015e380 con 0x7ff660153d50 2024-03-12T17:33:11.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.180+0000 7ff667600640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6600b2ae0 con 0x7ff660154130 2024-03-12T17:33:11.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.180+0000 7ff667600640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff66015df60 con 0x7ff6600cb720 2024-03-12T17:33:11.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.180+0000 7ff664c00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7ff660153d50 0x7ff6600b2060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:51010/0 (socket says 172.21.15.17:51010) 2024-03-12T17:33:11.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.180+0000 7ff664c00640 1 -- 172.21.15.17:0/1343624642 learned_addr learned my addr 172.21.15.17:0/1343624642 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:33:11.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.181+0000 7ff665600640 1 --2- 172.21.15.17:0/1343624642 >> v2:172.21.15.94:3300/0 conn(0x7ff6600cb720 0x7ff66006d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:11.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.181+0000 7ff65fe00640 1 -- 172.21.15.17:0/1343624642 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3449756499 0 0) 0x7ff66015e380 con 0x7ff660153d50 2024-03-12T17:33:11.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.181+0000 7ff65fe00640 1 -- 172.21.15.17:0/1343624642 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff640005730 con 0x7ff660153d50 2024-03-12T17:33:11.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.181+0000 7ff65fe00640 1 -- 172.21.15.17:0/1343624642 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1519285529 0 0) 0x7ff640005730 con 0x7ff660153d50 2024-03-12T17:33:11.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.181+0000 7ff65fe00640 1 -- 172.21.15.17:0/1343624642 >> v2:172.21.15.94:3300/0 conn(0x7ff6600cb720 msgr2=0x7ff66006d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:11.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.181+0000 7ff65fe00640 1 --2- 172.21.15.17:0/1343624642 >> v2:172.21.15.94:3300/0 conn(0x7ff6600cb720 0x7ff66006d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:11.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.181+0000 7ff65fe00640 1 -- 172.21.15.17:0/1343624642 >> v1:172.21.15.94:6789/0 conn(0x7ff660154130 legacy=0x7ff6600cb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:11.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.181+0000 7ff65fe00640 1 -- 172.21.15.17:0/1343624642 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66015d5c0 con 0x7ff660153d50 2024-03-12T17:33:11.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.181+0000 7ff65fe00640 1 -- 172.21.15.17:0/1343624642 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7ff650001670 con 0x7ff660153d50 2024-03-12T17:33:11.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.181+0000 7ff65fe00640 1 -- 172.21.15.17:0/1343624642 >> v1:172.21.15.17:6789/0 conn(0x7ff660153d50 legacy=0x7ff6600b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:11.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.181+0000 7ff65fe00640 1 --2- 172.21.15.17:0/1343624642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff640005bd0 0x7ff640005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:11.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.181+0000 7ff65fe00640 1 --2- 172.21.15.17:0/1343624642 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6400069d0 0x7ff640006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:11.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.181+0000 7ff65fe00640 1 --2- 172.21.15.17:0/1343624642 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff6400073e0 0x7ff64000db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:11.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.181+0000 7ff65fe00640 1 -- 172.21.15.17:0/1343624642 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66015df60 con 0x7ff640005bd0 2024-03-12T17:33:11.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.181+0000 7ff65fe00640 1 -- 172.21.15.17:0/1343624642 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64000e330 con 0x7ff6400069d0 2024-03-12T17:33:11.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.181+0000 7ff65fe00640 1 -- 172.21.15.17:0/1343624642 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff64000e4f0 con 0x7ff6400073e0 2024-03-12T17:33:11.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.181+0000 7ff664c00640 1 --2- 172.21.15.17:0/1343624642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff640005bd0 0x7ff640005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:11.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.182+0000 7ff657e00640 1 --2- 172.21.15.17:0/1343624642 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6400069d0 0x7ff640006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:11.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.182+0000 7ff665600640 1 --2- 172.21.15.17:0/1343624642 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff6400073e0 0x7ff64000db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:11.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.182+0000 7ff664c00640 1 -- 172.21.15.17:0/1343624642 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff6400073e0 msgr2=0x7ff64000db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:11.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.182+0000 7ff664c00640 1 --2- 172.21.15.17:0/1343624642 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff6400073e0 0x7ff64000db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:11.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.182+0000 7ff664c00640 1 -- 172.21.15.17:0/1343624642 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6400069d0 msgr2=0x7ff640006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:11.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.182+0000 7ff664c00640 1 --2- 172.21.15.17:0/1343624642 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff6400069d0 0x7ff640006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:11.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.182+0000 7ff664c00640 1 -- 172.21.15.17:0/1343624642 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff640005730 con 0x7ff640005bd0 2024-03-12T17:33:11.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.182+0000 7ff665600640 1 -- 172.21.15.17:0/1343624642 reap_dead start 2024-03-12T17:33:11.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.183+0000 7ff664c00640 1 --2- 172.21.15.17:0/1343624642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff640005bd0 0x7ff640005ff0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7ff65000c0e0 tx=0x7ff640007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fba790797d67683 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:11.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.184+0000 7ff65fe00640 1 -- 172.21.15.17:0/1343624642 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff650005ad0 con 0x7ff640005bd0 2024-03-12T17:33:11.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.184+0000 7ff65fe00640 1 -- 172.21.15.17:0/1343624642 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff650005c30 con 0x7ff640005bd0 2024-03-12T17:33:11.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.184+0000 7ff65fe00640 1 -- 172.21.15.17:0/1343624642 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65002ca00 con 0x7ff640005bd0 2024-03-12T17:33:11.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.184+0000 7ff667600640 1 -- 172.21.15.17:0/1343624642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff640005bd0 msgr2=0x7ff640005ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:11.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.184+0000 7ff667600640 1 --2- 172.21.15.17:0/1343624642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff640005bd0 0x7ff640005ff0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7ff65000c0e0 tx=0x7ff640007a00 comp rx=0 tx=0).stop 2024-03-12T17:33:11.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.184+0000 7ff667600640 1 -- 172.21.15.17:0/1343624642 shutdown_connections 2024-03-12T17:33:11.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.184+0000 7ff667600640 1 --2- 172.21.15.17:0/1343624642 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff640005bd0 0x7ff640005ff0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:11.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.184+0000 7ff667600640 1 -- 172.21.15.17:0/1343624642 >> 172.21.15.17:0/1343624642 conn(0x7ff660069ce0 msgr2=0x7ff66006a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:11.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.184+0000 7ff667600640 1 -- 172.21.15.17:0/1343624642 shutdown_connections 2024-03-12T17:33:11.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.185+0000 7ff667600640 1 -- 172.21.15.17:0/1343624642 wait complete. 2024-03-12T17:33:11.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.186+0000 7ff667600640 1 Processor -- start 2024-03-12T17:33:11.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.186+0000 7ff667600640 1 -- start start 2024-03-12T17:33:11.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.187+0000 7ff667600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff640005bd0 0x7ff66014e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:11.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.187+0000 7ff667600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff66014f570 0x7ff66015bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:11.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.187+0000 7ff667600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff66014eed0 0x7ff66015c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:11.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.188+0000 7ff667600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6600afd20 con 0x7ff66014f570 2024-03-12T17:33:11.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.188+0000 7ff667600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6600b1640 con 0x7ff66014eed0 2024-03-12T17:33:11.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.188+0000 7ff667600640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6600b0ac0 con 0x7ff640005bd0 2024-03-12T17:33:11.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.188+0000 7ff657e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff66014f570 0x7ff66015bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:11.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.188+0000 7ff657e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff66014f570 0x7ff66015bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:49184/0 (socket says 172.21.15.17:49184) 2024-03-12T17:33:11.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.188+0000 7ff657e00640 1 -- 172.21.15.17:0/2530838594 learned_addr learned my addr 172.21.15.17:0/2530838594 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:11.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.188+0000 7ff664c00640 1 --2- 172.21.15.17:0/2530838594 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff640005bd0 0x7ff66014e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:11.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.188+0000 7ff657e00640 1 -- 172.21.15.17:0/2530838594 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff640005bd0 msgr2=0x7ff66014e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:11.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.188+0000 7ff665600640 1 --2- 172.21.15.17:0/2530838594 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff66014eed0 0x7ff66015c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:11.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.188+0000 7ff657e00640 1 --2- 172.21.15.17:0/2530838594 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff640005bd0 0x7ff66014e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:11.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.188+0000 7ff657e00640 1 -- 172.21.15.17:0/2530838594 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff66014eed0 msgr2=0x7ff66015c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:11.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.188+0000 7ff657e00640 1 --2- 172.21.15.17:0/2530838594 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff66014eed0 0x7ff66015c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:11.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.188+0000 7ff657e00640 1 -- 172.21.15.17:0/2530838594 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6600b0da0 con 0x7ff66014f570 2024-03-12T17:33:11.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.188+0000 7ff664c00640 1 --2- 172.21.15.17:0/2530838594 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff640005bd0 0x7ff66014e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:33:11.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.189+0000 7ff657e00640 1 --2- 172.21.15.17:0/2530838594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff66014f570 0x7ff66015bc50 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ff64800e4d0 tx=0x7ff64800e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:11.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.189+0000 7ff65d600640 1 -- 172.21.15.17:0/2530838594 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6480052e0 con 0x7ff66014f570 2024-03-12T17:33:11.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.189+0000 7ff65d600640 1 -- 172.21.15.17:0/2530838594 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff648005440 con 0x7ff66014f570 2024-03-12T17:33:11.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.189+0000 7ff667600640 1 -- 172.21.15.17:0/2530838594 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6600b1080 con 0x7ff66014f570 2024-03-12T17:33:11.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.189+0000 7ff65d600640 1 -- 172.21.15.17:0/2530838594 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6480037f0 con 0x7ff66014f570 2024-03-12T17:33:11.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.189+0000 7ff667600640 1 -- 172.21.15.17:0/2530838594 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff66014eb60 con 0x7ff66014f570 2024-03-12T17:33:11.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.190+0000 7ff667600640 1 -- 172.21.15.17:0/2530838594 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff66014ecf0 con 0x7ff66014f570 2024-03-12T17:33:11.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.191+0000 7ff65d600640 1 -- 172.21.15.17:0/2530838594 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7ff648003950 con 0x7ff66014f570 2024-03-12T17:33:11.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.192+0000 7ff65d600640 1 --2- 172.21.15.17:0/2530838594 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ff63c06ac30 0x7ff63c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:11.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.193+0000 7ff65d600640 1 -- 172.21.15.17:0/2530838594 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5415+0+0 (secure 0 0 0) 0x7ff648088fa0 con 0x7ff66014f570 2024-03-12T17:33:11.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.193+0000 7ff664c00640 1 --2- 172.21.15.17:0/2530838594 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ff63c06ac30 0x7ff63c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:11.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.193+0000 7ff664c00640 1 --2- 172.21.15.17:0/2530838594 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ff63c06ac30 0x7ff63c06d0f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff650034000 tx=0x7ff650009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:11.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.197+0000 7ff65d600640 1 -- 172.21.15.17:0/2530838594 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7ff648054290 con 0x7ff66014f570 2024-03-12T17:33:11.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.396+0000 7ff667600640 1 -- 172.21.15.17:0/2530838594 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff66006ac40 con 0x7ff66014f570 2024-03-12T17:33:11.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.931+0000 7ff65d600640 1 -- 172.21.15.17:0/2530838594 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v52) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff6480578b0 con 0x7ff66014f570 2024-03-12T17:33:11.930 INFO:teuthology.orchestra.run.smithi017.stderr:pool 'cephfs_data' removed 2024-03-12T17:33:11.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.939+0000 7ff667600640 1 -- 172.21.15.17:0/2530838594 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ff63c06ac30 msgr2=0x7ff63c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:11.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.939+0000 7ff667600640 1 --2- 172.21.15.17:0/2530838594 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ff63c06ac30 0x7ff63c06d0f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff650034000 tx=0x7ff650009030 comp rx=0 tx=0).stop 2024-03-12T17:33:11.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.939+0000 7ff667600640 1 -- 172.21.15.17:0/2530838594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff66014f570 msgr2=0x7ff66015bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:11.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.939+0000 7ff667600640 1 --2- 172.21.15.17:0/2530838594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff66014f570 0x7ff66015bc50 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ff64800e4d0 tx=0x7ff64800e990 comp rx=0 tx=0).stop 2024-03-12T17:33:11.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.940+0000 7ff667600640 1 -- 172.21.15.17:0/2530838594 shutdown_connections 2024-03-12T17:33:11.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.940+0000 7ff667600640 1 --2- 172.21.15.17:0/2530838594 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ff63c06ac30 0x7ff63c06d0f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:11.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.940+0000 7ff667600640 1 --2- 172.21.15.17:0/2530838594 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff66014eed0 0x7ff66015c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:11.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.940+0000 7ff667600640 1 --2- 172.21.15.17:0/2530838594 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff66014f570 0x7ff66015bc50 secure :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7ff64800e4d0 tx=0x7ff64800e990 comp rx=0 tx=0).stop 2024-03-12T17:33:11.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.940+0000 7ff667600640 1 --2- 172.21.15.17:0/2530838594 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff640005bd0 0x7ff66014e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:11.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.940+0000 7ff667600640 1 -- 172.21.15.17:0/2530838594 >> 172.21.15.17:0/2530838594 conn(0x7ff660069ce0 msgr2=0x7ff660159f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:11.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.941+0000 7ff667600640 1 -- 172.21.15.17:0/2530838594 shutdown_connections 2024-03-12T17:33:11.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:11.941+0000 7ff667600640 1 -- 172.21.15.17:0/2530838594 wait complete. 2024-03-12T17:33:11.965 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-03-12T17:33:12.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.178+0000 7f2813e00640 1 Processor -- start 2024-03-12T17:33:12.174 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.178+0000 7f2813e00640 1 -- start start 2024-03-12T17:33:12.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.180+0000 7f2813e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2814140570 0x7f2814165400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:12.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.180+0000 7f2813e00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f281415bd70 con 0x7f2814070ba0 2024-03-12T17:33:12.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.180+0000 7f2813e00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2814070f80 con 0x7f28140ccea0 2024-03-12T17:33:12.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.180+0000 7f2813e00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2814140e80 con 0x7f2814140570 2024-03-12T17:33:12.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.180+0000 7f2813400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f2814140570 0x7f2814165400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:12.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.180+0000 7f2812a00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f2814070ba0 0x7f28140cc790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37576/0 (socket says 172.21.15.17:37576) 2024-03-12T17:33:12.176 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.180+0000 7f2812a00640 1 -- 172.21.15.17:0/1620640890 learned_addr learned my addr 172.21.15.17:0/1620640890 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:33:12.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.181+0000 7f2813400640 1 -- 172.21.15.17:0/1620640890 >> v1:172.21.15.94:6789/0 conn(0x7f28140ccea0 legacy=0x7f281413fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:12.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.181+0000 7f2813400640 1 -- 172.21.15.17:0/1620640890 >> v1:172.21.15.17:6789/0 conn(0x7f2814070ba0 legacy=0x7f28140cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:12.177 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.181+0000 7f2813400640 1 -- 172.21.15.17:0/1620640890 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f281415afd0 con 0x7f2814140570 2024-03-12T17:33:12.178 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.183+0000 7f2813400640 1 --2- 172.21.15.17:0/1620640890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2814140570 0x7f2814165400 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f280c0097a0 tx=0x7f280c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f172cfe88b97dc82 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:12.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.183+0000 7f2812000640 1 -- 172.21.15.17:0/1620640890 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280c02e070 con 0x7f2814140570 2024-03-12T17:33:12.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.183+0000 7f2812000640 1 -- 172.21.15.17:0/1620640890 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f280c0315a0 con 0x7f2814140570 2024-03-12T17:33:12.179 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.183+0000 7f2812000640 1 -- 172.21.15.17:0/1620640890 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280c031930 con 0x7f2814140570 2024-03-12T17:33:12.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.184+0000 7f2813e00640 1 -- 172.21.15.17:0/1620640890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2814140570 msgr2=0x7f2814165400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:12.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.184+0000 7f2813e00640 1 --2- 172.21.15.17:0/1620640890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2814140570 0x7f2814165400 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f280c0097a0 tx=0x7f280c02b840 comp rx=0 tx=0).stop 2024-03-12T17:33:12.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.184+0000 7f2813e00640 1 -- 172.21.15.17:0/1620640890 shutdown_connections 2024-03-12T17:33:12.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.184+0000 7f2813e00640 1 --2- 172.21.15.17:0/1620640890 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2814140570 0x7f2814165400 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:12.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.184+0000 7f2813e00640 1 -- 172.21.15.17:0/1620640890 >> 172.21.15.17:0/1620640890 conn(0x7f2814066000 msgr2=0x7f2814069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:12.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.184+0000 7f2813e00640 1 -- 172.21.15.17:0/1620640890 shutdown_connections 2024-03-12T17:33:12.180 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.184+0000 7f2813e00640 1 -- 172.21.15.17:0/1620640890 wait complete. 2024-03-12T17:33:12.181 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.186+0000 7f2813e00640 1 Processor -- start 2024-03-12T17:33:12.182 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.186+0000 7f2813e00640 1 -- start start 2024-03-12T17:33:12.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.187+0000 7f2813e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2814070ba0 0x7f28141e62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:12.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.187+0000 7f2813e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28140ccea0 0x7f28141571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:12.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.187+0000 7f2813e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2814140570 0x7f2814155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:12.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.187+0000 7f2813e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2814159cd0 con 0x7f28140ccea0 2024-03-12T17:33:12.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.187+0000 7f2813e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2814159050 con 0x7f2814070ba0 2024-03-12T17:33:12.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.187+0000 7f2813e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2814159330 con 0x7f2814140570 2024-03-12T17:33:12.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.188+0000 7f280a000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28140ccea0 0x7f28141571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:12.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.188+0000 7f280a000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28140ccea0 0x7f28141571a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35800/0 (socket says 172.21.15.17:35800) 2024-03-12T17:33:12.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.188+0000 7f280a000640 1 -- 172.21.15.17:0/738214480 learned_addr learned my addr 172.21.15.17:0/738214480 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:12.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.188+0000 7f2812a00640 1 --2- 172.21.15.17:0/738214480 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2814070ba0 0x7f28141e62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:12.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.188+0000 7f2813400640 1 --2- 172.21.15.17:0/738214480 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2814140570 0x7f2814155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:12.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.188+0000 7f280a000640 1 -- 172.21.15.17:0/738214480 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2814140570 msgr2=0x7f2814155480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:12.184 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.188+0000 7f280a000640 1 --2- 172.21.15.17:0/738214480 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2814140570 0x7f2814155480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:12.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.188+0000 7f280a000640 1 -- 172.21.15.17:0/738214480 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2814070ba0 msgr2=0x7f28141e62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:12.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.188+0000 7f280a000640 1 --2- 172.21.15.17:0/738214480 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2814070ba0 0x7f28141e62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:12.185 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.188+0000 7f280a000640 1 -- 172.21.15.17:0/738214480 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280c009400 con 0x7f28140ccea0 2024-03-12T17:33:12.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.189+0000 7f280a000640 1 --2- 172.21.15.17:0/738214480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28140ccea0 0x7f28141571a0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f27fc00c400 tx=0x7f27fc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:12.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.189+0000 7f280be00640 1 -- 172.21.15.17:0/738214480 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc011790 con 0x7f28140ccea0 2024-03-12T17:33:12.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.189+0000 7f280be00640 1 -- 172.21.15.17:0/738214480 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27fc011930 con 0x7f28140ccea0 2024-03-12T17:33:12.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.189+0000 7f280be00640 1 -- 172.21.15.17:0/738214480 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc011ce0 con 0x7f28140ccea0 2024-03-12T17:33:12.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.189+0000 7f2813e00640 1 -- 172.21.15.17:0/738214480 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2814159610 con 0x7f28140ccea0 2024-03-12T17:33:12.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.189+0000 7f2813e00640 1 -- 172.21.15.17:0/738214480 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f281413d150 con 0x7f28140ccea0 2024-03-12T17:33:12.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.190+0000 7f2813e00640 1 -- 172.21.15.17:0/738214480 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2814159e10 con 0x7f28140ccea0 2024-03-12T17:33:12.186 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.191+0000 7f280be00640 1 -- 172.21.15.17:0/738214480 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f27fc01c460 con 0x7f28140ccea0 2024-03-12T17:33:12.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.192+0000 7f280be00640 1 --2- 172.21.15.17:0/738214480 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f27f006ac00 0x7f27f006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:12.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.192+0000 7f280be00640 1 -- 172.21.15.17:0/738214480 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f27fc089010 con 0x7f28140ccea0 2024-03-12T17:33:12.188 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.193+0000 7f2812a00640 1 --2- 172.21.15.17:0/738214480 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f27f006ac00 0x7f27f006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:12.189 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.193+0000 7f2812a00640 1 --2- 172.21.15.17:0/738214480 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f27f006ac00 0x7f27f006d0c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2804005c00 tx=0x7f2804009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:12.192 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.197+0000 7f280be00640 1 -- 172.21.15.17:0/738214480 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f2814159e10 con 0x7f28140ccea0 2024-03-12T17:33:12.414 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.418+0000 7f2813e00640 1 -- 172.21.15.17:0/738214480 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f2814159e10 con 0x7f28140ccea0 2024-03-12T17:33:12.422 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.427+0000 7f280be00640 1 -- 172.21.15.17:0/738214480 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2814159e10 con 0x7f28140ccea0 2024-03-12T17:33:12.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.430+0000 7f2813e00640 1 -- 172.21.15.17:0/738214480 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f27f006ac00 msgr2=0x7f27f006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:12.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.430+0000 7f2813e00640 1 --2- 172.21.15.17:0/738214480 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f27f006ac00 0x7f27f006d0c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2804005c00 tx=0x7f2804009040 comp rx=0 tx=0).stop 2024-03-12T17:33:12.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.430+0000 7f2813e00640 1 -- 172.21.15.17:0/738214480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28140ccea0 msgr2=0x7f28141571a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:12.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.430+0000 7f2813e00640 1 --2- 172.21.15.17:0/738214480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28140ccea0 0x7f28141571a0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f27fc00c400 tx=0x7f27fc00c8c0 comp rx=0 tx=0).stop 2024-03-12T17:33:12.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.430+0000 7f2813e00640 1 -- 172.21.15.17:0/738214480 shutdown_connections 2024-03-12T17:33:12.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.430+0000 7f2813e00640 1 --2- 172.21.15.17:0/738214480 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f27f006ac00 0x7f27f006d0c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:12.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.430+0000 7f2813e00640 1 --2- 172.21.15.17:0/738214480 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f2814140570 0x7f2814155480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:12.426 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.430+0000 7f2813e00640 1 --2- 172.21.15.17:0/738214480 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f28140ccea0 0x7f28141571a0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:12.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.430+0000 7f2813e00640 1 --2- 172.21.15.17:0/738214480 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f2814070ba0 0x7f28141e62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:12.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.430+0000 7f2813e00640 1 -- 172.21.15.17:0/738214480 >> 172.21.15.17:0/738214480 conn(0x7f2814066000 msgr2=0x7f28140afd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:12.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.431+0000 7f2813e00640 1 -- 172.21.15.17:0/738214480 shutdown_connections 2024-03-12T17:33:12.427 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.431+0000 7f2813e00640 1 -- 172.21.15.17:0/738214480 wait complete. 2024-03-12T17:33:12.445 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_dump_tree.TestDumpTree.test_random' 2024-03-12T17:33:12.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.667+0000 7f3525600640 1 Processor -- start 2024-03-12T17:33:12.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.667+0000 7f3525600640 1 -- start start 2024-03-12T17:33:12.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.669+0000 7f3525600640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f35200cb930 0x7f35200b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:12.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.669+0000 7f3525600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f35200b23e0 0x7f35200cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:12.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.669+0000 7f3525600640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f35200cd850 0x7f35200b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:12.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.669+0000 7f3525600640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35200cc250 con 0x7f35200cb930 2024-03-12T17:33:12.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.669+0000 7f3525600640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35200ce1a0 con 0x7f35200cd850 2024-03-12T17:33:12.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.669+0000 7f3525600640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35200b1900 con 0x7f35200b23e0 2024-03-12T17:33:12.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.669+0000 7f351fe00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f35200cb930 0x7f35200b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:12.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.669+0000 7f351fe00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f35200cb930 0x7f35200b45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35802/0 (socket says 172.21.15.17:35802) 2024-03-12T17:33:12.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.669+0000 7f351fe00640 1 -- 172.21.15.17:0/2365980391 learned_addr learned my addr 172.21.15.17:0/2365980391 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:12.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.669+0000 7f351f400640 1 --2- 172.21.15.17:0/2365980391 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f35200b23e0 0x7f35200cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:12.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.669+0000 7f351fe00640 1 -- 172.21.15.17:0/2365980391 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f35200b23e0 msgr2=0x7f35200cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:12.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.669+0000 7f351fe00640 1 --2- 172.21.15.17:0/2365980391 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f35200b23e0 0x7f35200cbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:12.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.669+0000 7f3524c00640 1 --2- 172.21.15.17:0/2365980391 >> v2:172.21.15.94:3300/0 conn(0x7f35200cd850 0x7f35200b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:12.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.669+0000 7f351fe00640 1 -- 172.21.15.17:0/2365980391 >> v2:172.21.15.94:3300/0 conn(0x7f35200cd850 msgr2=0x7f35200b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:12.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.669+0000 7f351fe00640 1 --2- 172.21.15.17:0/2365980391 >> v2:172.21.15.94:3300/0 conn(0x7f35200cd850 0x7f35200b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:12.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.669+0000 7f351fe00640 1 -- 172.21.15.17:0/2365980391 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35200b1be0 con 0x7f35200cb930 2024-03-12T17:33:12.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.670+0000 7f3524c00640 1 --2- 172.21.15.17:0/2365980391 >> v2:172.21.15.94:3300/0 conn(0x7f35200cd850 0x7f35200b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:33:12.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.671+0000 7f351fe00640 1 --2- 172.21.15.17:0/2365980391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35200cb930 0x7f35200b45d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f35200b4390 tx=0x7f351002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=984b76c12397c032 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:12.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.671+0000 7f351ea00640 1 -- 172.21.15.17:0/2365980391 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3510031870 con 0x7f35200cb930 2024-03-12T17:33:12.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.671+0000 7f351ea00640 1 -- 172.21.15.17:0/2365980391 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35100319d0 con 0x7f35200cb930 2024-03-12T17:33:12.667 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.671+0000 7f351ea00640 1 -- 172.21.15.17:0/2365980391 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3510031d60 con 0x7f35200cb930 2024-03-12T17:33:12.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.672+0000 7f3525600640 1 -- 172.21.15.17:0/2365980391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35200cb930 msgr2=0x7f35200b45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:12.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.672+0000 7f3525600640 1 --2- 172.21.15.17:0/2365980391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35200cb930 0x7f35200b45d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f35200b4390 tx=0x7f351002b910 comp rx=0 tx=0).stop 2024-03-12T17:33:12.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.672+0000 7f3525600640 1 -- 172.21.15.17:0/2365980391 shutdown_connections 2024-03-12T17:33:12.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.672+0000 7f3525600640 1 --2- 172.21.15.17:0/2365980391 >> v2:172.21.15.94:3300/0 conn(0x7f35200cd850 0x7f35200b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:12.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.672+0000 7f3525600640 1 --2- 172.21.15.17:0/2365980391 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f35200b23e0 0x7f35200cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:12.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.672+0000 7f3525600640 1 --2- 172.21.15.17:0/2365980391 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35200cb930 0x7f35200b45d0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:12.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.672+0000 7f3525600640 1 -- 172.21.15.17:0/2365980391 >> 172.21.15.17:0/2365980391 conn(0x7f3520069ce0 msgr2=0x7f352006a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:12.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.672+0000 7f3525600640 1 -- 172.21.15.17:0/2365980391 shutdown_connections 2024-03-12T17:33:12.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.672+0000 7f3525600640 1 -- 172.21.15.17:0/2365980391 wait complete. 2024-03-12T17:33:12.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.674+0000 7f3525600640 1 Processor -- start 2024-03-12T17:33:12.669 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.674+0000 7f3525600640 1 -- start start 2024-03-12T17:33:12.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.675+0000 7f3525600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35200b23e0 0x7f35201f19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:12.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.675+0000 7f3525600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35200cb930 0x7f35200c37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:12.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.675+0000 7f3525600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f35200cd850 0x7f35200c3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:12.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.675+0000 7f3525600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3520159760 con 0x7f35200cb930 2024-03-12T17:33:12.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.675+0000 7f3525600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35201348a0 con 0x7f35200b23e0 2024-03-12T17:33:12.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.675+0000 7f3525600640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35201f1f10 con 0x7f35200cd850 2024-03-12T17:33:12.671 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.675+0000 7f351f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35200cb930 0x7f35200c37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:12.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.675+0000 7f351f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35200cb930 0x7f35200c37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35812/0 (socket says 172.21.15.17:35812) 2024-03-12T17:33:12.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.675+0000 7f351f400640 1 -- 172.21.15.17:0/2442709081 learned_addr learned my addr 172.21.15.17:0/2442709081 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:12.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.675+0000 7f351fe00640 1 --2- 172.21.15.17:0/2442709081 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35200b23e0 0x7f35201f19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:12.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.675+0000 7f3524c00640 1 --2- 172.21.15.17:0/2442709081 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f35200cd850 0x7f35200c3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:12.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.676+0000 7f351f400640 1 -- 172.21.15.17:0/2442709081 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f35200cd850 msgr2=0x7f35200c3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:12.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.676+0000 7f351f400640 1 --2- 172.21.15.17:0/2442709081 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f35200cd850 0x7f35200c3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:12.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.676+0000 7f351f400640 1 -- 172.21.15.17:0/2442709081 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35200b23e0 msgr2=0x7f35201f19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:12.672 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.676+0000 7f351f400640 1 --2- 172.21.15.17:0/2442709081 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35200b23e0 0x7f35201f19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:12.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.676+0000 7f351f400640 1 -- 172.21.15.17:0/2442709081 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35100094d0 con 0x7f35200cb930 2024-03-12T17:33:12.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.676+0000 7f351fe00640 1 --2- 172.21.15.17:0/2442709081 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35200b23e0 0x7f35201f19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:33:12.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.676+0000 7f351f400640 1 --2- 172.21.15.17:0/2442709081 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35200cb930 0x7f35200c37d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f350c00ce70 tx=0x7f350c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:12.673 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.676+0000 7f3517e00640 1 -- 172.21.15.17:0/2442709081 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c003b90 con 0x7f35200cb930 2024-03-12T17:33:12.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.676+0000 7f3517e00640 1 -- 172.21.15.17:0/2442709081 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350c003cf0 con 0x7f35200cb930 2024-03-12T17:33:12.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.676+0000 7f3517e00640 1 -- 172.21.15.17:0/2442709081 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350c004260 con 0x7f35200cb930 2024-03-12T17:33:12.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.676+0000 7f3525600640 1 -- 172.21.15.17:0/2442709081 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35200ce600 con 0x7f35200cb930 2024-03-12T17:33:12.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.676+0000 7f3525600640 1 -- 172.21.15.17:0/2442709081 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3520134250 con 0x7f35200cb930 2024-03-12T17:33:12.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.678+0000 7f3525600640 1 -- 172.21.15.17:0/2442709081 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3520134a50 con 0x7f35200cb930 2024-03-12T17:33:12.674 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.679+0000 7f3517e00640 1 -- 172.21.15.17:0/2442709081 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f350c0043c0 con 0x7f35200cb930 2024-03-12T17:33:12.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.679+0000 7f3517e00640 1 --2- 172.21.15.17:0/2442709081 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f350006ac30 0x7f350006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:12.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.680+0000 7f3517e00640 1 -- 172.21.15.17:0/2442709081 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f350c012070 con 0x7f35200cb930 2024-03-12T17:33:12.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.680+0000 7f351fe00640 1 --2- 172.21.15.17:0/2442709081 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f350006ac30 0x7f350006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:12.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.681+0000 7f351fe00640 1 --2- 172.21.15.17:0/2442709081 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f350006ac30 0x7f350006d0f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3510036000 tx=0x7f351003c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:12.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.684+0000 7f3517e00640 1 -- 172.21.15.17:0/2442709081 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f350c054ea0 con 0x7f35200cb930 2024-03-12T17:33:12.965 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:12.969+0000 7f3525600640 1 -- 172.21.15.17:0/2442709081 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_dump_tree.TestDumpTree.test_random"]} v 0) v1 -- 0x7f352004e030 con 0x7f35200cb930 2024-03-12T17:33:13.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:13.951+0000 7f3517e00640 1 -- 172.21.15.17:0/2442709081 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_dump_tree.TestDumpTree.test_random"]}]=0 v512) v1 ==== 131+0+0 (secure 0 0 0) 0x7f350c003e60 con 0x7f35200cb930 2024-03-12T17:33:13.951 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:13.955+0000 7f3525600640 1 -- 172.21.15.17:0/2442709081 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f350006ac30 msgr2=0x7f350006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:13.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:13.955+0000 7f3525600640 1 --2- 172.21.15.17:0/2442709081 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f350006ac30 0x7f350006d0f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3510036000 tx=0x7f351003c040 comp rx=0 tx=0).stop 2024-03-12T17:33:13.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:13.955+0000 7f3525600640 1 -- 172.21.15.17:0/2442709081 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35200cb930 msgr2=0x7f35200c37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:13.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:13.955+0000 7f3525600640 1 --2- 172.21.15.17:0/2442709081 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35200cb930 0x7f35200c37d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f350c00ce70 tx=0x7f350c00a660 comp rx=0 tx=0).stop 2024-03-12T17:33:13.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:13.956+0000 7f3525600640 1 -- 172.21.15.17:0/2442709081 shutdown_connections 2024-03-12T17:33:13.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:13.956+0000 7f3525600640 1 --2- 172.21.15.17:0/2442709081 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f350006ac30 0x7f350006d0f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:13.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:13.956+0000 7f3525600640 1 --2- 172.21.15.17:0/2442709081 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f35200cd850 0x7f35200c3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:13.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:13.956+0000 7f3525600640 1 --2- 172.21.15.17:0/2442709081 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f35200cb930 0x7f35200c37d0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:13.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:13.956+0000 7f3525600640 1 --2- 172.21.15.17:0/2442709081 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f35200b23e0 0x7f35201f19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:13.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:13.956+0000 7f3525600640 1 -- 172.21.15.17:0/2442709081 >> 172.21.15.17:0/2442709081 conn(0x7f3520069ce0 msgr2=0x7f35200acc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:13.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:13.956+0000 7f3525600640 1 -- 172.21.15.17:0/2442709081 shutdown_connections 2024-03-12T17:33:13.952 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:13.956+0000 7f3525600640 1 -- 172.21.15.17:0/2442709081 wait complete. 2024-03-12T17:33:13.972 INFO:tasks.cephfs_test_runner:test_random (tasks.cephfs.test_dump_tree.TestDumpTree) ... ok 2024-03-12T17:33:13.973 INFO:tasks.cephfs_test_runner: 2024-03-12T17:33:13.973 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-12T17:33:13.973 INFO:tasks.cephfs_test_runner:Ran 2 tests in 829.003s 2024-03-12T17:33:13.973 INFO:tasks.cephfs_test_runner: 2024-03-12T17:33:13.973 INFO:tasks.cephfs_test_runner:OK 2024-03-12T17:33:13.974 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-03-12T17:33:13.984 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-03-12T17:33:14.009 INFO:tasks.kclient:Unmounting kernel clients... 2024-03-12T17:33:14.009 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:33:14.009 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-12T17:33:14.069 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054202,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249800k,nr_inodes=812450,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-12T17:33:14.069 DEBUG:teuthology.orchestra.run.smithi017:> set -ex 2024-03-12T17:33:14.069 DEBUG:teuthology.orchestra.run.smithi017:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-12T17:33:14.121 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054202,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6499604k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249800k,nr_inodes=812450,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6499604k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-12T17:33:14.121 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-12T17:33:14.121 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-12T17:33:14.177 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053417,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498348k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249172k,nr_inodes=812293,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498348k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-12T17:33:14.177 DEBUG:teuthology.orchestra.run.smithi094:> set -ex 2024-03-12T17:33:14.177 DEBUG:teuthology.orchestra.run.smithi094:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-12T17:33:14.226 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053417,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498348k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249172k,nr_inodes=812293,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498348k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-12T17:33:14.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:33:14.227 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-03-12T17:33:14.287 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-12T17:33:14.288 INFO:teuthology.orchestra.run.smithi017.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-12T17:33:14.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:33:14.289 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-12T17:33:14.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:33:14.397 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-12T17:33:14.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:33:14.493 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link delete ceph-brx 2024-03-12T17:33:14.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:33:14.625 DEBUG:teuthology.orchestra.run.smithi017:> ip netns list 2024-03-12T17:33:14.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:33:14.671 DEBUG:teuthology.orchestra.run.smithi017:> sudo ip link delete ceph-brx 2024-03-12T17:33:14.811 INFO:teuthology.orchestra.run.smithi017.stderr:Cannot find device "ceph-brx" 2024-03-12T17:33:14.815 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-12T17:33:14.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:33:14.816 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list 2024-03-12T17:33:14.873 INFO:teuthology.orchestra.run.smithi094.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-12T17:33:14.873 INFO:teuthology.orchestra.run.smithi094.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-03-12T17:33:14.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:33:14.873 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-12T17:33:14.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:33:14.968 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-12T17:33:15.034 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:33:15.042 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:33:15.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:33:15.061 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link delete ceph-brx 2024-03-12T17:33:15.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:33:15.207 DEBUG:teuthology.orchestra.run.smithi094:> ip netns list 2024-03-12T17:33:15.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T17:33:15.291 DEBUG:teuthology.orchestra.run.smithi094:> sudo ip link delete ceph-brx 2024-03-12T17:33:15.430 INFO:teuthology.orchestra.run.smithi094.stderr:Cannot find device "ceph-brx" 2024-03-12T17:33:15.433 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-12T17:33:15.434 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-03-12T17:33:15.443 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-12T17:33:15.444 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-12T17:33:15.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.679+0000 7f6bbf200640 1 Processor -- start 2024-03-12T17:33:15.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.680+0000 7f6bbf200640 1 -- start start 2024-03-12T17:33:15.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.681+0000 7f6bbf200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6bc015caa0 0x7f6bc0160790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:15.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.681+0000 7f6bbf200640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6bc015ce80 0x7f6bc00cf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:15.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.681+0000 7f6bbf200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc0161650 con 0x7f6bc00b85f0 2024-03-12T17:33:15.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.681+0000 7f6bbf200640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc0161090 con 0x7f6bc015ce80 2024-03-12T17:33:15.677 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.681+0000 7f6bbf200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc0161370 con 0x7f6bc015caa0 2024-03-12T17:33:15.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.682+0000 7f6bbde00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6bc015caa0 0x7f6bc0160790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:15.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.682+0000 7f6bb7e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f6bc015ce80 0x7f6bc00cf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:15.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.682+0000 7f6bbe800640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f6bc00b85f0 0x7f6bc00b43a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.17:56302/0 (socket says 172.21.15.17:56302) 2024-03-12T17:33:15.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.682+0000 7f6bbe800640 1 -- 172.21.15.17:0/1282522500 learned_addr learned my addr 172.21.15.17:0/1282522500 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:33:15.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.682+0000 7f6bbde00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6bc015caa0 0x7f6bc0160790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.94:3301/0 says I am v2:172.21.15.17:48184/0 (socket says 172.21.15.17:48184) 2024-03-12T17:33:15.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.683+0000 7f6bbde00640 1 -- 172.21.15.17:0/1282522500 >> v2:172.21.15.94:3300/0 conn(0x7f6bc015ce80 msgr2=0x7f6bc00cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:15.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.683+0000 7f6bbde00640 1 --2- 172.21.15.17:0/1282522500 >> v2:172.21.15.94:3300/0 conn(0x7f6bc015ce80 0x7f6bc00cf330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:15.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.683+0000 7f6bbde00640 1 -- 172.21.15.17:0/1282522500 >> v1:172.21.15.94:6789/0 conn(0x7f6bc00b85f0 legacy=0x7f6bc00b43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:15.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.683+0000 7f6bbde00640 1 -- 172.21.15.17:0/1282522500 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc00d0ad0 con 0x7f6bc015caa0 2024-03-12T17:33:15.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.683+0000 7f6bb7e00640 1 --2- 172.21.15.17:0/1282522500 >> v2:172.21.15.94:3300/0 conn(0x7f6bc015ce80 0x7f6bc00cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-12T17:33:15.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.685+0000 7f6bbde00640 1 --2- 172.21.15.17:0/1282522500 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6bc015caa0 0x7f6bc0160790 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6bb00097a0 tx=0x7f6bb002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e97f622aae11e16e server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:15.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.686+0000 7f6bbd400640 1 -- 172.21.15.17:0/1282522500 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb0031830 con 0x7f6bc015caa0 2024-03-12T17:33:15.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.686+0000 7f6bbd400640 1 -- 172.21.15.17:0/1282522500 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb0031990 con 0x7f6bc015caa0 2024-03-12T17:33:15.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.686+0000 7f6bbd400640 1 -- 172.21.15.17:0/1282522500 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb0031d20 con 0x7f6bc015caa0 2024-03-12T17:33:15.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.687+0000 7f6bbf200640 1 -- 172.21.15.17:0/1282522500 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6bc015caa0 msgr2=0x7f6bc0160790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:15.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.687+0000 7f6bbf200640 1 --2- 172.21.15.17:0/1282522500 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6bc015caa0 0x7f6bc0160790 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6bb00097a0 tx=0x7f6bb002b8d0 comp rx=0 tx=0).stop 2024-03-12T17:33:15.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.687+0000 7f6bbf200640 1 -- 172.21.15.17:0/1282522500 shutdown_connections 2024-03-12T17:33:15.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.687+0000 7f6bbf200640 1 --2- 172.21.15.17:0/1282522500 >> v2:172.21.15.94:3300/0 conn(0x7f6bc015ce80 0x7f6bc00cf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:15.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.687+0000 7f6bbf200640 1 --2- 172.21.15.17:0/1282522500 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6bc015caa0 0x7f6bc0160790 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:15.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.687+0000 7f6bbf200640 1 -- 172.21.15.17:0/1282522500 >> 172.21.15.17:0/1282522500 conn(0x7f6bc006b160 msgr2=0x7f6bc006b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:15.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.687+0000 7f6bbf200640 1 -- 172.21.15.17:0/1282522500 shutdown_connections 2024-03-12T17:33:15.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.687+0000 7f6bbf200640 1 -- 172.21.15.17:0/1282522500 wait complete. 2024-03-12T17:33:15.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.689+0000 7f6bbf200640 1 Processor -- start 2024-03-12T17:33:15.684 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.689+0000 7f6bbf200640 1 -- start start 2024-03-12T17:33:15.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.690+0000 7f6bbf200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bc00b85f0 0x7f6bc00cb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:15.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.690+0000 7f6bbf200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bc015caa0 0x7f6bc01f1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:15.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.690+0000 7f6bbf200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6bc015ce80 0x7f6bc00ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:15.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.690+0000 7f6bbf200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc00cfc80 con 0x7f6bc015caa0 2024-03-12T17:33:15.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.690+0000 7f6bbf200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc00c99f0 con 0x7f6bc00b85f0 2024-03-12T17:33:15.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.690+0000 7f6bbf200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc00c9cd0 con 0x7f6bc015ce80 2024-03-12T17:33:15.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.690+0000 7f6bb7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bc015caa0 0x7f6bc01f1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:15.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.690+0000 7f6bb7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bc015caa0 0x7f6bc01f1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35820/0 (socket says 172.21.15.17:35820) 2024-03-12T17:33:15.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.690+0000 7f6bb7e00640 1 -- 172.21.15.17:0/4115172289 learned_addr learned my addr 172.21.15.17:0/4115172289 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:15.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.690+0000 7f6bbe800640 1 --2- 172.21.15.17:0/4115172289 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6bc015ce80 0x7f6bc00ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:15.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.690+0000 7f6bbde00640 1 --2- 172.21.15.17:0/4115172289 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bc00b85f0 0x7f6bc00cb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:15.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.691+0000 7f6bb7e00640 1 -- 172.21.15.17:0/4115172289 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6bc015ce80 msgr2=0x7f6bc00ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:15.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.691+0000 7f6bb7e00640 1 --2- 172.21.15.17:0/4115172289 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6bc015ce80 0x7f6bc00ca160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:15.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.691+0000 7f6bb7e00640 1 -- 172.21.15.17:0/4115172289 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bc00b85f0 msgr2=0x7f6bc00cb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:15.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.691+0000 7f6bb7e00640 1 --2- 172.21.15.17:0/4115172289 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bc00b85f0 0x7f6bc00cb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:15.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.691+0000 7f6bb7e00640 1 -- 172.21.15.17:0/4115172289 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba8009400 con 0x7f6bc015caa0 2024-03-12T17:33:15.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.691+0000 7f6bbde00640 1 --2- 172.21.15.17:0/4115172289 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bc00b85f0 0x7f6bc00cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:33:15.687 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.691+0000 7f6bb7e00640 1 --2- 172.21.15.17:0/4115172289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bc015caa0 0x7f6bc01f1ba0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f6ba800e930 tx=0x7f6ba800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:15.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.691+0000 7f6bb6000640 1 -- 172.21.15.17:0/4115172289 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba8009660 con 0x7f6bc015caa0 2024-03-12T17:33:15.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.691+0000 7f6bb6000640 1 -- 172.21.15.17:0/4115172289 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba800ca00 con 0x7f6bc015caa0 2024-03-12T17:33:15.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.691+0000 7f6bbf200640 1 -- 172.21.15.17:0/4115172289 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bb0009400 con 0x7f6bc015caa0 2024-03-12T17:33:15.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.691+0000 7f6bb6000640 1 -- 172.21.15.17:0/4115172289 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba800cdb0 con 0x7f6bc015caa0 2024-03-12T17:33:15.688 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.691+0000 7f6bbf200640 1 -- 172.21.15.17:0/4115172289 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc00cc130 con 0x7f6bc015caa0 2024-03-12T17:33:15.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.693+0000 7f6bbf200640 1 -- 172.21.15.17:0/4115172289 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc0072360 con 0x7f6bc015caa0 2024-03-12T17:33:15.689 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.694+0000 7f6bb6000640 1 -- 172.21.15.17:0/4115172289 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f6ba8013470 con 0x7f6bc015caa0 2024-03-12T17:33:15.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.694+0000 7f6bb6000640 1 --2- 172.21.15.17:0/4115172289 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f6b9c06ac00 0x7f6b9c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:15.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.694+0000 7f6bb6000640 1 -- 172.21.15.17:0/4115172289 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6ba8088ef0 con 0x7f6bc015caa0 2024-03-12T17:33:15.690 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.695+0000 7f6bbde00640 1 --2- 172.21.15.17:0/4115172289 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f6b9c06ac00 0x7f6b9c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:15.691 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.696+0000 7f6bbde00640 1 --2- 172.21.15.17:0/4115172289 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f6b9c06ac00 0x7f6b9c06d0c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0036000 tx=0x7f6bb0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:15.694 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.699+0000 7f6bb6000640 1 -- 172.21.15.17:0/4115172289 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f6ba80543b0 con 0x7f6bc015caa0 2024-03-12T17:33:15.890 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.894+0000 7f6bbf200640 1 -- 172.21.15.17:0/4115172289 --> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6bc00d22e0 con 0x7f6b9c06ac00 2024-03-12T17:33:15.894 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.898+0000 7f6bb6000640 1 -- 172.21.15.17:0/4115172289 <== mgr.4104 v2:172.21.15.17:6832/37052 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48147 (secure 0 0 0) 0x7f6bb0045400 con 0x7f6b9c06ac00 2024-03-12T17:33:15.895 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:33:15.895 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-03-12T17:33:15.897 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.901+0000 7f6bbf200640 1 -- 172.21.15.17:0/4115172289 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f6b9c06ac00 msgr2=0x7f6b9c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:15.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.901+0000 7f6bbf200640 1 --2- 172.21.15.17:0/4115172289 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f6b9c06ac00 0x7f6b9c06d0c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0036000 tx=0x7f6bb0008030 comp rx=0 tx=0).stop 2024-03-12T17:33:15.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.902+0000 7f6bbf200640 1 -- 172.21.15.17:0/4115172289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bc015caa0 msgr2=0x7f6bc01f1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:15.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.902+0000 7f6bbf200640 1 --2- 172.21.15.17:0/4115172289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bc015caa0 0x7f6bc01f1ba0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f6ba800e930 tx=0x7f6ba800edf0 comp rx=0 tx=0).stop 2024-03-12T17:33:15.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.902+0000 7f6bbf200640 1 -- 172.21.15.17:0/4115172289 shutdown_connections 2024-03-12T17:33:15.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.902+0000 7f6bbf200640 1 --2- 172.21.15.17:0/4115172289 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f6b9c06ac00 0x7f6b9c06d0c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:15.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.902+0000 7f6bbf200640 1 --2- 172.21.15.17:0/4115172289 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f6bc015ce80 0x7f6bc00ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:15.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.902+0000 7f6bbf200640 1 --2- 172.21.15.17:0/4115172289 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f6bc015caa0 0x7f6bc01f1ba0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:15.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.902+0000 7f6bbf200640 1 --2- 172.21.15.17:0/4115172289 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f6bc00b85f0 0x7f6bc00cb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:15.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.902+0000 7f6bbf200640 1 -- 172.21.15.17:0/4115172289 >> 172.21.15.17:0/4115172289 conn(0x7f6bc006b160 msgr2=0x7f6bc015b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:15.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.902+0000 7f6bbf200640 1 -- 172.21.15.17:0/4115172289 shutdown_connections 2024-03-12T17:33:15.898 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:15.902+0000 7f6bbf200640 1 -- 172.21.15.17:0/4115172289 wait complete. 2024-03-12T17:33:15.917 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":484,"stamp":"2024-03-12T17:33:15.792178+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":263156,"kb_used_data":6024,"kb_used_omap":13,"kb_used_meta":257010,"kb_avail":754711564,"statfs":{"total":773094113280,"available":772824641536,"internally_reserved":0,"allocated":6168576,"data_stored":3219712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":263178328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-20068777,"num_objects":-992,"num_object_clones":0,"num_object_copies":-1984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-992,"num_whiteouts":0,"num_read":-10,"num_read_kb":-7403,"num_write":-1673,"num_write_kb":-20891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-34,"num_bytes_recovered":-21858,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.239521"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":195,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-12T17:33:08.851398+0000","last_change":"2024-03-12T17:18:41.331756+0000","last_active":"2024-03-12T17:33:08.851398+0000","last_peered":"2024-03-12T17:33:08.851398+0000","last_clean":"2024-03-12T17:33:08.851398+0000","last_became_active":"2024-03-12T17:18:41.329237+0000","last_became_peered":"2024-03-12T17:18:41.329237+0000","last_unstale":"2024-03-12T17:33:08.851398+0000","last_undegraded":"2024-03-12T17:33:08.851398+0000","last_fullsized":"2024-03-12T17:33:08.851398+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:40.152422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:40.152422+0000","last_clean_scrub_stamp":"2024-03-12T17:18:40.152422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:35:43.664403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575026,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36400,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335440,"statfs":{"total":96636764160,"available":96599490560,"internally_reserved":0,"allocated":1216512,"data_stored":845240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.006,"15min":1.0369999999999999},"min":{"1min":0.67800000000000005,"5min":0.61699999999999999,"15min":0.48099999999999998},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":2.3730000000000002},"last":0.54100000000000004},{"interface":"front","average":{"1min":1.038,"5min":1.0289999999999999,"15min":1.0369999999999999},"min":{"1min":0.67700000000000005,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.494,"5min":1.5469999999999999,"15min":2.2330000000000001},"last":0.55400000000000005}]},{"osd":1,"last update":"Tue Mar 12 17:33:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0129999999999999,"15min":1.02},"min":{"1min":0.753,"5min":0.67200000000000004,"15min":0.52200000000000002},"max":{"1min":1.5,"5min":1.5,"15min":1.7050000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.111,"15min":1.123},"min":{"1min":0.73999999999999999,"5min":0.72699999999999998,"15min":0.61299999999999999},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":2.363},"last":0.51100000000000001}]},{"osd":2,"last update":"Tue Mar 12 17:33:06 2024","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.171,"15min":1.179},"min":{"1min":0.747,"5min":0.68100000000000005,"15min":0.60799999999999998},"max":{"1min":1.4339999999999999,"5min":1.655,"15min":1.827},"last":0.58599999999999997},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.22,"15min":1.2290000000000001},"min":{"1min":0.92500000000000004,"5min":0.83999999999999997,"15min":0.625},"max":{"1min":1.6379999999999999,"5min":1.7949999999999999,"15min":2.0870000000000002},"last":0.52600000000000002}]},{"osd":3,"last update":"Tue Mar 12 17:33:06 2024","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.2010000000000001,"15min":1.212},"min":{"1min":0.871,"5min":0.70699999999999996,"15min":0.55800000000000005},"max":{"1min":1.4710000000000001,"5min":1.722,"15min":1.921},"last":0.63500000000000001},{"interface":"front","average":{"1min":1.216,"5min":1.2709999999999999,"15min":1.2669999999999999},"min":{"1min":0.89300000000000002,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.4870000000000001,"5min":1.738,"15min":2.1499999999999999},"last":0.61799999999999999}]},{"osd":4,"last update":"Tue Mar 12 17:33:06 2024","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.1739999999999999,"15min":1.1990000000000001},"min":{"1min":0.79600000000000004,"5min":0.71299999999999997,"15min":0.51400000000000001},"max":{"1min":1.635,"5min":1.635,"15min":2.2349999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.351,"15min":1.381},"min":{"1min":1.105,"5min":0.84799999999999998,"15min":0.63700000000000001},"max":{"1min":1.635,"5min":1.786,"15min":2.2490000000000001},"last":0.70299999999999996}]},{"osd":5,"last update":"Tue Mar 12 17:33:06 2024","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.2969999999999999,"15min":1.3109999999999999},"min":{"1min":0.84699999999999998,"5min":0.66600000000000004,"15min":0.53100000000000003},"max":{"1min":1.615,"5min":1.833,"15min":2.323},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.427,"5min":1.379,"15min":1.4279999999999999},"min":{"1min":1.1200000000000001,"5min":0.85499999999999998,"15min":0.61099999999999999},"max":{"1min":1.8140000000000001,"5min":1.8140000000000001,"15min":3.9689999999999999},"last":0.77600000000000002}]},{"osd":6,"last update":"Tue Mar 12 17:33:06 2024","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.425,"15min":1.462},"min":{"1min":1.2130000000000001,"5min":0.94399999999999995,"15min":0.69999999999999996},"max":{"1min":1.722,"5min":1.8340000000000001,"15min":3.8319999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.4019999999999999,"15min":1.429},"min":{"1min":0.99099999999999999,"5min":0.627,"15min":0.55100000000000005},"max":{"1min":1.6379999999999999,"5min":1.891,"15min":2.4609999999999999},"last":0.749}]}]},{"osd":6,"up_from":13,"seq":55834575025,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31724,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340116,"statfs":{"total":96636764160,"available":96604278784,"internally_reserved":0,"allocated":622592,"data_stored":254872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.101,"15min":1.0629999999999999},"min":{"1min":0.72399999999999998,"5min":0.68600000000000005,"15min":0.54400000000000004},"max":{"1min":1.556,"5min":1.71,"15min":3.5390000000000001},"last":1.155},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.085,"15min":1.0569999999999999},"min":{"1min":0.80400000000000005,"5min":0.65700000000000003,"15min":0.60899999999999999},"max":{"1min":1.5269999999999999,"5min":1.6220000000000001,"15min":1.73},"last":1.458}]},{"osd":1,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.2789999999999999,"15min":1.2330000000000001},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.33900000000000002},"max":{"1min":1.5680000000000001,"5min":1.778,"15min":6.7450000000000001},"last":1.044},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.2889999999999999,"15min":1.2769999999999999},"min":{"1min":0.89900000000000002,"5min":0.73199999999999998,"15min":0.70199999999999996},"max":{"1min":1.681,"5min":1.734,"15min":4.1909999999999998},"last":1.3129999999999999}]},{"osd":2,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.2689999999999999,"15min":1.2410000000000001},"min":{"1min":0.93400000000000005,"5min":0.83899999999999997,"15min":0.41299999999999998},"max":{"1min":1.512,"5min":1.6799999999999999,"15min":6.6879999999999997},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.3149999999999999,"15min":1.3},"min":{"1min":1.181,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.6899999999999999,"5min":1.8240000000000001,"15min":2.9689999999999999},"last":0.73999999999999999}]},{"osd":3,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.2390000000000001,"15min":1.2050000000000001},"min":{"1min":0.72999999999999998,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.546,"5min":1.6759999999999999,"15min":1.7749999999999999},"last":1.528},{"interface":"front","average":{"1min":1.248,"5min":1.254,"15min":1.246},"min":{"1min":0.86399999999999999,"5min":0.73899999999999999,"15min":0.46200000000000002},"max":{"1min":1.48,"5min":1.7170000000000001,"15min":6.6070000000000002},"last":1.214}]},{"osd":4,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.244,"15min":1.256},"min":{"1min":0.91000000000000003,"5min":0.80100000000000005,"15min":0.68300000000000005},"max":{"1min":1.605,"5min":1.6950000000000001,"15min":2.2130000000000001},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.2669999999999999,"15min":1.256},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.59499999999999997},"max":{"1min":1.7849999999999999,"5min":1.976,"15min":1.976},"last":1.2470000000000001}]},{"osd":5,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.3959999999999999,"15min":1.3959999999999999},"min":{"1min":1.2010000000000001,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":2.0649999999999999,"5min":2.0649999999999999,"15min":2.8660000000000001},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3680000000000001,"15min":1.373},"min":{"1min":1,"5min":0.88,"15min":0.51900000000000002},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":6.4939999999999998},"last":1.286}]},{"osd":7,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.4279999999999999,"15min":1.454},"min":{"1min":1.1559999999999999,"5min":0.92000000000000004,"15min":0.64000000000000001},"max":{"1min":1.978,"5min":1.978,"15min":2.2069999999999999},"last":1.488},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.5449999999999999,"15min":1.5289999999999999},"min":{"1min":1.319,"5min":1.016,"15min":0.77500000000000002},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.258},"last":1.5800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575026,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31728,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":622592,"data_stored":254872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.0629999999999999,"15min":1.111},"min":{"1min":0.66100000000000003,"5min":0.60599999999999998,"15min":0.56399999999999995},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":2.161},"last":1.6339999999999999},{"interface":"front","average":{"1min":1.099,"5min":1.1140000000000001,"15min":1.145},"min":{"1min":0.72199999999999998,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.3899999999999999,"5min":1.5149999999999999,"15min":1.95},"last":1.1930000000000001}]},{"osd":1,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1279999999999999,"15min":1.1359999999999999},"min":{"1min":0.75,"5min":0.70499999999999996,"15min":0.69199999999999995},"max":{"1min":1.496,"5min":1.698,"15min":1.75},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1779999999999999,"15min":1.222},"min":{"1min":0.82799999999999996,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":2.5699999999999998},"last":1.3560000000000001}]},{"osd":2,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.212,"15min":1.234},"min":{"1min":0.96799999999999997,"5min":0.76000000000000001,"15min":0.71599999999999997},"max":{"1min":1.6220000000000001,"5min":1.7190000000000001,"15min":2.613},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.226,"15min":1.2310000000000001},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.524,"5min":1.897,"15min":2.359},"last":0.85799999999999998}]},{"osd":3,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2569999999999999,"15min":1.3089999999999999},"min":{"1min":0.77900000000000003,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.4930000000000001,"5min":1.75,"15min":2.6829999999999998},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.3,"15min":1.3280000000000001},"min":{"1min":0.90900000000000003,"5min":0.874,"15min":0.80500000000000005},"max":{"1min":1.5720000000000001,"5min":1.724,"15min":2.3559999999999999},"last":1.0620000000000001}]},{"osd":4,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2,"15min":1.248},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.73699999999999999},"max":{"1min":1.655,"5min":1.6719999999999999,"15min":2.0510000000000002},"last":0.996},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.306,"15min":1.361},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.76700000000000002},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":2.3999999999999999},"last":1.5249999999999999}]},{"osd":6,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.3160000000000001,"15min":1.375},"min":{"1min":0.91700000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.718,"5min":1.75,"15min":2.488},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.365,"15min":1.4179999999999999},"min":{"1min":1.1719999999999999,"5min":0.97199999999999998,"15min":0.66100000000000003},"max":{"1min":1.601,"5min":1.7949999999999999,"15min":2.2759999999999998},"last":1.4199999999999999}]},{"osd":7,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.413,"15min":1.4950000000000001},"min":{"1min":0.97799999999999998,"5min":0.95299999999999996,"15min":0.95299999999999996},"max":{"1min":1.696,"5min":1.7470000000000001,"15min":2.8700000000000001},"last":1.587},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.47,"15min":1.5249999999999999},"min":{"1min":1.073,"5min":0.87,"15min":0.87},"max":{"1min":1.72,"5min":1.833,"15min":2.722},"last":1.405}]}]},{"osd":4,"up_from":13,"seq":55834575026,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31728,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":622592,"data_stored":254872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1259999999999999,"15min":1.091},"min":{"1min":0.70099999999999996,"5min":0.67300000000000004,"15min":0.60799999999999998},"max":{"1min":1.679,"5min":1.7330000000000001,"15min":4.8979999999999997},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.996,"5min":1.073,"15min":1.0900000000000001},"min":{"1min":0.73299999999999998,"5min":0.67900000000000005,"15min":0.57699999999999996},"max":{"1min":1.4410000000000001,"5min":1.659,"15min":4.8300000000000001},"last":1.3520000000000001}]},{"osd":1,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1359999999999999,"15min":1.1339999999999999},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.64100000000000001},"max":{"1min":1.609,"5min":1.647,"15min":4.7779999999999996},"last":0.998},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.2070000000000001,"15min":1.161},"min":{"1min":0.82299999999999995,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.6100000000000001,"5min":1.887,"15min":1.911},"last":1.274}]},{"osd":2,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.2569999999999999,"15min":1.226},"min":{"1min":0.88,"5min":0.65800000000000003,"15min":0.60199999999999998},"max":{"1min":1.5409999999999999,"5min":1.6870000000000001,"15min":1.7450000000000001},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.351,"5min":1.3340000000000001,"15min":1.3049999999999999},"min":{"1min":1.028,"5min":0.81899999999999995,"15min":0.78500000000000003},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":2.3220000000000001},"last":1.397}]},{"osd":3,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.2310000000000001,"15min":1.24},"min":{"1min":0.90200000000000002,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.444,"5min":1.78,"15min":1.7949999999999999},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.2310000000000001,"15min":1.2290000000000001},"min":{"1min":0.90500000000000003,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.581,"5min":1.7130000000000001,"15min":1.9119999999999999},"last":1.1140000000000001}]},{"osd":5,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.3300000000000001,"15min":1.325},"min":{"1min":0.93400000000000005,"5min":0.83299999999999996,"15min":0.60499999999999998},"max":{"1min":1.766,"5min":1.766,"15min":2.1589999999999998},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.49,"5min":1.4159999999999999,"15min":1.3899999999999999},"min":{"1min":0.85999999999999999,"5min":0.79600000000000004,"15min":0.76700000000000002},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":2.5390000000000001},"last":1.458}]},{"osd":6,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.248,"15min":1.264},"min":{"1min":0.86299999999999999,"5min":0.81599999999999995,"15min":0.65900000000000003},"max":{"1min":1.5880000000000001,"5min":1.8009999999999999,"15min":1.885},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.508,"5min":1.3999999999999999,"15min":1.3919999999999999},"min":{"1min":1.0649999999999999,"5min":0.83299999999999996,"15min":0.63300000000000001},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.4750000000000001},"last":1.5169999999999999}]},{"osd":7,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.3979999999999999,"15min":1.4079999999999999},"min":{"1min":1.159,"5min":0.97799999999999998,"15min":0.56299999999999994},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":2.1200000000000001},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.427,"15min":1.425},"min":{"1min":0.97799999999999998,"5min":0.96999999999999997,"15min":0.67600000000000005},"max":{"1min":1.72,"5min":1.9199999999999999,"15min":2.4260000000000002},"last":1.3759999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575026,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35820,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336020,"statfs":{"total":96636764160,"available":96600084480,"internally_reserved":0,"allocated":622592,"data_stored":254872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.84999999999999998,"15min":0.88300000000000001},"min":{"1min":0.51000000000000001,"5min":0.432,"15min":0.35099999999999998},"max":{"1min":1.306,"5min":1.5189999999999999,"15min":2.9580000000000002},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.995,"5min":0.93999999999999995,"15min":0.95699999999999996},"min":{"1min":0.67800000000000005,"5min":0.55800000000000005,"15min":0.48199999999999998},"max":{"1min":1.401,"5min":1.651,"15min":3.9940000000000002},"last":1.1890000000000001}]},{"osd":1,"last update":"Tue Mar 12 17:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.89700000000000002,"15min":0.91900000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.38600000000000001},"max":{"1min":1.4019999999999999,"5min":1.5940000000000001,"15min":4.774},"last":1.222},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0449999999999999,"15min":1.0720000000000001},"min":{"1min":0.60599999999999998,"5min":0.58499999999999996,"15min":0.40999999999999998},"max":{"1min":1.647,"5min":1.647,"15min":5.0069999999999997},"last":0.91800000000000004}]},{"osd":2,"last update":"Tue Mar 12 17:32:56 2024","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.135,"15min":1.155},"min":{"1min":0.78200000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":2.4660000000000002},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.2250000000000001,"15min":1.2709999999999999},"min":{"1min":0.70499999999999996,"5min":0.57399999999999995,"15min":0.439},"max":{"1min":1.6020000000000001,"5min":1.7509999999999999,"15min":4.5650000000000004},"last":1.6299999999999999}]},{"osd":4,"last update":"Tue Mar 12 17:32:56 2024","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.24,"15min":1.272},"min":{"1min":0.84899999999999998,"5min":0.80700000000000005,"15min":0.67200000000000004},"max":{"1min":1.74,"5min":1.74,"15min":2.8860000000000001},"last":1.147},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2390000000000001,"15min":1.28},"min":{"1min":0.88300000000000001,"5min":0.80800000000000005,"15min":0.73399999999999999},"max":{"1min":1.546,"5min":1.6259999999999999,"15min":4.3520000000000003},"last":1.357}]},{"osd":5,"last update":"Tue Mar 12 17:32:56 2024","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.339,"15min":1.3500000000000001},"min":{"1min":0.91500000000000004,"5min":0.84799999999999998,"15min":0.76200000000000001},"max":{"1min":1.649,"5min":1.9059999999999999,"15min":2.843},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.3069999999999999,"15min":1.3320000000000001},"min":{"1min":0.96299999999999997,"5min":0.81399999999999995,"15min":0.68300000000000005},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.8149999999999999},"last":1.4830000000000001}]},{"osd":6,"last update":"Tue Mar 12 17:32:56 2024","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.4059999999999999,"15min":1.4379999999999999},"min":{"1min":1.1359999999999999,"5min":0.79600000000000004,"15min":0.71699999999999997},"max":{"1min":1.7509999999999999,"5min":2.0299999999999998,"15min":2.9199999999999999},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4039999999999999,"15min":1.423},"min":{"1min":1.0329999999999999,"5min":0.878,"15min":0.86399999999999999},"max":{"1min":1.982,"5min":1.982,"15min":2.6589999999999998},"last":1.6000000000000001}]},{"osd":7,"last update":"Tue Mar 12 17:32:56 2024","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.351,"15min":1.3959999999999999},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.83899999999999997},"max":{"1min":1.661,"5min":1.7450000000000001,"15min":4.6600000000000001},"last":1.528},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.4350000000000001,"15min":1.4670000000000001},"min":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.76800000000000002},"max":{"1min":1.7529999999999999,"5min":1.8240000000000001,"15min":4.4720000000000004},"last":1.6919999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575026,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31728,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":622592,"data_stored":254872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.97299999999999998,"15min":0.95499999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.40000000000000002},"max":{"1min":1.3540000000000001,"5min":2.097,"15min":3.1829999999999998},"last":0.60699999999999998},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0960000000000001,"15min":1.0800000000000001},"min":{"1min":0.66800000000000004,"5min":0.63400000000000001,"15min":0.50700000000000001},"max":{"1min":1.532,"5min":1.694,"15min":2.8199999999999998},"last":0.56299999999999994}]},{"osd":1,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":0.94199999999999995,"15min":0.94099999999999995},"min":{"1min":0.69199999999999995,"5min":0.49099999999999999,"15min":0.308},"max":{"1min":1.9259999999999999,"5min":2.0529999999999999,"15min":2.7360000000000002},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.119,"15min":1.099},"min":{"1min":0.621,"5min":0.621,"15min":0.44700000000000001},"max":{"1min":1.583,"5min":2.2010000000000001,"15min":3.1019999999999999},"last":0.81699999999999995}]},{"osd":3,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.117,"15min":1.1160000000000001},"min":{"1min":0.72599999999999998,"5min":0.629,"15min":0.45000000000000001},"max":{"1min":1.6020000000000001,"5min":1.883,"15min":2.7810000000000001},"last":0.63},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2270000000000001,"15min":1.2130000000000001},"min":{"1min":0.76500000000000001,"5min":0.66900000000000004,"15min":0.48299999999999998},"max":{"1min":1.5920000000000001,"5min":1.758,"15min":3.1419999999999999},"last":0.77300000000000002}]},{"osd":4,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.3420000000000001,"15min":1.3919999999999999},"min":{"1min":0.92900000000000005,"5min":0.86699999999999999,"15min":0.76100000000000001},"max":{"1min":1.7,"5min":1.9450000000000001,"15min":7.96},"last":1.264},{"interface":"front","average":{"1min":1.282,"5min":1.266,"15min":1.2789999999999999},"min":{"1min":0.82299999999999995,"5min":0.78800000000000003,"15min":0.67700000000000005},"max":{"1min":1.7210000000000001,"5min":1.806,"15min":3.3780000000000001},"last":0.88}]},{"osd":5,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.333,"15min":1.351},"min":{"1min":0.91800000000000004,"5min":0.89000000000000001,"15min":0.70399999999999996},"max":{"1min":1.8839999999999999,"5min":1.9059999999999999,"15min":4.0659999999999998},"last":1.097},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3320000000000001,"15min":1.3700000000000001},"min":{"1min":0.98599999999999999,"5min":0.86699999999999999,"15min":0.63800000000000001},"max":{"1min":1.649,"5min":1.929,"15min":3.012},"last":0.85199999999999998}]},{"osd":6,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.393,"15min":1.4019999999999999},"min":{"1min":1.1459999999999999,"5min":0.86599999999999999,"15min":0.74099999999999999},"max":{"1min":1.7729999999999999,"5min":2.1099999999999999,"15min":3.2330000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.389,"5min":1.4870000000000001,"15min":1.5169999999999999},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.68899999999999995},"max":{"1min":1.802,"5min":2.4100000000000001,"15min":7.9059999999999997},"last":1.1870000000000001}]},{"osd":7,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.423,"15min":1.4299999999999999},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.64700000000000002},"max":{"1min":1.8420000000000001,"5min":2.0529999999999999,"15min":4.0229999999999997},"last":1.036},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4750000000000001,"15min":1.4950000000000001},"min":{"1min":1.0509999999999999,"5min":0.95099999999999996,"15min":0.84499999999999997},"max":{"1min":1.885,"5min":2.0950000000000002,"15min":3.27},"last":1.0700000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575026,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31724,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340116,"statfs":{"total":96636764160,"available":96604278784,"internally_reserved":0,"allocated":622592,"data_stored":254872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.89800000000000002,"15min":0.88800000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.29,"5min":1.6699999999999999,"15min":1.7749999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.0149999999999999,"15min":1.0449999999999999},"min":{"1min":0.60999999999999999,"5min":0.59399999999999997,"15min":0.47499999999999998},"max":{"1min":1.76,"5min":1.869,"15min":7.6449999999999996},"last":1.76}]},{"osd":2,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.97099999999999997,"15min":0.95199999999999996},"min":{"1min":0.628,"5min":0.53200000000000003,"15min":0.40799999999999997},"max":{"1min":1.272,"5min":1.7629999999999999,"15min":1.9299999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.095,"15min":1.0669999999999999},"min":{"1min":0.58799999999999997,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.325,"5min":1.708,"15min":2.5720000000000001},"last":1.325}]},{"osd":3,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.208,"15min":1.242},"min":{"1min":0.625,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.681,"5min":1.875,"15min":2.4580000000000002},"last":1.526},{"interface":"front","average":{"1min":1.02,"5min":1.155,"15min":1.1599999999999999},"min":{"1min":0.56399999999999995,"5min":0.501,"15min":0.42499999999999999},"max":{"1min":1.502,"5min":1.8460000000000001,"15min":3.319},"last":1.218}]},{"osd":4,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.246,"15min":1.2350000000000001},"min":{"1min":0.77400000000000002,"5min":0.70799999999999996,"15min":0.63300000000000001},"max":{"1min":1.5700000000000001,"5min":1.9039999999999999,"15min":2.4580000000000002},"last":1.5700000000000001},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.363,"15min":1.355},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.70999999999999996},"max":{"1min":1.599,"5min":2.0680000000000001,"15min":2.6909999999999998},"last":1.599}]},{"osd":5,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.3740000000000001,"15min":1.3660000000000001},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.67200000000000004},"max":{"1min":1.629,"5min":1.9650000000000001,"15min":3.0609999999999999},"last":1.629},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3440000000000001,"15min":1.353},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.73299999999999998},"max":{"1min":1.8169999999999999,"5min":1.9339999999999999,"15min":2.4169999999999998},"last":1.1659999999999999}]},{"osd":6,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.4419999999999999,"15min":1.4299999999999999},"min":{"1min":0.752,"5min":0.752,"15min":0.70099999999999996},"max":{"1min":1.9139999999999999,"5min":2.137,"15min":3.1030000000000002},"last":1.9139999999999999},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.405,"15min":1.4059999999999999},"min":{"1min":0.874,"5min":0.874,"15min":0.82999999999999996},"max":{"1min":1.7509999999999999,"5min":2.0219999999999998,"15min":2.274},"last":1.492}]},{"osd":7,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.4950000000000001,"15min":1.47},"min":{"1min":1.129,"5min":0.85799999999999998,"15min":0.70899999999999996},"max":{"1min":1.7030000000000001,"5min":2.1659999999999999,"15min":2.7959999999999998},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.5389999999999999,"15min":1.518},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.73,"5min":2.2509999999999999,"15min":3.1440000000000001},"last":1.405}]}]},{"osd":0,"up_from":13,"seq":55834575025,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1216512,"data_stored":845240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.92100000000000004,"15min":0.92900000000000005},"min":{"1min":0.71899999999999997,"5min":0.46000000000000002,"15min":0.41799999999999998},"max":{"1min":1.45,"5min":1.829,"15min":1.829},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0469999999999999,"15min":1.028},"min":{"1min":0.54700000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.504,"5min":1.8280000000000001,"15min":2.3740000000000001},"last":1.1240000000000001}]},{"osd":2,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.054,"15min":1.056},"min":{"1min":0.80200000000000005,"5min":0.56999999999999995,"15min":0.52300000000000002},"max":{"1min":1.528,"5min":1.792,"15min":1.99},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.089,"5min":1.105,"15min":1.1000000000000001},"min":{"1min":0.621,"5min":0.51200000000000001,"15min":0.45500000000000002},"max":{"1min":1.591,"5min":1.752,"15min":2.468},"last":1.76}]},{"osd":3,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.002,"15min":1.016},"min":{"1min":0.58299999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.5449999999999999,"5min":1.8340000000000001,"15min":2.085},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.234,"15min":1.2310000000000001},"min":{"1min":0.73099999999999998,"5min":0.63800000000000001,"15min":0.56899999999999995},"max":{"1min":1.6479999999999999,"5min":1.78,"15min":2.286},"last":0.95899999999999996}]},{"osd":4,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2390000000000001,"15min":1.262},"min":{"1min":0.94999999999999996,"5min":0.79100000000000004,"15min":0.73499999999999999},"max":{"1min":1.5429999999999999,"5min":1.76,"15min":3.2349999999999999},"last":1.621},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.3839999999999999,"15min":1.383},"min":{"1min":1.093,"5min":0.88700000000000001,"15min":0.77700000000000002},"max":{"1min":1.744,"5min":2.008,"15min":2.5369999999999999},"last":1.379}]},{"osd":5,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3540000000000001,"15min":1.3740000000000001},"min":{"1min":1.1060000000000001,"5min":0.90800000000000003,"15min":0.85599999999999998},"max":{"1min":1.7250000000000001,"5min":1.798,"15min":2.988},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.395,"5min":1.327,"15min":1.361},"min":{"1min":1.093,"5min":0.81599999999999995,"15min":0.77000000000000002},"max":{"1min":1.6020000000000001,"5min":1.712,"15min":2.843},"last":1.7789999999999999}]},{"osd":6,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.472,"15min":1.462},"min":{"1min":1.1100000000000001,"5min":0.88300000000000001,"15min":0.81100000000000005},"max":{"1min":1.825,"5min":2.0760000000000001,"15min":2.431},"last":1.552},{"interface":"front","average":{"1min":1.5,"5min":1.4419999999999999,"15min":1.4339999999999999},"min":{"1min":0.98699999999999999,"5min":0.85799999999999998,"15min":0.67600000000000005},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.589},"last":1.6839999999999999}]},{"osd":7,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.5880000000000001,"5min":1.4890000000000001,"15min":1.5029999999999999},"min":{"1min":1.175,"5min":0.89500000000000002,"15min":0.78600000000000003},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.7410000000000001},"last":1.5900000000000001},{"interface":"front","average":{"1min":1.49,"5min":1.3779999999999999,"15min":1.4259999999999999},"min":{"1min":1.2090000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.972,"5min":1.972,"15min":2.8929999999999998},"last":2.0110000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-12T17:33:15.919 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-12T17:33:16.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.145+0000 7f749c400640 1 Processor -- start 2024-03-12T17:33:16.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.145+0000 7f749c400640 1 -- start start 2024-03-12T17:33:16.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.147+0000 7f749c400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f74940ced90 0x7f74940b1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:16.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.147+0000 7f749c400640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f749406c3f0 0x7f74940b3240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:16.143 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.147+0000 7f749c400640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74940b3bd0 con 0x7f74940b3780 2024-03-12T17:33:16.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.147+0000 7f749c400640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74940cb340 con 0x7f74940ced90 2024-03-12T17:33:16.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.147+0000 7f749c400640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7494159d50 con 0x7f749406c3f0 2024-03-12T17:33:16.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.147+0000 7f7499a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f74940ced90 0x7f74940b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:16.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.147+0000 7f7499a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f74940ced90 0x7f74940b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35824/0 (socket says 172.21.15.17:35824) 2024-03-12T17:33:16.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.147+0000 7f7499a00640 1 -- 172.21.15.17:0/520099049 learned_addr learned my addr 172.21.15.17:0/520099049 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:16.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.148+0000 7f7499000640 1 --2- 172.21.15.17:0/520099049 >> v2:172.21.15.94:3300/0 conn(0x7f749406c3f0 0x7f74940b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:16.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.148+0000 7f7499a00640 1 -- 172.21.15.17:0/520099049 >> v2:172.21.15.94:3300/0 conn(0x7f749406c3f0 msgr2=0x7f74940b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:16.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.148+0000 7f7499a00640 1 --2- 172.21.15.17:0/520099049 >> v2:172.21.15.94:3300/0 conn(0x7f749406c3f0 0x7f74940b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:16.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.148+0000 7f7499a00640 1 -- 172.21.15.17:0/520099049 >> v1:172.21.15.94:6789/0 conn(0x7f74940b3780 legacy=0x7f749415d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:16.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.148+0000 7f7499a00640 1 -- 172.21.15.17:0/520099049 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74940b1c50 con 0x7f74940ced90 2024-03-12T17:33:16.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.149+0000 7f7499a00640 1 --2- 172.21.15.17:0/520099049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74940ced90 0x7f74940b1710 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f7494071520 tx=0x7f748802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dac3e824fc6f7a95 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:16.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.149+0000 7f7493e00640 1 -- 172.21.15.17:0/520099049 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748802ca80 con 0x7f74940ced90 2024-03-12T17:33:16.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.149+0000 7f7493e00640 1 -- 172.21.15.17:0/520099049 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748802cbe0 con 0x7f74940ced90 2024-03-12T17:33:16.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.149+0000 7f7493e00640 1 -- 172.21.15.17:0/520099049 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74880343f0 con 0x7f74940ced90 2024-03-12T17:33:16.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.150+0000 7f749c400640 1 -- 172.21.15.17:0/520099049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74940ced90 msgr2=0x7f74940b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:16.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.150+0000 7f749c400640 1 --2- 172.21.15.17:0/520099049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74940ced90 0x7f74940b1710 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f7494071520 tx=0x7f748802bee0 comp rx=0 tx=0).stop 2024-03-12T17:33:16.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.150+0000 7f749c400640 1 -- 172.21.15.17:0/520099049 shutdown_connections 2024-03-12T17:33:16.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.150+0000 7f749c400640 1 --2- 172.21.15.17:0/520099049 >> v2:172.21.15.94:3300/0 conn(0x7f749406c3f0 0x7f74940b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:16.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.150+0000 7f749c400640 1 --2- 172.21.15.17:0/520099049 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74940ced90 0x7f74940b1710 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:16.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.150+0000 7f749c400640 1 -- 172.21.15.17:0/520099049 >> 172.21.15.17:0/520099049 conn(0x7f7494069ce0 msgr2=0x7f749406a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:16.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.150+0000 7f749c400640 1 -- 172.21.15.17:0/520099049 shutdown_connections 2024-03-12T17:33:16.146 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.150+0000 7f749c400640 1 -- 172.21.15.17:0/520099049 wait complete. 2024-03-12T17:33:16.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.153+0000 7f749c400640 1 Processor -- start 2024-03-12T17:33:16.149 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.153+0000 7f749c400640 1 -- start start 2024-03-12T17:33:16.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.154+0000 7f749c400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f749406c3f0 0x7f7494143aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:16.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.154+0000 7f749c400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74940b3780 0x7f74940af560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:16.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.154+0000 7f749c400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f74940ced90 0x7f74940afaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:16.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.154+0000 7f749c400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74940aeb10 con 0x7f74940b3780 2024-03-12T17:33:16.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.154+0000 7f749c400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74940aded0 con 0x7f749406c3f0 2024-03-12T17:33:16.150 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.154+0000 7f749c400640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74940ae170 con 0x7f74940ced90 2024-03-12T17:33:16.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.155+0000 7f7499000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74940b3780 0x7f74940af560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:16.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.155+0000 7f7499000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74940b3780 0x7f74940af560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35826/0 (socket says 172.21.15.17:35826) 2024-03-12T17:33:16.151 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.155+0000 7f7499000640 1 -- 172.21.15.17:0/2488709234 learned_addr learned my addr 172.21.15.17:0/2488709234 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:16.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.155+0000 7f7499a00640 1 --2- 172.21.15.17:0/2488709234 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f749406c3f0 0x7f7494143aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:16.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.155+0000 7f749a400640 1 --2- 172.21.15.17:0/2488709234 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f74940ced90 0x7f74940afaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:16.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.155+0000 7f7499000640 1 -- 172.21.15.17:0/2488709234 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f74940ced90 msgr2=0x7f74940afaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:16.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.155+0000 7f7499000640 1 --2- 172.21.15.17:0/2488709234 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f74940ced90 0x7f74940afaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:16.152 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.155+0000 7f7499000640 1 -- 172.21.15.17:0/2488709234 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f749406c3f0 msgr2=0x7f7494143aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:16.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.155+0000 7f7499000640 1 --2- 172.21.15.17:0/2488709234 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f749406c3f0 0x7f7494143aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:16.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.155+0000 7f7499000640 1 -- 172.21.15.17:0/2488709234 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7488009b30 con 0x7f74940b3780 2024-03-12T17:33:16.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.156+0000 7f7499000640 1 --2- 172.21.15.17:0/2488709234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74940b3780 0x7f74940af560 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f748000d800 tx=0x7f748000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:16.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.156+0000 7f7491600640 1 -- 172.21.15.17:0/2488709234 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748000b6c0 con 0x7f74940b3780 2024-03-12T17:33:16.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.156+0000 7f7491600640 1 -- 172.21.15.17:0/2488709234 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f748000b820 con 0x7f74940b3780 2024-03-12T17:33:16.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.156+0000 7f749c400640 1 -- 172.21.15.17:0/2488709234 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74940ae450 con 0x7f74940b3780 2024-03-12T17:33:16.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.156+0000 7f7491600640 1 -- 172.21.15.17:0/2488709234 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748000bbb0 con 0x7f74940b3780 2024-03-12T17:33:16.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.156+0000 7f749c400640 1 -- 172.21.15.17:0/2488709234 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74940aef30 con 0x7f74940b3780 2024-03-12T17:33:16.153 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.158+0000 7f749c400640 1 -- 172.21.15.17:0/2488709234 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74940af1b0 con 0x7f74940b3780 2024-03-12T17:33:16.154 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.158+0000 7f7491600640 1 -- 172.21.15.17:0/2488709234 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f748000bd10 con 0x7f74940b3780 2024-03-12T17:33:16.155 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.160+0000 7f7491600640 1 --2- 172.21.15.17:0/2488709234 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f747406ac00 0x7f747406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:16.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.160+0000 7f7491600640 1 -- 172.21.15.17:0/2488709234 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7480089730 con 0x7f74940b3780 2024-03-12T17:33:16.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.160+0000 7f7499a00640 1 --2- 172.21.15.17:0/2488709234 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f747406ac00 0x7f747406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:16.156 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.161+0000 7f7499a00640 1 --2- 172.21.15.17:0/2488709234 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f747406ac00 0x7f747406d0c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7488035000 tx=0x7f7488030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:16.160 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.164+0000 7f7491600640 1 -- 172.21.15.17:0/2488709234 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f74940af1b0 con 0x7f74940b3780 2024-03-12T17:33:16.359 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.363+0000 7f749c400640 1 -- 172.21.15.17:0/2488709234 --> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f74940b24b0 con 0x7f747406ac00 2024-03-12T17:33:16.361 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.366+0000 7f7491600640 1 -- 172.21.15.17:0/2488709234 <== mgr.4104 v2:172.21.15.17:6832/37052 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48147 (secure 0 0 0) 0x7f7488044090 con 0x7f747406ac00 2024-03-12T17:33:16.362 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:33:16.363 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-03-12T17:33:16.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.369+0000 7f749c400640 1 -- 172.21.15.17:0/2488709234 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f747406ac00 msgr2=0x7f747406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:16.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.369+0000 7f749c400640 1 --2- 172.21.15.17:0/2488709234 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f747406ac00 0x7f747406d0c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7488035000 tx=0x7f7488030000 comp rx=0 tx=0).stop 2024-03-12T17:33:16.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.369+0000 7f749c400640 1 -- 172.21.15.17:0/2488709234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74940b3780 msgr2=0x7f74940af560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:16.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.369+0000 7f749c400640 1 --2- 172.21.15.17:0/2488709234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74940b3780 0x7f74940af560 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f748000d800 tx=0x7f748000dcc0 comp rx=0 tx=0).stop 2024-03-12T17:33:16.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.369+0000 7f749c400640 1 -- 172.21.15.17:0/2488709234 shutdown_connections 2024-03-12T17:33:16.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.369+0000 7f749c400640 1 --2- 172.21.15.17:0/2488709234 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f747406ac00 0x7f747406d0c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:16.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.369+0000 7f749c400640 1 --2- 172.21.15.17:0/2488709234 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f74940ced90 0x7f74940afaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:16.365 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.369+0000 7f749c400640 1 --2- 172.21.15.17:0/2488709234 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f74940b3780 0x7f74940af560 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:16.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.369+0000 7f749c400640 1 --2- 172.21.15.17:0/2488709234 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f749406c3f0 0x7f7494143aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:16.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.369+0000 7f749c400640 1 -- 172.21.15.17:0/2488709234 >> 172.21.15.17:0/2488709234 conn(0x7f7494069ce0 msgr2=0x7f7494152400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:16.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.369+0000 7f749c400640 1 -- 172.21.15.17:0/2488709234 shutdown_connections 2024-03-12T17:33:16.366 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.369+0000 7f749c400640 1 -- 172.21.15.17:0/2488709234 wait complete. 2024-03-12T17:33:16.383 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":484,"stamp":"2024-03-12T17:33:15.792178+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":263156,"kb_used_data":6024,"kb_used_omap":13,"kb_used_meta":257010,"kb_avail":754711564,"statfs":{"total":773094113280,"available":772824641536,"internally_reserved":0,"allocated":6168576,"data_stored":3219712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":263178328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-20068777,"num_objects":-992,"num_object_clones":0,"num_object_copies":-1984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-992,"num_whiteouts":0,"num_read":-10,"num_read_kb":-7403,"num_write":-1673,"num_write_kb":-20891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-34,"num_bytes_recovered":-21858,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.239521"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":195,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-12T17:33:08.851398+0000","last_change":"2024-03-12T17:18:41.331756+0000","last_active":"2024-03-12T17:33:08.851398+0000","last_peered":"2024-03-12T17:33:08.851398+0000","last_clean":"2024-03-12T17:33:08.851398+0000","last_became_active":"2024-03-12T17:18:41.329237+0000","last_became_peered":"2024-03-12T17:18:41.329237+0000","last_unstale":"2024-03-12T17:33:08.851398+0000","last_undegraded":"2024-03-12T17:33:08.851398+0000","last_fullsized":"2024-03-12T17:33:08.851398+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:40.152422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:40.152422+0000","last_clean_scrub_stamp":"2024-03-12T17:18:40.152422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:35:43.664403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575026,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36400,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335440,"statfs":{"total":96636764160,"available":96599490560,"internally_reserved":0,"allocated":1216512,"data_stored":845240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.006,"15min":1.0369999999999999},"min":{"1min":0.67800000000000005,"5min":0.61699999999999999,"15min":0.48099999999999998},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":2.3730000000000002},"last":0.54100000000000004},{"interface":"front","average":{"1min":1.038,"5min":1.0289999999999999,"15min":1.0369999999999999},"min":{"1min":0.67700000000000005,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.494,"5min":1.5469999999999999,"15min":2.2330000000000001},"last":0.55400000000000005}]},{"osd":1,"last update":"Tue Mar 12 17:33:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0129999999999999,"15min":1.02},"min":{"1min":0.753,"5min":0.67200000000000004,"15min":0.52200000000000002},"max":{"1min":1.5,"5min":1.5,"15min":1.7050000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.111,"15min":1.123},"min":{"1min":0.73999999999999999,"5min":0.72699999999999998,"15min":0.61299999999999999},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":2.363},"last":0.51100000000000001}]},{"osd":2,"last update":"Tue Mar 12 17:33:06 2024","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.171,"15min":1.179},"min":{"1min":0.747,"5min":0.68100000000000005,"15min":0.60799999999999998},"max":{"1min":1.4339999999999999,"5min":1.655,"15min":1.827},"last":0.58599999999999997},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.22,"15min":1.2290000000000001},"min":{"1min":0.92500000000000004,"5min":0.83999999999999997,"15min":0.625},"max":{"1min":1.6379999999999999,"5min":1.7949999999999999,"15min":2.0870000000000002},"last":0.52600000000000002}]},{"osd":3,"last update":"Tue Mar 12 17:33:06 2024","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.2010000000000001,"15min":1.212},"min":{"1min":0.871,"5min":0.70699999999999996,"15min":0.55800000000000005},"max":{"1min":1.4710000000000001,"5min":1.722,"15min":1.921},"last":0.63500000000000001},{"interface":"front","average":{"1min":1.216,"5min":1.2709999999999999,"15min":1.2669999999999999},"min":{"1min":0.89300000000000002,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.4870000000000001,"5min":1.738,"15min":2.1499999999999999},"last":0.61799999999999999}]},{"osd":4,"last update":"Tue Mar 12 17:33:06 2024","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.1739999999999999,"15min":1.1990000000000001},"min":{"1min":0.79600000000000004,"5min":0.71299999999999997,"15min":0.51400000000000001},"max":{"1min":1.635,"5min":1.635,"15min":2.2349999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.351,"15min":1.381},"min":{"1min":1.105,"5min":0.84799999999999998,"15min":0.63700000000000001},"max":{"1min":1.635,"5min":1.786,"15min":2.2490000000000001},"last":0.70299999999999996}]},{"osd":5,"last update":"Tue Mar 12 17:33:06 2024","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.2969999999999999,"15min":1.3109999999999999},"min":{"1min":0.84699999999999998,"5min":0.66600000000000004,"15min":0.53100000000000003},"max":{"1min":1.615,"5min":1.833,"15min":2.323},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.427,"5min":1.379,"15min":1.4279999999999999},"min":{"1min":1.1200000000000001,"5min":0.85499999999999998,"15min":0.61099999999999999},"max":{"1min":1.8140000000000001,"5min":1.8140000000000001,"15min":3.9689999999999999},"last":0.77600000000000002}]},{"osd":6,"last update":"Tue Mar 12 17:33:06 2024","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.425,"15min":1.462},"min":{"1min":1.2130000000000001,"5min":0.94399999999999995,"15min":0.69999999999999996},"max":{"1min":1.722,"5min":1.8340000000000001,"15min":3.8319999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.4019999999999999,"15min":1.429},"min":{"1min":0.99099999999999999,"5min":0.627,"15min":0.55100000000000005},"max":{"1min":1.6379999999999999,"5min":1.891,"15min":2.4609999999999999},"last":0.749}]}]},{"osd":6,"up_from":13,"seq":55834575025,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31724,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340116,"statfs":{"total":96636764160,"available":96604278784,"internally_reserved":0,"allocated":622592,"data_stored":254872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.101,"15min":1.0629999999999999},"min":{"1min":0.72399999999999998,"5min":0.68600000000000005,"15min":0.54400000000000004},"max":{"1min":1.556,"5min":1.71,"15min":3.5390000000000001},"last":1.155},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.085,"15min":1.0569999999999999},"min":{"1min":0.80400000000000005,"5min":0.65700000000000003,"15min":0.60899999999999999},"max":{"1min":1.5269999999999999,"5min":1.6220000000000001,"15min":1.73},"last":1.458}]},{"osd":1,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.2789999999999999,"15min":1.2330000000000001},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.33900000000000002},"max":{"1min":1.5680000000000001,"5min":1.778,"15min":6.7450000000000001},"last":1.044},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.2889999999999999,"15min":1.2769999999999999},"min":{"1min":0.89900000000000002,"5min":0.73199999999999998,"15min":0.70199999999999996},"max":{"1min":1.681,"5min":1.734,"15min":4.1909999999999998},"last":1.3129999999999999}]},{"osd":2,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.2689999999999999,"15min":1.2410000000000001},"min":{"1min":0.93400000000000005,"5min":0.83899999999999997,"15min":0.41299999999999998},"max":{"1min":1.512,"5min":1.6799999999999999,"15min":6.6879999999999997},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.3149999999999999,"15min":1.3},"min":{"1min":1.181,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.6899999999999999,"5min":1.8240000000000001,"15min":2.9689999999999999},"last":0.73999999999999999}]},{"osd":3,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.2390000000000001,"15min":1.2050000000000001},"min":{"1min":0.72999999999999998,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.546,"5min":1.6759999999999999,"15min":1.7749999999999999},"last":1.528},{"interface":"front","average":{"1min":1.248,"5min":1.254,"15min":1.246},"min":{"1min":0.86399999999999999,"5min":0.73899999999999999,"15min":0.46200000000000002},"max":{"1min":1.48,"5min":1.7170000000000001,"15min":6.6070000000000002},"last":1.214}]},{"osd":4,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.244,"15min":1.256},"min":{"1min":0.91000000000000003,"5min":0.80100000000000005,"15min":0.68300000000000005},"max":{"1min":1.605,"5min":1.6950000000000001,"15min":2.2130000000000001},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.2669999999999999,"15min":1.256},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.59499999999999997},"max":{"1min":1.7849999999999999,"5min":1.976,"15min":1.976},"last":1.2470000000000001}]},{"osd":5,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.3959999999999999,"15min":1.3959999999999999},"min":{"1min":1.2010000000000001,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":2.0649999999999999,"5min":2.0649999999999999,"15min":2.8660000000000001},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3680000000000001,"15min":1.373},"min":{"1min":1,"5min":0.88,"15min":0.51900000000000002},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":6.4939999999999998},"last":1.286}]},{"osd":7,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.4279999999999999,"15min":1.454},"min":{"1min":1.1559999999999999,"5min":0.92000000000000004,"15min":0.64000000000000001},"max":{"1min":1.978,"5min":1.978,"15min":2.2069999999999999},"last":1.488},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.5449999999999999,"15min":1.5289999999999999},"min":{"1min":1.319,"5min":1.016,"15min":0.77500000000000002},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.258},"last":1.5800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575026,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31728,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":622592,"data_stored":254872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.0629999999999999,"15min":1.111},"min":{"1min":0.66100000000000003,"5min":0.60599999999999998,"15min":0.56399999999999995},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":2.161},"last":1.6339999999999999},{"interface":"front","average":{"1min":1.099,"5min":1.1140000000000001,"15min":1.145},"min":{"1min":0.72199999999999998,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.3899999999999999,"5min":1.5149999999999999,"15min":1.95},"last":1.1930000000000001}]},{"osd":1,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1279999999999999,"15min":1.1359999999999999},"min":{"1min":0.75,"5min":0.70499999999999996,"15min":0.69199999999999995},"max":{"1min":1.496,"5min":1.698,"15min":1.75},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1779999999999999,"15min":1.222},"min":{"1min":0.82799999999999996,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":2.5699999999999998},"last":1.3560000000000001}]},{"osd":2,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.212,"15min":1.234},"min":{"1min":0.96799999999999997,"5min":0.76000000000000001,"15min":0.71599999999999997},"max":{"1min":1.6220000000000001,"5min":1.7190000000000001,"15min":2.613},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.226,"15min":1.2310000000000001},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.524,"5min":1.897,"15min":2.359},"last":0.85799999999999998}]},{"osd":3,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2569999999999999,"15min":1.3089999999999999},"min":{"1min":0.77900000000000003,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.4930000000000001,"5min":1.75,"15min":2.6829999999999998},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.3,"15min":1.3280000000000001},"min":{"1min":0.90900000000000003,"5min":0.874,"15min":0.80500000000000005},"max":{"1min":1.5720000000000001,"5min":1.724,"15min":2.3559999999999999},"last":1.0620000000000001}]},{"osd":4,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2,"15min":1.248},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.73699999999999999},"max":{"1min":1.655,"5min":1.6719999999999999,"15min":2.0510000000000002},"last":0.996},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.306,"15min":1.361},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.76700000000000002},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":2.3999999999999999},"last":1.5249999999999999}]},{"osd":6,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.3160000000000001,"15min":1.375},"min":{"1min":0.91700000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.718,"5min":1.75,"15min":2.488},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.365,"15min":1.4179999999999999},"min":{"1min":1.1719999999999999,"5min":0.97199999999999998,"15min":0.66100000000000003},"max":{"1min":1.601,"5min":1.7949999999999999,"15min":2.2759999999999998},"last":1.4199999999999999}]},{"osd":7,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.413,"15min":1.4950000000000001},"min":{"1min":0.97799999999999998,"5min":0.95299999999999996,"15min":0.95299999999999996},"max":{"1min":1.696,"5min":1.7470000000000001,"15min":2.8700000000000001},"last":1.587},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.47,"15min":1.5249999999999999},"min":{"1min":1.073,"5min":0.87,"15min":0.87},"max":{"1min":1.72,"5min":1.833,"15min":2.722},"last":1.405}]}]},{"osd":4,"up_from":13,"seq":55834575026,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31728,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":622592,"data_stored":254872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1259999999999999,"15min":1.091},"min":{"1min":0.70099999999999996,"5min":0.67300000000000004,"15min":0.60799999999999998},"max":{"1min":1.679,"5min":1.7330000000000001,"15min":4.8979999999999997},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.996,"5min":1.073,"15min":1.0900000000000001},"min":{"1min":0.73299999999999998,"5min":0.67900000000000005,"15min":0.57699999999999996},"max":{"1min":1.4410000000000001,"5min":1.659,"15min":4.8300000000000001},"last":1.3520000000000001}]},{"osd":1,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1359999999999999,"15min":1.1339999999999999},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.64100000000000001},"max":{"1min":1.609,"5min":1.647,"15min":4.7779999999999996},"last":0.998},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.2070000000000001,"15min":1.161},"min":{"1min":0.82299999999999995,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.6100000000000001,"5min":1.887,"15min":1.911},"last":1.274}]},{"osd":2,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.2569999999999999,"15min":1.226},"min":{"1min":0.88,"5min":0.65800000000000003,"15min":0.60199999999999998},"max":{"1min":1.5409999999999999,"5min":1.6870000000000001,"15min":1.7450000000000001},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.351,"5min":1.3340000000000001,"15min":1.3049999999999999},"min":{"1min":1.028,"5min":0.81899999999999995,"15min":0.78500000000000003},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":2.3220000000000001},"last":1.397}]},{"osd":3,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.2310000000000001,"15min":1.24},"min":{"1min":0.90200000000000002,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.444,"5min":1.78,"15min":1.7949999999999999},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.2310000000000001,"15min":1.2290000000000001},"min":{"1min":0.90500000000000003,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.581,"5min":1.7130000000000001,"15min":1.9119999999999999},"last":1.1140000000000001}]},{"osd":5,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.3300000000000001,"15min":1.325},"min":{"1min":0.93400000000000005,"5min":0.83299999999999996,"15min":0.60499999999999998},"max":{"1min":1.766,"5min":1.766,"15min":2.1589999999999998},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.49,"5min":1.4159999999999999,"15min":1.3899999999999999},"min":{"1min":0.85999999999999999,"5min":0.79600000000000004,"15min":0.76700000000000002},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":2.5390000000000001},"last":1.458}]},{"osd":6,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.248,"15min":1.264},"min":{"1min":0.86299999999999999,"5min":0.81599999999999995,"15min":0.65900000000000003},"max":{"1min":1.5880000000000001,"5min":1.8009999999999999,"15min":1.885},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.508,"5min":1.3999999999999999,"15min":1.3919999999999999},"min":{"1min":1.0649999999999999,"5min":0.83299999999999996,"15min":0.63300000000000001},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.4750000000000001},"last":1.5169999999999999}]},{"osd":7,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.3979999999999999,"15min":1.4079999999999999},"min":{"1min":1.159,"5min":0.97799999999999998,"15min":0.56299999999999994},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":2.1200000000000001},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.427,"15min":1.425},"min":{"1min":0.97799999999999998,"5min":0.96999999999999997,"15min":0.67600000000000005},"max":{"1min":1.72,"5min":1.9199999999999999,"15min":2.4260000000000002},"last":1.3759999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575026,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35820,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336020,"statfs":{"total":96636764160,"available":96600084480,"internally_reserved":0,"allocated":622592,"data_stored":254872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.84999999999999998,"15min":0.88300000000000001},"min":{"1min":0.51000000000000001,"5min":0.432,"15min":0.35099999999999998},"max":{"1min":1.306,"5min":1.5189999999999999,"15min":2.9580000000000002},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.995,"5min":0.93999999999999995,"15min":0.95699999999999996},"min":{"1min":0.67800000000000005,"5min":0.55800000000000005,"15min":0.48199999999999998},"max":{"1min":1.401,"5min":1.651,"15min":3.9940000000000002},"last":1.1890000000000001}]},{"osd":1,"last update":"Tue Mar 12 17:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.89700000000000002,"15min":0.91900000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.38600000000000001},"max":{"1min":1.4019999999999999,"5min":1.5940000000000001,"15min":4.774},"last":1.222},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0449999999999999,"15min":1.0720000000000001},"min":{"1min":0.60599999999999998,"5min":0.58499999999999996,"15min":0.40999999999999998},"max":{"1min":1.647,"5min":1.647,"15min":5.0069999999999997},"last":0.91800000000000004}]},{"osd":2,"last update":"Tue Mar 12 17:32:56 2024","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.135,"15min":1.155},"min":{"1min":0.78200000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":2.4660000000000002},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.2250000000000001,"15min":1.2709999999999999},"min":{"1min":0.70499999999999996,"5min":0.57399999999999995,"15min":0.439},"max":{"1min":1.6020000000000001,"5min":1.7509999999999999,"15min":4.5650000000000004},"last":1.6299999999999999}]},{"osd":4,"last update":"Tue Mar 12 17:32:56 2024","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.24,"15min":1.272},"min":{"1min":0.84899999999999998,"5min":0.80700000000000005,"15min":0.67200000000000004},"max":{"1min":1.74,"5min":1.74,"15min":2.8860000000000001},"last":1.147},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2390000000000001,"15min":1.28},"min":{"1min":0.88300000000000001,"5min":0.80800000000000005,"15min":0.73399999999999999},"max":{"1min":1.546,"5min":1.6259999999999999,"15min":4.3520000000000003},"last":1.357}]},{"osd":5,"last update":"Tue Mar 12 17:32:56 2024","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.339,"15min":1.3500000000000001},"min":{"1min":0.91500000000000004,"5min":0.84799999999999998,"15min":0.76200000000000001},"max":{"1min":1.649,"5min":1.9059999999999999,"15min":2.843},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.3069999999999999,"15min":1.3320000000000001},"min":{"1min":0.96299999999999997,"5min":0.81399999999999995,"15min":0.68300000000000005},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.8149999999999999},"last":1.4830000000000001}]},{"osd":6,"last update":"Tue Mar 12 17:32:56 2024","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.4059999999999999,"15min":1.4379999999999999},"min":{"1min":1.1359999999999999,"5min":0.79600000000000004,"15min":0.71699999999999997},"max":{"1min":1.7509999999999999,"5min":2.0299999999999998,"15min":2.9199999999999999},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4039999999999999,"15min":1.423},"min":{"1min":1.0329999999999999,"5min":0.878,"15min":0.86399999999999999},"max":{"1min":1.982,"5min":1.982,"15min":2.6589999999999998},"last":1.6000000000000001}]},{"osd":7,"last update":"Tue Mar 12 17:32:56 2024","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.351,"15min":1.3959999999999999},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.83899999999999997},"max":{"1min":1.661,"5min":1.7450000000000001,"15min":4.6600000000000001},"last":1.528},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.4350000000000001,"15min":1.4670000000000001},"min":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.76800000000000002},"max":{"1min":1.7529999999999999,"5min":1.8240000000000001,"15min":4.4720000000000004},"last":1.6919999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575026,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31728,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":622592,"data_stored":254872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.97299999999999998,"15min":0.95499999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.40000000000000002},"max":{"1min":1.3540000000000001,"5min":2.097,"15min":3.1829999999999998},"last":0.60699999999999998},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0960000000000001,"15min":1.0800000000000001},"min":{"1min":0.66800000000000004,"5min":0.63400000000000001,"15min":0.50700000000000001},"max":{"1min":1.532,"5min":1.694,"15min":2.8199999999999998},"last":0.56299999999999994}]},{"osd":1,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":0.94199999999999995,"15min":0.94099999999999995},"min":{"1min":0.69199999999999995,"5min":0.49099999999999999,"15min":0.308},"max":{"1min":1.9259999999999999,"5min":2.0529999999999999,"15min":2.7360000000000002},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.119,"15min":1.099},"min":{"1min":0.621,"5min":0.621,"15min":0.44700000000000001},"max":{"1min":1.583,"5min":2.2010000000000001,"15min":3.1019999999999999},"last":0.81699999999999995}]},{"osd":3,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.117,"15min":1.1160000000000001},"min":{"1min":0.72599999999999998,"5min":0.629,"15min":0.45000000000000001},"max":{"1min":1.6020000000000001,"5min":1.883,"15min":2.7810000000000001},"last":0.63},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2270000000000001,"15min":1.2130000000000001},"min":{"1min":0.76500000000000001,"5min":0.66900000000000004,"15min":0.48299999999999998},"max":{"1min":1.5920000000000001,"5min":1.758,"15min":3.1419999999999999},"last":0.77300000000000002}]},{"osd":4,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.3420000000000001,"15min":1.3919999999999999},"min":{"1min":0.92900000000000005,"5min":0.86699999999999999,"15min":0.76100000000000001},"max":{"1min":1.7,"5min":1.9450000000000001,"15min":7.96},"last":1.264},{"interface":"front","average":{"1min":1.282,"5min":1.266,"15min":1.2789999999999999},"min":{"1min":0.82299999999999995,"5min":0.78800000000000003,"15min":0.67700000000000005},"max":{"1min":1.7210000000000001,"5min":1.806,"15min":3.3780000000000001},"last":0.88}]},{"osd":5,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.333,"15min":1.351},"min":{"1min":0.91800000000000004,"5min":0.89000000000000001,"15min":0.70399999999999996},"max":{"1min":1.8839999999999999,"5min":1.9059999999999999,"15min":4.0659999999999998},"last":1.097},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3320000000000001,"15min":1.3700000000000001},"min":{"1min":0.98599999999999999,"5min":0.86699999999999999,"15min":0.63800000000000001},"max":{"1min":1.649,"5min":1.929,"15min":3.012},"last":0.85199999999999998}]},{"osd":6,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.393,"15min":1.4019999999999999},"min":{"1min":1.1459999999999999,"5min":0.86599999999999999,"15min":0.74099999999999999},"max":{"1min":1.7729999999999999,"5min":2.1099999999999999,"15min":3.2330000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.389,"5min":1.4870000000000001,"15min":1.5169999999999999},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.68899999999999995},"max":{"1min":1.802,"5min":2.4100000000000001,"15min":7.9059999999999997},"last":1.1870000000000001}]},{"osd":7,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.423,"15min":1.4299999999999999},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.64700000000000002},"max":{"1min":1.8420000000000001,"5min":2.0529999999999999,"15min":4.0229999999999997},"last":1.036},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4750000000000001,"15min":1.4950000000000001},"min":{"1min":1.0509999999999999,"5min":0.95099999999999996,"15min":0.84499999999999997},"max":{"1min":1.885,"5min":2.0950000000000002,"15min":3.27},"last":1.0700000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575026,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31724,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340116,"statfs":{"total":96636764160,"available":96604278784,"internally_reserved":0,"allocated":622592,"data_stored":254872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.89800000000000002,"15min":0.88800000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.29,"5min":1.6699999999999999,"15min":1.7749999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.0149999999999999,"15min":1.0449999999999999},"min":{"1min":0.60999999999999999,"5min":0.59399999999999997,"15min":0.47499999999999998},"max":{"1min":1.76,"5min":1.869,"15min":7.6449999999999996},"last":1.76}]},{"osd":2,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.97099999999999997,"15min":0.95199999999999996},"min":{"1min":0.628,"5min":0.53200000000000003,"15min":0.40799999999999997},"max":{"1min":1.272,"5min":1.7629999999999999,"15min":1.9299999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.095,"15min":1.0669999999999999},"min":{"1min":0.58799999999999997,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.325,"5min":1.708,"15min":2.5720000000000001},"last":1.325}]},{"osd":3,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.208,"15min":1.242},"min":{"1min":0.625,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.681,"5min":1.875,"15min":2.4580000000000002},"last":1.526},{"interface":"front","average":{"1min":1.02,"5min":1.155,"15min":1.1599999999999999},"min":{"1min":0.56399999999999995,"5min":0.501,"15min":0.42499999999999999},"max":{"1min":1.502,"5min":1.8460000000000001,"15min":3.319},"last":1.218}]},{"osd":4,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.246,"15min":1.2350000000000001},"min":{"1min":0.77400000000000002,"5min":0.70799999999999996,"15min":0.63300000000000001},"max":{"1min":1.5700000000000001,"5min":1.9039999999999999,"15min":2.4580000000000002},"last":1.5700000000000001},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.363,"15min":1.355},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.70999999999999996},"max":{"1min":1.599,"5min":2.0680000000000001,"15min":2.6909999999999998},"last":1.599}]},{"osd":5,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.3740000000000001,"15min":1.3660000000000001},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.67200000000000004},"max":{"1min":1.629,"5min":1.9650000000000001,"15min":3.0609999999999999},"last":1.629},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3440000000000001,"15min":1.353},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.73299999999999998},"max":{"1min":1.8169999999999999,"5min":1.9339999999999999,"15min":2.4169999999999998},"last":1.1659999999999999}]},{"osd":6,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.4419999999999999,"15min":1.4299999999999999},"min":{"1min":0.752,"5min":0.752,"15min":0.70099999999999996},"max":{"1min":1.9139999999999999,"5min":2.137,"15min":3.1030000000000002},"last":1.9139999999999999},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.405,"15min":1.4059999999999999},"min":{"1min":0.874,"5min":0.874,"15min":0.82999999999999996},"max":{"1min":1.7509999999999999,"5min":2.0219999999999998,"15min":2.274},"last":1.492}]},{"osd":7,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.4950000000000001,"15min":1.47},"min":{"1min":1.129,"5min":0.85799999999999998,"15min":0.70899999999999996},"max":{"1min":1.7030000000000001,"5min":2.1659999999999999,"15min":2.7959999999999998},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.5389999999999999,"15min":1.518},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.73,"5min":2.2509999999999999,"15min":3.1440000000000001},"last":1.405}]}]},{"osd":0,"up_from":13,"seq":55834575025,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1216512,"data_stored":845240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.92100000000000004,"15min":0.92900000000000005},"min":{"1min":0.71899999999999997,"5min":0.46000000000000002,"15min":0.41799999999999998},"max":{"1min":1.45,"5min":1.829,"15min":1.829},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0469999999999999,"15min":1.028},"min":{"1min":0.54700000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.504,"5min":1.8280000000000001,"15min":2.3740000000000001},"last":1.1240000000000001}]},{"osd":2,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.054,"15min":1.056},"min":{"1min":0.80200000000000005,"5min":0.56999999999999995,"15min":0.52300000000000002},"max":{"1min":1.528,"5min":1.792,"15min":1.99},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.089,"5min":1.105,"15min":1.1000000000000001},"min":{"1min":0.621,"5min":0.51200000000000001,"15min":0.45500000000000002},"max":{"1min":1.591,"5min":1.752,"15min":2.468},"last":1.76}]},{"osd":3,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.002,"15min":1.016},"min":{"1min":0.58299999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.5449999999999999,"5min":1.8340000000000001,"15min":2.085},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.234,"15min":1.2310000000000001},"min":{"1min":0.73099999999999998,"5min":0.63800000000000001,"15min":0.56899999999999995},"max":{"1min":1.6479999999999999,"5min":1.78,"15min":2.286},"last":0.95899999999999996}]},{"osd":4,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2390000000000001,"15min":1.262},"min":{"1min":0.94999999999999996,"5min":0.79100000000000004,"15min":0.73499999999999999},"max":{"1min":1.5429999999999999,"5min":1.76,"15min":3.2349999999999999},"last":1.621},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.3839999999999999,"15min":1.383},"min":{"1min":1.093,"5min":0.88700000000000001,"15min":0.77700000000000002},"max":{"1min":1.744,"5min":2.008,"15min":2.5369999999999999},"last":1.379}]},{"osd":5,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3540000000000001,"15min":1.3740000000000001},"min":{"1min":1.1060000000000001,"5min":0.90800000000000003,"15min":0.85599999999999998},"max":{"1min":1.7250000000000001,"5min":1.798,"15min":2.988},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.395,"5min":1.327,"15min":1.361},"min":{"1min":1.093,"5min":0.81599999999999995,"15min":0.77000000000000002},"max":{"1min":1.6020000000000001,"5min":1.712,"15min":2.843},"last":1.7789999999999999}]},{"osd":6,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.472,"15min":1.462},"min":{"1min":1.1100000000000001,"5min":0.88300000000000001,"15min":0.81100000000000005},"max":{"1min":1.825,"5min":2.0760000000000001,"15min":2.431},"last":1.552},{"interface":"front","average":{"1min":1.5,"5min":1.4419999999999999,"15min":1.4339999999999999},"min":{"1min":0.98699999999999999,"5min":0.85799999999999998,"15min":0.67600000000000005},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.589},"last":1.6839999999999999}]},{"osd":7,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.5880000000000001,"5min":1.4890000000000001,"15min":1.5029999999999999},"min":{"1min":1.175,"5min":0.89500000000000002,"15min":0.78600000000000003},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.7410000000000001},"last":1.5900000000000001},{"interface":"front","average":{"1min":1.49,"5min":1.3779999999999999,"15min":1.4259999999999999},"min":{"1min":1.2090000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.972,"5min":1.972,"15min":2.8929999999999998},"last":2.0110000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-12T17:33:16.385 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-12T17:33:16.385 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-12T17:33:16.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.594+0000 7ff629400640 1 Processor -- start 2024-03-12T17:33:16.590 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.595+0000 7ff629400640 1 -- start start 2024-03-12T17:33:16.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.596+0000 7ff629400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff62415caa0 0x7ff624160790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:16.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.596+0000 7ff629400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7ff6240cfa40 0x7ff6240d12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:16.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.596+0000 7ff629400640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff624161650 con 0x7ff62415ce80 2024-03-12T17:33:16.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.596+0000 7ff629400640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff624161090 con 0x7ff6240cfa40 2024-03-12T17:33:16.592 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.596+0000 7ff629400640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff624161370 con 0x7ff62415caa0 2024-03-12T17:33:16.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.597+0000 7ff623400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7ff62415ce80 0x7ff6240cf330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37582/0 (socket says 172.21.15.17:37582) 2024-03-12T17:33:16.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.597+0000 7ff623400640 1 -- 172.21.15.17:0/927943681 learned_addr learned my addr 172.21.15.17:0/927943681 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:33:16.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.597+0000 7ff623e00640 1 --2- 172.21.15.17:0/927943681 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff62415caa0 0x7ff624160790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:16.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.597+0000 7ff628a00640 1 --2- 172.21.15.17:0/927943681 >> v2:172.21.15.17:3300/0 conn(0x7ff6240cfa40 0x7ff6240d12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:16.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.597+0000 7ff622a00640 1 -- 172.21.15.17:0/927943681 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3626048870 0 0) 0x7ff624161650 con 0x7ff62415ce80 2024-03-12T17:33:16.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.597+0000 7ff622a00640 1 -- 172.21.15.17:0/927943681 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff608003520 con 0x7ff62415ce80 2024-03-12T17:33:16.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.598+0000 7ff628a00640 1 -- 172.21.15.17:0/927943681 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff62415caa0 msgr2=0x7ff624160790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:16.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.598+0000 7ff628a00640 1 --2- 172.21.15.17:0/927943681 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff62415caa0 0x7ff624160790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:16.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.598+0000 7ff628a00640 1 -- 172.21.15.17:0/927943681 >> v1:172.21.15.17:6789/0 conn(0x7ff62415ce80 legacy=0x7ff6240cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:16.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.598+0000 7ff628a00640 1 -- 172.21.15.17:0/927943681 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6240d0ad0 con 0x7ff6240cfa40 2024-03-12T17:33:16.594 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.599+0000 7ff628a00640 1 --2- 172.21.15.17:0/927943681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6240cfa40 0x7ff6240d12d0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff61c009d90 tx=0x7ff61c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b3b5ca31f9e565 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:16.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.600+0000 7ff622a00640 1 -- 172.21.15.17:0/927943681 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61c02cc60 con 0x7ff6240cfa40 2024-03-12T17:33:16.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.600+0000 7ff622a00640 1 -- 172.21.15.17:0/927943681 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff61c02cdc0 con 0x7ff6240cfa40 2024-03-12T17:33:16.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.600+0000 7ff622a00640 1 -- 172.21.15.17:0/927943681 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61c034660 con 0x7ff6240cfa40 2024-03-12T17:33:16.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.600+0000 7ff629400640 1 -- 172.21.15.17:0/927943681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6240cfa40 msgr2=0x7ff6240d12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:16.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.600+0000 7ff629400640 1 --2- 172.21.15.17:0/927943681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6240cfa40 0x7ff6240d12d0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff61c009d90 tx=0x7ff61c02beb0 comp rx=0 tx=0).stop 2024-03-12T17:33:16.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.600+0000 7ff629400640 1 -- 172.21.15.17:0/927943681 shutdown_connections 2024-03-12T17:33:16.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.600+0000 7ff629400640 1 --2- 172.21.15.17:0/927943681 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6240cfa40 0x7ff6240d12d0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:16.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.600+0000 7ff629400640 1 --2- 172.21.15.17:0/927943681 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff62415caa0 0x7ff624160790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:16.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.600+0000 7ff629400640 1 -- 172.21.15.17:0/927943681 >> 172.21.15.17:0/927943681 conn(0x7ff62406b160 msgr2=0x7ff62406b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:16.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.600+0000 7ff629400640 1 -- 172.21.15.17:0/927943681 shutdown_connections 2024-03-12T17:33:16.596 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.600+0000 7ff629400640 1 -- 172.21.15.17:0/927943681 wait complete. 2024-03-12T17:33:16.597 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.602+0000 7ff629400640 1 Processor -- start 2024-03-12T17:33:16.598 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.602+0000 7ff629400640 1 -- start start 2024-03-12T17:33:16.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.603+0000 7ff629400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6240cfa40 0x7ff6240c7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:16.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.603+0000 7ff629400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff62415caa0 0x7ff6241f23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:16.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.603+0000 7ff629400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff62415ce80 0x7ff6240c6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:16.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.603+0000 7ff629400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6240c8300 con 0x7ff6240cfa40 2024-03-12T17:33:16.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.603+0000 7ff629400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6240c7f60 con 0x7ff62415caa0 2024-03-12T17:33:16.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.603+0000 7ff629400640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6241f2c60 con 0x7ff62415ce80 2024-03-12T17:33:16.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.603+0000 7ff623e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6240cfa40 0x7ff6240c7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:16.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.603+0000 7ff623e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6240cfa40 0x7ff6240c7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35850/0 (socket says 172.21.15.17:35850) 2024-03-12T17:33:16.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.603+0000 7ff623e00640 1 -- 172.21.15.17:0/1084043125 learned_addr learned my addr 172.21.15.17:0/1084043125 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:16.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.604+0000 7ff623400640 1 --2- 172.21.15.17:0/1084043125 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff62415caa0 0x7ff6241f23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:16.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.604+0000 7ff628a00640 1 --2- 172.21.15.17:0/1084043125 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff62415ce80 0x7ff6240c6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:16.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.604+0000 7ff623e00640 1 -- 172.21.15.17:0/1084043125 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff62415ce80 msgr2=0x7ff6240c6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:16.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.604+0000 7ff623e00640 1 --2- 172.21.15.17:0/1084043125 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff62415ce80 0x7ff6240c6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:16.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.604+0000 7ff623e00640 1 -- 172.21.15.17:0/1084043125 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff62415caa0 msgr2=0x7ff6241f23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:16.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.604+0000 7ff623e00640 1 --2- 172.21.15.17:0/1084043125 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff62415caa0 0x7ff6241f23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:16.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.604+0000 7ff623e00640 1 -- 172.21.15.17:0/1084043125 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff61c009a70 con 0x7ff6240cfa40 2024-03-12T17:33:16.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.604+0000 7ff628a00640 1 --2- 172.21.15.17:0/1084043125 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff62415ce80 0x7ff6240c6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:33:16.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.604+0000 7ff623e00640 1 --2- 172.21.15.17:0/1084043125 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6240cfa40 0x7ff6240c7180 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff61400e9b0 tx=0x7ff61400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:16.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.605+0000 7ff61be00640 1 -- 172.21.15.17:0/1084043125 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff614009670 con 0x7ff6240cfa40 2024-03-12T17:33:16.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.605+0000 7ff61be00640 1 -- 172.21.15.17:0/1084043125 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff61400c9a0 con 0x7ff6240cfa40 2024-03-12T17:33:16.601 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.605+0000 7ff61be00640 1 -- 172.21.15.17:0/1084043125 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61400cd50 con 0x7ff6240cfa40 2024-03-12T17:33:16.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.605+0000 7ff629400640 1 -- 172.21.15.17:0/1084043125 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6241f2f40 con 0x7ff6240cfa40 2024-03-12T17:33:16.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.605+0000 7ff629400640 1 -- 172.21.15.17:0/1084043125 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6240c76c0 con 0x7ff6240cfa40 2024-03-12T17:33:16.602 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.606+0000 7ff629400640 1 -- 172.21.15.17:0/1084043125 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6240c8570 con 0x7ff6240cfa40 2024-03-12T17:33:16.603 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.607+0000 7ff61be00640 1 -- 172.21.15.17:0/1084043125 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7ff614013470 con 0x7ff6240cfa40 2024-03-12T17:33:16.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.608+0000 7ff61be00640 1 --2- 172.21.15.17:0/1084043125 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ff60406ac00 0x7ff60406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:16.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.608+0000 7ff61be00640 1 -- 172.21.15.17:0/1084043125 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff614089250 con 0x7ff6240cfa40 2024-03-12T17:33:16.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.608+0000 7ff623400640 1 --2- 172.21.15.17:0/1084043125 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ff60406ac00 0x7ff60406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:16.604 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.609+0000 7ff623400640 1 --2- 172.21.15.17:0/1084043125 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ff60406ac00 0x7ff60406d0c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff6240d2560 tx=0x7ff610009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:16.609 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.613+0000 7ff61be00640 1 -- 172.21.15.17:0/1084043125 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7ff6140547c0 con 0x7ff6240cfa40 2024-03-12T17:33:16.817 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.822+0000 7ff629400640 1 -- 172.21.15.17:0/1084043125 --> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff6240b85f0 con 0x7ff60406ac00 2024-03-12T17:33:16.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.825+0000 7ff61be00640 1 -- 172.21.15.17:0/1084043125 <== mgr.4104 v2:172.21.15.17:6832/37052 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48147 (secure 0 0 0) 0x7ff610001c40 con 0x7ff60406ac00 2024-03-12T17:33:16.821 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:33:16.821 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-03-12T17:33:16.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.827+0000 7ff629400640 1 -- 172.21.15.17:0/1084043125 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ff60406ac00 msgr2=0x7ff60406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:16.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.827+0000 7ff629400640 1 --2- 172.21.15.17:0/1084043125 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ff60406ac00 0x7ff60406d0c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff6240d2560 tx=0x7ff610009040 comp rx=0 tx=0).stop 2024-03-12T17:33:16.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.827+0000 7ff629400640 1 -- 172.21.15.17:0/1084043125 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6240cfa40 msgr2=0x7ff6240c7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:16.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.827+0000 7ff629400640 1 --2- 172.21.15.17:0/1084043125 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6240cfa40 0x7ff6240c7180 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff61400e9b0 tx=0x7ff61400ee70 comp rx=0 tx=0).stop 2024-03-12T17:33:16.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.828+0000 7ff629400640 1 -- 172.21.15.17:0/1084043125 shutdown_connections 2024-03-12T17:33:16.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.828+0000 7ff629400640 1 --2- 172.21.15.17:0/1084043125 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7ff60406ac00 0x7ff60406d0c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:16.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.828+0000 7ff629400640 1 --2- 172.21.15.17:0/1084043125 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7ff62415ce80 0x7ff6240c6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:16.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.828+0000 7ff629400640 1 --2- 172.21.15.17:0/1084043125 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7ff62415caa0 0x7ff6241f23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:16.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.828+0000 7ff629400640 1 --2- 172.21.15.17:0/1084043125 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7ff6240cfa40 0x7ff6240c7180 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:16.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.828+0000 7ff629400640 1 -- 172.21.15.17:0/1084043125 >> 172.21.15.17:0/1084043125 conn(0x7ff62406b160 msgr2=0x7ff62415be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:16.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.828+0000 7ff629400640 1 -- 172.21.15.17:0/1084043125 shutdown_connections 2024-03-12T17:33:16.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:16.828+0000 7ff629400640 1 -- 172.21.15.17:0/1084043125 wait complete. 2024-03-12T17:33:16.842 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":484,"stamp":"2024-03-12T17:33:15.792178+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":263156,"kb_used_data":6024,"kb_used_omap":13,"kb_used_meta":257010,"kb_avail":754711564,"statfs":{"total":773094113280,"available":772824641536,"internally_reserved":0,"allocated":6168576,"data_stored":3219712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":263178328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-20068777,"num_objects":-992,"num_object_clones":0,"num_object_copies":-1984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-992,"num_whiteouts":0,"num_read":-10,"num_read_kb":-7403,"num_write":-1673,"num_write_kb":-20891,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-34,"num_bytes_recovered":-21858,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.239521"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":195,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-12T17:33:08.851398+0000","last_change":"2024-03-12T17:18:41.331756+0000","last_active":"2024-03-12T17:33:08.851398+0000","last_peered":"2024-03-12T17:33:08.851398+0000","last_clean":"2024-03-12T17:33:08.851398+0000","last_became_active":"2024-03-12T17:18:41.329237+0000","last_became_peered":"2024-03-12T17:18:41.329237+0000","last_unstale":"2024-03-12T17:33:08.851398+0000","last_undegraded":"2024-03-12T17:33:08.851398+0000","last_fullsized":"2024-03-12T17:33:08.851398+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:40.152422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:40.152422+0000","last_clean_scrub_stamp":"2024-03-12T17:18:40.152422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:35:43.664403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575026,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36400,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335440,"statfs":{"total":96636764160,"available":96599490560,"internally_reserved":0,"allocated":1216512,"data_stored":845240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.006,"15min":1.0369999999999999},"min":{"1min":0.67800000000000005,"5min":0.61699999999999999,"15min":0.48099999999999998},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":2.3730000000000002},"last":0.54100000000000004},{"interface":"front","average":{"1min":1.038,"5min":1.0289999999999999,"15min":1.0369999999999999},"min":{"1min":0.67700000000000005,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.494,"5min":1.5469999999999999,"15min":2.2330000000000001},"last":0.55400000000000005}]},{"osd":1,"last update":"Tue Mar 12 17:33:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0129999999999999,"15min":1.02},"min":{"1min":0.753,"5min":0.67200000000000004,"15min":0.52200000000000002},"max":{"1min":1.5,"5min":1.5,"15min":1.7050000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.111,"15min":1.123},"min":{"1min":0.73999999999999999,"5min":0.72699999999999998,"15min":0.61299999999999999},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":2.363},"last":0.51100000000000001}]},{"osd":2,"last update":"Tue Mar 12 17:33:06 2024","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.171,"15min":1.179},"min":{"1min":0.747,"5min":0.68100000000000005,"15min":0.60799999999999998},"max":{"1min":1.4339999999999999,"5min":1.655,"15min":1.827},"last":0.58599999999999997},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.22,"15min":1.2290000000000001},"min":{"1min":0.92500000000000004,"5min":0.83999999999999997,"15min":0.625},"max":{"1min":1.6379999999999999,"5min":1.7949999999999999,"15min":2.0870000000000002},"last":0.52600000000000002}]},{"osd":3,"last update":"Tue Mar 12 17:33:06 2024","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.2010000000000001,"15min":1.212},"min":{"1min":0.871,"5min":0.70699999999999996,"15min":0.55800000000000005},"max":{"1min":1.4710000000000001,"5min":1.722,"15min":1.921},"last":0.63500000000000001},{"interface":"front","average":{"1min":1.216,"5min":1.2709999999999999,"15min":1.2669999999999999},"min":{"1min":0.89300000000000002,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.4870000000000001,"5min":1.738,"15min":2.1499999999999999},"last":0.61799999999999999}]},{"osd":4,"last update":"Tue Mar 12 17:33:06 2024","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.1739999999999999,"15min":1.1990000000000001},"min":{"1min":0.79600000000000004,"5min":0.71299999999999997,"15min":0.51400000000000001},"max":{"1min":1.635,"5min":1.635,"15min":2.2349999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.351,"15min":1.381},"min":{"1min":1.105,"5min":0.84799999999999998,"15min":0.63700000000000001},"max":{"1min":1.635,"5min":1.786,"15min":2.2490000000000001},"last":0.70299999999999996}]},{"osd":5,"last update":"Tue Mar 12 17:33:06 2024","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.2969999999999999,"15min":1.3109999999999999},"min":{"1min":0.84699999999999998,"5min":0.66600000000000004,"15min":0.53100000000000003},"max":{"1min":1.615,"5min":1.833,"15min":2.323},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.427,"5min":1.379,"15min":1.4279999999999999},"min":{"1min":1.1200000000000001,"5min":0.85499999999999998,"15min":0.61099999999999999},"max":{"1min":1.8140000000000001,"5min":1.8140000000000001,"15min":3.9689999999999999},"last":0.77600000000000002}]},{"osd":6,"last update":"Tue Mar 12 17:33:06 2024","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.425,"15min":1.462},"min":{"1min":1.2130000000000001,"5min":0.94399999999999995,"15min":0.69999999999999996},"max":{"1min":1.722,"5min":1.8340000000000001,"15min":3.8319999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.4019999999999999,"15min":1.429},"min":{"1min":0.99099999999999999,"5min":0.627,"15min":0.55100000000000005},"max":{"1min":1.6379999999999999,"5min":1.891,"15min":2.4609999999999999},"last":0.749}]}]},{"osd":6,"up_from":13,"seq":55834575025,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31724,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340116,"statfs":{"total":96636764160,"available":96604278784,"internally_reserved":0,"allocated":622592,"data_stored":254872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.101,"15min":1.0629999999999999},"min":{"1min":0.72399999999999998,"5min":0.68600000000000005,"15min":0.54400000000000004},"max":{"1min":1.556,"5min":1.71,"15min":3.5390000000000001},"last":1.155},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.085,"15min":1.0569999999999999},"min":{"1min":0.80400000000000005,"5min":0.65700000000000003,"15min":0.60899999999999999},"max":{"1min":1.5269999999999999,"5min":1.6220000000000001,"15min":1.73},"last":1.458}]},{"osd":1,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.2789999999999999,"15min":1.2330000000000001},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.33900000000000002},"max":{"1min":1.5680000000000001,"5min":1.778,"15min":6.7450000000000001},"last":1.044},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.2889999999999999,"15min":1.2769999999999999},"min":{"1min":0.89900000000000002,"5min":0.73199999999999998,"15min":0.70199999999999996},"max":{"1min":1.681,"5min":1.734,"15min":4.1909999999999998},"last":1.3129999999999999}]},{"osd":2,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.2689999999999999,"15min":1.2410000000000001},"min":{"1min":0.93400000000000005,"5min":0.83899999999999997,"15min":0.41299999999999998},"max":{"1min":1.512,"5min":1.6799999999999999,"15min":6.6879999999999997},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.3149999999999999,"15min":1.3},"min":{"1min":1.181,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.6899999999999999,"5min":1.8240000000000001,"15min":2.9689999999999999},"last":0.73999999999999999}]},{"osd":3,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.2390000000000001,"15min":1.2050000000000001},"min":{"1min":0.72999999999999998,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.546,"5min":1.6759999999999999,"15min":1.7749999999999999},"last":1.528},{"interface":"front","average":{"1min":1.248,"5min":1.254,"15min":1.246},"min":{"1min":0.86399999999999999,"5min":0.73899999999999999,"15min":0.46200000000000002},"max":{"1min":1.48,"5min":1.7170000000000001,"15min":6.6070000000000002},"last":1.214}]},{"osd":4,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.244,"15min":1.256},"min":{"1min":0.91000000000000003,"5min":0.80100000000000005,"15min":0.68300000000000005},"max":{"1min":1.605,"5min":1.6950000000000001,"15min":2.2130000000000001},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.2669999999999999,"15min":1.256},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.59499999999999997},"max":{"1min":1.7849999999999999,"5min":1.976,"15min":1.976},"last":1.2470000000000001}]},{"osd":5,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.3959999999999999,"15min":1.3959999999999999},"min":{"1min":1.2010000000000001,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":2.0649999999999999,"5min":2.0649999999999999,"15min":2.8660000000000001},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3680000000000001,"15min":1.373},"min":{"1min":1,"5min":0.88,"15min":0.51900000000000002},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":6.4939999999999998},"last":1.286}]},{"osd":7,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.4279999999999999,"15min":1.454},"min":{"1min":1.1559999999999999,"5min":0.92000000000000004,"15min":0.64000000000000001},"max":{"1min":1.978,"5min":1.978,"15min":2.2069999999999999},"last":1.488},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.5449999999999999,"15min":1.5289999999999999},"min":{"1min":1.319,"5min":1.016,"15min":0.77500000000000002},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.258},"last":1.5800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575026,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31728,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":622592,"data_stored":254872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.0629999999999999,"15min":1.111},"min":{"1min":0.66100000000000003,"5min":0.60599999999999998,"15min":0.56399999999999995},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":2.161},"last":1.6339999999999999},{"interface":"front","average":{"1min":1.099,"5min":1.1140000000000001,"15min":1.145},"min":{"1min":0.72199999999999998,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.3899999999999999,"5min":1.5149999999999999,"15min":1.95},"last":1.1930000000000001}]},{"osd":1,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1279999999999999,"15min":1.1359999999999999},"min":{"1min":0.75,"5min":0.70499999999999996,"15min":0.69199999999999995},"max":{"1min":1.496,"5min":1.698,"15min":1.75},"last":1.1279999999999999},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1779999999999999,"15min":1.222},"min":{"1min":0.82799999999999996,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":2.5699999999999998},"last":1.3560000000000001}]},{"osd":2,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.212,"15min":1.234},"min":{"1min":0.96799999999999997,"5min":0.76000000000000001,"15min":0.71599999999999997},"max":{"1min":1.6220000000000001,"5min":1.7190000000000001,"15min":2.613},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.226,"15min":1.2310000000000001},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.524,"5min":1.897,"15min":2.359},"last":0.85799999999999998}]},{"osd":3,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2569999999999999,"15min":1.3089999999999999},"min":{"1min":0.77900000000000003,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.4930000000000001,"5min":1.75,"15min":2.6829999999999998},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.3,"15min":1.3280000000000001},"min":{"1min":0.90900000000000003,"5min":0.874,"15min":0.80500000000000005},"max":{"1min":1.5720000000000001,"5min":1.724,"15min":2.3559999999999999},"last":1.0620000000000001}]},{"osd":4,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2,"15min":1.248},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.73699999999999999},"max":{"1min":1.655,"5min":1.6719999999999999,"15min":2.0510000000000002},"last":0.996},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.306,"15min":1.361},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.76700000000000002},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":2.3999999999999999},"last":1.5249999999999999}]},{"osd":6,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.3160000000000001,"15min":1.375},"min":{"1min":0.91700000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.718,"5min":1.75,"15min":2.488},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.365,"15min":1.4179999999999999},"min":{"1min":1.1719999999999999,"5min":0.97199999999999998,"15min":0.66100000000000003},"max":{"1min":1.601,"5min":1.7949999999999999,"15min":2.2759999999999998},"last":1.4199999999999999}]},{"osd":7,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.413,"15min":1.4950000000000001},"min":{"1min":0.97799999999999998,"5min":0.95299999999999996,"15min":0.95299999999999996},"max":{"1min":1.696,"5min":1.7470000000000001,"15min":2.8700000000000001},"last":1.587},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.47,"15min":1.5249999999999999},"min":{"1min":1.073,"5min":0.87,"15min":0.87},"max":{"1min":1.72,"5min":1.833,"15min":2.722},"last":1.405}]}]},{"osd":4,"up_from":13,"seq":55834575026,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31728,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":622592,"data_stored":254872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1259999999999999,"15min":1.091},"min":{"1min":0.70099999999999996,"5min":0.67300000000000004,"15min":0.60799999999999998},"max":{"1min":1.679,"5min":1.7330000000000001,"15min":4.8979999999999997},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.996,"5min":1.073,"15min":1.0900000000000001},"min":{"1min":0.73299999999999998,"5min":0.67900000000000005,"15min":0.57699999999999996},"max":{"1min":1.4410000000000001,"5min":1.659,"15min":4.8300000000000001},"last":1.3520000000000001}]},{"osd":1,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1359999999999999,"15min":1.1339999999999999},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.64100000000000001},"max":{"1min":1.609,"5min":1.647,"15min":4.7779999999999996},"last":0.998},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.2070000000000001,"15min":1.161},"min":{"1min":0.82299999999999995,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.6100000000000001,"5min":1.887,"15min":1.911},"last":1.274}]},{"osd":2,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.2569999999999999,"15min":1.226},"min":{"1min":0.88,"5min":0.65800000000000003,"15min":0.60199999999999998},"max":{"1min":1.5409999999999999,"5min":1.6870000000000001,"15min":1.7450000000000001},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.351,"5min":1.3340000000000001,"15min":1.3049999999999999},"min":{"1min":1.028,"5min":0.81899999999999995,"15min":0.78500000000000003},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":2.3220000000000001},"last":1.397}]},{"osd":3,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.2310000000000001,"15min":1.24},"min":{"1min":0.90200000000000002,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.444,"5min":1.78,"15min":1.7949999999999999},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.2310000000000001,"15min":1.2290000000000001},"min":{"1min":0.90500000000000003,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.581,"5min":1.7130000000000001,"15min":1.9119999999999999},"last":1.1140000000000001}]},{"osd":5,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.3300000000000001,"15min":1.325},"min":{"1min":0.93400000000000005,"5min":0.83299999999999996,"15min":0.60499999999999998},"max":{"1min":1.766,"5min":1.766,"15min":2.1589999999999998},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.49,"5min":1.4159999999999999,"15min":1.3899999999999999},"min":{"1min":0.85999999999999999,"5min":0.79600000000000004,"15min":0.76700000000000002},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":2.5390000000000001},"last":1.458}]},{"osd":6,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.248,"15min":1.264},"min":{"1min":0.86299999999999999,"5min":0.81599999999999995,"15min":0.65900000000000003},"max":{"1min":1.5880000000000001,"5min":1.8009999999999999,"15min":1.885},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.508,"5min":1.3999999999999999,"15min":1.3919999999999999},"min":{"1min":1.0649999999999999,"5min":0.83299999999999996,"15min":0.63300000000000001},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.4750000000000001},"last":1.5169999999999999}]},{"osd":7,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.3979999999999999,"15min":1.4079999999999999},"min":{"1min":1.159,"5min":0.97799999999999998,"15min":0.56299999999999994},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":2.1200000000000001},"last":1.4790000000000001},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.427,"15min":1.425},"min":{"1min":0.97799999999999998,"5min":0.96999999999999997,"15min":0.67600000000000005},"max":{"1min":1.72,"5min":1.9199999999999999,"15min":2.4260000000000002},"last":1.3759999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575026,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35820,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336020,"statfs":{"total":96636764160,"available":96600084480,"internally_reserved":0,"allocated":622592,"data_stored":254872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.84999999999999998,"15min":0.88300000000000001},"min":{"1min":0.51000000000000001,"5min":0.432,"15min":0.35099999999999998},"max":{"1min":1.306,"5min":1.5189999999999999,"15min":2.9580000000000002},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.995,"5min":0.93999999999999995,"15min":0.95699999999999996},"min":{"1min":0.67800000000000005,"5min":0.55800000000000005,"15min":0.48199999999999998},"max":{"1min":1.401,"5min":1.651,"15min":3.9940000000000002},"last":1.1890000000000001}]},{"osd":1,"last update":"Tue Mar 12 17:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.89700000000000002,"15min":0.91900000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.38600000000000001},"max":{"1min":1.4019999999999999,"5min":1.5940000000000001,"15min":4.774},"last":1.222},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0449999999999999,"15min":1.0720000000000001},"min":{"1min":0.60599999999999998,"5min":0.58499999999999996,"15min":0.40999999999999998},"max":{"1min":1.647,"5min":1.647,"15min":5.0069999999999997},"last":0.91800000000000004}]},{"osd":2,"last update":"Tue Mar 12 17:32:56 2024","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.135,"15min":1.155},"min":{"1min":0.78200000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":2.4660000000000002},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.2250000000000001,"15min":1.2709999999999999},"min":{"1min":0.70499999999999996,"5min":0.57399999999999995,"15min":0.439},"max":{"1min":1.6020000000000001,"5min":1.7509999999999999,"15min":4.5650000000000004},"last":1.6299999999999999}]},{"osd":4,"last update":"Tue Mar 12 17:32:56 2024","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.24,"15min":1.272},"min":{"1min":0.84899999999999998,"5min":0.80700000000000005,"15min":0.67200000000000004},"max":{"1min":1.74,"5min":1.74,"15min":2.8860000000000001},"last":1.147},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2390000000000001,"15min":1.28},"min":{"1min":0.88300000000000001,"5min":0.80800000000000005,"15min":0.73399999999999999},"max":{"1min":1.546,"5min":1.6259999999999999,"15min":4.3520000000000003},"last":1.357}]},{"osd":5,"last update":"Tue Mar 12 17:32:56 2024","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.339,"15min":1.3500000000000001},"min":{"1min":0.91500000000000004,"5min":0.84799999999999998,"15min":0.76200000000000001},"max":{"1min":1.649,"5min":1.9059999999999999,"15min":2.843},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.3069999999999999,"15min":1.3320000000000001},"min":{"1min":0.96299999999999997,"5min":0.81399999999999995,"15min":0.68300000000000005},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.8149999999999999},"last":1.4830000000000001}]},{"osd":6,"last update":"Tue Mar 12 17:32:56 2024","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.4059999999999999,"15min":1.4379999999999999},"min":{"1min":1.1359999999999999,"5min":0.79600000000000004,"15min":0.71699999999999997},"max":{"1min":1.7509999999999999,"5min":2.0299999999999998,"15min":2.9199999999999999},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4039999999999999,"15min":1.423},"min":{"1min":1.0329999999999999,"5min":0.878,"15min":0.86399999999999999},"max":{"1min":1.982,"5min":1.982,"15min":2.6589999999999998},"last":1.6000000000000001}]},{"osd":7,"last update":"Tue Mar 12 17:32:56 2024","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.351,"15min":1.3959999999999999},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.83899999999999997},"max":{"1min":1.661,"5min":1.7450000000000001,"15min":4.6600000000000001},"last":1.528},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.4350000000000001,"15min":1.4670000000000001},"min":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.76800000000000002},"max":{"1min":1.7529999999999999,"5min":1.8240000000000001,"15min":4.4720000000000004},"last":1.6919999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575026,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31728,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":622592,"data_stored":254872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.97299999999999998,"15min":0.95499999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.40000000000000002},"max":{"1min":1.3540000000000001,"5min":2.097,"15min":3.1829999999999998},"last":0.60699999999999998},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0960000000000001,"15min":1.0800000000000001},"min":{"1min":0.66800000000000004,"5min":0.63400000000000001,"15min":0.50700000000000001},"max":{"1min":1.532,"5min":1.694,"15min":2.8199999999999998},"last":0.56299999999999994}]},{"osd":1,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":0.94199999999999995,"15min":0.94099999999999995},"min":{"1min":0.69199999999999995,"5min":0.49099999999999999,"15min":0.308},"max":{"1min":1.9259999999999999,"5min":2.0529999999999999,"15min":2.7360000000000002},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.119,"15min":1.099},"min":{"1min":0.621,"5min":0.621,"15min":0.44700000000000001},"max":{"1min":1.583,"5min":2.2010000000000001,"15min":3.1019999999999999},"last":0.81699999999999995}]},{"osd":3,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.117,"15min":1.1160000000000001},"min":{"1min":0.72599999999999998,"5min":0.629,"15min":0.45000000000000001},"max":{"1min":1.6020000000000001,"5min":1.883,"15min":2.7810000000000001},"last":0.63},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2270000000000001,"15min":1.2130000000000001},"min":{"1min":0.76500000000000001,"5min":0.66900000000000004,"15min":0.48299999999999998},"max":{"1min":1.5920000000000001,"5min":1.758,"15min":3.1419999999999999},"last":0.77300000000000002}]},{"osd":4,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.3420000000000001,"15min":1.3919999999999999},"min":{"1min":0.92900000000000005,"5min":0.86699999999999999,"15min":0.76100000000000001},"max":{"1min":1.7,"5min":1.9450000000000001,"15min":7.96},"last":1.264},{"interface":"front","average":{"1min":1.282,"5min":1.266,"15min":1.2789999999999999},"min":{"1min":0.82299999999999995,"5min":0.78800000000000003,"15min":0.67700000000000005},"max":{"1min":1.7210000000000001,"5min":1.806,"15min":3.3780000000000001},"last":0.88}]},{"osd":5,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.333,"15min":1.351},"min":{"1min":0.91800000000000004,"5min":0.89000000000000001,"15min":0.70399999999999996},"max":{"1min":1.8839999999999999,"5min":1.9059999999999999,"15min":4.0659999999999998},"last":1.097},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3320000000000001,"15min":1.3700000000000001},"min":{"1min":0.98599999999999999,"5min":0.86699999999999999,"15min":0.63800000000000001},"max":{"1min":1.649,"5min":1.929,"15min":3.012},"last":0.85199999999999998}]},{"osd":6,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.393,"15min":1.4019999999999999},"min":{"1min":1.1459999999999999,"5min":0.86599999999999999,"15min":0.74099999999999999},"max":{"1min":1.7729999999999999,"5min":2.1099999999999999,"15min":3.2330000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":1.389,"5min":1.4870000000000001,"15min":1.5169999999999999},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.68899999999999995},"max":{"1min":1.802,"5min":2.4100000000000001,"15min":7.9059999999999997},"last":1.1870000000000001}]},{"osd":7,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.423,"15min":1.4299999999999999},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.64700000000000002},"max":{"1min":1.8420000000000001,"5min":2.0529999999999999,"15min":4.0229999999999997},"last":1.036},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4750000000000001,"15min":1.4950000000000001},"min":{"1min":1.0509999999999999,"5min":0.95099999999999996,"15min":0.84499999999999997},"max":{"1min":1.885,"5min":2.0950000000000002,"15min":3.27},"last":1.0700000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575026,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31724,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340116,"statfs":{"total":96636764160,"available":96604278784,"internally_reserved":0,"allocated":622592,"data_stored":254872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.89800000000000002,"15min":0.88800000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.29,"5min":1.6699999999999999,"15min":1.7749999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.0149999999999999,"15min":1.0449999999999999},"min":{"1min":0.60999999999999999,"5min":0.59399999999999997,"15min":0.47499999999999998},"max":{"1min":1.76,"5min":1.869,"15min":7.6449999999999996},"last":1.76}]},{"osd":2,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.97099999999999997,"15min":0.95199999999999996},"min":{"1min":0.628,"5min":0.53200000000000003,"15min":0.40799999999999997},"max":{"1min":1.272,"5min":1.7629999999999999,"15min":1.9299999999999999},"last":0.99199999999999999},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.095,"15min":1.0669999999999999},"min":{"1min":0.58799999999999997,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.325,"5min":1.708,"15min":2.5720000000000001},"last":1.325}]},{"osd":3,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.208,"15min":1.242},"min":{"1min":0.625,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.681,"5min":1.875,"15min":2.4580000000000002},"last":1.526},{"interface":"front","average":{"1min":1.02,"5min":1.155,"15min":1.1599999999999999},"min":{"1min":0.56399999999999995,"5min":0.501,"15min":0.42499999999999999},"max":{"1min":1.502,"5min":1.8460000000000001,"15min":3.319},"last":1.218}]},{"osd":4,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.246,"15min":1.2350000000000001},"min":{"1min":0.77400000000000002,"5min":0.70799999999999996,"15min":0.63300000000000001},"max":{"1min":1.5700000000000001,"5min":1.9039999999999999,"15min":2.4580000000000002},"last":1.5700000000000001},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.363,"15min":1.355},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.70999999999999996},"max":{"1min":1.599,"5min":2.0680000000000001,"15min":2.6909999999999998},"last":1.599}]},{"osd":5,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.3740000000000001,"15min":1.3660000000000001},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.67200000000000004},"max":{"1min":1.629,"5min":1.9650000000000001,"15min":3.0609999999999999},"last":1.629},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3440000000000001,"15min":1.353},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.73299999999999998},"max":{"1min":1.8169999999999999,"5min":1.9339999999999999,"15min":2.4169999999999998},"last":1.1659999999999999}]},{"osd":6,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.4419999999999999,"15min":1.4299999999999999},"min":{"1min":0.752,"5min":0.752,"15min":0.70099999999999996},"max":{"1min":1.9139999999999999,"5min":2.137,"15min":3.1030000000000002},"last":1.9139999999999999},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.405,"15min":1.4059999999999999},"min":{"1min":0.874,"5min":0.874,"15min":0.82999999999999996},"max":{"1min":1.7509999999999999,"5min":2.0219999999999998,"15min":2.274},"last":1.492}]},{"osd":7,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.4950000000000001,"15min":1.47},"min":{"1min":1.129,"5min":0.85799999999999998,"15min":0.70899999999999996},"max":{"1min":1.7030000000000001,"5min":2.1659999999999999,"15min":2.7959999999999998},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.5389999999999999,"15min":1.518},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.73,"5min":2.2509999999999999,"15min":3.1440000000000001},"last":1.405}]}]},{"osd":0,"up_from":13,"seq":55834575025,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1216512,"data_stored":845240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.92100000000000004,"15min":0.92900000000000005},"min":{"1min":0.71899999999999997,"5min":0.46000000000000002,"15min":0.41799999999999998},"max":{"1min":1.45,"5min":1.829,"15min":1.829},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0469999999999999,"15min":1.028},"min":{"1min":0.54700000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.504,"5min":1.8280000000000001,"15min":2.3740000000000001},"last":1.1240000000000001}]},{"osd":2,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.054,"15min":1.056},"min":{"1min":0.80200000000000005,"5min":0.56999999999999995,"15min":0.52300000000000002},"max":{"1min":1.528,"5min":1.792,"15min":1.99},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.089,"5min":1.105,"15min":1.1000000000000001},"min":{"1min":0.621,"5min":0.51200000000000001,"15min":0.45500000000000002},"max":{"1min":1.591,"5min":1.752,"15min":2.468},"last":1.76}]},{"osd":3,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.002,"15min":1.016},"min":{"1min":0.58299999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.5449999999999999,"5min":1.8340000000000001,"15min":2.085},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.234,"15min":1.2310000000000001},"min":{"1min":0.73099999999999998,"5min":0.63800000000000001,"15min":0.56899999999999995},"max":{"1min":1.6479999999999999,"5min":1.78,"15min":2.286},"last":0.95899999999999996}]},{"osd":4,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2390000000000001,"15min":1.262},"min":{"1min":0.94999999999999996,"5min":0.79100000000000004,"15min":0.73499999999999999},"max":{"1min":1.5429999999999999,"5min":1.76,"15min":3.2349999999999999},"last":1.621},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.3839999999999999,"15min":1.383},"min":{"1min":1.093,"5min":0.88700000000000001,"15min":0.77700000000000002},"max":{"1min":1.744,"5min":2.008,"15min":2.5369999999999999},"last":1.379}]},{"osd":5,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3540000000000001,"15min":1.3740000000000001},"min":{"1min":1.1060000000000001,"5min":0.90800000000000003,"15min":0.85599999999999998},"max":{"1min":1.7250000000000001,"5min":1.798,"15min":2.988},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.395,"5min":1.327,"15min":1.361},"min":{"1min":1.093,"5min":0.81599999999999995,"15min":0.77000000000000002},"max":{"1min":1.6020000000000001,"5min":1.712,"15min":2.843},"last":1.7789999999999999}]},{"osd":6,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.472,"15min":1.462},"min":{"1min":1.1100000000000001,"5min":0.88300000000000001,"15min":0.81100000000000005},"max":{"1min":1.825,"5min":2.0760000000000001,"15min":2.431},"last":1.552},{"interface":"front","average":{"1min":1.5,"5min":1.4419999999999999,"15min":1.4339999999999999},"min":{"1min":0.98699999999999999,"5min":0.85799999999999998,"15min":0.67600000000000005},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.589},"last":1.6839999999999999}]},{"osd":7,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.5880000000000001,"5min":1.4890000000000001,"15min":1.5029999999999999},"min":{"1min":1.175,"5min":0.89500000000000002,"15min":0.78600000000000003},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.7410000000000001},"last":1.5900000000000001},{"interface":"front","average":{"1min":1.49,"5min":1.3779999999999999,"15min":1.4259999999999999},"min":{"1min":1.2090000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.972,"5min":1.972,"15min":2.8929999999999998},"last":2.0110000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-12T17:33:16.843 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T17:33:17.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.054+0000 7f51b8c00640 1 Processor -- start 2024-03-12T17:33:17.050 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.055+0000 7f51b8c00640 1 -- start start 2024-03-12T17:33:17.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.056+0000 7f51b8c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f51b40d2fa0 0x7f51b40d3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:17.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.056+0000 7f51b8c00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f51b40b5f70 0x7f51b40d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:17.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.056+0000 7f51b8c00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51b40d14e0 con 0x7f51b40b5b50 2024-03-12T17:33:17.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.056+0000 7f51b8c00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51b40b59e0 con 0x7f51b40b5f70 2024-03-12T17:33:17.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.056+0000 7f51b8c00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b40d38c0 con 0x7f51b40d2fa0 2024-03-12T17:33:17.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.056+0000 7f51b2800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f51b40b5f70 0x7f51b40d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:17.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.057+0000 7f51b2800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f51b40b5f70 0x7f51b40d1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35866/0 (socket says 172.21.15.17:35866) 2024-03-12T17:33:17.052 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.057+0000 7f51b2800640 1 -- 172.21.15.17:0/4248120379 learned_addr learned my addr 172.21.15.17:0/4248120379 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:17.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.057+0000 7f51b1e00640 1 --2- 172.21.15.17:0/4248120379 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f51b40d2fa0 0x7f51b40d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:17.053 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.057+0000 7f51b2800640 1 -- 172.21.15.17:0/4248120379 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f51b40d2fa0 msgr2=0x7f51b40d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:17.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.057+0000 7f51b2800640 1 --2- 172.21.15.17:0/4248120379 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f51b40d2fa0 0x7f51b40d3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:17.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.057+0000 7f51b2800640 1 -- 172.21.15.17:0/4248120379 >> v1:172.21.15.94:6789/0 conn(0x7f51b40b5b50 legacy=0x7f51b40cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:17.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.057+0000 7f51b2800640 1 -- 172.21.15.17:0/4248120379 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b40b85b0 con 0x7f51b40b5f70 2024-03-12T17:33:17.054 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.059+0000 7f51b2800640 1 --2- 172.21.15.17:0/4248120379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51b40b5f70 0x7f51b40d1f30 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f51ac009e50 tx=0x7f51ac02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c58ad284a3de02eb server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:17.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.059+0000 7f51b0a00640 1 -- 172.21.15.17:0/4248120379 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac02cb00 con 0x7f51b40b5f70 2024-03-12T17:33:17.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.059+0000 7f51b0a00640 1 -- 172.21.15.17:0/4248120379 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ac02cc60 con 0x7f51b40b5f70 2024-03-12T17:33:17.055 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.059+0000 7f51b0a00640 1 -- 172.21.15.17:0/4248120379 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac0343f0 con 0x7f51b40b5f70 2024-03-12T17:33:17.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.060+0000 7f51b8c00640 1 -- 172.21.15.17:0/4248120379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51b40b5f70 msgr2=0x7f51b40d1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:17.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.060+0000 7f51b8c00640 1 --2- 172.21.15.17:0/4248120379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51b40b5f70 0x7f51b40d1f30 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f51ac009e50 tx=0x7f51ac02bf60 comp rx=0 tx=0).stop 2024-03-12T17:33:17.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.060+0000 7f51b8c00640 1 -- 172.21.15.17:0/4248120379 shutdown_connections 2024-03-12T17:33:17.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.060+0000 7f51b8c00640 1 --2- 172.21.15.17:0/4248120379 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51b40b5f70 0x7f51b40d1f30 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:17.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.060+0000 7f51b8c00640 1 --2- 172.21.15.17:0/4248120379 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f51b40d2fa0 0x7f51b40d3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:17.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.060+0000 7f51b8c00640 1 -- 172.21.15.17:0/4248120379 >> 172.21.15.17:0/4248120379 conn(0x7f51b4065df0 msgr2=0x7f51b4066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:17.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.060+0000 7f51b8c00640 1 -- 172.21.15.17:0/4248120379 shutdown_connections 2024-03-12T17:33:17.056 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.060+0000 7f51b8c00640 1 -- 172.21.15.17:0/4248120379 wait complete. 2024-03-12T17:33:17.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.063+0000 7f51b8c00640 1 Processor -- start 2024-03-12T17:33:17.058 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.063+0000 7f51b8c00640 1 -- start start 2024-03-12T17:33:17.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.064+0000 7f51b8c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51b40b5b50 0x7f51b415a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:17.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.064+0000 7f51b8c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f51b40b5f70 0x7f51b41f2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:17.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.064+0000 7f51b8c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51b40d2fa0 0x7f51b40ca530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:17.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.064+0000 7f51b8c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b41f36b0 con 0x7f51b40d2fa0 2024-03-12T17:33:17.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.064+0000 7f51b8c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51b415ad20 con 0x7f51b40b5b50 2024-03-12T17:33:17.060 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.064+0000 7f51b8c00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51b41f32b0 con 0x7f51b40b5f70 2024-03-12T17:33:17.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.065+0000 7f51b2800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51b40d2fa0 0x7f51b40ca530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:17.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.065+0000 7f51b2800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51b40d2fa0 0x7f51b40ca530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35882/0 (socket says 172.21.15.17:35882) 2024-03-12T17:33:17.061 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.065+0000 7f51b2800640 1 -- 172.21.15.17:0/876912952 learned_addr learned my addr 172.21.15.17:0/876912952 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:17.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.065+0000 7f51b1e00640 1 --2- 172.21.15.17:0/876912952 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51b40b5b50 0x7f51b415a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:17.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.065+0000 7f51b1400640 1 --2- 172.21.15.17:0/876912952 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f51b40b5f70 0x7f51b41f2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:17.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.065+0000 7f51b2800640 1 -- 172.21.15.17:0/876912952 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f51b40b5f70 msgr2=0x7f51b41f2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:17.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.065+0000 7f51b2800640 1 --2- 172.21.15.17:0/876912952 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f51b40b5f70 0x7f51b41f2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:17.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.065+0000 7f51b2800640 1 -- 172.21.15.17:0/876912952 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51b40b5b50 msgr2=0x7f51b415a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:17.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.065+0000 7f51b2800640 1 --2- 172.21.15.17:0/876912952 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51b40b5b50 0x7f51b415a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:17.062 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.065+0000 7f51b2800640 1 -- 172.21.15.17:0/876912952 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ac009b30 con 0x7f51b40d2fa0 2024-03-12T17:33:17.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.066+0000 7f51b2800640 1 --2- 172.21.15.17:0/876912952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51b40d2fa0 0x7f51b40ca530 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f51ac009e50 tx=0x7f51ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:17.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.066+0000 7f51aa000640 1 -- 172.21.15.17:0/876912952 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac009510 con 0x7f51b40d2fa0 2024-03-12T17:33:17.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.066+0000 7f51aa000640 1 -- 172.21.15.17:0/876912952 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ac03e450 con 0x7f51b40d2fa0 2024-03-12T17:33:17.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.066+0000 7f51aa000640 1 -- 172.21.15.17:0/876912952 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac03e7e0 con 0x7f51b40d2fa0 2024-03-12T17:33:17.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.066+0000 7f51b8c00640 1 -- 172.21.15.17:0/876912952 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b41f27c0 con 0x7f51b40d2fa0 2024-03-12T17:33:17.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.066+0000 7f51b8c00640 1 -- 172.21.15.17:0/876912952 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51b41f2cf0 con 0x7f51b40d2fa0 2024-03-12T17:33:17.063 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.067+0000 7f51b8c00640 1 -- 172.21.15.17:0/876912952 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51b41f37f0 con 0x7f51b40d2fa0 2024-03-12T17:33:17.064 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.068+0000 7f51aa000640 1 -- 172.21.15.17:0/876912952 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f51ac03e940 con 0x7f51b40d2fa0 2024-03-12T17:33:17.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.070+0000 7f51aa000640 1 --2- 172.21.15.17:0/876912952 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f519406ac00 0x7f519406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:17.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.070+0000 7f51aa000640 1 -- 172.21.15.17:0/876912952 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f51ac0abdd0 con 0x7f51b40d2fa0 2024-03-12T17:33:17.065 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.070+0000 7f51b1e00640 1 --2- 172.21.15.17:0/876912952 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f519406ac00 0x7f519406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:17.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.071+0000 7f51b1e00640 1 --2- 172.21.15.17:0/876912952 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f519406ac00 0x7f519406d0c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f51a4006fd0 tx=0x7f51a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:17.069 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.074+0000 7f51aa000640 1 -- 172.21.15.17:0/876912952 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f51ac0772a0 con 0x7f51b40d2fa0 2024-03-12T17:33:17.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.273+0000 7f51b8c00640 1 -- 172.21.15.17:0/876912952 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f51b40736c0 con 0x7f51b40d2fa0 2024-03-12T17:33:17.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.275+0000 7f51aa000640 1 -- 172.21.15.17:0/876912952 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+12470 (secure 0 0 0) 0x7f51ac07a8c0 con 0x7f51b40d2fa0 2024-03-12T17:33:17.271 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:33:17.271 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":52,"fsid":"73425bc1-630f-4bd2-8abb-716ed5d8ca29","created":"2024-03-12T17:18:26.384168+0000","modified":"2024-03-12T17:33:11.924499+0000","last_up_change":"2024-03-12T17:18:38.144756+0000","last_in_change":"2024-03-12T17:18:29.801638+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-12T17:18:39.552910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9eb95ea9-ae79-4d0c-b1a3-61293dbc14fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6800","nonce":37305},{"type":"v1","addr":"172.21.15.17:6801","nonce":37305}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6802","nonce":37305},{"type":"v1","addr":"172.21.15.17:6803","nonce":37305}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6806","nonce":37305},{"type":"v1","addr":"172.21.15.17:6807","nonce":37305}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6804","nonce":37305},{"type":"v1","addr":"172.21.15.17:6805","nonce":37305}]},"public_addr":"172.21.15.17:6801/37305","cluster_addr":"172.21.15.17:6803/37305","heartbeat_back_addr":"172.21.15.17:6807/37305","heartbeat_front_addr":"172.21.15.17:6805/37305","state":["exists","up"]},{"osd":1,"uuid":"b5a8fe74-1be5-4b16-bf45-4a48fdfcd903","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6812","nonce":37307},{"type":"v1","addr":"172.21.15.17:6814","nonce":37307}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6816","nonce":37307},{"type":"v1","addr":"172.21.15.17:6818","nonce":37307}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6825","nonce":37307},{"type":"v1","addr":"172.21.15.17:6827","nonce":37307}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6821","nonce":37307},{"type":"v1","addr":"172.21.15.17:6823","nonce":37307}]},"public_addr":"172.21.15.17:6814/37307","cluster_addr":"172.21.15.17:6818/37307","heartbeat_back_addr":"172.21.15.17:6827/37307","heartbeat_front_addr":"172.21.15.17:6823/37307","state":["exists","up"]},{"osd":2,"uuid":"23df2a44-1a0d-4102-80b0-0123937722ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6808","nonce":37303},{"type":"v1","addr":"172.21.15.17:6809","nonce":37303}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6810","nonce":37303},{"type":"v1","addr":"172.21.15.17:6811","nonce":37303}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6817","nonce":37303},{"type":"v1","addr":"172.21.15.17:6819","nonce":37303}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6813","nonce":37303},{"type":"v1","addr":"172.21.15.17:6815","nonce":37303}]},"public_addr":"172.21.15.17:6809/37303","cluster_addr":"172.21.15.17:6811/37303","heartbeat_back_addr":"172.21.15.17:6819/37303","heartbeat_front_addr":"172.21.15.17:6815/37303","state":["exists","up"]},{"osd":3,"uuid":"d13d1eb3-124d-4c8f-b103-830669b01503","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6820","nonce":37308},{"type":"v1","addr":"172.21.15.17:6822","nonce":37308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6824","nonce":37308},{"type":"v1","addr":"172.21.15.17:6826","nonce":37308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6830","nonce":37308},{"type":"v1","addr":"172.21.15.17:6831","nonce":37308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6828","nonce":37308},{"type":"v1","addr":"172.21.15.17:6829","nonce":37308}]},"public_addr":"172.21.15.17:6822/37308","cluster_addr":"172.21.15.17:6826/37308","heartbeat_back_addr":"172.21.15.17:6831/37308","heartbeat_front_addr":"172.21.15.17:6829/37308","state":["exists","up"]},{"osd":4,"uuid":"fd2ec44e-2a3c-48a4-a177-0badb6048e32","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6808","nonce":37465},{"type":"v1","addr":"172.21.15.94:6809","nonce":37465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6811","nonce":37465},{"type":"v1","addr":"172.21.15.94:6813","nonce":37465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6819","nonce":37465},{"type":"v1","addr":"172.21.15.94:6822","nonce":37465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6815","nonce":37465},{"type":"v1","addr":"172.21.15.94:6817","nonce":37465}]},"public_addr":"172.21.15.94:6809/37465","cluster_addr":"172.21.15.94:6813/37465","heartbeat_back_addr":"172.21.15.94:6822/37465","heartbeat_front_addr":"172.21.15.94:6817/37465","state":["exists","up"]},{"osd":5,"uuid":"a1d66b17-d782-49a4-8e0f-94f0a8b4251b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6810","nonce":37464},{"type":"v1","addr":"172.21.15.94:6812","nonce":37464}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6814","nonce":37464},{"type":"v1","addr":"172.21.15.94:6816","nonce":37464}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6821","nonce":37464},{"type":"v1","addr":"172.21.15.94:6823","nonce":37464}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6818","nonce":37464},{"type":"v1","addr":"172.21.15.94:6820","nonce":37464}]},"public_addr":"172.21.15.94:6812/37464","cluster_addr":"172.21.15.94:6816/37464","heartbeat_back_addr":"172.21.15.94:6823/37464","heartbeat_front_addr":"172.21.15.94:6820/37464","state":["exists","up"]},{"osd":6,"uuid":"da027f37-269f-4e84-a7ed-522ed722876c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6824","nonce":37467},{"type":"v1","addr":"172.21.15.94:6825","nonce":37467}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6826","nonce":37467},{"type":"v1","addr":"172.21.15.94:6827","nonce":37467}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6830","nonce":37467},{"type":"v1","addr":"172.21.15.94:6831","nonce":37467}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6828","nonce":37467},{"type":"v1","addr":"172.21.15.94:6829","nonce":37467}]},"public_addr":"172.21.15.94:6825/37467","cluster_addr":"172.21.15.94:6827/37467","heartbeat_back_addr":"172.21.15.94:6831/37467","heartbeat_front_addr":"172.21.15.94:6829/37467","state":["exists","up"]},{"osd":7,"uuid":"58a7945a-f2c4-4783-8d9c-08b44b54281f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6800","nonce":37466},{"type":"v1","addr":"172.21.15.94:6801","nonce":37466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6802","nonce":37466},{"type":"v1","addr":"172.21.15.94:6803","nonce":37466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6806","nonce":37466},{"type":"v1","addr":"172.21.15.94:6807","nonce":37466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6804","nonce":37466},{"type":"v1","addr":"172.21.15.94:6805","nonce":37466}]},"public_addr":"172.21.15.94:6801/37466","cluster_addr":"172.21.15.94:6803/37466","heartbeat_back_addr":"172.21.15.94:6807/37466","heartbeat_front_addr":"172.21.15.94:6805/37466","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.327217+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.186966+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.419986+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.150585+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.120621+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.121576+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.181257+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T17:18:35.293188+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.17:6837/2711965846":"2024-03-13T17:33:08.547541+0000","172.21.15.17:6836/2711965846":"2024-03-13T17:33:08.547541+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T17:33:17.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.278+0000 7f51b8c00640 1 -- 172.21.15.17:0/876912952 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f519406ac00 msgr2=0x7f519406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:17.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.278+0000 7f51b8c00640 1 --2- 172.21.15.17:0/876912952 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f519406ac00 0x7f519406d0c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f51a4006fd0 tx=0x7f51a4008040 comp rx=0 tx=0).stop 2024-03-12T17:33:17.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.278+0000 7f51b8c00640 1 -- 172.21.15.17:0/876912952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51b40d2fa0 msgr2=0x7f51b40ca530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:17.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.278+0000 7f51b8c00640 1 --2- 172.21.15.17:0/876912952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51b40d2fa0 0x7f51b40ca530 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f51ac009e50 tx=0x7f51ac004a40 comp rx=0 tx=0).stop 2024-03-12T17:33:17.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.278+0000 7f51b8c00640 1 -- 172.21.15.17:0/876912952 shutdown_connections 2024-03-12T17:33:17.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.278+0000 7f51b8c00640 1 --2- 172.21.15.17:0/876912952 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f519406ac00 0x7f519406d0c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:17.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.278+0000 7f51b8c00640 1 --2- 172.21.15.17:0/876912952 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51b40d2fa0 0x7f51b40ca530 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:17.274 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.278+0000 7f51b8c00640 1 --2- 172.21.15.17:0/876912952 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f51b40b5f70 0x7f51b41f2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:17.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.278+0000 7f51b8c00640 1 --2- 172.21.15.17:0/876912952 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51b40b5b50 0x7f51b415a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:17.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.278+0000 7f51b8c00640 1 -- 172.21.15.17:0/876912952 >> 172.21.15.17:0/876912952 conn(0x7f51b4065df0 msgr2=0x7f51b40c8540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:17.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.278+0000 7f51b8c00640 1 -- 172.21.15.17:0/876912952 shutdown_connections 2024-03-12T17:33:17.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:17.278+0000 7f51b8c00640 1 -- 172.21.15.17:0/876912952 wait complete. 2024-03-12T17:33:18.294 INFO:tasks.ceph:Scrubbing osd.0 2024-03-12T17:33:18.294 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-03-12T17:33:18.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.535+0000 7f3283e00640 1 Processor -- start 2024-03-12T17:33:18.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.535+0000 7f3283e00640 1 -- start start 2024-03-12T17:33:18.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.537+0000 7f3283e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f328415b820 0x7f328406a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:18.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.537+0000 7f3283e00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f328406aa60 con 0x7f328406a630 2024-03-12T17:33:18.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.537+0000 7f3283e00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f328415bc60 con 0x7f328415a8a0 2024-03-12T17:33:18.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.537+0000 7f3283e00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32840cbce0 con 0x7f328415b820 2024-03-12T17:33:18.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.537+0000 7f3283400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f328406a630 0x7f328415beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37598/0 (socket says 172.21.15.17:37598) 2024-03-12T17:33:18.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.537+0000 7f3283400640 1 -- 172.21.15.17:0/74135813 learned_addr learned my addr 172.21.15.17:0/74135813 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:33:18.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.537+0000 7f327be00640 1 --2- 172.21.15.17:0/74135813 >> v2:172.21.15.94:3300/0 conn(0x7f328415b820 0x7f328406a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:18.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.538+0000 7f3282000640 1 -- 172.21.15.17:0/74135813 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 58464867 0 0) 0x7f328406aa60 con 0x7f328406a630 2024-03-12T17:33:18.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.538+0000 7f3282000640 1 -- 172.21.15.17:0/74135813 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3268003520 con 0x7f328406a630 2024-03-12T17:33:18.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.538+0000 7f3282000640 1 -- 172.21.15.17:0/74135813 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2222761392 0 0) 0x7f3268003520 con 0x7f328406a630 2024-03-12T17:33:18.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.538+0000 7f3282000640 1 -- 172.21.15.17:0/74135813 >> v2:172.21.15.94:3300/0 conn(0x7f328415b820 msgr2=0x7f328406a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:18.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.538+0000 7f3282000640 1 --2- 172.21.15.17:0/74135813 >> v2:172.21.15.94:3300/0 conn(0x7f328415b820 0x7f328406a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:18.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.538+0000 7f3282000640 1 -- 172.21.15.17:0/74135813 >> v1:172.21.15.94:6789/0 conn(0x7f328415a8a0 legacy=0x7f32840cb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:18.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.538+0000 7f3282000640 1 -- 172.21.15.17:0/74135813 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32840cbfc0 con 0x7f328406a630 2024-03-12T17:33:18.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.538+0000 7f3282000640 1 -- 172.21.15.17:0/74135813 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7f327c001a10 con 0x7f328406a630 2024-03-12T17:33:18.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.538+0000 7f3282000640 1 -- 172.21.15.17:0/74135813 >> v1:172.21.15.17:6789/0 conn(0x7f328406a630 legacy=0x7f328415beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:18.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.538+0000 7f3282000640 1 --2- 172.21.15.17:0/74135813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3268003970 0x7f3268003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:18.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.538+0000 7f3282000640 1 --2- 172.21.15.17:0/74135813 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f32680047c0 0x7f3268004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:18.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.538+0000 7f3282000640 1 --2- 172.21.15.17:0/74135813 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3268005180 0x7f326800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:18.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.538+0000 7f3282000640 1 -- 172.21.15.17:0/74135813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32840cbce0 con 0x7f3268003970 2024-03-12T17:33:18.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.538+0000 7f3282000640 1 -- 172.21.15.17:0/74135813 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f326800c020 con 0x7f3268005180 2024-03-12T17:33:18.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.538+0000 7f3282000640 1 -- 172.21.15.17:0/74135813 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f326800c1e0 con 0x7f32680047c0 2024-03-12T17:33:18.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.538+0000 7f3282a00640 1 --2- 172.21.15.17:0/74135813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3268003970 0x7f3268003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:18.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.539+0000 7f327be00640 1 --2- 172.21.15.17:0/74135813 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f32680047c0 0x7f3268004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:18.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.539+0000 7f3282a00640 1 -- 172.21.15.17:0/74135813 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f32680047c0 msgr2=0x7f3268004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:18.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.539+0000 7f3282a00640 1 --2- 172.21.15.17:0/74135813 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f32680047c0 0x7f3268004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:18.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.539+0000 7f3282a00640 1 -- 172.21.15.17:0/74135813 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3268005180 msgr2=0x7f326800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:18.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.539+0000 7f3282a00640 1 --2- 172.21.15.17:0/74135813 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f3268005180 0x7f326800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:18.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.539+0000 7f3282a00640 1 -- 172.21.15.17:0/74135813 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3268003520 con 0x7f3268003970 2024-03-12T17:33:18.536 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.539+0000 7f3283400640 1 -- 172.21.15.17:0/74135813 reap_dead start 2024-03-12T17:33:18.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.540+0000 7f3282a00640 1 --2- 172.21.15.17:0/74135813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3268003970 0x7f3268003d90 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f3274001750 tx=0x7f32680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d92a211955375c9 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:18.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.540+0000 7f3282000640 1 -- 172.21.15.17:0/74135813 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32740052d0 con 0x7f3268003970 2024-03-12T17:33:18.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.541+0000 7f3282000640 1 -- 172.21.15.17:0/74135813 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327402e050 con 0x7f3268003970 2024-03-12T17:33:18.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.541+0000 7f3282000640 1 -- 172.21.15.17:0/74135813 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3274003830 con 0x7f3268003970 2024-03-12T17:33:18.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.541+0000 7f3283e00640 1 -- 172.21.15.17:0/74135813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3268003970 msgr2=0x7f3268003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:18.537 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.541+0000 7f3283e00640 1 --2- 172.21.15.17:0/74135813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3268003970 0x7f3268003d90 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f3274001750 tx=0x7f32680057f0 comp rx=0 tx=0).stop 2024-03-12T17:33:18.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.541+0000 7f3283e00640 1 -- 172.21.15.17:0/74135813 shutdown_connections 2024-03-12T17:33:18.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.541+0000 7f3283e00640 1 --2- 172.21.15.17:0/74135813 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3268003970 0x7f3268003d90 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:18.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.541+0000 7f3283e00640 1 -- 172.21.15.17:0/74135813 >> 172.21.15.17:0/74135813 conn(0x7f3284069ce0 msgr2=0x7f32840b3970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:18.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.541+0000 7f3283e00640 1 -- 172.21.15.17:0/74135813 shutdown_connections 2024-03-12T17:33:18.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.541+0000 7f3283e00640 1 -- 172.21.15.17:0/74135813 wait complete. 2024-03-12T17:33:18.538 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.543+0000 7f3283e00640 1 Processor -- start 2024-03-12T17:33:18.539 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.543+0000 7f3283e00640 1 -- start start 2024-03-12T17:33:18.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.544+0000 7f3283e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3268003970 0x7f328413f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:18.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.544+0000 7f3283e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f328413fea0 0x7f32841414b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:18.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.544+0000 7f3283e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f32841419f0 0x7f3284143390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:18.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.544+0000 7f3283e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3284141090 con 0x7f3268003970 2024-03-12T17:33:18.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.544+0000 7f3283e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328413fbc0 con 0x7f32841419f0 2024-03-12T17:33:18.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.544+0000 7f3283e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3284140410 con 0x7f328413fea0 2024-03-12T17:33:18.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.544+0000 7f3282a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3268003970 0x7f328413f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:18.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.544+0000 7f3282a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3268003970 0x7f328413f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35902/0 (socket says 172.21.15.17:35902) 2024-03-12T17:33:18.540 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.544+0000 7f3282a00640 1 -- 172.21.15.17:0/2865653295 learned_addr learned my addr 172.21.15.17:0/2865653295 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:18.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.545+0000 7f327be00640 1 --2- 172.21.15.17:0/2865653295 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f328413fea0 0x7f32841414b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:18.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.545+0000 7f3282a00640 1 -- 172.21.15.17:0/2865653295 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f328413fea0 msgr2=0x7f32841414b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:18.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.545+0000 7f3282a00640 1 --2- 172.21.15.17:0/2865653295 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f328413fea0 0x7f32841414b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:18.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.545+0000 7f3282a00640 1 -- 172.21.15.17:0/2865653295 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f32841419f0 msgr2=0x7f3284143390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:18.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.545+0000 7f3282a00640 1 --2- 172.21.15.17:0/2865653295 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f32841419f0 0x7f3284143390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:18.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.545+0000 7f3282a00640 1 -- 172.21.15.17:0/2865653295 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32841406f0 con 0x7f3268003970 2024-03-12T17:33:18.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.545+0000 7f3282a00640 1 --2- 172.21.15.17:0/2865653295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3268003970 0x7f328413f680 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f3274005040 tx=0x7f3274001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:18.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.546+0000 7f327b400640 1 -- 172.21.15.17:0/2865653295 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32740076c0 con 0x7f3268003970 2024-03-12T17:33:18.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.546+0000 7f327b400640 1 -- 172.21.15.17:0/2865653295 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3274007a30 con 0x7f3268003970 2024-03-12T17:33:18.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.546+0000 7f327b400640 1 -- 172.21.15.17:0/2865653295 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3274006be0 con 0x7f3268003970 2024-03-12T17:33:18.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.546+0000 7f3283e00640 1 -- 172.21.15.17:0/2865653295 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32841409d0 con 0x7f3268003970 2024-03-12T17:33:18.542 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.546+0000 7f3283e00640 1 -- 172.21.15.17:0/2865653295 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32841537a0 con 0x7f3268003970 2024-03-12T17:33:18.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.547+0000 7f3283e00640 1 -- 172.21.15.17:0/2865653295 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f32840b11b0 con 0x7f3268003970 2024-03-12T17:33:18.543 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.548+0000 7f327b400640 1 -- 172.21.15.17:0/2865653295 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f3274006d40 con 0x7f3268003970 2024-03-12T17:33:18.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.549+0000 7f327b400640 1 --2- 172.21.15.17:0/2865653295 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f326006ac30 0x7f326006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:18.544 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.549+0000 7f327b400640 1 -- 172.21.15.17:0/2865653295 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f32740ab120 con 0x7f3268003970 2024-03-12T17:33:18.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.549+0000 7f327be00640 1 --2- 172.21.15.17:0/2865653295 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f326006ac30 0x7f326006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:18.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.549+0000 7f327b400640 1 --2- 172.21.15.17:0/2865653295 >> [v2:172.21.15.17:6800/37305,v1:172.21.15.17:6801/37305] conn(0x7f3260070a90 0x7f3260072eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:18.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.549+0000 7f327b400640 1 -- 172.21.15.17:0/2865653295 --> [v2:172.21.15.17:6800/37305,v1:172.21.15.17:6801/37305] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3260073560 con 0x7f3260070a90 2024-03-12T17:33:18.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.549+0000 7f327b400640 1 -- 172.21.15.17:0/2865653295 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32740ad700 con 0x7f3268003970 2024-03-12T17:33:18.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.549+0000 7f3283400640 1 --2- 172.21.15.17:0/2865653295 >> [v2:172.21.15.17:6800/37305,v1:172.21.15.17:6801/37305] conn(0x7f3260070a90 0x7f3260072eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:18.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.550+0000 7f327be00640 1 --2- 172.21.15.17:0/2865653295 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f326006ac30 0x7f326006d0f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3284071590 tx=0x7f326c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:18.545 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.550+0000 7f3283400640 1 --2- 172.21.15.17:0/2865653295 >> [v2:172.21.15.17:6800/37305,v1:172.21.15.17:6801/37305] conn(0x7f3260070a90 0x7f3260072eb0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:18.546 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.551+0000 7f327b400640 1 -- 172.21.15.17:0/2865653295 <== osd.0 v2:172.21.15.17:6800/37305 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f3260073560 con 0x7f3260070a90 2024-03-12T17:33:18.560 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.564+0000 7f3283e00640 1 -- 172.21.15.17:0/2865653295 --> [v2:172.21.15.17:6800/37305,v1:172.21.15.17:6801/37305] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f328415b300 con 0x7f3260070a90 2024-03-12T17:33:18.561 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.565+0000 7f327b400640 1 -- 172.21.15.17:0/2865653295 <== osd.0 v2:172.21.15.17:6800/37305 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f327c001e00 con 0x7f3260070a90 2024-03-12T17:33:18.561 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-12T17:33:18.561 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-12T17:33:18.561 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-12T17:33:18.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.566+0000 7f3283e00640 1 -- 172.21.15.17:0/2865653295 >> [v2:172.21.15.17:6800/37305,v1:172.21.15.17:6801/37305] conn(0x7f3260070a90 msgr2=0x7f3260072eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:18.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.566+0000 7f3283e00640 1 --2- 172.21.15.17:0/2865653295 >> [v2:172.21.15.17:6800/37305,v1:172.21.15.17:6801/37305] conn(0x7f3260070a90 0x7f3260072eb0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:18.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.566+0000 7f3283e00640 1 -- 172.21.15.17:0/2865653295 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f326006ac30 msgr2=0x7f326006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:18.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.566+0000 7f3283e00640 1 --2- 172.21.15.17:0/2865653295 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f326006ac30 0x7f326006d0f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3284071590 tx=0x7f326c008040 comp rx=0 tx=0).stop 2024-03-12T17:33:18.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.566+0000 7f3283e00640 1 -- 172.21.15.17:0/2865653295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3268003970 msgr2=0x7f328413f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:18.562 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.566+0000 7f3283e00640 1 --2- 172.21.15.17:0/2865653295 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f3268003970 0x7f328413f680 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f3274005040 tx=0x7f3274001120 comp rx=0 tx=0).stop 2024-03-12T17:33:18.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.566+0000 7f3283400640 1 -- 172.21.15.17:0/2865653295 reap_dead start 2024-03-12T17:33:18.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.566+0000 7f3283e00640 1 -- 172.21.15.17:0/2865653295 shutdown_connections 2024-03-12T17:33:18.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.566+0000 7f3283e00640 1 -- 172.21.15.17:0/2865653295 >> 172.21.15.17:0/2865653295 conn(0x7f3284069ce0 msgr2=0x7f32840ae540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:18.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.566+0000 7f3283e00640 1 -- 172.21.15.17:0/2865653295 shutdown_connections 2024-03-12T17:33:18.563 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.566+0000 7f3283e00640 1 -- 172.21.15.17:0/2865653295 wait complete. 2024-03-12T17:33:18.579 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-03-12T17:33:18.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.811+0000 7fb633000640 1 Processor -- start 2024-03-12T17:33:18.807 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.812+0000 7fb633000640 1 -- start start 2024-03-12T17:33:18.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.813+0000 7fb633000640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb62c070ba0 0x7fb62c0cc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:18.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.813+0000 7fb633000640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fb62c0cccd0 0x7fb62c13fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:18.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.813+0000 7fb633000640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb62c15bd70 con 0x7fb62c1403a0 2024-03-12T17:33:18.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.813+0000 7fb633000640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb62c140e80 con 0x7fb62c070ba0 2024-03-12T17:33:18.809 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.813+0000 7fb633000640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb62c0cd160 con 0x7fb62c0cccd0 2024-03-12T17:33:18.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.814+0000 7fb631c00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb62c070ba0 0x7fb62c0cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:18.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.814+0000 7fb631c00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fb62c070ba0 0x7fb62c0cc790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35904/0 (socket says 172.21.15.17:35904) 2024-03-12T17:33:18.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.814+0000 7fb631c00640 1 -- 172.21.15.17:0/3753583602 learned_addr learned my addr 172.21.15.17:0/3753583602 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:18.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.814+0000 7fb631200640 1 --2- 172.21.15.17:0/3753583602 >> v2:172.21.15.94:3300/0 conn(0x7fb62c0cccd0 0x7fb62c13fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:18.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.814+0000 7fb631c00640 1 -- 172.21.15.17:0/3753583602 >> v2:172.21.15.94:3300/0 conn(0x7fb62c0cccd0 msgr2=0x7fb62c13fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:18.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.814+0000 7fb631c00640 1 --2- 172.21.15.17:0/3753583602 >> v2:172.21.15.94:3300/0 conn(0x7fb62c0cccd0 0x7fb62c13fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:18.810 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.814+0000 7fb631c00640 1 -- 172.21.15.17:0/3753583602 >> v1:172.21.15.94:6789/0 conn(0x7fb62c1403a0 legacy=0x7fb62c0cb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:18.811 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.814+0000 7fb631c00640 1 -- 172.21.15.17:0/3753583602 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb62c070f80 con 0x7fb62c070ba0 2024-03-12T17:33:18.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.816+0000 7fb631c00640 1 --2- 172.21.15.17:0/3753583602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb62c070ba0 0x7fb62c0cc790 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fb62c0ce440 tx=0x7fb62002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92fc2d298803accf server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:18.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.817+0000 7fb62be00640 1 -- 172.21.15.17:0/3753583602 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb620031870 con 0x7fb62c070ba0 2024-03-12T17:33:18.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.817+0000 7fb62be00640 1 -- 172.21.15.17:0/3753583602 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6200319d0 con 0x7fb62c070ba0 2024-03-12T17:33:18.812 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.817+0000 7fb62be00640 1 -- 172.21.15.17:0/3753583602 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb620031d60 con 0x7fb62c070ba0 2024-03-12T17:33:18.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.817+0000 7fb633000640 1 -- 172.21.15.17:0/3753583602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb62c070ba0 msgr2=0x7fb62c0cc790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:18.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.817+0000 7fb633000640 1 --2- 172.21.15.17:0/3753583602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb62c070ba0 0x7fb62c0cc790 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fb62c0ce440 tx=0x7fb62002b910 comp rx=0 tx=0).stop 2024-03-12T17:33:18.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.817+0000 7fb633000640 1 -- 172.21.15.17:0/3753583602 shutdown_connections 2024-03-12T17:33:18.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.817+0000 7fb633000640 1 --2- 172.21.15.17:0/3753583602 >> v2:172.21.15.94:3300/0 conn(0x7fb62c0cccd0 0x7fb62c13fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:18.813 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.817+0000 7fb633000640 1 --2- 172.21.15.17:0/3753583602 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb62c070ba0 0x7fb62c0cc790 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:18.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.817+0000 7fb633000640 1 -- 172.21.15.17:0/3753583602 >> 172.21.15.17:0/3753583602 conn(0x7fb62c066000 msgr2=0x7fb62c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:18.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.818+0000 7fb633000640 1 -- 172.21.15.17:0/3753583602 shutdown_connections 2024-03-12T17:33:18.814 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.818+0000 7fb633000640 1 -- 172.21.15.17:0/3753583602 wait complete. 2024-03-12T17:33:18.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.820+0000 7fb633000640 1 Processor -- start 2024-03-12T17:33:18.815 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.820+0000 7fb633000640 1 -- start start 2024-03-12T17:33:18.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.821+0000 7fb633000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb62c070ba0 0x7fb62c1e40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:18.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.821+0000 7fb633000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb62c0cccd0 0x7fb62c155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:18.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.821+0000 7fb633000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb62c1403a0 0x7fb62c156ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:18.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.821+0000 7fb633000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c1593f0 con 0x7fb62c1403a0 2024-03-12T17:33:18.818 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.821+0000 7fb633000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c1e45e0 con 0x7fb62c070ba0 2024-03-12T17:33:18.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.821+0000 7fb633000640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb62c158b00 con 0x7fb62c0cccd0 2024-03-12T17:33:18.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.822+0000 7fb632600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb62c1403a0 0x7fb62c156ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:18.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.822+0000 7fb632600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb62c1403a0 0x7fb62c156ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35910/0 (socket says 172.21.15.17:35910) 2024-03-12T17:33:18.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.822+0000 7fb632600640 1 -- 172.21.15.17:0/3620584669 learned_addr learned my addr 172.21.15.17:0/3620584669 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:18.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.822+0000 7fb631200640 1 --2- 172.21.15.17:0/3620584669 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb62c0cccd0 0x7fb62c155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:18.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.822+0000 7fb631c00640 1 --2- 172.21.15.17:0/3620584669 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb62c070ba0 0x7fb62c1e40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:18.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.822+0000 7fb632600640 1 -- 172.21.15.17:0/3620584669 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb62c0cccd0 msgr2=0x7fb62c155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:18.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.822+0000 7fb632600640 1 --2- 172.21.15.17:0/3620584669 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb62c0cccd0 0x7fb62c155e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:18.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.822+0000 7fb632600640 1 -- 172.21.15.17:0/3620584669 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb62c070ba0 msgr2=0x7fb62c1e40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:18.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.822+0000 7fb632600640 1 --2- 172.21.15.17:0/3620584669 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb62c070ba0 0x7fb62c1e40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:18.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.822+0000 7fb632600640 1 -- 172.21.15.17:0/3620584669 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6200094d0 con 0x7fb62c1403a0 2024-03-12T17:33:18.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.822+0000 7fb632600640 1 --2- 172.21.15.17:0/3620584669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb62c1403a0 0x7fb62c156ad0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb62400b9a0 tx=0x7fb62400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:18.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.823+0000 7fb629600640 1 -- 172.21.15.17:0/3620584669 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb62400cba0 con 0x7fb62c1403a0 2024-03-12T17:33:18.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.823+0000 7fb629600640 1 -- 172.21.15.17:0/3620584669 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb62400cd00 con 0x7fb62c1403a0 2024-03-12T17:33:18.819 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.823+0000 7fb629600640 1 -- 172.21.15.17:0/3620584669 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb624014680 con 0x7fb62c1403a0 2024-03-12T17:33:18.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.823+0000 7fb633000640 1 -- 172.21.15.17:0/3620584669 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb62c1563b0 con 0x7fb62c1403a0 2024-03-12T17:33:18.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.823+0000 7fb633000640 1 -- 172.21.15.17:0/3620584669 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb62c158da0 con 0x7fb62c1403a0 2024-03-12T17:33:18.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.824+0000 7fb633000640 1 -- 172.21.15.17:0/3620584669 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb62c1595a0 con 0x7fb62c1403a0 2024-03-12T17:33:18.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.825+0000 7fb629600640 1 -- 172.21.15.17:0/3620584669 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fb62401d3b0 con 0x7fb62c1403a0 2024-03-12T17:33:18.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.827+0000 7fb629600640 1 --2- 172.21.15.17:0/3620584669 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb60c06ac00 0x7fb60c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:18.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.827+0000 7fb629600640 1 -- 172.21.15.17:0/3620584669 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb624088f10 con 0x7fb62c1403a0 2024-03-12T17:33:18.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.827+0000 7fb631c00640 1 --2- 172.21.15.17:0/3620584669 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb60c06ac00 0x7fb60c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:18.823 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.828+0000 7fb631c00640 1 --2- 172.21.15.17:0/3620584669 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb60c06ac00 0x7fb60c06d0c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb620036000 tx=0x7fb62003c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:18.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:18.832+0000 7fb629600640 1 -- 172.21.15.17:0/3620584669 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fb62c1595a0 con 0x7fb62c1403a0 2024-03-12T17:33:19.028 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.032+0000 7fb633000640 1 -- 172.21.15.17:0/3620584669 --> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fb62c15b590 con 0x7fb60c06ac00 2024-03-12T17:33:19.029 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.033+0000 7fb629600640 1 -- 172.21.15.17:0/3620584669 <== mgr.4104 v2:172.21.15.17:6832/37052 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb620031bc0 con 0x7fb60c06ac00 2024-03-12T17:33:19.029 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 0 to deep-scrub 2024-03-12T17:33:19.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.036+0000 7fb633000640 1 -- 172.21.15.17:0/3620584669 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb60c06ac00 msgr2=0x7fb60c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:19.031 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.036+0000 7fb633000640 1 --2- 172.21.15.17:0/3620584669 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb60c06ac00 0x7fb60c06d0c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb620036000 tx=0x7fb62003c040 comp rx=0 tx=0).stop 2024-03-12T17:33:19.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.036+0000 7fb633000640 1 -- 172.21.15.17:0/3620584669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb62c1403a0 msgr2=0x7fb62c156ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:19.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.036+0000 7fb633000640 1 --2- 172.21.15.17:0/3620584669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb62c1403a0 0x7fb62c156ad0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb62400b9a0 tx=0x7fb62400be60 comp rx=0 tx=0).stop 2024-03-12T17:33:19.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.036+0000 7fb633000640 1 -- 172.21.15.17:0/3620584669 shutdown_connections 2024-03-12T17:33:19.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.036+0000 7fb633000640 1 --2- 172.21.15.17:0/3620584669 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fb60c06ac00 0x7fb60c06d0c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:19.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.036+0000 7fb633000640 1 --2- 172.21.15.17:0/3620584669 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fb62c1403a0 0x7fb62c156ad0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:19.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.036+0000 7fb633000640 1 --2- 172.21.15.17:0/3620584669 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fb62c0cccd0 0x7fb62c155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:19.032 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.036+0000 7fb633000640 1 --2- 172.21.15.17:0/3620584669 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fb62c070ba0 0x7fb62c1e40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:19.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.036+0000 7fb633000640 1 -- 172.21.15.17:0/3620584669 >> 172.21.15.17:0/3620584669 conn(0x7fb62c066000 msgr2=0x7fb62c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:19.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.036+0000 7fb633000640 1 -- 172.21.15.17:0/3620584669 shutdown_connections 2024-03-12T17:33:19.033 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.036+0000 7fb633000640 1 -- 172.21.15.17:0/3620584669 wait complete. 2024-03-12T17:33:19.051 INFO:tasks.ceph:Scrubbing osd.1 2024-03-12T17:33:19.052 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-03-12T17:33:19.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.269+0000 7f65b6800640 1 Processor -- start 2024-03-12T17:33:19.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.269+0000 7f65b6800640 1 -- start start 2024-03-12T17:33:19.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.271+0000 7f65b6800640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f65b015bba0 0x7f65b01641f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:19.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.271+0000 7f65b6800640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65b0159b90 con 0x7f65b006a0f0 2024-03-12T17:33:19.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.271+0000 7f65b6800640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65b0159dd0 con 0x7f65b00cd8d0 2024-03-12T17:33:19.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.271+0000 7f65b6800640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65b00ce640 con 0x7f65b015bba0 2024-03-12T17:33:19.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.271+0000 7f65b5400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f65b006a0f0 0x7f65b006a4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37600/0 (socket says 172.21.15.17:37600) 2024-03-12T17:33:19.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.271+0000 7f65b5400640 1 -- 172.21.15.17:0/773870014 learned_addr learned my addr 172.21.15.17:0/773870014 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:33:19.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.271+0000 7f65b5e00640 1 --2- 172.21.15.17:0/773870014 >> v2:172.21.15.17:3300/0 conn(0x7f65b015bba0 0x7f65b01641f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:19.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.272+0000 7f65afe00640 1 -- 172.21.15.17:0/773870014 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3429318474 0 0) 0x7f65a4001110 con 0x7f65b006a0f0 2024-03-12T17:33:19.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.272+0000 7f65afe00640 1 -- 172.21.15.17:0/773870014 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6598003520 con 0x7f65b006a0f0 2024-03-12T17:33:19.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.272+0000 7f65b5e00640 1 -- 172.21.15.17:0/773870014 >> v1:172.21.15.94:6789/0 conn(0x7f65b00cd8d0 legacy=0x7f65b00cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:19.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.272+0000 7f65b5e00640 1 -- 172.21.15.17:0/773870014 >> v1:172.21.15.17:6789/0 conn(0x7f65b006a0f0 legacy=0x7f65b006a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:19.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.272+0000 7f65afe00640 1 -- 172.21.15.17:0/773870014 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1357488914 0 0) 0x7f6598003520 con 0x7f65b006a0f0 2024-03-12T17:33:19.268 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.272+0000 7f65b5e00640 1 -- 172.21.15.17:0/773870014 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b015a0b0 con 0x7f65b015bba0 2024-03-12T17:33:19.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.273+0000 7f65b5e00640 1 --2- 172.21.15.17:0/773870014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65b015bba0 0x7f65b01641f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f65a8009d90 tx=0x7f65a802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af06872d6f121c60 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:19.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.274+0000 7f65afe00640 1 -- 172.21.15.17:0/773870014 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a802cd00 con 0x7f65b015bba0 2024-03-12T17:33:19.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.274+0000 7f65afe00640 1 -- 172.21.15.17:0/773870014 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a802ce60 con 0x7f65b015bba0 2024-03-12T17:33:19.269 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.274+0000 7f65afe00640 1 -- 172.21.15.17:0/773870014 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a8034660 con 0x7f65b015bba0 2024-03-12T17:33:19.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.274+0000 7f65b6800640 1 -- 172.21.15.17:0/773870014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65b015bba0 msgr2=0x7f65b01641f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:19.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.274+0000 7f65b6800640 1 --2- 172.21.15.17:0/773870014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65b015bba0 0x7f65b01641f0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f65a8009d90 tx=0x7f65a802bf50 comp rx=0 tx=0).stop 2024-03-12T17:33:19.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.274+0000 7f65b6800640 1 -- 172.21.15.17:0/773870014 shutdown_connections 2024-03-12T17:33:19.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.274+0000 7f65b6800640 1 --2- 172.21.15.17:0/773870014 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65b015bba0 0x7f65b01641f0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:19.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.274+0000 7f65b6800640 1 -- 172.21.15.17:0/773870014 >> 172.21.15.17:0/773870014 conn(0x7f65b0069ce0 msgr2=0x7f65b00b3970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:19.270 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.274+0000 7f65b6800640 1 -- 172.21.15.17:0/773870014 shutdown_connections 2024-03-12T17:33:19.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.275+0000 7f65b6800640 1 -- 172.21.15.17:0/773870014 wait complete. 2024-03-12T17:33:19.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.276+0000 7f65b6800640 1 Processor -- start 2024-03-12T17:33:19.272 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.276+0000 7f65b6800640 1 -- start start 2024-03-12T17:33:19.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.277+0000 7f65b6800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65b006a0f0 0x7f65b0143a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:19.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.277+0000 7f65b6800640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65b00cd8d0 0x7f65b0155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:19.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.277+0000 7f65b6800640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f65b015bba0 0x7f65b015c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:19.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.277+0000 7f65b6800640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b0143f60 con 0x7f65b006a0f0 2024-03-12T17:33:19.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.277+0000 7f65b6800640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b0156260 con 0x7f65b00cd8d0 2024-03-12T17:33:19.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.277+0000 7f65b6800640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65b0156540 con 0x7f65b015bba0 2024-03-12T17:33:19.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.277+0000 7f65b5400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65b006a0f0 0x7f65b0143a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:19.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.278+0000 7f65b5400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65b006a0f0 0x7f65b0143a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35928/0 (socket says 172.21.15.17:35928) 2024-03-12T17:33:19.273 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.278+0000 7f65b5400640 1 -- 172.21.15.17:0/1619920429 learned_addr learned my addr 172.21.15.17:0/1619920429 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:19.275 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.278+0000 7f65b5e00640 1 --2- 172.21.15.17:0/1619920429 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f65b015bba0 0x7f65b015c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:19.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.278+0000 7f65b4a00640 1 --2- 172.21.15.17:0/1619920429 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65b00cd8d0 0x7f65b0155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:19.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.278+0000 7f65b5400640 1 -- 172.21.15.17:0/1619920429 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f65b015bba0 msgr2=0x7f65b015c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:19.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.278+0000 7f65b5400640 1 --2- 172.21.15.17:0/1619920429 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f65b015bba0 0x7f65b015c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:19.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.278+0000 7f65b5400640 1 -- 172.21.15.17:0/1619920429 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65b00cd8d0 msgr2=0x7f65b0155810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:19.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.278+0000 7f65b5400640 1 --2- 172.21.15.17:0/1619920429 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f65b00cd8d0 0x7f65b0155810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:19.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.278+0000 7f65b5400640 1 -- 172.21.15.17:0/1619920429 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a8009a70 con 0x7f65b006a0f0 2024-03-12T17:33:19.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.278+0000 7f65b5400640 1 --2- 172.21.15.17:0/1619920429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65b006a0f0 0x7f65b0143a20 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f65a4007fd0 tx=0x7f65a400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:19.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.279+0000 7f65ad600640 1 -- 172.21.15.17:0/1619920429 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a4005ce0 con 0x7f65b006a0f0 2024-03-12T17:33:19.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.279+0000 7f65ad600640 1 -- 172.21.15.17:0/1619920429 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a4005e40 con 0x7f65b006a0f0 2024-03-12T17:33:19.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.279+0000 7f65b6800640 1 -- 172.21.15.17:0/1619920429 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65b0156820 con 0x7f65b006a0f0 2024-03-12T17:33:19.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.279+0000 7f65ad600640 1 -- 172.21.15.17:0/1619920429 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a4007310 con 0x7f65b006a0f0 2024-03-12T17:33:19.276 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.279+0000 7f65b6800640 1 -- 172.21.15.17:0/1619920429 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65b014fb60 con 0x7f65b006a0f0 2024-03-12T17:33:19.277 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.280+0000 7f65b6800640 1 -- 172.21.15.17:0/1619920429 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f65b015a670 con 0x7f65b006a0f0 2024-03-12T17:33:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.281+0000 7f65ad600640 1 -- 172.21.15.17:0/1619920429 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f65a4007530 con 0x7f65b006a0f0 2024-03-12T17:33:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.282+0000 7f65ad600640 1 --2- 172.21.15.17:0/1619920429 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f659006ac00 0x7f659006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.282+0000 7f65ad600640 1 -- 172.21.15.17:0/1619920429 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f65a40884b0 con 0x7f65b006a0f0 2024-03-12T17:33:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.282+0000 7f65b4a00640 1 --2- 172.21.15.17:0/1619920429 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f659006ac00 0x7f659006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.282+0000 7f65ad600640 1 --2- 172.21.15.17:0/1619920429 >> [v2:172.21.15.17:6812/37307,v1:172.21.15.17:6814/37307] conn(0x7f6590070a60 0x7f6590072e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.282+0000 7f65ad600640 1 -- 172.21.15.17:0/1619920429 --> [v2:172.21.15.17:6812/37307,v1:172.21.15.17:6814/37307] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6590073530 con 0x7f6590070a60 2024-03-12T17:33:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.282+0000 7f65ad600640 1 -- 172.21.15.17:0/1619920429 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65a408ab10 con 0x7f65b006a0f0 2024-03-12T17:33:19.278 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.282+0000 7f65b5e00640 1 --2- 172.21.15.17:0/1619920429 >> [v2:172.21.15.17:6812/37307,v1:172.21.15.17:6814/37307] conn(0x7f6590070a60 0x7f6590072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:19.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.283+0000 7f65b4a00640 1 --2- 172.21.15.17:0/1619920429 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f659006ac00 0x7f659006d0c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f65b01376f0 tx=0x7f659c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:19.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.283+0000 7f65b5e00640 1 --2- 172.21.15.17:0/1619920429 >> [v2:172.21.15.17:6812/37307,v1:172.21.15.17:6814/37307] conn(0x7f6590070a60 0x7f6590072e80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:19.279 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.284+0000 7f65ad600640 1 -- 172.21.15.17:0/1619920429 <== osd.1 v2:172.21.15.17:6812/37307 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f6590073530 con 0x7f6590070a60 2024-03-12T17:33:19.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.297+0000 7f65b6800640 1 -- 172.21.15.17:0/1619920429 --> [v2:172.21.15.17:6812/37307,v1:172.21.15.17:6814/37307] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f65b0159b90 con 0x7f6590070a60 2024-03-12T17:33:19.293 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.297+0000 7f65ad600640 1 -- 172.21.15.17:0/1619920429 <== osd.1 v2:172.21.15.17:6812/37307 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f65b0159b90 con 0x7f6590070a60 2024-03-12T17:33:19.293 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-12T17:33:19.293 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-12T17:33:19.293 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-12T17:33:19.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.298+0000 7f65b6800640 1 -- 172.21.15.17:0/1619920429 >> [v2:172.21.15.17:6812/37307,v1:172.21.15.17:6814/37307] conn(0x7f6590070a60 msgr2=0x7f6590072e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:19.294 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.298+0000 7f65b6800640 1 --2- 172.21.15.17:0/1619920429 >> [v2:172.21.15.17:6812/37307,v1:172.21.15.17:6814/37307] conn(0x7f6590070a60 0x7f6590072e80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:19.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.298+0000 7f65b6800640 1 -- 172.21.15.17:0/1619920429 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f659006ac00 msgr2=0x7f659006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:19.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.298+0000 7f65b6800640 1 --2- 172.21.15.17:0/1619920429 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f659006ac00 0x7f659006d0c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f65b01376f0 tx=0x7f659c009040 comp rx=0 tx=0).stop 2024-03-12T17:33:19.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.298+0000 7f65b6800640 1 -- 172.21.15.17:0/1619920429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65b006a0f0 msgr2=0x7f65b0143a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:19.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.298+0000 7f65b6800640 1 --2- 172.21.15.17:0/1619920429 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f65b006a0f0 0x7f65b0143a20 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f65a4007fd0 tx=0x7f65a400c9b0 comp rx=0 tx=0).stop 2024-03-12T17:33:19.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.298+0000 7f65b5e00640 1 -- 172.21.15.17:0/1619920429 reap_dead start 2024-03-12T17:33:19.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.298+0000 7f65b6800640 1 -- 172.21.15.17:0/1619920429 shutdown_connections 2024-03-12T17:33:19.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.298+0000 7f65b6800640 1 -- 172.21.15.17:0/1619920429 >> 172.21.15.17:0/1619920429 conn(0x7f65b0069ce0 msgr2=0x7f65b00afa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:19.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.298+0000 7f65b6800640 1 -- 172.21.15.17:0/1619920429 shutdown_connections 2024-03-12T17:33:19.295 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.298+0000 7f65b6800640 1 -- 172.21.15.17:0/1619920429 wait complete. 2024-03-12T17:33:19.311 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-03-12T17:33:19.518 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.523+0000 7f4280a00640 1 Processor -- start 2024-03-12T17:33:19.519 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.523+0000 7f4280a00640 1 -- start start 2024-03-12T17:33:19.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.525+0000 7f4280a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f427c15ccc0 0x7f427c15dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:19.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.525+0000 7f4280a00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f427c06a3f0 0x7f427c0aca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:19.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.525+0000 7f4280a00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f427c0b2620 con 0x7f427c0b4210 2024-03-12T17:33:19.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.525+0000 7f4280a00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f427c15e230 con 0x7f427c15ccc0 2024-03-12T17:33:19.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.525+0000 7f4280a00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f427c0ac600 con 0x7f427c06a3f0 2024-03-12T17:33:19.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.526+0000 7f4279e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f427c15ccc0 0x7f427c15dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:19.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.526+0000 7f4279400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f427c0b4210 0x7f427c069ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37614/0 (socket says 172.21.15.17:37614) 2024-03-12T17:33:19.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.526+0000 7f4279400640 1 -- 172.21.15.17:0/2430380090 learned_addr learned my addr 172.21.15.17:0/2430380090 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:33:19.522 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.526+0000 7f427a800640 1 --2- 172.21.15.17:0/2430380090 >> v2:172.21.15.94:3300/0 conn(0x7f427c06a3f0 0x7f427c0aca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:19.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.526+0000 7f4279e00640 1 -- 172.21.15.17:0/2430380090 >> v2:172.21.15.94:3300/0 conn(0x7f427c06a3f0 msgr2=0x7f427c0aca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:19.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.526+0000 7f4279e00640 1 --2- 172.21.15.17:0/2430380090 >> v2:172.21.15.94:3300/0 conn(0x7f427c06a3f0 0x7f427c0aca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:19.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.526+0000 7f4279e00640 1 -- 172.21.15.17:0/2430380090 >> v1:172.21.15.17:6789/0 conn(0x7f427c0b4210 legacy=0x7f427c069ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:19.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.526+0000 7f4279e00640 1 -- 172.21.15.17:0/2430380090 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f427c0b0f60 con 0x7f427c15ccc0 2024-03-12T17:33:19.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.526+0000 7f427a800640 1 --2- 172.21.15.17:0/2430380090 >> v2:172.21.15.94:3300/0 conn(0x7f427c06a3f0 0x7f427c0aca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:33:19.523 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.527+0000 7f4279e00640 1 --2- 172.21.15.17:0/2430380090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f427c15ccc0 0x7f427c15dcf0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f426c009d90 tx=0x7f426c02bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9b6d1dbbc3f0948 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:19.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.527+0000 7f4278a00640 1 -- 172.21.15.17:0/2430380090 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c02cb40 con 0x7f427c15ccc0 2024-03-12T17:33:19.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.528+0000 7f4278a00640 1 -- 172.21.15.17:0/2430380090 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426c02cca0 con 0x7f427c15ccc0 2024-03-12T17:33:19.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.528+0000 7f4278a00640 1 -- 172.21.15.17:0/2430380090 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c034660 con 0x7f427c15ccc0 2024-03-12T17:33:19.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.528+0000 7f4280a00640 1 -- 172.21.15.17:0/2430380090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f427c15ccc0 msgr2=0x7f427c15dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:19.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.528+0000 7f4280a00640 1 --2- 172.21.15.17:0/2430380090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f427c15ccc0 0x7f427c15dcf0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f426c009d90 tx=0x7f426c02bd90 comp rx=0 tx=0).stop 2024-03-12T17:33:19.524 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.528+0000 7f4280a00640 1 -- 172.21.15.17:0/2430380090 shutdown_connections 2024-03-12T17:33:19.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.528+0000 7f4280a00640 1 --2- 172.21.15.17:0/2430380090 >> v2:172.21.15.94:3300/0 conn(0x7f427c06a3f0 0x7f427c0aca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:19.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.528+0000 7f4280a00640 1 --2- 172.21.15.17:0/2430380090 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f427c15ccc0 0x7f427c15dcf0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:19.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.528+0000 7f4280a00640 1 -- 172.21.15.17:0/2430380090 >> 172.21.15.17:0/2430380090 conn(0x7f427c098a60 msgr2=0x7f427c0b4b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:19.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.528+0000 7f4280a00640 1 -- 172.21.15.17:0/2430380090 shutdown_connections 2024-03-12T17:33:19.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.528+0000 7f4280a00640 1 -- 172.21.15.17:0/2430380090 wait complete. 2024-03-12T17:33:19.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.530+0000 7f4280a00640 1 Processor -- start 2024-03-12T17:33:19.525 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.530+0000 7f4280a00640 1 -- start start 2024-03-12T17:33:19.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.531+0000 7f4280a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f427c06a3f0 0x7f427c15bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:19.527 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.531+0000 7f4280a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f427c0b4210 0x7f427c14abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:19.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.531+0000 7f4280a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f427c15ccc0 0x7f427c1f5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:19.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.531+0000 7f4280a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427c152f80 con 0x7f427c06a3f0 2024-03-12T17:33:19.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.531+0000 7f4280a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427c1529c0 con 0x7f427c15ccc0 2024-03-12T17:33:19.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.531+0000 7f4280a00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f427c152ca0 con 0x7f427c0b4210 2024-03-12T17:33:19.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.531+0000 7f4279e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f427c06a3f0 0x7f427c15bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:19.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.531+0000 7f4279e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f427c06a3f0 0x7f427c15bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35938/0 (socket says 172.21.15.17:35938) 2024-03-12T17:33:19.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.531+0000 7f4279e00640 1 -- 172.21.15.17:0/821131918 learned_addr learned my addr 172.21.15.17:0/821131918 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:19.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.531+0000 7f4279400640 1 --2- 172.21.15.17:0/821131918 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f427c0b4210 0x7f427c14abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:19.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.532+0000 7f427a800640 1 --2- 172.21.15.17:0/821131918 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f427c15ccc0 0x7f427c1f5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:19.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.532+0000 7f4279e00640 1 -- 172.21.15.17:0/821131918 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f427c0b4210 msgr2=0x7f427c14abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:19.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.532+0000 7f4279e00640 1 --2- 172.21.15.17:0/821131918 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f427c0b4210 0x7f427c14abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:19.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.532+0000 7f4279e00640 1 -- 172.21.15.17:0/821131918 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f427c15ccc0 msgr2=0x7f427c1f5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:19.528 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.532+0000 7f4279e00640 1 --2- 172.21.15.17:0/821131918 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f427c15ccc0 0x7f427c1f5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:19.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.532+0000 7f4279e00640 1 -- 172.21.15.17:0/821131918 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426c009a70 con 0x7f427c06a3f0 2024-03-12T17:33:19.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.532+0000 7f4279e00640 1 --2- 172.21.15.17:0/821131918 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f427c06a3f0 0x7f427c15bd60 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f426c009d90 tx=0x7f426c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:19.529 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.532+0000 7f4272000640 1 -- 172.21.15.17:0/821131918 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c040650 con 0x7f427c06a3f0 2024-03-12T17:33:19.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.532+0000 7f4272000640 1 -- 172.21.15.17:0/821131918 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426c0407d0 con 0x7f427c06a3f0 2024-03-12T17:33:19.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.532+0000 7f4272000640 1 -- 172.21.15.17:0/821131918 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c040b80 con 0x7f427c06a3f0 2024-03-12T17:33:19.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.532+0000 7f4280a00640 1 -- 172.21.15.17:0/821131918 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f427c155630 con 0x7f427c06a3f0 2024-03-12T17:33:19.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.533+0000 7f4280a00640 1 -- 172.21.15.17:0/821131918 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f427c14b100 con 0x7f427c06a3f0 2024-03-12T17:33:19.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.534+0000 7f4280a00640 1 -- 172.21.15.17:0/821131918 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f427c155b50 con 0x7f427c06a3f0 2024-03-12T17:33:19.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.535+0000 7f4272000640 1 -- 172.21.15.17:0/821131918 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f426c040ce0 con 0x7f427c06a3f0 2024-03-12T17:33:19.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.536+0000 7f4272000640 1 --2- 172.21.15.17:0/821131918 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f425c06ac00 0x7f425c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:19.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.536+0000 7f4272000640 1 -- 172.21.15.17:0/821131918 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f426c0ac030 con 0x7f427c06a3f0 2024-03-12T17:33:19.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.536+0000 7f4279400640 1 --2- 172.21.15.17:0/821131918 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f425c06ac00 0x7f425c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:19.532 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.537+0000 7f4279400640 1 --2- 172.21.15.17:0/821131918 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f425c06ac00 0x7f425c06d0c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f427c158e30 tx=0x7f4268009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:19.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.540+0000 7f4272000640 1 -- 172.21.15.17:0/821131918 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f427c155b50 con 0x7f427c06a3f0 2024-03-12T17:33:19.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.738+0000 7f4280a00640 1 -- 172.21.15.17:0/821131918 --> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f427c152e10 con 0x7f425c06ac00 2024-03-12T17:33:19.735 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.739+0000 7f4272000640 1 -- 172.21.15.17:0/821131918 <== mgr.4104 v2:172.21.15.17:6832/37052 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f427c152e10 con 0x7f425c06ac00 2024-03-12T17:33:19.735 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 1 to deep-scrub 2024-03-12T17:33:19.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.741+0000 7f4280a00640 1 -- 172.21.15.17:0/821131918 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f425c06ac00 msgr2=0x7f425c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:19.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.741+0000 7f4280a00640 1 --2- 172.21.15.17:0/821131918 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f425c06ac00 0x7f425c06d0c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f427c158e30 tx=0x7f4268009040 comp rx=0 tx=0).stop 2024-03-12T17:33:19.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.742+0000 7f4280a00640 1 -- 172.21.15.17:0/821131918 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f427c06a3f0 msgr2=0x7f427c15bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:19.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.742+0000 7f4280a00640 1 --2- 172.21.15.17:0/821131918 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f427c06a3f0 0x7f427c15bd60 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f426c009d90 tx=0x7f426c004a40 comp rx=0 tx=0).stop 2024-03-12T17:33:19.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.742+0000 7f4280a00640 1 -- 172.21.15.17:0/821131918 shutdown_connections 2024-03-12T17:33:19.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.742+0000 7f4280a00640 1 --2- 172.21.15.17:0/821131918 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f425c06ac00 0x7f425c06d0c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:19.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.742+0000 7f4280a00640 1 --2- 172.21.15.17:0/821131918 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f427c15ccc0 0x7f427c1f5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:19.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.742+0000 7f4280a00640 1 --2- 172.21.15.17:0/821131918 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f427c0b4210 0x7f427c14abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:19.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.742+0000 7f4280a00640 1 --2- 172.21.15.17:0/821131918 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f427c06a3f0 0x7f427c15bd60 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:19.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.742+0000 7f4280a00640 1 -- 172.21.15.17:0/821131918 >> 172.21.15.17:0/821131918 conn(0x7f427c098a60 msgr2=0x7f427c0cfb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:19.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.742+0000 7f4280a00640 1 -- 172.21.15.17:0/821131918 shutdown_connections 2024-03-12T17:33:19.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.742+0000 7f4280a00640 1 -- 172.21.15.17:0/821131918 wait complete. 2024-03-12T17:33:19.755 INFO:tasks.ceph:Scrubbing osd.2 2024-03-12T17:33:19.755 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-03-12T17:33:19.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.992+0000 7fd50cc00640 1 Processor -- start 2024-03-12T17:33:19.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.992+0000 7fd50cc00640 1 -- start start 2024-03-12T17:33:19.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.993+0000 7fd50cc00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd50815cd40 0x7fd5080b42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:19.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.994+0000 7fd50cc00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd508160fa0 con 0x7fd50815c960 2024-03-12T17:33:19.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.994+0000 7fd50cc00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd508161280 con 0x7fd5080b38e0 2024-03-12T17:33:19.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.994+0000 7fd50cc00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd508160db0 con 0x7fd50815cd40 2024-03-12T17:33:19.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.994+0000 7fd505400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd50815cd40 0x7fd5080b42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:19.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.994+0000 7fd505e00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fd50815c960 0x7fd5081606a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37618/0 (socket says 172.21.15.17:37618) 2024-03-12T17:33:19.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.994+0000 7fd505e00640 1 -- 172.21.15.17:0/346513396 learned_addr learned my addr 172.21.15.17:0/346513396 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:33:19.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.995+0000 7fd505400640 1 -- 172.21.15.17:0/346513396 >> v1:172.21.15.94:6789/0 conn(0x7fd5080b38e0 legacy=0x7fd50806b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:19.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.995+0000 7fd505400640 1 -- 172.21.15.17:0/346513396 >> v1:172.21.15.17:6789/0 conn(0x7fd50815c960 legacy=0x7fd5081606a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:19.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.995+0000 7fd505400640 1 -- 172.21.15.17:0/346513396 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd50806b1b0 con 0x7fd50815cd40 2024-03-12T17:33:19.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.995+0000 7fd504a00640 1 -- 172.21.15.17:0/346513396 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1135984751 0 0) 0x7fd508160fa0 con 0x7fd50815c960 2024-03-12T17:33:19.991 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.996+0000 7fd505400640 1 --2- 172.21.15.17:0/346513396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd50815cd40 0x7fd5080b42f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fd4f40097d0 tx=0x7fd4f402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a11f64ffa3ce1fd server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:19.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.996+0000 7fd504a00640 1 -- 172.21.15.17:0/346513396 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f4031830 con 0x7fd50815cd40 2024-03-12T17:33:19.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.996+0000 7fd504a00640 1 -- 172.21.15.17:0/346513396 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f4031990 con 0x7fd50815cd40 2024-03-12T17:33:19.992 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.996+0000 7fd504a00640 1 -- 172.21.15.17:0/346513396 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f4031d20 con 0x7fd50815cd40 2024-03-12T17:33:19.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.997+0000 7fd50cc00640 1 -- 172.21.15.17:0/346513396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd50815cd40 msgr2=0x7fd5080b42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:19.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.997+0000 7fd50cc00640 1 --2- 172.21.15.17:0/346513396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd50815cd40 0x7fd5080b42f0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fd4f40097d0 tx=0x7fd4f402b8d0 comp rx=0 tx=0).stop 2024-03-12T17:33:19.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.997+0000 7fd50cc00640 1 -- 172.21.15.17:0/346513396 shutdown_connections 2024-03-12T17:33:19.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.997+0000 7fd50cc00640 1 --2- 172.21.15.17:0/346513396 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd50815cd40 0x7fd5080b42f0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:19.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.997+0000 7fd50cc00640 1 -- 172.21.15.17:0/346513396 >> 172.21.15.17:0/346513396 conn(0x7fd50806e6d0 msgr2=0x7fd50806eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:19.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.997+0000 7fd50cc00640 1 -- 172.21.15.17:0/346513396 shutdown_connections 2024-03-12T17:33:19.993 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.997+0000 7fd50cc00640 1 -- 172.21.15.17:0/346513396 wait complete. 2024-03-12T17:33:19.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.999+0000 7fd50cc00640 1 Processor -- start 2024-03-12T17:33:19.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:19.999+0000 7fd50cc00640 1 -- start start 2024-03-12T17:33:19.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.000+0000 7fd50cc00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5080b38e0 0x7fd50815ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:19.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.000+0000 7fd50cc00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd50815c960 0x7fd5081f3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:19.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.000+0000 7fd50cc00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd50815cd40 0x7fd5080cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:19.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.000+0000 7fd50cc00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5080cab60 con 0x7fd50815cd40 2024-03-12T17:33:19.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.000+0000 7fd50cc00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5081f3cb0 con 0x7fd5080b38e0 2024-03-12T17:33:19.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.000+0000 7fd50cc00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5080c9f50 con 0x7fd50815c960 2024-03-12T17:33:19.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.001+0000 7fd506800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd50815cd40 0x7fd5080cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:19.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.001+0000 7fd506800640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd50815cd40 0x7fd5080cb1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35946/0 (socket says 172.21.15.17:35946) 2024-03-12T17:33:19.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.001+0000 7fd506800640 1 -- 172.21.15.17:0/3009183525 learned_addr learned my addr 172.21.15.17:0/3009183525 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:19.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.001+0000 7fd505e00640 1 --2- 172.21.15.17:0/3009183525 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5080b38e0 0x7fd50815ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:19.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.001+0000 7fd505400640 1 --2- 172.21.15.17:0/3009183525 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd50815c960 0x7fd5081f3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:19.997 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.001+0000 7fd506800640 1 -- 172.21.15.17:0/3009183525 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd50815c960 msgr2=0x7fd5081f3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:19.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.001+0000 7fd506800640 1 --2- 172.21.15.17:0/3009183525 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd50815c960 0x7fd5081f3770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:19.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.001+0000 7fd506800640 1 -- 172.21.15.17:0/3009183525 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5080b38e0 msgr2=0x7fd50815ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:19.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.001+0000 7fd506800640 1 --2- 172.21.15.17:0/3009183525 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd5080b38e0 0x7fd50815ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:19.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.001+0000 7fd506800640 1 -- 172.21.15.17:0/3009183525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f4009400 con 0x7fd50815cd40 2024-03-12T17:33:19.998 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.001+0000 7fd506800640 1 --2- 172.21.15.17:0/3009183525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd50815cd40 0x7fd5080cb1c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fd50000c700 tx=0x7fd50000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:19.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.002+0000 7fd4fe000640 1 -- 172.21.15.17:0/3009183525 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50000aa50 con 0x7fd50815cd40 2024-03-12T17:33:19.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.002+0000 7fd4fe000640 1 -- 172.21.15.17:0/3009183525 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50000abb0 con 0x7fd50815cd40 2024-03-12T17:33:19.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.002+0000 7fd50cc00640 1 -- 172.21.15.17:0/3009183525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5080ca230 con 0x7fd50815cd40 2024-03-12T17:33:19.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.002+0000 7fd4fe000640 1 -- 172.21.15.17:0/3009183525 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50000ce10 con 0x7fd50815cd40 2024-03-12T17:33:19.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.002+0000 7fd50cc00640 1 -- 172.21.15.17:0/3009183525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5080ca7f0 con 0x7fd50815cd40 2024-03-12T17:33:19.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.003+0000 7fd50cc00640 1 -- 172.21.15.17:0/3009183525 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd508161560 con 0x7fd50815cd40 2024-03-12T17:33:19.999 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.004+0000 7fd4fe000640 1 -- 172.21.15.17:0/3009183525 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fd500012420 con 0x7fd50815cd40 2024-03-12T17:33:20.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.005+0000 7fd4fe000640 1 --2- 172.21.15.17:0/3009183525 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd4e806ac00 0x7fd4e806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:20.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.005+0000 7fd4fe000640 1 -- 172.21.15.17:0/3009183525 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd500089610 con 0x7fd50815cd40 2024-03-12T17:33:20.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.005+0000 7fd4fe000640 1 --2- 172.21.15.17:0/3009183525 >> [v2:172.21.15.17:6808/37303,v1:172.21.15.17:6809/37303] conn(0x7fd4e8070a60 0x7fd4e8072e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:20.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.005+0000 7fd4fe000640 1 -- 172.21.15.17:0/3009183525 --> [v2:172.21.15.17:6808/37303,v1:172.21.15.17:6809/37303] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd4e8073530 con 0x7fd4e8070a60 2024-03-12T17:33:20.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.005+0000 7fd4fe000640 1 -- 172.21.15.17:0/3009183525 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd50008bbf0 con 0x7fd50815cd40 2024-03-12T17:33:20.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.005+0000 7fd505e00640 1 --2- 172.21.15.17:0/3009183525 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd4e806ac00 0x7fd4e806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:20.001 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.005+0000 7fd505400640 1 --2- 172.21.15.17:0/3009183525 >> [v2:172.21.15.17:6808/37303,v1:172.21.15.17:6809/37303] conn(0x7fd4e8070a60 0x7fd4e8072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:20.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.006+0000 7fd505e00640 1 --2- 172.21.15.17:0/3009183525 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd4e806ac00 0x7fd4e806d0c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8000f60 tx=0x7fd4f8007b50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:20.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.006+0000 7fd505400640 1 --2- 172.21.15.17:0/3009183525 >> [v2:172.21.15.17:6808/37303,v1:172.21.15.17:6809/37303] conn(0x7fd4e8070a60 0x7fd4e8072e80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:20.002 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.007+0000 7fd4fe000640 1 -- 172.21.15.17:0/3009183525 <== osd.2 v2:172.21.15.17:6808/37303 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fd4e8073530 con 0x7fd4e8070a60 2024-03-12T17:33:20.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.021+0000 7fd50cc00640 1 -- 172.21.15.17:0/3009183525 --> [v2:172.21.15.17:6808/37303,v1:172.21.15.17:6809/37303] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd5080736c0 con 0x7fd4e8070a60 2024-03-12T17:33:20.017 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.021+0000 7fd4fe000640 1 -- 172.21.15.17:0/3009183525 <== osd.2 v2:172.21.15.17:6808/37303 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd5080736c0 con 0x7fd4e8070a60 2024-03-12T17:33:20.017 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-12T17:33:20.018 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-12T17:33:20.018 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-12T17:33:20.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.022+0000 7fd50cc00640 1 -- 172.21.15.17:0/3009183525 >> [v2:172.21.15.17:6808/37303,v1:172.21.15.17:6809/37303] conn(0x7fd4e8070a60 msgr2=0x7fd4e8072e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:20.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.022+0000 7fd50cc00640 1 --2- 172.21.15.17:0/3009183525 >> [v2:172.21.15.17:6808/37303,v1:172.21.15.17:6809/37303] conn(0x7fd4e8070a60 0x7fd4e8072e80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:20.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.022+0000 7fd50cc00640 1 -- 172.21.15.17:0/3009183525 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd4e806ac00 msgr2=0x7fd4e806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:20.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.022+0000 7fd50cc00640 1 --2- 172.21.15.17:0/3009183525 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd4e806ac00 0x7fd4e806d0c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8000f60 tx=0x7fd4f8007b50 comp rx=0 tx=0).stop 2024-03-12T17:33:20.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.022+0000 7fd50cc00640 1 -- 172.21.15.17:0/3009183525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd50815cd40 msgr2=0x7fd5080cb1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:20.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.022+0000 7fd50cc00640 1 --2- 172.21.15.17:0/3009183525 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd50815cd40 0x7fd5080cb1c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fd50000c700 tx=0x7fd50000cbc0 comp rx=0 tx=0).stop 2024-03-12T17:33:20.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.022+0000 7fd506800640 1 -- 172.21.15.17:0/3009183525 reap_dead start 2024-03-12T17:33:20.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.022+0000 7fd50cc00640 1 -- 172.21.15.17:0/3009183525 shutdown_connections 2024-03-12T17:33:20.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.022+0000 7fd50cc00640 1 -- 172.21.15.17:0/3009183525 >> 172.21.15.17:0/3009183525 conn(0x7fd50806e6d0 msgr2=0x7fd5080cfe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:20.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.022+0000 7fd50cc00640 1 -- 172.21.15.17:0/3009183525 shutdown_connections 2024-03-12T17:33:20.019 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.023+0000 7fd50cc00640 1 -- 172.21.15.17:0/3009183525 wait complete. 2024-03-12T17:33:20.036 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-03-12T17:33:20.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.258+0000 7f5143200640 1 Processor -- start 2024-03-12T17:33:20.254 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.259+0000 7f5143200640 1 -- start start 2024-03-12T17:33:20.256 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.260+0000 7f5143200640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f51440ccea0 0x7f514413fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:20.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.260+0000 7f5143200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f51441403a0 0x7f5144140850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:20.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.260+0000 7f5143200640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514415bd70 con 0x7f5144070ba0 2024-03-12T17:33:20.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.260+0000 7f5143200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5144140e80 con 0x7f51441403a0 2024-03-12T17:33:20.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.260+0000 7f5143200640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f514415adc0 con 0x7f51440ccea0 2024-03-12T17:33:20.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.260+0000 7f5141e00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f5144070ba0 0x7f51440cc790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37632/0 (socket says 172.21.15.17:37632) 2024-03-12T17:33:20.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.260+0000 7f5141e00640 1 -- 172.21.15.17:0/3198046947 learned_addr learned my addr 172.21.15.17:0/3198046947 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:33:20.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.260+0000 7f5142800640 1 --2- 172.21.15.17:0/3198046947 >> v2:172.21.15.17:3300/0 conn(0x7f51441403a0 0x7f5144140850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:20.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.261+0000 7f513be00640 1 --2- 172.21.15.17:0/3198046947 >> v2:172.21.15.94:3300/0 conn(0x7f51440ccea0 0x7f514413fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:20.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.261+0000 7f5141400640 1 -- 172.21.15.17:0/3198046947 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 408535698 0 0) 0x7f5134001110 con 0x7f5144070ba0 2024-03-12T17:33:20.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.261+0000 7f5141400640 1 -- 172.21.15.17:0/3198046947 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5128003520 con 0x7f5144070ba0 2024-03-12T17:33:20.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.261+0000 7f5142800640 1 -- 172.21.15.17:0/3198046947 >> v2:172.21.15.94:3300/0 conn(0x7f51440ccea0 msgr2=0x7f514413fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:20.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.261+0000 7f5142800640 1 --2- 172.21.15.17:0/3198046947 >> v2:172.21.15.94:3300/0 conn(0x7f51440ccea0 0x7f514413fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:20.257 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.261+0000 7f5142800640 1 -- 172.21.15.17:0/3198046947 >> v1:172.21.15.17:6789/0 conn(0x7f5144070ba0 legacy=0x7f51440cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:20.258 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.261+0000 7f5142800640 1 -- 172.21.15.17:0/3198046947 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5144070f80 con 0x7f51441403a0 2024-03-12T17:33:20.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.262+0000 7f5142800640 1 --2- 172.21.15.17:0/3198046947 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51441403a0 0x7f5144140850 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f51440ce160 tx=0x7f513c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fbe379c4371ed6c server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:20.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.263+0000 7f5141400640 1 -- 172.21.15.17:0/3198046947 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c02cc80 con 0x7f51441403a0 2024-03-12T17:33:20.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.263+0000 7f5141400640 1 -- 172.21.15.17:0/3198046947 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f513c02cde0 con 0x7f51441403a0 2024-03-12T17:33:20.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.263+0000 7f5141400640 1 -- 172.21.15.17:0/3198046947 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513c034660 con 0x7f51441403a0 2024-03-12T17:33:20.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.263+0000 7f5143200640 1 -- 172.21.15.17:0/3198046947 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51441403a0 msgr2=0x7f5144140850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:20.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.263+0000 7f5143200640 1 --2- 172.21.15.17:0/3198046947 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51441403a0 0x7f5144140850 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f51440ce160 tx=0x7f513c02bed0 comp rx=0 tx=0).stop 2024-03-12T17:33:20.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.263+0000 7f5143200640 1 -- 172.21.15.17:0/3198046947 shutdown_connections 2024-03-12T17:33:20.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.263+0000 7f5143200640 1 --2- 172.21.15.17:0/3198046947 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51441403a0 0x7f5144140850 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:20.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.263+0000 7f5143200640 1 --2- 172.21.15.17:0/3198046947 >> v2:172.21.15.94:3300/0 conn(0x7f51440ccea0 0x7f514413fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:20.259 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.263+0000 7f5143200640 1 -- 172.21.15.17:0/3198046947 >> 172.21.15.17:0/3198046947 conn(0x7f5144066000 msgr2=0x7f5144069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:20.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.263+0000 7f5143200640 1 -- 172.21.15.17:0/3198046947 shutdown_connections 2024-03-12T17:33:20.260 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.263+0000 7f5143200640 1 -- 172.21.15.17:0/3198046947 wait complete. 2024-03-12T17:33:20.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.265+0000 7f5143200640 1 Processor -- start 2024-03-12T17:33:20.261 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.265+0000 7f5143200640 1 -- start start 2024-03-12T17:33:20.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.266+0000 7f5143200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5144070ba0 0x7f5144155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:20.263 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.266+0000 7f5143200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51440ccea0 0x7f5144139240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:20.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.266+0000 7f5143200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51441403a0 0x7f514415d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:20.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.266+0000 7f5143200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5144156d50 con 0x7f51440ccea0 2024-03-12T17:33:20.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.266+0000 7f5143200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51441f9f40 con 0x7f51441403a0 2024-03-12T17:33:20.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.266+0000 7f5143200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5144139780 con 0x7f5144070ba0 2024-03-12T17:33:20.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.267+0000 7f513be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51440ccea0 0x7f5144139240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:20.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.267+0000 7f513be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51440ccea0 0x7f5144139240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35964/0 (socket says 172.21.15.17:35964) 2024-03-12T17:33:20.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.267+0000 7f513be00640 1 -- 172.21.15.17:0/3159203591 learned_addr learned my addr 172.21.15.17:0/3159203591 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:20.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.267+0000 7f5141e00640 1 --2- 172.21.15.17:0/3159203591 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5144070ba0 0x7f5144155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:20.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.267+0000 7f513be00640 1 -- 172.21.15.17:0/3159203591 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5144070ba0 msgr2=0x7f5144155480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:20.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.267+0000 7f5142800640 1 --2- 172.21.15.17:0/3159203591 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51441403a0 0x7f514415d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:20.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.267+0000 7f513be00640 1 --2- 172.21.15.17:0/3159203591 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5144070ba0 0x7f5144155480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:20.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.267+0000 7f513be00640 1 -- 172.21.15.17:0/3159203591 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51441403a0 msgr2=0x7f514415d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:20.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.267+0000 7f513be00640 1 --2- 172.21.15.17:0/3159203591 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51441403a0 0x7f514415d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:20.264 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.267+0000 7f513be00640 1 -- 172.21.15.17:0/3159203591 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f513c009a70 con 0x7f51440ccea0 2024-03-12T17:33:20.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.267+0000 7f513be00640 1 --2- 172.21.15.17:0/3159203591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51440ccea0 0x7f5144139240 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f512c00d7d0 tx=0x7f512c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:20.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.268+0000 7f513a000640 1 -- 172.21.15.17:0/3159203591 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c00b6c0 con 0x7f51440ccea0 2024-03-12T17:33:20.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.268+0000 7f513a000640 1 -- 172.21.15.17:0/3159203591 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512c00b820 con 0x7f51440ccea0 2024-03-12T17:33:20.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.268+0000 7f513a000640 1 -- 172.21.15.17:0/3159203591 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c00bbb0 con 0x7f51440ccea0 2024-03-12T17:33:20.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.268+0000 7f5143200640 1 -- 172.21.15.17:0/3159203591 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f514415d880 con 0x7f51440ccea0 2024-03-12T17:33:20.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.268+0000 7f5143200640 1 -- 172.21.15.17:0/3159203591 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51441fa470 con 0x7f51440ccea0 2024-03-12T17:33:20.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.269+0000 7f5143200640 1 -- 172.21.15.17:0/3159203591 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f514404e030 con 0x7f51440ccea0 2024-03-12T17:33:20.265 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.270+0000 7f513a000640 1 -- 172.21.15.17:0/3159203591 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f512c00bd10 con 0x7f51440ccea0 2024-03-12T17:33:20.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.271+0000 7f513a000640 1 --2- 172.21.15.17:0/3159203591 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f512006ac30 0x7f512006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:20.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.271+0000 7f513a000640 1 -- 172.21.15.17:0/3159203591 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f512c089570 con 0x7f51440ccea0 2024-03-12T17:33:20.266 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.271+0000 7f5141e00640 1 --2- 172.21.15.17:0/3159203591 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f512006ac30 0x7f512006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:20.267 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.272+0000 7f5141e00640 1 --2- 172.21.15.17:0/3159203591 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f512006ac30 0x7f512006d0f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5134001370 tx=0x7f5134009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:20.271 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.275+0000 7f513a000640 1 -- 172.21.15.17:0/3159203591 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f512c054a40 con 0x7f51440ccea0 2024-03-12T17:33:20.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.474+0000 7f5143200640 1 -- 172.21.15.17:0/3159203591 --> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f514415b590 con 0x7f512006ac30 2024-03-12T17:33:20.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.475+0000 7f513a000640 1 -- 172.21.15.17:0/3159203591 <== mgr.4104 v2:172.21.15.17:6832/37052 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5134001c50 con 0x7f512006ac30 2024-03-12T17:33:20.471 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 2 to deep-scrub 2024-03-12T17:33:20.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.478+0000 7f5143200640 1 -- 172.21.15.17:0/3159203591 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f512006ac30 msgr2=0x7f512006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:20.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.478+0000 7f5143200640 1 --2- 172.21.15.17:0/3159203591 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f512006ac30 0x7f512006d0f0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5134001370 tx=0x7f5134009040 comp rx=0 tx=0).stop 2024-03-12T17:33:20.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.478+0000 7f5143200640 1 -- 172.21.15.17:0/3159203591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51440ccea0 msgr2=0x7f5144139240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:20.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.478+0000 7f5143200640 1 --2- 172.21.15.17:0/3159203591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51440ccea0 0x7f5144139240 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f512c00d7d0 tx=0x7f512c00dc90 comp rx=0 tx=0).stop 2024-03-12T17:33:20.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.478+0000 7f5143200640 1 -- 172.21.15.17:0/3159203591 shutdown_connections 2024-03-12T17:33:20.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.478+0000 7f5143200640 1 --2- 172.21.15.17:0/3159203591 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f512006ac30 0x7f512006d0f0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:20.474 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.478+0000 7f5143200640 1 --2- 172.21.15.17:0/3159203591 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51441403a0 0x7f514415d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:20.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.478+0000 7f5143200640 1 --2- 172.21.15.17:0/3159203591 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51440ccea0 0x7f5144139240 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:20.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.478+0000 7f5143200640 1 --2- 172.21.15.17:0/3159203591 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f5144070ba0 0x7f5144155480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:20.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.478+0000 7f5143200640 1 -- 172.21.15.17:0/3159203591 >> 172.21.15.17:0/3159203591 conn(0x7f5144066000 msgr2=0x7f514415a120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:20.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.478+0000 7f5143200640 1 -- 172.21.15.17:0/3159203591 shutdown_connections 2024-03-12T17:33:20.475 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.479+0000 7f5143200640 1 -- 172.21.15.17:0/3159203591 wait complete. 2024-03-12T17:33:20.491 INFO:tasks.ceph:Scrubbing osd.3 2024-03-12T17:33:20.492 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-03-12T17:33:20.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.718+0000 7f640fe00640 1 Processor -- start 2024-03-12T17:33:20.713 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.718+0000 7f640fe00640 1 -- start start 2024-03-12T17:33:20.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.719+0000 7f640fe00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f64100cf9e0 0x7f6410160730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:20.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.719+0000 7f640fe00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f641015cd90 0x7f6410160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:20.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.719+0000 7f640fe00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64100b8520 con 0x7f641015c9b0 2024-03-12T17:33:20.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.719+0000 7f640fe00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64101615f0 con 0x7f64100cf9e0 2024-03-12T17:33:20.715 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.719+0000 7f640fe00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6410161310 con 0x7f641015cd90 2024-03-12T17:33:20.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.720+0000 7f640ea00640 1 --1- >> v1:172.21.15.94:6789/0 conn(0x7f641015c9b0 0x7f64100cf2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.94:6789/0 says I am v1:172.21.15.17:56366/0 (socket says 172.21.15.17:56366) 2024-03-12T17:33:20.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.720+0000 7f640ea00640 1 -- 172.21.15.17:0/1725599065 learned_addr learned my addr 172.21.15.17:0/1725599065 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:33:20.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.720+0000 7f640e000640 1 --2- 172.21.15.17:0/1725599065 >> v2:172.21.15.94:3300/0 conn(0x7f64100cf9e0 0x7f6410160730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:20.716 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.720+0000 7f640f400640 1 --2- 172.21.15.17:0/1725599065 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f641015cd90 0x7f6410160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:20.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.721+0000 7f640f400640 1 -- 172.21.15.17:0/1725599065 >> v2:172.21.15.94:3300/0 conn(0x7f64100cf9e0 msgr2=0x7f6410160730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:20.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.721+0000 7f640f400640 1 --2- 172.21.15.17:0/1725599065 >> v2:172.21.15.94:3300/0 conn(0x7f64100cf9e0 0x7f6410160730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:20.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.721+0000 7f640f400640 1 -- 172.21.15.17:0/1725599065 >> v1:172.21.15.94:6789/0 conn(0x7f641015c9b0 legacy=0x7f64100cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:20.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.721+0000 7f640f400640 1 -- 172.21.15.17:0/1725599065 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64100d0a70 con 0x7f641015cd90 2024-03-12T17:33:20.717 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.721+0000 7f640d600640 1 -- 172.21.15.17:0/1725599065 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3044830016 0 0) 0x7f64100b8520 con 0x7f641015c9b0 2024-03-12T17:33:20.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.722+0000 7f640f400640 1 --2- 172.21.15.17:0/1725599065 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f641015cd90 0x7f6410160c70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6408009d90 tx=0x7f640802be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8e83baa29abf796 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:20.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.723+0000 7f640d600640 1 -- 172.21.15.17:0/1725599065 <== mon.2 v2:172.21.15.94:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640802cbc0 con 0x7f641015cd90 2024-03-12T17:33:20.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.723+0000 7f640d600640 1 -- 172.21.15.17:0/1725599065 <== mon.2 v2:172.21.15.94:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f640802cd20 con 0x7f641015cd90 2024-03-12T17:33:20.718 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.723+0000 7f640d600640 1 -- 172.21.15.17:0/1725599065 <== mon.2 v2:172.21.15.94:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6408034660 con 0x7f641015cd90 2024-03-12T17:33:20.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.723+0000 7f640fe00640 1 -- 172.21.15.17:0/1725599065 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f641015cd90 msgr2=0x7f6410160c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:20.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.723+0000 7f640fe00640 1 --2- 172.21.15.17:0/1725599065 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f641015cd90 0x7f6410160c70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6408009d90 tx=0x7f640802be10 comp rx=0 tx=0).stop 2024-03-12T17:33:20.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.723+0000 7f640fe00640 1 -- 172.21.15.17:0/1725599065 shutdown_connections 2024-03-12T17:33:20.719 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.723+0000 7f640fe00640 1 --2- 172.21.15.17:0/1725599065 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f641015cd90 0x7f6410160c70 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:20.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.723+0000 7f640fe00640 1 --2- 172.21.15.17:0/1725599065 >> v2:172.21.15.94:3300/0 conn(0x7f64100cf9e0 0x7f6410160730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:20.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.723+0000 7f640fe00640 1 -- 172.21.15.17:0/1725599065 >> 172.21.15.17:0/1725599065 conn(0x7f641006b160 msgr2=0x7f641006b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:20.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.723+0000 7f640fe00640 1 -- 172.21.15.17:0/1725599065 shutdown_connections 2024-03-12T17:33:20.720 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.723+0000 7f640fe00640 1 -- 172.21.15.17:0/1725599065 wait complete. 2024-03-12T17:33:20.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.725+0000 7f640fe00640 1 Processor -- start 2024-03-12T17:33:20.721 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.725+0000 7f640fe00640 1 -- start start 2024-03-12T17:33:20.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.726+0000 7f640fe00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f64100cf9e0 0x7f641015b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:20.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.726+0000 7f640fe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f641015c9b0 0x7f64100c6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:20.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.726+0000 7f640fe00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f641015cd90 0x7f64101f2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:20.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.726+0000 7f640fe00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641015e1f0 con 0x7f641015c9b0 2024-03-12T17:33:20.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.726+0000 7f640fe00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641015e4d0 con 0x7f641015cd90 2024-03-12T17:33:20.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.726+0000 7f640fe00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f641015e7b0 con 0x7f64100cf9e0 2024-03-12T17:33:20.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.727+0000 7f640e000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f641015c9b0 0x7f64100c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:20.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.727+0000 7f640e000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f641015c9b0 0x7f64100c6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35968/0 (socket says 172.21.15.17:35968) 2024-03-12T17:33:20.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.727+0000 7f640e000640 1 -- 172.21.15.17:0/2051150018 learned_addr learned my addr 172.21.15.17:0/2051150018 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:20.723 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.727+0000 7f640ea00640 1 --2- 172.21.15.17:0/2051150018 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f64100cf9e0 0x7f641015b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:20.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.727+0000 7f640f400640 1 --2- 172.21.15.17:0/2051150018 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f641015cd90 0x7f64101f2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:20.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.727+0000 7f640e000640 1 -- 172.21.15.17:0/2051150018 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f64100cf9e0 msgr2=0x7f641015b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:20.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.727+0000 7f640e000640 1 --2- 172.21.15.17:0/2051150018 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f64100cf9e0 0x7f641015b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:20.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.727+0000 7f640e000640 1 -- 172.21.15.17:0/2051150018 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f641015cd90 msgr2=0x7f64101f2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:20.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.727+0000 7f640e000640 1 --2- 172.21.15.17:0/2051150018 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f641015cd90 0x7f64101f2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:20.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.727+0000 7f640e000640 1 -- 172.21.15.17:0/2051150018 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6408009a70 con 0x7f641015c9b0 2024-03-12T17:33:20.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.727+0000 7f640f400640 1 --2- 172.21.15.17:0/2051150018 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f641015cd90 0x7f64101f2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:33:20.724 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.728+0000 7f640e000640 1 --2- 172.21.15.17:0/2051150018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f641015c9b0 0x7f64100c6900 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f63fc00e9b0 tx=0x7f63fc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:20.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.728+0000 7f6406a00640 1 -- 172.21.15.17:0/2051150018 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63fc009670 con 0x7f641015c9b0 2024-03-12T17:33:20.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.728+0000 7f6406a00640 1 -- 172.21.15.17:0/2051150018 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63fc00c9a0 con 0x7f641015c9b0 2024-03-12T17:33:20.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.728+0000 7f640fe00640 1 -- 172.21.15.17:0/2051150018 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f641015ea90 con 0x7f641015c9b0 2024-03-12T17:33:20.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.728+0000 7f6406a00640 1 -- 172.21.15.17:0/2051150018 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63fc00cd50 con 0x7f641015c9b0 2024-03-12T17:33:20.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.728+0000 7f640fe00640 1 -- 172.21.15.17:0/2051150018 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f641015f050 con 0x7f641015c9b0 2024-03-12T17:33:20.725 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.729+0000 7f640fe00640 1 -- 172.21.15.17:0/2051150018 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f64100d1030 con 0x7f641015c9b0 2024-03-12T17:33:20.726 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.730+0000 7f6406a00640 1 -- 172.21.15.17:0/2051150018 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f63fc013470 con 0x7f641015c9b0 2024-03-12T17:33:20.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.731+0000 7f6406a00640 1 --2- 172.21.15.17:0/2051150018 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f63f006ac00 0x7f63f006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:20.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.731+0000 7f6406a00640 1 -- 172.21.15.17:0/2051150018 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f63fc0895e0 con 0x7f641015c9b0 2024-03-12T17:33:20.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.732+0000 7f6406a00640 1 --2- 172.21.15.17:0/2051150018 >> [v2:172.21.15.17:6820/37308,v1:172.21.15.17:6822/37308] conn(0x7f63f0070a60 0x7f63f0072e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:20.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.732+0000 7f640ea00640 1 --2- 172.21.15.17:0/2051150018 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f63f006ac00 0x7f63f006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:20.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.732+0000 7f6406a00640 1 -- 172.21.15.17:0/2051150018 --> [v2:172.21.15.17:6820/37308,v1:172.21.15.17:6822/37308] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f63f0073530 con 0x7f63f0070a60 2024-03-12T17:33:20.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.732+0000 7f6406a00640 1 -- 172.21.15.17:0/2051150018 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f63fc089a30 con 0x7f641015c9b0 2024-03-12T17:33:20.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.732+0000 7f640f400640 1 --2- 172.21.15.17:0/2051150018 >> [v2:172.21.15.17:6820/37308,v1:172.21.15.17:6822/37308] conn(0x7f63f0070a60 0x7f63f0072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:20.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.732+0000 7f640ea00640 1 --2- 172.21.15.17:0/2051150018 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f63f006ac00 0x7f63f006d0c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6400000f60 tx=0x7f6400007b70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:20.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.733+0000 7f640f400640 1 --2- 172.21.15.17:0/2051150018 >> [v2:172.21.15.17:6820/37308,v1:172.21.15.17:6822/37308] conn(0x7f63f0070a60 0x7f63f0072e80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:20.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.733+0000 7f6406a00640 1 -- 172.21.15.17:0/2051150018 <== osd.3 v2:172.21.15.17:6820/37308 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f63f0073530 con 0x7f63f0070a60 2024-03-12T17:33:20.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.748+0000 7f640fe00640 1 -- 172.21.15.17:0/2051150018 --> [v2:172.21.15.17:6820/37308,v1:172.21.15.17:6822/37308] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f64100d1550 con 0x7f63f0070a60 2024-03-12T17:33:20.743 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.748+0000 7f6406a00640 1 -- 172.21.15.17:0/2051150018 <== osd.3 v2:172.21.15.17:6820/37308 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f640802ce90 con 0x7f63f0070a60 2024-03-12T17:33:20.744 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-12T17:33:20.744 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-12T17:33:20.744 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-12T17:33:20.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.748+0000 7f640fe00640 1 -- 172.21.15.17:0/2051150018 >> [v2:172.21.15.17:6820/37308,v1:172.21.15.17:6822/37308] conn(0x7f63f0070a60 msgr2=0x7f63f0072e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:20.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.748+0000 7f640fe00640 1 --2- 172.21.15.17:0/2051150018 >> [v2:172.21.15.17:6820/37308,v1:172.21.15.17:6822/37308] conn(0x7f63f0070a60 0x7f63f0072e80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:20.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.749+0000 7f640fe00640 1 -- 172.21.15.17:0/2051150018 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f63f006ac00 msgr2=0x7f63f006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:20.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.749+0000 7f640fe00640 1 --2- 172.21.15.17:0/2051150018 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f63f006ac00 0x7f63f006d0c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f6400000f60 tx=0x7f6400007b70 comp rx=0 tx=0).stop 2024-03-12T17:33:20.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.749+0000 7f640fe00640 1 -- 172.21.15.17:0/2051150018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f641015c9b0 msgr2=0x7f64100c6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:20.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.749+0000 7f640fe00640 1 --2- 172.21.15.17:0/2051150018 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f641015c9b0 0x7f64100c6900 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f63fc00e9b0 tx=0x7f63fc00ee70 comp rx=0 tx=0).stop 2024-03-12T17:33:20.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.749+0000 7f640f400640 1 -- 172.21.15.17:0/2051150018 reap_dead start 2024-03-12T17:33:20.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.749+0000 7f640fe00640 1 -- 172.21.15.17:0/2051150018 shutdown_connections 2024-03-12T17:33:20.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.749+0000 7f640fe00640 1 -- 172.21.15.17:0/2051150018 >> 172.21.15.17:0/2051150018 conn(0x7f641006b160 msgr2=0x7f64100b7590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:20.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.749+0000 7f640fe00640 1 -- 172.21.15.17:0/2051150018 shutdown_connections 2024-03-12T17:33:20.745 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.749+0000 7f640fe00640 1 -- 172.21.15.17:0/2051150018 wait complete. 2024-03-12T17:33:20.761 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-03-12T17:33:20.975 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.980+0000 7fbae7e00640 1 Processor -- start 2024-03-12T17:33:20.976 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.980+0000 7fbae7e00640 1 -- start start 2024-03-12T17:33:20.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.982+0000 7fbae7e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbae8145d10 0x7fbae80accb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:20.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.982+0000 7fbae7e00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbae815dc20 con 0x7fbae8070260 2024-03-12T17:33:20.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.982+0000 7fbae7e00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbae815d010 con 0x7fbae80b3a00 2024-03-12T17:33:20.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.982+0000 7fbae7e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae80b3e60 con 0x7fbae8145d10 2024-03-12T17:33:20.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.982+0000 7fbae6000640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fbae8070260 0x7fbae80b32f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37642/0 (socket says 172.21.15.17:37642) 2024-03-12T17:33:20.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.982+0000 7fbae6000640 1 -- 172.21.15.17:0/43576946 learned_addr learned my addr 172.21.15.17:0/43576946 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:33:20.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.982+0000 7fbae6a00640 1 --2- 172.21.15.17:0/43576946 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbae8145d10 0x7fbae80accb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:20.978 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.982+0000 7fbae5600640 1 -- 172.21.15.17:0/43576946 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 879970041 0 0) 0x7fbae815dc20 con 0x7fbae8070260 2024-03-12T17:33:20.979 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.983+0000 7fbae5600640 1 -- 172.21.15.17:0/43576946 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbacc003520 con 0x7fbae8070260 2024-03-12T17:33:20.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.983+0000 7fbae5600640 1 -- 172.21.15.17:0/43576946 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1197691141 0 0) 0x7fbacc003520 con 0x7fbae8070260 2024-03-12T17:33:20.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.983+0000 7fbae5600640 1 -- 172.21.15.17:0/43576946 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbae8145d10 msgr2=0x7fbae80accb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:20.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.983+0000 7fbae5600640 1 --2- 172.21.15.17:0/43576946 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbae8145d10 0x7fbae80accb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:20.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.983+0000 7fbae5600640 1 -- 172.21.15.17:0/43576946 >> v1:172.21.15.94:6789/0 conn(0x7fbae80b3a00 legacy=0x7fbae81605d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:20.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.983+0000 7fbae5600640 1 -- 172.21.15.17:0/43576946 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae815d2f0 con 0x7fbae8070260 2024-03-12T17:33:20.980 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.983+0000 7fbae5600640 1 -- 172.21.15.17:0/43576946 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7fbad4001670 con 0x7fbae8070260 2024-03-12T17:33:20.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.983+0000 7fbae5600640 1 -- 172.21.15.17:0/43576946 >> v1:172.21.15.17:6789/0 conn(0x7fbae8070260 legacy=0x7fbae80b32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:20.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.983+0000 7fbae5600640 1 --2- 172.21.15.17:0/43576946 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbacc0039a0 0x7fbacc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:20.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.983+0000 7fbae5600640 1 --2- 172.21.15.17:0/43576946 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbae8145d10 0x7fbacc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:20.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.983+0000 7fbae5600640 1 --2- 172.21.15.17:0/43576946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbacc004d00 0x7fbacc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:20.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.983+0000 7fbae5600640 1 -- 172.21.15.17:0/43576946 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae80b3e60 con 0x7fbacc004d00 2024-03-12T17:33:20.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.983+0000 7fbae5600640 1 -- 172.21.15.17:0/43576946 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbacc00ba60 con 0x7fbacc0039a0 2024-03-12T17:33:20.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.983+0000 7fbae5600640 1 -- 172.21.15.17:0/43576946 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbacc00bc20 con 0x7fbae8145d10 2024-03-12T17:33:20.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.983+0000 7fbae7400640 1 --2- 172.21.15.17:0/43576946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbacc004d00 0x7fbacc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:20.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.984+0000 7fbae6a00640 1 --2- 172.21.15.17:0/43576946 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbacc0039a0 0x7fbacc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:20.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.984+0000 7fbae6000640 1 --2- 172.21.15.17:0/43576946 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbae8145d10 0x7fbacc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:20.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.984+0000 7fbae7400640 1 -- 172.21.15.17:0/43576946 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbae8145d10 msgr2=0x7fbacc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:20.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.984+0000 7fbae7400640 1 --2- 172.21.15.17:0/43576946 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbae8145d10 0x7fbacc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:20.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.984+0000 7fbae7400640 1 -- 172.21.15.17:0/43576946 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbacc0039a0 msgr2=0x7fbacc003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:20.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.984+0000 7fbae7400640 1 --2- 172.21.15.17:0/43576946 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbacc0039a0 0x7fbacc003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:20.981 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.984+0000 7fbae7400640 1 -- 172.21.15.17:0/43576946 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbacc003520 con 0x7fbacc004d00 2024-03-12T17:33:20.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.985+0000 7fbae7400640 1 --2- 172.21.15.17:0/43576946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbacc004d00 0x7fbacc005180 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fbae0001e20 tx=0x7fbacc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43274ceb05b9c869 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:20.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.985+0000 7fbae5600640 1 -- 172.21.15.17:0/43576946 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae0003b70 con 0x7fbacc004d00 2024-03-12T17:33:20.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.985+0000 7fbae5600640 1 -- 172.21.15.17:0/43576946 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae0003cd0 con 0x7fbacc004d00 2024-03-12T17:33:20.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.985+0000 7fbae5600640 1 -- 172.21.15.17:0/43576946 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae0005310 con 0x7fbacc004d00 2024-03-12T17:33:20.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.986+0000 7fbae7e00640 1 -- 172.21.15.17:0/43576946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbacc004d00 msgr2=0x7fbacc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:20.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.986+0000 7fbae7e00640 1 --2- 172.21.15.17:0/43576946 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbacc004d00 0x7fbacc005180 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fbae0001e20 tx=0x7fbacc0057f0 comp rx=0 tx=0).stop 2024-03-12T17:33:20.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.986+0000 7fbae7400640 1 -- 172.21.15.17:0/43576946 reap_dead start 2024-03-12T17:33:20.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.986+0000 7fbae7e00640 1 -- 172.21.15.17:0/43576946 shutdown_connections 2024-03-12T17:33:20.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.986+0000 7fbae7e00640 1 -- 172.21.15.17:0/43576946 >> 172.21.15.17:0/43576946 conn(0x7fbae8066000 msgr2=0x7fbae8069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:20.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.986+0000 7fbae7e00640 1 -- 172.21.15.17:0/43576946 shutdown_connections 2024-03-12T17:33:20.983 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.986+0000 7fbae7e00640 1 -- 172.21.15.17:0/43576946 wait complete. 2024-03-12T17:33:20.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.988+0000 7fbae7e00640 1 Processor -- start 2024-03-12T17:33:20.984 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.988+0000 7fbae7e00640 1 -- start start 2024-03-12T17:33:20.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.989+0000 7fbae7e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbacc004d00 0x7fbae80c4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:20.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.989+0000 7fbae7e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbae8143f90 0x7fbae8140d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:20.986 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.989+0000 7fbae7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbae81f28f0 0x7fbae81f2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:20.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.989+0000 7fbae7e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae81412b0 con 0x7fbae81f28f0 2024-03-12T17:33:20.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.989+0000 7fbae7e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbae80c4830 con 0x7fbacc004d00 2024-03-12T17:33:20.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.989+0000 7fbae7e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbae80c4b10 con 0x7fbae8143f90 2024-03-12T17:33:20.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.989+0000 7fbae7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbae81f28f0 0x7fbae81f2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:20.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.989+0000 7fbae7400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbae81f28f0 0x7fbae81f2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35982/0 (socket says 172.21.15.17:35982) 2024-03-12T17:33:20.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.989+0000 7fbae7400640 1 -- 172.21.15.17:0/1169474407 learned_addr learned my addr 172.21.15.17:0/1169474407 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:20.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.990+0000 7fbae6000640 1 --2- 172.21.15.17:0/1169474407 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbae8143f90 0x7fbae8140d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:20.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.990+0000 7fbae6a00640 1 --2- 172.21.15.17:0/1169474407 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbacc004d00 0x7fbae80c4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:20.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.990+0000 7fbae7400640 1 -- 172.21.15.17:0/1169474407 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbae8143f90 msgr2=0x7fbae8140d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:20.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.990+0000 7fbae7400640 1 --2- 172.21.15.17:0/1169474407 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbae8143f90 0x7fbae8140d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:20.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.990+0000 7fbae7400640 1 -- 172.21.15.17:0/1169474407 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbacc004d00 msgr2=0x7fbae80c4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:20.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.990+0000 7fbae7400640 1 --2- 172.21.15.17:0/1169474407 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbacc004d00 0x7fbae80c4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:20.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.990+0000 7fbae7400640 1 -- 172.21.15.17:0/1169474407 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbae80c4df0 con 0x7fbae81f28f0 2024-03-12T17:33:20.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.990+0000 7fbae6a00640 1 --2- 172.21.15.17:0/1169474407 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbacc004d00 0x7fbae80c4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:33:20.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.990+0000 7fbae7400640 1 --2- 172.21.15.17:0/1169474407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbae81f28f0 0x7fbae81f2d70 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fbae0001f40 tx=0x7fbae00014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:20.987 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.990+0000 7fbadf400640 1 -- 172.21.15.17:0/1169474407 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae003e070 con 0x7fbae81f28f0 2024-03-12T17:33:20.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.991+0000 7fbadf400640 1 -- 172.21.15.17:0/1169474407 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbae0003e40 con 0x7fbae81f28f0 2024-03-12T17:33:20.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.991+0000 7fbae7e00640 1 -- 172.21.15.17:0/1169474407 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbae80c50d0 con 0x7fbae81f28f0 2024-03-12T17:33:20.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.991+0000 7fbadf400640 1 -- 172.21.15.17:0/1169474407 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbae0006d90 con 0x7fbae81f28f0 2024-03-12T17:33:20.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.991+0000 7fbae7e00640 1 -- 172.21.15.17:0/1169474407 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbae8141690 con 0x7fbae81f28f0 2024-03-12T17:33:20.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.992+0000 7fbae7e00640 1 -- 172.21.15.17:0/1169474407 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbae80c55f0 con 0x7fbae81f28f0 2024-03-12T17:33:20.988 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.993+0000 7fbadf400640 1 -- 172.21.15.17:0/1169474407 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fbae0007030 con 0x7fbae81f28f0 2024-03-12T17:33:20.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.993+0000 7fbadf400640 1 --2- 172.21.15.17:0/1169474407 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fbac806ac00 0x7fbac806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:20.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.994+0000 7fbadf400640 1 -- 172.21.15.17:0/1169474407 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbae00aa3f0 con 0x7fbae81f28f0 2024-03-12T17:33:20.989 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.994+0000 7fbae6a00640 1 --2- 172.21.15.17:0/1169474407 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fbac806ac00 0x7fbac806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:20.990 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.995+0000 7fbae6a00640 1 --2- 172.21.15.17:0/1169474407 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fbac806ac00 0x7fbac806d0c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbad8009a00 tx=0x7fbad8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:20.994 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:20.998+0000 7fbadf400640 1 -- 172.21.15.17:0/1169474407 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fbae80c55f0 con 0x7fbae81f28f0 2024-03-12T17:33:21.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.198+0000 7fbae7e00640 1 -- 172.21.15.17:0/1169474407 --> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fbae815d8b0 con 0x7fbac806ac00 2024-03-12T17:33:21.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.199+0000 7fbadf400640 1 -- 172.21.15.17:0/1169474407 <== mgr.4104 v2:172.21.15.17:6832/37052 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbad8012950 con 0x7fbac806ac00 2024-03-12T17:33:21.195 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 3 to deep-scrub 2024-03-12T17:33:21.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.202+0000 7fbae7e00640 1 -- 172.21.15.17:0/1169474407 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fbac806ac00 msgr2=0x7fbac806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:21.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.202+0000 7fbae7e00640 1 --2- 172.21.15.17:0/1169474407 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fbac806ac00 0x7fbac806d0c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbad8009a00 tx=0x7fbad8008040 comp rx=0 tx=0).stop 2024-03-12T17:33:21.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.202+0000 7fbae7e00640 1 -- 172.21.15.17:0/1169474407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbae81f28f0 msgr2=0x7fbae81f2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:21.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.202+0000 7fbae7e00640 1 --2- 172.21.15.17:0/1169474407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbae81f28f0 0x7fbae81f2d70 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fbae0001f40 tx=0x7fbae00014a0 comp rx=0 tx=0).stop 2024-03-12T17:33:21.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.202+0000 7fbae7e00640 1 -- 172.21.15.17:0/1169474407 shutdown_connections 2024-03-12T17:33:21.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.202+0000 7fbae7e00640 1 --2- 172.21.15.17:0/1169474407 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fbac806ac00 0x7fbac806d0c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:21.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.202+0000 7fbae7e00640 1 --2- 172.21.15.17:0/1169474407 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fbae81f28f0 0x7fbae81f2d70 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:21.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.202+0000 7fbae7e00640 1 --2- 172.21.15.17:0/1169474407 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fbae8143f90 0x7fbae8140d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:21.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.202+0000 7fbae7e00640 1 --2- 172.21.15.17:0/1169474407 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fbacc004d00 0x7fbae80c4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:21.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.202+0000 7fbae7e00640 1 -- 172.21.15.17:0/1169474407 >> 172.21.15.17:0/1169474407 conn(0x7fbae8066000 msgr2=0x7fbae815f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:21.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.202+0000 7fbae7e00640 1 -- 172.21.15.17:0/1169474407 shutdown_connections 2024-03-12T17:33:21.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.202+0000 7fbae7e00640 1 -- 172.21.15.17:0/1169474407 wait complete. 2024-03-12T17:33:21.218 INFO:tasks.ceph:Scrubbing osd.4 2024-03-12T17:33:21.218 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-03-12T17:33:21.442 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.447+0000 7fce51e00640 1 Processor -- start 2024-03-12T17:33:21.443 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.447+0000 7fce51e00640 1 -- start start 2024-03-12T17:33:21.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.449+0000 7fce51e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fce4c06a800 0x7fce4c15beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:21.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.449+0000 7fce51e00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce4c15bc60 con 0x7fce4c15a8a0 2024-03-12T17:33:21.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.449+0000 7fce51e00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce4c0cbce0 con 0x7fce4c15b820 2024-03-12T17:33:21.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.449+0000 7fce51e00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce4c0cbfc0 con 0x7fce4c06a800 2024-03-12T17:33:21.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.449+0000 7fce50a00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fce4c15a8a0 0x7fce4c0cb220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37646/0 (socket says 172.21.15.17:37646) 2024-03-12T17:33:21.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.449+0000 7fce50a00640 1 -- 172.21.15.17:0/3559502670 learned_addr learned my addr 172.21.15.17:0/3559502670 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:33:21.445 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.449+0000 7fce51400640 1 --2- 172.21.15.17:0/3559502670 >> v2:172.21.15.94:3300/0 conn(0x7fce4c06a800 0x7fce4c15beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:21.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.450+0000 7fce4b400640 1 -- 172.21.15.17:0/3559502670 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 513610081 0 0) 0x7fce4c15bc60 con 0x7fce4c15a8a0 2024-03-12T17:33:21.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.450+0000 7fce4b400640 1 -- 172.21.15.17:0/3559502670 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce34003520 con 0x7fce4c15a8a0 2024-03-12T17:33:21.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.450+0000 7fce4b400640 1 -- 172.21.15.17:0/3559502670 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1563821865 0 0) 0x7fce34003520 con 0x7fce4c15a8a0 2024-03-12T17:33:21.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.450+0000 7fce4b400640 1 -- 172.21.15.17:0/3559502670 >> v2:172.21.15.94:3300/0 conn(0x7fce4c06a800 msgr2=0x7fce4c15beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:21.447 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.450+0000 7fce4b400640 1 --2- 172.21.15.17:0/3559502670 >> v2:172.21.15.94:3300/0 conn(0x7fce4c06a800 0x7fce4c15beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:21.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.450+0000 7fce4b400640 1 -- 172.21.15.17:0/3559502670 >> v1:172.21.15.94:6789/0 conn(0x7fce4c15b820 legacy=0x7fce4c06a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:21.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.450+0000 7fce4b400640 1 -- 172.21.15.17:0/3559502670 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce4c15b020 con 0x7fce4c15a8a0 2024-03-12T17:33:21.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.450+0000 7fce4b400640 1 -- 172.21.15.17:0/3559502670 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7fce40001670 con 0x7fce4c15a8a0 2024-03-12T17:33:21.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.450+0000 7fce4b400640 1 -- 172.21.15.17:0/3559502670 >> v1:172.21.15.17:6789/0 conn(0x7fce4c15a8a0 legacy=0x7fce4c0cb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:21.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.450+0000 7fce4b400640 1 --2- 172.21.15.17:0/3559502670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce34003970 0x7fce34003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:21.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.450+0000 7fce4b400640 1 --2- 172.21.15.17:0/3559502670 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce340047c0 0x7fce34004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:21.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.450+0000 7fce4b400640 1 --2- 172.21.15.17:0/3559502670 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fce34005180 0x7fce3400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:21.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.450+0000 7fce4b400640 1 -- 172.21.15.17:0/3559502670 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c0cbfc0 con 0x7fce34003970 2024-03-12T17:33:21.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.450+0000 7fce4b400640 1 -- 172.21.15.17:0/3559502670 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3400c020 con 0x7fce340047c0 2024-03-12T17:33:21.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.450+0000 7fce4b400640 1 -- 172.21.15.17:0/3559502670 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce3400c1e0 con 0x7fce34005180 2024-03-12T17:33:21.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.451+0000 7fce50a00640 1 --2- 172.21.15.17:0/3559502670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce34003970 0x7fce34003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:21.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.451+0000 7fce4be00640 1 --2- 172.21.15.17:0/3559502670 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce340047c0 0x7fce34004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:21.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.451+0000 7fce51400640 1 --2- 172.21.15.17:0/3559502670 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fce34005180 0x7fce3400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:21.448 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.451+0000 7fce50a00640 1 -- 172.21.15.17:0/3559502670 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fce34005180 msgr2=0x7fce3400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:21.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.451+0000 7fce50a00640 1 --2- 172.21.15.17:0/3559502670 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fce34005180 0x7fce3400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:21.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.451+0000 7fce50a00640 1 -- 172.21.15.17:0/3559502670 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce340047c0 msgr2=0x7fce34004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:21.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.451+0000 7fce50a00640 1 --2- 172.21.15.17:0/3559502670 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce340047c0 0x7fce34004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:21.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.451+0000 7fce50a00640 1 -- 172.21.15.17:0/3559502670 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce34003520 con 0x7fce34003970 2024-03-12T17:33:21.449 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.451+0000 7fce51400640 1 -- 172.21.15.17:0/3559502670 reap_dead start 2024-03-12T17:33:21.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.452+0000 7fce50a00640 1 --2- 172.21.15.17:0/3559502670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce34003970 0x7fce34003d90 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fce4000c240 tx=0x7fce340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c015ad3b9decdb38 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:21.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.453+0000 7fce4b400640 1 -- 172.21.15.17:0/3559502670 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce40005ad0 con 0x7fce34003970 2024-03-12T17:33:21.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.453+0000 7fce4b400640 1 -- 172.21.15.17:0/3559502670 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce40005c30 con 0x7fce34003970 2024-03-12T17:33:21.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.453+0000 7fce4b400640 1 -- 172.21.15.17:0/3559502670 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4002ca90 con 0x7fce34003970 2024-03-12T17:33:21.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.453+0000 7fce51e00640 1 -- 172.21.15.17:0/3559502670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce34003970 msgr2=0x7fce34003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:21.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.453+0000 7fce51e00640 1 --2- 172.21.15.17:0/3559502670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce34003970 0x7fce34003d90 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fce4000c240 tx=0x7fce340057f0 comp rx=0 tx=0).stop 2024-03-12T17:33:21.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.453+0000 7fce51e00640 1 -- 172.21.15.17:0/3559502670 shutdown_connections 2024-03-12T17:33:21.450 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.453+0000 7fce51e00640 1 --2- 172.21.15.17:0/3559502670 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce34003970 0x7fce34003d90 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:21.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.453+0000 7fce51e00640 1 -- 172.21.15.17:0/3559502670 >> 172.21.15.17:0/3559502670 conn(0x7fce4c069ce0 msgr2=0x7fce4c0b3970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:21.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.453+0000 7fce51e00640 1 -- 172.21.15.17:0/3559502670 shutdown_connections 2024-03-12T17:33:21.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.454+0000 7fce51e00640 1 -- 172.21.15.17:0/3559502670 wait complete. 2024-03-12T17:33:21.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.455+0000 7fce51e00640 1 Processor -- start 2024-03-12T17:33:21.451 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.455+0000 7fce51e00640 1 -- start start 2024-03-12T17:33:21.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.456+0000 7fce51e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce34003970 0x7fce4c156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:21.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.456+0000 7fce51e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce4c1521b0 0x7fce4c0b1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:21.452 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.456+0000 7fce51e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fce4c0b1b70 0x7fce4c1f25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:21.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.456+0000 7fce51e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c156fa0 con 0x7fce4c1521b0 2024-03-12T17:33:21.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.456+0000 7fce51e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c1f5b70 con 0x7fce34003970 2024-03-12T17:33:21.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.456+0000 7fce51e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce4c1f5e50 con 0x7fce4c0b1b70 2024-03-12T17:33:21.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.457+0000 7fce4be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce4c1521b0 0x7fce4c0b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:21.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.457+0000 7fce4be00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce4c1521b0 0x7fce4c0b1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36002/0 (socket says 172.21.15.17:36002) 2024-03-12T17:33:21.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.457+0000 7fce4be00640 1 -- 172.21.15.17:0/3286066129 learned_addr learned my addr 172.21.15.17:0/3286066129 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:21.453 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.457+0000 7fce50a00640 1 --2- 172.21.15.17:0/3286066129 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce34003970 0x7fce4c156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:21.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.457+0000 7fce51400640 1 --2- 172.21.15.17:0/3286066129 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fce4c0b1b70 0x7fce4c1f25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:21.454 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.457+0000 7fce4be00640 1 -- 172.21.15.17:0/3286066129 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fce4c0b1b70 msgr2=0x7fce4c1f25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:21.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.457+0000 7fce4be00640 1 --2- 172.21.15.17:0/3286066129 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fce4c0b1b70 0x7fce4c1f25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:21.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.457+0000 7fce4be00640 1 -- 172.21.15.17:0/3286066129 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce34003970 msgr2=0x7fce4c156a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:21.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.457+0000 7fce4be00640 1 --2- 172.21.15.17:0/3286066129 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fce34003970 0x7fce4c156a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:21.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.457+0000 7fce4be00640 1 -- 172.21.15.17:0/3286066129 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce4c1f6130 con 0x7fce4c1521b0 2024-03-12T17:33:21.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.458+0000 7fce4be00640 1 --2- 172.21.15.17:0/3286066129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce4c1521b0 0x7fce4c0b1630 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fce38007fd0 tx=0x7fce3800e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:21.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.458+0000 7fce48c00640 1 -- 172.21.15.17:0/3286066129 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce380052e0 con 0x7fce4c1521b0 2024-03-12T17:33:21.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.458+0000 7fce48c00640 1 -- 172.21.15.17:0/3286066129 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce38005440 con 0x7fce4c1521b0 2024-03-12T17:33:21.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.458+0000 7fce48c00640 1 -- 172.21.15.17:0/3286066129 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce38003810 con 0x7fce4c1521b0 2024-03-12T17:33:21.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.458+0000 7fce51e00640 1 -- 172.21.15.17:0/3286066129 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce4c1f6410 con 0x7fce4c1521b0 2024-03-12T17:33:21.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.458+0000 7fce51e00640 1 -- 172.21.15.17:0/3286066129 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce4c0b39d0 con 0x7fce4c1521b0 2024-03-12T17:33:21.455 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.459+0000 7fce51e00640 1 -- 172.21.15.17:0/3286066129 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fce4c0b11b0 con 0x7fce4c1521b0 2024-03-12T17:33:21.456 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.460+0000 7fce48c00640 1 -- 172.21.15.17:0/3286066129 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fce38003970 con 0x7fce4c1521b0 2024-03-12T17:33:21.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.461+0000 7fce48c00640 1 --2- 172.21.15.17:0/3286066129 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fce2c06ac30 0x7fce2c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:21.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.461+0000 7fce48c00640 1 -- 172.21.15.17:0/3286066129 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fce380888d0 con 0x7fce4c1521b0 2024-03-12T17:33:21.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.461+0000 7fce48c00640 1 --2- 172.21.15.17:0/3286066129 >> [v2:172.21.15.94:6808/37465,v1:172.21.15.94:6809/37465] conn(0x7fce2c070a90 0x7fce2c072eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:21.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.462+0000 7fce48c00640 1 -- 172.21.15.17:0/3286066129 --> [v2:172.21.15.94:6808/37465,v1:172.21.15.94:6809/37465] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fce2c073560 con 0x7fce2c070a90 2024-03-12T17:33:21.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.462+0000 7fce48c00640 1 -- 172.21.15.17:0/3286066129 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce3808d2a0 con 0x7fce4c1521b0 2024-03-12T17:33:21.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.462+0000 7fce50a00640 1 --2- 172.21.15.17:0/3286066129 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fce2c06ac30 0x7fce2c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:21.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.462+0000 7fce51400640 1 --2- 172.21.15.17:0/3286066129 >> [v2:172.21.15.94:6808/37465,v1:172.21.15.94:6809/37465] conn(0x7fce2c070a90 0x7fce2c072eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:21.458 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.462+0000 7fce50a00640 1 --2- 172.21.15.17:0/3286066129 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fce2c06ac30 0x7fce2c06d0f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fce40034000 tx=0x7fce40009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:21.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.463+0000 7fce51400640 1 --2- 172.21.15.17:0/3286066129 >> [v2:172.21.15.94:6808/37465,v1:172.21.15.94:6809/37465] conn(0x7fce2c070a90 0x7fce2c072eb0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:21.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.465+0000 7fce48c00640 1 -- 172.21.15.17:0/3286066129 <== osd.4 v2:172.21.15.94:6808/37465 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fce2c073560 con 0x7fce2c070a90 2024-03-12T17:33:21.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.480+0000 7fce51e00640 1 -- 172.21.15.17:0/3286066129 --> [v2:172.21.15.94:6808/37465,v1:172.21.15.94:6809/37465] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fce4c0b3b60 con 0x7fce2c070a90 2024-03-12T17:33:21.477 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.481+0000 7fce48c00640 1 -- 172.21.15.17:0/3286066129 <== osd.4 v2:172.21.15.94:6808/37465 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fce4c0b3b60 con 0x7fce2c070a90 2024-03-12T17:33:21.477 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-12T17:33:21.478 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-12T17:33:21.478 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-12T17:33:21.478 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.482+0000 7fce51e00640 1 -- 172.21.15.17:0/3286066129 >> [v2:172.21.15.94:6808/37465,v1:172.21.15.94:6809/37465] conn(0x7fce2c070a90 msgr2=0x7fce2c072eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:21.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.482+0000 7fce51e00640 1 --2- 172.21.15.17:0/3286066129 >> [v2:172.21.15.94:6808/37465,v1:172.21.15.94:6809/37465] conn(0x7fce2c070a90 0x7fce2c072eb0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:21.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.482+0000 7fce51e00640 1 -- 172.21.15.17:0/3286066129 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fce2c06ac30 msgr2=0x7fce2c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:21.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.482+0000 7fce51e00640 1 --2- 172.21.15.17:0/3286066129 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fce2c06ac30 0x7fce2c06d0f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fce40034000 tx=0x7fce40009030 comp rx=0 tx=0).stop 2024-03-12T17:33:21.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.482+0000 7fce51e00640 1 -- 172.21.15.17:0/3286066129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce4c1521b0 msgr2=0x7fce4c0b1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:21.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.482+0000 7fce51e00640 1 --2- 172.21.15.17:0/3286066129 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fce4c1521b0 0x7fce4c0b1630 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fce38007fd0 tx=0x7fce3800e8a0 comp rx=0 tx=0).stop 2024-03-12T17:33:21.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.482+0000 7fce51400640 1 -- 172.21.15.17:0/3286066129 reap_dead start 2024-03-12T17:33:21.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.482+0000 7fce51e00640 1 -- 172.21.15.17:0/3286066129 shutdown_connections 2024-03-12T17:33:21.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.482+0000 7fce51e00640 1 -- 172.21.15.17:0/3286066129 >> 172.21.15.17:0/3286066129 conn(0x7fce4c069ce0 msgr2=0x7fce4c0af9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:21.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.482+0000 7fce51e00640 1 -- 172.21.15.17:0/3286066129 shutdown_connections 2024-03-12T17:33:21.479 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.482+0000 7fce51e00640 1 -- 172.21.15.17:0/3286066129 wait complete. 2024-03-12T17:33:21.499 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-03-12T17:33:21.727 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.732+0000 7fe575400640 1 Processor -- start 2024-03-12T17:33:21.728 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.732+0000 7fe575400640 1 -- start start 2024-03-12T17:33:21.729 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.734+0000 7fe575400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe5700cbee0 0x7fe570164550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:21.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.734+0000 7fe575400640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe57015ab90 con 0x7fe57006db80 2024-03-12T17:33:21.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.734+0000 7fe575400640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe57015d260 con 0x7fe5700b2ca0 2024-03-12T17:33:21.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.734+0000 7fe575400640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe57015dee0 con 0x7fe5700cbee0 2024-03-12T17:33:21.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.734+0000 7fe56f400640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fe57006db80 0x7fe5700cb7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:37654/0 (socket says 172.21.15.17:37654) 2024-03-12T17:33:21.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.734+0000 7fe56f400640 1 -- 172.21.15.17:0/3104947593 learned_addr learned my addr 172.21.15.17:0/3104947593 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:33:21.730 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.734+0000 7fe574a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fe5700cbee0 0x7fe570164550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:21.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.735+0000 7fe574a00640 1 -- 172.21.15.17:0/3104947593 >> v1:172.21.15.94:6789/0 conn(0x7fe5700b2ca0 legacy=0x7fe57006d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:21.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.735+0000 7fe574a00640 1 -- 172.21.15.17:0/3104947593 >> v1:172.21.15.17:6789/0 conn(0x7fe57006db80 legacy=0x7fe5700cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:21.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.735+0000 7fe574a00640 1 -- 172.21.15.17:0/3104947593 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe57015d540 con 0x7fe5700cbee0 2024-03-12T17:33:21.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.735+0000 7fe56ea00640 1 -- 172.21.15.17:0/3104947593 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4206707265 0 0) 0x7fe57015ab90 con 0x7fe57006db80 2024-03-12T17:33:21.731 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.736+0000 7fe574a00640 1 --2- 172.21.15.17:0/3104947593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5700cbee0 0x7fe570164550 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe5680097a0 tx=0x7fe56802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6da69de974f9dab7 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:21.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.736+0000 7fe56ea00640 1 -- 172.21.15.17:0/3104947593 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe568031830 con 0x7fe5700cbee0 2024-03-12T17:33:21.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.736+0000 7fe56ea00640 1 -- 172.21.15.17:0/3104947593 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe568031990 con 0x7fe5700cbee0 2024-03-12T17:33:21.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.736+0000 7fe56ea00640 1 -- 172.21.15.17:0/3104947593 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe568031d20 con 0x7fe5700cbee0 2024-03-12T17:33:21.732 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.737+0000 7fe575400640 1 -- 172.21.15.17:0/3104947593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5700cbee0 msgr2=0x7fe570164550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:21.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.737+0000 7fe575400640 1 --2- 172.21.15.17:0/3104947593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5700cbee0 0x7fe570164550 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fe5680097a0 tx=0x7fe56802b8d0 comp rx=0 tx=0).stop 2024-03-12T17:33:21.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.737+0000 7fe575400640 1 -- 172.21.15.17:0/3104947593 shutdown_connections 2024-03-12T17:33:21.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.737+0000 7fe575400640 1 --2- 172.21.15.17:0/3104947593 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5700cbee0 0x7fe570164550 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:21.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.737+0000 7fe575400640 1 -- 172.21.15.17:0/3104947593 >> 172.21.15.17:0/3104947593 conn(0x7fe570066000 msgr2=0x7fe570069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:21.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.737+0000 7fe575400640 1 -- 172.21.15.17:0/3104947593 shutdown_connections 2024-03-12T17:33:21.733 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.737+0000 7fe575400640 1 -- 172.21.15.17:0/3104947593 wait complete. 2024-03-12T17:33:21.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.738+0000 7fe575400640 1 Processor -- start 2024-03-12T17:33:21.734 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.739+0000 7fe575400640 1 -- start start 2024-03-12T17:33:21.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.740+0000 7fe575400640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe57006db80 0x7fe57014a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:21.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.740+0000 7fe575400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5700b2ca0 0x7fe570159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:21.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.740+0000 7fe575400640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5700cbee0 0x7fe57014b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:21.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.740+0000 7fe575400640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57014a150 con 0x7fe5700b2ca0 2024-03-12T17:33:21.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.740+0000 7fe575400640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe57014c170 con 0x7fe5700cbee0 2024-03-12T17:33:21.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.740+0000 7fe575400640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe570149b60 con 0x7fe57006db80 2024-03-12T17:33:21.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.740+0000 7fe56f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5700b2ca0 0x7fe570159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:21.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.740+0000 7fe56f400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5700b2ca0 0x7fe570159d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:36022/0 (socket says 172.21.15.17:36022) 2024-03-12T17:33:21.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.740+0000 7fe56f400640 1 -- 172.21.15.17:0/157578190 learned_addr learned my addr 172.21.15.17:0/157578190 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:21.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.740+0000 7fe56f400640 1 -- 172.21.15.17:0/157578190 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe57006db80 msgr2=0x7fe57014a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:21.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.740+0000 7fe56f400640 1 --2- 172.21.15.17:0/157578190 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe57006db80 0x7fe57014a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:21.736 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.740+0000 7fe56f400640 1 -- 172.21.15.17:0/157578190 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5700cbee0 msgr2=0x7fe57014b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:21.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.740+0000 7fe56f400640 1 --2- 172.21.15.17:0/157578190 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5700cbee0 0x7fe57014b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:21.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.740+0000 7fe56f400640 1 -- 172.21.15.17:0/157578190 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe568009400 con 0x7fe5700b2ca0 2024-03-12T17:33:21.737 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.741+0000 7fe56f400640 1 --2- 172.21.15.17:0/157578190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5700b2ca0 0x7fe570159d40 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fe55800c890 tx=0x7fe55800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:21.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.741+0000 7fe567e00640 1 -- 172.21.15.17:0/157578190 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55800a640 con 0x7fe5700b2ca0 2024-03-12T17:33:21.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.741+0000 7fe567e00640 1 -- 172.21.15.17:0/157578190 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55800a7c0 con 0x7fe5700b2ca0 2024-03-12T17:33:21.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.741+0000 7fe567e00640 1 -- 172.21.15.17:0/157578190 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55800ab70 con 0x7fe5700b2ca0 2024-03-12T17:33:21.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.741+0000 7fe575400640 1 -- 172.21.15.17:0/157578190 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe57014bbb0 con 0x7fe5700b2ca0 2024-03-12T17:33:21.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.741+0000 7fe575400640 1 -- 172.21.15.17:0/157578190 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe570149d70 con 0x7fe5700b2ca0 2024-03-12T17:33:21.738 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.742+0000 7fe575400640 1 -- 172.21.15.17:0/157578190 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe57004e030 con 0x7fe5700b2ca0 2024-03-12T17:33:21.739 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.743+0000 7fe567e00640 1 -- 172.21.15.17:0/157578190 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fe55800acd0 con 0x7fe5700b2ca0 2024-03-12T17:33:21.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.744+0000 7fe567e00640 1 --2- 172.21.15.17:0/157578190 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe54c06ac00 0x7fe54c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:21.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.744+0000 7fe567e00640 1 -- 172.21.15.17:0/157578190 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe558088630 con 0x7fe5700b2ca0 2024-03-12T17:33:21.740 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.745+0000 7fe56fe00640 1 --2- 172.21.15.17:0/157578190 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe54c06ac00 0x7fe54c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:21.741 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.745+0000 7fe56fe00640 1 --2- 172.21.15.17:0/157578190 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe54c06ac00 0x7fe54c06d0c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe5700b0f20 tx=0x7fe5600079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:21.744 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.749+0000 7fe567e00640 1 -- 172.21.15.17:0/157578190 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7fe558053a70 con 0x7fe5700b2ca0 2024-03-12T17:33:21.942 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.947+0000 7fe575400640 1 -- 172.21.15.17:0/157578190 --> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fe5700b3080 con 0x7fe54c06ac00 2024-03-12T17:33:21.943 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.947+0000 7fe567e00640 1 -- 172.21.15.17:0/157578190 <== mgr.4104 v2:172.21.15.17:6832/37052 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe560005030 con 0x7fe54c06ac00 2024-03-12T17:33:21.943 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 4 to deep-scrub 2024-03-12T17:33:21.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.950+0000 7fe575400640 1 -- 172.21.15.17:0/157578190 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe54c06ac00 msgr2=0x7fe54c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:21.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.950+0000 7fe575400640 1 --2- 172.21.15.17:0/157578190 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe54c06ac00 0x7fe54c06d0c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe5700b0f20 tx=0x7fe5600079b0 comp rx=0 tx=0).stop 2024-03-12T17:33:21.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.950+0000 7fe575400640 1 -- 172.21.15.17:0/157578190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5700b2ca0 msgr2=0x7fe570159d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:21.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.950+0000 7fe575400640 1 --2- 172.21.15.17:0/157578190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5700b2ca0 0x7fe570159d40 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fe55800c890 tx=0x7fe55800cd50 comp rx=0 tx=0).stop 2024-03-12T17:33:21.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.950+0000 7fe575400640 1 -- 172.21.15.17:0/157578190 shutdown_connections 2024-03-12T17:33:21.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.950+0000 7fe575400640 1 --2- 172.21.15.17:0/157578190 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fe54c06ac00 0x7fe54c06d0c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:21.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.950+0000 7fe575400640 1 --2- 172.21.15.17:0/157578190 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fe5700cbee0 0x7fe57014b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:21.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.950+0000 7fe575400640 1 --2- 172.21.15.17:0/157578190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fe5700b2ca0 0x7fe570159d40 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:21.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.950+0000 7fe575400640 1 --2- 172.21.15.17:0/157578190 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fe57006db80 0x7fe57014a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:21.946 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.950+0000 7fe575400640 1 -- 172.21.15.17:0/157578190 >> 172.21.15.17:0/157578190 conn(0x7fe570066000 msgr2=0x7fe570069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:21.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.950+0000 7fe575400640 1 -- 172.21.15.17:0/157578190 shutdown_connections 2024-03-12T17:33:21.947 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:21.950+0000 7fe575400640 1 -- 172.21.15.17:0/157578190 wait complete. 2024-03-12T17:33:21.966 INFO:tasks.ceph:Scrubbing osd.5 2024-03-12T17:33:21.966 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-03-12T17:33:22.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.195+0000 7fc605c00640 1 Processor -- start 2024-03-12T17:33:22.191 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.196+0000 7fc605c00640 1 -- start start 2024-03-12T17:33:22.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.197+0000 7fc605c00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fc6000cb720 0x7fc60006d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:22.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.197+0000 7fc605c00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc60015e380 con 0x7fc600154130 2024-03-12T17:33:22.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.197+0000 7fc605c00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6000b2ae0 con 0x7fc600153d50 2024-03-12T17:33:22.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.197+0000 7fc605c00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc60015df60 con 0x7fc6000cb720 2024-03-12T17:33:22.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.197+0000 7fc5f7e00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7fc600154130 0x7fc6000cb010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34522/0 (socket says 172.21.15.17:34522) 2024-03-12T17:33:22.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.197+0000 7fc5f7e00640 1 -- 172.21.15.17:0/1819533987 learned_addr learned my addr 172.21.15.17:0/1819533987 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:33:22.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.197+0000 7fc5ff400640 1 --2- 172.21.15.17:0/1819533987 >> v2:172.21.15.17:3300/0 conn(0x7fc6000cb720 0x7fc60006d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:22.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.198+0000 7fc5fe000640 1 -- 172.21.15.17:0/1819533987 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1299145341 0 0) 0x7fc60015e380 con 0x7fc600154130 2024-03-12T17:33:22.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.198+0000 7fc5fe000640 1 -- 172.21.15.17:0/1819533987 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5e4005730 con 0x7fc600154130 2024-03-12T17:33:22.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.198+0000 7fc5ff400640 1 -- 172.21.15.17:0/1819533987 >> v1:172.21.15.94:6789/0 conn(0x7fc600153d50 legacy=0x7fc6000b2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:22.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.198+0000 7fc5ff400640 1 -- 172.21.15.17:0/1819533987 >> v1:172.21.15.17:6789/0 conn(0x7fc600154130 legacy=0x7fc6000cb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:22.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.198+0000 7fc5ff400640 1 -- 172.21.15.17:0/1819533987 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc60015d5c0 con 0x7fc6000cb720 2024-03-12T17:33:22.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.199+0000 7fc5ff400640 1 --2- 172.21.15.17:0/1819533987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6000cb720 0x7fc60006d9e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8009d90 tx=0x7fc5f802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=355838fc90aa6881 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:22.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.199+0000 7fc5fe000640 1 -- 172.21.15.17:0/1819533987 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f802cd00 con 0x7fc6000cb720 2024-03-12T17:33:22.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.199+0000 7fc5fe000640 1 -- 172.21.15.17:0/1819533987 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f802ce60 con 0x7fc6000cb720 2024-03-12T17:33:22.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.199+0000 7fc5fe000640 1 -- 172.21.15.17:0/1819533987 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f8034660 con 0x7fc6000cb720 2024-03-12T17:33:22.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.200+0000 7fc605c00640 1 -- 172.21.15.17:0/1819533987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6000cb720 msgr2=0x7fc60006d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:22.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.200+0000 7fc605c00640 1 --2- 172.21.15.17:0/1819533987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6000cb720 0x7fc60006d9e0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc5f8009d90 tx=0x7fc5f802bf50 comp rx=0 tx=0).stop 2024-03-12T17:33:22.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.200+0000 7fc605c00640 1 -- 172.21.15.17:0/1819533987 shutdown_connections 2024-03-12T17:33:22.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.200+0000 7fc605c00640 1 --2- 172.21.15.17:0/1819533987 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc6000cb720 0x7fc60006d9e0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:22.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.200+0000 7fc605c00640 1 -- 172.21.15.17:0/1819533987 >> 172.21.15.17:0/1819533987 conn(0x7fc600069ce0 msgr2=0x7fc60006a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:22.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.200+0000 7fc605c00640 1 -- 172.21.15.17:0/1819533987 shutdown_connections 2024-03-12T17:33:22.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.200+0000 7fc605c00640 1 -- 172.21.15.17:0/1819533987 wait complete. 2024-03-12T17:33:22.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.202+0000 7fc605c00640 1 Processor -- start 2024-03-12T17:33:22.198 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.202+0000 7fc605c00640 1 -- start start 2024-03-12T17:33:22.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.203+0000 7fc605c00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc6000cb720 0x7fc600154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:22.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.203+0000 7fc605c00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc600153d50 0x7fc60015ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:22.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.203+0000 7fc605c00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc600154130 0x7fc60015bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:22.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.203+0000 7fc605c00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6001560f0 con 0x7fc600153d50 2024-03-12T17:33:22.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.203+0000 7fc605c00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc600156390 con 0x7fc600154130 2024-03-12T17:33:22.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.203+0000 7fc605c00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc600156670 con 0x7fc6000cb720 2024-03-12T17:33:22.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.203+0000 7fc5f7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc600153d50 0x7fc60015ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:22.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.203+0000 7fc5f7e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc600153d50 0x7fc60015ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35528/0 (socket says 172.21.15.17:35528) 2024-03-12T17:33:22.199 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.203+0000 7fc5f7e00640 1 -- 172.21.15.17:0/483468228 learned_addr learned my addr 172.21.15.17:0/483468228 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:22.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.204+0000 7fc5fea00640 1 --2- 172.21.15.17:0/483468228 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc6000cb720 0x7fc600154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:22.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.204+0000 7fc5ff400640 1 --2- 172.21.15.17:0/483468228 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc600154130 0x7fc60015bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:22.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.204+0000 7fc5f7e00640 1 -- 172.21.15.17:0/483468228 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc6000cb720 msgr2=0x7fc600154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:22.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.204+0000 7fc5f7e00640 1 --2- 172.21.15.17:0/483468228 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc6000cb720 0x7fc600154610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:22.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.204+0000 7fc5f7e00640 1 -- 172.21.15.17:0/483468228 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc600154130 msgr2=0x7fc60015bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:22.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.204+0000 7fc5f7e00640 1 --2- 172.21.15.17:0/483468228 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fc600154130 0x7fc60015bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:22.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.204+0000 7fc5f7e00640 1 -- 172.21.15.17:0/483468228 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f8009a70 con 0x7fc600153d50 2024-03-12T17:33:22.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.204+0000 7fc5fea00640 1 --2- 172.21.15.17:0/483468228 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fc6000cb720 0x7fc600154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:33:22.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.204+0000 7fc5f7e00640 1 --2- 172.21.15.17:0/483468228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc600153d50 0x7fc60015ba10 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc5e800c4d0 tx=0x7fc5e800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:22.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.204+0000 7fc5f6a00640 1 -- 172.21.15.17:0/483468228 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8005ce0 con 0x7fc600153d50 2024-03-12T17:33:22.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.204+0000 7fc5f6a00640 1 -- 172.21.15.17:0/483468228 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5e8005e40 con 0x7fc600153d50 2024-03-12T17:33:22.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.205+0000 7fc605c00640 1 -- 172.21.15.17:0/483468228 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc600156950 con 0x7fc600153d50 2024-03-12T17:33:22.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.205+0000 7fc5f6a00640 1 -- 172.21.15.17:0/483468228 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5e8007270 con 0x7fc600153d50 2024-03-12T17:33:22.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.205+0000 7fc605c00640 1 -- 172.21.15.17:0/483468228 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc600156f10 con 0x7fc600153d50 2024-03-12T17:33:22.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.206+0000 7fc605c00640 1 -- 172.21.15.17:0/483468228 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc6000cdb20 con 0x7fc600153d50 2024-03-12T17:33:22.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.207+0000 7fc5f6a00640 1 -- 172.21.15.17:0/483468228 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fc5e8007490 con 0x7fc600153d50 2024-03-12T17:33:22.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.207+0000 7fc5f6a00640 1 --2- 172.21.15.17:0/483468228 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc5dc06ac00 0x7fc5dc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:22.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.208+0000 7fc5f6a00640 1 -- 172.21.15.17:0/483468228 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc5e8088500 con 0x7fc600153d50 2024-03-12T17:33:22.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.208+0000 7fc5fea00640 1 --2- 172.21.15.17:0/483468228 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc5dc06ac00 0x7fc5dc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:22.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.208+0000 7fc5f6a00640 1 --2- 172.21.15.17:0/483468228 >> [v2:172.21.15.94:6810/37464,v1:172.21.15.94:6812/37464] conn(0x7fc5dc070a60 0x7fc5dc072e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:22.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.208+0000 7fc5f6a00640 1 -- 172.21.15.17:0/483468228 --> [v2:172.21.15.94:6810/37464,v1:172.21.15.94:6812/37464] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc5dc073530 con 0x7fc5dc070a60 2024-03-12T17:33:22.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.208+0000 7fc5f6a00640 1 -- 172.21.15.17:0/483468228 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5e808aae0 con 0x7fc600153d50 2024-03-12T17:33:22.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.208+0000 7fc5ff400640 1 --2- 172.21.15.17:0/483468228 >> [v2:172.21.15.94:6810/37464,v1:172.21.15.94:6812/37464] conn(0x7fc5dc070a60 0x7fc5dc072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:22.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.209+0000 7fc5fea00640 1 --2- 172.21.15.17:0/483468228 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc5dc06ac00 0x7fc5dc06d0c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc6000ad360 tx=0x7fc5f0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:22.205 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.209+0000 7fc5ff400640 1 --2- 172.21.15.17:0/483468228 >> [v2:172.21.15.94:6810/37464,v1:172.21.15.94:6812/37464] conn(0x7fc5dc070a60 0x7fc5dc072e80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:22.207 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.211+0000 7fc5f6a00640 1 -- 172.21.15.17:0/483468228 <== osd.5 v2:172.21.15.94:6810/37464 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fc5dc073530 con 0x7fc5dc070a60 2024-03-12T17:33:22.221 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.225+0000 7fc605c00640 1 -- 172.21.15.17:0/483468228 --> [v2:172.21.15.94:6810/37464,v1:172.21.15.94:6812/37464] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc60015db80 con 0x7fc5dc070a60 2024-03-12T17:33:22.222 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.226+0000 7fc5f6a00640 1 -- 172.21.15.17:0/483468228 <== osd.5 v2:172.21.15.94:6810/37464 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc5f803f450 con 0x7fc5dc070a60 2024-03-12T17:33:22.222 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-12T17:33:22.223 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-12T17:33:22.223 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-12T17:33:22.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.227+0000 7fc605c00640 1 -- 172.21.15.17:0/483468228 >> [v2:172.21.15.94:6810/37464,v1:172.21.15.94:6812/37464] conn(0x7fc5dc070a60 msgr2=0x7fc5dc072e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:22.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.227+0000 7fc605c00640 1 --2- 172.21.15.17:0/483468228 >> [v2:172.21.15.94:6810/37464,v1:172.21.15.94:6812/37464] conn(0x7fc5dc070a60 0x7fc5dc072e80 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:22.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.227+0000 7fc605c00640 1 -- 172.21.15.17:0/483468228 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc5dc06ac00 msgr2=0x7fc5dc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:22.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.227+0000 7fc605c00640 1 --2- 172.21.15.17:0/483468228 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fc5dc06ac00 0x7fc5dc06d0c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc6000ad360 tx=0x7fc5f0009040 comp rx=0 tx=0).stop 2024-03-12T17:33:22.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.227+0000 7fc605c00640 1 -- 172.21.15.17:0/483468228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc600153d50 msgr2=0x7fc60015ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:22.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.227+0000 7fc605c00640 1 --2- 172.21.15.17:0/483468228 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fc600153d50 0x7fc60015ba10 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc5e800c4d0 tx=0x7fc5e800c990 comp rx=0 tx=0).stop 2024-03-12T17:33:22.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.227+0000 7fc5ff400640 1 -- 172.21.15.17:0/483468228 reap_dead start 2024-03-12T17:33:22.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.227+0000 7fc605c00640 1 -- 172.21.15.17:0/483468228 shutdown_connections 2024-03-12T17:33:22.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.227+0000 7fc605c00640 1 -- 172.21.15.17:0/483468228 >> 172.21.15.17:0/483468228 conn(0x7fc600069ce0 msgr2=0x7fc6001532a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:22.224 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.228+0000 7fc605c00640 1 -- 172.21.15.17:0/483468228 shutdown_connections 2024-03-12T17:33:22.225 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.228+0000 7fc605c00640 1 -- 172.21.15.17:0/483468228 wait complete. 2024-03-12T17:33:22.240 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-03-12T17:33:22.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.461+0000 7f8e31000640 1 Processor -- start 2024-03-12T17:33:22.457 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.462+0000 7f8e31000640 1 -- start start 2024-03-12T17:33:22.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.463+0000 7f8e31000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8e2c0ccea0 0x7f8e2c13fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:22.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.463+0000 7f8e31000640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e2c15bd70 con 0x7f8e2c1403a0 2024-03-12T17:33:22.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.463+0000 7f8e31000640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e2c070f80 con 0x7f8e2c070ba0 2024-03-12T17:33:22.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.463+0000 7f8e31000640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c140e80 con 0x7f8e2c0ccea0 2024-03-12T17:33:22.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.464+0000 7f8e2be00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f8e2c1403a0 0x7f8e2c1643f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34538/0 (socket says 172.21.15.17:34538) 2024-03-12T17:33:22.459 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.464+0000 7f8e2be00640 1 -- 172.21.15.17:0/2950151836 learned_addr learned my addr 172.21.15.17:0/2950151836 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:33:22.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.464+0000 7f8e23e00640 1 --2- 172.21.15.17:0/2950151836 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8e2c0ccea0 0x7f8e2c13fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:22.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.464+0000 7f8e2aa00640 1 -- 172.21.15.17:0/2950151836 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 388312022 0 0) 0x7f8e24001490 con 0x7f8e2c1403a0 2024-03-12T17:33:22.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.464+0000 7f8e2aa00640 1 -- 172.21.15.17:0/2950151836 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e10003520 con 0x7f8e2c1403a0 2024-03-12T17:33:22.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.465+0000 7f8e2aa00640 1 -- 172.21.15.17:0/2950151836 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1224641705 0 0) 0x7f8e10003520 con 0x7f8e2c1403a0 2024-03-12T17:33:22.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.465+0000 7f8e2aa00640 1 -- 172.21.15.17:0/2950151836 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8e2c0ccea0 msgr2=0x7f8e2c13fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:22.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.465+0000 7f8e2aa00640 1 --2- 172.21.15.17:0/2950151836 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8e2c0ccea0 0x7f8e2c13fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:22.461 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.465+0000 7f8e2aa00640 1 -- 172.21.15.17:0/2950151836 >> v1:172.21.15.94:6789/0 conn(0x7f8e2c070ba0 legacy=0x7f8e2c0cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:22.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.465+0000 7f8e2aa00640 1 -- 172.21.15.17:0/2950151836 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2c15afd0 con 0x7f8e2c1403a0 2024-03-12T17:33:22.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.465+0000 7f8e2aa00640 1 -- 172.21.15.17:0/2950151836 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7f8e24001b80 con 0x7f8e2c1403a0 2024-03-12T17:33:22.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.465+0000 7f8e2aa00640 1 -- 172.21.15.17:0/2950151836 >> v1:172.21.15.17:6789/0 conn(0x7f8e2c1403a0 legacy=0x7f8e2c1643f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:22.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.465+0000 7f8e2aa00640 1 --2- 172.21.15.17:0/2950151836 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8e2c0ccea0 0x7f8e100039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:22.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.465+0000 7f8e2aa00640 1 --2- 172.21.15.17:0/2950151836 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e10003f20 0x7f8e100047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:22.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.465+0000 7f8e2aa00640 1 --2- 172.21.15.17:0/2950151836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e10004d00 0x7f8e10005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:22.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.465+0000 7f8e2aa00640 1 -- 172.21.15.17:0/2950151836 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1000ba30 con 0x7f8e10004d00 2024-03-12T17:33:22.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.465+0000 7f8e2aa00640 1 -- 172.21.15.17:0/2950151836 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1000bba0 con 0x7f8e10003f20 2024-03-12T17:33:22.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.465+0000 7f8e2aa00640 1 -- 172.21.15.17:0/2950151836 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e1000bd60 con 0x7f8e2c0ccea0 2024-03-12T17:33:22.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.465+0000 7f8e2be00640 1 --2- 172.21.15.17:0/2950151836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e10004d00 0x7f8e10005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:22.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.465+0000 7f8e2b400640 1 --2- 172.21.15.17:0/2950151836 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8e2c0ccea0 0x7f8e100039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:22.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.465+0000 7f8e2be00640 1 -- 172.21.15.17:0/2950151836 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8e2c0ccea0 msgr2=0x7f8e100039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:22.462 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.465+0000 7f8e23e00640 1 --2- 172.21.15.17:0/2950151836 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e10003f20 0x7f8e100047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:22.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.466+0000 7f8e2be00640 1 --2- 172.21.15.17:0/2950151836 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8e2c0ccea0 0x7f8e100039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:22.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.466+0000 7f8e2be00640 1 -- 172.21.15.17:0/2950151836 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e10003f20 msgr2=0x7f8e100047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:22.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.466+0000 7f8e2be00640 1 --2- 172.21.15.17:0/2950151836 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e10003f20 0x7f8e100047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:22.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.466+0000 7f8e2be00640 1 -- 172.21.15.17:0/2950151836 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e10003520 con 0x7f8e10004d00 2024-03-12T17:33:22.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.466+0000 7f8e2b400640 1 --2- 172.21.15.17:0/2950151836 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8e2c0ccea0 0x7f8e100039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:33:22.463 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.466+0000 7f8e23e00640 1 --2- 172.21.15.17:0/2950151836 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e10003f20 0x7f8e100047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:33:22.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.467+0000 7f8e2be00640 1 --2- 172.21.15.17:0/2950151836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e10004d00 0x7f8e10005180 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f8e2400a830 tx=0x7f8e100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=289a2e6ba2531a85 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:22.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.467+0000 7f8e2aa00640 1 -- 172.21.15.17:0/2950151836 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e24034630 con 0x7f8e10004d00 2024-03-12T17:33:22.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.467+0000 7f8e2aa00640 1 -- 172.21.15.17:0/2950151836 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2402f070 con 0x7f8e10004d00 2024-03-12T17:33:22.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.467+0000 7f8e2aa00640 1 -- 172.21.15.17:0/2950151836 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e24034a30 con 0x7f8e10004d00 2024-03-12T17:33:22.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.467+0000 7f8e31000640 1 -- 172.21.15.17:0/2950151836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e10004d00 msgr2=0x7f8e10005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:22.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.467+0000 7f8e31000640 1 --2- 172.21.15.17:0/2950151836 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e10004d00 0x7f8e10005180 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f8e2400a830 tx=0x7f8e100057f0 comp rx=0 tx=0).stop 2024-03-12T17:33:22.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.467+0000 7f8e2be00640 1 -- 172.21.15.17:0/2950151836 reap_dead start 2024-03-12T17:33:22.464 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.468+0000 7f8e31000640 1 -- 172.21.15.17:0/2950151836 shutdown_connections 2024-03-12T17:33:22.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.468+0000 7f8e31000640 1 -- 172.21.15.17:0/2950151836 >> 172.21.15.17:0/2950151836 conn(0x7f8e2c066000 msgr2=0x7f8e2c069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:22.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.468+0000 7f8e31000640 1 -- 172.21.15.17:0/2950151836 shutdown_connections 2024-03-12T17:33:22.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.468+0000 7f8e31000640 1 -- 172.21.15.17:0/2950151836 wait complete. 2024-03-12T17:33:22.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.470+0000 7f8e31000640 1 Processor -- start 2024-03-12T17:33:22.465 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.470+0000 7f8e31000640 1 -- start start 2024-03-12T17:33:22.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.471+0000 7f8e31000640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8e10004d00 0x7f8e2c1f2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:22.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.471+0000 7f8e31000640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e2c1e8310 0x7f8e2c159870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:22.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.471+0000 7f8e31000640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e2c159db0 0x7f8e2c13c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:22.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.471+0000 7f8e31000640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c15a240 con 0x7f8e2c1e8310 2024-03-12T17:33:22.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.471+0000 7f8e31000640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c0b39c0 con 0x7f8e2c159db0 2024-03-12T17:33:22.469 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.471+0000 7f8e31000640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c1e31d0 con 0x7f8e10004d00 2024-03-12T17:33:22.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.471+0000 7f8e23e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e2c1e8310 0x7f8e2c159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:22.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.471+0000 7f8e23e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e2c1e8310 0x7f8e2c159870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35542/0 (socket says 172.21.15.17:35542) 2024-03-12T17:33:22.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.471+0000 7f8e23e00640 1 -- 172.21.15.17:0/640450190 learned_addr learned my addr 172.21.15.17:0/640450190 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:22.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.471+0000 7f8e2be00640 1 --2- 172.21.15.17:0/640450190 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e2c159db0 0x7f8e2c13c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:22.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.471+0000 7f8e2b400640 1 --2- 172.21.15.17:0/640450190 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8e10004d00 0x7f8e2c1f2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:22.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.472+0000 7f8e23e00640 1 -- 172.21.15.17:0/640450190 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8e10004d00 msgr2=0x7f8e2c1f2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:22.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.472+0000 7f8e23e00640 1 --2- 172.21.15.17:0/640450190 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8e10004d00 0x7f8e2c1f2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:22.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.472+0000 7f8e23e00640 1 -- 172.21.15.17:0/640450190 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e2c159db0 msgr2=0x7f8e2c13c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:22.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.472+0000 7f8e23e00640 1 --2- 172.21.15.17:0/640450190 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e2c159db0 0x7f8e2c13c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:22.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.472+0000 7f8e23e00640 1 -- 172.21.15.17:0/640450190 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2c1e34b0 con 0x7f8e2c1e8310 2024-03-12T17:33:22.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.472+0000 7f8e23e00640 1 --2- 172.21.15.17:0/640450190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e2c1e8310 0x7f8e2c159870 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f8e140108b0 tx=0x7f8e14010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:22.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.472+0000 7f8e23400640 1 -- 172.21.15.17:0/640450190 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1400eb60 con 0x7f8e2c1e8310 2024-03-12T17:33:22.470 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.472+0000 7f8e23400640 1 -- 172.21.15.17:0/640450190 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1400ecc0 con 0x7f8e2c1e8310 2024-03-12T17:33:22.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.472+0000 7f8e23400640 1 -- 172.21.15.17:0/640450190 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1401c400 con 0x7f8e2c1e8310 2024-03-12T17:33:22.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.472+0000 7f8e31000640 1 -- 172.21.15.17:0/640450190 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e2c1e3790 con 0x7f8e2c1e8310 2024-03-12T17:33:22.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.473+0000 7f8e31000640 1 -- 172.21.15.17:0/640450190 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e2c1e3d50 con 0x7f8e2c1e8310 2024-03-12T17:33:22.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.474+0000 7f8e31000640 1 -- 172.21.15.17:0/640450190 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e2c04e030 con 0x7f8e2c1e8310 2024-03-12T17:33:22.471 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.475+0000 7f8e23400640 1 -- 172.21.15.17:0/640450190 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f8e1401c560 con 0x7f8e2c1e8310 2024-03-12T17:33:22.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.475+0000 7f8e23400640 1 --2- 172.21.15.17:0/640450190 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f8e0806ac30 0x7f8e0806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:22.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.476+0000 7f8e23400640 1 -- 172.21.15.17:0/640450190 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8e14089630 con 0x7f8e2c1e8310 2024-03-12T17:33:22.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.476+0000 7f8e2b400640 1 --2- 172.21.15.17:0/640450190 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f8e0806ac30 0x7f8e0806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:22.472 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.477+0000 7f8e2b400640 1 --2- 172.21.15.17:0/640450190 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f8e0806ac30 0x7f8e0806d0f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c1408c0 tx=0x7f8e1c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:22.476 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.480+0000 7f8e23400640 1 -- 172.21.15.17:0/640450190 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f8e14054bb0 con 0x7f8e2c1e8310 2024-03-12T17:33:22.675 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.679+0000 7f8e31000640 1 -- 172.21.15.17:0/640450190 --> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e2c15b870 con 0x7f8e0806ac30 2024-03-12T17:33:22.676 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.680+0000 7f8e23400640 1 -- 172.21.15.17:0/640450190 <== mgr.4104 v2:172.21.15.17:6832/37052 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8e1c00d050 con 0x7f8e0806ac30 2024-03-12T17:33:22.676 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 5 to deep-scrub 2024-03-12T17:33:22.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.682+0000 7f8e31000640 1 -- 172.21.15.17:0/640450190 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f8e0806ac30 msgr2=0x7f8e0806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:22.678 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.682+0000 7f8e31000640 1 --2- 172.21.15.17:0/640450190 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f8e0806ac30 0x7f8e0806d0f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c1408c0 tx=0x7f8e1c009040 comp rx=0 tx=0).stop 2024-03-12T17:33:22.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.682+0000 7f8e31000640 1 -- 172.21.15.17:0/640450190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e2c1e8310 msgr2=0x7f8e2c159870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:22.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.682+0000 7f8e31000640 1 --2- 172.21.15.17:0/640450190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e2c1e8310 0x7f8e2c159870 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f8e140108b0 tx=0x7f8e14010d70 comp rx=0 tx=0).stop 2024-03-12T17:33:22.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.683+0000 7f8e31000640 1 -- 172.21.15.17:0/640450190 shutdown_connections 2024-03-12T17:33:22.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.683+0000 7f8e31000640 1 --2- 172.21.15.17:0/640450190 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f8e0806ac30 0x7f8e0806d0f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:22.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.683+0000 7f8e31000640 1 --2- 172.21.15.17:0/640450190 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f8e2c159db0 0x7f8e2c13c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:22.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.683+0000 7f8e31000640 1 --2- 172.21.15.17:0/640450190 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f8e2c1e8310 0x7f8e2c159870 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:22.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.683+0000 7f8e31000640 1 --2- 172.21.15.17:0/640450190 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f8e10004d00 0x7f8e2c1f2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:22.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.683+0000 7f8e31000640 1 -- 172.21.15.17:0/640450190 >> 172.21.15.17:0/640450190 conn(0x7f8e2c066000 msgr2=0x7f8e2c0cc790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:22.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.683+0000 7f8e31000640 1 -- 172.21.15.17:0/640450190 shutdown_connections 2024-03-12T17:33:22.679 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.683+0000 7f8e31000640 1 -- 172.21.15.17:0/640450190 wait complete. 2024-03-12T17:33:22.697 INFO:tasks.ceph:Scrubbing osd.6 2024-03-12T17:33:22.698 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-03-12T17:33:22.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.925+0000 7f9bc2a00640 1 Processor -- start 2024-03-12T17:33:22.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.925+0000 7f9bc2a00640 1 -- start start 2024-03-12T17:33:22.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.927+0000 7f9bc2a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9bbc15b820 0x7f9bbc06a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:22.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.927+0000 7f9bc2a00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bbc15bc60 con 0x7f9bbc06a630 2024-03-12T17:33:22.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.927+0000 7f9bc2a00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bbc0cbce0 con 0x7f9bbc15a8a0 2024-03-12T17:33:22.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.927+0000 7f9bc2a00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc06aac0 con 0x7f9bbc15b820 2024-03-12T17:33:22.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.927+0000 7f9bc2000640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f9bbc06a630 0x7f9bbc15beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34550/0 (socket says 172.21.15.17:34550) 2024-03-12T17:33:22.923 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.927+0000 7f9bc2000640 1 -- 172.21.15.17:0/4074989455 learned_addr learned my addr 172.21.15.17:0/4074989455 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:33:22.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.927+0000 7f9bc0c00640 1 --2- 172.21.15.17:0/4074989455 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9bbc15b820 0x7f9bbc06a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:22.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.928+0000 7f9bbbe00640 1 -- 172.21.15.17:0/4074989455 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3001274389 0 0) 0x7f9bbc15bc60 con 0x7f9bbc06a630 2024-03-12T17:33:22.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.928+0000 7f9bbbe00640 1 -- 172.21.15.17:0/4074989455 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ba4003520 con 0x7f9bbc06a630 2024-03-12T17:33:22.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.928+0000 7f9bbbe00640 1 -- 172.21.15.17:0/4074989455 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4134809552 0 0) 0x7f9ba4003520 con 0x7f9bbc06a630 2024-03-12T17:33:22.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.928+0000 7f9bbbe00640 1 -- 172.21.15.17:0/4074989455 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9bbc15b820 msgr2=0x7f9bbc06a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:22.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.928+0000 7f9bbbe00640 1 --2- 172.21.15.17:0/4074989455 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9bbc15b820 0x7f9bbc06a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:22.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.928+0000 7f9bbbe00640 1 -- 172.21.15.17:0/4074989455 >> v1:172.21.15.94:6789/0 conn(0x7f9bbc15a8a0 legacy=0x7f9bbc0cb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:22.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.928+0000 7f9bbbe00640 1 -- 172.21.15.17:0/4074989455 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bbc0cbfc0 con 0x7f9bbc06a630 2024-03-12T17:33:22.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.928+0000 7f9bbbe00640 1 -- 172.21.15.17:0/4074989455 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7f9bb40019f0 con 0x7f9bbc06a630 2024-03-12T17:33:22.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.928+0000 7f9bbbe00640 1 -- 172.21.15.17:0/4074989455 >> v1:172.21.15.17:6789/0 conn(0x7f9bbc06a630 legacy=0x7f9bbc15beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:22.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.928+0000 7f9bbbe00640 1 --2- 172.21.15.17:0/4074989455 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9bbc15b820 0x7f9ba40039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:22.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.928+0000 7f9bbbe00640 1 --2- 172.21.15.17:0/4074989455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ba4003f70 0x7f9ba40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:22.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.928+0000 7f9bbbe00640 1 --2- 172.21.15.17:0/4074989455 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ba4004d00 0x7f9ba4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:22.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.928+0000 7f9bbbe00640 1 -- 172.21.15.17:0/4074989455 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc06aac0 con 0x7f9ba4003f70 2024-03-12T17:33:22.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.928+0000 7f9bbbe00640 1 -- 172.21.15.17:0/4074989455 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba400bac0 con 0x7f9ba4004d00 2024-03-12T17:33:22.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.928+0000 7f9bbbe00640 1 -- 172.21.15.17:0/4074989455 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba400bc80 con 0x7f9bbc15b820 2024-03-12T17:33:22.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.929+0000 7f9bc0c00640 1 --2- 172.21.15.17:0/4074989455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ba4003f70 0x7f9ba40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:22.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.929+0000 7f9bc1600640 1 --2- 172.21.15.17:0/4074989455 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9bbc15b820 0x7f9ba40039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:22.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.929+0000 7f9bc2000640 1 --2- 172.21.15.17:0/4074989455 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ba4004d00 0x7f9ba4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:22.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.929+0000 7f9bc0c00640 1 -- 172.21.15.17:0/4074989455 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9bbc15b820 msgr2=0x7f9ba40039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:22.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.929+0000 7f9bc0c00640 1 --2- 172.21.15.17:0/4074989455 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9bbc15b820 0x7f9ba40039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:22.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.929+0000 7f9bc0c00640 1 -- 172.21.15.17:0/4074989455 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ba4004d00 msgr2=0x7f9ba4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:22.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.929+0000 7f9bc0c00640 1 --2- 172.21.15.17:0/4074989455 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ba4004d00 0x7f9ba4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:22.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.929+0000 7f9bc0c00640 1 -- 172.21.15.17:0/4074989455 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba4003520 con 0x7f9ba4003f70 2024-03-12T17:33:22.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.929+0000 7f9bc2000640 1 --2- 172.21.15.17:0/4074989455 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9ba4004d00 0x7f9ba4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:33:22.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.930+0000 7f9bc0c00640 1 --2- 172.21.15.17:0/4074989455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ba4003f70 0x7f9ba40047c0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0009ac0 tx=0x7f9ba40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=362cc1fc9035035b server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:22.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.931+0000 7f9bbbe00640 1 -- 172.21.15.17:0/4074989455 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb002c600 con 0x7f9ba4003f70 2024-03-12T17:33:22.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.931+0000 7f9bbbe00640 1 -- 172.21.15.17:0/4074989455 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb002c760 con 0x7f9ba4003f70 2024-03-12T17:33:22.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.931+0000 7f9bbbe00640 1 -- 172.21.15.17:0/4074989455 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb002caf0 con 0x7f9ba4003f70 2024-03-12T17:33:22.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.931+0000 7f9bc2a00640 1 -- 172.21.15.17:0/4074989455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ba4003f70 msgr2=0x7f9ba40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:22.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.931+0000 7f9bc2a00640 1 --2- 172.21.15.17:0/4074989455 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ba4003f70 0x7f9ba40047c0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0009ac0 tx=0x7f9ba40057f0 comp rx=0 tx=0).stop 2024-03-12T17:33:22.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.931+0000 7f9bc2000640 1 -- 172.21.15.17:0/4074989455 reap_dead start 2024-03-12T17:33:22.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.932+0000 7f9bc2a00640 1 -- 172.21.15.17:0/4074989455 shutdown_connections 2024-03-12T17:33:22.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.932+0000 7f9bc2a00640 1 -- 172.21.15.17:0/4074989455 >> 172.21.15.17:0/4074989455 conn(0x7f9bbc069ce0 msgr2=0x7f9bbc0b3970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:22.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.932+0000 7f9bc2a00640 1 -- 172.21.15.17:0/4074989455 shutdown_connections 2024-03-12T17:33:22.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.932+0000 7f9bc2a00640 1 -- 172.21.15.17:0/4074989455 wait complete. 2024-03-12T17:33:22.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.934+0000 7f9bc2a00640 1 Processor -- start 2024-03-12T17:33:22.930 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.934+0000 7f9bc2a00640 1 -- start start 2024-03-12T17:33:22.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.935+0000 7f9bc2a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ba4003f70 0x7f9bbc0ac690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:22.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.935+0000 7f9bc2a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9bbc142fb0 0x7f9bbc0b26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:22.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.935+0000 7f9bc2a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9bbc0b2be0 0x7f9bbc150e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:22.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.935+0000 7f9bc2a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc151dc0 con 0x7f9ba4003f70 2024-03-12T17:33:22.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.935+0000 7f9bc2a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc0b3060 con 0x7f9bbc142fb0 2024-03-12T17:33:22.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.935+0000 7f9bc2a00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bbc0acbd0 con 0x7f9bbc0b2be0 2024-03-12T17:33:22.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.935+0000 7f9bc1600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ba4003f70 0x7f9bbc0ac690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:22.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.935+0000 7f9bc1600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ba4003f70 0x7f9bbc0ac690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35546/0 (socket says 172.21.15.17:35546) 2024-03-12T17:33:22.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.935+0000 7f9bc1600640 1 -- 172.21.15.17:0/4288423276 learned_addr learned my addr 172.21.15.17:0/4288423276 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:22.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.935+0000 7f9bc0c00640 1 --2- 172.21.15.17:0/4288423276 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9bbc142fb0 0x7f9bbc0b26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:22.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.935+0000 7f9bc1600640 1 -- 172.21.15.17:0/4288423276 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9bbc0b2be0 msgr2=0x7f9bbc150e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:22.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.935+0000 7f9bc1600640 1 --2- 172.21.15.17:0/4288423276 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f9bbc0b2be0 0x7f9bbc150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:22.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.935+0000 7f9bc1600640 1 -- 172.21.15.17:0/4288423276 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9bbc142fb0 msgr2=0x7f9bbc0b26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:22.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.935+0000 7f9bc1600640 1 --2- 172.21.15.17:0/4288423276 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f9bbc142fb0 0x7f9bbc0b26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:22.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.936+0000 7f9bc1600640 1 -- 172.21.15.17:0/4288423276 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bbc0ac200 con 0x7f9ba4003f70 2024-03-12T17:33:22.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.936+0000 7f9bc1600640 1 --2- 172.21.15.17:0/4288423276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ba4003f70 0x7f9bbc0ac690 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f9bac00e580 tx=0x7f9bac00ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:22.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.936+0000 7f9bb9600640 1 -- 172.21.15.17:0/4288423276 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac0052e0 con 0x7f9ba4003f70 2024-03-12T17:33:22.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.936+0000 7f9bb9600640 1 -- 172.21.15.17:0/4288423276 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bac005440 con 0x7f9ba4003f70 2024-03-12T17:33:22.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.936+0000 7f9bb9600640 1 -- 172.21.15.17:0/4288423276 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bac003810 con 0x7f9ba4003f70 2024-03-12T17:33:22.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.936+0000 7f9bc2a00640 1 -- 172.21.15.17:0/4288423276 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bbc151ae0 con 0x7f9ba4003f70 2024-03-12T17:33:22.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.936+0000 7f9bc2a00640 1 -- 172.21.15.17:0/4288423276 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bbc0abe90 con 0x7f9ba4003f70 2024-03-12T17:33:22.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.937+0000 7f9bc2a00640 1 -- 172.21.15.17:0/4288423276 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9bbc0b11b0 con 0x7f9ba4003f70 2024-03-12T17:33:22.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.938+0000 7f9bb9600640 1 -- 172.21.15.17:0/4288423276 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f9bac003970 con 0x7f9ba4003f70 2024-03-12T17:33:22.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.939+0000 7f9bb9600640 1 --2- 172.21.15.17:0/4288423276 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f9ba006ac00 0x7f9ba006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:22.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.939+0000 7f9bb9600640 1 -- 172.21.15.17:0/4288423276 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9bac088e00 con 0x7f9ba4003f70 2024-03-12T17:33:22.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.939+0000 7f9bb9600640 1 --2- 172.21.15.17:0/4288423276 >> [v2:172.21.15.94:6824/37467,v1:172.21.15.94:6825/37467] conn(0x7f9ba0070a60 0x7f9ba0072e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:22.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.939+0000 7f9bc0c00640 1 --2- 172.21.15.17:0/4288423276 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f9ba006ac00 0x7f9ba006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:22.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.939+0000 7f9bb9600640 1 -- 172.21.15.17:0/4288423276 --> [v2:172.21.15.94:6824/37467,v1:172.21.15.94:6825/37467] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9ba0073530 con 0x7f9ba0070a60 2024-03-12T17:33:22.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.939+0000 7f9bb9600640 1 -- 172.21.15.17:0/4288423276 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9bac08b380 con 0x7f9ba4003f70 2024-03-12T17:33:22.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.940+0000 7f9bc0c00640 1 --2- 172.21.15.17:0/4288423276 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f9ba006ac00 0x7f9ba006d0c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0036000 tx=0x7f9bb0030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:22.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.940+0000 7f9bc2000640 1 --2- 172.21.15.17:0/4288423276 >> [v2:172.21.15.94:6824/37467,v1:172.21.15.94:6825/37467] conn(0x7f9ba0070a60 0x7f9ba0072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:22.937 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.941+0000 7f9bc2000640 1 --2- 172.21.15.17:0/4288423276 >> [v2:172.21.15.94:6824/37467,v1:172.21.15.94:6825/37467] conn(0x7f9ba0070a60 0x7f9ba0072e80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:22.939 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.943+0000 7f9bb9600640 1 -- 172.21.15.17:0/4288423276 <== osd.6 v2:172.21.15.94:6824/37467 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f9ba0073530 con 0x7f9ba0070a60 2024-03-12T17:33:22.953 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.957+0000 7f9bc2a00640 1 -- 172.21.15.17:0/4288423276 --> [v2:172.21.15.94:6824/37467,v1:172.21.15.94:6825/37467] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9bbc15b300 con 0x7f9ba0070a60 2024-03-12T17:33:22.954 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.958+0000 7f9bb9600640 1 -- 172.21.15.17:0/4288423276 <== osd.6 v2:172.21.15.94:6824/37467 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f9bb4001810 con 0x7f9ba0070a60 2024-03-12T17:33:22.955 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-12T17:33:22.955 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-12T17:33:22.955 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-12T17:33:22.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.959+0000 7f9bc2a00640 1 -- 172.21.15.17:0/4288423276 >> [v2:172.21.15.94:6824/37467,v1:172.21.15.94:6825/37467] conn(0x7f9ba0070a60 msgr2=0x7f9ba0072e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:22.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.959+0000 7f9bc2a00640 1 --2- 172.21.15.17:0/4288423276 >> [v2:172.21.15.94:6824/37467,v1:172.21.15.94:6825/37467] conn(0x7f9ba0070a60 0x7f9ba0072e80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:22.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.959+0000 7f9bc2a00640 1 -- 172.21.15.17:0/4288423276 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f9ba006ac00 msgr2=0x7f9ba006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:22.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.959+0000 7f9bc2a00640 1 --2- 172.21.15.17:0/4288423276 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f9ba006ac00 0x7f9ba006d0c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0036000 tx=0x7f9bb0030000 comp rx=0 tx=0).stop 2024-03-12T17:33:22.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.959+0000 7f9bc2a00640 1 -- 172.21.15.17:0/4288423276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ba4003f70 msgr2=0x7f9bbc0ac690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:22.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.959+0000 7f9bc2a00640 1 --2- 172.21.15.17:0/4288423276 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f9ba4003f70 0x7f9bbc0ac690 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f9bac00e580 tx=0x7f9bac00ea40 comp rx=0 tx=0).stop 2024-03-12T17:33:22.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.959+0000 7f9bc2000640 1 -- 172.21.15.17:0/4288423276 reap_dead start 2024-03-12T17:33:22.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.959+0000 7f9bc2a00640 1 -- 172.21.15.17:0/4288423276 shutdown_connections 2024-03-12T17:33:22.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.959+0000 7f9bc2a00640 1 -- 172.21.15.17:0/4288423276 >> 172.21.15.17:0/4288423276 conn(0x7f9bbc069ce0 msgr2=0x7f9bbc0af9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:22.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.960+0000 7f9bc2a00640 1 -- 172.21.15.17:0/4288423276 shutdown_connections 2024-03-12T17:33:22.956 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:22.960+0000 7f9bc2a00640 1 -- 172.21.15.17:0/4288423276 wait complete. 2024-03-12T17:33:22.974 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-03-12T17:33:23.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.194+0000 7f214ca00640 1 Processor -- start 2024-03-12T17:33:23.190 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.195+0000 7f214ca00640 1 -- start start 2024-03-12T17:33:23.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.196+0000 7f214ca00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f21480b86c0 0x7f21480b4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:23.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.196+0000 7f214ca00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f21480b4950 0x7f21480d1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:23.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.196+0000 7f214ca00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2148160470 con 0x7f2148160090 2024-03-12T17:33:23.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.196+0000 7f214ca00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21480d0e40 con 0x7f21480b86c0 2024-03-12T17:33:23.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.196+0000 7f214ca00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f214806b840 con 0x7f21480b4950 2024-03-12T17:33:23.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.196+0000 7f2146800640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f2148160090 0x7f214806b130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34554/0 (socket says 172.21.15.17:34554) 2024-03-12T17:33:23.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.196+0000 7f2146800640 1 -- 172.21.15.17:0/795243936 learned_addr learned my addr 172.21.15.17:0/795243936 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:33:23.193 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.197+0000 7f2145e00640 1 --2- 172.21.15.17:0/795243936 >> v2:172.21.15.17:3300/0 conn(0x7f21480b86c0 0x7f21480b4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:23.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.197+0000 7f2147200640 1 --2- 172.21.15.17:0/795243936 >> v2:172.21.15.94:3300/0 conn(0x7f21480b4950 0x7f21480d1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:23.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.197+0000 7f2145400640 1 -- 172.21.15.17:0/795243936 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 139151815 0 0) 0x7f2148160470 con 0x7f2148160090 2024-03-12T17:33:23.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.197+0000 7f2145400640 1 -- 172.21.15.17:0/795243936 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2128003520 con 0x7f2148160090 2024-03-12T17:33:23.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.197+0000 7f2145e00640 1 -- 172.21.15.17:0/795243936 >> v2:172.21.15.94:3300/0 conn(0x7f21480b4950 msgr2=0x7f21480d1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:23.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.197+0000 7f2145e00640 1 --2- 172.21.15.17:0/795243936 >> v2:172.21.15.94:3300/0 conn(0x7f21480b4950 0x7f21480d1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:23.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.197+0000 7f2145e00640 1 -- 172.21.15.17:0/795243936 >> v1:172.21.15.17:6789/0 conn(0x7f2148160090 legacy=0x7f214806b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:23.194 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.197+0000 7f2145e00640 1 -- 172.21.15.17:0/795243936 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21480b4d60 con 0x7f21480b86c0 2024-03-12T17:33:23.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.198+0000 7f2145e00640 1 --2- 172.21.15.17:0/795243936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21480b86c0 0x7f21480b4410 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f21480cf160 tx=0x7f213002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=737d72f114164b5f server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:23.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.199+0000 7f2145400640 1 -- 172.21.15.17:0/795243936 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213002cbf0 con 0x7f21480b86c0 2024-03-12T17:33:23.195 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.199+0000 7f2145400640 1 -- 172.21.15.17:0/795243936 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213002cd50 con 0x7f21480b86c0 2024-03-12T17:33:23.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.199+0000 7f2145400640 1 -- 172.21.15.17:0/795243936 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2130034640 con 0x7f21480b86c0 2024-03-12T17:33:23.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.199+0000 7f214ca00640 1 -- 172.21.15.17:0/795243936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21480b86c0 msgr2=0x7f21480b4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:23.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.199+0000 7f214ca00640 1 --2- 172.21.15.17:0/795243936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21480b86c0 0x7f21480b4410 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f21480cf160 tx=0x7f213002be40 comp rx=0 tx=0).stop 2024-03-12T17:33:23.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.200+0000 7f214ca00640 1 -- 172.21.15.17:0/795243936 shutdown_connections 2024-03-12T17:33:23.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.200+0000 7f214ca00640 1 --2- 172.21.15.17:0/795243936 >> v2:172.21.15.94:3300/0 conn(0x7f21480b4950 0x7f21480d1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:23.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.200+0000 7f214ca00640 1 --2- 172.21.15.17:0/795243936 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f21480b86c0 0x7f21480b4410 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:23.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.200+0000 7f214ca00640 1 -- 172.21.15.17:0/795243936 >> 172.21.15.17:0/795243936 conn(0x7f21480cf5f0 msgr2=0x7f21480cfa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:23.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.200+0000 7f214ca00640 1 -- 172.21.15.17:0/795243936 shutdown_connections 2024-03-12T17:33:23.196 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.200+0000 7f214ca00640 1 -- 172.21.15.17:0/795243936 wait complete. 2024-03-12T17:33:23.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.201+0000 7f214ca00640 1 Processor -- start 2024-03-12T17:33:23.197 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.202+0000 7f214ca00640 1 -- start start 2024-03-12T17:33:23.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.203+0000 7f214ca00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f21480b4950 0x7f21480b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:23.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.203+0000 7f214ca00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f21480b86c0 0x7f21480b6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:23.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.203+0000 7f214ca00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2148160090 0x7f21480b6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:23.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.203+0000 7f214ca00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214814f330 con 0x7f2148160090 2024-03-12T17:33:23.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.203+0000 7f214ca00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214814f7c0 con 0x7f21480b86c0 2024-03-12T17:33:23.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.203+0000 7f214ca00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f214814e720 con 0x7f21480b4950 2024-03-12T17:33:23.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.203+0000 7f2147200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2148160090 0x7f21480b6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:23.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.203+0000 7f2147200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2148160090 0x7f21480b6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35560/0 (socket says 172.21.15.17:35560) 2024-03-12T17:33:23.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.203+0000 7f2147200640 1 -- 172.21.15.17:0/4135035223 learned_addr learned my addr 172.21.15.17:0/4135035223 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:23.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.203+0000 7f2146800640 1 --2- 172.21.15.17:0/4135035223 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f21480b4950 0x7f21480b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:23.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.203+0000 7f2145e00640 1 --2- 172.21.15.17:0/4135035223 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f21480b86c0 0x7f21480b6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:23.200 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.203+0000 7f2147200640 1 -- 172.21.15.17:0/4135035223 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f21480b4950 msgr2=0x7f21480b0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:23.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.203+0000 7f2147200640 1 --2- 172.21.15.17:0/4135035223 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f21480b4950 0x7f21480b0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:23.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.203+0000 7f2147200640 1 -- 172.21.15.17:0/4135035223 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f21480b86c0 msgr2=0x7f21480b6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:23.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.203+0000 7f2147200640 1 --2- 172.21.15.17:0/4135035223 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f21480b86c0 0x7f21480b6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:23.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.203+0000 7f2147200640 1 -- 172.21.15.17:0/4135035223 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2130009a70 con 0x7f2148160090 2024-03-12T17:33:23.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.204+0000 7f2147200640 1 --2- 172.21.15.17:0/4135035223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2148160090 0x7f21480b6750 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f214000d800 tx=0x7f214000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:23.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.204+0000 7f213ea00640 1 -- 172.21.15.17:0/4135035223 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214000b6c0 con 0x7f2148160090 2024-03-12T17:33:23.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.204+0000 7f213ea00640 1 -- 172.21.15.17:0/4135035223 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214000b840 con 0x7f2148160090 2024-03-12T17:33:23.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.204+0000 7f213ea00640 1 -- 172.21.15.17:0/4135035223 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214000bbf0 con 0x7f2148160090 2024-03-12T17:33:23.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.204+0000 7f214ca00640 1 -- 172.21.15.17:0/4135035223 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f214814ea00 con 0x7f2148160090 2024-03-12T17:33:23.201 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.204+0000 7f214ca00640 1 -- 172.21.15.17:0/4135035223 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f214814efc0 con 0x7f2148160090 2024-03-12T17:33:23.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.205+0000 7f214ca00640 1 -- 172.21.15.17:0/4135035223 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2148067120 con 0x7f2148160090 2024-03-12T17:33:23.202 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.206+0000 7f213ea00640 1 -- 172.21.15.17:0/4135035223 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f214000bd50 con 0x7f2148160090 2024-03-12T17:33:23.203 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.207+0000 7f213ea00640 1 --2- 172.21.15.17:0/4135035223 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f212406ac00 0x7f212406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:23.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.208+0000 7f213ea00640 1 -- 172.21.15.17:0/4135035223 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2140089500 con 0x7f2148160090 2024-03-12T17:33:23.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.208+0000 7f2146800640 1 --2- 172.21.15.17:0/4135035223 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f212406ac00 0x7f212406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:23.204 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.209+0000 7f2146800640 1 --2- 172.21.15.17:0/4135035223 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f212406ac00 0x7f212406d0c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2138000f60 tx=0x7f2138009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:23.208 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.213+0000 7f213ea00640 1 -- 172.21.15.17:0/4135035223 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f2140054a70 con 0x7f2148160090 2024-03-12T17:33:23.406 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.411+0000 7f214ca00640 1 -- 172.21.15.17:0/4135035223 --> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f214806bd80 con 0x7f212406ac00 2024-03-12T17:33:23.407 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.411+0000 7f213ea00640 1 -- 172.21.15.17:0/4135035223 <== mgr.4104 v2:172.21.15.17:6832/37052 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f21380058d0 con 0x7f212406ac00 2024-03-12T17:33:23.407 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 6 to deep-scrub 2024-03-12T17:33:23.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.414+0000 7f214ca00640 1 -- 172.21.15.17:0/4135035223 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f212406ac00 msgr2=0x7f212406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:23.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.414+0000 7f214ca00640 1 --2- 172.21.15.17:0/4135035223 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f212406ac00 0x7f212406d0c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f2138000f60 tx=0x7f2138009040 comp rx=0 tx=0).stop 2024-03-12T17:33:23.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.414+0000 7f214ca00640 1 -- 172.21.15.17:0/4135035223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2148160090 msgr2=0x7f21480b6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:23.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.414+0000 7f214ca00640 1 --2- 172.21.15.17:0/4135035223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2148160090 0x7f21480b6750 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f214000d800 tx=0x7f214000dcc0 comp rx=0 tx=0).stop 2024-03-12T17:33:23.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.414+0000 7f214ca00640 1 -- 172.21.15.17:0/4135035223 shutdown_connections 2024-03-12T17:33:23.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.414+0000 7f214ca00640 1 --2- 172.21.15.17:0/4135035223 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f212406ac00 0x7f212406d0c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:23.410 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.414+0000 7f214ca00640 1 --2- 172.21.15.17:0/4135035223 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f2148160090 0x7f21480b6750 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:23.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.414+0000 7f214ca00640 1 --2- 172.21.15.17:0/4135035223 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f21480b86c0 0x7f21480b6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:23.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.414+0000 7f214ca00640 1 --2- 172.21.15.17:0/4135035223 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f21480b4950 0x7f21480b0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:23.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.414+0000 7f214ca00640 1 -- 172.21.15.17:0/4135035223 >> 172.21.15.17:0/4135035223 conn(0x7f21480cf5f0 msgr2=0x7f21480b2c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:23.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.415+0000 7f214ca00640 1 -- 172.21.15.17:0/4135035223 shutdown_connections 2024-03-12T17:33:23.411 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.415+0000 7f214ca00640 1 -- 172.21.15.17:0/4135035223 wait complete. 2024-03-12T17:33:23.430 INFO:tasks.ceph:Scrubbing osd.7 2024-03-12T17:33:23.430 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-03-12T17:33:23.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.656+0000 7fd302e00640 1 Processor -- start 2024-03-12T17:33:23.652 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.656+0000 7fd302e00640 1 -- start start 2024-03-12T17:33:23.653 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.658+0000 7fd302e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd2fc15cbb0 0x7fd2fc06c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:23.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.658+0000 7fd302e00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd2fc0cdb80 0x7fd2fc0cdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:23.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.658+0000 7fd302e00640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7fd2fc0cafb0 0x7fd2fc0cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:23.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.658+0000 7fd302e00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2fc0ce5b0 con 0x7fd2fc0cdb80 2024-03-12T17:33:23.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.658+0000 7fd302e00640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2fc0cb980 con 0x7fd2fc0cafb0 2024-03-12T17:33:23.654 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.658+0000 7fd302e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc0b1970 con 0x7fd2fc15cbb0 2024-03-12T17:33:23.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.658+0000 7fd2fb400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd2fc0cdb80 0x7fd2fc0cdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:23.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.659+0000 7fd2fb400640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7fd2fc0cdb80 0x7fd2fc0cdfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35562/0 (socket says 172.21.15.17:35562) 2024-03-12T17:33:23.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.659+0000 7fd2fb400640 1 -- 172.21.15.17:0/880912606 learned_addr learned my addr 172.21.15.17:0/880912606 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:23.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.659+0000 7fd2fbe00640 1 --2- 172.21.15.17:0/880912606 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd2fc15cbb0 0x7fd2fc06c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:23.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.659+0000 7fd300e00640 1 --2- 172.21.15.17:0/880912606 >> v2:172.21.15.94:3300/0 conn(0x7fd2fc0cafb0 0x7fd2fc0cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:23.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.659+0000 7fd2fb400640 1 -- 172.21.15.17:0/880912606 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd2fc15cbb0 msgr2=0x7fd2fc06c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:23.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.659+0000 7fd2fb400640 1 --2- 172.21.15.17:0/880912606 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd2fc15cbb0 0x7fd2fc06c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:23.655 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.659+0000 7fd2fb400640 1 -- 172.21.15.17:0/880912606 >> v2:172.21.15.94:3300/0 conn(0x7fd2fc0cafb0 msgr2=0x7fd2fc0cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:23.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.659+0000 7fd2fb400640 1 --2- 172.21.15.17:0/880912606 >> v2:172.21.15.94:3300/0 conn(0x7fd2fc0cafb0 0x7fd2fc0cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:23.656 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.659+0000 7fd2fb400640 1 -- 172.21.15.17:0/880912606 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2fc15cf90 con 0x7fd2fc0cdb80 2024-03-12T17:33:23.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.660+0000 7fd2fb400640 1 --2- 172.21.15.17:0/880912606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2fc0cdb80 0x7fd2fc0cdfe0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc0711c0 tx=0x7fd2e402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22dace688adfcac2 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:23.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.660+0000 7fd2faa00640 1 -- 172.21.15.17:0/880912606 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e4031870 con 0x7fd2fc0cdb80 2024-03-12T17:33:23.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.661+0000 7fd2faa00640 1 -- 172.21.15.17:0/880912606 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e40319d0 con 0x7fd2fc0cdb80 2024-03-12T17:33:23.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.661+0000 7fd2faa00640 1 -- 172.21.15.17:0/880912606 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e4031d60 con 0x7fd2fc0cdb80 2024-03-12T17:33:23.657 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.661+0000 7fd302e00640 1 -- 172.21.15.17:0/880912606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2fc0cdb80 msgr2=0x7fd2fc0cdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:23.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.661+0000 7fd302e00640 1 --2- 172.21.15.17:0/880912606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2fc0cdb80 0x7fd2fc0cdfe0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc0711c0 tx=0x7fd2e402b910 comp rx=0 tx=0).stop 2024-03-12T17:33:23.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.661+0000 7fd302e00640 1 -- 172.21.15.17:0/880912606 shutdown_connections 2024-03-12T17:33:23.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.661+0000 7fd302e00640 1 --2- 172.21.15.17:0/880912606 >> v2:172.21.15.94:3300/0 conn(0x7fd2fc0cafb0 0x7fd2fc0cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:23.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.661+0000 7fd302e00640 1 --2- 172.21.15.17:0/880912606 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2fc0cdb80 0x7fd2fc0cdfe0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:23.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.661+0000 7fd302e00640 1 --2- 172.21.15.17:0/880912606 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd2fc15cbb0 0x7fd2fc06c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:23.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.661+0000 7fd302e00640 1 -- 172.21.15.17:0/880912606 >> 172.21.15.17:0/880912606 conn(0x7fd2fc069ce0 msgr2=0x7fd2fc06a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:23.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.661+0000 7fd302e00640 1 -- 172.21.15.17:0/880912606 shutdown_connections 2024-03-12T17:33:23.658 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.662+0000 7fd302e00640 1 -- 172.21.15.17:0/880912606 wait complete. 2024-03-12T17:33:23.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.663+0000 7fd302e00640 1 Processor -- start 2024-03-12T17:33:23.659 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.663+0000 7fd302e00640 1 -- start start 2024-03-12T17:33:23.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.664+0000 7fd302e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2fc0cafb0 0x7fd2fc14d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:23.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.664+0000 7fd302e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd2fc0cdb80 0x7fd2fc1f27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:23.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.664+0000 7fd302e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2fc15cbb0 0x7fd2fc1590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:23.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.664+0000 7fd302e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc0abc00 con 0x7fd2fc0cafb0 2024-03-12T17:33:23.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.664+0000 7fd302e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc156c00 con 0x7fd2fc15cbb0 2024-03-12T17:33:23.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.664+0000 7fd302e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2fc156ea0 con 0x7fd2fc0cdb80 2024-03-12T17:33:23.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.665+0000 7fd2fbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2fc0cafb0 0x7fd2fc14d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:23.661 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.665+0000 7fd2fbe00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2fc0cafb0 0x7fd2fc14d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35576/0 (socket says 172.21.15.17:35576) 2024-03-12T17:33:23.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.665+0000 7fd2fbe00640 1 -- 172.21.15.17:0/3611742072 learned_addr learned my addr 172.21.15.17:0/3611742072 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:23.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.665+0000 7fd2fbe00640 1 -- 172.21.15.17:0/3611742072 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd2fc0cdb80 msgr2=0x7fd2fc1f27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:23.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.665+0000 7fd2fbe00640 1 --2- 172.21.15.17:0/3611742072 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7fd2fc0cdb80 0x7fd2fc1f27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:23.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.665+0000 7fd2fbe00640 1 -- 172.21.15.17:0/3611742072 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2fc15cbb0 msgr2=0x7fd2fc1590b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:23.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.665+0000 7fd300e00640 1 --2- 172.21.15.17:0/3611742072 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2fc15cbb0 0x7fd2fc1590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:23.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.665+0000 7fd2fbe00640 1 --2- 172.21.15.17:0/3611742072 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7fd2fc15cbb0 0x7fd2fc1590b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:23.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.665+0000 7fd2fbe00640 1 -- 172.21.15.17:0/3611742072 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e40094d0 con 0x7fd2fc0cafb0 2024-03-12T17:33:23.662 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.666+0000 7fd2fbe00640 1 --2- 172.21.15.17:0/3611742072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2fc0cafb0 0x7fd2fc14d2c0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fd2f4007ef0 tx=0x7fd2f400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:23.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.666+0000 7fd2f3e00640 1 -- 172.21.15.17:0/3611742072 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f4014620 con 0x7fd2fc0cafb0 2024-03-12T17:33:23.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.666+0000 7fd2f3e00640 1 -- 172.21.15.17:0/3611742072 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2f4014780 con 0x7fd2fc0cafb0 2024-03-12T17:33:23.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.666+0000 7fd302e00640 1 -- 172.21.15.17:0/3611742072 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2fc157180 con 0x7fd2fc0cafb0 2024-03-12T17:33:23.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.666+0000 7fd2f3e00640 1 -- 172.21.15.17:0/3611742072 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2f4014b30 con 0x7fd2fc0cafb0 2024-03-12T17:33:23.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.666+0000 7fd302e00640 1 -- 172.21.15.17:0/3611742072 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2fc157740 con 0x7fd2fc0cafb0 2024-03-12T17:33:23.663 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.667+0000 7fd302e00640 1 -- 172.21.15.17:0/3611742072 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd2fc0ced80 con 0x7fd2fc0cafb0 2024-03-12T17:33:23.664 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.668+0000 7fd2f3e00640 1 -- 172.21.15.17:0/3611742072 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7fd2f4014c90 con 0x7fd2fc0cafb0 2024-03-12T17:33:23.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.669+0000 7fd2f3e00640 1 --2- 172.21.15.17:0/3611742072 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd2d806ac00 0x7fd2d806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:23.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.669+0000 7fd2f3e00640 1 -- 172.21.15.17:0/3611742072 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd2f4089af0 con 0x7fd2fc0cafb0 2024-03-12T17:33:23.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.669+0000 7fd2f3e00640 1 --2- 172.21.15.17:0/3611742072 >> [v2:172.21.15.94:6800/37466,v1:172.21.15.94:6801/37466] conn(0x7fd2d8070a60 0x7fd2d8072e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:23.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.669+0000 7fd2f3e00640 1 -- 172.21.15.17:0/3611742072 --> [v2:172.21.15.94:6800/37466,v1:172.21.15.94:6801/37466] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd2d8073530 con 0x7fd2d8070a60 2024-03-12T17:33:23.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.669+0000 7fd2f3e00640 1 -- 172.21.15.17:0/3611742072 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2f408e2a0 con 0x7fd2fc0cafb0 2024-03-12T17:33:23.665 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.669+0000 7fd2fb400640 1 --2- 172.21.15.17:0/3611742072 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd2d806ac00 0x7fd2d806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:23.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.670+0000 7fd300e00640 1 --2- 172.21.15.17:0/3611742072 >> [v2:172.21.15.94:6800/37466,v1:172.21.15.94:6801/37466] conn(0x7fd2d8070a60 0x7fd2d8072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:23.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.670+0000 7fd2fb400640 1 --2- 172.21.15.17:0/3611742072 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd2d806ac00 0x7fd2d806d0c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4036000 tx=0x7fd2e4030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:23.666 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.671+0000 7fd300e00640 1 --2- 172.21.15.17:0/3611742072 >> [v2:172.21.15.94:6800/37466,v1:172.21.15.94:6801/37466] conn(0x7fd2d8070a60 0x7fd2d8072e80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:23.668 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.673+0000 7fd2f3e00640 1 -- 172.21.15.17:0/3611742072 <== osd.7 v2:172.21.15.94:6800/37466 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fd2d8073530 con 0x7fd2d8070a60 2024-03-12T17:33:23.682 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.687+0000 7fd302e00640 1 -- 172.21.15.17:0/3611742072 --> [v2:172.21.15.94:6800/37466,v1:172.21.15.94:6801/37466] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd2fc157010 con 0x7fd2d8070a60 2024-03-12T17:33:23.683 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.688+0000 7fd2f3e00640 1 -- 172.21.15.17:0/3611742072 <== osd.7 v2:172.21.15.94:6800/37466 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fd2fc157010 con 0x7fd2d8070a60 2024-03-12T17:33:23.684 INFO:teuthology.orchestra.run.smithi017.stdout:{ 2024-03-12T17:33:23.684 INFO:teuthology.orchestra.run.smithi017.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-12T17:33:23.684 INFO:teuthology.orchestra.run.smithi017.stdout:} 2024-03-12T17:33:23.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.688+0000 7fd302e00640 1 -- 172.21.15.17:0/3611742072 >> [v2:172.21.15.94:6800/37466,v1:172.21.15.94:6801/37466] conn(0x7fd2d8070a60 msgr2=0x7fd2d8072e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:23.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.688+0000 7fd302e00640 1 --2- 172.21.15.17:0/3611742072 >> [v2:172.21.15.94:6800/37466,v1:172.21.15.94:6801/37466] conn(0x7fd2d8070a60 0x7fd2d8072e80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:23.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.689+0000 7fd302e00640 1 -- 172.21.15.17:0/3611742072 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd2d806ac00 msgr2=0x7fd2d806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:23.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.689+0000 7fd302e00640 1 --2- 172.21.15.17:0/3611742072 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7fd2d806ac00 0x7fd2d806d0c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4036000 tx=0x7fd2e4030000 comp rx=0 tx=0).stop 2024-03-12T17:33:23.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.689+0000 7fd302e00640 1 -- 172.21.15.17:0/3611742072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2fc0cafb0 msgr2=0x7fd2fc14d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:23.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.689+0000 7fd302e00640 1 --2- 172.21.15.17:0/3611742072 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7fd2fc0cafb0 0x7fd2fc14d2c0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fd2f4007ef0 tx=0x7fd2f400e4b0 comp rx=0 tx=0).stop 2024-03-12T17:33:23.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.689+0000 7fd300e00640 1 -- 172.21.15.17:0/3611742072 reap_dead start 2024-03-12T17:33:23.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.689+0000 7fd302e00640 1 -- 172.21.15.17:0/3611742072 shutdown_connections 2024-03-12T17:33:23.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.689+0000 7fd302e00640 1 -- 172.21.15.17:0/3611742072 >> 172.21.15.17:0/3611742072 conn(0x7fd2fc069ce0 msgr2=0x7fd2fc072e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:23.685 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.689+0000 7fd302e00640 1 -- 172.21.15.17:0/3611742072 shutdown_connections 2024-03-12T17:33:23.686 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.689+0000 7fd302e00640 1 -- 172.21.15.17:0/3611742072 wait complete. 2024-03-12T17:33:23.701 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-03-12T17:33:23.920 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.925+0000 7f88af600640 1 Processor -- start 2024-03-12T17:33:23.921 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.925+0000 7f88af600640 1 -- start start 2024-03-12T17:33:23.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.926+0000 7f88af600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88a80d2fa0 0x7f88a80d3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:23.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.926+0000 7f88af600640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88a80d14e0 con 0x7f88a80b5f70 2024-03-12T17:33:23.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.926+0000 7f88af600640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88a80d38c0 con 0x7f88a80b5b50 2024-03-12T17:33:23.922 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.926+0000 7f88af600640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a80b59e0 con 0x7f88a80d2fa0 2024-03-12T17:33:23.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.927+0000 7f88ad600640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f88a80b5f70 0x7f88a80d1f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:34560/0 (socket says 172.21.15.17:34560) 2024-03-12T17:33:23.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.927+0000 7f88ad600640 1 -- 172.21.15.17:0/2587148542 learned_addr learned my addr 172.21.15.17:0/2587148542 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:33:23.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.927+0000 7f88acc00640 1 --2- 172.21.15.17:0/2587148542 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88a80d2fa0 0x7f88a80d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:23.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.927+0000 7f88a7400640 1 -- 172.21.15.17:0/2587148542 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2539763337 0 0) 0x7f88a80d14e0 con 0x7f88a80b5f70 2024-03-12T17:33:23.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.927+0000 7f88a7400640 1 -- 172.21.15.17:0/2587148542 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f888c003520 con 0x7f88a80b5f70 2024-03-12T17:33:23.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.928+0000 7f88a7400640 1 -- 172.21.15.17:0/2587148542 <== mon.1 v1:172.21.15.94:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1754212042 0 0) 0x7f88a80d38c0 con 0x7f88a80b5b50 2024-03-12T17:33:23.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.928+0000 7f88a7400640 1 -- 172.21.15.17:0/2587148542 --> v1:172.21.15.94:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88a80d14e0 con 0x7f88a80b5b50 2024-03-12T17:33:23.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.928+0000 7f88a7400640 1 -- 172.21.15.17:0/2587148542 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3091943157 0 0) 0x7f888c003520 con 0x7f88a80b5f70 2024-03-12T17:33:23.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.928+0000 7f88a7400640 1 -- 172.21.15.17:0/2587148542 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88a80d2fa0 msgr2=0x7f88a80d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:23.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.928+0000 7f88a7400640 1 --2- 172.21.15.17:0/2587148542 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88a80d2fa0 0x7f88a80d3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:23.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.928+0000 7f88a7400640 1 -- 172.21.15.17:0/2587148542 >> v1:172.21.15.94:6789/0 conn(0x7f88a80b5b50 legacy=0x7f88a80cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:23.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.928+0000 7f88a7400640 1 -- 172.21.15.17:0/2587148542 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a80b85b0 con 0x7f88a80b5f70 2024-03-12T17:33:23.924 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.928+0000 7f88a7400640 1 -- 172.21.15.17:0/2587148542 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7f88a0001670 con 0x7f88a80b5f70 2024-03-12T17:33:23.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.928+0000 7f88a7400640 1 -- 172.21.15.17:0/2587148542 >> v1:172.21.15.17:6789/0 conn(0x7f88a80b5f70 legacy=0x7f88a80d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:23.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.928+0000 7f88a7400640 1 --2- 172.21.15.17:0/2587148542 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f888c003b30 0x7f888c003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:23.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.928+0000 7f88a7400640 1 --2- 172.21.15.17:0/2587148542 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88a80d2fa0 0x7f888c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:23.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.928+0000 7f88a7400640 1 --2- 172.21.15.17:0/2587148542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f888c004d00 0x7f888c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:23.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.928+0000 7f88a7400640 1 -- 172.21.15.17:0/2587148542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888c00ba30 con 0x7f888c004d00 2024-03-12T17:33:23.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.928+0000 7f88a7400640 1 -- 172.21.15.17:0/2587148542 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888c00bb70 con 0x7f888c003b30 2024-03-12T17:33:23.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.928+0000 7f88a7400640 1 -- 172.21.15.17:0/2587148542 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f888c00bce0 con 0x7f88a80d2fa0 2024-03-12T17:33:23.925 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.928+0000 7f88ad600640 1 --2- 172.21.15.17:0/2587148542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f888c004d00 0x7f888c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:23.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.928+0000 7f88a7e00640 1 --2- 172.21.15.17:0/2587148542 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88a80d2fa0 0x7f888c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:23.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.928+0000 7f88acc00640 1 --2- 172.21.15.17:0/2587148542 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f888c003b30 0x7f888c003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:23.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.929+0000 7f88ad600640 1 -- 172.21.15.17:0/2587148542 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88a80d2fa0 msgr2=0x7f888c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:23.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.929+0000 7f88ad600640 1 --2- 172.21.15.17:0/2587148542 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88a80d2fa0 0x7f888c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:23.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.929+0000 7f88ad600640 1 -- 172.21.15.17:0/2587148542 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f888c003b30 msgr2=0x7f888c003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:23.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.929+0000 7f88ad600640 1 --2- 172.21.15.17:0/2587148542 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f888c003b30 0x7f888c003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:23.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.929+0000 7f88ad600640 1 -- 172.21.15.17:0/2587148542 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f888c003520 con 0x7f888c004d00 2024-03-12T17:33:23.926 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.930+0000 7f88ad600640 1 --2- 172.21.15.17:0/2587148542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f888c004d00 0x7f888c005180 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f88a000c160 tx=0x7f888c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d0dbebd6e9687eb server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:23.927 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.931+0000 7f88a7400640 1 -- 172.21.15.17:0/2587148542 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a0005ad0 con 0x7f888c004d00 2024-03-12T17:33:23.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.931+0000 7f88a7400640 1 -- 172.21.15.17:0/2587148542 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a0005c30 con 0x7f888c004d00 2024-03-12T17:33:23.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.931+0000 7f88a7400640 1 -- 172.21.15.17:0/2587148542 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a002c830 con 0x7f888c004d00 2024-03-12T17:33:23.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.931+0000 7f88af600640 1 -- 172.21.15.17:0/2587148542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f888c004d00 msgr2=0x7f888c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:23.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.931+0000 7f88af600640 1 --2- 172.21.15.17:0/2587148542 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f888c004d00 0x7f888c005180 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f88a000c160 tx=0x7f888c0057f0 comp rx=0 tx=0).stop 2024-03-12T17:33:23.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.931+0000 7f88ad600640 1 -- 172.21.15.17:0/2587148542 reap_dead start 2024-03-12T17:33:23.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.931+0000 7f88af600640 1 -- 172.21.15.17:0/2587148542 shutdown_connections 2024-03-12T17:33:23.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.931+0000 7f88af600640 1 -- 172.21.15.17:0/2587148542 >> 172.21.15.17:0/2587148542 conn(0x7f88a8065df0 msgr2=0x7f88a8066200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:23.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.932+0000 7f88af600640 1 -- 172.21.15.17:0/2587148542 shutdown_connections 2024-03-12T17:33:23.928 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.932+0000 7f88af600640 1 -- 172.21.15.17:0/2587148542 wait complete. 2024-03-12T17:33:23.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.933+0000 7f88af600640 1 Processor -- start 2024-03-12T17:33:23.929 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.933+0000 7f88af600640 1 -- start start 2024-03-12T17:33:23.931 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.934+0000 7f88af600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88a815ae10 0x7f88a80cc630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:23.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.934+0000 7f88af600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f88a80cae50 0x7f88a815f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:23.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.934+0000 7f88af600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88a815f540 0x7f88a81f2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:23.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.934+0000 7f88af600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a815b1f0 con 0x7f88a815f540 2024-03-12T17:33:23.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.934+0000 7f88af600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a815f9c0 con 0x7f88a80cae50 2024-03-12T17:33:23.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.934+0000 7f88af600640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a80ccb70 con 0x7f88a815ae10 2024-03-12T17:33:23.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.935+0000 7f88ad600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88a815f540 0x7f88a81f2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:23.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.935+0000 7f88ad600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88a815f540 0x7f88a81f2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35596/0 (socket says 172.21.15.17:35596) 2024-03-12T17:33:23.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.935+0000 7f88ad600640 1 -- 172.21.15.17:0/2385185446 learned_addr learned my addr 172.21.15.17:0/2385185446 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:23.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.935+0000 7f88a7e00640 1 --2- 172.21.15.17:0/2385185446 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f88a80cae50 0x7f88a815f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:23.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.935+0000 7f88acc00640 1 --2- 172.21.15.17:0/2385185446 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88a815ae10 0x7f88a80cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:23.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.935+0000 7f88ad600640 1 -- 172.21.15.17:0/2385185446 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88a815ae10 msgr2=0x7f88a80cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:23.932 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.935+0000 7f88ad600640 1 --2- 172.21.15.17:0/2385185446 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88a815ae10 0x7f88a80cc630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:23.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.935+0000 7f88ad600640 1 -- 172.21.15.17:0/2385185446 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f88a80cae50 msgr2=0x7f88a815f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:23.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.935+0000 7f88ad600640 1 --2- 172.21.15.17:0/2385185446 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f88a80cae50 0x7f88a815f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:23.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.935+0000 7f88ad600640 1 -- 172.21.15.17:0/2385185446 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a80c9ad0 con 0x7f88a815f540 2024-03-12T17:33:23.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.936+0000 7f88ad600640 1 --2- 172.21.15.17:0/2385185446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88a815f540 0x7f88a81f2070 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f88a000c280 tx=0x7f88a0001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:23.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.936+0000 7f88a4c00640 1 -- 172.21.15.17:0/2385185446 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a002ca30 con 0x7f88a815f540 2024-03-12T17:33:23.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.936+0000 7f88a4c00640 1 -- 172.21.15.17:0/2385185446 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a002cbb0 con 0x7f88a815f540 2024-03-12T17:33:23.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.936+0000 7f88a4c00640 1 -- 172.21.15.17:0/2385185446 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a0001bd0 con 0x7f88a815f540 2024-03-12T17:33:23.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.936+0000 7f88af600640 1 -- 172.21.15.17:0/2385185446 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88a80c9db0 con 0x7f88a815f540 2024-03-12T17:33:23.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.936+0000 7f88af600640 1 -- 172.21.15.17:0/2385185446 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88a80ca370 con 0x7f88a815f540 2024-03-12T17:33:23.933 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.937+0000 7f88af600640 1 -- 172.21.15.17:0/2385185446 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88a80736c0 con 0x7f88a815f540 2024-03-12T17:33:23.934 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.938+0000 7f88a4c00640 1 -- 172.21.15.17:0/2385185446 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f88a0032070 con 0x7f88a815f540 2024-03-12T17:33:23.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.939+0000 7f88a4c00640 1 --2- 172.21.15.17:0/2385185446 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f888406ac30 0x7f888406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:23.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.940+0000 7f88a4c00640 1 -- 172.21.15.17:0/2385185446 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f88a003c070 con 0x7f88a815f540 2024-03-12T17:33:23.935 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.940+0000 7f88acc00640 1 --2- 172.21.15.17:0/2385185446 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f888406ac30 0x7f888406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:23.936 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.941+0000 7f88acc00640 1 --2- 172.21.15.17:0/2385185446 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f888406ac30 0x7f888406d0f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f88900099e0 tx=0x7f8890008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:23.940 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:23.944+0000 7f88a4c00640 1 -- 172.21.15.17:0/2385185446 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f88a0074b60 con 0x7f88a815f540 2024-03-12T17:33:24.140 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.144+0000 7f88af600640 1 -- 172.21.15.17:0/2385185446 --> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f88a80d1a10 con 0x7f888406ac30 2024-03-12T17:33:24.141 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.145+0000 7f88a4c00640 1 -- 172.21.15.17:0/2385185446 <== mgr.4104 v2:172.21.15.17:6832/37052 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8890013960 con 0x7f888406ac30 2024-03-12T17:33:24.141 INFO:teuthology.orchestra.run.smithi017.stderr:instructed osd(s) 7 to deep-scrub 2024-03-12T17:33:24.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.148+0000 7f88af600640 1 -- 172.21.15.17:0/2385185446 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f888406ac30 msgr2=0x7f888406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:24.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.148+0000 7f88af600640 1 --2- 172.21.15.17:0/2385185446 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f888406ac30 0x7f888406d0f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f88900099e0 tx=0x7f8890008040 comp rx=0 tx=0).stop 2024-03-12T17:33:24.144 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.148+0000 7f88af600640 1 -- 172.21.15.17:0/2385185446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88a815f540 msgr2=0x7f88a81f2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:24.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.148+0000 7f88af600640 1 --2- 172.21.15.17:0/2385185446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88a815f540 0x7f88a81f2070 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f88a000c280 tx=0x7f88a0001980 comp rx=0 tx=0).stop 2024-03-12T17:33:24.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.148+0000 7f88af600640 1 -- 172.21.15.17:0/2385185446 shutdown_connections 2024-03-12T17:33:24.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.148+0000 7f88af600640 1 --2- 172.21.15.17:0/2385185446 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f888406ac30 0x7f888406d0f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:24.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.148+0000 7f88af600640 1 --2- 172.21.15.17:0/2385185446 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f88a815f540 0x7f88a81f2070 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:24.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.148+0000 7f88af600640 1 --2- 172.21.15.17:0/2385185446 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f88a80cae50 0x7f88a815f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:24.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.148+0000 7f88af600640 1 --2- 172.21.15.17:0/2385185446 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f88a815ae10 0x7f88a80cc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:24.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.148+0000 7f88af600640 1 -- 172.21.15.17:0/2385185446 >> 172.21.15.17:0/2385185446 conn(0x7f88a8065df0 msgr2=0x7f88a80d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:24.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.149+0000 7f88af600640 1 -- 172.21.15.17:0/2385185446 shutdown_connections 2024-03-12T17:33:24.145 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.149+0000 7f88af600640 1 -- 172.21.15.17:0/2385185446 wait complete. 2024-03-12T17:33:24.164 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-12T17:33:24.380 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.385+0000 7f526b600640 1 Processor -- start 2024-03-12T17:33:24.381 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.385+0000 7f526b600640 1 -- start start 2024-03-12T17:33:24.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.386+0000 7f526b600640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f5264144240 0x7f52640ce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:24.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.386+0000 7f526b600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f52640cecf0 0x7f52640b2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:24.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.386+0000 7f526b600640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f52640b25b0 0x7f52640cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:24.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.386+0000 7f526b600640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52640ce320 con 0x7f5264144240 2024-03-12T17:33:24.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.386+0000 7f526b600640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5264144620 con 0x7f52640b25b0 2024-03-12T17:33:24.382 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.386+0000 7f526b600640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f526415f3d0 con 0x7f52640cecf0 2024-03-12T17:33:24.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.386+0000 7f5268c00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f5264144240 0x7f52640ce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:24.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.387+0000 7f5268c00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f5264144240 0x7f52640ce7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35602/0 (socket says 172.21.15.17:35602) 2024-03-12T17:33:24.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.387+0000 7f5268c00640 1 -- 172.21.15.17:0/2183084238 learned_addr learned my addr 172.21.15.17:0/2183084238 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:24.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.387+0000 7f5269600640 1 --2- 172.21.15.17:0/2183084238 >> v2:172.21.15.94:3300/0 conn(0x7f52640b25b0 0x7f52640cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:24.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.387+0000 7f5263e00640 1 --2- 172.21.15.17:0/2183084238 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f52640cecf0 0x7f52640b2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:24.383 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.387+0000 7f5268c00640 1 -- 172.21.15.17:0/2183084238 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f52640cecf0 msgr2=0x7f52640b2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:24.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.387+0000 7f5268c00640 1 --2- 172.21.15.17:0/2183084238 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f52640cecf0 0x7f52640b2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:24.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.387+0000 7f5268c00640 1 -- 172.21.15.17:0/2183084238 >> v2:172.21.15.94:3300/0 conn(0x7f52640b25b0 msgr2=0x7f52640cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:24.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.387+0000 7f5268c00640 1 --2- 172.21.15.17:0/2183084238 >> v2:172.21.15.94:3300/0 conn(0x7f52640b25b0 0x7f52640cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:24.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.387+0000 7f5268c00640 1 -- 172.21.15.17:0/2183084238 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52640cd9f0 con 0x7f5264144240 2024-03-12T17:33:24.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.387+0000 7f5269600640 1 --2- 172.21.15.17:0/2183084238 >> v2:172.21.15.94:3300/0 conn(0x7f52640b25b0 0x7f52640cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:33:24.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.387+0000 7f5263e00640 1 --2- 172.21.15.17:0/2183084238 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f52640cecf0 0x7f52640b2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-12T17:33:24.384 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.389+0000 7f5268c00640 1 --2- 172.21.15.17:0/2183084238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5264144240 0x7f52640ce7b0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f5254009870 tx=0x7f525402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd67f54ab295bc47 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:24.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.389+0000 7f5263400640 1 -- 172.21.15.17:0/2183084238 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5254031640 con 0x7f5264144240 2024-03-12T17:33:24.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.389+0000 7f5263400640 1 -- 172.21.15.17:0/2183084238 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52540317a0 con 0x7f5264144240 2024-03-12T17:33:24.385 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.389+0000 7f5263400640 1 -- 172.21.15.17:0/2183084238 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5254031b30 con 0x7f5264144240 2024-03-12T17:33:24.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.390+0000 7f526b600640 1 -- 172.21.15.17:0/2183084238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5264144240 msgr2=0x7f52640ce7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:24.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.390+0000 7f526b600640 1 --2- 172.21.15.17:0/2183084238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5264144240 0x7f52640ce7b0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f5254009870 tx=0x7f525402b8f0 comp rx=0 tx=0).stop 2024-03-12T17:33:24.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.390+0000 7f526b600640 1 -- 172.21.15.17:0/2183084238 shutdown_connections 2024-03-12T17:33:24.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.390+0000 7f526b600640 1 --2- 172.21.15.17:0/2183084238 >> v2:172.21.15.94:3300/0 conn(0x7f52640b25b0 0x7f52640cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:24.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.390+0000 7f526b600640 1 --2- 172.21.15.17:0/2183084238 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f52640cecf0 0x7f52640b2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:24.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.390+0000 7f526b600640 1 --2- 172.21.15.17:0/2183084238 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5264144240 0x7f52640ce7b0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:24.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.390+0000 7f526b600640 1 -- 172.21.15.17:0/2183084238 >> 172.21.15.17:0/2183084238 conn(0x7f5264069ce0 msgr2=0x7f526406a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:24.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.390+0000 7f526b600640 1 -- 172.21.15.17:0/2183084238 shutdown_connections 2024-03-12T17:33:24.386 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.390+0000 7f526b600640 1 -- 172.21.15.17:0/2183084238 wait complete. 2024-03-12T17:33:24.387 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.392+0000 7f526b600640 1 Processor -- start 2024-03-12T17:33:24.388 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.392+0000 7f526b600640 1 -- start start 2024-03-12T17:33:24.389 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.393+0000 7f526b600640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f52640b25b0 0x7f526406cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:24.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.393+0000 7f526b600640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f52640cecf0 0x7f52640b0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:24.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.393+0000 7f526b600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5264144240 0x7f526415e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:24.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.393+0000 7f526b600640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f526406dd30 con 0x7f5264144240 2024-03-12T17:33:24.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.393+0000 7f526b600640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52640b0c90 con 0x7f52640b25b0 2024-03-12T17:33:24.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.393+0000 7f526b600640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f526406d490 con 0x7f52640cecf0 2024-03-12T17:33:24.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.393+0000 7f5269600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5264144240 0x7f526415e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:24.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.393+0000 7f5269600640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5264144240 0x7f526415e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:35614/0 (socket says 172.21.15.17:35614) 2024-03-12T17:33:24.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.393+0000 7f5269600640 1 -- 172.21.15.17:0/3171479838 learned_addr learned my addr 172.21.15.17:0/3171479838 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:24.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.394+0000 7f5268c00640 1 --2- 172.21.15.17:0/3171479838 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f52640b25b0 0x7f526406cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:24.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.394+0000 7f5263e00640 1 --2- 172.21.15.17:0/3171479838 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f52640cecf0 0x7f52640b0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:24.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.394+0000 7f5269600640 1 -- 172.21.15.17:0/3171479838 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f52640cecf0 msgr2=0x7f52640b0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:24.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.394+0000 7f5269600640 1 --2- 172.21.15.17:0/3171479838 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f52640cecf0 0x7f52640b0750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:24.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.394+0000 7f5269600640 1 -- 172.21.15.17:0/3171479838 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f52640b25b0 msgr2=0x7f526406cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:24.390 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.394+0000 7f5269600640 1 --2- 172.21.15.17:0/3171479838 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f52640b25b0 0x7f526406cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:24.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.394+0000 7f5269600640 1 -- 172.21.15.17:0/3171479838 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52540094d0 con 0x7f5264144240 2024-03-12T17:33:24.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.394+0000 7f5269600640 1 --2- 172.21.15.17:0/3171479838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5264144240 0x7f526415e7e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f525c00cd50 tx=0x7f525c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:24.391 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.394+0000 7f5260c00640 1 -- 172.21.15.17:0/3171479838 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525c00f680 con 0x7f5264144240 2024-03-12T17:33:24.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.394+0000 7f5260c00640 1 -- 172.21.15.17:0/3171479838 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525c00f800 con 0x7f5264144240 2024-03-12T17:33:24.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.394+0000 7f5260c00640 1 -- 172.21.15.17:0/3171479838 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525c00fbb0 con 0x7f5264144240 2024-03-12T17:33:24.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.395+0000 7f526b600640 1 -- 172.21.15.17:0/3171479838 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f526406d770 con 0x7f5264144240 2024-03-12T17:33:24.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.395+0000 7f526b600640 1 -- 172.21.15.17:0/3171479838 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52641f3000 con 0x7f5264144240 2024-03-12T17:33:24.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.396+0000 7f526b600640 1 -- 172.21.15.17:0/3171479838 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52640736c0 con 0x7f5264144240 2024-03-12T17:33:24.392 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.397+0000 7f5260c00640 1 -- 172.21.15.17:0/3171479838 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f525c00b040 con 0x7f5264144240 2024-03-12T17:33:24.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.397+0000 7f5260c00640 1 --2- 172.21.15.17:0/3171479838 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f524406ac00 0x7f524406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:24.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.398+0000 7f5260c00640 1 -- 172.21.15.17:0/3171479838 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f525c089a40 con 0x7f5264144240 2024-03-12T17:33:24.393 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.398+0000 7f5268c00640 1 --2- 172.21.15.17:0/3171479838 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f524406ac00 0x7f524406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:24.394 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.399+0000 7f5268c00640 1 --2- 172.21.15.17:0/3171479838 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f524406ac00 0x7f524406d0c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5254036000 tx=0x7f525403c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:24.397 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.402+0000 7f5260c00640 1 -- 172.21.15.17:0/3171479838 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f525c054f10 con 0x7f5264144240 2024-03-12T17:33:24.593 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.597+0000 7f526b600640 1 -- 172.21.15.17:0/3171479838 --> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f52640cdfb0 con 0x7f524406ac00 2024-03-12T17:33:24.595 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.599+0000 7f5260c00640 1 -- 172.21.15.17:0/3171479838 <== mgr.4104 v2:172.21.15.17:6832/37052 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+47890 (secure 0 0 0) 0x7f5254044400 con 0x7f524406ac00 2024-03-12T17:33:24.596 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:33:24.596 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-03-12T17:33:24.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.603+0000 7f526b600640 1 -- 172.21.15.17:0/3171479838 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f524406ac00 msgr2=0x7f524406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:24.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.603+0000 7f526b600640 1 --2- 172.21.15.17:0/3171479838 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f524406ac00 0x7f524406d0c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5254036000 tx=0x7f525403c040 comp rx=0 tx=0).stop 2024-03-12T17:33:24.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.603+0000 7f526b600640 1 -- 172.21.15.17:0/3171479838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5264144240 msgr2=0x7f526415e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:24.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.603+0000 7f526b600640 1 --2- 172.21.15.17:0/3171479838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5264144240 0x7f526415e7e0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f525c00cd50 tx=0x7f525c00a650 comp rx=0 tx=0).stop 2024-03-12T17:33:24.599 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.604+0000 7f526b600640 1 -- 172.21.15.17:0/3171479838 shutdown_connections 2024-03-12T17:33:24.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.604+0000 7f526b600640 1 --2- 172.21.15.17:0/3171479838 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f524406ac00 0x7f524406d0c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:24.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.604+0000 7f526b600640 1 --2- 172.21.15.17:0/3171479838 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f5264144240 0x7f526415e7e0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:24.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.604+0000 7f526b600640 1 --2- 172.21.15.17:0/3171479838 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f52640cecf0 0x7f52640b0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:24.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.604+0000 7f526b600640 1 --2- 172.21.15.17:0/3171479838 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f52640b25b0 0x7f526406cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:24.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.604+0000 7f526b600640 1 -- 172.21.15.17:0/3171479838 >> 172.21.15.17:0/3171479838 conn(0x7f5264069ce0 msgr2=0x7f5264142320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:24.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.604+0000 7f526b600640 1 -- 172.21.15.17:0/3171479838 shutdown_connections 2024-03-12T17:33:24.600 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:24.604+0000 7f526b600640 1 -- 172.21.15.17:0/3171479838 wait complete. 2024-03-12T17:33:24.617 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":488,"stamp":"2024-03-12T17:33:23.794106+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":263156,"kb_used_data":6024,"kb_used_omap":13,"kb_used_meta":257010,"kb_avail":754711564,"statfs":{"total":773094113280,"available":772824641536,"internally_reserved":0,"allocated":6168576,"data_stored":3219712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":263178328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.863888"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":195,"reported_epoch":50,"state":"active+clean","last_fresh":"2024-03-12T17:33:08.851398+0000","last_change":"2024-03-12T17:18:41.331756+0000","last_active":"2024-03-12T17:33:08.851398+0000","last_peered":"2024-03-12T17:33:08.851398+0000","last_clean":"2024-03-12T17:33:08.851398+0000","last_became_active":"2024-03-12T17:18:41.329237+0000","last_became_peered":"2024-03-12T17:18:41.329237+0000","last_unstale":"2024-03-12T17:33:08.851398+0000","last_undegraded":"2024-03-12T17:33:08.851398+0000","last_fullsized":"2024-03-12T17:33:08.851398+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T17:18:40.152422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T17:18:40.152422+0000","last_clean_scrub_stamp":"2024-03-12T17:18:40.152422+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-13T23:35:43.664403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575028,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36400,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335440,"statfs":{"total":96636764160,"available":96599490560,"internally_reserved":0,"allocated":1216512,"data_stored":845240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.006,"15min":1.0369999999999999},"min":{"1min":0.67800000000000005,"5min":0.61699999999999999,"15min":0.48099999999999998},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":2.3730000000000002},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.038,"5min":1.0289999999999999,"15min":1.0369999999999999},"min":{"1min":0.67700000000000005,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.494,"5min":1.5469999999999999,"15min":2.2330000000000001},"last":0.88300000000000001}]},{"osd":1,"last update":"Tue Mar 12 17:33:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0129999999999999,"15min":1.02},"min":{"1min":0.753,"5min":0.67200000000000004,"15min":0.52200000000000002},"max":{"1min":1.5,"5min":1.5,"15min":1.7050000000000001},"last":1.054},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.111,"15min":1.123},"min":{"1min":0.73999999999999999,"5min":0.72699999999999998,"15min":0.61299999999999999},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":2.363},"last":1.0009999999999999}]},{"osd":2,"last update":"Tue Mar 12 17:33:06 2024","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.171,"15min":1.179},"min":{"1min":0.747,"5min":0.68100000000000005,"15min":0.60799999999999998},"max":{"1min":1.4339999999999999,"5min":1.655,"15min":1.827},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.22,"15min":1.2290000000000001},"min":{"1min":0.92500000000000004,"5min":0.83999999999999997,"15min":0.625},"max":{"1min":1.6379999999999999,"5min":1.7949999999999999,"15min":2.0870000000000002},"last":1.323}]},{"osd":3,"last update":"Tue Mar 12 17:33:06 2024","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.2010000000000001,"15min":1.212},"min":{"1min":0.871,"5min":0.70699999999999996,"15min":0.55800000000000005},"max":{"1min":1.4710000000000001,"5min":1.722,"15min":1.921},"last":1.103},{"interface":"front","average":{"1min":1.216,"5min":1.2709999999999999,"15min":1.2669999999999999},"min":{"1min":0.89300000000000002,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.4870000000000001,"5min":1.738,"15min":2.1499999999999999},"last":1.4019999999999999}]},{"osd":4,"last update":"Tue Mar 12 17:33:06 2024","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.1739999999999999,"15min":1.1990000000000001},"min":{"1min":0.79600000000000004,"5min":0.71299999999999997,"15min":0.51400000000000001},"max":{"1min":1.635,"5min":1.635,"15min":2.2349999999999999},"last":1.153},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.351,"15min":1.381},"min":{"1min":1.105,"5min":0.84799999999999998,"15min":0.63700000000000001},"max":{"1min":1.635,"5min":1.786,"15min":2.2490000000000001},"last":1.2809999999999999}]},{"osd":5,"last update":"Tue Mar 12 17:33:06 2024","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.2969999999999999,"15min":1.3109999999999999},"min":{"1min":0.84699999999999998,"5min":0.66600000000000004,"15min":0.53100000000000003},"max":{"1min":1.615,"5min":1.833,"15min":2.323},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.427,"5min":1.379,"15min":1.4279999999999999},"min":{"1min":1.1200000000000001,"5min":0.85499999999999998,"15min":0.61099999999999999},"max":{"1min":1.8140000000000001,"5min":1.8140000000000001,"15min":3.9689999999999999},"last":1.3720000000000001}]},{"osd":6,"last update":"Tue Mar 12 17:33:06 2024","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.425,"15min":1.462},"min":{"1min":1.2130000000000001,"5min":0.94399999999999995,"15min":0.69999999999999996},"max":{"1min":1.722,"5min":1.8340000000000001,"15min":3.8319999999999999},"last":1.254},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.4019999999999999,"15min":1.429},"min":{"1min":0.99099999999999999,"5min":0.627,"15min":0.55100000000000005},"max":{"1min":1.6379999999999999,"5min":1.891,"15min":2.4609999999999999},"last":1.4650000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575027,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31724,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340116,"statfs":{"total":96636764160,"available":96604278784,"internally_reserved":0,"allocated":622592,"data_stored":254872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.101,"15min":1.0629999999999999},"min":{"1min":0.72399999999999998,"5min":0.68600000000000005,"15min":0.54400000000000004},"max":{"1min":1.556,"5min":1.71,"15min":3.5390000000000001},"last":1.29},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.085,"15min":1.0569999999999999},"min":{"1min":0.80400000000000005,"5min":0.65700000000000003,"15min":0.60899999999999999},"max":{"1min":1.5269999999999999,"5min":1.6220000000000001,"15min":1.73},"last":1.248}]},{"osd":1,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.2789999999999999,"15min":1.2330000000000001},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.33900000000000002},"max":{"1min":1.5680000000000001,"5min":1.778,"15min":6.7450000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.2889999999999999,"15min":1.2769999999999999},"min":{"1min":0.89900000000000002,"5min":0.73199999999999998,"15min":0.70199999999999996},"max":{"1min":1.681,"5min":1.734,"15min":4.1909999999999998},"last":1.1639999999999999}]},{"osd":2,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.2689999999999999,"15min":1.2410000000000001},"min":{"1min":0.93400000000000005,"5min":0.83899999999999997,"15min":0.41299999999999998},"max":{"1min":1.512,"5min":1.6799999999999999,"15min":6.6879999999999997},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.3149999999999999,"15min":1.3},"min":{"1min":1.181,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.6899999999999999,"5min":1.8240000000000001,"15min":2.9689999999999999},"last":1.3700000000000001}]},{"osd":3,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.2390000000000001,"15min":1.2050000000000001},"min":{"1min":0.72999999999999998,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.546,"5min":1.6759999999999999,"15min":1.7749999999999999},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.248,"5min":1.254,"15min":1.246},"min":{"1min":0.86399999999999999,"5min":0.73899999999999999,"15min":0.46200000000000002},"max":{"1min":1.48,"5min":1.7170000000000001,"15min":6.6070000000000002},"last":0.99199999999999999}]},{"osd":4,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.244,"15min":1.256},"min":{"1min":0.91000000000000003,"5min":0.80100000000000005,"15min":0.68300000000000005},"max":{"1min":1.605,"5min":1.6950000000000001,"15min":2.2130000000000001},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.2669999999999999,"15min":1.256},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.59499999999999997},"max":{"1min":1.7849999999999999,"5min":1.976,"15min":1.976},"last":1.5900000000000001}]},{"osd":5,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.3959999999999999,"15min":1.3959999999999999},"min":{"1min":1.2010000000000001,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":2.0649999999999999,"5min":2.0649999999999999,"15min":2.8660000000000001},"last":1.6519999999999999},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3680000000000001,"15min":1.373},"min":{"1min":1,"5min":0.88,"15min":0.51900000000000002},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":6.4939999999999998},"last":1.0940000000000001}]},{"osd":7,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.4279999999999999,"15min":1.454},"min":{"1min":1.1559999999999999,"5min":0.92000000000000004,"15min":0.64000000000000001},"max":{"1min":1.978,"5min":1.978,"15min":2.2069999999999999},"last":1.5149999999999999},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.5449999999999999,"15min":1.5289999999999999},"min":{"1min":1.319,"5min":1.016,"15min":0.77500000000000002},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.258},"last":1.8540000000000001}]}]},{"osd":5,"up_from":13,"seq":55834575028,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31728,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":622592,"data_stored":254872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.0629999999999999,"15min":1.111},"min":{"1min":0.66100000000000003,"5min":0.60599999999999998,"15min":0.56399999999999995},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":2.161},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.099,"5min":1.1140000000000001,"15min":1.145},"min":{"1min":0.72199999999999998,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.3899999999999999,"5min":1.5149999999999999,"15min":1.95},"last":1.413}]},{"osd":1,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1279999999999999,"15min":1.1359999999999999},"min":{"1min":0.75,"5min":0.70499999999999996,"15min":0.69199999999999995},"max":{"1min":1.496,"5min":1.698,"15min":1.75},"last":0.63},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1779999999999999,"15min":1.222},"min":{"1min":0.82799999999999996,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":2.5699999999999998},"last":0.86199999999999999}]},{"osd":2,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.212,"15min":1.234},"min":{"1min":0.96799999999999997,"5min":0.76000000000000001,"15min":0.71599999999999997},"max":{"1min":1.6220000000000001,"5min":1.7190000000000001,"15min":2.613},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.226,"15min":1.2310000000000001},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.524,"5min":1.897,"15min":2.359},"last":0.752}]},{"osd":3,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2569999999999999,"15min":1.3089999999999999},"min":{"1min":0.77900000000000003,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.4930000000000001,"5min":1.75,"15min":2.6829999999999998},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.26,"5min":1.3,"15min":1.3280000000000001},"min":{"1min":0.90900000000000003,"5min":0.874,"15min":0.80500000000000005},"max":{"1min":1.5720000000000001,"5min":1.724,"15min":2.3559999999999999},"last":1.546}]},{"osd":4,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2,"15min":1.248},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.73699999999999999},"max":{"1min":1.655,"5min":1.6719999999999999,"15min":2.0510000000000002},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.306,"15min":1.361},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.76700000000000002},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":2.3999999999999999},"last":1.147}]},{"osd":6,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.3160000000000001,"15min":1.375},"min":{"1min":0.91700000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.718,"5min":1.75,"15min":2.488},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.365,"15min":1.4179999999999999},"min":{"1min":1.1719999999999999,"5min":0.97199999999999998,"15min":0.66100000000000003},"max":{"1min":1.601,"5min":1.7949999999999999,"15min":2.2759999999999998},"last":0.98099999999999998}]},{"osd":7,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.413,"15min":1.4950000000000001},"min":{"1min":0.97799999999999998,"5min":0.95299999999999996,"15min":0.95299999999999996},"max":{"1min":1.696,"5min":1.7470000000000001,"15min":2.8700000000000001},"last":1.266},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.47,"15min":1.5249999999999999},"min":{"1min":1.073,"5min":0.87,"15min":0.87},"max":{"1min":1.72,"5min":1.833,"15min":2.722},"last":1.6379999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575028,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31728,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":622592,"data_stored":254872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1259999999999999,"15min":1.091},"min":{"1min":0.70099999999999996,"5min":0.67300000000000004,"15min":0.60799999999999998},"max":{"1min":1.679,"5min":1.7330000000000001,"15min":4.8979999999999997},"last":0.752},{"interface":"front","average":{"1min":0.996,"5min":1.073,"15min":1.0900000000000001},"min":{"1min":0.73299999999999998,"5min":0.67900000000000005,"15min":0.57699999999999996},"max":{"1min":1.4410000000000001,"5min":1.659,"15min":4.8300000000000001},"last":1.147}]},{"osd":1,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1359999999999999,"15min":1.1339999999999999},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.64100000000000001},"max":{"1min":1.609,"5min":1.647,"15min":4.7779999999999996},"last":0.997},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.2070000000000001,"15min":1.161},"min":{"1min":0.82299999999999995,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.6100000000000001,"5min":1.887,"15min":1.911},"last":1.1930000000000001}]},{"osd":2,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.2569999999999999,"15min":1.226},"min":{"1min":0.88,"5min":0.65800000000000003,"15min":0.60199999999999998},"max":{"1min":1.5409999999999999,"5min":1.6870000000000001,"15min":1.7450000000000001},"last":1.486},{"interface":"front","average":{"1min":1.351,"5min":1.3340000000000001,"15min":1.3049999999999999},"min":{"1min":1.028,"5min":0.81899999999999995,"15min":0.78500000000000003},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":2.3220000000000001},"last":1.0800000000000001}]},{"osd":3,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.2310000000000001,"15min":1.24},"min":{"1min":0.90200000000000002,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.444,"5min":1.78,"15min":1.7949999999999999},"last":1.407},{"interface":"front","average":{"1min":1.232,"5min":1.2310000000000001,"15min":1.2290000000000001},"min":{"1min":0.90500000000000003,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.581,"5min":1.7130000000000001,"15min":1.9119999999999999},"last":1.6830000000000001}]},{"osd":5,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.3300000000000001,"15min":1.325},"min":{"1min":0.93400000000000005,"5min":0.83299999999999996,"15min":0.60499999999999998},"max":{"1min":1.766,"5min":1.766,"15min":2.1589999999999998},"last":1.321},{"interface":"front","average":{"1min":1.49,"5min":1.4159999999999999,"15min":1.3899999999999999},"min":{"1min":0.85999999999999999,"5min":0.79600000000000004,"15min":0.76700000000000002},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":2.5390000000000001},"last":1.3759999999999999}]},{"osd":6,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.248,"15min":1.264},"min":{"1min":0.86299999999999999,"5min":0.81599999999999995,"15min":0.65900000000000003},"max":{"1min":1.5880000000000001,"5min":1.8009999999999999,"15min":1.885},"last":1.571},{"interface":"front","average":{"1min":1.508,"5min":1.3999999999999999,"15min":1.3919999999999999},"min":{"1min":1.0649999999999999,"5min":0.83299999999999996,"15min":0.63300000000000001},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.4750000000000001},"last":1.617}]},{"osd":7,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.3979999999999999,"15min":1.4079999999999999},"min":{"1min":1.159,"5min":0.97799999999999998,"15min":0.56299999999999994},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":2.1200000000000001},"last":1.5509999999999999},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.427,"15min":1.425},"min":{"1min":0.97799999999999998,"5min":0.96999999999999997,"15min":0.67600000000000005},"max":{"1min":1.72,"5min":1.9199999999999999,"15min":2.4260000000000002},"last":1.7509999999999999}]}]},{"osd":3,"up_from":13,"seq":55834575028,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35820,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336020,"statfs":{"total":96636764160,"available":96600084480,"internally_reserved":0,"allocated":622592,"data_stored":254872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.84999999999999998,"15min":0.88300000000000001},"min":{"1min":0.51000000000000001,"5min":0.432,"15min":0.35099999999999998},"max":{"1min":1.306,"5min":1.5189999999999999,"15min":2.9580000000000002},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.995,"5min":0.93999999999999995,"15min":0.95699999999999996},"min":{"1min":0.67800000000000005,"5min":0.55800000000000005,"15min":0.48199999999999998},"max":{"1min":1.401,"5min":1.651,"15min":3.9940000000000002},"last":0.91700000000000004}]},{"osd":1,"last update":"Tue Mar 12 17:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.89700000000000002,"15min":0.91900000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.38600000000000001},"max":{"1min":1.4019999999999999,"5min":1.5940000000000001,"15min":4.774},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0449999999999999,"15min":1.0720000000000001},"min":{"1min":0.60599999999999998,"5min":0.58499999999999996,"15min":0.40999999999999998},"max":{"1min":1.647,"5min":1.647,"15min":5.0069999999999997},"last":1.113}]},{"osd":2,"last update":"Tue Mar 12 17:32:56 2024","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.135,"15min":1.155},"min":{"1min":0.78200000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":2.4660000000000002},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.2250000000000001,"15min":1.2709999999999999},"min":{"1min":0.70499999999999996,"5min":0.57399999999999995,"15min":0.439},"max":{"1min":1.6020000000000001,"5min":1.7509999999999999,"15min":4.5650000000000004},"last":1.591}]},{"osd":4,"last update":"Tue Mar 12 17:32:56 2024","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.24,"15min":1.272},"min":{"1min":0.84899999999999998,"5min":0.80700000000000005,"15min":0.67200000000000004},"max":{"1min":1.74,"5min":1.74,"15min":2.8860000000000001},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2390000000000001,"15min":1.28},"min":{"1min":0.88300000000000001,"5min":0.80800000000000005,"15min":0.73399999999999999},"max":{"1min":1.546,"5min":1.6259999999999999,"15min":4.3520000000000003},"last":1.395}]},{"osd":5,"last update":"Tue Mar 12 17:32:56 2024","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.339,"15min":1.3500000000000001},"min":{"1min":0.91500000000000004,"5min":0.84799999999999998,"15min":0.76200000000000001},"max":{"1min":1.649,"5min":1.9059999999999999,"15min":2.843},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.389,"5min":1.3069999999999999,"15min":1.3320000000000001},"min":{"1min":0.96299999999999997,"5min":0.81399999999999995,"15min":0.68300000000000005},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.8149999999999999},"last":1.639}]},{"osd":6,"last update":"Tue Mar 12 17:32:56 2024","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.4059999999999999,"15min":1.4379999999999999},"min":{"1min":1.1359999999999999,"5min":0.79600000000000004,"15min":0.71699999999999997},"max":{"1min":1.7509999999999999,"5min":2.0299999999999998,"15min":2.9199999999999999},"last":1.5640000000000001},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4039999999999999,"15min":1.423},"min":{"1min":1.0329999999999999,"5min":0.878,"15min":0.86399999999999999},"max":{"1min":1.982,"5min":1.982,"15min":2.6589999999999998},"last":1.746}]},{"osd":7,"last update":"Tue Mar 12 17:32:56 2024","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.351,"15min":1.3959999999999999},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.83899999999999997},"max":{"1min":1.661,"5min":1.7450000000000001,"15min":4.6600000000000001},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.4350000000000001,"15min":1.4670000000000001},"min":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.76800000000000002},"max":{"1min":1.7529999999999999,"5min":1.8240000000000001,"15min":4.4720000000000004},"last":1.532}]}]},{"osd":2,"up_from":13,"seq":55834575028,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31728,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":622592,"data_stored":254872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.97299999999999998,"15min":0.95499999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.40000000000000002},"max":{"1min":1.3540000000000001,"5min":2.097,"15min":3.1829999999999998},"last":0.58099999999999996},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0960000000000001,"15min":1.0800000000000001},"min":{"1min":0.66800000000000004,"5min":0.63400000000000001,"15min":0.50700000000000001},"max":{"1min":1.532,"5min":1.694,"15min":2.8199999999999998},"last":0.86199999999999999}]},{"osd":1,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":0.94199999999999995,"15min":0.94099999999999995},"min":{"1min":0.69199999999999995,"5min":0.49099999999999999,"15min":0.308},"max":{"1min":1.9259999999999999,"5min":2.0529999999999999,"15min":2.7360000000000002},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.119,"15min":1.099},"min":{"1min":0.621,"5min":0.621,"15min":0.44700000000000001},"max":{"1min":1.583,"5min":2.2010000000000001,"15min":3.1019999999999999},"last":0.96299999999999997}]},{"osd":3,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.117,"15min":1.1160000000000001},"min":{"1min":0.72599999999999998,"5min":0.629,"15min":0.45000000000000001},"max":{"1min":1.6020000000000001,"5min":1.883,"15min":2.7810000000000001},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2270000000000001,"15min":1.2130000000000001},"min":{"1min":0.76500000000000001,"5min":0.66900000000000004,"15min":0.48299999999999998},"max":{"1min":1.5920000000000001,"5min":1.758,"15min":3.1419999999999999},"last":1.097}]},{"osd":4,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.3420000000000001,"15min":1.3919999999999999},"min":{"1min":0.92900000000000005,"5min":0.86699999999999999,"15min":0.76100000000000001},"max":{"1min":1.7,"5min":1.9450000000000001,"15min":7.96},"last":1.224},{"interface":"front","average":{"1min":1.282,"5min":1.266,"15min":1.2789999999999999},"min":{"1min":0.82299999999999995,"5min":0.78800000000000003,"15min":0.67700000000000005},"max":{"1min":1.7210000000000001,"5min":1.806,"15min":3.3780000000000001},"last":1.5860000000000001}]},{"osd":5,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.333,"15min":1.351},"min":{"1min":0.91800000000000004,"5min":0.89000000000000001,"15min":0.70399999999999996},"max":{"1min":1.8839999999999999,"5min":1.9059999999999999,"15min":4.0659999999999998},"last":1.653},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3320000000000001,"15min":1.3700000000000001},"min":{"1min":0.98599999999999999,"5min":0.86699999999999999,"15min":0.63800000000000001},"max":{"1min":1.649,"5min":1.929,"15min":3.012},"last":1.1739999999999999}]},{"osd":6,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.393,"15min":1.4019999999999999},"min":{"1min":1.1459999999999999,"5min":0.86599999999999999,"15min":0.74099999999999999},"max":{"1min":1.7729999999999999,"5min":2.1099999999999999,"15min":3.2330000000000001},"last":1.258},{"interface":"front","average":{"1min":1.389,"5min":1.4870000000000001,"15min":1.5169999999999999},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.68899999999999995},"max":{"1min":1.802,"5min":2.4100000000000001,"15min":7.9059999999999997},"last":1.391}]},{"osd":7,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.423,"15min":1.4299999999999999},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.64700000000000002},"max":{"1min":1.8420000000000001,"5min":2.0529999999999999,"15min":4.0229999999999997},"last":1.504},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4750000000000001,"15min":1.4950000000000001},"min":{"1min":1.0509999999999999,"5min":0.95099999999999996,"15min":0.84499999999999997},"max":{"1min":1.885,"5min":2.0950000000000002,"15min":3.27},"last":1.3089999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575028,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31724,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340116,"statfs":{"total":96636764160,"available":96604278784,"internally_reserved":0,"allocated":622592,"data_stored":254872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.89800000000000002,"15min":0.88800000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.29,"5min":1.6699999999999999,"15min":1.7749999999999999},"last":1.052},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.0149999999999999,"15min":1.0449999999999999},"min":{"1min":0.60999999999999999,"5min":0.59399999999999997,"15min":0.47499999999999998},"max":{"1min":1.76,"5min":1.869,"15min":7.6449999999999996},"last":0.71899999999999997}]},{"osd":2,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.97099999999999997,"15min":0.95199999999999996},"min":{"1min":0.628,"5min":0.53200000000000003,"15min":0.40799999999999997},"max":{"1min":1.272,"5min":1.7629999999999999,"15min":1.9299999999999999},"last":1.179},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.095,"15min":1.0669999999999999},"min":{"1min":0.58799999999999997,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.325,"5min":1.708,"15min":2.5720000000000001},"last":1.23}]},{"osd":3,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.208,"15min":1.242},"min":{"1min":0.625,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.681,"5min":1.875,"15min":2.4580000000000002},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.02,"5min":1.155,"15min":1.1599999999999999},"min":{"1min":0.56399999999999995,"5min":0.501,"15min":0.42499999999999999},"max":{"1min":1.502,"5min":1.8460000000000001,"15min":3.319},"last":0.95499999999999996}]},{"osd":4,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.246,"15min":1.2350000000000001},"min":{"1min":0.77400000000000002,"5min":0.70799999999999996,"15min":0.63300000000000001},"max":{"1min":1.5700000000000001,"5min":1.9039999999999999,"15min":2.4580000000000002},"last":1.3720000000000001},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.363,"15min":1.355},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.70999999999999996},"max":{"1min":1.599,"5min":2.0680000000000001,"15min":2.6909999999999998},"last":1.3420000000000001}]},{"osd":5,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.3740000000000001,"15min":1.3660000000000001},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.67200000000000004},"max":{"1min":1.629,"5min":1.9650000000000001,"15min":3.0609999999999999},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3440000000000001,"15min":1.353},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.73299999999999998},"max":{"1min":1.8169999999999999,"5min":1.9339999999999999,"15min":2.4169999999999998},"last":1.306}]},{"osd":6,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.4419999999999999,"15min":1.4299999999999999},"min":{"1min":0.752,"5min":0.752,"15min":0.70099999999999996},"max":{"1min":1.9139999999999999,"5min":2.137,"15min":3.1030000000000002},"last":1.397},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.405,"15min":1.4059999999999999},"min":{"1min":0.874,"5min":0.874,"15min":0.82999999999999996},"max":{"1min":1.7509999999999999,"5min":2.0219999999999998,"15min":2.274},"last":1.425}]},{"osd":7,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.4950000000000001,"15min":1.47},"min":{"1min":1.129,"5min":0.85799999999999998,"15min":0.70899999999999996},"max":{"1min":1.7030000000000001,"5min":2.1659999999999999,"15min":2.7959999999999998},"last":1.5189999999999999},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.5389999999999999,"15min":1.518},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.73,"5min":2.2509999999999999,"15min":3.1440000000000001},"last":1.4870000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575027,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1216512,"data_stored":845240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.92100000000000004,"15min":0.92900000000000005},"min":{"1min":0.71899999999999997,"5min":0.46000000000000002,"15min":0.41799999999999998},"max":{"1min":1.45,"5min":1.829,"15min":1.829},"last":0.64300000000000002},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0469999999999999,"15min":1.028},"min":{"1min":0.54700000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.504,"5min":1.8280000000000001,"15min":2.3740000000000001},"last":0.98399999999999999}]},{"osd":2,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.054,"15min":1.056},"min":{"1min":0.80200000000000005,"5min":0.56999999999999995,"15min":0.52300000000000002},"max":{"1min":1.528,"5min":1.792,"15min":1.99},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.089,"5min":1.105,"15min":1.1000000000000001},"min":{"1min":0.621,"5min":0.51200000000000001,"15min":0.45500000000000002},"max":{"1min":1.591,"5min":1.752,"15min":2.468},"last":1.212}]},{"osd":3,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.002,"15min":1.016},"min":{"1min":0.58299999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.5449999999999999,"5min":1.8340000000000001,"15min":2.085},"last":0.749},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.234,"15min":1.2310000000000001},"min":{"1min":0.73099999999999998,"5min":0.63800000000000001,"15min":0.56899999999999995},"max":{"1min":1.6479999999999999,"5min":1.78,"15min":2.286},"last":1.0329999999999999}]},{"osd":4,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2390000000000001,"15min":1.262},"min":{"1min":0.94999999999999996,"5min":0.79100000000000004,"15min":0.73499999999999999},"max":{"1min":1.5429999999999999,"5min":1.76,"15min":3.2349999999999999},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.3839999999999999,"15min":1.383},"min":{"1min":1.093,"5min":0.88700000000000001,"15min":0.77700000000000002},"max":{"1min":1.744,"5min":2.008,"15min":2.5369999999999999},"last":1.1930000000000001}]},{"osd":5,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3540000000000001,"15min":1.3740000000000001},"min":{"1min":1.1060000000000001,"5min":0.90800000000000003,"15min":0.85599999999999998},"max":{"1min":1.7250000000000001,"5min":1.798,"15min":2.988},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.395,"5min":1.327,"15min":1.361},"min":{"1min":1.093,"5min":0.81599999999999995,"15min":0.77000000000000002},"max":{"1min":1.6020000000000001,"5min":1.712,"15min":2.843},"last":1.0640000000000001}]},{"osd":6,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.472,"15min":1.462},"min":{"1min":1.1100000000000001,"5min":0.88300000000000001,"15min":0.81100000000000005},"max":{"1min":1.825,"5min":2.0760000000000001,"15min":2.431},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.5,"5min":1.4419999999999999,"15min":1.4339999999999999},"min":{"1min":0.98699999999999999,"5min":0.85799999999999998,"15min":0.67600000000000005},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.589},"last":1.2969999999999999}]},{"osd":7,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.5880000000000001,"5min":1.4890000000000001,"15min":1.5029999999999999},"min":{"1min":1.175,"5min":0.89500000000000002,"15min":0.78600000000000003},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.7410000000000001},"last":1.393},{"interface":"front","average":{"1min":1.49,"5min":1.3779999999999999,"15min":1.4259999999999999},"min":{"1min":1.2090000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.972,"5min":1.972,"15min":2.8929999999999998},"last":1.425}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-12T17:33:24.622 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-12T17:18:40.152422+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=12, tm_hour=17, tm_min=18, tm_sec=40, tm_wday=1, tm_yday=72, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=12, tm_hour=17, tm_min=33, tm_sec=17, tm_wday=1, tm_yday=72, tm_isdst=0) 2024-03-12T17:33:24.622 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-12T17:33:44.624 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-12T17:33:44.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.859+0000 7f51e9200640 1 Processor -- start 2024-03-12T17:33:44.855 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.860+0000 7f51e9200640 1 -- start start 2024-03-12T17:33:44.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.861+0000 7f51e9200640 1 --2- >> v2:172.21.15.94:3300/0 conn(0x7f51e41441f0 0x7f51e4070240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:44.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.861+0000 7f51e9200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f51e415ae20 0x7f51e406d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:44.856 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.861+0000 7f51e9200640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51e40a7660 con 0x7f51e40b3b70 2024-03-12T17:33:44.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.861+0000 7f51e9200640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e415e460 con 0x7f51e415ae20 2024-03-12T17:33:44.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.861+0000 7f51e9200640 1 -- --> v2:172.21.15.94:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e41445d0 con 0x7f51e41441f0 2024-03-12T17:33:44.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.861+0000 7f51dbe00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f51e415ae20 0x7f51e406d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:44.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.862+0000 7f51dbe00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f51e415ae20 0x7f51e406d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58134/0 (socket says 172.21.15.17:58134) 2024-03-12T17:33:44.857 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.862+0000 7f51dbe00640 1 -- 172.21.15.17:0/4094808827 learned_addr learned my addr 172.21.15.17:0/4094808827 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:44.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.862+0000 7f51e3400640 1 --2- 172.21.15.17:0/4094808827 >> v2:172.21.15.94:3300/0 conn(0x7f51e41441f0 0x7f51e4070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:44.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.862+0000 7f51dbe00640 1 -- 172.21.15.17:0/4094808827 >> v2:172.21.15.94:3300/0 conn(0x7f51e41441f0 msgr2=0x7f51e4070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:44.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.862+0000 7f51dbe00640 1 --2- 172.21.15.17:0/4094808827 >> v2:172.21.15.94:3300/0 conn(0x7f51e41441f0 0x7f51e4070240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:44.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.862+0000 7f51dbe00640 1 -- 172.21.15.17:0/4094808827 >> v1:172.21.15.94:6789/0 conn(0x7f51e40b3b70 legacy=0x7f51e40b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:44.858 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.862+0000 7f51dbe00640 1 -- 172.21.15.17:0/4094808827 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e415b3e0 con 0x7f51e415ae20 2024-03-12T17:33:44.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.863+0000 7f51dbe00640 1 --2- 172.21.15.17:0/4094808827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51e415ae20 0x7f51e406d130 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f51e406e4d0 tx=0x7f51cc02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfd1dfe6d840bfb9 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:44.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.864+0000 7f51e2a00640 1 -- 172.21.15.17:0/4094808827 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51cc030860 con 0x7f51e415ae20 2024-03-12T17:33:44.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.864+0000 7f51e2a00640 1 -- 172.21.15.17:0/4094808827 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51cc0309c0 con 0x7f51e415ae20 2024-03-12T17:33:44.859 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.864+0000 7f51e2a00640 1 -- 172.21.15.17:0/4094808827 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51cc030d50 con 0x7f51e415ae20 2024-03-12T17:33:44.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.864+0000 7f51e9200640 1 -- 172.21.15.17:0/4094808827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51e415ae20 msgr2=0x7f51e406d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:44.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.864+0000 7f51e9200640 1 --2- 172.21.15.17:0/4094808827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51e415ae20 0x7f51e406d130 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f51e406e4d0 tx=0x7f51cc02b9a0 comp rx=0 tx=0).stop 2024-03-12T17:33:44.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.865+0000 7f51e9200640 1 -- 172.21.15.17:0/4094808827 shutdown_connections 2024-03-12T17:33:44.860 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.865+0000 7f51e9200640 1 --2- 172.21.15.17:0/4094808827 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51e415ae20 0x7f51e406d130 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:44.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.865+0000 7f51e9200640 1 --2- 172.21.15.17:0/4094808827 >> v2:172.21.15.94:3300/0 conn(0x7f51e41441f0 0x7f51e4070240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:44.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.865+0000 7f51e9200640 1 -- 172.21.15.17:0/4094808827 >> 172.21.15.17:0/4094808827 conn(0x7f51e4069ce0 msgr2=0x7f51e406a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:44.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.865+0000 7f51e9200640 1 -- 172.21.15.17:0/4094808827 shutdown_connections 2024-03-12T17:33:44.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.865+0000 7f51e9200640 1 -- 172.21.15.17:0/4094808827 wait complete. 2024-03-12T17:33:44.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.866+0000 7f51e9200640 1 Processor -- start 2024-03-12T17:33:44.861 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.867+0000 7f51e9200640 1 -- start start 2024-03-12T17:33:44.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.868+0000 7f51e9200640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51e40b3b70 0x7f51e415d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:44.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.868+0000 7f51e9200640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f51e41441f0 0x7f51e40aa070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:44.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.868+0000 7f51e9200640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51e415ae20 0x7f51e415bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:44.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.868+0000 7f51e9200640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e4131380 con 0x7f51e40b3b70 2024-03-12T17:33:44.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.868+0000 7f51e9200640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e40ae080 con 0x7f51e415ae20 2024-03-12T17:33:44.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.868+0000 7f51e9200640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e415d7e0 con 0x7f51e41441f0 2024-03-12T17:33:44.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.868+0000 7f51e3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51e40b3b70 0x7f51e415d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:44.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.868+0000 7f51e3400640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51e40b3b70 0x7f51e415d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58148/0 (socket says 172.21.15.17:58148) 2024-03-12T17:33:44.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.868+0000 7f51e3400640 1 -- 172.21.15.17:0/4214900347 learned_addr learned my addr 172.21.15.17:0/4214900347 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:44.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.868+0000 7f51e3e00640 1 --2- 172.21.15.17:0/4214900347 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51e415ae20 0x7f51e415bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:44.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.868+0000 7f51dbe00640 1 --2- 172.21.15.17:0/4214900347 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f51e41441f0 0x7f51e40aa070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:44.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.869+0000 7f51e3400640 1 -- 172.21.15.17:0/4214900347 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f51e41441f0 msgr2=0x7f51e40aa070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:44.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.869+0000 7f51e3400640 1 --2- 172.21.15.17:0/4214900347 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f51e41441f0 0x7f51e40aa070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:44.864 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.869+0000 7f51e3400640 1 -- 172.21.15.17:0/4214900347 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51e415ae20 msgr2=0x7f51e415bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:44.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.869+0000 7f51e3400640 1 --2- 172.21.15.17:0/4214900347 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51e415ae20 0x7f51e415bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:44.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.869+0000 7f51e3400640 1 -- 172.21.15.17:0/4214900347 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51cc0094d0 con 0x7f51e40b3b70 2024-03-12T17:33:44.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.869+0000 7f51e3400640 1 --2- 172.21.15.17:0/4214900347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51e40b3b70 0x7f51e415d2a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f51d400d800 tx=0x7f51d400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:44.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.869+0000 7f51db400640 1 -- 172.21.15.17:0/4214900347 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d400b6c0 con 0x7f51e40b3b70 2024-03-12T17:33:44.865 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.869+0000 7f51db400640 1 -- 172.21.15.17:0/4214900347 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d400b820 con 0x7f51e40b3b70 2024-03-12T17:33:44.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.869+0000 7f51e9200640 1 -- 172.21.15.17:0/4214900347 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e40aa5b0 con 0x7f51e40b3b70 2024-03-12T17:33:44.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.869+0000 7f51db400640 1 -- 172.21.15.17:0/4214900347 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d400bbb0 con 0x7f51e40b3b70 2024-03-12T17:33:44.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.869+0000 7f51e9200640 1 -- 172.21.15.17:0/4214900347 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e4130cc0 con 0x7f51e40b3b70 2024-03-12T17:33:44.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.871+0000 7f51e9200640 1 -- 172.21.15.17:0/4214900347 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51e41315f0 con 0x7f51e40b3b70 2024-03-12T17:33:44.866 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.871+0000 7f51db400640 1 -- 172.21.15.17:0/4214900347 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f51d400bd10 con 0x7f51e40b3b70 2024-03-12T17:33:44.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.872+0000 7f51db400640 1 --2- 172.21.15.17:0/4214900347 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f51c006ac00 0x7f51c006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:44.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.872+0000 7f51db400640 1 -- 172.21.15.17:0/4214900347 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f51d40896a0 con 0x7f51e40b3b70 2024-03-12T17:33:44.867 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.873+0000 7f51dbe00640 1 --2- 172.21.15.17:0/4214900347 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f51c006ac00 0x7f51c006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:44.868 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.873+0000 7f51dbe00640 1 --2- 172.21.15.17:0/4214900347 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f51c006ac00 0x7f51c006d0c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f51cc036000 tx=0x7f51cc03b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:44.872 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:44.877+0000 7f51db400640 1 -- 172.21.15.17:0/4214900347 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f51d4054ae0 con 0x7f51e40b3b70 2024-03-12T17:33:45.066 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.071+0000 7f51e9200640 1 -- 172.21.15.17:0/4214900347 --> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f51e415bc80 con 0x7f51c006ac00 2024-03-12T17:33:45.072 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.077+0000 7f51db400640 1 -- 172.21.15.17:0/4214900347 <== mgr.4104 v2:172.21.15.17:6832/37052 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+47939 (secure 0 0 0) 0x7f51cc030bb0 con 0x7f51c006ac00 2024-03-12T17:33:45.073 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:33:45.073 INFO:teuthology.orchestra.run.smithi017.stderr:dumped all 2024-03-12T17:33:45.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.079+0000 7f51e9200640 1 -- 172.21.15.17:0/4214900347 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f51c006ac00 msgr2=0x7f51c006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:45.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.080+0000 7f51e9200640 1 --2- 172.21.15.17:0/4214900347 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f51c006ac00 0x7f51c006d0c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f51cc036000 tx=0x7f51cc03b040 comp rx=0 tx=0).stop 2024-03-12T17:33:45.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.080+0000 7f51e9200640 1 -- 172.21.15.17:0/4214900347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51e40b3b70 msgr2=0x7f51e415d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:45.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.080+0000 7f51e9200640 1 --2- 172.21.15.17:0/4214900347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51e40b3b70 0x7f51e415d2a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f51d400d800 tx=0x7f51d400dcc0 comp rx=0 tx=0).stop 2024-03-12T17:33:45.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.080+0000 7f51e9200640 1 -- 172.21.15.17:0/4214900347 shutdown_connections 2024-03-12T17:33:45.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.080+0000 7f51e9200640 1 --2- 172.21.15.17:0/4214900347 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f51c006ac00 0x7f51c006d0c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:45.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.080+0000 7f51e9200640 1 --2- 172.21.15.17:0/4214900347 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f51e415ae20 0x7f51e415bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:45.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.080+0000 7f51e9200640 1 --2- 172.21.15.17:0/4214900347 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f51e41441f0 0x7f51e40aa070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:45.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.080+0000 7f51e9200640 1 --2- 172.21.15.17:0/4214900347 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f51e40b3b70 0x7f51e415d2a0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:45.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.080+0000 7f51e9200640 1 -- 172.21.15.17:0/4214900347 >> 172.21.15.17:0/4214900347 conn(0x7f51e4069ce0 msgr2=0x7f51e4142110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:45.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.080+0000 7f51e9200640 1 -- 172.21.15.17:0/4214900347 shutdown_connections 2024-03-12T17:33:45.077 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.080+0000 7f51e9200640 1 -- 172.21.15.17:0/4214900347 wait complete. 2024-03-12T17:33:45.096 INFO:teuthology.orchestra.run.smithi017.stdout:{"pg_ready":true,"pg_map":{"version":498,"stamp":"2024-03-12T17:33:43.799800+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":263148,"kb_used_data":6024,"kb_used_omap":13,"kb_used_meta":257010,"kb_avail":754711572,"statfs":{"total":773094113280,"available":772824649728,"internally_reserved":0,"allocated":6168576,"data_stored":3219712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":263178328},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003485"},"pg_stats":[{"pgid":"1.0","version":"52'119","reported_seq":209,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-03-12T17:33:24.859394+0000","last_change":"2024-03-12T17:33:24.859661+0000","last_active":"2024-03-12T17:33:24.859394+0000","last_peered":"2024-03-12T17:33:24.859394+0000","last_clean":"2024-03-12T17:33:24.859394+0000","last_became_active":"2024-03-12T17:18:41.329237+0000","last_became_peered":"2024-03-12T17:18:41.329237+0000","last_unstale":"2024-03-12T17:33:24.859394+0000","last_undegraded":"2024-03-12T17:33:24.859394+0000","last_fullsized":"2024-03-12T17:33:24.859394+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"52'119","last_scrub_stamp":"2024-03-12T17:33:24.859342+0000","last_deep_scrub":"52'119","last_deep_scrub_stamp":"2024-03-12T17:33:24.859342+0000","last_clean_scrub_stamp":"2024-03-12T17:33:24.859342+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-14T01:03:46.396795+0000","scrub_duration":0.011889869000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575032,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36396,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94335444,"statfs":{"total":96636764160,"available":96599494656,"internally_reserved":0,"allocated":1216512,"data_stored":845240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:33:06 2024","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":1.006,"15min":1.0369999999999999},"min":{"1min":0.67800000000000005,"5min":0.61699999999999999,"15min":0.48099999999999998},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":2.3730000000000002},"last":0.97399999999999998},{"interface":"front","average":{"1min":1.038,"5min":1.0289999999999999,"15min":1.0369999999999999},"min":{"1min":0.67700000000000005,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.494,"5min":1.5469999999999999,"15min":2.2330000000000001},"last":1.204}]},{"osd":1,"last update":"Tue Mar 12 17:33:06 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0129999999999999,"15min":1.02},"min":{"1min":0.753,"5min":0.67200000000000004,"15min":0.52200000000000002},"max":{"1min":1.5,"5min":1.5,"15min":1.7050000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.111,"15min":1.123},"min":{"1min":0.73999999999999999,"5min":0.72699999999999998,"15min":0.61299999999999999},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":2.363},"last":1.079}]},{"osd":2,"last update":"Tue Mar 12 17:33:06 2024","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.171,"15min":1.179},"min":{"1min":0.747,"5min":0.68100000000000005,"15min":0.60799999999999998},"max":{"1min":1.4339999999999999,"5min":1.655,"15min":1.827},"last":1.234},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.22,"15min":1.2290000000000001},"min":{"1min":0.92500000000000004,"5min":0.83999999999999997,"15min":0.625},"max":{"1min":1.6379999999999999,"5min":1.7949999999999999,"15min":2.0870000000000002},"last":1.1180000000000001}]},{"osd":3,"last update":"Tue Mar 12 17:33:06 2024","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.2010000000000001,"15min":1.212},"min":{"1min":0.871,"5min":0.70699999999999996,"15min":0.55800000000000005},"max":{"1min":1.4710000000000001,"5min":1.722,"15min":1.921},"last":1.355},{"interface":"front","average":{"1min":1.216,"5min":1.2709999999999999,"15min":1.2669999999999999},"min":{"1min":0.89300000000000002,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.4870000000000001,"5min":1.738,"15min":2.1499999999999999},"last":1.046}]},{"osd":4,"last update":"Tue Mar 12 17:33:06 2024","interfaces":[{"interface":"back","average":{"1min":1.2,"5min":1.1739999999999999,"15min":1.1990000000000001},"min":{"1min":0.79600000000000004,"5min":0.71299999999999997,"15min":0.51400000000000001},"max":{"1min":1.635,"5min":1.635,"15min":2.2349999999999999},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.351,"15min":1.381},"min":{"1min":1.105,"5min":0.84799999999999998,"15min":0.63700000000000001},"max":{"1min":1.635,"5min":1.786,"15min":2.2490000000000001},"last":1.4570000000000001}]},{"osd":5,"last update":"Tue Mar 12 17:33:06 2024","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.2969999999999999,"15min":1.3109999999999999},"min":{"1min":0.84699999999999998,"5min":0.66600000000000004,"15min":0.53100000000000003},"max":{"1min":1.615,"5min":1.833,"15min":2.323},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.427,"5min":1.379,"15min":1.4279999999999999},"min":{"1min":1.1200000000000001,"5min":0.85499999999999998,"15min":0.61099999999999999},"max":{"1min":1.8140000000000001,"5min":1.8140000000000001,"15min":3.9689999999999999},"last":1.3080000000000001}]},{"osd":6,"last update":"Tue Mar 12 17:33:06 2024","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.425,"15min":1.462},"min":{"1min":1.2130000000000001,"5min":0.94399999999999995,"15min":0.69999999999999996},"max":{"1min":1.722,"5min":1.8340000000000001,"15min":3.8319999999999999},"last":1.403},{"interface":"front","average":{"1min":1.3640000000000001,"5min":1.4019999999999999,"15min":1.429},"min":{"1min":0.99099999999999999,"5min":0.627,"15min":0.55100000000000005},"max":{"1min":1.6379999999999999,"5min":1.891,"15min":2.4609999999999999},"last":1.141}]}]},{"osd":6,"up_from":13,"seq":55834575031,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31724,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340116,"statfs":{"total":96636764160,"available":96604278784,"internally_reserved":0,"allocated":622592,"data_stored":254872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.101,"15min":1.0629999999999999},"min":{"1min":0.72399999999999998,"5min":0.68600000000000005,"15min":0.54400000000000004},"max":{"1min":1.556,"5min":1.71,"15min":3.5390000000000001},"last":1.1140000000000001},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.085,"15min":1.0569999999999999},"min":{"1min":0.80400000000000005,"5min":0.65700000000000003,"15min":0.60899999999999999},"max":{"1min":1.5269999999999999,"5min":1.6220000000000001,"15min":1.73},"last":0.85699999999999998}]},{"osd":1,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.2789999999999999,"15min":1.2330000000000001},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.33900000000000002},"max":{"1min":1.5680000000000001,"5min":1.778,"15min":6.7450000000000001},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.2889999999999999,"15min":1.2769999999999999},"min":{"1min":0.89900000000000002,"5min":0.73199999999999998,"15min":0.70199999999999996},"max":{"1min":1.681,"5min":1.734,"15min":4.1909999999999998},"last":1.3660000000000001}]},{"osd":2,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.2410000000000001,"5min":1.2689999999999999,"15min":1.2410000000000001},"min":{"1min":0.93400000000000005,"5min":0.83899999999999997,"15min":0.41299999999999998},"max":{"1min":1.512,"5min":1.6799999999999999,"15min":6.6879999999999997},"last":1.149},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.3149999999999999,"15min":1.3},"min":{"1min":1.181,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.6899999999999999,"5min":1.8240000000000001,"15min":2.9689999999999999},"last":1.4870000000000001}]},{"osd":3,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.2390000000000001,"15min":1.2050000000000001},"min":{"1min":0.72999999999999998,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.546,"5min":1.6759999999999999,"15min":1.7749999999999999},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.248,"5min":1.254,"15min":1.246},"min":{"1min":0.86399999999999999,"5min":0.73899999999999999,"15min":0.46200000000000002},"max":{"1min":1.48,"5min":1.7170000000000001,"15min":6.6070000000000002},"last":1.2589999999999999}]},{"osd":4,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.244,"15min":1.256},"min":{"1min":0.91000000000000003,"5min":0.80100000000000005,"15min":0.68300000000000005},"max":{"1min":1.605,"5min":1.6950000000000001,"15min":2.2130000000000001},"last":1.2350000000000001},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.2669999999999999,"15min":1.256},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.59499999999999997},"max":{"1min":1.7849999999999999,"5min":1.976,"15min":1.976},"last":1.302}]},{"osd":5,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.3959999999999999,"15min":1.3959999999999999},"min":{"1min":1.2010000000000001,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":2.0649999999999999,"5min":2.0649999999999999,"15min":2.8660000000000001},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3680000000000001,"15min":1.373},"min":{"1min":1,"5min":0.88,"15min":0.51900000000000002},"max":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":6.4939999999999998},"last":1.4450000000000001}]},{"osd":7,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.4279999999999999,"15min":1.454},"min":{"1min":1.1559999999999999,"5min":0.92000000000000004,"15min":0.64000000000000001},"max":{"1min":1.978,"5min":1.978,"15min":2.2069999999999999},"last":1.591},{"interface":"front","average":{"1min":1.5980000000000001,"5min":1.5449999999999999,"15min":1.5289999999999999},"min":{"1min":1.319,"5min":1.016,"15min":0.77500000000000002},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.258},"last":1.6539999999999999}]}]},{"osd":5,"up_from":13,"seq":55834575032,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31728,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":622592,"data_stored":254872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.0629999999999999,"15min":1.111},"min":{"1min":0.66100000000000003,"5min":0.60599999999999998,"15min":0.56399999999999995},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":2.161},"last":1.196},{"interface":"front","average":{"1min":1.099,"5min":1.1140000000000001,"15min":1.145},"min":{"1min":0.72199999999999998,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.3899999999999999,"5min":1.5149999999999999,"15min":1.95},"last":1.603}]},{"osd":1,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.1279999999999999,"15min":1.1359999999999999},"min":{"1min":0.75,"5min":0.70499999999999996,"15min":0.69199999999999995},"max":{"1min":1.496,"5min":1.698,"15min":1.75},"last":1.321},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.1779999999999999,"15min":1.222},"min":{"1min":0.82799999999999996,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":2.5699999999999998},"last":0.89900000000000002}]},{"osd":2,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.212,"15min":1.234},"min":{"1min":0.96799999999999997,"5min":0.76000000000000001,"15min":0.71599999999999997},"max":{"1min":1.6220000000000001,"5min":1.7190000000000001,"15min":2.613},"last":1.238},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.226,"15min":1.2310000000000001},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.524,"5min":1.897,"15min":2.359},"last":1.5529999999999999}]},{"osd":3,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2569999999999999,"15min":1.3089999999999999},"min":{"1min":0.77900000000000003,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.4930000000000001,"5min":1.75,"15min":2.6829999999999998},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.3,"15min":1.3280000000000001},"min":{"1min":0.90900000000000003,"5min":0.874,"15min":0.80500000000000005},"max":{"1min":1.5720000000000001,"5min":1.724,"15min":2.3559999999999999},"last":1.3839999999999999}]},{"osd":4,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.2,"15min":1.248},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.73699999999999999},"max":{"1min":1.655,"5min":1.6719999999999999,"15min":2.0510000000000002},"last":1.421},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.306,"15min":1.361},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.76700000000000002},"max":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":2.3999999999999999},"last":1.087}]},{"osd":6,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2649999999999999,"5min":1.3160000000000001,"15min":1.375},"min":{"1min":0.91700000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.718,"5min":1.75,"15min":2.488},"last":1.5169999999999999},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.365,"15min":1.4179999999999999},"min":{"1min":1.1719999999999999,"5min":0.97199999999999998,"15min":0.66100000000000003},"max":{"1min":1.601,"5min":1.7949999999999999,"15min":2.2759999999999998},"last":1.4990000000000001}]},{"osd":7,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.413,"15min":1.4950000000000001},"min":{"1min":0.97799999999999998,"5min":0.95299999999999996,"15min":0.95299999999999996},"max":{"1min":1.696,"5min":1.7470000000000001,"15min":2.8700000000000001},"last":1.302},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.47,"15min":1.5249999999999999},"min":{"1min":1.073,"5min":0.87,"15min":0.87},"max":{"1min":1.72,"5min":1.833,"15min":2.722},"last":1.6930000000000001}]}]},{"osd":4,"up_from":13,"seq":55834575032,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31728,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":622592,"data_stored":254872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":1.1259999999999999,"15min":1.091},"min":{"1min":0.70099999999999996,"5min":0.67300000000000004,"15min":0.60799999999999998},"max":{"1min":1.679,"5min":1.7330000000000001,"15min":4.8979999999999997},"last":1.2969999999999999},{"interface":"front","average":{"1min":0.996,"5min":1.073,"15min":1.0900000000000001},"min":{"1min":0.73299999999999998,"5min":0.67900000000000005,"15min":0.57699999999999996},"max":{"1min":1.4410000000000001,"5min":1.659,"15min":4.8300000000000001},"last":1.331}]},{"osd":1,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.1359999999999999,"15min":1.1339999999999999},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.64100000000000001},"max":{"1min":1.609,"5min":1.647,"15min":4.7779999999999996},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.2070000000000001,"15min":1.161},"min":{"1min":0.82299999999999995,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.6100000000000001,"5min":1.887,"15min":1.911},"last":1.0609999999999999}]},{"osd":2,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.2569999999999999,"15min":1.226},"min":{"1min":0.88,"5min":0.65800000000000003,"15min":0.60199999999999998},"max":{"1min":1.5409999999999999,"5min":1.6870000000000001,"15min":1.7450000000000001},"last":1.484},{"interface":"front","average":{"1min":1.351,"5min":1.3340000000000001,"15min":1.3049999999999999},"min":{"1min":1.028,"5min":0.81899999999999995,"15min":0.78500000000000003},"max":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":2.3220000000000001},"last":1.5900000000000001}]},{"osd":3,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.2310000000000001,"15min":1.24},"min":{"1min":0.90200000000000002,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.444,"5min":1.78,"15min":1.7949999999999999},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.232,"5min":1.2310000000000001,"15min":1.2290000000000001},"min":{"1min":0.90500000000000003,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.581,"5min":1.7130000000000001,"15min":1.9119999999999999},"last":1.4490000000000001}]},{"osd":5,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.3300000000000001,"15min":1.325},"min":{"1min":0.93400000000000005,"5min":0.83299999999999996,"15min":0.60499999999999998},"max":{"1min":1.766,"5min":1.766,"15min":2.1589999999999998},"last":1.25},{"interface":"front","average":{"1min":1.49,"5min":1.4159999999999999,"15min":1.3899999999999999},"min":{"1min":0.85999999999999999,"5min":0.79600000000000004,"15min":0.76700000000000002},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":2.5390000000000001},"last":1.512}]},{"osd":6,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.248,"15min":1.264},"min":{"1min":0.86299999999999999,"5min":0.81599999999999995,"15min":0.65900000000000003},"max":{"1min":1.5880000000000001,"5min":1.8009999999999999,"15min":1.885},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.508,"5min":1.3999999999999999,"15min":1.3919999999999999},"min":{"1min":1.0649999999999999,"5min":0.83299999999999996,"15min":0.63300000000000001},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.4750000000000001},"last":1.407}]},{"osd":7,"last update":"Tue Mar 12 17:33:04 2024","interfaces":[{"interface":"back","average":{"1min":1.4710000000000001,"5min":1.3979999999999999,"15min":1.4079999999999999},"min":{"1min":1.159,"5min":0.97799999999999998,"15min":0.56299999999999994},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":2.1200000000000001},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.427,"15min":1.425},"min":{"1min":0.97799999999999998,"5min":0.96999999999999997,"15min":0.67600000000000005},"max":{"1min":1.72,"5min":1.9199999999999999,"15min":2.4260000000000002},"last":1.353}]}]},{"osd":3,"up_from":13,"seq":55834575032,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":35820,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94336020,"statfs":{"total":96636764160,"available":96600084480,"internally_reserved":0,"allocated":622592,"data_stored":254872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.84999999999999998,"15min":0.88300000000000001},"min":{"1min":0.51000000000000001,"5min":0.432,"15min":0.35099999999999998},"max":{"1min":1.306,"5min":1.5189999999999999,"15min":2.9580000000000002},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.995,"5min":0.93999999999999995,"15min":0.95699999999999996},"min":{"1min":0.67800000000000005,"5min":0.55800000000000005,"15min":0.48199999999999998},"max":{"1min":1.401,"5min":1.651,"15min":3.9940000000000002},"last":1.1060000000000001}]},{"osd":1,"last update":"Tue Mar 12 17:32:56 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.89700000000000002,"15min":0.91900000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.38600000000000001},"max":{"1min":1.4019999999999999,"5min":1.5940000000000001,"15min":4.774},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.0780000000000001,"5min":1.0449999999999999,"15min":1.0720000000000001},"min":{"1min":0.60599999999999998,"5min":0.58499999999999996,"15min":0.40999999999999998},"max":{"1min":1.647,"5min":1.647,"15min":5.0069999999999997},"last":1.044}]},{"osd":2,"last update":"Tue Mar 12 17:32:56 2024","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.135,"15min":1.155},"min":{"1min":0.78200000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":2.4660000000000002},"last":1.444},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.2250000000000001,"15min":1.2709999999999999},"min":{"1min":0.70499999999999996,"5min":0.57399999999999995,"15min":0.439},"max":{"1min":1.6020000000000001,"5min":1.7509999999999999,"15min":4.5650000000000004},"last":1.4770000000000001}]},{"osd":4,"last update":"Tue Mar 12 17:32:56 2024","interfaces":[{"interface":"back","average":{"1min":1.2729999999999999,"5min":1.24,"15min":1.272},"min":{"1min":0.84899999999999998,"5min":0.80700000000000005,"15min":0.67200000000000004},"max":{"1min":1.74,"5min":1.74,"15min":2.8860000000000001},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2390000000000001,"15min":1.28},"min":{"1min":0.88300000000000001,"5min":0.80800000000000005,"15min":0.73399999999999999},"max":{"1min":1.546,"5min":1.6259999999999999,"15min":4.3520000000000003},"last":1.264}]},{"osd":5,"last update":"Tue Mar 12 17:32:56 2024","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.339,"15min":1.3500000000000001},"min":{"1min":0.91500000000000004,"5min":0.84799999999999998,"15min":0.76200000000000001},"max":{"1min":1.649,"5min":1.9059999999999999,"15min":2.843},"last":1.403},{"interface":"front","average":{"1min":1.389,"5min":1.3069999999999999,"15min":1.3320000000000001},"min":{"1min":0.96299999999999997,"5min":0.81399999999999995,"15min":0.68300000000000005},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.8149999999999999},"last":1.3799999999999999}]},{"osd":6,"last update":"Tue Mar 12 17:32:56 2024","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.4059999999999999,"15min":1.4379999999999999},"min":{"1min":1.1359999999999999,"5min":0.79600000000000004,"15min":0.71699999999999997},"max":{"1min":1.7509999999999999,"5min":2.0299999999999998,"15min":2.9199999999999999},"last":1.464},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4039999999999999,"15min":1.423},"min":{"1min":1.0329999999999999,"5min":0.878,"15min":0.86399999999999999},"max":{"1min":1.982,"5min":1.982,"15min":2.6589999999999998},"last":1.5129999999999999}]},{"osd":7,"last update":"Tue Mar 12 17:32:56 2024","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.351,"15min":1.3959999999999999},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.83899999999999997},"max":{"1min":1.661,"5min":1.7450000000000001,"15min":4.6600000000000001},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.3819999999999999,"5min":1.4350000000000001,"15min":1.4670000000000001},"min":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.76800000000000002},"max":{"1min":1.7529999999999999,"5min":1.8240000000000001,"15min":4.4720000000000004},"last":1.4199999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575032,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31728,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340112,"statfs":{"total":96636764160,"available":96604274688,"internally_reserved":0,"allocated":622592,"data_stored":254872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.97299999999999998,"15min":0.95499999999999996},"min":{"1min":0.495,"5min":0.495,"15min":0.40000000000000002},"max":{"1min":1.3540000000000001,"5min":2.097,"15min":3.1829999999999998},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.0580000000000001,"5min":1.0960000000000001,"15min":1.0800000000000001},"min":{"1min":0.66800000000000004,"5min":0.63400000000000001,"15min":0.50700000000000001},"max":{"1min":1.532,"5min":1.694,"15min":2.8199999999999998},"last":1.0580000000000001}]},{"osd":1,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":0.94199999999999995,"15min":0.94099999999999995},"min":{"1min":0.69199999999999995,"5min":0.49099999999999999,"15min":0.308},"max":{"1min":1.9259999999999999,"5min":2.0529999999999999,"15min":2.7360000000000002},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.97299999999999998,"5min":1.119,"15min":1.099},"min":{"1min":0.621,"5min":0.621,"15min":0.44700000000000001},"max":{"1min":1.583,"5min":2.2010000000000001,"15min":3.1019999999999999},"last":0.92700000000000005}]},{"osd":3,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.117,"15min":1.1160000000000001},"min":{"1min":0.72599999999999998,"5min":0.629,"15min":0.45000000000000001},"max":{"1min":1.6020000000000001,"5min":1.883,"15min":2.7810000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2270000000000001,"15min":1.2130000000000001},"min":{"1min":0.76500000000000001,"5min":0.66900000000000004,"15min":0.48299999999999998},"max":{"1min":1.5920000000000001,"5min":1.758,"15min":3.1419999999999999},"last":1.0209999999999999}]},{"osd":4,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.3420000000000001,"15min":1.3919999999999999},"min":{"1min":0.92900000000000005,"5min":0.86699999999999999,"15min":0.76100000000000001},"max":{"1min":1.7,"5min":1.9450000000000001,"15min":7.96},"last":1.2410000000000001},{"interface":"front","average":{"1min":1.282,"5min":1.266,"15min":1.2789999999999999},"min":{"1min":0.82299999999999995,"5min":0.78800000000000003,"15min":0.67700000000000005},"max":{"1min":1.7210000000000001,"5min":1.806,"15min":3.3780000000000001},"last":1.5609999999999999}]},{"osd":5,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.333,"15min":1.351},"min":{"1min":0.91800000000000004,"5min":0.89000000000000001,"15min":0.70399999999999996},"max":{"1min":1.8839999999999999,"5min":1.9059999999999999,"15min":4.0659999999999998},"last":1.298},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3320000000000001,"15min":1.3700000000000001},"min":{"1min":0.98599999999999999,"5min":0.86699999999999999,"15min":0.63800000000000001},"max":{"1min":1.649,"5min":1.929,"15min":3.012},"last":1.1120000000000001}]},{"osd":6,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.393,"15min":1.4019999999999999},"min":{"1min":1.1459999999999999,"5min":0.86599999999999999,"15min":0.74099999999999999},"max":{"1min":1.7729999999999999,"5min":2.1099999999999999,"15min":3.2330000000000001},"last":1.353},{"interface":"front","average":{"1min":1.389,"5min":1.4870000000000001,"15min":1.5169999999999999},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.68899999999999995},"max":{"1min":1.802,"5min":2.4100000000000001,"15min":7.9059999999999997},"last":1.3979999999999999}]},{"osd":7,"last update":"Tue Mar 12 17:33:00 2024","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.423,"15min":1.4299999999999999},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.64700000000000002},"max":{"1min":1.8420000000000001,"5min":2.0529999999999999,"15min":4.0229999999999997},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.4730000000000001,"5min":1.4750000000000001,"15min":1.4950000000000001},"min":{"1min":1.0509999999999999,"5min":0.95099999999999996,"15min":0.84499999999999997},"max":{"1min":1.885,"5min":2.0950000000000002,"15min":3.27},"last":1.5069999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575032,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31724,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340116,"statfs":{"total":96636764160,"available":96604278784,"internally_reserved":0,"allocated":622592,"data_stored":254872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.89800000000000002,"15min":0.88800000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.29,"5min":1.6699999999999999,"15min":1.7749999999999999},"last":0.872},{"interface":"front","average":{"1min":0.97199999999999998,"5min":1.0149999999999999,"15min":1.0449999999999999},"min":{"1min":0.60999999999999999,"5min":0.59399999999999997,"15min":0.47499999999999998},"max":{"1min":1.76,"5min":1.869,"15min":7.6449999999999996},"last":1.256}]},{"osd":2,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.97099999999999997,"15min":0.95199999999999996},"min":{"1min":0.628,"5min":0.53200000000000003,"15min":0.40799999999999997},"max":{"1min":1.272,"5min":1.7629999999999999,"15min":1.9299999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.98699999999999999,"5min":1.095,"15min":1.0669999999999999},"min":{"1min":0.58799999999999997,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.325,"5min":1.708,"15min":2.5720000000000001},"last":0.99299999999999999}]},{"osd":3,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.208,"15min":1.242},"min":{"1min":0.625,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.681,"5min":1.875,"15min":2.4580000000000002},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.02,"5min":1.155,"15min":1.1599999999999999},"min":{"1min":0.56399999999999995,"5min":0.501,"15min":0.42499999999999999},"max":{"1min":1.502,"5min":1.8460000000000001,"15min":3.319},"last":1.4950000000000001}]},{"osd":4,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.246,"15min":1.2350000000000001},"min":{"1min":0.77400000000000002,"5min":0.70799999999999996,"15min":0.63300000000000001},"max":{"1min":1.5700000000000001,"5min":1.9039999999999999,"15min":2.4580000000000002},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.363,"15min":1.355},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.70999999999999996},"max":{"1min":1.599,"5min":2.0680000000000001,"15min":2.6909999999999998},"last":1.4590000000000001}]},{"osd":5,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.3740000000000001,"15min":1.3660000000000001},"min":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.67200000000000004},"max":{"1min":1.629,"5min":1.9650000000000001,"15min":3.0609999999999999},"last":1.349},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3440000000000001,"15min":1.353},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.73299999999999998},"max":{"1min":1.8169999999999999,"5min":1.9339999999999999,"15min":2.4169999999999998},"last":1.431}]},{"osd":6,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.4419999999999999,"15min":1.4299999999999999},"min":{"1min":0.752,"5min":0.752,"15min":0.70099999999999996},"max":{"1min":1.9139999999999999,"5min":2.137,"15min":3.1030000000000002},"last":1.653},{"interface":"front","average":{"1min":1.4219999999999999,"5min":1.405,"15min":1.4059999999999999},"min":{"1min":0.874,"5min":0.874,"15min":0.82999999999999996},"max":{"1min":1.7509999999999999,"5min":2.0219999999999998,"15min":2.274},"last":1.371}]},{"osd":7,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.4950000000000001,"15min":1.47},"min":{"1min":1.129,"5min":0.85799999999999998,"15min":0.70899999999999996},"max":{"1min":1.7030000000000001,"5min":2.1659999999999999,"15min":2.7959999999999998},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.5389999999999999,"15min":1.518},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.73,"5min":2.2509999999999999,"15min":3.1440000000000001},"last":1.5940000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575031,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32300,"kb_used_data":1188,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339540,"statfs":{"total":96636764160,"available":96603688960,"internally_reserved":0,"allocated":1216512,"data_stored":845240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.92100000000000004,"15min":0.92900000000000005},"min":{"1min":0.71899999999999997,"5min":0.46000000000000002,"15min":0.41799999999999998},"max":{"1min":1.45,"5min":1.829,"15min":1.829},"last":0.67900000000000005},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0469999999999999,"15min":1.028},"min":{"1min":0.54700000000000004,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.504,"5min":1.8280000000000001,"15min":2.3740000000000001},"last":0.77900000000000003}]},{"osd":2,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.054,"15min":1.056},"min":{"1min":0.80200000000000005,"5min":0.56999999999999995,"15min":0.52300000000000002},"max":{"1min":1.528,"5min":1.792,"15min":1.99},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.089,"5min":1.105,"15min":1.1000000000000001},"min":{"1min":0.621,"5min":0.51200000000000001,"15min":0.45500000000000002},"max":{"1min":1.591,"5min":1.752,"15min":2.468},"last":0.89400000000000002}]},{"osd":3,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.002,"15min":1.016},"min":{"1min":0.58299999999999996,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.5449999999999999,"5min":1.8340000000000001,"15min":2.085},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.2290000000000001,"5min":1.234,"15min":1.2310000000000001},"min":{"1min":0.73099999999999998,"5min":0.63800000000000001,"15min":0.56899999999999995},"max":{"1min":1.6479999999999999,"5min":1.78,"15min":2.286},"last":1.51}]},{"osd":4,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.2669999999999999,"5min":1.2390000000000001,"15min":1.262},"min":{"1min":0.94999999999999996,"5min":0.79100000000000004,"15min":0.73499999999999999},"max":{"1min":1.5429999999999999,"5min":1.76,"15min":3.2349999999999999},"last":1.464},{"interface":"front","average":{"1min":1.4039999999999999,"5min":1.3839999999999999,"15min":1.383},"min":{"1min":1.093,"5min":0.88700000000000001,"15min":0.77700000000000002},"max":{"1min":1.744,"5min":2.008,"15min":2.5369999999999999},"last":1.617}]},{"osd":5,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3540000000000001,"15min":1.3740000000000001},"min":{"1min":1.1060000000000001,"5min":0.90800000000000003,"15min":0.85599999999999998},"max":{"1min":1.7250000000000001,"5min":1.798,"15min":2.988},"last":1.21},{"interface":"front","average":{"1min":1.395,"5min":1.327,"15min":1.361},"min":{"1min":1.093,"5min":0.81599999999999995,"15min":0.77000000000000002},"max":{"1min":1.6020000000000001,"5min":1.712,"15min":2.843},"last":1.232}]},{"osd":6,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.472,"15min":1.462},"min":{"1min":1.1100000000000001,"5min":0.88300000000000001,"15min":0.81100000000000005},"max":{"1min":1.825,"5min":2.0760000000000001,"15min":2.431},"last":1.7130000000000001},{"interface":"front","average":{"1min":1.5,"5min":1.4419999999999999,"15min":1.4339999999999999},"min":{"1min":0.98699999999999999,"5min":0.85799999999999998,"15min":0.67600000000000005},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.589},"last":1.4990000000000001}]},{"osd":7,"last update":"Tue Mar 12 17:33:10 2024","interfaces":[{"interface":"back","average":{"1min":1.5880000000000001,"5min":1.4890000000000001,"15min":1.5029999999999999},"min":{"1min":1.175,"5min":0.89500000000000002,"15min":0.78600000000000003},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.7410000000000001},"last":1.4259999999999999},{"interface":"front","average":{"1min":1.49,"5min":1.3779999999999999,"15min":1.4259999999999999},"min":{"1min":1.2090000000000001,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.972,"5min":1.972,"15min":2.8929999999999998},"last":1.5600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-12T17:33:45.098 DEBUG:teuthology.orchestra.run.smithi017:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-03-12T17:33:45.173 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:33:45.181 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:33:45.307 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.313+0000 7f4aa0a00640 1 Processor -- start 2024-03-12T17:33:45.308 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.313+0000 7f4aa0a00640 1 -- start start 2024-03-12T17:33:45.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.314+0000 7f4aa0a00640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4a9c098ec0 0x7f4a9c0b19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:45.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.314+0000 7f4aa0a00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a9c0b1010 con 0x7f4a9c098a60 2024-03-12T17:33:45.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.314+0000 7f4aa0a00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a9c15ad20 con 0x7f4a9c15a940 2024-03-12T17:33:45.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.314+0000 7f4aa0a00640 1 -- --> v2:172.21.15.17:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a9c0cb290 con 0x7f4a9c098ec0 2024-03-12T17:33:45.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.314+0000 7f4a9b200640 1 --2- >> v2:172.21.15.17:3300/0 conn(0x7f4a9c098ec0 0x7f4a9c0b19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:45.309 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.314+0000 7f4a93e00640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f4a9c098a60 0x7f4a9c0b12c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:54756/0 (socket says 172.21.15.17:54756) 2024-03-12T17:33:45.310 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.314+0000 7f4a93e00640 1 -- 172.21.15.17:0/3678217471 learned_addr learned my addr 172.21.15.17:0/3678217471 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:33:45.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.315+0000 7f4a9b200640 1 -- 172.21.15.17:0/3678217471 >> v1:172.21.15.94:6789/0 conn(0x7f4a9c15a940 legacy=0x7f4a9c0ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:45.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.315+0000 7f4a9b200640 1 -- 172.21.15.17:0/3678217471 >> v1:172.21.15.17:6789/0 conn(0x7f4a9c098a60 legacy=0x7f4a9c0b12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:45.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.315+0000 7f4a9b200640 1 -- 172.21.15.17:0/3678217471 --> v2:172.21.15.17:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a9c0cb4a0 con 0x7f4a9c098ec0 2024-03-12T17:33:45.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.316+0000 7f4a9b200640 1 --2- 172.21.15.17:0/3678217471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a9c098ec0 0x7f4a9c0b19d0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f4a94009d90 tx=0x7f4a9402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5abbe86be241d6e3 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:45.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.316+0000 7f4a99e00640 1 -- 172.21.15.17:0/3678217471 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9402cc60 con 0x7f4a9c098ec0 2024-03-12T17:33:45.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.316+0000 7f4a99e00640 1 -- 172.21.15.17:0/3678217471 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a9402cdc0 con 0x7f4a9c098ec0 2024-03-12T17:33:45.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.316+0000 7f4a99e00640 1 -- 172.21.15.17:0/3678217471 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a94034660 con 0x7f4a9c098ec0 2024-03-12T17:33:45.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.317+0000 7f4aa0a00640 1 -- 172.21.15.17:0/3678217471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a9c098ec0 msgr2=0x7f4a9c0b19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:45.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.317+0000 7f4aa0a00640 1 --2- 172.21.15.17:0/3678217471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a9c098ec0 0x7f4a9c0b19d0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f4a94009d90 tx=0x7f4a9402beb0 comp rx=0 tx=0).stop 2024-03-12T17:33:45.312 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.317+0000 7f4aa0a00640 1 -- 172.21.15.17:0/3678217471 shutdown_connections 2024-03-12T17:33:45.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.317+0000 7f4aa0a00640 1 --2- 172.21.15.17:0/3678217471 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a9c098ec0 0x7f4a9c0b19d0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:45.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.317+0000 7f4aa0a00640 1 -- 172.21.15.17:0/3678217471 >> 172.21.15.17:0/3678217471 conn(0x7f4a9c0b2190 msgr2=0x7f4a9c0b25a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:45.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.317+0000 7f4aa0a00640 1 -- 172.21.15.17:0/3678217471 shutdown_connections 2024-03-12T17:33:45.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.317+0000 7f4aa0a00640 1 -- 172.21.15.17:0/3678217471 wait complete. 2024-03-12T17:33:45.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.319+0000 7f4aa0a00640 1 Processor -- start 2024-03-12T17:33:45.313 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.319+0000 7f4aa0a00640 1 -- start start 2024-03-12T17:33:45.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.320+0000 7f4aa0a00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a9c098a60 0x7f4a9c0c4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:45.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.320+0000 7f4aa0a00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a9c098ec0 0x7f4a9c15af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:45.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.320+0000 7f4aa0a00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4a9c15a940 0x7f4a9c155740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:45.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.320+0000 7f4aa0a00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9c1eff50 con 0x7f4a9c098ec0 2024-03-12T17:33:45.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.320+0000 7f4aa0a00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9c0c5dd0 con 0x7f4a9c098a60 2024-03-12T17:33:45.315 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.320+0000 7f4aa0a00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a9c0c51c0 con 0x7f4a9c15a940 2024-03-12T17:33:45.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.320+0000 7f4a93e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a9c098ec0 0x7f4a9c15af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:45.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.320+0000 7f4a93e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a9c098ec0 0x7f4a9c15af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58158/0 (socket says 172.21.15.17:58158) 2024-03-12T17:33:45.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.320+0000 7f4a93e00640 1 -- 172.21.15.17:0/2697097734 learned_addr learned my addr 172.21.15.17:0/2697097734 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:45.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.320+0000 7f4a9a800640 1 --2- 172.21.15.17:0/2697097734 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a9c098a60 0x7f4a9c0c4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:45.316 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.320+0000 7f4a9b200640 1 --2- 172.21.15.17:0/2697097734 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4a9c15a940 0x7f4a9c155740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:45.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.321+0000 7f4a93e00640 1 -- 172.21.15.17:0/2697097734 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4a9c15a940 msgr2=0x7f4a9c155740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:45.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.321+0000 7f4a93e00640 1 --2- 172.21.15.17:0/2697097734 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4a9c15a940 0x7f4a9c155740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:45.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.321+0000 7f4a93e00640 1 -- 172.21.15.17:0/2697097734 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a9c098a60 msgr2=0x7f4a9c0c4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:45.317 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.321+0000 7f4a93e00640 1 --2- 172.21.15.17:0/2697097734 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a9c098a60 0x7f4a9c0c4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:45.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.321+0000 7f4a93e00640 1 -- 172.21.15.17:0/2697097734 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a94009a70 con 0x7f4a9c098ec0 2024-03-12T17:33:45.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.321+0000 7f4a9b200640 1 --2- 172.21.15.17:0/2697097734 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4a9c15a940 0x7f4a9c155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T17:33:45.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.321+0000 7f4a93e00640 1 --2- 172.21.15.17:0/2697097734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a9c098ec0 0x7f4a9c15af10 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f4a8400c480 tx=0x7f4a8400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:45.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.321+0000 7f4a92a00640 1 -- 172.21.15.17:0/2697097734 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a84005ce0 con 0x7f4a9c098ec0 2024-03-12T17:33:45.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.321+0000 7f4a92a00640 1 -- 172.21.15.17:0/2697097734 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a84005e40 con 0x7f4a9c098ec0 2024-03-12T17:33:45.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.321+0000 7f4a92a00640 1 -- 172.21.15.17:0/2697097734 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a840072f0 con 0x7f4a9c098ec0 2024-03-12T17:33:45.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.321+0000 7f4aa0a00640 1 -- 172.21.15.17:0/2697097734 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a9c0c54a0 con 0x7f4a9c098ec0 2024-03-12T17:33:45.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.322+0000 7f4aa0a00640 1 -- 172.21.15.17:0/2697097734 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a9c0c5a60 con 0x7f4a9c098ec0 2024-03-12T17:33:45.318 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.323+0000 7f4aa0a00640 1 -- 172.21.15.17:0/2697097734 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a9c0c5f40 con 0x7f4a9c098ec0 2024-03-12T17:33:45.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.323+0000 7f4a92a00640 1 -- 172.21.15.17:0/2697097734 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f4a84007510 con 0x7f4a9c098ec0 2024-03-12T17:33:45.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.324+0000 7f4a92a00640 1 --2- 172.21.15.17:0/2697097734 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f4a7806ac00 0x7f4a7806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:45.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.324+0000 7f4a92a00640 1 -- 172.21.15.17:0/2697097734 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4a840885c0 con 0x7f4a9c098ec0 2024-03-12T17:33:45.319 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.325+0000 7f4a9a800640 1 --2- 172.21.15.17:0/2697097734 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f4a7806ac00 0x7f4a7806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:45.320 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.325+0000 7f4a9a800640 1 --2- 172.21.15.17:0/2697097734 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f4a7806ac00 0x7f4a7806d0c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c159f60 tx=0x7f4a8c007e30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:45.323 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.329+0000 7f4a92a00640 1 -- 172.21.15.17:0/2697097734 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f4a84053b40 con 0x7f4a9c098ec0 2024-03-12T17:33:45.521 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.526+0000 7f4aa0a00640 1 -- 172.21.15.17:0/2697097734 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f4a9c04e030 con 0x7f4a9c098ec0 2024-03-12T17:33:45.530 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.535+0000 7f4a92a00640 1 -- 172.21.15.17:0/2697097734 <== mon.0 v2:172.21.15.17:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4a84001160 con 0x7f4a9c098ec0 2024-03-12T17:33:45.531 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.536+0000 7f4a92a00640 1 -- 172.21.15.17:0/2697097734 <== mon.0 v2:172.21.15.17:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v14)=0 v14) v1 ==== 123+0+0 (secure 0 0 0) 0x7f4a840170c0 con 0x7f4a9c098ec0 2024-03-12T17:33:45.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.539+0000 7f4aa0a00640 1 -- 172.21.15.17:0/2697097734 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f4a7806ac00 msgr2=0x7f4a7806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:45.534 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.539+0000 7f4aa0a00640 1 --2- 172.21.15.17:0/2697097734 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f4a7806ac00 0x7f4a7806d0c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4a9c159f60 tx=0x7f4a8c007e30 comp rx=0 tx=0).stop 2024-03-12T17:33:45.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.539+0000 7f4aa0a00640 1 -- 172.21.15.17:0/2697097734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a9c098ec0 msgr2=0x7f4a9c15af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:45.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.539+0000 7f4aa0a00640 1 --2- 172.21.15.17:0/2697097734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a9c098ec0 0x7f4a9c15af10 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f4a8400c480 tx=0x7f4a8400c940 comp rx=0 tx=0).stop 2024-03-12T17:33:45.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.539+0000 7f4aa0a00640 1 -- 172.21.15.17:0/2697097734 shutdown_connections 2024-03-12T17:33:45.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.539+0000 7f4aa0a00640 1 --2- 172.21.15.17:0/2697097734 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f4a7806ac00 0x7f4a7806d0c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:45.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.539+0000 7f4aa0a00640 1 --2- 172.21.15.17:0/2697097734 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f4a9c15a940 0x7f4a9c155740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:45.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.539+0000 7f4aa0a00640 1 --2- 172.21.15.17:0/2697097734 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f4a9c098ec0 0x7f4a9c15af10 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:45.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.539+0000 7f4aa0a00640 1 --2- 172.21.15.17:0/2697097734 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f4a9c098a60 0x7f4a9c0c4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:45.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.539+0000 7f4aa0a00640 1 -- 172.21.15.17:0/2697097734 >> 172.21.15.17:0/2697097734 conn(0x7f4a9c0b2190 msgr2=0x7f4a9c0b2570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:45.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.540+0000 7f4aa0a00640 1 -- 172.21.15.17:0/2697097734 shutdown_connections 2024-03-12T17:33:45.535 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.540+0000 7f4aa0a00640 1 -- 172.21.15.17:0/2697097734 wait complete. 2024-03-12T17:33:45.554 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-12T17:33:45.554 DEBUG:teuthology.orchestra.run.smithi017:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-12T17:33:45.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.825+0000 7f7690e00640 1 Processor -- start 2024-03-12T17:33:45.820 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.825+0000 7f7690e00640 1 -- start start 2024-03-12T17:33:45.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.827+0000 7f7690e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f768c0b2070 0x7f768c0b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:45.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.827+0000 7f7690e00640 1 -- --> v1:172.21.15.17:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f768c0ce320 con 0x7f768c0cb970 2024-03-12T17:33:45.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.827+0000 7f7690e00640 1 -- --> v1:172.21.15.94:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f768c144620 con 0x7f768c144240 2024-03-12T17:33:45.822 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.827+0000 7f7690e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f768c15f3d0 con 0x7f768c0b2070 2024-03-12T17:33:45.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.827+0000 7f768a800640 1 --1- >> v1:172.21.15.17:6789/0 conn(0x7f768c0cb970 0x7f768c15e670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.17:6789/0 says I am v1:172.21.15.17:54772/0 (socket says 172.21.15.17:54772) 2024-03-12T17:33:45.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.827+0000 7f768a800640 1 -- 172.21.15.17:0/4003018176 learned_addr learned my addr 172.21.15.17:0/4003018176 (peer_addr_for_me v1:172.21.15.17:0/0) 2024-03-12T17:33:45.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.827+0000 7f7689400640 1 --2- 172.21.15.17:0/4003018176 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f768c0b2070 0x7f768c0b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:45.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.828+0000 7f7688a00640 1 -- 172.21.15.17:0/4003018176 <== mon.0 v1:172.21.15.17:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1926408528 0 0) 0x7f768c0ce320 con 0x7f768c0cb970 2024-03-12T17:33:45.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.828+0000 7f7688a00640 1 -- 172.21.15.17:0/4003018176 --> v1:172.21.15.17:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7670003520 con 0x7f768c0cb970 2024-03-12T17:33:45.824 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.828+0000 7f7688a00640 1 -- 172.21.15.17:0/4003018176 <== mon.0 v1:172.21.15.17:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1757546068 0 0) 0x7f7670003520 con 0x7f768c0cb970 2024-03-12T17:33:45.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.828+0000 7f7688a00640 1 -- 172.21.15.17:0/4003018176 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f768c0b2070 msgr2=0x7f768c0b24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:45.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.828+0000 7f7688a00640 1 --2- 172.21.15.17:0/4003018176 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f768c0b2070 0x7f768c0b24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:45.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.828+0000 7f7688a00640 1 -- 172.21.15.17:0/4003018176 >> v1:172.21.15.94:6789/0 conn(0x7f768c144240 legacy=0x7f768c0ce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:45.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.828+0000 7f7688a00640 1 -- 172.21.15.17:0/4003018176 --> v1:172.21.15.17:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768c0cd9f0 con 0x7f768c0cb970 2024-03-12T17:33:45.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.828+0000 7f7688a00640 1 -- 172.21.15.17:0/4003018176 <== mon.0 v1:172.21.15.17:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1302388533 0 0) 0x7f76840019f0 con 0x7f768c0cb970 2024-03-12T17:33:45.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.828+0000 7f7688a00640 1 -- 172.21.15.17:0/4003018176 >> v1:172.21.15.17:6789/0 conn(0x7f768c0cb970 legacy=0x7f768c15e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:45.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.828+0000 7f7688a00640 1 --2- 172.21.15.17:0/4003018176 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f768c0b2070 0x7f76700039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:45.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.828+0000 7f7688a00640 1 --2- 172.21.15.17:0/4003018176 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7670003f20 0x7f76700047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:45.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.828+0000 7f7688a00640 1 --2- 172.21.15.17:0/4003018176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7670004d00 0x7f7670005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:45.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.828+0000 7f7688a00640 1 -- 172.21.15.17:0/4003018176 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768c15f3d0 con 0x7f7670004d00 2024-03-12T17:33:45.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.828+0000 7f7688a00640 1 -- 172.21.15.17:0/4003018176 --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767000ba60 con 0x7f7670003f20 2024-03-12T17:33:45.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.828+0000 7f7688a00640 1 -- 172.21.15.17:0/4003018176 --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f767000bc20 con 0x7f768c0b2070 2024-03-12T17:33:45.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.829+0000 7f768a800640 1 --2- 172.21.15.17:0/4003018176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7670004d00 0x7f7670005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:45.825 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.829+0000 7f7689400640 1 --2- 172.21.15.17:0/4003018176 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7670003f20 0x7f76700047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:45.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.829+0000 7f7689e00640 1 --2- 172.21.15.17:0/4003018176 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f768c0b2070 0x7f76700039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:45.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.829+0000 7f768a800640 1 -- 172.21.15.17:0/4003018176 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f768c0b2070 msgr2=0x7f76700039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:45.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.829+0000 7f768a800640 1 --2- 172.21.15.17:0/4003018176 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f768c0b2070 0x7f76700039a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:45.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.829+0000 7f768a800640 1 -- 172.21.15.17:0/4003018176 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7670003f20 msgr2=0x7f76700047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-12T17:33:45.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.829+0000 7f768a800640 1 --2- 172.21.15.17:0/4003018176 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f7670003f20 0x7f76700047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:45.826 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.829+0000 7f768a800640 1 -- 172.21.15.17:0/4003018176 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7670003520 con 0x7f7670004d00 2024-03-12T17:33:45.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.830+0000 7f768a800640 1 --2- 172.21.15.17:0/4003018176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7670004d00 0x7f7670005180 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f768400a830 tx=0x7f76700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a49f30470bbe96b server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:45.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.830+0000 7f7688a00640 1 -- 172.21.15.17:0/4003018176 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76840072d0 con 0x7f7670004d00 2024-03-12T17:33:45.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.830+0000 7f7688a00640 1 -- 172.21.15.17:0/4003018176 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f768402f070 con 0x7f7670004d00 2024-03-12T17:33:45.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.830+0000 7f7688a00640 1 -- 172.21.15.17:0/4003018176 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7684007710 con 0x7f7670004d00 2024-03-12T17:33:45.827 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.831+0000 7f7690e00640 1 -- 172.21.15.17:0/4003018176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7670004d00 msgr2=0x7f7670005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:45.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.831+0000 7f7690e00640 1 --2- 172.21.15.17:0/4003018176 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7670004d00 0x7f7670005180 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f768400a830 tx=0x7f76700057f0 comp rx=0 tx=0).stop 2024-03-12T17:33:45.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.831+0000 7f768a800640 1 -- 172.21.15.17:0/4003018176 reap_dead start 2024-03-12T17:33:45.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.831+0000 7f7690e00640 1 -- 172.21.15.17:0/4003018176 shutdown_connections 2024-03-12T17:33:45.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.831+0000 7f7690e00640 1 -- 172.21.15.17:0/4003018176 >> 172.21.15.17:0/4003018176 conn(0x7f768c069ce0 msgr2=0x7f768c06a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:45.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.831+0000 7f7690e00640 1 -- 172.21.15.17:0/4003018176 shutdown_connections 2024-03-12T17:33:45.828 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.831+0000 7f7690e00640 1 -- 172.21.15.17:0/4003018176 wait complete. 2024-03-12T17:33:45.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.833+0000 7f7690e00640 1 Processor -- start 2024-03-12T17:33:45.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.833+0000 7f7690e00640 1 -- start start 2024-03-12T17:33:45.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.834+0000 7f7690e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7670004d00 0x7f768c13b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:45.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.834+0000 7f7690e00640 1 --2- >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f768c13bac0 0x7f768c0adf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:45.829 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.834+0000 7f7690e00640 1 --2- >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f768c0ae460 0x7f768c14df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:45.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.834+0000 7f7690e00640 1 -- --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768c1410b0 con 0x7f7670004d00 2024-03-12T17:33:45.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.834+0000 7f7690e00640 1 -- --> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768c1404a0 con 0x7f768c0ae460 2024-03-12T17:33:45.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.834+0000 7f7690e00640 1 -- --> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f768c140710 con 0x7f768c13bac0 2024-03-12T17:33:45.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.834+0000 7f7689e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7670004d00 0x7f768c13b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:45.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.834+0000 7f7689e00640 1 --2- >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7670004d00 0x7f768c13b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.17:3300/0 says I am v2:172.21.15.17:58176/0 (socket says 172.21.15.17:58176) 2024-03-12T17:33:45.830 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.834+0000 7f7689e00640 1 -- 172.21.15.17:0/681602044 learned_addr learned my addr 172.21.15.17:0/681602044 (peer_addr_for_me v2:172.21.15.17:0/0) 2024-03-12T17:33:45.831 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.835+0000 7f7689400640 1 --2- 172.21.15.17:0/681602044 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f768c13bac0 0x7f768c0adf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:45.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.835+0000 7f7689e00640 1 -- 172.21.15.17:0/681602044 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f768c13bac0 msgr2=0x7f768c0adf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:45.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.835+0000 7f7689e00640 1 --2- 172.21.15.17:0/681602044 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f768c13bac0 0x7f768c0adf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:45.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.835+0000 7f768a800640 1 --2- 172.21.15.17:0/681602044 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f768c0ae460 0x7f768c14df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:45.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.835+0000 7f7689e00640 1 -- 172.21.15.17:0/681602044 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f768c0ae460 msgr2=0x7f768c14df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:45.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.835+0000 7f7689e00640 1 --2- 172.21.15.17:0/681602044 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f768c0ae460 0x7f768c14df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:45.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.835+0000 7f7689e00640 1 -- 172.21.15.17:0/681602044 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768c1409f0 con 0x7f7670004d00 2024-03-12T17:33:45.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.835+0000 7f7689e00640 1 --2- 172.21.15.17:0/681602044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7670004d00 0x7f768c13b580 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f767c00d5a0 tx=0x7f767c00da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:45.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.835+0000 7f7682000640 1 -- 172.21.15.17:0/681602044 <== mon.0 v2:172.21.15.17:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c005480 con 0x7f7670004d00 2024-03-12T17:33:45.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.835+0000 7f7682000640 1 -- 172.21.15.17:0/681602044 <== mon.0 v2:172.21.15.17:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f767c003610 con 0x7f7670004d00 2024-03-12T17:33:45.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.835+0000 7f7682000640 1 -- 172.21.15.17:0/681602044 <== mon.0 v2:172.21.15.17:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c0039a0 con 0x7f7670004d00 2024-03-12T17:33:45.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.835+0000 7f7690e00640 1 -- 172.21.15.17:0/681602044 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f768c140cd0 con 0x7f7670004d00 2024-03-12T17:33:45.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.836+0000 7f7690e00640 1 -- 172.21.15.17:0/681602044 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f768c15a1e0 con 0x7f7670004d00 2024-03-12T17:33:45.832 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.837+0000 7f7690e00640 1 -- 172.21.15.17:0/681602044 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f768c06e400 con 0x7f7670004d00 2024-03-12T17:33:45.833 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.838+0000 7f7682000640 1 -- 172.21.15.17:0/681602044 <== mon.0 v2:172.21.15.17:3300/0 4 ==== mgrmap(e 5) v1 ==== 89137+0+0 (secure 0 0 0) 0x7f767c003b00 con 0x7f7670004d00 2024-03-12T17:33:45.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.839+0000 7f7682000640 1 --2- 172.21.15.17:0/681602044 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f766c06ac00 0x7f766c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-12T17:33:45.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.839+0000 7f7682000640 1 -- 172.21.15.17:0/681602044 <== mon.0 v2:172.21.15.17:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f767c089090 con 0x7f7670004d00 2024-03-12T17:33:45.834 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.839+0000 7f7689400640 1 --2- 172.21.15.17:0/681602044 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f766c06ac00 0x7f766c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T17:33:45.835 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.840+0000 7f7689400640 1 --2- 172.21.15.17:0/681602044 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f766c06ac00 0x7f766c06d0c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7678009950 tx=0x7f7678008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T17:33:45.838 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:45.844+0000 7f7682000640 1 -- 172.21.15.17:0/681602044 <== mon.0 v2:172.21.15.17:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181471 (secure 0 0 0) 0x7f767c054440 con 0x7f7670004d00 2024-03-12T17:33:46.075 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:46.080+0000 7f7690e00640 1 -- 172.21.15.17:0/681602044 --> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f768c0736c0 con 0x7f7670004d00 2024-03-12T17:33:46.076 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:46.081+0000 7f7682000640 1 -- 172.21.15.17:0/681602044 <== mon.0 v2:172.21.15.17:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f767c001230 con 0x7f7670004d00 2024-03-12T17:33:46.076 INFO:teuthology.orchestra.run.smithi017.stdout: 2024-03-12T17:33:46.076 INFO:teuthology.orchestra.run.smithi017.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4808,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6834/3175855266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6832","nonce":3175855266},{"type":"v1","addr":"172.21.15.94:6834","nonce":3175855266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":4927,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6835/1725537585","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6834","nonce":1725537585},{"type":"v1","addr":"172.21.15.17:6835","nonce":1725537585}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":4939,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.94:6835/630541950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.94:6833","nonce":630541950},{"type":"v1","addr":"172.21.15.94:6835","nonce":630541950}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":5724,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.17:6837/4042645247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.17:6836","nonce":4042645247},{"type":"v1","addr":"172.21.15.17:6837","nonce":4042645247}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[]} 2024-03-12T17:33:46.077 INFO:teuthology.orchestra.run.smithi017.stderr:dumped fsmap epoch 24 2024-03-12T17:33:46.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:46.084+0000 7f7690e00640 1 -- 172.21.15.17:0/681602044 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f766c06ac00 msgr2=0x7f766c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:46.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:46.084+0000 7f7690e00640 1 --2- 172.21.15.17:0/681602044 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f766c06ac00 0x7f766c06d0c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7678009950 tx=0x7f7678008040 comp rx=0 tx=0).stop 2024-03-12T17:33:46.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:46.084+0000 7f7690e00640 1 -- 172.21.15.17:0/681602044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7670004d00 msgr2=0x7f768c13b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T17:33:46.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:46.084+0000 7f7690e00640 1 --2- 172.21.15.17:0/681602044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7670004d00 0x7f768c13b580 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f767c00d5a0 tx=0x7f767c00da60 comp rx=0 tx=0).stop 2024-03-12T17:33:46.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:46.084+0000 7f7690e00640 1 -- 172.21.15.17:0/681602044 shutdown_connections 2024-03-12T17:33:46.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:46.084+0000 7f7690e00640 1 --2- 172.21.15.17:0/681602044 >> [v2:172.21.15.17:6832/37052,v1:172.21.15.17:6833/37052] conn(0x7f766c06ac00 0x7f766c06d0c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:46.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:46.084+0000 7f7690e00640 1 --2- 172.21.15.17:0/681602044 >> [v2:172.21.15.94:3300/0,v1:172.21.15.94:6789/0] conn(0x7f768c0ae460 0x7f768c14df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:46.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:46.084+0000 7f7690e00640 1 --2- 172.21.15.17:0/681602044 >> [v2:172.21.15.94:3301/0,v1:172.21.15.94:6790/0] conn(0x7f768c13bac0 0x7f768c0adf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:46.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:46.084+0000 7f7690e00640 1 --2- 172.21.15.17:0/681602044 >> [v2:172.21.15.17:3300/0,v1:172.21.15.17:6789/0] conn(0x7f7670004d00 0x7f768c13b580 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-12T17:33:46.079 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:46.084+0000 7f7690e00640 1 -- 172.21.15.17:0/681602044 >> 172.21.15.17:0/681602044 conn(0x7f768c069ce0 msgr2=0x7f768c1426b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T17:33:46.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:46.084+0000 7f7690e00640 1 -- 172.21.15.17:0/681602044 shutdown_connections 2024-03-12T17:33:46.080 INFO:teuthology.orchestra.run.smithi017.stderr:2024-03-12T17:33:46.084+0000 7f7690e00640 1 -- 172.21.15.17:0/681602044 wait complete. 2024-03-12T17:33:46.097 DEBUG:tasks.cephfs.filesystem:already dead... 2024-03-12T17:33:46.098 INFO:teuthology.misc:Shutting down mds daemons... 2024-03-12T17:33:46.098 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-12T17:33:46.098 INFO:teuthology.orchestra.run:waiting for 300 2024-03-12T17:33:46.121 INFO:tasks.ceph.mds.a:Stopped 2024-03-12T17:33:46.121 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-12T17:33:46.122 INFO:teuthology.orchestra.run:waiting for 300 2024-03-12T17:33:46.185 INFO:tasks.ceph.mds.c:Stopped 2024-03-12T17:33:46.186 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-12T17:33:46.186 INFO:teuthology.orchestra.run:waiting for 300 2024-03-12T17:33:46.213 INFO:tasks.ceph.mds.b:Stopped 2024-03-12T17:33:46.213 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-12T17:33:46.214 INFO:teuthology.orchestra.run:waiting for 300 2024-03-12T17:33:46.277 INFO:tasks.ceph.mds.d:Stopped 2024-03-12T17:33:46.277 INFO:teuthology.misc:Shutting down osd daemons... 2024-03-12T17:33:46.277 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-03-12T17:33:46.277 INFO:teuthology.orchestra.run:waiting for 300 2024-03-12T17:33:46.336 INFO:tasks.ceph.osd.0:Stopped 2024-03-12T17:33:46.336 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-03-12T17:33:46.336 INFO:teuthology.orchestra.run:waiting for 300 2024-03-12T17:33:46.399 INFO:tasks.ceph.osd.1:Stopped 2024-03-12T17:33:46.400 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-03-12T17:33:46.400 INFO:teuthology.orchestra.run:waiting for 300 2024-03-12T17:33:46.463 INFO:tasks.ceph.osd.2:Stopped 2024-03-12T17:33:46.463 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-03-12T17:33:46.463 INFO:teuthology.orchestra.run:waiting for 300 2024-03-12T17:33:46.513 INFO:tasks.ceph.osd.3:Stopped 2024-03-12T17:33:46.513 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-03-12T17:33:46.513 INFO:teuthology.orchestra.run:waiting for 300 2024-03-12T17:33:46.591 INFO:tasks.ceph.osd.4:Stopped 2024-03-12T17:33:46.591 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-03-12T17:33:46.591 INFO:teuthology.orchestra.run:waiting for 300 2024-03-12T17:33:46.636 INFO:tasks.ceph.osd.5:Stopped 2024-03-12T17:33:46.636 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-03-12T17:33:46.636 INFO:teuthology.orchestra.run:waiting for 300 2024-03-12T17:33:46.698 INFO:tasks.ceph.osd.6:Stopped 2024-03-12T17:33:46.698 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-03-12T17:33:46.698 INFO:teuthology.orchestra.run:waiting for 300 2024-03-12T17:33:46.739 INFO:tasks.ceph.osd.7:Stopped 2024-03-12T17:33:46.740 INFO:teuthology.misc:Shutting down mgr daemons... 2024-03-12T17:33:46.740 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-03-12T17:33:46.740 INFO:teuthology.orchestra.run:waiting for 300 2024-03-12T17:33:46.827 INFO:tasks.ceph.mgr.y:Stopped 2024-03-12T17:33:46.827 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-03-12T17:33:46.827 INFO:teuthology.orchestra.run:waiting for 300 2024-03-12T17:33:46.907 INFO:tasks.ceph.mgr.x:Stopped 2024-03-12T17:33:46.908 INFO:teuthology.misc:Shutting down mon daemons... 2024-03-12T17:33:46.908 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-12T17:33:46.908 INFO:teuthology.orchestra.run:waiting for 300 2024-03-12T17:33:46.946 INFO:tasks.ceph.mon.a:Stopped 2024-03-12T17:33:46.946 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-12T17:33:46.946 INFO:teuthology.orchestra.run:waiting for 300 2024-03-12T17:33:46.971 INFO:tasks.ceph.mon.b:Stopped 2024-03-12T17:33:46.971 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-12T17:33:46.971 INFO:teuthology.orchestra.run:waiting for 300 2024-03-12T17:33:47.041 INFO:tasks.ceph.mon.c:Stopped 2024-03-12T17:33:47.041 INFO:tasks.ceph:Checking cluster log for badness... 2024-03-12T17:33:47.042 DEBUG:teuthology.orchestra.run.smithi017:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-03-12T17:33:47.149 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi017.front.sepia.ceph.com 2024-03-12T17:33:47.149 DEBUG:teuthology.orchestra.run.smithi017:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-03-12T17:33:47.394 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi017.front.sepia.ceph.com 2024-03-12T17:33:47.395 DEBUG:teuthology.orchestra.run.smithi017:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-03-12T17:33:47.572 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi017.front.sepia.ceph.com 2024-03-12T17:33:47.572 DEBUG:teuthology.orchestra.run.smithi017:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-03-12T17:33:47.716 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi017.front.sepia.ceph.com 2024-03-12T17:33:47.717 DEBUG:teuthology.orchestra.run.smithi017:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-03-12T17:33:47.920 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi094.front.sepia.ceph.com 2024-03-12T17:33:47.920 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-03-12T17:33:48.228 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi094.front.sepia.ceph.com 2024-03-12T17:33:48.229 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-03-12T17:33:48.374 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi094.front.sepia.ceph.com 2024-03-12T17:33:48.374 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-03-12T17:33:48.534 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi094.front.sepia.ceph.com 2024-03-12T17:33:48.534 DEBUG:teuthology.orchestra.run.smithi094:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-03-12T17:33:48.694 INFO:tasks.ceph:Archiving mon data... 2024-03-12T17:33:48.695 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2024-03-12_14:59:27-fs-wip-yuri11-testing-2024-03-11-0838-reef-distro-default-smithi/7593742/data/mon.a.tgz 2024-03-12T17:33:48.696 DEBUG:teuthology.orchestra.run.smithi017:> mktemp 2024-03-12T17:33:48.755 INFO:teuthology.orchestra.run.smithi017.stdout:/tmp/tmp.EbA9z4SN1G 2024-03-12T17:33:48.755 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.EbA9z4SN1G 2024-03-12T17:33:48.931 DEBUG:teuthology.orchestra.run.smithi017:> sudo chmod 0666 /tmp/tmp.EbA9z4SN1G 2024-03-12T17:33:49.081 DEBUG:teuthology.orchestra.remote:smithi017:/tmp/tmp.EbA9z4SN1G is 234KB 2024-03-12T17:33:49.192 DEBUG:teuthology.orchestra.run.smithi017:> rm -fr /tmp/tmp.EbA9z4SN1G 2024-03-12T17:33:49.251 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2024-03-12_14:59:27-fs-wip-yuri11-testing-2024-03-11-0838-reef-distro-default-smithi/7593742/data/mon.b.tgz 2024-03-12T17:33:49.251 DEBUG:teuthology.orchestra.run.smithi094:> mktemp 2024-03-12T17:33:49.308 INFO:teuthology.orchestra.run.smithi094.stdout:/tmp/tmp.aMOgkesOxy 2024-03-12T17:33:49.309 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.aMOgkesOxy 2024-03-12T17:33:49.470 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0666 /tmp/tmp.aMOgkesOxy 2024-03-12T17:33:49.596 DEBUG:teuthology.orchestra.remote:smithi094:/tmp/tmp.aMOgkesOxy is 236KB 2024-03-12T17:33:49.701 DEBUG:teuthology.orchestra.run.smithi094:> rm -fr /tmp/tmp.aMOgkesOxy 2024-03-12T17:33:49.756 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2024-03-12_14:59:27-fs-wip-yuri11-testing-2024-03-11-0838-reef-distro-default-smithi/7593742/data/mon.c.tgz 2024-03-12T17:33:49.756 DEBUG:teuthology.orchestra.run.smithi094:> mktemp 2024-03-12T17:33:49.850 INFO:teuthology.orchestra.run.smithi094.stdout:/tmp/tmp.jtMFcrM8R9 2024-03-12T17:33:49.851 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.jtMFcrM8R9 2024-03-12T17:33:50.000 DEBUG:teuthology.orchestra.run.smithi094:> sudo chmod 0666 /tmp/tmp.jtMFcrM8R9 2024-03-12T17:33:50.140 DEBUG:teuthology.orchestra.remote:smithi094:/tmp/tmp.jtMFcrM8R9 is 236KB 2024-03-12T17:33:50.247 DEBUG:teuthology.orchestra.run.smithi094:> rm -fr /tmp/tmp.jtMFcrM8R9 2024-03-12T17:33:50.300 INFO:tasks.ceph:Cleaning ceph cluster... 2024-03-12T17:33:50.300 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-12T17:33:50.308 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-12T17:33:50.404 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-03-12T17:33:50.404 DEBUG:teuthology.orchestra.run.smithi017:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-03-12T17:33:50.412 DEBUG:teuthology.orchestra.run.smithi094:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-03-12T17:33:50.508 INFO:teuthology.orchestra.run.smithi017.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-03-12T17:33:50.509 INFO:teuthology.orchestra.run.smithi094.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-03-12T17:33:50.523 INFO:tasks.ceph:Archiving crash dumps... 2024-03-12T17:33:50.525 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-03-12_14:59:27-fs-wip-yuri11-testing-2024-03-11-0838-reef-distro-default-smithi/7593742/remote/smithi017/crash 2024-03-12T17:33:50.526 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-12T17:33:50.601 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-03-12_14:59:27-fs-wip-yuri11-testing-2024-03-11-0838-reef-distro-default-smithi/7593742/remote/smithi094/crash 2024-03-12T17:33:50.602 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-12T17:33:50.696 INFO:tasks.ceph:Shutting down logrotate 2024-03-12T17:33:50.697 DEBUG:teuthology.orchestra.run.smithi017:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:33:50.704 DEBUG:teuthology.orchestra.run.smithi094:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-12T17:33:50.846 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-12T17:33:50.947 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-12T17:33:51.044 INFO:tasks.ceph:Compressing logs... 2024-03-12T17:33:51.044 DEBUG:teuthology.orchestra.run.smithi017:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-12T17:33:51.052 DEBUG:teuthology.orchestra.run.smithi094:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-12T17:33:57.446 INFO:tasks.ceph:Archiving logs... 2024-03-12T17:33:57.446 DEBUG:teuthology.misc:Transferring archived files from smithi017:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-03-12_14:59:27-fs-wip-yuri11-testing-2024-03-11-0838-reef-distro-default-smithi/7593742/remote/smithi017/log 2024-03-12T17:33:57.447 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-12T17:33:58.427 DEBUG:teuthology.misc:Transferring archived files from smithi094:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-03-12_14:59:27-fs-wip-yuri11-testing-2024-03-11-0838-reef-distro-default-smithi/7593742/remote/smithi094/log 2024-03-12T17:33:58.428 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-12T17:33:58.810 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-12T17:33:58.820 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-12T17:33:58.820 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-12T17:33:58.828 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-12T17:33:58.984 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-12T17:33:58.994 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-12T17:33:58.994 DEBUG:teuthology.orchestra.run.smithi017:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-12T17:33:59.002 DEBUG:teuthology.orchestra.run.smithi094:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-12T17:33:59.049 INFO:teuthology.orchestra.run.smithi017.stderr:bash: line 1: ntpq: command not found 2024-03-12T17:33:59.056 INFO:teuthology.orchestra.run.smithi094.stderr:bash: line 1: ntpq: command not found 2024-03-12T17:33:59.060 INFO:teuthology.orchestra.run.smithi017.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-12T17:33:59.060 INFO:teuthology.orchestra.run.smithi017.stdout:=============================================================================== 2024-03-12T17:33:59.060 INFO:teuthology.orchestra.run.smithi017.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 49 +3571us[+3439us] +/- 120ms 2024-03-12T17:33:59.060 INFO:teuthology.orchestra.run.smithi017.stdout:^* hv02.front.sepia.ceph.com 3 6 377 47 -1032us[-1164us] +/- 83ms 2024-03-12T17:33:59.060 INFO:teuthology.orchestra.run.smithi017.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 50 -1148us[-1280us] +/- 63ms 2024-03-12T17:33:59.060 INFO:teuthology.orchestra.run.smithi017.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-03-12T17:33:59.066 INFO:teuthology.orchestra.run.smithi094.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-12T17:33:59.066 INFO:teuthology.orchestra.run.smithi094.stdout:=============================================================================== 2024-03-12T17:33:59.066 INFO:teuthology.orchestra.run.smithi094.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 48 +3486us[+3481us] +/- 120ms 2024-03-12T17:33:59.066 INFO:teuthology.orchestra.run.smithi094.stdout:^* hv02.front.sepia.ceph.com 3 6 377 48 -1151us[-1157us] +/- 83ms 2024-03-12T17:33:59.066 INFO:teuthology.orchestra.run.smithi094.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 47 -1264us[-1264us] +/- 63ms 2024-03-12T17:33:59.066 INFO:teuthology.orchestra.run.smithi094.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-03-12T17:33:59.068 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-12T17:33:59.076 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-12T17:33:59.077 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-12T17:33:59.103 DEBUG:teuthology.orchestra.run.smithi017:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-12T17:33:59.359 DEBUG:teuthology.orchestra.run.smithi094:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-12T17:33:59.564 DEBUG:teuthology.orchestra.run.smithi017:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-12T17:33:59.672 INFO:teuthology.orchestra.run.smithi017.stdout:type=AVC msg=audit(1710263318.066:199): avc: denied { checkpoint_restore } for pid=1206 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1 2024-03-12T17:33:59.674 DEBUG:teuthology.task.selinux:ubuntu@smithi017.front.sepia.ceph.com has 1 denials 2024-03-12T17:33:59.674 DEBUG:teuthology.orchestra.run.smithi094:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-12T17:33:59.774 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-12T17:33:59.774 ERROR:teuthology.run_tasks:Manager failed: selinux Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/__init__.py", line 136, in __exit__ self.teardown() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/selinux.py", line 166, in teardown self.get_new_denials() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/selinux.py", line 215, in get_new_denials raise SELinuxError(node=remote, teuthology.exceptions.SELinuxError: SELinux denials found on ubuntu@smithi017.front.sepia.ceph.com: ['type=AVC msg=audit(1710263318.066:199): avc: denied { checkpoint_restore } for pid=1206 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1'] 2024-03-12T17:33:59.775 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-12T17:33:59.785 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-12T17:33:59.828 INFO:teuthology.task.internal:Duration was 1523.320861 seconds 2024-03-12T17:33:59.829 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-12T17:33:59.862 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-12T17:33:59.862 DEBUG:teuthology.orchestra.run.smithi017:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-12T17:33:59.870 DEBUG:teuthology.orchestra.run.smithi094:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-12T17:34:00.030 INFO:teuthology.orchestra.run.smithi094.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-12T17:34:00.043 INFO:teuthology.orchestra.run.smithi017.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-12T17:34:00.443 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-12T17:34:00.443 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi017.front.sepia.ceph.com 2024-03-12T17:34:00.443 DEBUG:teuthology.orchestra.run.smithi017:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-12T17:34:00.512 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi094.front.sepia.ceph.com 2024-03-12T17:34:00.513 DEBUG:teuthology.orchestra.run.smithi094:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-12T17:34:00.597 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-12T17:34:00.597 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-12T17:34:00.605 DEBUG:teuthology.orchestra.run.smithi094:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-12T17:34:00.703 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-12T17:34:00.704 DEBUG:teuthology.orchestra.run.smithi017:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-12T17:34:00.710 DEBUG:teuthology.orchestra.run.smithi094:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-12T17:34:00.908 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-12T17:34:00.919 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-12T17:34:00.919 DEBUG:teuthology.orchestra.run.smithi017:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-12T17:34:01.015 DEBUG:teuthology.orchestra.run.smithi094:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-12T17:34:01.111 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-12T17:34:01.122 DEBUG:teuthology.orchestra.run.smithi017:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-12T17:34:01.130 DEBUG:teuthology.orchestra.run.smithi094:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-12T17:34:01.238 INFO:teuthology.orchestra.run.smithi017.stdout:kernel.core_pattern = core 2024-03-12T17:34:01.239 INFO:teuthology.orchestra.run.smithi094.stdout:kernel.core_pattern = core 2024-03-12T17:34:01.293 DEBUG:teuthology.orchestra.run.smithi017:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-12T17:34:01.343 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-12T17:34:01.344 DEBUG:teuthology.orchestra.run.smithi094:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-12T17:34:01.396 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-12T17:34:01.396 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-12T17:34:01.407 INFO:teuthology.task.internal:Transferring archived files... 2024-03-12T17:34:01.408 DEBUG:teuthology.misc:Transferring archived files from smithi017:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-03-12_14:59:27-fs-wip-yuri11-testing-2024-03-11-0838-reef-distro-default-smithi/7593742/remote/smithi017 2024-03-12T17:34:01.408 DEBUG:teuthology.orchestra.run.smithi017:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-12T17:34:01.525 DEBUG:teuthology.misc:Transferring archived files from smithi094:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-03-12_14:59:27-fs-wip-yuri11-testing-2024-03-11-0838-reef-distro-default-smithi/7593742/remote/smithi094 2024-03-12T17:34:01.525 DEBUG:teuthology.orchestra.run.smithi094:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-12T17:34:01.630 INFO:teuthology.task.internal:Removing archive directory... 2024-03-12T17:34:01.631 DEBUG:teuthology.orchestra.run.smithi017:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-12T17:34:01.639 DEBUG:teuthology.orchestra.run.smithi094:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-12T17:34:01.696 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-12T17:34:01.707 INFO:teuthology.task.internal:Not uploading archives. 2024-03-12T17:34:01.707 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-12T17:34:01.824 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-12T17:34:01.824 DEBUG:teuthology.orchestra.run.smithi017:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-12T17:34:01.832 DEBUG:teuthology.orchestra.run.smithi094:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-12T17:34:01.884 INFO:teuthology.orchestra.run.smithi017.stdout: 395195 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 12 17:34 /home/ubuntu/cephtest 2024-03-12T17:34:01.889 INFO:teuthology.orchestra.run.smithi094.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 12 17:34 /home/ubuntu/cephtest 2024-03-12T17:34:01.892 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-12T17:34:01.903 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-12T17:34:01.930 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: SELinuxError: SELinux denials found on ubuntu@smithi017.front.sepia.ceph.com: ['type=AVC msg=audit(1710263318.066:199): avc: denied { checkpoint_restore } for pid=1206 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1'] 2024-03-12T17:34:01.931 INFO:teuthology.nuke:Checking targets against current locks 2024-03-12T17:34:01.957 DEBUG:teuthology.nuke:shortname: smithi017 2024-03-12T17:34:01.957 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-12T17:34:01.979 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi017.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-03-12_14:59:27-fs-wip-yuri11-testing-2024-03-11-0838-reef-distro-default-smithi/7593742', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-12 16:58:49.804604', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBqlMRN7UkesTbPmmEl/Fu33YbcUUW+S7CaISm4Tqk3pP+0ezaEyT2I38Sgxt1DP2LZik+P22JmtaEtvCRScUkA='} 2024-03-12T17:34:01.983 DEBUG:teuthology.nuke:shortname: smithi094 2024-03-12T17:34:01.983 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-12T17:34:02.006 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi094.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-03-12_14:59:27-fs-wip-yuri11-testing-2024-03-11-0838-reef-distro-default-smithi/7593742', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-12 16:58:49.805969', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMeHIyWbUAqn+IYD1RDvRs+UR8VUiDaQcRsg7RqsboRUENvrnVUDMtNdw0d+m4rETIWEK58NMqv8ka9jMdfQbZY='} 2024-03-12T17:34:02.032 INFO:teuthology.orchestra.console.smithi017:Power off 2024-03-12T17:34:02.032 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-12T17:34:02.056 DEBUG:teuthology.orchestra.console.smithi017:power off output: Chassis Power Control: Down/Off 2024-03-12T17:34:02.056 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-12T17:34:02.071 INFO:teuthology.orchestra.console.smithi094:Power off 2024-03-12T17:34:02.072 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-12T17:34:02.079 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2024-03-12T17:34:02.093 DEBUG:teuthology.orchestra.console.smithi094:power off output: Chassis Power Control: Down/Off 2024-03-12T17:34:02.093 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-12T17:34:02.116 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on 2024-03-12T17:34:06.081 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-12T17:34:06.117 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-12T17:34:06.191 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is on 2024-03-12T17:34:06.226 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is on 2024-03-12T17:34:10.195 DEBUG:teuthology.orchestra.console.smithi017:pexpect command: ipmitool -H smithi017.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-12T17:34:10.227 DEBUG:teuthology.orchestra.console.smithi094:pexpect command: ipmitool -H smithi094.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-12T17:34:10.305 DEBUG:teuthology.orchestra.console.smithi017:check power output: Chassis Power is off 2024-03-12T17:34:10.337 DEBUG:teuthology.orchestra.console.smithi094:check power output: Chassis Power is off 2024-03-12T17:34:10.407 INFO:teuthology.orchestra.console.smithi017:Power off completed 2024-03-12T17:34:10.438 INFO:teuthology.orchestra.console.smithi094:Power off completed 2024-03-12T17:34:10.544 INFO:teuthology.run:Summary data: client.0-kernel-sha1: bf761b6efc7e0ff8090671a5bd7700e429806836 client.1-kernel-sha1: bf761b6efc7e0ff8090671a5bd7700e429806836 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v1 tasks/asok_dump_tree} duration: 1523.320860862732 failure_reason: 'SELinux denials found on ubuntu@smithi017.front.sepia.ceph.com: [''type=AVC msg=audit(1710263318.066:199): avc: denied { checkpoint_restore } for pid=1206 comm="agetty" capability=40 scontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tcontext=system_u:system_r:getty_t:s0-s0:c0.c1023 tclass=capability2 permissive=1'']' flavor: default owner: scheduled_yuriw@teuthology status: fail success: false 2024-03-12T17:34:10.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-12T17:34:10.625 INFO:teuthology.run:FAIL